2024-09-19T04:10:16.682 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T04:10:16.710 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T04:10:16.799 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631 branch: squid description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/norstats}} email: ceph-qa@ceph.com first_in_suite: false job_id: '7911631' kernel: kdb: 1 sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: cephfs: max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true mds_bal_replicate_threshold: 1 mds_export_ephemeral_random_max: 0.1 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - online, but wants - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - min: 3 name: mds_cache.dir_update - min: 3 name: mds_cache.dir_update_receipt - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 kclient: client.0: mount_subvol_num: 1 rbytes: false selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 1747 sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 sleep_before_teardown: 0 subset: 176/512 suite: fs suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 6fad5dd73c93545e52f57f681e140a9c3529c11e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi070.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/P2i5XMBBD38U/+eDOvu+spnDEGreHrv5jZL6OUBKfNqV5KiMuAJKyQQELRBmFJfRAc4afM6Zd2ZU2VwJlf8w= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOz9CNoJSucj5ffm6OCESk/1t2V56ojjFD2XnZFhLq6P+2BKrrUH8kM1YlnTehoUPjGiuGS9A/B9reISycvjIvQ= smithi167.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBComJTz+njxAWNT9s8DvWyhe4JofNkGX2NZR7ED9FkebrNgcavTUEyEE1fJh5JCNREBSR98G60RDi1Ii03i1DM0= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - ceph-fuse: null - exec: mon.a: - ceph fs set cephfs balance_automate false - ceph fs subvolumegroup pin cephfs qa random 0.10 - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-18_21:24:17 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T04:10:16.799 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa; will attempt to use it 2024-09-19T04:10:16.800 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks 2024-09-19T04:10:16.800 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T04:10:16.801 INFO:teuthology.task.internal:Checking packages... 2024-09-19T04:10:16.821 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '2f599a46ad10e37c929e5c43da2f6907ddcd1961' 2024-09-19T04:10:16.821 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T04:10:16.821 INFO:teuthology.packaging:ref: None 2024-09-19T04:10:16.821 INFO:teuthology.packaging:tag: None 2024-09-19T04:10:16.821 INFO:teuthology.packaging:branch: squid 2024-09-19T04:10:16.821 INFO:teuthology.packaging:sha1: 2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:10:16.821 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-09-19T04:10:17.032 INFO:teuthology.task.internal:Found packages for ceph version 19.1.1-363.g6fad5dd7 2024-09-19T04:10:17.033 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T04:10:17.041 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T04:10:17.041 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T04:10:17.095 INFO:teuthology.task.internal:Saving configuration 2024-09-19T04:10:17.115 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T04:10:17.122 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T04:10:17.145 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi070.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:03:28.018226', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBB/P2i5XMBBD38U/+eDOvu+spnDEGreHrv5jZL6OUBKfNqV5KiMuAJKyQQELRBmFJfRAc4afM6Zd2ZU2VwJlf8w='} 2024-09-19T04:10:17.166 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:03:28.019508', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOz9CNoJSucj5ffm6OCESk/1t2V56ojjFD2XnZFhLq6P+2BKrrUH8kM1YlnTehoUPjGiuGS9A/B9reISycvjIvQ='} 2024-09-19T04:10:17.184 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi167.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 04:03:28.016764', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBComJTz+njxAWNT9s8DvWyhe4JofNkGX2NZR7ED9FkebrNgcavTUEyEE1fJh5JCNREBSR98G60RDi1Ii03i1DM0='} 2024-09-19T04:10:17.184 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T04:10:17.190 INFO:teuthology.task.internal:roles: ubuntu@smithi070.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-09-19T04:10:17.190 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-09-19T04:10:17.190 INFO:teuthology.task.internal:roles: ubuntu@smithi167.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-09-19T04:10:17.191 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T04:10:17.291 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f4b9c563520>, signals=[15]) 2024-09-19T04:10:17.292 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T04:10:17.297 INFO:teuthology.task.internal:Opening connections... 2024-09-19T04:10:17.298 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:10:17.299 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:10:17.414 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-09-19T04:10:17.414 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:10:17.490 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi167.front.sepia.ceph.com 2024-09-19T04:10:17.491 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:10:17.566 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T04:10:17.573 DEBUG:teuthology.orchestra.run.smithi070:> uname -m 2024-09-19T04:10:17.591 INFO:teuthology.orchestra.run.smithi070.stdout:x86_64 2024-09-19T04:10:17.592 DEBUG:teuthology.orchestra.run.smithi070:> cat /etc/os-release 2024-09-19T04:10:17.649 INFO:teuthology.orchestra.run.smithi070.stdout:NAME="CentOS Stream" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION="9" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:ID="centos" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:ID_LIKE="rhel fedora" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:VERSION_ID="9" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:PLATFORM_ID="platform:el9" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:ANSI_COLOR="0;31" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:LOGO="fedora-logo-icon" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:HOME_URL="https://centos.org/" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T04:10:17.650 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T04:10:17.651 INFO:teuthology.orchestra.run.smithi070.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T04:10:17.651 INFO:teuthology.lock.ops:Updating smithi070.front.sepia.ceph.com on lock server 2024-09-19T04:10:17.676 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-09-19T04:10:17.694 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-09-19T04:10:17.694 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-09-19T04:10:17.752 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="9" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="9" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el9" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:LOGO="fedora-logo-icon" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T04:10:17.753 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T04:10:17.754 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T04:10:17.754 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-09-19T04:10:17.776 DEBUG:teuthology.orchestra.run.smithi167:> uname -m 2024-09-19T04:10:17.795 INFO:teuthology.orchestra.run.smithi167.stdout:x86_64 2024-09-19T04:10:17.795 DEBUG:teuthology.orchestra.run.smithi167:> cat /etc/os-release 2024-09-19T04:10:17.853 INFO:teuthology.orchestra.run.smithi167.stdout:NAME="CentOS Stream" 2024-09-19T04:10:17.853 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION="9" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:ID="centos" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:ID_LIKE="rhel fedora" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:VERSION_ID="9" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:PLATFORM_ID="platform:el9" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:ANSI_COLOR="0;31" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:LOGO="fedora-logo-icon" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:HOME_URL="https://centos.org/" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T04:10:17.854 INFO:teuthology.orchestra.run.smithi167.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T04:10:17.855 INFO:teuthology.lock.ops:Updating smithi167.front.sepia.ceph.com on lock server 2024-09-19T04:10:17.876 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T04:10:17.886 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T04:10:17.901 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T04:10:17.901 DEBUG:teuthology.orchestra.run.smithi070:> test '!' -e /home/ubuntu/cephtest 2024-09-19T04:10:17.904 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-09-19T04:10:17.906 DEBUG:teuthology.orchestra.run.smithi167:> test '!' -e /home/ubuntu/cephtest 2024-09-19T04:10:17.923 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T04:10:17.930 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T04:10:17.930 DEBUG:teuthology.orchestra.run.smithi070:> test -z $(ls -A /var/lib/ceph) 2024-09-19T04:10:17.962 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-09-19T04:10:17.964 DEBUG:teuthology.orchestra.run.smithi167:> test -z $(ls -A /var/lib/ceph) 2024-09-19T04:10:18.036 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T04:10:18.109 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T04:10:18.123 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T04:10:18.123 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}, 'mon.c': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T04:10:18.124 DEBUG:teuthology.orchestra.run.smithi070:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T04:10:18.124 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T04:10:18.125 DEBUG:teuthology.orchestra.run.smithi167:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T04:10:18.141 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:10:18.142 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-19T04:10:18.142 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:10:18.143 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:10:18.143 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-19T04:10:18.143 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-19T04:10:18.199 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-503.el9.x86_64 2024-09-19T04:10:18.200 INFO:teuthology.task.kernel:Running kernel on smithi134: 5.14.0-503.el9.x86_64 2024-09-19T04:10:18.200 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-09-19T04:10:18.201 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-503.el9.x86_64 2024-09-19T04:10:18.201 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-503.el9.x86_64 2024-09-19T04:10:18.202 INFO:teuthology.task.kernel:Running kernel on smithi167: 5.14.0-503.el9.x86_64 2024-09-19T04:10:18.202 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum install -y kernel 2024-09-19T04:10:18.202 INFO:teuthology.task.kernel:Running kernel on smithi070: 5.14.0-503.el9.x86_64 2024-09-19T04:10:18.202 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum install -y kernel 2024-09-19T04:10:20.568 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T04:10:21.335 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.3 MB 00:01 2024-09-19T04:10:22.311 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T04:10:23.781 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 2.2 MB/s | 8.3 MB 00:03 2024-09-19T04:10:24.352 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 10 MB/s | 20 MB 00:01 2024-09-19T04:10:26.495 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 17 MB/s | 6.5 MB 00:00 2024-09-19T04:10:27.920 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 101 kB/s | 19 kB 00:00 2024-09-19T04:10:28.181 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 6.1 MB/s | 20 MB 00:03 2024-09-19T04:10:28.594 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T04:10:30.112 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 63 kB/s | 19 kB 00:00 2024-09-19T04:10:31.744 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 15 MB/s | 23 MB 00:01 2024-09-19T04:10:33.782 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 3.6 MB/s | 6.5 MB 00:01 2024-09-19T04:10:35.999 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-19T04:10:37.147 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 32 kB/s | 1.7 kB 00:00 2024-09-19T04:10:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T04:10:39.071 INFO:teuthology.orchestra.run.smithi167.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T04:10:39.151 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: Package Architecture Version Repository Size 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T04:10:39.159 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T04:10:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:10:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-19T04:10:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:================================================================================ 2024-09-19T04:10:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:Install 4 Packages 2024-09-19T04:10:39.160 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:10:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 79 M 2024-09-19T04:10:39.160 INFO:teuthology.orchestra.run.smithi167.stdout:Installed size: 126 M 2024-09-19T04:10:39.161 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-19T04:10:39.524 INFO:teuthology.orchestra.run.smithi167.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 330 kB/s | 36 kB 00:00 2024-09-19T04:10:39.916 INFO:teuthology.orchestra.run.smithi167.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 31 MB/s | 16 MB 00:00 2024-09-19T04:10:40.341 INFO:teuthology.orchestra.run.smithi167.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 37 MB/s | 35 MB 00:00 2024-09-19T04:10:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-19T04:10:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:10:40.608 INFO:teuthology.orchestra.run.smithi167.stdout:Total 54 MB/s | 79 MB 00:01 2024-09-19T04:10:41.016 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 4.6 MB/s | 23 MB 00:04 2024-09-19T04:10:41.292 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-19T04:10:41.654 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-19T04:10:41.654 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-19T04:10:42.595 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-19T04:10:42.595 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-19T04:10:45.049 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-19T04:10:45.730 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:10:45.809 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:10:46.411 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T04:10:48.309 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T04:10:48.309 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T04:10:48.415 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-19T04:10:48.420 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-09-19T04:10:48.421 INFO:teuthology.orchestra.run.smithi134.stdout:Install 4 Packages 2024-09-19T04:10:48.421 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:10:48.421 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 79 M 2024-09-19T04:10:48.421 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 126 M 2024-09-19T04:10:48.421 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-19T04:10:48.600 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:10:48.670 INFO:teuthology.orchestra.run.smithi134.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 336 kB/s | 36 kB 00:00 2024-09-19T04:10:48.736 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:10:50.487 INFO:teuthology.orchestra.run.smithi134.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 8.1 MB/s | 16 MB 00:01 2024-09-19T04:10:51.059 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 1.0 MB/s | 23 MB 00:23 2024-09-19T04:10:52.370 INFO:teuthology.orchestra.run.smithi134.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 7.7 MB/s | 29 MB 00:03 2024-09-19T04:10:52.963 INFO:teuthology.orchestra.run.smithi134.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 7.9 MB/s | 35 MB 00:04 2024-09-19T04:10:52.963 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:10:52.963 INFO:teuthology.orchestra.run.smithi134.stdout:Total 17 MB/s | 79 MB 00:04 2024-09-19T04:10:53.553 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:10:53.595 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:10:53.643 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-19T04:10:53.986 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-19T04:10:53.986 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-19T04:10:54.961 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-19T04:10:54.961 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-19T04:10:56.410 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T04:10:57.400 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-19T04:10:58.042 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:10:58.124 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:10:58.299 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T04:10:58.299 INFO:teuthology.orchestra.run.smithi070.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T04:10:58.403 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-19T04:10:58.410 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-19T04:10:58.410 INFO:teuthology.orchestra.run.smithi070.stdout: Package Architecture Version Repository Size 2024-09-19T04:10:58.410 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-19T04:10:58.410 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-19T04:10:58.410 INFO:teuthology.orchestra.run.smithi070.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T04:10:58.410 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-19T04:10:58.410 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T04:10:58.411 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T04:10:58.411 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T04:10:58.411 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:10:58.411 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-19T04:10:58.411 INFO:teuthology.orchestra.run.smithi070.stdout:================================================================================ 2024-09-19T04:10:58.411 INFO:teuthology.orchestra.run.smithi070.stdout:Install 4 Packages 2024-09-19T04:10:58.411 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:10:58.412 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 79 M 2024-09-19T04:10:58.412 INFO:teuthology.orchestra.run.smithi070.stdout:Installed size: 126 M 2024-09-19T04:10:58.412 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-19T04:10:58.434 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:10:58.836 INFO:teuthology.orchestra.run.smithi070.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 118 kB/s | 36 kB 00:00 2024-09-19T04:11:00.878 INFO:teuthology.orchestra.run.smithi070.stdout:(2/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 15 MB/s | 35 MB 00:02 2024-09-19T04:11:00.892 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:11:01.019 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:11:05.831 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:11:05.877 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:10.727 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:14.733 INFO:teuthology.orchestra.run.smithi070.stdout:(3/4): kernel-core-5.14.0-508.el9.x86_64.rpm 990 kB/s | 16 MB 00:16 2024-09-19T04:11:34.588 INFO:teuthology.orchestra.run.smithi070.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 819 kB/s | 29 MB 00:35 2024-09-19T04:11:34.588 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:11:34.588 INFO:teuthology.orchestra.run.smithi070.stdout:Total 2.2 MB/s | 79 MB 00:36 2024-09-19T04:11:35.267 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-19T04:11:35.627 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-19T04:11:35.627 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-19T04:11:36.486 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:36.526 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:36.585 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-19T04:11:36.586 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-19T04:11:36.908 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:36.908 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:11:36.909 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:11:36.909 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:11:37.775 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:37.775 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:11:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-19T04:11:37.776 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T04:11:37.776 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T04:11:37.776 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T04:11:37.776 INFO:teuthology.orchestra.run.smithi167.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T04:11:37.776 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:11:37.776 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-19T04:11:38.136 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:11:38.227 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:11:38.228 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:11:38.228 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T04:11:38.228 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T04:11:38.229 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T04:11:38.229 INFO:teuthology.task.kernel:Installing distro kernel on mon.c... 2024-09-19T04:11:38.229 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi167.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T04:11:38.229 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:11:38.289 INFO:teuthology.orchestra.run.smithi167.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:11:38.290 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:11:38.290 DEBUG:teuthology.orchestra.run.smithi167:> sudo rpm -qi grub2-tools 2024-09-19T04:11:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:Name : grub2-tools 2024-09-19T04:11:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:Epoch : 1 2024-09-19T04:11:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:Version : 2.06 2024-09-19T04:11:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:Release : 82.el9 2024-09-19T04:11:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:Architecture: x86_64 2024-09-19T04:11:38.333 INFO:teuthology.orchestra.run.smithi167.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Group : Unspecified 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Size : 8274670 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:License : GPLv3+ 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Packager : builder@centos.org 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Vendor : CentOS 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Summary : Support tools for GRUB. 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:Description : 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:11:38.334 INFO:teuthology.orchestra.run.smithi167.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T04:11:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T04:11:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T04:11:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:hardware devices. 2024-09-19T04:11:38.335 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:11:38.335 INFO:teuthology.orchestra.run.smithi167.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T04:11:38.336 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T04:11:38.336 INFO:teuthology.task.kernel:Updating grub on smithi167 to boot 5.14.0-508.el9.x86_64 2024-09-19T04:11:38.336 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T04:11:38.993 INFO:teuthology.orchestra.run.smithi167.stderr:Generating grub configuration file ... 2024-09-19T04:11:39.023 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-19T04:11:39.707 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:11:39.788 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:11:40.354 INFO:teuthology.orchestra.run.smithi167.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T04:11:40.386 INFO:teuthology.orchestra.run.smithi167.stderr:done 2024-09-19T04:11:40.388 DEBUG:teuthology.orchestra.run.smithi167:> mktemp 2024-09-19T04:11:40.404 INFO:teuthology.orchestra.run.smithi167.stdout:/tmp/tmp.0yrHs5KfBZ 2024-09-19T04:11:40.405 DEBUG:teuthology.orchestra.run.smithi167:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.0yrHs5KfBZ 2024-09-19T04:11:40.471 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 0666 /tmp/tmp.0yrHs5KfBZ 2024-09-19T04:11:40.617 DEBUG:teuthology.orchestra.remote:smithi167:/tmp/tmp.0yrHs5KfBZ is 6KB 2024-09-19T04:11:40.666 DEBUG:teuthology.orchestra.run.smithi167:> rm -fr /tmp/tmp.0yrHs5KfBZ 2024-09-19T04:11:40.681 DEBUG:teuthology.orchestra.run.smithi167:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T04:11:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T04:11:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T04:11:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T04:11:40.751 INFO:teuthology.orchestra.run.smithi167.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T04:11:40.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T04:11:40.905 DEBUG:teuthology.orchestra.run.smithi167:> sudo shutdown -r now 2024-09-19T04:11:42.532 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:11:42.674 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:11:47.487 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:11:47.532 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:49.034 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:49.073 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:11:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:11:49.430 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:11:50.287 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:50.287 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:11:50.288 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-19T04:11:50.288 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T04:11:50.288 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T04:11:50.288 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T04:11:50.288 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T04:11:50.288 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:11:50.288 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-19T04:11:50.644 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:11:50.737 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:11:50.738 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:11:50.738 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T04:11:50.738 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T04:11:50.738 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T04:11:50.738 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-09-19T04:11:50.739 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T04:11:50.739 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:11:50.797 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:11:50.798 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:11:50.798 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.06 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 82.el9 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Group : Unspecified 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 8274670 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-09-19T04:11:50.830 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T04:11:50.831 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T04:11:50.831 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T04:11:50.831 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T04:11:50.831 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : builder@centos.org 2024-09-19T04:11:50.831 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-09-19T04:11:50.831 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:11:50.832 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T04:11:50.833 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T04:11:50.833 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 5.14.0-508.el9.x86_64 2024-09-19T04:11:50.834 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T04:11:51.455 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-09-19T04:11:52.366 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:11:52.781 INFO:teuthology.orchestra.run.smithi134.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T04:11:52.807 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-09-19T04:11:52.810 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-09-19T04:11:52.825 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.t0bVKl2pR0 2024-09-19T04:11:52.825 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.t0bVKl2pR0 2024-09-19T04:11:52.892 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.t0bVKl2pR0 2024-09-19T04:11:53.042 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.t0bVKl2pR0 is 6KB 2024-09-19T04:11:53.062 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.t0bVKl2pR0 2024-09-19T04:11:53.076 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T04:11:53.140 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T04:11:53.140 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T04:11:53.140 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T04:11:53.140 INFO:teuthology.orchestra.run.smithi134.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T04:11:53.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T04:11:53.296 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-09-19T04:12:10.908 INFO:teuthology.task.kernel:Checking client mon.c for new kernel version... 2024-09-19T04:12:10.909 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T04:12:10.910 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:12:23.299 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-09-19T04:12:23.300 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-19T04:12:23.300 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:12:29.374 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-19T04:12:30.725 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:12:30.767 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:12:31.148 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:12:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T04:12:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T04:12:31.149 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:12:32.011 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-19T04:12:32.365 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:12:32.448 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:12:32.448 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:12:32.448 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T04:12:32.448 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T04:12:32.449 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T04:12:32.449 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T04:12:32.449 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi070.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T04:12:32.449 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T04:12:32.508 INFO:teuthology.orchestra.run.smithi070.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T04:12:32.508 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T04:12:32.509 DEBUG:teuthology.orchestra.run.smithi070:> sudo rpm -qi grub2-tools 2024-09-19T04:12:32.542 INFO:teuthology.orchestra.run.smithi070.stdout:Name : grub2-tools 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Epoch : 1 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Version : 2.06 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Release : 82.el9 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Architecture: x86_64 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Group : Unspecified 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Size : 8274670 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:License : GPLv3+ 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T04:12:32.543 INFO:teuthology.orchestra.run.smithi070.stdout:Packager : builder@centos.org 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:Vendor : CentOS 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:Summary : Support tools for GRUB. 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:Description : 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout:hardware devices. 2024-09-19T04:12:32.544 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:12:32.545 INFO:teuthology.orchestra.run.smithi070.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T04:12:32.545 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T04:12:32.545 INFO:teuthology.task.kernel:Updating grub on smithi070 to boot 5.14.0-508.el9.x86_64 2024-09-19T04:12:32.546 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T04:12:33.262 INFO:teuthology.orchestra.run.smithi070.stderr:Generating grub configuration file ... 2024-09-19T04:12:34.623 INFO:teuthology.orchestra.run.smithi070.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T04:12:34.651 INFO:teuthology.orchestra.run.smithi070.stderr:done 2024-09-19T04:12:34.653 DEBUG:teuthology.orchestra.run.smithi070:> mktemp 2024-09-19T04:12:34.668 INFO:teuthology.orchestra.run.smithi070.stdout:/tmp/tmp.oUWg9hC83h 2024-09-19T04:12:34.669 DEBUG:teuthology.orchestra.run.smithi070:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.oUWg9hC83h 2024-09-19T04:12:34.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0666 /tmp/tmp.oUWg9hC83h 2024-09-19T04:12:34.873 DEBUG:teuthology.orchestra.remote:smithi070:/tmp/tmp.oUWg9hC83h is 6KB 2024-09-19T04:12:34.922 DEBUG:teuthology.orchestra.run.smithi070:> rm -fr /tmp/tmp.oUWg9hC83h 2024-09-19T04:12:34.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T04:12:34.999 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T04:12:34.999 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T04:12:34.999 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T04:12:34.999 INFO:teuthology.orchestra.run.smithi070.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T04:12:35.001 DEBUG:teuthology.orchestra.run.smithi070:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T04:12:35.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo shutdown -r now 2024-09-19T04:12:38.378 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T04:12:38.379 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:12:41.441 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-19T04:12:41.661 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-09-19T04:12:50.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-19T04:12:50.671 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:12:53.444 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T04:12:53.445 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:13:05.169 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T04:13:05.170 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-19T04:13:05.171 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:13:11.869 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.167 2024-09-19T04:13:23.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.70 2024-09-19T04:13:26.873 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T04:13:26.874 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:13:27.265 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-19T04:13:27.612 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T04:13:27.612 INFO:teuthology.task.kernel:Checking kernel version of mon.c, want "5.14.0-508.el9.x86_64"... 2024-09-19T04:13:27.612 DEBUG:teuthology.orchestra.run.smithi167:> uname -r 2024-09-19T04:13:27.627 INFO:teuthology.orchestra.run.smithi167.stdout:5.14.0-508.el9.x86_64 2024-09-19T04:13:27.627 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T04:13:27.627 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T04:13:27.627 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T04:13:28.629 INFO:teuthology.task.kernel:Enabling kdb on mon.c... 2024-09-19T04:13:28.629 DEBUG:teuthology.orchestra.run.smithi167:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T04:13:28.754 INFO:teuthology.orchestra.run.smithi167.stdout:ttyS1 2024-09-19T04:13:28.787 DEBUG:teuthology.parallel:result is None 2024-09-19T04:13:32.646 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-19T04:13:32.647 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:13:50.673 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T04:14:02.674 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-19T04:14:02.675 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:14:03.186 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-19T04:14:03.540 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-19T04:14:03.540 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-508.el9.x86_64"... 2024-09-19T04:14:03.541 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-09-19T04:14:03.558 INFO:teuthology.orchestra.run.smithi134.stdout:5.14.0-508.el9.x86_64 2024-09-19T04:14:03.558 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T04:14:03.558 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T04:14:03.558 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T04:14:04.559 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-09-19T04:14:04.559 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T04:14:04.627 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-09-19T04:14:04.652 DEBUG:teuthology.parallel:result is None 2024-09-19T04:14:32.649 DEBUG:teuthology.orchestra.remote:timed out 2024-09-19T04:14:44.651 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-19T04:14:44.652 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:14:45.011 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-19T04:14:45.385 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-19T04:14:45.385 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T04:14:45.385 DEBUG:teuthology.orchestra.run.smithi070:> uname -r 2024-09-19T04:14:45.401 INFO:teuthology.orchestra.run.smithi070.stdout:5.14.0-508.el9.x86_64 2024-09-19T04:14:45.402 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T04:14:45.402 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T04:14:45.402 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T04:14:46.403 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T04:14:46.403 DEBUG:teuthology.orchestra.run.smithi070:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T04:14:46.480 INFO:teuthology.orchestra.run.smithi070.stdout:ttyS1 2024-09-19T04:14:46.505 DEBUG:teuthology.parallel:result is None 2024-09-19T04:14:46.505 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T04:14:46.513 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T04:14:46.514 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T04:14:46.516 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T04:14:46.519 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T04:14:46.538 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T04:14:46.561 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T04:14:46.592 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T04:14:46.592 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T04:14:46.595 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T04:14:46.597 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T04:14:46.634 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T04:14:46.645 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T04:14:46.645 DEBUG:teuthology.orchestra.run.smithi070:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T04:14:46.658 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T04:14:46.667 DEBUG:teuthology.orchestra.run.smithi167:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T04:14:46.695 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:14:46.704 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:14:46.706 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:14:46.706 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:14:46.715 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:14:46.717 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T04:14:46.719 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T04:14:46.731 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T04:14:46.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T04:14:46.750 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T04:14:46.760 DEBUG:teuthology.orchestra.run.smithi167:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T04:14:46.787 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T04:14:46.800 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T04:14:46.800 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T04:14:46.818 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T04:14:46.830 DEBUG:teuthology.orchestra.run.smithi167:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T04:14:46.847 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:14:46.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:14:46.965 DEBUG:teuthology.orchestra.run.smithi070:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:14:47.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:14:47.089 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:14:47.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:14:47.155 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:14:47.197 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:14:47.256 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:14:47.345 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:14:47.385 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:14:47.385 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:14:47.452 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:14:47.496 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T04:14:47.551 DEBUG:teuthology.orchestra.run.smithi167:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:14:47.629 DEBUG:teuthology.orchestra.run.smithi167:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T04:14:47.678 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:14:47.678 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T04:14:47.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo service rsyslog restart 2024-09-19T04:14:47.747 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-09-19T04:14:47.749 DEBUG:teuthology.orchestra.run.smithi167:> sudo service rsyslog restart 2024-09-19T04:14:47.787 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:14:47.788 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:14:47.822 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:14:48.242 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T04:14:48.249 INFO:teuthology.task.internal:Starting timer... 2024-09-19T04:14:48.249 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T04:14:48.278 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T04:14:48.310 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-09-19T04:14:48.310 DEBUG:teuthology.orchestra.run.smithi070:> sudo service auditd rotate 2024-09-19T04:14:48.364 INFO:teuthology.orchestra.run.smithi070.stdout:Rotating logs: 2024-09-19T04:14:48.366 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-09-19T04:14:48.420 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-09-19T04:14:48.422 DEBUG:teuthology.orchestra.run.smithi167:> sudo service auditd rotate 2024-09-19T04:14:48.483 INFO:teuthology.orchestra.run.smithi167.stdout:Rotating logs: 2024-09-19T04:14:48.485 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T04:14:48.486 DEBUG:teuthology.orchestra.run.smithi070:> /usr/sbin/getenforce 2024-09-19T04:14:48.510 INFO:teuthology.orchestra.run.smithi070.stdout:Permissive 2024-09-19T04:14:48.510 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-09-19T04:14:48.540 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-09-19T04:14:48.540 DEBUG:teuthology.orchestra.run.smithi167:> /usr/sbin/getenforce 2024-09-19T04:14:48.562 INFO:teuthology.orchestra.run.smithi167.stdout:Permissive 2024-09-19T04:14:48.562 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi070.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi167.front.sepia.ceph.com': 'permissive'} 2024-09-19T04:14:48.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:14:48.591 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:14:48.592 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:14:48.620 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:14:48.621 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:14:48.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:14:48.648 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T04:14:48.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:14:48.689 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:14:48.726 DEBUG:teuthology.orchestra.run.smithi167:> sudo /usr/sbin/setenforce permissive 2024-09-19T04:14:48.766 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T04:14:48.775 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T04:14:48.786 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T04:14:48.786 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi070.front.sepia.ceph.com,smithi134.front.sepia.ceph.com,smithi167.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T04:18:38.912 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi070.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com'), Remote(name='ubuntu@smithi167.front.sepia.ceph.com')] 2024-09-19T04:18:38.914 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-19T04:18:38.915 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi070.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:18:38.991 DEBUG:teuthology.orchestra.run.smithi070:> true 2024-09-19T04:18:39.068 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi070.front.sepia.ceph.com' 2024-09-19T04:18:39.069 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-19T04:18:39.069 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:18:39.146 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-09-19T04:18:39.224 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-09-19T04:18:39.224 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T04:18:39.225 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi167.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T04:18:39.301 DEBUG:teuthology.orchestra.run.smithi167:> true 2024-09-19T04:18:39.386 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi167.front.sepia.ceph.com' 2024-09-19T04:18:39.386 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T04:18:39.397 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T04:18:39.397 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:18:39.398 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:18:39.400 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:18:39.400 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:18:39.403 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T04:18:39.403 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:18:39.430 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:18:39.430 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:18:39.444 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:18:39.444 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:18:39.458 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T04:18:39.468 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-09-19T04:18:39.469 INFO:teuthology.orchestra.run.smithi070.stderr:sudo: ntpd: command not found 2024-09-19T04:18:39.473 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T04:18:39.479 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-09-19T04:18:39.481 INFO:teuthology.orchestra.run.smithi070.stdout:506 Cannot talk to daemon 2024-09-19T04:18:39.494 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:18:39.495 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:18:39.499 INFO:teuthology.orchestra.run.smithi167.stderr:sudo: ntpd: command not found 2024-09-19T04:18:39.508 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:18:39.509 INFO:teuthology.orchestra.run.smithi070.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:18:39.510 INFO:teuthology.orchestra.run.smithi167.stdout:506 Cannot talk to daemon 2024-09-19T04:18:39.524 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T04:18:39.537 INFO:teuthology.orchestra.run.smithi167.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T04:18:39.569 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:18:39.572 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:18:39.572 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-19T04:18:39.572 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.572 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.572 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.572 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.573 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:18:39.576 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:18:39.576 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-19T04:18:39.576 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.576 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.576 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.576 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.596 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:18:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:18:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-19T04:18:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.599 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.600 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:18:39.600 INFO:teuthology.run_tasks:Running task install... 2024-09-19T04:18:39.608 DEBUG:teuthology.task.install:project ceph 2024-09-19T04:18:39.608 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'}} 2024-09-19T04:18:39.608 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961'} 2024-09-19T04:18:39.608 INFO:teuthology.task.install:Using flavor: default 2024-09-19T04:18:39.616 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T04:18:39.616 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-09-19T04:18:39.616 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:18:39.617 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:18:39.619 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:18:39.619 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:18:39.620 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'tag': None, 'wait_for_package': False} 2024-09-19T04:18:39.620 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:18:39.760 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:18:39.761 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:18:39.770 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:18:39.770 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:18:39.774 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/ 2024-09-19T04:18:39.774 INFO:teuthology.task.install.rpm:Package version is 19.1.1-361.g2f599a46 2024-09-19T04:18:39.870 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:18:39.871 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:18:39.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:18:39.884 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:18:39.884 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:18:39.884 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:18:39.897 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:18:39.897 DEBUG:teuthology.orchestra.run.smithi070:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:18:39.906 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T04:18:39.906 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:18:39.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T04:18:39.910 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:18:39.910 DEBUG:teuthology.orchestra.run.smithi167:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:18:39.932 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-09-19T04:18:39.932 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/2f599a46ad10e37c929e5c43da2f6907ddcd1961/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T04:18:39.962 DEBUG:teuthology.orchestra.run.smithi070:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:18:39.977 DEBUG:teuthology.orchestra.run.smithi167:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:18:39.998 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T04:18:40.037 DEBUG:teuthology.orchestra.run.smithi070:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:18:40.052 DEBUG:teuthology.orchestra.run.smithi167:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:18:40.073 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T04:18:40.101 INFO:teuthology.orchestra.run.smithi070.stdout:check_obsoletes = 1 2024-09-19T04:18:40.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum clean all 2024-09-19T04:18:40.117 INFO:teuthology.orchestra.run.smithi167.stdout:check_obsoletes = 1 2024-09-19T04:18:40.118 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum clean all 2024-09-19T04:18:40.137 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-09-19T04:18:40.138 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-09-19T04:18:40.336 INFO:teuthology.orchestra.run.smithi070.stdout:45 files removed 2024-09-19T04:18:40.342 INFO:teuthology.orchestra.run.smithi167.stdout:45 files removed 2024-09-19T04:18:40.362 DEBUG:teuthology.orchestra.run.smithi070:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:18:40.366 INFO:teuthology.orchestra.run.smithi134.stdout:45 files removed 2024-09-19T04:18:40.369 DEBUG:teuthology.orchestra.run.smithi167:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:18:40.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-09-19T04:18:40.926 INFO:teuthology.orchestra.run.smithi070.stdout:ceph packages for x86_64 304 kB/s | 84 kB 00:00 2024-09-19T04:18:40.947 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 311 kB/s | 84 kB 00:00 2024-09-19T04:18:40.979 INFO:teuthology.orchestra.run.smithi167.stdout:ceph packages for x86_64 261 kB/s | 84 kB 00:00 2024-09-19T04:18:41.210 INFO:teuthology.orchestra.run.smithi070.stdout:ceph noarch packages 49 kB/s | 12 kB 00:00 2024-09-19T04:18:41.255 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 45 kB/s | 12 kB 00:00 2024-09-19T04:18:41.271 INFO:teuthology.orchestra.run.smithi167.stdout:ceph noarch packages 47 kB/s | 12 kB 00:00 2024-09-19T04:18:41.485 INFO:teuthology.orchestra.run.smithi070.stdout:ceph source packages 8.0 kB/s | 1.9 kB 00:00 2024-09-19T04:18:41.530 INFO:teuthology.orchestra.run.smithi167.stdout:ceph source packages 8.6 kB/s | 1.9 kB 00:00 2024-09-19T04:18:41.540 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 7.7 kB/s | 1.9 kB 00:00 2024-09-19T04:18:42.036 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 8.3 MB 00:00 2024-09-19T04:18:42.073 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - BaseOS 17 MB/s | 8.3 MB 00:00 2024-09-19T04:18:42.155 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T04:18:43.908 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - AppStream 30 MB/s | 20 MB 00:00 2024-09-19T04:18:44.324 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - AppStream 17 MB/s | 20 MB 00:01 2024-09-19T04:18:48.600 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - CRB 14 MB/s | 6.5 MB 00:00 2024-09-19T04:18:48.958 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - CRB 5.1 MB/s | 6.5 MB 00:01 2024-09-19T04:18:50.258 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 9 - Extras packages 64 kB/s | 19 kB 00:00 2024-09-19T04:18:50.626 INFO:teuthology.orchestra.run.smithi167.stdout:CentOS Stream 9 - Extras packages 45 kB/s | 19 kB 00:00 2024-09-19T04:18:50.835 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - AppStream 2.6 MB/s | 20 MB 00:07 2024-09-19T04:18:51.482 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 21 MB/s | 23 MB 00:01 2024-09-19T04:18:55.811 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - CRB 5.4 MB/s | 6.5 MB 00:01 2024-09-19T04:18:56.902 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-09-19T04:18:58.028 INFO:teuthology.orchestra.run.smithi070.stdout:CentOS Stream 9 - Extras packages 19 kB/s | 19 kB 00:00 2024-09-19T04:18:58.476 INFO:teuthology.orchestra.run.smithi167.stdout:Extra Packages for Enterprise Linux 2.9 MB/s | 23 MB 00:07 2024-09-19T04:18:59.113 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:18:59.114 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:18:59.125 INFO:teuthology.orchestra.run.smithi134.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:18:59.126 INFO:teuthology.orchestra.run.smithi134.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:18:59.127 INFO:teuthology.orchestra.run.smithi134.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:18:59.128 INFO:teuthology.orchestra.run.smithi134.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:18:59.129 INFO:teuthology.orchestra.run.smithi134.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:18:59.132 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:18:59.133 INFO:teuthology.orchestra.run.smithi134.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:18:59.196 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-09-19T04:18:59.211 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-19T04:18:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-09-19T04:18:59.211 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-19T04:18:59.211 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-09-19T04:18:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:18:59.211 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:18:59.212 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:18:59.213 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:18:59.214 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:18:59.215 INFO:teuthology.orchestra.run.smithi134.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:18:59.216 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:18:59.217 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:18:59.218 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:18:59.219 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:18:59.220 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:18:59.221 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:18:59.222 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:18:59.223 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:18:59.224 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout:====================================================================================== 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout:Install 148 Packages 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 8 Packages 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:18:59.225 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 226 M 2024-09-19T04:18:59.226 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-09-19T04:18:59.962 INFO:teuthology.orchestra.run.smithi134.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 49 kB/s | 6.6 kB 00:00 2024-09-19T04:19:00.154 INFO:teuthology.orchestra.run.smithi134.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.6 MB/s | 896 kB 00:00 2024-09-19T04:19:00.262 INFO:teuthology.orchestra.run.smithi134.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T04:19:00.287 INFO:teuthology.orchestra.run.smithi134.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.1 MB/s | 145 kB 00:00 2024-09-19T04:19:00.379 INFO:teuthology.orchestra.run.smithi134.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 20 MB/s | 2.4 MB 00:00 2024-09-19T04:19:00.438 INFO:teuthology.orchestra.run.smithi134.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-19T04:19:00.655 INFO:teuthology.orchestra.run.smithi134.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T04:19:01.039 INFO:teuthology.orchestra.run.smithi134.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 18 MB/s | 21 MB 00:01 2024-09-19T04:19:01.089 INFO:teuthology.orchestra.run.smithi134.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 507 kB/s | 25 kB 00:00 2024-09-19T04:19:01.581 INFO:teuthology.orchestra.run.smithi134.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 11 MB/s | 11 MB 00:00 2024-09-19T04:19:01.639 INFO:teuthology.orchestra.run.smithi134.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.8 MB/s | 228 kB 00:00 2024-09-19T04:19:01.815 INFO:teuthology.orchestra.run.smithi134.stdout:(12/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 17 MB 00:01 2024-09-19T04:19:01.832 INFO:teuthology.orchestra.run.smithi134.stdout:(13/156): cephfs-shell-19.1.1-361.g2f599a46.el9 141 kB/s | 27 kB 00:00 2024-09-19T04:19:01.857 INFO:teuthology.orchestra.run.smithi134.stdout:(14/156): libcephfs-devel-19.1.1-361.g2f599a46. 760 kB/s | 32 kB 00:00 2024-09-19T04:19:01.899 INFO:teuthology.orchestra.run.smithi134.stdout:(15/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 11 MB/s | 751 kB 00:00 2024-09-19T04:19:01.924 INFO:teuthology.orchestra.run.smithi134.stdout:(16/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.4 MB/s | 163 kB 00:00 2024-09-19T04:19:01.966 INFO:teuthology.orchestra.run.smithi134.stdout:(17/156): librados-devel-19.1.1-361.g2f599a46.e 1.8 MB/s | 127 kB 00:00 2024-09-19T04:19:02.000 INFO:teuthology.orchestra.run.smithi134.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 6.6 MB/s | 506 kB 00:00 2024-09-19T04:19:02.058 INFO:teuthology.orchestra.run.smithi134.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 777 kB/s | 45 kB 00:00 2024-09-19T04:19:02.150 INFO:teuthology.orchestra.run.smithi134.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 1.5 MB/s | 136 kB 00:00 2024-09-19T04:19:02.209 INFO:teuthology.orchestra.run.smithi134.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.7 MB/s | 161 kB 00:00 2024-09-19T04:19:02.276 INFO:teuthology.orchestra.run.smithi134.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 4.7 MB/s | 320 kB 00:00 2024-09-19T04:19:02.351 INFO:teuthology.orchestra.run.smithi134.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-19T04:19:02.376 INFO:teuthology.orchestra.run.smithi134.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.9 MB/s | 300 kB 00:00 2024-09-19T04:19:02.402 INFO:teuthology.orchestra.run.smithi134.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T04:19:02.427 INFO:teuthology.orchestra.run.smithi134.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T04:19:02.485 INFO:teuthology.orchestra.run.smithi134.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T04:19:02.552 INFO:teuthology.orchestra.run.smithi134.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 477 kB/s | 32 kB 00:00 2024-09-19T04:19:02.603 INFO:teuthology.orchestra.run.smithi134.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 15 MB/s | 3.1 MB 00:00 2024-09-19T04:19:02.628 INFO:teuthology.orchestra.run.smithi134.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.9 MB/s | 146 kB 00:00 2024-09-19T04:19:03.220 INFO:teuthology.orchestra.run.smithi134.stdout:(31/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 23 MB/s | 49 MB 00:02 2024-09-19T04:19:03.287 INFO:teuthology.orchestra.run.smithi134.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 5.2 MB/s | 3.6 MB 00:00 2024-09-19T04:19:03.312 INFO:teuthology.orchestra.run.smithi134.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.7 MB/s | 249 kB 00:00 2024-09-19T04:19:03.337 INFO:teuthology.orchestra.run.smithi134.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 986 kB/s | 49 kB 00:00 2024-09-19T04:19:03.362 INFO:teuthology.orchestra.run.smithi134.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 329 kB/s | 16 kB 00:00 2024-09-19T04:19:03.421 INFO:teuthology.orchestra.run.smithi134.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 3.3 MB/s | 285 kB 00:00 2024-09-19T04:19:03.455 INFO:teuthology.orchestra.run.smithi134.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 8.1 MB/s | 765 kB 00:00 2024-09-19T04:19:03.480 INFO:teuthology.orchestra.run.smithi134.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 313 kB/s | 18 kB 00:00 2024-09-19T04:19:03.564 INFO:teuthology.orchestra.run.smithi134.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 7.9 MB/s | 7.4 MB 00:00 2024-09-19T04:19:03.656 INFO:teuthology.orchestra.run.smithi134.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 399 kB/s | 80 kB 00:00 2024-09-19T04:19:03.706 INFO:teuthology.orchestra.run.smithi134.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.3 MB/s | 191 kB 00:00 2024-09-19T04:19:03.748 INFO:teuthology.orchestra.run.smithi134.stdout:(42/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.9 MB/s | 801 kB 00:00 2024-09-19T04:19:03.773 INFO:teuthology.orchestra.run.smithi134.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.1 MB/s | 253 kB 00:00 2024-09-19T04:19:03.798 INFO:teuthology.orchestra.run.smithi134.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-09-19T04:19:03.824 INFO:teuthology.orchestra.run.smithi134.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-09-19T04:19:03.849 INFO:teuthology.orchestra.run.smithi134.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-09-19T04:19:03.875 INFO:teuthology.orchestra.run.smithi134.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T04:19:03.916 INFO:teuthology.orchestra.run.smithi134.stdout:(48/156): python3-cryptography-36.0.1-4.el9.x86 5.8 MB/s | 1.2 MB 00:00 2024-09-19T04:19:03.920 INFO:teuthology.orchestra.run.smithi167.stdout:lab-extras 35 kB/s | 1.7 kB 00:00 2024-09-19T04:19:04.017 INFO:teuthology.orchestra.run.smithi134.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 1.0 MB/s | 107 kB 00:00 2024-09-19T04:19:04.059 INFO:teuthology.orchestra.run.smithi134.stdout:(50/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-19T04:19:04.100 INFO:teuthology.orchestra.run.smithi134.stdout:(51/156): bison-3.7.4-5.el9.x86_64.rpm 4.1 MB/s | 943 kB 00:00 2024-09-19T04:19:04.126 INFO:teuthology.orchestra.run.smithi134.stdout:(52/156): elfutils-libelf-devel-0.191-4.el9.x86 199 kB/s | 22 kB 00:00 2024-09-19T04:19:04.151 INFO:teuthology.orchestra.run.smithi134.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 3.3 MB/s | 313 kB 00:00 2024-09-19T04:19:04.193 INFO:teuthology.orchestra.run.smithi134.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-09-19T04:19:04.218 INFO:teuthology.orchestra.run.smithi134.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 272 kB/s | 18 kB 00:00 2024-09-19T04:19:04.260 INFO:teuthology.orchestra.run.smithi134.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 167 kB/s | 11 kB 00:00 2024-09-19T04:19:04.294 INFO:teuthology.orchestra.run.smithi134.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.1 MB/s | 160 kB 00:00 2024-09-19T04:19:04.361 INFO:teuthology.orchestra.run.smithi134.stdout:(58/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-19T04:19:04.411 INFO:teuthology.orchestra.run.smithi134.stdout:(59/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 300 kB/s | 45 kB 00:00 2024-09-19T04:19:04.436 INFO:teuthology.orchestra.run.smithi134.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 4.6 MB/s | 662 kB 00:00 2024-09-19T04:19:04.461 INFO:teuthology.orchestra.run.smithi134.stdout:(61/156): libtool-2.4.6-46.el9.x86_64.rpm 5.7 MB/s | 581 kB 00:00 2024-09-19T04:19:04.487 INFO:teuthology.orchestra.run.smithi134.stdout:(62/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 325 kB/s | 24 kB 00:00 2024-09-19T04:19:04.512 INFO:teuthology.orchestra.run.smithi134.stdout:(63/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 629 kB/s | 47 kB 00:00 2024-09-19T04:19:04.545 INFO:teuthology.orchestra.run.smithi134.stdout:(64/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T04:19:04.571 INFO:teuthology.orchestra.run.smithi134.stdout:(65/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T04:19:04.596 INFO:teuthology.orchestra.run.smithi134.stdout:(66/156): openblas-0.3.26-2.el9.x86_64.rpm 459 kB/s | 38 kB 00:00 2024-09-19T04:19:04.688 INFO:teuthology.orchestra.run.smithi134.stdout:(67/156): openblas-openmp-0.3.26-2.el9.x86_64.r 35 MB/s | 4.9 MB 00:00 2024-09-19T04:19:04.738 INFO:teuthology.orchestra.run.smithi134.stdout:(68/156): postgresql-13.16-1.el9.x86_64.rpm 11 MB/s | 1.6 MB 00:00 2024-09-19T04:19:04.780 INFO:teuthology.orchestra.run.smithi134.stdout:(69/156): postgresql-contrib-13.16-1.el9.x86_64 9.7 MB/s | 910 kB 00:00 2024-09-19T04:19:04.805 INFO:teuthology.orchestra.run.smithi134.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 2.0 MB/s | 137 kB 00:00 2024-09-19T04:19:04.872 INFO:teuthology.orchestra.run.smithi134.stdout:(71/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 15 MB/s | 4.4 MB 00:00 2024-09-19T04:19:04.914 INFO:teuthology.orchestra.run.smithi134.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 9.3 MB/s | 1.0 MB 00:00 2024-09-19T04:19:04.939 INFO:teuthology.orchestra.run.smithi134.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-09-19T04:19:04.946 INFO:teuthology.orchestra.run.smithi070.stdout:Extra Packages for Enterprise Linux 3.3 MB/s | 23 MB 00:06 2024-09-19T04:19:05.015 INFO:teuthology.orchestra.run.smithi134.stdout:(74/156): postgresql-server-13.16-1.el9.x86_64. 25 MB/s | 5.8 MB 00:00 2024-09-19T04:19:05.040 INFO:teuthology.orchestra.run.smithi134.stdout:(75/156): python3-colorama-0.4.6-3.el9.noarch.r 610 kB/s | 61 kB 00:00 2024-09-19T04:19:05.140 INFO:teuthology.orchestra.run.smithi134.stdout:(76/156): python3-babel-2.9.1-2.el9.noarch.rpm 26 MB/s | 6.0 MB 00:00 2024-09-19T04:19:05.166 INFO:teuthology.orchestra.run.smithi134.stdout:(77/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.6 MB/s | 245 kB 00:00 2024-09-19T04:19:05.191 INFO:teuthology.orchestra.run.smithi134.stdout:(78/156): python3-jinja2-2.11.3-6.el9.noarch.rp 1.6 MB/s | 248 kB 00:00 2024-09-19T04:19:05.216 INFO:teuthology.orchestra.run.smithi134.stdout:(79/156): python3-jsonpatch-1.21-16.el9.noarch. 339 kB/s | 26 kB 00:00 2024-09-19T04:19:05.258 INFO:teuthology.orchestra.run.smithi134.stdout:(80/156): python3-jsonpointer-2.0-4.el9.noarch. 287 kB/s | 19 kB 00:00 2024-09-19T04:19:05.283 INFO:teuthology.orchestra.run.smithi134.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 520 kB/s | 35 kB 00:00 2024-09-19T04:19:05.309 INFO:teuthology.orchestra.run.smithi134.stdout:(82/156): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-09-19T04:19:05.342 INFO:teuthology.orchestra.run.smithi134.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-09-19T04:19:05.376 INFO:teuthology.orchestra.run.smithi134.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 3.2 MB/s | 222 kB 00:00 2024-09-19T04:19:05.409 INFO:teuthology.orchestra.run.smithi134.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-09-19T04:19:05.443 INFO:teuthology.orchestra.run.smithi134.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 631 kB/s | 42 kB 00:00 2024-09-19T04:19:05.510 INFO:teuthology.orchestra.run.smithi134.stdout:(87/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-09-19T04:19:05.535 INFO:teuthology.orchestra.run.smithi134.stdout:(88/156): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-09-19T04:19:05.561 INFO:teuthology.orchestra.run.smithi134.stdout:(89/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.3 MB/s | 159 kB 00:00 2024-09-19T04:19:05.619 INFO:teuthology.orchestra.run.smithi134.stdout:(90/156): python3-pyasn1-modules-0.4.8-6.el9.no 2.5 MB/s | 279 kB 00:00 2024-09-19T04:19:05.645 INFO:teuthology.orchestra.run.smithi134.stdout:(91/156): python3-pytz-2021.1-5.el9.noarch.rpm 468 kB/s | 51 kB 00:00 2024-09-19T04:19:05.670 INFO:teuthology.orchestra.run.smithi134.stdout:(92/156): python3-requests-oauthlib-1.3.0-12.el 493 kB/s | 54 kB 00:00 2024-09-19T04:19:05.737 INFO:teuthology.orchestra.run.smithi134.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 629 kB/s | 42 kB 00:00 2024-09-19T04:19:05.762 INFO:teuthology.orchestra.run.smithi134.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 483 kB/s | 44 kB 00:00 2024-09-19T04:19:05.795 INFO:teuthology.orchestra.run.smithi134.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T04:19:05.829 INFO:teuthology.orchestra.run.smithi134.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 538 kB/s | 36 kB 00:00 2024-09-19T04:19:05.862 INFO:teuthology.orchestra.run.smithi134.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 709 kB/s | 47 kB 00:00 2024-09-19T04:19:05.896 INFO:teuthology.orchestra.run.smithi134.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-09-19T04:19:05.921 INFO:teuthology.orchestra.run.smithi134.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 988 kB/s | 58 kB 00:00 2024-09-19T04:19:05.964 INFO:teuthology.orchestra.run.smithi134.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.4 MB/s | 96 kB 00:00 2024-09-19T04:19:05.989 INFO:teuthology.orchestra.run.smithi134.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 953 kB/s | 64 kB 00:00 2024-09-19T04:19:06.022 INFO:teuthology.orchestra.run.smithi134.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 768 kB/s | 45 kB 00:00 2024-09-19T04:19:06.150 INFO:teuthology.orchestra.run.smithi167.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:19:06.151 INFO:teuthology.orchestra.run.smithi167.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:19:06.164 INFO:teuthology.orchestra.run.smithi167.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:19:06.165 INFO:teuthology.orchestra.run.smithi167.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:19:06.166 INFO:teuthology.orchestra.run.smithi167.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:19:06.167 INFO:teuthology.orchestra.run.smithi167.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:19:06.169 INFO:teuthology.orchestra.run.smithi167.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:19:06.172 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:19:06.173 INFO:teuthology.orchestra.run.smithi167.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:19:06.181 INFO:teuthology.orchestra.run.smithi134.stdout:(103/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-09-19T04:19:06.206 INFO:teuthology.orchestra.run.smithi134.stdout:(104/156): lua-devel-5.4.4-4.el9.x86_64.rpm 103 kB/s | 22 kB 00:00 2024-09-19T04:19:06.236 INFO:teuthology.orchestra.run.smithi167.stdout:Dependencies resolved. 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout: Package Arch Version Repository Size 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout:Installing: 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:19:06.256 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:19:06.257 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:19:06.258 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:19:06.259 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrading: 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout:Installing dependencies: 2024-09-19T04:19:06.260 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:19:06.261 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:19:06.262 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:19:06.263 INFO:teuthology.orchestra.run.smithi167.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:19:06.264 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:19:06.265 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:19:06.266 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:19:06.267 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:19:06.268 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:19:06.269 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout:Installing weak dependencies: 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:06.270 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction Summary 2024-09-19T04:19:06.271 INFO:teuthology.orchestra.run.smithi167.stdout:====================================================================================== 2024-09-19T04:19:06.271 INFO:teuthology.orchestra.run.smithi167.stdout:Install 148 Packages 2024-09-19T04:19:06.271 INFO:teuthology.orchestra.run.smithi167.stdout:Upgrade 8 Packages 2024-09-19T04:19:06.271 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:06.271 INFO:teuthology.orchestra.run.smithi134.stdout:(105/156): abseil-cpp-20211102.0-3.el9.x86_64.r 7.2 MB/s | 548 kB 00:00 2024-09-19T04:19:06.272 INFO:teuthology.orchestra.run.smithi167.stdout:Total download size: 226 M 2024-09-19T04:19:06.272 INFO:teuthology.orchestra.run.smithi167.stdout:Downloading Packages: 2024-09-19T04:19:06.281 INFO:teuthology.orchestra.run.smithi134.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 789 kB/s | 19 kB 00:00 2024-09-19T04:19:06.307 INFO:teuthology.orchestra.run.smithi134.stdout:(107/156): gperftools-libs-2.9.1-3.el9.x86_64.r 3.0 MB/s | 308 kB 00:00 2024-09-19T04:19:06.332 INFO:teuthology.orchestra.run.smithi134.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T04:19:06.357 INFO:teuthology.orchestra.run.smithi134.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T04:19:06.391 INFO:teuthology.orchestra.run.smithi134.stdout:(110/156): protobuf-compiler-3.14.0-13.el9.x86_ 2.3 MB/s | 863 kB 00:00 2024-09-19T04:19:06.425 INFO:teuthology.orchestra.run.smithi134.stdout:(111/156): libunwind-1.6.2-1.el9.x86_64.rpm 1.0 MB/s | 67 kB 00:00 2024-09-19T04:19:06.492 INFO:teuthology.orchestra.run.smithi134.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 14 MB/s | 839 kB 00:00 2024-09-19T04:19:06.517 INFO:teuthology.orchestra.run.smithi134.stdout:(113/156): luarocks-3.9.2-5.el9.noarch.rpm 1.2 MB/s | 151 kB 00:00 2024-09-19T04:19:06.551 INFO:teuthology.orchestra.run.smithi134.stdout:(114/156): python3-asyncssh-2.13.2-5.el9.noarch 9.2 MB/s | 548 kB 00:00 2024-09-19T04:19:06.576 INFO:teuthology.orchestra.run.smithi134.stdout:(115/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 742 kB/s | 43 kB 00:00 2024-09-19T04:19:06.601 INFO:teuthology.orchestra.run.smithi134.stdout:(116/156): python3-cachetools-4.2.4-1.el9.noarc 642 kB/s | 32 kB 00:00 2024-09-19T04:19:06.628 INFO:teuthology.orchestra.run.smithi134.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-09-19T04:19:06.652 INFO:teuthology.orchestra.run.smithi134.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T04:19:06.694 INFO:teuthology.orchestra.run.smithi134.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 7.1 MB/s | 303 kB 00:00 2024-09-19T04:19:06.719 INFO:teuthology.orchestra.run.smithi134.stdout:(120/156): python3-cherrypy-18.6.1-2.el9.noarch 3.8 MB/s | 358 kB 00:00 2024-09-19T04:19:06.744 INFO:teuthology.orchestra.run.smithi134.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 4.3 MB/s | 220 kB 00:00 2024-09-19T04:19:06.811 INFO:teuthology.orchestra.run.smithi134.stdout:(122/156): libarrow-9.0.0-11.el9.x86_64.rpm 8.3 MB/s | 4.4 MB 00:00 2024-09-19T04:19:06.828 INFO:teuthology.orchestra.run.smithi134.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 650 kB/s | 11 kB 00:00 2024-09-19T04:19:06.853 INFO:teuthology.orchestra.run.smithi134.stdout:(124/156): python3-grpcio-tools-1.46.7-10.el9.x 1.3 MB/s | 144 kB 00:00 2024-09-19T04:19:06.870 INFO:teuthology.orchestra.run.smithi134.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 425 kB/s | 18 kB 00:00 2024-09-19T04:19:06.887 INFO:teuthology.orchestra.run.smithi134.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 692 kB/s | 23 kB 00:00 2024-09-19T04:19:06.912 INFO:teuthology.orchestra.run.smithi134.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 464 kB/s | 19 kB 00:00 2024-09-19T04:19:06.930 INFO:teuthology.orchestra.run.smithi167.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 47 kB/s | 6.6 kB 00:00 2024-09-19T04:19:06.938 INFO:teuthology.orchestra.run.smithi134.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-19T04:19:06.963 INFO:teuthology.orchestra.run.smithi134.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T04:19:06.996 INFO:teuthology.orchestra.run.smithi134.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 2.3 MB/s | 79 kB 00:00 2024-09-19T04:19:07.022 INFO:teuthology.orchestra.run.smithi134.stdout:(131/156): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-09-19T04:19:07.064 INFO:teuthology.orchestra.run.smithi134.stdout:(132/156): python3-kubernetes-26.1.0-2.el9.noar 6.8 MB/s | 1.0 MB 00:00 2024-09-19T04:19:07.089 INFO:teuthology.orchestra.run.smithi134.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 664 kB/s | 16 kB 00:00 2024-09-19T04:19:07.114 INFO:teuthology.orchestra.run.smithi134.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T04:19:07.148 INFO:teuthology.orchestra.run.smithi134.stdout:(135/156): python3-pecan-1.4.2-3.el9.noarch.rpm 2.1 MB/s | 272 kB 00:00 2024-09-19T04:19:07.164 INFO:teuthology.orchestra.run.smithi167.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 3.7 MB/s | 896 kB 00:00 2024-09-19T04:19:07.173 INFO:teuthology.orchestra.run.smithi134.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 483 kB/s | 28 kB 00:00 2024-09-19T04:19:07.198 INFO:teuthology.orchestra.run.smithi134.stdout:(137/156): python3-repoze-lru-0.7-16.el9.noarch 611 kB/s | 31 kB 00:00 2024-09-19T04:19:07.223 INFO:teuthology.orchestra.run.smithi134.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T04:19:07.247 INFO:teuthology.orchestra.run.smithi167.stdout:(3/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 12 MB/s | 5.4 MB 00:00 2024-09-19T04:19:07.249 INFO:teuthology.orchestra.run.smithi134.stdout:(139/156): python3-routes-2.5.1-5.el9.noarch.rp 2.4 MB/s | 188 kB 00:00 2024-09-19T04:19:07.273 INFO:teuthology.orchestra.run.smithi167.stdout:(4/156): ceph-immutable-object-cache-19.1.1-361 1.3 MB/s | 145 kB 00:00 2024-09-19T04:19:07.274 INFO:teuthology.orchestra.run.smithi134.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 714 kB/s | 36 kB 00:00 2024-09-19T04:19:07.325 INFO:teuthology.orchestra.run.smithi134.stdout:(141/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.4 MB/s | 2.0 MB 00:00 2024-09-19T04:19:07.350 INFO:teuthology.orchestra.run.smithi134.stdout:(142/156): python3-typing-extensions-4.12.2-2.e 741 kB/s | 74 kB 00:00 2024-09-19T04:19:07.375 INFO:teuthology.orchestra.run.smithi134.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T04:19:07.381 INFO:teuthology.orchestra.run.smithi167.stdout:(5/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 18 MB/s | 2.4 MB 00:00 2024-09-19T04:19:07.392 INFO:teuthology.orchestra.run.smithi134.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T04:19:07.417 INFO:teuthology.orchestra.run.smithi134.stdout:(145/156): python3-webob-1.8.8-2.el9.noarch.rpm 1.6 MB/s | 230 kB 00:00 2024-09-19T04:19:07.442 INFO:teuthology.orchestra.run.smithi134.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 3.7 MB/s | 191 kB 00:00 2024-09-19T04:19:07.448 INFO:teuthology.orchestra.run.smithi167.stdout:(6/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 8.7 MB/s | 1.5 MB 00:00 2024-09-19T04:19:07.468 INFO:teuthology.orchestra.run.smithi134.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T04:19:07.518 INFO:teuthology.orchestra.run.smithi134.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T04:19:07.598 INFO:teuthology.orchestra.run.smithi167.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 22 MB/s | 4.7 MB 00:00 2024-09-19T04:19:07.702 INFO:teuthology.orchestra.run.smithi134.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-19T04:19:07.769 INFO:teuthology.orchestra.run.smithi134.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-19T04:19:07.810 INFO:teuthology.orchestra.run.smithi134.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 984 kB/s | 41 kB 00:00 2024-09-19T04:19:07.852 INFO:teuthology.orchestra.run.smithi134.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 5.8 MB/s | 249 kB 00:00 2024-09-19T04:19:07.911 INFO:teuthology.orchestra.run.smithi134.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-19T04:19:07.995 INFO:teuthology.orchestra.run.smithi134.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-19T04:19:08.149 INFO:teuthology.orchestra.run.smithi167.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 16 MB/s | 21 MB 00:01 2024-09-19T04:19:08.253 INFO:teuthology.orchestra.run.smithi134.stdout:(155/156): librados2-19.1.1-361.g2f599a46.el9.x 4.2 MB/s | 3.4 MB 00:00 2024-09-19T04:19:08.291 INFO:teuthology.orchestra.run.smithi167.stdout:(9/156): ceph-radosgw-19.1.1-361.g2f599a46.el9. 15 MB/s | 11 MB 00:00 2024-09-19T04:19:08.316 INFO:teuthology.orchestra.run.smithi167.stdout:(10/156): ceph-selinux-19.1.1-361.g2f599a46.el9 151 kB/s | 25 kB 00:00 2024-09-19T04:19:08.383 INFO:teuthology.orchestra.run.smithi167.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.3 MB/s | 228 kB 00:00 2024-09-19T04:19:08.442 INFO:teuthology.orchestra.run.smithi167.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 463 kB/s | 27 kB 00:00 2024-09-19T04:19:08.509 INFO:teuthology.orchestra.run.smithi167.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 477 kB/s | 32 kB 00:00 2024-09-19T04:19:08.626 INFO:teuthology.orchestra.run.smithi167.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.3 MB/s | 751 kB 00:00 2024-09-19T04:19:08.701 INFO:teuthology.orchestra.run.smithi167.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 2.1 MB/s | 163 kB 00:00 2024-09-19T04:19:08.768 INFO:teuthology.orchestra.run.smithi167.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 1.9 MB/s | 127 kB 00:00 2024-09-19T04:19:08.952 INFO:teuthology.orchestra.run.smithi167.stdout:(17/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 17 MB 00:01 2024-09-19T04:19:08.985 INFO:teuthology.orchestra.run.smithi167.stdout:(18/156): libradosstriper1-19.1.1-361.g2f599a46 2.3 MB/s | 506 kB 00:00 2024-09-19T04:19:09.036 INFO:teuthology.orchestra.run.smithi167.stdout:(19/156): python3-ceph-argparse-19.1.1-361.g2f5 905 kB/s | 45 kB 00:00 2024-09-19T04:19:09.103 INFO:teuthology.orchestra.run.smithi167.stdout:(20/156): python3-ceph-common-19.1.1-361.g2f599 2.0 MB/s | 136 kB 00:00 2024-09-19T04:19:09.170 INFO:teuthology.orchestra.run.smithi167.stdout:(21/156): python3-cephfs-19.1.1-361.g2f599a46.e 2.4 MB/s | 161 kB 00:00 2024-09-19T04:19:09.254 INFO:teuthology.orchestra.run.smithi167.stdout:(22/156): python3-rados-19.1.1-361.g2f599a46.el 3.8 MB/s | 320 kB 00:00 2024-09-19T04:19:09.379 INFO:teuthology.orchestra.run.smithi167.stdout:(23/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 13 MB/s | 5.3 MB 00:00 2024-09-19T04:19:09.404 INFO:teuthology.orchestra.run.smithi167.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 2.0 MB/s | 300 kB 00:00 2024-09-19T04:19:09.429 INFO:teuthology.orchestra.run.smithi167.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T04:19:09.463 INFO:teuthology.orchestra.run.smithi167.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.4 MB/s | 85 kB 00:00 2024-09-19T04:19:09.513 INFO:teuthology.orchestra.run.smithi167.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 3.3 MB/s | 171 kB 00:00 2024-09-19T04:19:09.572 INFO:teuthology.orchestra.run.smithi167.stdout:(28/156): ceph-grafana-dashboards-19.1.1-361.g2 546 kB/s | 32 kB 00:00 2024-09-19T04:19:09.673 INFO:teuthology.orchestra.run.smithi167.stdout:(29/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.1 MB 00:00 2024-09-19T04:19:09.697 INFO:teuthology.orchestra.run.smithi167.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 1.1 MB/s | 146 kB 00:00 2024-09-19T04:19:10.248 INFO:teuthology.orchestra.run.smithi167.stdout:(31/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 25 MB/s | 49 MB 00:01 2024-09-19T04:19:10.315 INFO:teuthology.orchestra.run.smithi167.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 5.6 MB/s | 3.6 MB 00:00 2024-09-19T04:19:10.320 INFO:teuthology.orchestra.run.smithi134.stdout:(156/156): librbd1-19.1.1-361.g2f599a46.el9.x86 1.1 MB/s | 3.2 MB 00:02 2024-09-19T04:19:10.326 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:19:10.327 INFO:teuthology.orchestra.run.smithi134.stdout:Total 20 MB/s | 226 MB 00:11 2024-09-19T04:19:10.349 INFO:teuthology.orchestra.run.smithi167.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.4 MB/s | 249 kB 00:00 2024-09-19T04:19:10.374 INFO:teuthology.orchestra.run.smithi167.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 847 kB/s | 49 kB 00:00 2024-09-19T04:19:10.378 INFO:teuthology.orchestra.run.smithi070.stdout:lab-extras 33 kB/s | 1.7 kB 00:00 2024-09-19T04:19:10.399 INFO:teuthology.orchestra.run.smithi167.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 328 kB/s | 16 kB 00:00 2024-09-19T04:19:10.433 INFO:teuthology.orchestra.run.smithi167.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 4.8 MB/s | 285 kB 00:00 2024-09-19T04:19:10.466 INFO:teuthology.orchestra.run.smithi167.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 11 MB/s | 765 kB 00:00 2024-09-19T04:19:10.492 INFO:teuthology.orchestra.run.smithi167.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 311 kB/s | 18 kB 00:00 2024-09-19T04:19:10.584 INFO:teuthology.orchestra.run.smithi167.stdout:(39/156): ceph-mgr-diskprediction-local-19.1.1- 8.4 MB/s | 7.4 MB 00:00 2024-09-19T04:19:10.701 INFO:teuthology.orchestra.run.smithi167.stdout:(40/156): fuse-2.9.9-16.el9.x86_64.rpm 341 kB/s | 80 kB 00:00 2024-09-19T04:19:10.809 INFO:teuthology.orchestra.run.smithi167.stdout:(41/156): libgfortran-11.5.0-2.el9.x86_64.rpm 2.5 MB/s | 801 kB 00:00 2024-09-19T04:19:10.843 INFO:teuthology.orchestra.run.smithi167.stdout:(42/156): libquadmath-11.5.0-2.el9.x86_64.rpm 738 kB/s | 191 kB 00:00 2024-09-19T04:19:10.868 INFO:teuthology.orchestra.run.smithi167.stdout:(43/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-19T04:19:10.927 INFO:teuthology.orchestra.run.smithi167.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 1.8 MB/s | 106 kB 00:00 2024-09-19T04:19:10.952 INFO:teuthology.orchestra.run.smithi167.stdout:(45/156): python3-pycparser-2.20-6.el9.noarch.r 1.6 MB/s | 135 kB 00:00 2024-09-19T04:19:10.986 INFO:teuthology.orchestra.run.smithi167.stdout:(46/156): python3-cryptography-36.0.1-4.el9.x86 7.0 MB/s | 1.2 MB 00:00 2024-09-19T04:19:11.011 INFO:teuthology.orchestra.run.smithi167.stdout:(47/156): python3-requests-2.25.1-8.el9.noarch. 1.5 MB/s | 125 kB 00:00 2024-09-19T04:19:11.053 INFO:teuthology.orchestra.run.smithi167.stdout:(48/156): python3-urllib3-1.26.5-6.el9.noarch.r 2.1 MB/s | 215 kB 00:00 2024-09-19T04:19:11.196 INFO:teuthology.orchestra.run.smithi167.stdout:(49/156): automake-1.16.2-8.el9.noarch.rpm 3.2 MB/s | 689 kB 00:00 2024-09-19T04:19:11.221 INFO:teuthology.orchestra.run.smithi167.stdout:(50/156): boost-program-options-1.75.0-8.el9.x8 640 kB/s | 107 kB 00:00 2024-09-19T04:19:11.246 INFO:teuthology.orchestra.run.smithi167.stdout:(51/156): elfutils-libelf-devel-0.191-4.el9.x86 432 kB/s | 22 kB 00:00 2024-09-19T04:19:11.288 INFO:teuthology.orchestra.run.smithi167.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 3.3 MB/s | 943 kB 00:00 2024-09-19T04:19:11.313 INFO:teuthology.orchestra.run.smithi167.stdout:(53/156): flexiblas-3.0.4-8.el9.x86_64.rpm 489 kB/s | 33 kB 00:00 2024-09-19T04:19:11.355 INFO:teuthology.orchestra.run.smithi167.stdout:(54/156): flex-2.6.4-9.el9.x86_64.rpm 2.3 MB/s | 313 kB 00:00 2024-09-19T04:19:11.381 INFO:teuthology.orchestra.run.smithi167.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 273 kB/s | 18 kB 00:00 2024-09-19T04:19:11.406 INFO:teuthology.orchestra.run.smithi167.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T04:19:11.431 INFO:teuthology.orchestra.run.smithi167.stdout:(57/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-09-19T04:19:11.456 INFO:teuthology.orchestra.run.smithi167.stdout:(58/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 900 kB/s | 45 kB 00:00 2024-09-19T04:19:11.515 INFO:teuthology.orchestra.run.smithi167.stdout:(59/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 13 MB/s | 3.0 MB 00:00 2024-09-19T04:19:11.540 INFO:teuthology.orchestra.run.smithi167.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 5.9 MB/s | 662 kB 00:00 2024-09-19T04:19:11.566 INFO:teuthology.orchestra.run.smithi167.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 489 kB/s | 24 kB 00:00 2024-09-19T04:19:11.572 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-09-19T04:19:11.591 INFO:teuthology.orchestra.run.smithi167.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T04:19:11.616 INFO:teuthology.orchestra.run.smithi167.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-09-19T04:19:11.650 INFO:teuthology.orchestra.run.smithi167.stdout:(64/156): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-09-19T04:19:11.675 INFO:teuthology.orchestra.run.smithi167.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 659 kB/s | 38 kB 00:00 2024-09-19T04:19:11.701 INFO:teuthology.orchestra.run.smithi167.stdout:(66/156): lua-5.4.4-4.el9.x86_64.rpm 1.7 MB/s | 188 kB 00:00 2024-09-19T04:19:11.724 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-09-19T04:19:11.724 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-09-19T04:19:11.768 INFO:teuthology.orchestra.run.smithi167.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 24 MB/s | 1.6 MB 00:00 2024-09-19T04:19:11.860 INFO:teuthology.orchestra.run.smithi167.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 24 MB/s | 4.9 MB 00:00 2024-09-19T04:19:11.927 INFO:teuthology.orchestra.run.smithi167.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 18 MB/s | 4.4 MB 00:00 2024-09-19T04:19:11.960 INFO:teuthology.orchestra.run.smithi167.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.3 MB/s | 137 kB 00:00 2024-09-19T04:19:11.985 INFO:teuthology.orchestra.run.smithi167.stdout:(71/156): postgresql-contrib-13.16-1.el9.x86_64 4.1 MB/s | 910 kB 00:00 2024-09-19T04:19:12.019 INFO:teuthology.orchestra.run.smithi167.stdout:(72/156): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-09-19T04:19:12.045 INFO:teuthology.orchestra.run.smithi167.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-09-19T04:19:12.087 INFO:teuthology.orchestra.run.smithi167.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-09-19T04:19:12.187 INFO:teuthology.orchestra.run.smithi167.stdout:(75/156): postgresql-server-13.16-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-09-19T04:19:12.212 INFO:teuthology.orchestra.run.smithi167.stdout:(76/156): python3-devel-3.9.19-8.el9.x86_64.rpm 1.9 MB/s | 245 kB 00:00 2024-09-19T04:19:12.238 INFO:teuthology.orchestra.run.smithi167.stdout:(77/156): python3-jinja2-2.11.3-6.el9.noarch.rp 4.8 MB/s | 248 kB 00:00 2024-09-19T04:19:12.263 INFO:teuthology.orchestra.run.smithi167.stdout:(78/156): python3-jsonpatch-1.21-16.el9.noarch. 509 kB/s | 26 kB 00:00 2024-09-19T04:19:12.288 INFO:teuthology.orchestra.run.smithi167.stdout:(79/156): python3-jsonpointer-2.0-4.el9.noarch. 380 kB/s | 19 kB 00:00 2024-09-19T04:19:12.313 INFO:teuthology.orchestra.run.smithi167.stdout:(80/156): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T04:19:12.339 INFO:teuthology.orchestra.run.smithi167.stdout:(81/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-19T04:19:12.423 INFO:teuthology.orchestra.run.smithi167.stdout:(82/156): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-09-19T04:19:12.448 INFO:teuthology.orchestra.run.smithi167.stdout:(83/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.3 MB/s | 250 kB 00:00 2024-09-19T04:19:12.473 INFO:teuthology.orchestra.run.smithi167.stdout:(84/156): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-09-19T04:19:12.498 INFO:teuthology.orchestra.run.smithi167.stdout:(85/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T04:19:12.524 INFO:teuthology.orchestra.run.smithi167.stdout:(86/156): python3-prettytable-0.7.2-27.el9.noar 842 kB/s | 42 kB 00:00 2024-09-19T04:19:12.549 INFO:teuthology.orchestra.run.smithi167.stdout:(87/156): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-09-19T04:19:12.564 INFO:teuthology.orchestra.run.smithi070.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:19:12.565 INFO:teuthology.orchestra.run.smithi070.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-09-19T04:19:12.574 INFO:teuthology.orchestra.run.smithi167.stdout:(88/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-09-19T04:19:12.577 INFO:teuthology.orchestra.run.smithi070.stdout:Package NetworkManager-1:1.48.8-1.el9.x86_64 is already installed. 2024-09-19T04:19:12.578 INFO:teuthology.orchestra.run.smithi070.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-09-19T04:19:12.578 INFO:teuthology.orchestra.run.smithi070.stdout:Package util-linux-2.37.4-20.el9.x86_64 is already installed. 2024-09-19T04:19:12.579 INFO:teuthology.orchestra.run.smithi070.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-09-19T04:19:12.581 INFO:teuthology.orchestra.run.smithi070.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-09-19T04:19:12.584 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-09-19T04:19:12.584 INFO:teuthology.orchestra.run.smithi070.stdout:Package xfsprogs-6.4.0-4.el9.x86_64 is already installed. 2024-09-19T04:19:12.608 INFO:teuthology.orchestra.run.smithi167.stdout:(89/156): python3-pyasn1-modules-0.4.8-6.el9.no 4.6 MB/s | 279 kB 00:00 2024-09-19T04:19:12.633 INFO:teuthology.orchestra.run.smithi167.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 871 kB/s | 51 kB 00:00 2024-09-19T04:19:12.648 INFO:teuthology.orchestra.run.smithi070.stdout:Dependencies resolved. 2024-09-19T04:19:12.658 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-19T04:19:12.658 INFO:teuthology.orchestra.run.smithi070.stdout: Package Arch Version Repository Size 2024-09-19T04:19:12.658 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-19T04:19:12.658 INFO:teuthology.orchestra.run.smithi070.stdout:Installing: 2024-09-19T04:19:12.658 INFO:teuthology.orchestra.run.smithi070.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-09-19T04:19:12.658 INFO:teuthology.orchestra.run.smithi070.stdout: ceph x86_64 2:19.1.1-361.g2f599a46.el9 ceph 6.6 k 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.4 M 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 896 k 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache x86_64 2:19.1.1-361.g2f599a46.el9 ceph 145 k 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr x86_64 2:19.1.1-361.g2f599a46.el9 ceph 1.5 M 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 146 k 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 3.6 M 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 7.4 M 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 49 k 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 11 M 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test x86_64 2:19.1.1-361.g2f599a46.el9 ceph 49 M 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 285 k 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 765 k 2024-09-19T04:19:12.659 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 228 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell x86_64 2:19.1.1-361.g2f599a46.el9 ceph 27 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 18 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 32 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 751 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel x86_64 2:19.1.1-361.g2f599a46.el9 ceph 127 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel x86_64 2.37.4-20.el9 appstream 24 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel x86_64 1:3.2.2-6.el9 appstream 4.4 M 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql x86_64 13.16-1.el9 appstream 1.6 M 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib x86_64 13.16-1.el9 appstream 910 k 2024-09-19T04:19:12.660 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server x86_64 13.16-1.el9 appstream 5.8 M 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs x86_64 2:19.1.1-361.g2f599a46.el9 ceph 161 k 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados x86_64 2:19.1.1-361.g2f599a46.el9 ceph 320 k 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 300 k 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw x86_64 2:19.1.1-361.g2f599a46.el9 ceph 99 k 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 85 k 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.1 M 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 171 k 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel x86_64 6.4.0-4.el9 appstream 96 k 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrading: 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager x86_64 1:1.51.0-1.el9 baseos 2.3 M 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm x86_64 1:1.51.0-1.el9 baseos 1.8 M 2024-09-19T04:19:12.661 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team x86_64 1:1.51.0-1.el9 baseos 41 k 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui x86_64 1:1.51.0-1.el9 baseos 249 k 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: librados2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.4 M 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 3.2 M 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: openssl x86_64 1:3.2.2-6.el9 baseos 1.4 M 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs x86_64 1:3.2.2-6.el9 baseos 2.4 M 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout:Installing dependencies: 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 21 M 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 32 k 2024-09-19T04:19:12.662 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds x86_64 2:19.1.1-361.g2f599a46.el9 ceph 2.4 M 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 249 k 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon x86_64 2:19.1.1-361.g2f599a46.el9 ceph 4.7 M 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd x86_64 2:19.1.1-361.g2f599a46.el9 ceph 17 M 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts noarch 2:19.1.1-361.g2f599a46.el9 ceph-noarch 16 k 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux x86_64 2:19.1.1-361.g2f599a46.el9 ceph 25 k 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T04:19:12.663 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite x86_64 2:19.1.1-361.g2f599a46.el9 ceph 163 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 506 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2 x86_64 2:19.1.1-361.g2f599a46.el9 ceph 5.3 M 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-09-19T04:19:12.664 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs x86_64 13.16-1.el9 appstream 137 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T04:19:12.665 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse x86_64 2:19.1.1-361.g2f599a46.el9 ceph 45 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common x86_64 2:19.1.1-361.g2f599a46.el9 ceph 136 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T04:19:12.666 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T04:19:12.667 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T04:19:12.668 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T04:19:12.669 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T04:19:12.670 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout:Installing weak dependencies: 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:19:12.671 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction Summary 2024-09-19T04:19:12.672 INFO:teuthology.orchestra.run.smithi070.stdout:====================================================================================== 2024-09-19T04:19:12.672 INFO:teuthology.orchestra.run.smithi070.stdout:Install 148 Packages 2024-09-19T04:19:12.672 INFO:teuthology.orchestra.run.smithi070.stdout:Upgrade 8 Packages 2024-09-19T04:19:12.672 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:19:12.673 INFO:teuthology.orchestra.run.smithi167.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T04:19:12.673 INFO:teuthology.orchestra.run.smithi070.stdout:Total download size: 226 M 2024-09-19T04:19:12.673 INFO:teuthology.orchestra.run.smithi070.stdout:Downloading Packages: 2024-09-19T04:19:12.742 INFO:teuthology.orchestra.run.smithi167.stdout:(92/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-09-19T04:19:12.776 INFO:teuthology.orchestra.run.smithi167.stdout:(93/156): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 42 kB 00:00 2024-09-19T04:19:12.801 INFO:teuthology.orchestra.run.smithi167.stdout:(94/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 757 kB/s | 44 kB 00:00 2024-09-19T04:19:12.826 INFO:teuthology.orchestra.run.smithi167.stdout:(95/156): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T04:19:12.852 INFO:teuthology.orchestra.run.smithi167.stdout:(96/156): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-09-19T04:19:12.877 INFO:teuthology.orchestra.run.smithi167.stdout:(97/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 943 kB/s | 47 kB 00:00 2024-09-19T04:19:12.911 INFO:teuthology.orchestra.run.smithi167.stdout:(98/156): socat-1.7.4.1-6.el9.x86_64.rpm 5.1 MB/s | 304 kB 00:00 2024-09-19T04:19:12.936 INFO:teuthology.orchestra.run.smithi167.stdout:(99/156): uuid-1.6.2-55.el9.x86_64.rpm 989 kB/s | 58 kB 00:00 2024-09-19T04:19:12.961 INFO:teuthology.orchestra.run.smithi167.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-09-19T04:19:12.987 INFO:teuthology.orchestra.run.smithi167.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T04:19:13.020 INFO:teuthology.orchestra.run.smithi167.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 762 kB/s | 45 kB 00:00 2024-09-19T04:19:13.104 INFO:teuthology.orchestra.run.smithi167.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 191 kB/s | 22 kB 00:00 2024-09-19T04:19:13.154 INFO:teuthology.orchestra.run.smithi167.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T04:19:13.188 INFO:teuthology.orchestra.run.smithi167.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.1 MB/s | 308 kB 00:00 2024-09-19T04:19:13.213 INFO:teuthology.orchestra.run.smithi167.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 779 kB/s | 19 kB 00:00 2024-09-19T04:19:13.247 INFO:teuthology.orchestra.run.smithi167.stdout:(107/156): protobuf-compiler-3.14.0-13.el9.x86_ 3.7 MB/s | 863 kB 00:00 2024-09-19T04:19:13.396 INFO:teuthology.orchestra.run.smithi070.stdout:(1/156): ceph-19.1.1-361.g2f599a46.el9.x86_64.r 53 kB/s | 6.6 kB 00:00 2024-09-19T04:19:13.431 INFO:teuthology.orchestra.run.smithi167.stdout:(108/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 20 MB/s | 16 MB 00:00 2024-09-19T04:19:13.464 INFO:teuthology.orchestra.run.smithi167.stdout:(109/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 120 kB/s | 26 kB 00:00 2024-09-19T04:19:13.489 INFO:teuthology.orchestra.run.smithi167.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.9 MB/s | 67 kB 00:00 2024-09-19T04:19:13.506 INFO:teuthology.orchestra.run.smithi167.stdout:(111/156): liboath-2.6.7-2.el9.x86_64.rpm 663 kB/s | 49 kB 00:00 2024-09-19T04:19:13.540 INFO:teuthology.orchestra.run.smithi167.stdout:(112/156): luarocks-3.9.2-5.el9.noarch.rpm 2.9 MB/s | 151 kB 00:00 2024-09-19T04:19:13.591 INFO:teuthology.orchestra.run.smithi167.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 11 MB/s | 548 kB 00:00 2024-09-19T04:19:13.605 INFO:teuthology.orchestra.run.smithi070.stdout:(2/156): ceph-fuse-19.1.1-361.g2f599a46.el9.x86 4.2 MB/s | 896 kB 00:00 2024-09-19T04:19:13.607 INFO:teuthology.orchestra.run.smithi167.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 2.6 MB/s | 43 kB 00:00 2024-09-19T04:19:13.624 INFO:teuthology.orchestra.run.smithi167.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-09-19T04:19:13.658 INFO:teuthology.orchestra.run.smithi167.stdout:(116/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.4 MB/s | 839 kB 00:00 2024-09-19T04:19:13.683 INFO:teuthology.orchestra.run.smithi167.stdout:(117/156): python3-certifi-2023.05.07-4.el9.noa 241 kB/s | 14 kB 00:00 2024-09-19T04:19:13.688 INFO:teuthology.orchestra.run.smithi070.stdout:(3/156): ceph-immutable-object-cache-19.1.1-361 1.7 MB/s | 145 kB 00:00 2024-09-19T04:19:13.709 INFO:teuthology.orchestra.run.smithi167.stdout:(118/156): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-09-19T04:19:13.742 INFO:teuthology.orchestra.run.smithi167.stdout:(119/156): python3-cherrypy-18.6.1-2.el9.noarch 6.0 MB/s | 358 kB 00:00 2024-09-19T04:19:13.767 INFO:teuthology.orchestra.run.smithi167.stdout:(120/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.1 MB/s | 303 kB 00:00 2024-09-19T04:19:13.780 INFO:teuthology.orchestra.run.smithi070.stdout:(4/156): ceph-base-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 5.4 MB 00:00 2024-09-19T04:19:13.912 INFO:teuthology.orchestra.run.smithi167.stdout:(121/156): python3-google-auth-2.34.0-1.el9.noa 1.3 MB/s | 220 kB 00:00 2024-09-19T04:19:13.930 INFO:teuthology.orchestra.run.smithi070.stdout:(5/156): ceph-mgr-19.1.1-361.g2f599a46.el9.x86_ 10 MB/s | 1.5 MB 00:00 2024-09-19T04:19:13.951 INFO:teuthology.orchestra.run.smithi167.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 3.6 MB/s | 144 kB 00:00 2024-09-19T04:19:13.976 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-09-19T04:19:13.977 INFO:teuthology.orchestra.run.smithi167.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-09-19T04:19:13.977 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-09-19T04:19:14.002 INFO:teuthology.orchestra.run.smithi167.stdout:(124/156): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-09-19T04:19:14.028 INFO:teuthology.orchestra.run.smithi167.stdout:(125/156): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-09-19T04:19:14.053 INFO:teuthology.orchestra.run.smithi167.stdout:(126/156): python3-jaraco-functools-3.5.0-2.el9 780 kB/s | 19 kB 00:00 2024-09-19T04:19:14.078 INFO:teuthology.orchestra.run.smithi167.stdout:(127/156): python3-jaraco-text-3.2.0-6.el9.noar 786 kB/s | 20 kB 00:00 2024-09-19T04:19:14.097 INFO:teuthology.orchestra.run.smithi070.stdout:(6/156): ceph-mds-19.1.1-361.g2f599a46.el9.x86_ 5.8 MB/s | 2.4 MB 00:00 2024-09-19T04:19:14.146 INFO:teuthology.orchestra.run.smithi167.stdout:(128/156): python3-kubernetes-26.1.0-2.el9.noar 15 MB/s | 1.0 MB 00:00 2024-09-19T04:19:14.171 INFO:teuthology.orchestra.run.smithi167.stdout:(129/156): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-09-19T04:19:14.196 INFO:teuthology.orchestra.run.smithi167.stdout:(130/156): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-09-19T04:19:14.206 INFO:teuthology.orchestra.run.smithi070.stdout:(7/156): ceph-mon-19.1.1-361.g2f599a46.el9.x86_ 17 MB/s | 4.7 MB 00:00 2024-09-19T04:19:14.263 INFO:teuthology.orchestra.run.smithi167.stdout:(131/156): libarrow-9.0.0-11.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-09-19T04:19:14.288 INFO:teuthology.orchestra.run.smithi167.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 628 kB/s | 58 kB 00:00 2024-09-19T04:19:14.314 INFO:teuthology.orchestra.run.smithi167.stdout:(133/156): python3-portend-3.1.0-2.el9.noarch.r 661 kB/s | 16 kB 00:00 2024-09-19T04:19:14.356 INFO:teuthology.orchestra.run.smithi167.stdout:(134/156): python3-grpcio-1.46.7-10.el9.x86_64. 3.5 MB/s | 2.0 MB 00:00 2024-09-19T04:19:14.381 INFO:teuthology.orchestra.run.smithi167.stdout:(135/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-09-19T04:19:14.406 INFO:teuthology.orchestra.run.smithi167.stdout:(136/156): python3-pyperclip-1.8.2-2.el9.noarch 561 kB/s | 28 kB 00:00 2024-09-19T04:19:14.432 INFO:teuthology.orchestra.run.smithi167.stdout:(137/156): python3-pecan-1.4.2-3.el9.noarch.rpm 1.6 MB/s | 272 kB 00:00 2024-09-19T04:19:14.457 INFO:teuthology.orchestra.run.smithi167.stdout:(138/156): python3-repoze-lru-0.7-16.el9.noarch 407 kB/s | 31 kB 00:00 2024-09-19T04:19:14.482 INFO:teuthology.orchestra.run.smithi167.stdout:(139/156): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-09-19T04:19:14.507 INFO:teuthology.orchestra.run.smithi167.stdout:(140/156): python3-tempora-5.0.0-2.el9.noarch.r 713 kB/s | 36 kB 00:00 2024-09-19T04:19:14.533 INFO:teuthology.orchestra.run.smithi167.stdout:(141/156): python3-typing-extensions-4.12.2-2.e 1.5 MB/s | 74 kB 00:00 2024-09-19T04:19:14.558 INFO:teuthology.orchestra.run.smithi167.stdout:(142/156): python3-routes-2.5.1-5.el9.noarch.rp 1.2 MB/s | 188 kB 00:00 2024-09-19T04:19:14.583 INFO:teuthology.orchestra.run.smithi167.stdout:(143/156): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-09-19T04:19:14.608 INFO:teuthology.orchestra.run.smithi167.stdout:(144/156): python3-webob-1.8.8-2.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-09-19T04:19:14.626 INFO:teuthology.orchestra.run.smithi167.stdout:(145/156): python3-zc-lockfile-2.0-10.el9.noarc 476 kB/s | 20 kB 00:00 2024-09-19T04:19:14.631 INFO:teuthology.orchestra.run.smithi070.stdout:(8/156): ceph-common-19.1.1-361.g2f599a46.el9.x 16 MB/s | 21 MB 00:01 2024-09-19T04:19:14.651 INFO:teuthology.orchestra.run.smithi167.stdout:(146/156): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T04:19:14.676 INFO:teuthology.orchestra.run.smithi167.stdout:(147/156): python3-werkzeug-2.0.3-3.el9.1.noarc 3.5 MB/s | 427 kB 00:00 2024-09-19T04:19:14.681 INFO:teuthology.orchestra.run.smithi070.stdout:(9/156): ceph-selinux-19.1.1-361.g2f599a46.el9. 505 kB/s | 25 kB 00:00 2024-09-19T04:19:14.727 INFO:teuthology.orchestra.run.smithi167.stdout:(148/156): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-09-19T04:19:14.834 INFO:teuthology.orchestra.run.smithi070.stdout:(10/156): ceph-radosgw-19.1.1-361.g2f599a46.el9 17 MB/s | 11 MB 00:00 2024-09-19T04:19:14.909 INFO:teuthology.orchestra.run.smithi070.stdout:(11/156): cephfs-mirror-19.1.1-361.g2f599a46.el 3.0 MB/s | 228 kB 00:00 2024-09-19T04:19:14.919 INFO:teuthology.orchestra.run.smithi167.stdout:(149/156): librados2-19.1.1-361.g2f599a46.el9.x 13 MB/s | 3.4 MB 00:00 2024-09-19T04:19:14.968 INFO:teuthology.orchestra.run.smithi070.stdout:(12/156): cephfs-shell-19.1.1-361.g2f599a46.el9 465 kB/s | 27 kB 00:00 2024-09-19T04:19:15.026 INFO:teuthology.orchestra.run.smithi070.stdout:(13/156): libcephfs-devel-19.1.1-361.g2f599a46. 546 kB/s | 32 kB 00:00 2024-09-19T04:19:15.027 INFO:teuthology.orchestra.run.smithi167.stdout:(150/156): NetworkManager-1.51.0-1.el9.x86_64.r 7.9 MB/s | 2.3 MB 00:00 2024-09-19T04:19:15.086 INFO:teuthology.orchestra.run.smithi167.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 704 kB/s | 41 kB 00:00 2024-09-19T04:19:15.137 INFO:teuthology.orchestra.run.smithi070.stdout:(14/156): libcephfs2-19.1.1-361.g2f599a46.el9.x 6.6 MB/s | 751 kB 00:00 2024-09-19T04:19:15.144 INFO:teuthology.orchestra.run.smithi167.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.2 MB/s | 249 kB 00:00 2024-09-19T04:19:15.185 INFO:teuthology.orchestra.run.smithi070.stdout:(15/156): libcephsqlite-19.1.1-361.g2f599a46.el 3.3 MB/s | 163 kB 00:00 2024-09-19T04:19:15.220 INFO:teuthology.orchestra.run.smithi167.stdout:(153/156): NetworkManager-libnm-1.51.0-1.el9.x8 6.0 MB/s | 1.8 MB 00:00 2024-09-19T04:19:15.244 INFO:teuthology.orchestra.run.smithi070.stdout:(16/156): librados-devel-19.1.1-361.g2f599a46.e 2.1 MB/s | 127 kB 00:00 2024-09-19T04:19:15.262 INFO:teuthology.orchestra.run.smithi167.stdout:(154/156): openssl-3.2.2-6.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-09-19T04:19:15.311 INFO:teuthology.orchestra.run.smithi070.stdout:(17/156): libradosstriper1-19.1.1-361.g2f599a46 7.4 MB/s | 506 kB 00:00 2024-09-19T04:19:15.329 INFO:teuthology.orchestra.run.smithi167.stdout:(155/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 22 MB/s | 2.4 MB 00:00 2024-09-19T04:19:15.537 INFO:teuthology.orchestra.run.smithi167.stdout:(156/156): librbd1-19.1.1-361.g2f599a46.el9.x86 3.7 MB/s | 3.2 MB 00:00 2024-09-19T04:19:15.544 INFO:teuthology.orchestra.run.smithi167.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:19:15.544 INFO:teuthology.orchestra.run.smithi167.stdout:Total 24 MB/s | 226 MB 00:09 2024-09-19T04:19:15.586 INFO:teuthology.orchestra.run.smithi070.stdout:(18/156): ceph-osd-19.1.1-361.g2f599a46.el9.x86 11 MB/s | 17 MB 00:01 2024-09-19T04:19:15.687 INFO:teuthology.orchestra.run.smithi070.stdout:(19/156): librgw2-19.1.1-361.g2f599a46.el9.x86_ 14 MB/s | 5.3 MB 00:00 2024-09-19T04:19:15.711 INFO:teuthology.orchestra.run.smithi070.stdout:(20/156): python3-ceph-argparse-19.1.1-361.g2f5 361 kB/s | 45 kB 00:00 2024-09-19T04:19:15.737 INFO:teuthology.orchestra.run.smithi070.stdout:(21/156): python3-ceph-common-19.1.1-361.g2f599 2.7 MB/s | 136 kB 00:00 2024-09-19T04:19:15.762 INFO:teuthology.orchestra.run.smithi070.stdout:(22/156): python3-cephfs-19.1.1-361.g2f599a46.e 3.1 MB/s | 161 kB 00:00 2024-09-19T04:19:15.788 INFO:teuthology.orchestra.run.smithi070.stdout:(23/156): python3-rados-19.1.1-361.g2f599a46.el 6.2 MB/s | 320 kB 00:00 2024-09-19T04:19:15.813 INFO:teuthology.orchestra.run.smithi070.stdout:(24/156): python3-rbd-19.1.1-361.g2f599a46.el9. 5.9 MB/s | 300 kB 00:00 2024-09-19T04:19:15.838 INFO:teuthology.orchestra.run.smithi070.stdout:(25/156): python3-rgw-19.1.1-361.g2f599a46.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T04:19:15.864 INFO:teuthology.orchestra.run.smithi070.stdout:(26/156): rbd-fuse-19.1.1-361.g2f599a46.el9.x86 1.7 MB/s | 85 kB 00:00 2024-09-19T04:19:15.922 INFO:teuthology.orchestra.run.smithi070.stdout:(27/156): rbd-nbd-19.1.1-361.g2f599a46.el9.x86_ 2.9 MB/s | 171 kB 00:00 2024-09-19T04:19:15.998 INFO:teuthology.orchestra.run.smithi070.stdout:(28/156): rbd-mirror-19.1.1-361.g2f599a46.el9.x 20 MB/s | 3.1 MB 00:00 2024-09-19T04:19:16.023 INFO:teuthology.orchestra.run.smithi070.stdout:(29/156): ceph-grafana-dashboards-19.1.1-361.g2 317 kB/s | 32 kB 00:00 2024-09-19T04:19:16.048 INFO:teuthology.orchestra.run.smithi070.stdout:(30/156): ceph-mgr-cephadm-19.1.1-361.g2f599a46 2.9 MB/s | 146 kB 00:00 2024-09-19T04:19:16.424 INFO:teuthology.orchestra.run.smithi070.stdout:(31/156): ceph-mgr-diskprediction-local-19.1.1- 20 MB/s | 7.4 MB 00:00 2024-09-19T04:19:16.491 INFO:teuthology.orchestra.run.smithi070.stdout:(32/156): ceph-mgr-dashboard-19.1.1-361.g2f599a 7.6 MB/s | 3.6 MB 00:00 2024-09-19T04:19:16.516 INFO:teuthology.orchestra.run.smithi070.stdout:(33/156): ceph-mgr-modules-core-19.1.1-361.g2f5 2.7 MB/s | 249 kB 00:00 2024-09-19T04:19:16.541 INFO:teuthology.orchestra.run.smithi070.stdout:(34/156): ceph-mgr-rook-19.1.1-361.g2f599a46.el 987 kB/s | 49 kB 00:00 2024-09-19T04:19:16.558 INFO:teuthology.orchestra.run.smithi070.stdout:(35/156): ceph-prometheus-alerts-19.1.1-361.g2f 392 kB/s | 16 kB 00:00 2024-09-19T04:19:16.591 INFO:teuthology.orchestra.run.smithi070.stdout:(36/156): ceph-volume-19.1.1-361.g2f599a46.el9. 5.5 MB/s | 285 kB 00:00 2024-09-19T04:19:16.634 INFO:teuthology.orchestra.run.smithi070.stdout:(37/156): cephadm-19.1.1-361.g2f599a46.el9.noar 9.9 MB/s | 765 kB 00:00 2024-09-19T04:19:16.659 INFO:teuthology.orchestra.run.smithi070.stdout:(38/156): cephfs-top-19.1.1-361.g2f599a46.el9.n 271 kB/s | 18 kB 00:00 2024-09-19T04:19:16.768 INFO:teuthology.orchestra.run.smithi070.stdout:(39/156): fuse-2.9.9-16.el9.x86_64.rpm 598 kB/s | 80 kB 00:00 2024-09-19T04:19:16.779 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction check 2024-09-19T04:19:16.843 INFO:teuthology.orchestra.run.smithi070.stdout:(40/156): libgfortran-11.5.0-2.el9.x86_64.rpm 4.3 MB/s | 801 kB 00:00 2024-09-19T04:19:16.868 INFO:teuthology.orchestra.run.smithi070.stdout:(41/156): libquadmath-11.5.0-2.el9.x86_64.rpm 1.9 MB/s | 191 kB 00:00 2024-09-19T04:19:16.902 INFO:teuthology.orchestra.run.smithi070.stdout:(42/156): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.2 MB/s | 253 kB 00:00 2024-09-19T04:19:16.930 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction check succeeded. 2024-09-19T04:19:16.931 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction test 2024-09-19T04:19:17.344 INFO:teuthology.orchestra.run.smithi070.stdout:(43/156): ceph-test-19.1.1-361.g2f599a46.el9.x8 18 MB/s | 49 MB 00:02 2024-09-19T04:19:17.369 INFO:teuthology.orchestra.run.smithi070.stdout:(44/156): python3-ply-3.11-14.el9.noarch.rpm 228 kB/s | 106 kB 00:00 2024-09-19T04:19:17.411 INFO:teuthology.orchestra.run.smithi070.stdout:(45/156): python3-cryptography-36.0.1-4.el9.x86 2.3 MB/s | 1.2 MB 00:00 2024-09-19T04:19:17.437 INFO:teuthology.orchestra.run.smithi070.stdout:(46/156): python3-requests-2.25.1-8.el9.noarch. 1.8 MB/s | 125 kB 00:00 2024-09-19T04:19:17.462 INFO:teuthology.orchestra.run.smithi070.stdout:(47/156): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-09-19T04:19:17.487 INFO:teuthology.orchestra.run.smithi070.stdout:(48/156): python3-pycparser-2.20-6.el9.noarch.r 950 kB/s | 135 kB 00:00 2024-09-19T04:19:17.621 INFO:teuthology.orchestra.run.smithi070.stdout:(49/156): boost-program-options-1.75.0-8.el9.x8 802 kB/s | 107 kB 00:00 2024-09-19T04:19:17.671 INFO:teuthology.orchestra.run.smithi070.stdout:(50/156): elfutils-libelf-devel-0.191-4.el9.x86 434 kB/s | 22 kB 00:00 2024-09-19T04:19:17.763 INFO:teuthology.orchestra.run.smithi070.stdout:(51/156): automake-1.16.2-8.el9.noarch.rpm 2.1 MB/s | 689 kB 00:00 2024-09-19T04:19:17.813 INFO:teuthology.orchestra.run.smithi070.stdout:(52/156): bison-3.7.4-5.el9.x86_64.rpm 2.6 MB/s | 943 kB 00:00 2024-09-19T04:19:17.838 INFO:teuthology.orchestra.run.smithi070.stdout:(53/156): flex-2.6.4-9.el9.x86_64.rpm 1.8 MB/s | 313 kB 00:00 2024-09-19T04:19:17.864 INFO:teuthology.orchestra.run.smithi070.stdout:(54/156): flexiblas-3.0.4-8.el9.x86_64.rpm 325 kB/s | 33 kB 00:00 2024-09-19T04:19:17.889 INFO:teuthology.orchestra.run.smithi070.stdout:(55/156): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-09-19T04:19:17.914 INFO:teuthology.orchestra.run.smithi070.stdout:(56/156): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-09-19T04:19:17.965 INFO:teuthology.orchestra.run.smithi070.stdout:(57/156): librabbitmq-0.11.0-7.el9.x86_64.rpm 907 kB/s | 45 kB 00:00 2024-09-19T04:19:17.990 INFO:teuthology.orchestra.run.smithi070.stdout:(58/156): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-09-19T04:19:18.132 INFO:teuthology.orchestra.run.smithi070.stdout:(59/156): libtool-2.4.6-46.el9.x86_64.rpm 4.0 MB/s | 581 kB 00:00 2024-09-19T04:19:18.157 INFO:teuthology.orchestra.run.smithi070.stdout:(60/156): librdkafka-1.6.1-102.el9.x86_64.rpm 3.4 MB/s | 662 kB 00:00 2024-09-19T04:19:18.183 INFO:teuthology.orchestra.run.smithi070.stdout:(61/156): libuuid-devel-2.37.4-20.el9.x86_64.rp 486 kB/s | 24 kB 00:00 2024-09-19T04:19:18.208 INFO:teuthology.orchestra.run.smithi070.stdout:(62/156): libzstd-devel-1.5.1-2.el9.x86_64.rpm 945 kB/s | 47 kB 00:00 2024-09-19T04:19:18.266 INFO:teuthology.orchestra.run.smithi070.stdout:(63/156): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.4 MB/s | 292 kB 00:00 2024-09-19T04:19:18.292 INFO:teuthology.orchestra.run.smithi070.stdout:(64/156): lua-5.4.4-4.el9.x86_64.rpm 2.2 MB/s | 188 kB 00:00 2024-09-19T04:19:18.376 INFO:teuthology.orchestra.run.smithi070.stdout:(65/156): openblas-0.3.26-2.el9.x86_64.rpm 353 kB/s | 38 kB 00:00 2024-09-19T04:19:18.718 INFO:teuthology.orchestra.run.smithi070.stdout:(66/156): flexiblas-netlib-3.0.4-8.el9.x86_64.r 3.3 MB/s | 3.0 MB 00:00 2024-09-19T04:19:19.195 INFO:teuthology.orchestra.run.smithi167.stdout:Transaction test succeeded. 2024-09-19T04:19:19.195 INFO:teuthology.orchestra.run.smithi167.stdout:Running transaction 2024-09-19T04:19:19.268 INFO:teuthology.orchestra.run.smithi070.stdout:(67/156): postgresql-13.16-1.el9.x86_64.rpm 2.9 MB/s | 1.6 MB 00:00 2024-09-19T04:19:19.368 INFO:teuthology.orchestra.run.smithi070.stdout:(68/156): openblas-openmp-0.3.26-2.el9.x86_64.r 4.6 MB/s | 4.9 MB 00:01 2024-09-19T04:19:19.435 INFO:teuthology.orchestra.run.smithi070.stdout:(69/156): openssl-devel-3.2.2-6.el9.x86_64.rpm 4.2 MB/s | 4.4 MB 00:01 2024-09-19T04:19:19.460 INFO:teuthology.orchestra.run.smithi070.stdout:(70/156): postgresql-private-libs-13.16-1.el9.x 1.5 MB/s | 137 kB 00:00 2024-09-19T04:19:19.652 INFO:teuthology.orchestra.run.smithi070.stdout:(71/156): protobuf-3.14.0-13.el9.x86_64.rpm 5.3 MB/s | 1.0 MB 00:00 2024-09-19T04:19:19.677 INFO:teuthology.orchestra.run.smithi070.stdout:(72/156): postgresql-contrib-13.16-1.el9.x86_64 2.2 MB/s | 910 kB 00:00 2024-09-19T04:19:19.703 INFO:teuthology.orchestra.run.smithi070.stdout:(73/156): python3-attrs-20.3.0-7.el9.noarch.rpm 1.7 MB/s | 87 kB 00:00 2024-09-19T04:19:19.753 INFO:teuthology.orchestra.run.smithi070.stdout:(74/156): python3-colorama-0.4.6-3.el9.noarch.r 1.2 MB/s | 61 kB 00:00 2024-09-19T04:19:19.837 INFO:teuthology.orchestra.run.smithi070.stdout:(75/156): python3-devel-3.9.19-8.el9.x86_64.rpm 2.9 MB/s | 245 kB 00:00 2024-09-19T04:19:19.920 INFO:teuthology.orchestra.run.smithi070.stdout:(76/156): python3-jinja2-2.11.3-6.el9.noarch.rp 2.9 MB/s | 248 kB 00:00 2024-09-19T04:19:19.970 INFO:teuthology.orchestra.run.smithi070.stdout:(77/156): python3-jsonpatch-1.21-16.el9.noarch. 514 kB/s | 26 kB 00:00 2024-09-19T04:19:20.021 INFO:teuthology.orchestra.run.smithi070.stdout:(78/156): python3-jsonpointer-2.0-4.el9.noarch. 383 kB/s | 19 kB 00:00 2024-09-19T04:19:20.079 INFO:teuthology.orchestra.run.smithi070.stdout:(79/156): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-09-19T04:19:20.130 INFO:teuthology.orchestra.run.smithi070.stdout:(80/156): python3-markupsafe-1.1.1-12.el9.x86_6 694 kB/s | 35 kB 00:00 2024-09-19T04:19:20.384 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-09-19T04:19:20.455 INFO:teuthology.orchestra.run.smithi070.stdout:(81/156): postgresql-server-13.16-1.el9.x86_64. 5.7 MB/s | 5.8 MB 00:01 2024-09-19T04:19:20.489 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:19:20.531 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:19:20.539 INFO:teuthology.orchestra.run.smithi070.stdout:(82/156): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.9 MB/s | 250 kB 00:00 2024-09-19T04:19:20.599 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:19:20.622 INFO:teuthology.orchestra.run.smithi070.stdout:(83/156): python3-oauthlib-3.1.1-5.el9.noarch.r 2.6 MB/s | 222 kB 00:00 2024-09-19T04:19:20.640 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:19:20.665 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:19:20.672 INFO:teuthology.orchestra.run.smithi070.stdout:(84/156): python3-packaging-20.9-5.el9.noarch.r 1.5 MB/s | 77 kB 00:00 2024-09-19T04:19:20.723 INFO:teuthology.orchestra.run.smithi070.stdout:(85/156): python3-prettytable-0.7.2-27.el9.noar 845 kB/s | 42 kB 00:00 2024-09-19T04:19:20.723 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:19:20.815 INFO:teuthology.orchestra.run.smithi070.stdout:(86/156): python3-protobuf-3.14.0-13.el9.noarch 2.9 MB/s | 269 kB 00:00 2024-09-19T04:19:20.898 INFO:teuthology.orchestra.run.smithi070.stdout:(87/156): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.9 MB/s | 159 kB 00:00 2024-09-19T04:19:20.982 INFO:teuthology.orchestra.run.smithi070.stdout:(88/156): python3-pyasn1-modules-0.4.8-6.el9.no 3.3 MB/s | 279 kB 00:00 2024-09-19T04:19:21.049 INFO:teuthology.orchestra.run.smithi070.stdout:(89/156): python3-numpy-1.20.1-5.el9.x86_64.rpm 5.5 MB/s | 5.1 MB 00:00 2024-09-19T04:19:21.054 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:19:21.074 INFO:teuthology.orchestra.run.smithi070.stdout:(90/156): python3-pytz-2021.1-5.el9.noarch.rpm 554 kB/s | 51 kB 00:00 2024-09-19T04:19:21.100 INFO:teuthology.orchestra.run.smithi070.stdout:(91/156): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-09-19T04:19:21.150 INFO:teuthology.orchestra.run.smithi070.stdout:(92/156): python3-toml-0.10.2-6.el9.noarch.rpm 834 kB/s | 42 kB 00:00 2024-09-19T04:19:21.175 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:19:21.209 INFO:teuthology.orchestra.run.smithi070.stdout:(93/156): python3-wcwidth-0.2.5-8.el9.noarch.rp 759 kB/s | 44 kB 00:00 2024-09-19T04:19:21.267 INFO:teuthology.orchestra.run.smithi070.stdout:(94/156): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-09-19T04:19:21.295 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:19:21.325 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:19:21.326 INFO:teuthology.orchestra.run.smithi070.stdout:(95/156): qatlib-service-24.02.0-1.el9.x86_64.r 616 kB/s | 36 kB 00:00 2024-09-19T04:19:21.384 INFO:teuthology.orchestra.run.smithi070.stdout:(96/156): qatzip-libs-1.2.0-1.el9.x86_64.rpm 814 kB/s | 47 kB 00:00 2024-09-19T04:19:21.417 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:19:21.446 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:19:21.468 INFO:teuthology.orchestra.run.smithi070.stdout:(97/156): socat-1.7.4.1-6.el9.x86_64.rpm 3.6 MB/s | 304 kB 00:00 2024-09-19T04:19:21.527 INFO:teuthology.orchestra.run.smithi070.stdout:(98/156): uuid-1.6.2-55.el9.x86_64.rpm 990 kB/s | 58 kB 00:00 2024-09-19T04:19:21.607 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:19:21.627 INFO:teuthology.orchestra.run.smithi070.stdout:(99/156): python3-babel-2.9.1-2.el9.noarch.rpm 3.1 MB/s | 6.0 MB 00:01 2024-09-19T04:19:21.652 INFO:teuthology.orchestra.run.smithi070.stdout:(100/156): xfsprogs-devel-6.4.0-4.el9.x86_64.rp 765 kB/s | 96 kB 00:00 2024-09-19T04:19:21.659 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:19:21.678 INFO:teuthology.orchestra.run.smithi070.stdout:(101/156): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-09-19T04:19:21.688 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:19:21.703 INFO:teuthology.orchestra.run.smithi070.stdout:(102/156): zlib-devel-1.2.11-41.el9.x86_64.rpm 890 kB/s | 45 kB 00:00 2024-09-19T04:19:21.792 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:19:21.822 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:19:21.885 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:19:21.914 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:19:21.942 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:19:21.970 INFO:teuthology.orchestra.run.smithi070.stdout:(103/156): lua-devel-5.4.4-4.el9.x86_64.rpm 76 kB/s | 22 kB 00:00 2024-09-19T04:19:22.020 INFO:teuthology.orchestra.run.smithi070.stdout:(104/156): abseil-cpp-20211102.0-3.el9.x86_64.r 11 MB/s | 548 kB 00:00 2024-09-19T04:19:22.054 INFO:teuthology.orchestra.run.smithi070.stdout:(105/156): gperftools-libs-2.9.1-3.el9.x86_64.r 9.0 MB/s | 308 kB 00:00 2024-09-19T04:19:22.079 INFO:teuthology.orchestra.run.smithi070.stdout:(106/156): grpc-data-1.46.7-10.el9.noarch.rpm 785 kB/s | 19 kB 00:00 2024-09-19T04:19:22.126 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:19:22.204 INFO:teuthology.orchestra.run.smithi070.stdout:(107/156): libarrow-9.0.0-11.el9.x86_64.rpm 35 MB/s | 4.4 MB 00:00 2024-09-19T04:19:22.230 INFO:teuthology.orchestra.run.smithi070.stdout:(108/156): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-09-19T04:19:22.255 INFO:teuthology.orchestra.run.smithi070.stdout:(109/156): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-09-19T04:19:22.289 INFO:teuthology.orchestra.run.smithi070.stdout:(110/156): libunwind-1.6.2-1.el9.x86_64.rpm 2.0 MB/s | 67 kB 00:00 2024-09-19T04:19:22.314 INFO:teuthology.orchestra.run.smithi070.stdout:(111/156): luarocks-3.9.2-5.el9.noarch.rpm 6.0 MB/s | 151 kB 00:00 2024-09-19T04:19:22.315 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:19:22.348 INFO:teuthology.orchestra.run.smithi070.stdout:(112/156): parquet-libs-9.0.0-11.el9.x86_64.rpm 25 MB/s | 839 kB 00:00 2024-09-19T04:19:22.390 INFO:teuthology.orchestra.run.smithi070.stdout:(113/156): python3-asyncssh-2.13.2-5.el9.noarch 13 MB/s | 548 kB 00:00 2024-09-19T04:19:22.415 INFO:teuthology.orchestra.run.smithi070.stdout:(114/156): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-09-19T04:19:22.421 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:19:22.440 INFO:teuthology.orchestra.run.smithi070.stdout:(115/156): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-09-19T04:19:22.465 INFO:teuthology.orchestra.run.smithi070.stdout:(116/156): python3-certifi-2023.05.07-4.el9.noa 566 kB/s | 14 kB 00:00 2024-09-19T04:19:22.490 INFO:teuthology.orchestra.run.smithi070.stdout:(117/156): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-09-19T04:19:22.524 INFO:teuthology.orchestra.run.smithi070.stdout:(118/156): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-09-19T04:19:22.540 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:22.550 INFO:teuthology.orchestra.run.smithi070.stdout:(119/156): python3-cmd2-2.4.2-2.el9.noarch.rpm 12 MB/s | 303 kB 00:00 2024-09-19T04:19:22.575 INFO:teuthology.orchestra.run.smithi070.stdout:(120/156): python3-google-auth-2.34.0-1.el9.noa 8.6 MB/s | 220 kB 00:00 2024-09-19T04:19:22.617 INFO:teuthology.orchestra.run.smithi070.stdout:(121/156): protobuf-compiler-3.14.0-13.el9.x86_ 945 kB/s | 863 kB 00:00 2024-09-19T04:19:22.622 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:22.668 INFO:teuthology.orchestra.run.smithi070.stdout:(122/156): python3-grpcio-tools-1.46.7-10.el9.x 2.8 MB/s | 144 kB 00:00 2024-09-19T04:19:22.693 INFO:teuthology.orchestra.run.smithi070.stdout:(123/156): python3-jaraco-8.2.1-3.el9.noarch.rp 438 kB/s | 11 kB 00:00 2024-09-19T04:19:22.751 INFO:teuthology.orchestra.run.smithi070.stdout:(124/156): python3-grpcio-1.46.7-10.el9.x86_64. 12 MB/s | 2.0 MB 00:00 2024-09-19T04:19:22.777 INFO:teuthology.orchestra.run.smithi070.stdout:(125/156): python3-jaraco-classes-3.2.1-5.el9.n 211 kB/s | 18 kB 00:00 2024-09-19T04:19:22.802 INFO:teuthology.orchestra.run.smithi070.stdout:(126/156): python3-jaraco-collections-3.0.0-8.e 459 kB/s | 23 kB 00:00 2024-09-19T04:19:22.827 INFO:teuthology.orchestra.run.smithi070.stdout:(127/156): python3-jaraco-functools-3.5.0-2.el9 387 kB/s | 19 kB 00:00 2024-09-19T04:19:22.840 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:22.852 INFO:teuthology.orchestra.run.smithi070.stdout:(128/156): python3-jaraco-text-3.2.0-6.el9.noar 393 kB/s | 20 kB 00:00 2024-09-19T04:19:22.903 INFO:teuthology.orchestra.run.smithi070.stdout:(129/156): python3-kubernetes-26.1.0-2.el9.noar 14 MB/s | 1.0 MB 00:00 2024-09-19T04:19:22.928 INFO:teuthology.orchestra.run.smithi070.stdout:(130/156): python3-logutils-0.3.5-21.el9.noarch 616 kB/s | 46 kB 00:00 2024-09-19T04:19:22.953 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:19:22.970 INFO:teuthology.orchestra.run.smithi070.stdout:(131/156): python3-more-itertools-8.12.0-2.el9. 1.2 MB/s | 79 kB 00:00 2024-09-19T04:19:23.012 INFO:teuthology.orchestra.run.smithi070.stdout:(132/156): python3-natsort-7.1.1-5.el9.noarch.r 752 kB/s | 58 kB 00:00 2024-09-19T04:19:23.050 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:19:23.054 INFO:teuthology.orchestra.run.smithi070.stdout:(133/156): python3-pecan-1.4.2-3.el9.noarch.rpm 3.5 MB/s | 272 kB 00:00 2024-09-19T04:19:23.079 INFO:teuthology.orchestra.run.smithi070.stdout:(134/156): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-09-19T04:19:23.086 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:19:23.104 INFO:teuthology.orchestra.run.smithi070.stdout:(135/156): python3-pyperclip-1.8.2-2.el9.noarch 1.1 MB/s | 28 kB 00:00 2024-09-19T04:19:23.121 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:19:23.130 INFO:teuthology.orchestra.run.smithi070.stdout:(136/156): python3-repoze-lru-0.7-16.el9.noarch 1.2 MB/s | 31 kB 00:00 2024-09-19T04:19:23.155 INFO:teuthology.orchestra.run.smithi070.stdout:(137/156): python3-routes-2.5.1-5.el9.noarch.rp 7.4 MB/s | 188 kB 00:00 2024-09-19T04:19:23.181 INFO:teuthology.orchestra.run.smithi070.stdout:(138/156): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T04:19:23.195 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:19:23.206 INFO:teuthology.orchestra.run.smithi070.stdout:(139/156): python3-tempora-5.0.0-2.el9.noarch.r 1.4 MB/s | 36 kB 00:00 2024-09-19T04:19:23.231 INFO:teuthology.orchestra.run.smithi070.stdout:(140/156): python3-typing-extensions-4.12.2-2.e 2.9 MB/s | 74 kB 00:00 2024-09-19T04:19:23.238 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:19:23.256 INFO:teuthology.orchestra.run.smithi070.stdout:(141/156): python3-webob-1.8.8-2.el9.noarch.rpm 9.0 MB/s | 230 kB 00:00 2024-09-19T04:19:23.270 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:19:23.282 INFO:teuthology.orchestra.run.smithi070.stdout:(142/156): python3-websocket-client-1.2.3-2.el9 3.5 MB/s | 90 kB 00:00 2024-09-19T04:19:23.314 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:19:23.315 INFO:teuthology.orchestra.run.smithi070.stdout:(143/156): python3-werkzeug-2.0.3-3.el9.1.noarc 12 MB/s | 427 kB 00:00 2024-09-19T04:19:23.332 INFO:teuthology.orchestra.run.smithi070.stdout:(144/156): python3-zc-lockfile-2.0-10.el9.noarc 1.2 MB/s | 20 kB 00:00 2024-09-19T04:19:23.346 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:19:23.366 INFO:teuthology.orchestra.run.smithi070.stdout:(145/156): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-19T04:19:23.384 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:19:23.425 INFO:teuthology.orchestra.run.smithi070.stdout:(146/156): thrift-0.15.0-2.el9.x86_64.rpm 27 MB/s | 1.6 MB 00:00 2024-09-19T04:19:23.451 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:19:23.504 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:19:23.536 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:19:23.579 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:19:23.656 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:19:23.698 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:19:23.709 INFO:teuthology.orchestra.run.smithi070.stdout:(147/156): librados2-19.1.1-361.g2f599a46.el9.x 12 MB/s | 3.4 MB 00:00 2024-09-19T04:19:23.749 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:19:23.778 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:19:23.847 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:19:23.892 INFO:teuthology.orchestra.run.smithi070.stdout:(148/156): librbd1-19.1.1-361.g2f599a46.el9.x86 17 MB/s | 3.2 MB 00:00 2024-09-19T04:19:23.901 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:19:23.975 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:19:24.076 INFO:teuthology.orchestra.run.smithi070.stdout:(149/156): NetworkManager-1.51.0-1.el9.x86_64.r 13 MB/s | 2.3 MB 00:00 2024-09-19T04:19:24.107 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:19:24.143 INFO:teuthology.orchestra.run.smithi070.stdout:(150/156): NetworkManager-libnm-1.51.0-1.el9.x8 27 MB/s | 1.8 MB 00:00 2024-09-19T04:19:24.161 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:19:24.184 INFO:teuthology.orchestra.run.smithi070.stdout:(151/156): NetworkManager-team-1.51.0-1.el9.x86 981 kB/s | 41 kB 00:00 2024-09-19T04:19:24.235 INFO:teuthology.orchestra.run.smithi070.stdout:(152/156): NetworkManager-tui-1.51.0-1.el9.x86_ 4.9 MB/s | 249 kB 00:00 2024-09-19T04:19:24.294 INFO:teuthology.orchestra.run.smithi070.stdout:(153/156): openssl-3.2.2-6.el9.x86_64.rpm 23 MB/s | 1.4 MB 00:00 2024-09-19T04:19:24.377 INFO:teuthology.orchestra.run.smithi070.stdout:(154/156): openssl-libs-3.2.2-6.el9.x86_64.rpm 29 MB/s | 2.4 MB 00:00 2024-09-19T04:19:24.682 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:19:24.773 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:19:24.803 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:19:24.836 INFO:teuthology.orchestra.run.smithi070.stdout:(155/156): python3-scipy-1.6.2-8.el9.x86_64.rpm 4.3 MB/s | 16 MB 00:03 2024-09-19T04:19:24.846 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:19:24.861 INFO:teuthology.orchestra.run.smithi070.stdout:(156/156): python3-portend-3.1.0-2.el9.noarch.r 8.9 kB/s | 16 kB 00:01 2024-09-19T04:19:24.864 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:19:24.864 INFO:teuthology.orchestra.run.smithi070.stdout:Total 19 MB/s | 226 MB 00:12 2024-09-19T04:19:24.883 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:19:24.926 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:19:25.091 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:19:25.153 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:19:25.207 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:19:25.271 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:19:25.304 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:19:25.340 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:19:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:19:25.431 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:19:25.474 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:19:25.516 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:19:25.651 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:19:25.692 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:19:25.734 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:19:25.734 INFO:teuthology.orchestra.run.smithi167.stdout: Preparing : 1/1 2024-09-19T04:19:25.836 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:19:25.872 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:19:25.916 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:19:26.010 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:19:26.036 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:19:26.048 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:19:26.074 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:19:26.082 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction check 2024-09-19T04:19:26.134 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:19:26.203 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:19:26.232 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction check succeeded. 2024-09-19T04:19:26.232 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction test 2024-09-19T04:19:26.234 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:19:26.258 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:19:26.353 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:19:26.467 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:19:26.486 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:19:26.527 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:19:26.555 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:19:26.575 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:19:26.589 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:19:26.628 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:19:26.660 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:19:26.689 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:19:26.697 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:19:26.726 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:19:26.732 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:19:26.774 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:19:26.815 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:19:26.818 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:19:26.850 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:19:26.856 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:19:26.936 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:19:26.980 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:19:27.011 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:19:27.037 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:19:27.103 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:19:27.113 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:19:27.131 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:19:27.170 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:19:27.243 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:19:27.265 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:19:27.320 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:19:27.341 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:19:27.364 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:19:27.511 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:19:27.701 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:19:27.848 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:19:27.903 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:19:27.951 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:19:27.966 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:27.984 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:19:28.050 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:28.081 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:19:28.131 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:19:28.175 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:19:28.272 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:19:28.276 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:28.310 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:19:28.389 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:19:28.456 INFO:teuthology.orchestra.run.smithi070.stdout:Transaction test succeeded. 2024-09-19T04:19:28.457 INFO:teuthology.orchestra.run.smithi070.stdout:Running transaction 2024-09-19T04:19:28.485 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:19:28.495 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:19:28.514 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:19:28.525 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:19:28.556 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:19:28.616 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:19:28.623 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:19:28.676 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:19:28.716 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:19:28.759 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:19:28.801 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:19:28.836 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:19:28.906 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:19:28.959 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:19:28.990 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:19:29.034 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:19:29.109 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:19:29.144 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:19:29.187 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:19:29.217 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:19:29.287 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:19:29.296 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:19:29.340 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:19:29.415 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:19:29.422 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:19:29.558 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:19:29.609 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:19:30.145 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:19:30.229 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:19:30.259 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:19:30.310 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:19:30.348 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:19:30.391 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:19:30.547 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:19:30.601 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:19:30.665 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:19:30.672 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:19:30.737 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:19:30.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:19:30.769 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:19:30.791 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:19:30.806 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:19:30.824 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:19:30.852 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:19:30.888 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:19:30.932 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:19:30.973 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:19:31.119 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:19:31.141 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:19:31.168 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:19:31.203 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:19:31.259 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:19:31.302 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:19:31.333 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:19:31.362 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:19:31.378 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:19:31.402 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:19:31.442 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:19:31.475 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:19:31.500 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:19:31.602 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:19:31.731 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:19:31.778 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:19:31.806 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:19:31.849 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:19:31.859 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:19:31.896 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:19:31.898 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:19:31.928 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:19:31.953 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:19:31.958 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:19:31.983 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:19:31.993 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:19:32.026 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:19:32.068 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:19:32.102 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:19:32.188 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:19:32.232 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:19:32.272 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:19:32.376 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:19:32.431 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:19:33.154 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:19:33.206 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:19:33.240 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:19:33.337 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:19:33.397 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:19:33.448 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:19:33.535 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:19:33.565 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:19:33.751 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:19:33.788 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:19:33.865 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:19:34.242 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:34.279 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:34.528 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:19:34.698 INFO:teuthology.orchestra.run.smithi070.stdout: Preparing : 1/1 2024-09-19T04:19:34.812 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:19:34.817 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-libs-1:3.2.2-6.el9.x86_64 1/164 2024-09-19T04:19:34.829 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:34.865 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:19:34.893 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/164 2024-09-19T04:19:34.957 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:19:34.957 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:19:34.958 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:19:34.958 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:34.967 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/164 2024-09-19T04:19:35.000 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:19:35.001 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/164 2024-09-19T04:19:35.035 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/164 2024-09-19T04:19:35.090 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/164 2024-09-19T04:19:35.424 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/164 2024-09-19T04:19:35.536 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:19:35.649 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:19:35.678 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:19:35.773 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:19:35.818 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:19:35.986 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-private-libs-13.16-1.el9.x86_64 11/164 2024-09-19T04:19:36.055 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-13.16-1.el9.x86_64 12/164 2024-09-19T04:19:36.091 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:19:36.104 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:19:36.196 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:19:36.210 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:19:36.234 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:19:36.238 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:19:36.271 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:19:36.297 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 14/164 2024-09-19T04:19:36.335 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:19:36.357 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 15/164 2024-09-19T04:19:36.537 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:19:36.653 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:19:36.701 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:19:36.708 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 16/164 2024-09-19T04:19:36.784 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:19:36.814 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:19:36.825 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 17/164 2024-09-19T04:19:36.851 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:19:36.936 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:37.001 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:37.227 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.51.0-1.el9.x86_64 18/164 2024-09-19T04:19:37.331 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:19:37.337 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : re2-1:20211101-20.el9.x86_64 19/164 2024-09-19T04:19:37.371 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:19:37.437 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 20/164 2024-09-19T04:19:37.443 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:19:37.473 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:19:37.476 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 21/164 2024-09-19T04:19:37.517 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : liboath-2.6.7-2.el9.x86_64 22/164 2024-09-19T04:19:37.582 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 23/164 2024-09-19T04:19:37.634 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 24/164 2024-09-19T04:19:37.683 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-packaging-20.9-5.el9.noarch 25/164 2024-09-19T04:19:37.727 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 26/164 2024-09-19T04:19:37.759 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 27/164 2024-09-19T04:19:37.787 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-5.4.4-4.el9.x86_64 28/164 2024-09-19T04:19:37.856 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 29/164 2024-09-19T04:19:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 30/164 2024-09-19T04:19:37.940 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 31/164 2024-09-19T04:19:37.978 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 32/164 2024-09-19T04:19:38.052 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 33/164 2024-09-19T04:19:38.095 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 34/164 2024-09-19T04:19:38.137 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 35/164 2024-09-19T04:19:38.166 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 36/164 2024-09-19T04:19:38.235 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 37/164 2024-09-19T04:19:38.280 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : luarocks-3.9.2-5.el9.noarch 38/164 2024-09-19T04:19:38.356 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 39/164 2024-09-19T04:19:38.490 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 40/164 2024-09-19T04:19:38.542 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 41/164 2024-09-19T04:19:39.065 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rsa-4.9-2.el9.noarch 42/164 2024-09-19T04:19:39.145 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 43/164 2024-09-19T04:19:39.174 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 44/164 2024-09-19T04:19:39.218 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 45/164 2024-09-19T04:19:39.255 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 46/164 2024-09-19T04:19:39.298 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 47/164 2024-09-19T04:19:39.471 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 48/164 2024-09-19T04:19:39.534 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : openssl-1:3.2.2-6.el9.x86_64 49/164 2024-09-19T04:19:39.588 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 50/164 2024-09-19T04:19:39.661 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 51/164 2024-09-19T04:19:39.693 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 52/164 2024-09-19T04:19:39.729 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 53/164 2024-09-19T04:19:39.769 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:39.775 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 54/164 2024-09-19T04:19:39.803 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:39.811 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 55/164 2024-09-19T04:19:39.855 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 56/164 2024-09-19T04:19:39.905 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 57/164 2024-09-19T04:19:40.050 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 58/164 2024-09-19T04:19:40.107 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 59/164 2024-09-19T04:19:40.149 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 60/164 2024-09-19T04:19:40.251 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 61/164 2024-09-19T04:19:40.356 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:40.390 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:19:40.465 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 62/164 2024-09-19T04:19:40.500 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:19:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:19:40.500 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:19:40.500 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:40.508 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 63/164 2024-09-19T04:19:40.533 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:19:40.540 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 64/164 2024-09-19T04:19:40.565 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 65/164 2024-09-19T04:19:40.664 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 66/164 2024-09-19T04:19:40.794 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 67/164 2024-09-19T04:19:40.834 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 68/164 2024-09-19T04:19:40.862 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 69/164 2024-09-19T04:19:40.896 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 70/164 2024-09-19T04:19:40.935 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : uuid-1.6.2-55.el9.x86_64 71/164 2024-09-19T04:19:40.966 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 72/164 2024-09-19T04:19:40.997 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 73/164 2024-09-19T04:19:41.031 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 74/164 2024-09-19T04:19:41.065 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 75/164 2024-09-19T04:19:41.106 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 76/164 2024-09-19T04:19:41.141 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 77/164 2024-09-19T04:19:41.236 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 78/164 2024-09-19T04:19:41.288 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 79/164 2024-09-19T04:19:41.319 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 80/164 2024-09-19T04:19:41.423 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 81/164 2024-09-19T04:19:41.470 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 82/164 2024-09-19T04:19:42.192 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 83/164 2024-09-19T04:19:42.278 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 84/164 2024-09-19T04:19:42.310 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 85/164 2024-09-19T04:19:42.411 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 86/164 2024-09-19T04:19:42.465 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 87/164 2024-09-19T04:19:42.509 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 88/164 2024-09-19T04:19:42.607 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 89/164 2024-09-19T04:19:42.640 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 90/164 2024-09-19T04:19:42.833 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-0.3.26-2.el9.x86_64 91/164 2024-09-19T04:19:42.872 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 92/164 2024-09-19T04:19:42.950 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 93/164 2024-09-19T04:19:43.608 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 94/164 2024-09-19T04:19:43.728 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 95/164 2024-09-19T04:19:44.994 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 96/164 2024-09-19T04:19:45.076 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 97/164 2024-09-19T04:19:45.104 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 98/164 2024-09-19T04:19:45.137 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libuuid-devel-2.37.4-20.el9.x86_64 99/164 2024-09-19T04:19:45.448 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 100/164 2024-09-19T04:19:45.500 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:19:45.599 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 101/164 2024-09-19T04:19:45.630 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 102/164 2024-09-19T04:19:45.694 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 103/164 2024-09-19T04:19:46.174 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 104/164 2024-09-19T04:19:46.203 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:19:46.274 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 105/164 2024-09-19T04:19:46.305 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 106/164 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /root 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-09-19T04:19:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:47.017 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:19:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:19:47.033 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:47.033 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:19:47.033 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:48.502 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:19:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:19:48.530 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:48.530 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:19:48.530 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:19:48.530 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:19:48.530 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:48.638 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:48.677 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:48.762 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:19:48.786 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:19:48.786 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:48.786 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:19:48.786 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:19:48.786 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:19:48.786 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:49.226 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 107/164 2024-09-19T04:19:49.230 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:19:49.254 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:19:49.254 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:49.255 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:19:49.255 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:19:49.255 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:19:49.255 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:49.263 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:19:49.361 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 108/164 2024-09-19T04:19:49.361 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T04:19:49.361 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T04:19:49.361 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:19:49.368 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:19:49.406 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:19:49.425 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:19:49.481 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:19:49.668 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:19:49.722 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:19:49.801 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:19:49.906 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:19:50.045 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:19:50.102 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:19:50.149 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:19:50.173 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:19:50.602 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:19:50.630 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:19:50.661 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:19:50.760 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:19:50.795 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:19:51.845 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:19:51.888 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:19:52.433 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:19:52.434 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /sys 2024-09-19T04:19:52.434 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /proc 2024-09-19T04:19:52.434 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /mnt 2024-09-19T04:19:52.434 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /var/tmp 2024-09-19T04:19:52.434 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /home 2024-09-19T04:19:52.434 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /root 2024-09-19T04:19:52.434 INFO:teuthology.orchestra.run.smithi167.stdout:skipping the directory /tmp 2024-09-19T04:19:52.434 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:52.614 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:19:52.631 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:19:52.631 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:52.631 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:19:52.631 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:52.854 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:19:52.880 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:19:52.983 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:19:53.151 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:19:53.182 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:19:53.206 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:19:53.206 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:53.206 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:19:53.206 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:19:53.207 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:19:53.207 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:53.258 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:19:53.270 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:19:53.372 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:19:53.433 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:19:54.127 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:19:54.154 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:19:54.154 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:54.154 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:19:54.154 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:19:54.154 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:19:54.155 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:54.363 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:19:54.378 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:54.402 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:19:54.403 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:54.404 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:19:54.427 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:19:54.427 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:54.427 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:19:54.427 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:19:54.427 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:19:54.427 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:54.470 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:19:54.493 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:19:54.493 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:54.493 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:19:54.493 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:54.545 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:19:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:19:54.569 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:54.569 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:19:54.569 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:19:54.569 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:19:54.569 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:54.845 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:19:54.869 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:19:54.869 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:54.869 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:19:54.869 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:19:54.870 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:19:54.870 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:54.871 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:19:54.894 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:19:54.895 INFO:teuthology.orchestra.run.smithi134.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:54.895 INFO:teuthology.orchestra.run.smithi134.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:19:54.895 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:19:54.895 INFO:teuthology.orchestra.run.smithi134.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:19:54.895 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:19:54.984 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:19:55.032 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:19:55.088 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:19:55.274 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:19:55.322 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:19:55.400 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:19:55.488 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:19:55.630 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:19:55.682 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:19:55.721 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:19:55.748 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:19:56.204 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:19:56.231 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:19:56.262 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:19:56.325 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:19:56.354 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:19:57.408 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:19:57.439 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:19:58.405 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:19:58.431 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:19:58.535 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:19:58.705 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:19:58.742 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:19:58.766 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:19:58.766 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:58.766 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:19:58.766 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:19:58.767 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:19:58.767 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:19:58.826 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:19:58.839 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:19:58.937 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:19:58.995 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:19:59.449 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:19:59.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:19:59.541 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:19:59.571 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:19:59.599 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:19:59.793 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:19:59.836 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:19:59.867 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:19:59.897 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:19:59.917 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:19:59.951 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:19:59.954 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:19:59.978 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:19:59.978 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:19:59.978 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:19:59.978 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:19:59.979 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:19:59.979 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:20:00.022 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:20:00.058 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:20:00.058 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:00.058 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:20:00.059 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:20:00.105 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:20:00.130 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:20:00.130 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:00.130 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:20:00.130 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:20:00.130 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:20:00.130 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:20:00.431 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:20:00.455 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:20:00.455 INFO:teuthology.orchestra.run.smithi167.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:00.455 INFO:teuthology.orchestra.run.smithi167.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:20:00.455 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:20:00.455 INFO:teuthology.orchestra.run.smithi167.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:20:00.455 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:20:00.545 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:00.590 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:00.612 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:00.944 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 109/164 2024-09-19T04:20:00.944 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /sys 2024-09-19T04:20:00.944 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /proc 2024-09-19T04:20:00.944 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /mnt 2024-09-19T04:20:00.944 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /var/tmp 2024-09-19T04:20:00.944 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /home 2024-09-19T04:20:00.945 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /root 2024-09-19T04:20:00.945 INFO:teuthology.orchestra.run.smithi070.stdout:skipping the directory /tmp 2024-09-19T04:20:00.945 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:01.111 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:20:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 110/164 2024-09-19T04:20:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:01.127 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T04:20:01.127 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:01.452 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:20:01.544 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:20:01.591 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:20:01.685 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:20:01.714 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:20:01.740 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:20:01.782 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:20:01.782 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:20:01.866 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:20:01.866 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:20:01.950 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:20:01.975 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:20:01.981 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:01.981 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:02.177 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:20:02.269 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:20:02.343 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:02.621 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:20:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 111/164 2024-09-19T04:20:02.648 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:02.648 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T04:20:02.648 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:20:02.648 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T04:20:02.648 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:02.890 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:20:02.913 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 112/164 2024-09-19T04:20:02.913 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:02.913 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T04:20:02.913 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:20:02.913 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T04:20:02.913 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:03.367 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:20:03.391 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 113/164 2024-09-19T04:20:03.391 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:03.391 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T04:20:03.391 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:20:03.392 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T04:20:03.392 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:03.497 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : automake-1.16.2-8.el9.noarch 114/164 2024-09-19T04:20:03.554 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-ply-3.11-14.el9.noarch 115/164 2024-09-19T04:20:03.609 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 116/164 2024-09-19T04:20:03.797 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 117/164 2024-09-19T04:20:03.851 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 118/164 2024-09-19T04:20:03.929 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 119/164 2024-09-19T04:20:04.017 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 120/164 2024-09-19T04:20:04.148 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 121/164 2024-09-19T04:20:04.200 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 122/164 2024-09-19T04:20:04.234 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 123/164 2024-09-19T04:20:04.261 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : fuse-2.9.9-16.el9.x86_64 124/164 2024-09-19T04:20:04.665 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:20:04.693 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 125/164 2024-09-19T04:20:04.725 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 126/164 2024-09-19T04:20:04.787 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 127/164 2024-09-19T04:20:04.816 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:20:05.036 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:20:05.085 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:20:05.126 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:20:05.158 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:20:05.186 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:20:05.376 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:20:05.416 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:20:05.447 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:20:05.477 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:20:05.523 INFO:teuthology.orchestra.run.smithi167.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:20:05.866 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 128/164 2024-09-19T04:20:05.910 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:20:06.157 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:06.196 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:06.217 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:06.874 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 129/164 2024-09-19T04:20:06.910 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:20:07.014 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 130/164 2024-09-19T04:20:07.056 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:20:07.144 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:20:07.182 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 131/164 2024-09-19T04:20:07.189 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:20:07.212 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:20:07.236 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 132/164 2024-09-19T04:20:07.236 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:07.236 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T04:20:07.236 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:20:07.236 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T04:20:07.236 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:07.280 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:20:07.288 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:20:07.291 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 133/164 2024-09-19T04:20:07.322 INFO:teuthology.orchestra.run.smithi167.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:20:07.349 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:20:07.382 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:20:07.382 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:20:07.395 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 134/164 2024-09-19T04:20:07.453 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 135/164 2024-09-19T04:20:07.500 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:20:07.500 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:20:07.584 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:20:07.609 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:20:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:07.614 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:07.803 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:20:07.887 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:20:07.951 INFO:teuthology.orchestra.run.smithi167.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:20:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:20:08.045 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:20:08.046 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:20:08.047 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:20:08.060 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:20:08.061 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:20:08.062 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:20:08.063 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:20:08.064 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:20:08.065 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:20:08.066 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:20:08.067 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:20:08.068 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:20:08.069 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:20:08.070 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:20:08.379 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libtool-2.4.6-46.el9.x86_64 136/164 2024-09-19T04:20:08.416 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:20:08.439 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 137/164 2024-09-19T04:20:08.439 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:08.439 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T04:20:08.440 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:20:08.440 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T04:20:08.440 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:08.483 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:20:08.505 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.1-361.g2f599a 138/164 2024-09-19T04:20:08.506 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:08.506 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T04:20:08.506 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:08.559 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:20:08.582 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 139/164 2024-09-19T04:20:08.582 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:08.582 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-09-19T04:20:08.582 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:20:08.582 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-09-19T04:20:08.582 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:08.893 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:20:08.916 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 140/164 2024-09-19T04:20:08.916 INFO:teuthology.orchestra.run.smithi070.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T04:20:08.916 INFO:teuthology.orchestra.run.smithi070.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T04:20:08.916 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:20:08.916 INFO:teuthology.orchestra.run.smithi070.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T04:20:08.917 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:10.369 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:20:10.370 INFO:teuthology.orchestra.run.smithi134.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.371 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.372 INFO:teuthology.orchestra.run.smithi134.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.373 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:20:10.374 INFO:teuthology.orchestra.run.smithi134.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:20:10.375 INFO:teuthology.orchestra.run.smithi134.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:20:10.376 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:20:10.377 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:20:10.378 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:20:10.379 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:20:10.380 INFO:teuthology.orchestra.run.smithi134.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:10.381 INFO:teuthology.orchestra.run.smithi134.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:20:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:20:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:20:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:20:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:20:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:20:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:20:10.382 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:20:10.382 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-09-19T04:20:10.804 DEBUG:teuthology.parallel:result is None 2024-09-19T04:20:13.488 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 141/164 2024-09-19T04:20:13.529 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 142/164 2024-09-19T04:20:13.570 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 143/164 2024-09-19T04:20:13.602 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : xfsprogs-devel-6.4.0-4.el9.x86_64 144/164 2024-09-19T04:20:13.629 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 145/164 2024-09-19T04:20:13.820 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 146/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:20:13.829 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:20:13.830 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:20:13.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:20:13.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:20:13.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:20:13.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:20:13.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:20:13.831 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:20:13.844 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:20:13.844 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:20:13.844 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:20:13.844 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:20:13.844 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:20:13.844 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:20:13.845 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:20:13.846 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:20:13.847 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:20:13.848 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:20:13.849 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:20:13.850 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:20:13.851 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:20:13.852 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:20:13.853 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:20:13.854 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:20:13.876 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-contrib-13.16-1.el9.x86_64 147/164 2024-09-19T04:20:13.906 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 148/164 2024-09-19T04:20:13.936 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-team-1:1.51.0-1.el9.x86_64 149/164 2024-09-19T04:20:13.982 INFO:teuthology.orchestra.run.smithi070.stdout: Upgrading : NetworkManager-tui-1:1.51.0-1.el9.x86_64 150/164 2024-09-19T04:20:14.581 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:14.622 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:14.642 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: postgresql-server-13.16-1.el9.x86_64 151/164 2024-09-19T04:20:15.474 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 152/164 2024-09-19T04:20:15.569 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : openssl-devel-1:3.2.2-6.el9.x86_64 153/164 2024-09-19T04:20:15.620 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 154/164 2024-09-19T04:20:15.721 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : flex-2.6.4-9.el9.x86_64 155/164 2024-09-19T04:20:15.755 INFO:teuthology.orchestra.run.smithi070.stdout: Installing : bison-3.7.4-5.el9.x86_64 156/164 2024-09-19T04:20:15.781 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-tui-1:1.48.8-1.el9.x86_64 157/164 2024-09-19T04:20:15.807 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-1:3.2.2-4.el9.x86_64 158/164 2024-09-19T04:20:15.807 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:20:15.891 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 159/164 2024-09-19T04:20:15.891 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:20:15.975 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 160/164 2024-09-19T04:20:16.000 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-team-1:1.48.8-1.el9.x86_64 161/164 2024-09-19T04:20:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:16.006 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-1:1.48.8-1.el9.x86_64 162/164 2024-09-19T04:20:16.194 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:20:16.269 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.8-1.el9.x86_64 163/164 2024-09-19T04:20:16.335 INFO:teuthology.orchestra.run.smithi070.stdout: Cleanup : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout:Upgraded: 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.400 INFO:teuthology.orchestra.run.smithi167.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout:Installed: 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.401 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.402 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:20:16.403 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:20:16.404 INFO:teuthology.orchestra.run.smithi167.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:20:16.405 INFO:teuthology.orchestra.run.smithi167.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:20:16.406 INFO:teuthology.orchestra.run.smithi167.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:20:16.407 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:20:16.408 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:20:16.409 INFO:teuthology.orchestra.run.smithi167.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:20:16.410 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:20:16.411 INFO:teuthology.orchestra.run.smithi167.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:20:16.412 INFO:teuthology.orchestra.run.smithi167.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:20:16.413 INFO:teuthology.orchestra.run.smithi167.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:20:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:20:16.414 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:20:16.414 INFO:teuthology.orchestra.run.smithi167.stdout:Complete! 2024-09-19T04:20:16.837 DEBUG:teuthology.parallel:result is None 2024-09-19T04:20:21.934 INFO:teuthology.orchestra.run.smithi070.stdout: Running scriptlet: openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-2:19.1.1-361.g2f599a46.el9.x86_64 1/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 3/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 4/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-immutable-object-cache-2:19.1.1-361.g2f599a 5/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 6/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 7/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 8/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 9/164 2024-09-19T04:20:21.935 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 10/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 11/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 12/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 13/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 14/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_6 15/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 16/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 17/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 18/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_ 19/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 20/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9 21/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x 22/164 2024-09-19T04:20:21.936 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 23/164 2024-09-19T04:20:21.937 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 24/164 2024-09-19T04:20:21.937 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 25/164 2024-09-19T04:20:21.937 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 26/164 2024-09-19T04:20:21.937 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 27/164 2024-09-19T04:20:21.937 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 28/164 2024-09-19T04:20:21.937 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 29/164 2024-09-19T04:20:21.948 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.e 30/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noar 31/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.no 32/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.1-361.g2f59 33/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9 34/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 35/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el 36/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 37/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephadm-2:19.1.1-361.g2f599a46.el9.noarch 38/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 39/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 41/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 42/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/164 2024-09-19T04:20:21.949 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/164 2024-09-19T04:20:21.950 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libuuid-devel-2.37.4-20.el9.x86_64 62/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 66/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 67/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-devel-1:3.2.2-6.el9.x86_64 68/164 2024-09-19T04:20:21.951 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-13.16-1.el9.x86_64 69/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-contrib-13.16-1.el9.x86_64 70/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-private-libs-13.16-1.el9.x86_64 71/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : postgresql-server-13.16-1.el9.x86_64 72/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 77/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/164 2024-09-19T04:20:21.952 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/164 2024-09-19T04:20:21.953 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xfsprogs-devel-6.4.0-4.el9.x86_64 101/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/164 2024-09-19T04:20:21.954 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 107/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/164 2024-09-19T04:20:21.955 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 122/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/164 2024-09-19T04:20:21.956 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 143/164 2024-09-19T04:20:21.957 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : re2-1:20211101-20.el9.x86_64 147/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:19.1.1-361.g2f599a46.el9.x86_64 149/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 151/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.51.0-1.el9.x86_64 153/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-1:1.48.8-1.el9.x86_64 154/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.51.0-1.el9.x86_64 155/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-libnm-1:1.48.8-1.el9.x86_64 156/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.51.0-1.el9.x86_64 157/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-team-1:1.48.8-1.el9.x86_64 158/164 2024-09-19T04:20:21.958 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.51.0-1.el9.x86_64 159/164 2024-09-19T04:20:21.959 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : NetworkManager-tui-1:1.48.8-1.el9.x86_64 160/164 2024-09-19T04:20:21.959 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-6.el9.x86_64 161/164 2024-09-19T04:20:21.959 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-1:3.2.2-4.el9.x86_64 162/164 2024-09-19T04:20:21.959 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-6.el9.x86_64 163/164 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: Verifying : openssl-libs-1:3.2.2-4.el9.x86_64 164/164 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout:Upgraded: 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-libnm-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-team-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: NetworkManager-tui-1:1.51.0-1.el9.x86_64 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: librados2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: librbd1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.405 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-libs-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout:Installed: 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: automake-1.16.2-8.el9.noarch 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: bison-3.7.4-5.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-base-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-grafana-dashboards-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-immutable-object-cache-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.406 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mds-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-dashboard-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-diskprediction-local-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-modules-core-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mgr-rook-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-mon-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-osd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-prometheus-alerts-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-radosgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.407 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-selinux-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-test-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: ceph-volume-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: cephadm-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-shell-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: cephfs-top-2:19.1.1-361.g2f599a46.el9.noarch 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: flex-2.6.4-9.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T04:20:24.408 INFO:teuthology.orchestra.run.smithi070.stdout: fuse-2.9.9-16.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libcephfs2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libcephsqlite-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T04:20:24.409 INFO:teuthology.orchestra.run.smithi070.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: librados-devel-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: libradosstriper1-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: librgw2-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: libtool-2.4.6-46.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: libuuid-devel-2.37.4-20.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T04:20:24.410 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: openssl-devel-1:3.2.2-6.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-13.16-1.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-contrib-13.16-1.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-private-libs-13.16-1.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: postgresql-server-13.16-1.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T04:20:24.411 INFO:teuthology.orchestra.run.smithi070.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-argparse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ceph-common-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cephfs-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T04:20:24.412 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T04:20:24.413 INFO:teuthology.orchestra.run.smithi070.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T04:20:24.414 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rados-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rgw-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T04:20:24.415 INFO:teuthology.orchestra.run.smithi070.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-fuse-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-mirror-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: rbd-nbd-2:19.1.1-361.g2f599a46.el9.x86_64 2024-09-19T04:20:24.416 INFO:teuthology.orchestra.run.smithi070.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T04:20:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T04:20:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T04:20:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: uuid-1.6.2-55.el9.x86_64 2024-09-19T04:20:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: xfsprogs-devel-6.4.0-4.el9.x86_64 2024-09-19T04:20:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T04:20:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-09-19T04:20:24.417 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:20:24.417 INFO:teuthology.orchestra.run.smithi070.stdout:Complete! 2024-09-19T04:20:24.851 DEBUG:teuthology.parallel:result is None 2024-09-19T04:20:24.852 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:20:24.997 DEBUG:teuthology.orchestra.run.smithi070:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:20:25.020 INFO:teuthology.orchestra.run.smithi070.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:20:25.020 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:20:25.020 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:20:25.022 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:20:25.164 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:20:25.191 INFO:teuthology.orchestra.run.smithi134.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:20:25.191 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:20:25.191 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:20:25.193 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:20:25.339 DEBUG:teuthology.orchestra.run.smithi167:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T04:20:25.365 INFO:teuthology.orchestra.run.smithi167.stdout:19.1.1-361.g2f599a46.el9 2024-09-19T04:20:25.365 INFO:teuthology.packaging:The installed version of ceph is 19.1.1-361.g2f599a46.el9 2024-09-19T04:20:25.365 INFO:teuthology.task.install:The correct ceph version 19.1.1-361.g2f599a46 is installed. 2024-09-19T04:20:25.367 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T04:20:25.368 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:20:25.368 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:20:25.396 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:20:25.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:20:25.428 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:20:25.428 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T04:20:25.460 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T04:20:25.461 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:20:25.461 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:20:25.487 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:20:25.553 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:20:25.553 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:20:25.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:20:25.650 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:20:25.650 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T04:20:25.680 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T04:20:25.747 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T04:20:25.748 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:20:25.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:20:25.773 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:20:25.838 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:20:25.838 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:20:25.864 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:20:25.929 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:20:25.929 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T04:20:25.957 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T04:20:26.026 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T04:20:26.026 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:20:26.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:20:26.051 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:20:26.115 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:20:26.116 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:20:26.141 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:20:26.206 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:20:26.206 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T04:20:26.234 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T04:20:26.302 INFO:teuthology.run_tasks:Running task cephadm... 2024-09-19T04:20:26.394 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_bal_replicate_threshold': 1, 'mds_export_ephemeral_random_max': 0.1, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'online, but wants', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'subvols': {'create': 2}} 2024-09-19T04:20:26.394 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:20:26.395 INFO:tasks.cephadm:Cluster fsid is 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:20:26.395 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-09-19T04:20:26.395 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.70', 'mon.b': '172.21.15.134', 'mon.c': '172.21.15.167'} 2024-09-19T04:20:26.395 INFO:tasks.cephadm:First mon is mon.a on smithi070 2024-09-19T04:20:26.395 INFO:tasks.cephadm:First mgr is x 2024-09-19T04:20:26.396 INFO:tasks.cephadm:Normalizing hostnames... 2024-09-19T04:20:26.396 DEBUG:teuthology.orchestra.run.smithi070:> sudo hostname $(hostname -s) 2024-09-19T04:20:26.421 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-09-19T04:20:26.445 DEBUG:teuthology.orchestra.run.smithi167:> sudo hostname $(hostname -s) 2024-09-19T04:20:26.473 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-09-19T04:20:26.473 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:20:26.623 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '2f599a46ad10e37c929e5c43da2f6907ddcd1961', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/56106/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.1-361-g2f599a46', 'node_name': '172.21.2.7+braggi07', 'job_name': 'ceph-dev-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.1-361.g2f599a46'}, 'url': 'https://1.chacra.ceph.com/r/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-09-18 17:52:24.287651', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid', 'chacra_url': 'https://1.chacra.ceph.com/repos/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/flavors/default/', 'archs': ['source', 'x86_64'], 'distro': 'centos'}] 2024-09-19T04:20:26.759 INFO:tasks.util.chacra:got chacra host 1.chacra.ceph.com, ref squid, sha1 2f599a46ad10e37c929e5c43da2f6907ddcd1961 from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:20:26.760 INFO:tasks.cephadm:Discovered cachra url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T04:20:26.760 INFO:tasks.cephadm:Downloading cephadm from url: https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm 2024-09-19T04:20:26.760 DEBUG:teuthology.orchestra.run.smithi070:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.142 INFO:teuthology.orchestra.run.smithi070.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:20 /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.142 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.531 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:20 /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.531 DEBUG:teuthology.orchestra.run.smithi167:> curl --silent -L https://1.chacra.ceph.com/binaries/ceph/squid/2f599a46ad10e37c929e5c43da2f6907ddcd1961/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.919 INFO:teuthology.orchestra.run.smithi167.stdout:-rw-r--r--. 1 ubuntu ubuntu 784313 Sep 19 04:20 /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.919 DEBUG:teuthology.orchestra.run.smithi070:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.939 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.958 DEBUG:teuthology.orchestra.run.smithi167:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-09-19T04:20:27.994 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 on all hosts... 2024-09-19T04:20:27.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:20:27.997 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:20:28.001 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 pull 2024-09-19T04:20:29.493 INFO:teuthology.orchestra.run.smithi070.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:20:29.638 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:20:29.704 INFO:teuthology.orchestra.run.smithi167.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:21:03.306 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-19T04:21:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:21:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:21:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "repo_digests": [ 2024-09-19T04:21:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:21:03.307 INFO:teuthology.orchestra.run.smithi167.stdout: ] 2024-09-19T04:21:03.307 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-19T04:21:05.427 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-19T04:21:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:21:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:21:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-09-19T04:21:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:21:05.427 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-09-19T04:21:05.427 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-19T04:21:20.305 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:21:20.305 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:21:20.305 INFO:teuthology.orchestra.run.smithi070.stdout: "image_id": "d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d", 2024-09-19T04:21:20.305 INFO:teuthology.orchestra.run.smithi070.stdout: "repo_digests": [ 2024-09-19T04:21:20.306 INFO:teuthology.orchestra.run.smithi070.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e" 2024-09-19T04:21:20.306 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:21:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:21:20.331 DEBUG:teuthology.orchestra.run.smithi070:> sudo mkdir -p /etc/ceph 2024-09-19T04:21:20.383 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-09-19T04:21:20.416 DEBUG:teuthology.orchestra.run.smithi167:> sudo mkdir -p /etc/ceph 2024-09-19T04:21:20.449 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 777 /etc/ceph 2024-09-19T04:21:20.474 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-09-19T04:21:20.503 DEBUG:teuthology.orchestra.run.smithi167:> sudo chmod 777 /etc/ceph 2024-09-19T04:21:20.531 INFO:tasks.cephadm:Writing seed config... 2024-09-19T04:21:20.532 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-09-19T04:21:20.532 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-09-19T04:21:20.532 INFO:tasks.cephadm: override: [client] debug client = 20 2024-09-19T04:21:20.533 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-09-19T04:21:20.533 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-09-19T04:21:20.533 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-09-19T04:21:20.533 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-09-19T04:21:20.533 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-09-19T04:21:20.533 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-09-19T04:21:20.533 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-09-19T04:21:20.533 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] mds_bal_replicate_threshold = 1 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] mds_export_ephemeral_random_max = 0.1 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-09-19T04:21:20.534 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-09-19T04:21:20.535 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-09-19T04:21:20.536 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-09-19T04:21:20.537 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-09-19T04:21:20.537 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-09-19T04:21:20.537 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-09-19T04:21:20.537 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10 2024-09-19T04:21:20.538 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:21:20.538 DEBUG:teuthology.orchestra.run.smithi070:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-09-19T04:21:20.554 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7f15b24a-763e-11ef-bceb-c7b262605968 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True mds_bal_replicate_threshold = 1 mds_export_ephemeral_random_max = 0.1 osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-09-19T04:21:20.554 DEBUG:teuthology.orchestra.run.smithi070:mon.a> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a.service 2024-09-19T04:21:20.597 DEBUG:teuthology.orchestra.run.smithi070:mgr.x> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.x.service 2024-09-19T04:21:20.640 INFO:tasks.cephadm:Bootstrapping... 2024-09-19T04:21:20.641 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 -v bootstrap --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.70 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:21:20.842 INFO:teuthology.orchestra.run.smithi070.stdout:-------------------------------------------------------------------------------- 2024-09-19T04:21:20.843 INFO:teuthology.orchestra.run.smithi070.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961', '-v', 'bootstrap', '--fsid', '7f15b24a-763e-11ef-bceb-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.70', '--skip-admin-label'] 2024-09-19T04:21:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-09-19T04:21:20.843 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying podman|docker is present... 2024-09-19T04:21:20.866 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 5.2.2 2024-09-19T04:21:20.866 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying lvm2 is present... 2024-09-19T04:21:20.866 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying time synchronization is in place... 2024-09-19T04:21:20.874 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T04:21:20.874 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T04:21:20.880 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T04:21:20.880 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-19T04:21:20.887 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-09-19T04:21:20.893 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-09-19T04:21:20.893 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-09-19T04:21:20.893 INFO:teuthology.orchestra.run.smithi070.stdout:Repeating the final host check... 2024-09-19T04:21:20.916 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout 5.2.2 2024-09-19T04:21:20.916 INFO:teuthology.orchestra.run.smithi070.stdout:podman (/bin/podman) version 5.2.2 is present 2024-09-19T04:21:20.916 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl is present 2024-09-19T04:21:20.916 INFO:teuthology.orchestra.run.smithi070.stdout:lvcreate is present 2024-09-19T04:21:20.922 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-09-19T04:21:20.923 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-09-19T04:21:20.929 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-09-19T04:21:20.929 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-19T04:21:20.935 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout enabled 2024-09-19T04:21:20.942 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout active 2024-09-19T04:21:20.942 INFO:teuthology.orchestra.run.smithi070.stdout:Unit chronyd.service is enabled and running 2024-09-19T04:21:20.942 INFO:teuthology.orchestra.run.smithi070.stdout:Host looks OK 2024-09-19T04:21:20.942 INFO:teuthology.orchestra.run.smithi070.stdout:Cluster fsid: 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:20.942 INFO:teuthology.orchestra.run.smithi070.stdout:Acquiring lock 140416711205888 on /run/cephadm/7f15b24a-763e-11ef-bceb-c7b262605968.lock 2024-09-19T04:21:20.943 INFO:teuthology.orchestra.run.smithi070.stdout:Lock 140416711205888 acquired on /run/cephadm/7f15b24a-763e-11ef-bceb-c7b262605968.lock 2024-09-19T04:21:20.943 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 3300 ... 2024-09-19T04:21:20.943 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying IP 172.21.15.70 port 6789 ... 2024-09-19T04:21:20.943 INFO:teuthology.orchestra.run.smithi070.stdout:Base mon IP(s) is [172.21.15.70:3300, 172.21.15.70:6789], mon addrv is [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-19T04:21:20.946 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.70 metric 100 2024-09-19T04:21:20.946 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.70 metric 100 2024-09-19T04:21:20.948 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-09-19T04:21:20.948 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 1024 pref medium 2024-09-19T04:21:20.949 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 100 pref medium 2024-09-19T04:21:20.951 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-09-19T04:21:20.951 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-09-19T04:21:20.951 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T04:21:20.951 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-09-19T04:21:20.951 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-19T04:21:20.951 INFO:teuthology.orchestra.run.smithi070.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-09-19T04:21:20.952 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-09-19T04:21:20.952 INFO:teuthology.orchestra.run.smithi070.stdout:Mon IP `172.21.15.70` is in CIDR network `172.21.0.0/20` 2024-09-19T04:21:20.952 INFO:teuthology.orchestra.run.smithi070.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-09-19T04:21:20.952 INFO:teuthology.orchestra.run.smithi070.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-09-19T04:21:20.953 INFO:teuthology.orchestra.run.smithi070.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:21:21.416 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stdout d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T04:21:21.416 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961... 2024-09-19T04:21:21.416 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Getting image source signatures 2024-09-19T04:21:21.416 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:c4221751d16d26d2a4b7031ebd71ecffffff13c8cf7401cf95ce80dab3b6d67a 2024-09-19T04:21:21.416 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-09-19T04:21:21.416 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Copying config sha256:d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d 2024-09-19T04:21:21.417 INFO:teuthology.orchestra.run.smithi070.stdout:/bin/podman: stderr Writing manifest to image destination 2024-09-19T04:21:22.319 INFO:teuthology.orchestra.run.smithi070.stdout:ceph: stdout ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T04:21:22.319 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph version: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable) 2024-09-19T04:21:22.320 INFO:teuthology.orchestra.run.smithi070.stdout:Extracting ceph user uid/gid from container image... 2024-09-19T04:21:23.250 INFO:teuthology.orchestra.run.smithi070.stdout:stat: stdout 167 167 2024-09-19T04:21:23.250 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial keys... 2024-09-19T04:21:24.122 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDDputm/AqdIhAAXC0zHYhgVeWOBbBgb1MCaA== 2024-09-19T04:21:25.169 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDEputmiVN6GhAAv6YIWU6YN+S0ic6aJ3I0lg== 2024-09-19T04:21:26.192 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph-authtool: stdout AQDFputmwubTHRAAmCxSANtYbjFweOe2q40wUQ== 2024-09-19T04:21:26.193 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial monmap... 2024-09-19T04:21:27.164 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T04:21:27.164 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-09-19T04:21:27.164 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:27.164 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T04:21:27.164 INFO:teuthology.orchestra.run.smithi070.stdout:monmaptool for a [v2:172.21.15.70:3300,v1:172.21.15.70:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-09-19T04:21:27.164 INFO:teuthology.orchestra.run.smithi070.stdout:setting min_mon_release = quincy 2024-09-19T04:21:27.165 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: set fsid to 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:27.165 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-09-19T04:21:27.165 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:21:27.165 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mon... 2024-09-19T04:21:28.086 INFO:teuthology.orchestra.run.smithi070.stdout:create mon.a on 2024-09-19T04:21:28.311 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-09-19T04:21:28.458 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-09-19T04:21:28.631 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7f15b24a-763e-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-7f15b24a-763e-11ef-bceb-c7b262605968.target. 2024-09-19T04:21:28.631 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7f15b24a-763e-11ef-bceb-c7b262605968.target → /etc/systemd/system/ceph-7f15b24a-763e-11ef-bceb-c7b262605968.target. 2024-09-19T04:21:28.875 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a 2024-09-19T04:21:28.876 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a.service: Unit ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a.service not loaded. 2024-09-19T04:21:29.041 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7f15b24a-763e-11ef-bceb-c7b262605968.target.wants/ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a.service → /etc/systemd/system/ceph-7f15b24a-763e-11ef-bceb-c7b262605968@.service. 2024-09-19T04:21:29.586 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:21:29.586 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-19T04:21:29.593 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:21:29.593 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-19T04:21:29.593 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-19T04:21:29.593 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T04:21:29.594 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon to start... 2024-09-19T04:21:29.594 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mon... 2024-09-19T04:21:29.718 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:29 smithi070 systemd[1]: Started Ceph mon.a for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:21:30.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T04:21:30.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: monmap epoch 1 2024-09-19T04:21:30.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:30.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: last_changed 2024-09-19T04:21:26.544673+0000 2024-09-19T04:21:30.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:21:30.602 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: min_mon_release 19 (squid) 2024-09-19T04:21:30.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: election_strategy: 1 2024-09-19T04:21:30.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:21:30.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: fsmap 2024-09-19T04:21:30.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T04:21:30.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: mgrmap e1: no daemons active 2024-09-19T04:21:30.603 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:30 smithi070 ceph-mon[30569]: from='client.? 172.21.15.70:0/807884215' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-09-19T04:21:30.610 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout cluster: 2024-09-19T04:21:30.610 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout id: 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:30.610 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-09-19T04:21:30.610 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:30.610 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout services: 2024-09-19T04:21:30.610 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.583902s) 2024-09-19T04:21:30.610 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout data: 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout pgs: 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.016+0000 7f4833b2b640 1 Processor -- start 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.016+0000 7f4833b2b640 1 -- start start 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.016+0000 7f4833b2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c106bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:30.611 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.016+0000 7f4833b2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f482c107180 con 0x7f482c1067b0 2024-09-19T04:21:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.016+0000 7f48318c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c106bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.016+0000 7f48318c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c106bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56798/0 (socket says 172.21.15.70:56798) 2024-09-19T04:21:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.016+0000 7f48318c7640 1 -- 172.21.15.70:0/1721842853 learned_addr learned my addr 172.21.15.70:0/1721842853 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.017+0000 7f48318c7640 1 -- 172.21.15.70:0/1721842853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482c1079b0 con 0x7f482c1067b0 2024-09-19T04:21:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.019+0000 7f48318c7640 1 --2- 172.21.15.70:0/1721842853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c106bb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4828009820 tx=0x7f482802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b673b411f2ab7bb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.019+0000 7f48308c5640 1 -- 172.21.15.70:0/1721842853 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4828037070 con 0x7f482c1067b0 2024-09-19T04:21:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.019+0000 7f48308c5640 1 -- 172.21.15.70:0/1721842853 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4828032440 con 0x7f482c1067b0 2024-09-19T04:21:30.612 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.019+0000 7f48308c5640 1 -- 172.21.15.70:0/1721842853 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4828032740 con 0x7f482c1067b0 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 -- 172.21.15.70:0/1721842853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 msgr2=0x7f482c106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 --2- 172.21.15.70:0/1721842853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c106bb0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f4828009820 tx=0x7f482802a270 comp rx=0 tx=0).stop 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 -- 172.21.15.70:0/1721842853 shutdown_connections 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 --2- 172.21.15.70:0/1721842853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c106bb0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 -- 172.21.15.70:0/1721842853 >> 172.21.15.70:0/1721842853 conn(0x7f482c101f80 msgr2=0x7f482c1043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 -- 172.21.15.70:0/1721842853 shutdown_connections 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 -- 172.21.15.70:0/1721842853 wait complete. 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 Processor -- start 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.020+0000 7f4833b2b640 1 -- start start 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f4833b2b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c18f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f4833b2b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f482c107f50 con 0x7f482c1067b0 2024-09-19T04:21:30.613 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f48318c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c18f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f48318c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c18f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56810/0 (socket says 172.21.15.70:56810) 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f48318c7640 1 -- 172.21.15.70:0/807884215 learned_addr learned my addr 172.21.15.70:0/807884215 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f48318c7640 1 -- 172.21.15.70:0/807884215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f482c18f8b0 con 0x7f482c1067b0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f48318c7640 1 --2- 172.21.15.70:0/807884215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c18f370 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f48280090b0 tx=0x7f48280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f4822ffd640 1 -- 172.21.15.70:0/807884215 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4828041070 con 0x7f482c1067b0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f4822ffd640 1 -- 172.21.15.70:0/807884215 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f482803c7a0 con 0x7f482c1067b0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f482c18daa0 con 0x7f482c1067b0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f4822ffd640 1 -- 172.21.15.70:0/807884215 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4828037040 con 0x7f482c1067b0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.021+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f482c18dfe0 con 0x7f482c1067b0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.022+0000 7f4822ffd640 1 -- 172.21.15.70:0/807884215 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4828044070 con 0x7f482c1067b0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.022+0000 7f4822ffd640 1 -- 172.21.15.70:0/807884215 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f482803d3f0 con 0x7f482c1067b0 2024-09-19T04:21:30.614 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.022+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f482c1085a0 con 0x7f482c1067b0 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.025+0000 7f4822ffd640 1 -- 172.21.15.70:0/807884215 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f4828046450 con 0x7f482c1067b0 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.085+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7f482c1944c0 con 0x7f482c1067b0 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.085+0000 7f4822ffd640 1 -- 172.21.15.70:0/807884215 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7f4828046630 con 0x7f482c1067b0 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.086+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 msgr2=0x7f482c18f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.086+0000 7f4833b2b640 1 --2- 172.21.15.70:0/807884215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c18f370 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f48280090b0 tx=0x7f48280046c0 comp rx=0 tx=0).stop 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.086+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 shutdown_connections 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.086+0000 7f4833b2b640 1 --2- 172.21.15.70:0/807884215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f482c1067b0 0x7f482c18f370 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.086+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 >> 172.21.15.70:0/807884215 conn(0x7f482c101f80 msgr2=0x7f482c07b8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.086+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 shutdown_connections 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:30.086+0000 7f4833b2b640 1 -- 172.21.15.70:0/807884215 wait complete. 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:mon is available 2024-09-19T04:21:30.615 INFO:teuthology.orchestra.run.smithi070.stdout:Assimilating anything we can from ceph.conf... 2024-09-19T04:21:31.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:31 smithi070 ceph-mon[30569]: from='client.? 172.21.15.70:0/129449449' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T04:21:31.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:31 smithi070 ceph-mon[30569]: from='client.? 172.21.15.70:0/129449449' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-09-19T04:21:31.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:31.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T04:21:31.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:31.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-19T04:21:31.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T04:21:31.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T04:21:31.675 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T04:21:31.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T04:21:31.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:31.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T04:21:31.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T04:21:31.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:31.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T04:21:31.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T04:21:31.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.012+0000 7f9e5ab5b640 1 Processor -- start 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.012+0000 7f9e5ab5b640 1 -- start start 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.012+0000 7f9e5ab5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e54107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.012+0000 7f9e5ab5b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54108290 con 0x7f9e541078c0 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.012+0000 7f9e588f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e54107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.012+0000 7f9e588f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e54107cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56824/0 (socket says 172.21.15.70:56824) 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.012+0000 7f9e588f7640 1 -- 172.21.15.70:0/1843051119 learned_addr learned my addr 172.21.15.70:0/1843051119 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.013+0000 7f9e588f7640 1 -- 172.21.15.70:0/1843051119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e54108a70 con 0x7f9e541078c0 2024-09-19T04:21:31.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.013+0000 7f9e588f7640 1 --2- 172.21.15.70:0/1843051119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e54107cc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009820 tx=0x7f9e4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59df18c2a42a5427 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.013+0000 7f9e537fe640 1 -- 172.21.15.70:0/1843051119 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e48037070 con 0x7f9e541078c0 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.013+0000 7f9e537fe640 1 -- 172.21.15.70:0/1843051119 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e48032440 con 0x7f9e541078c0 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.013+0000 7f9e537fe640 1 -- 172.21.15.70:0/1843051119 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e48032740 con 0x7f9e541078c0 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.014+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/1843051119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 msgr2=0x7f9e54107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.014+0000 7f9e5ab5b640 1 --2- 172.21.15.70:0/1843051119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e54107cc0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f9e48009820 tx=0x7f9e4802a270 comp rx=0 tx=0).stop 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.014+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/1843051119 shutdown_connections 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.014+0000 7f9e5ab5b640 1 --2- 172.21.15.70:0/1843051119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e54107cc0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.014+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/1843051119 >> 172.21.15.70:0/1843051119 conn(0x7f9e54103090 msgr2=0x7f9e541054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.014+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/1843051119 shutdown_connections 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.014+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/1843051119 wait complete. 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.014+0000 7f9e5ab5b640 1 Processor -- start 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e5ab5b640 1 -- start start 2024-09-19T04:21:31.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e5ab5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e5419b050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e5ab5b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e54109010 con 0x7f9e541078c0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e588f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e5419b050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e588f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e5419b050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56838/0 (socket says 172.21.15.70:56838) 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e588f7640 1 -- 172.21.15.70:0/129449449 learned_addr learned my addr 172.21.15.70:0/129449449 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e588f7640 1 -- 172.21.15.70:0/129449449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5419b590 con 0x7f9e541078c0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e588f7640 1 --2- 172.21.15.70:0/129449449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e5419b050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9e480090b0 tx=0x7f9e480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e51ffb640 1 -- 172.21.15.70:0/129449449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e48041070 con 0x7f9e541078c0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e51ffb640 1 -- 172.21.15.70:0/129449449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e4803c7a0 con 0x7f9e541078c0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e51ffb640 1 -- 172.21.15.70:0/129449449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9e48037040 con 0x7f9e541078c0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.015+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5419b820 con 0x7f9e541078c0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.016+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5419e510 con 0x7f9e541078c0 2024-09-19T04:21:31.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.016+0000 7f9e51ffb640 1 -- 172.21.15.70:0/129449449 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9e48044070 con 0x7f9e541078c0 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.016+0000 7f9e51ffb640 1 -- 172.21.15.70:0/129449449 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f9e4803d3f0 con 0x7f9e541078c0 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.017+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e54109660 con 0x7f9e541078c0 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.019+0000 7f9e51ffb640 1 -- 172.21.15.70:0/129449449 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7f9e48046450 con 0x7f9e541078c0 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.075+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f9e5419fbe0 con 0x7f9e541078c0 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.078+0000 7f9e51ffb640 1 -- 172.21.15.70:0/129449449 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+429 (secure 0 0 0) 0x7f9e48046630 con 0x7f9e541078c0 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.079+0000 7f9e51ffb640 1 -- 172.21.15.70:0/129449449 <== mon.0 v2:172.21.15.70:3300/0 8 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f9e48056070 con 0x7f9e541078c0 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.080+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 msgr2=0x7f9e5419b050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.080+0000 7f9e5ab5b640 1 --2- 172.21.15.70:0/129449449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e5419b050 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f9e480090b0 tx=0x7f9e480046c0 comp rx=0 tx=0).stop 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.080+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 shutdown_connections 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.080+0000 7f9e5ab5b640 1 --2- 172.21.15.70:0/129449449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e541078c0 0x7f9e5419b050 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:31.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.080+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 >> 172.21.15.70:0/129449449 conn(0x7f9e54103090 msgr2=0x7f9e5418f340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:31.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.080+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 shutdown_connections 2024-09-19T04:21:31.681 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:31.080+0000 7f9e5ab5b640 1 -- 172.21.15.70:0/129449449 wait complete. 2024-09-19T04:21:31.681 INFO:teuthology.orchestra.run.smithi070.stdout:Generating new minimal ceph.conf... 2024-09-19T04:21:32.731 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:32 smithi070 ceph-mon[30569]: from='client.? 172.21.15.70:0/18893131' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:21:32.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.043+0000 7fa52a5e7640 1 Processor -- start 2024-09-19T04:21:32.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.043+0000 7fa52a5e7640 1 -- start start 2024-09-19T04:21:32.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.043+0000 7fa52a5e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa524105fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:32.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.043+0000 7fa52a5e7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa524106590 con 0x7fa524105bc0 2024-09-19T04:21:32.737 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.043+0000 7fa523fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa524105fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.043+0000 7fa523fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa524105fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56846/0 (socket says 172.21.15.70:56846) 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.043+0000 7fa523fff640 1 -- 172.21.15.70:0/4028364527 learned_addr learned my addr 172.21.15.70:0/4028364527 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.043+0000 7fa523fff640 1 -- 172.21.15.70:0/4028364527 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa524108ba0 con 0x7fa524105bc0 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.044+0000 7fa523fff640 1 --2- 172.21.15.70:0/4028364527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa524105fc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa514009820 tx=0x7fa51402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12b75bbf3cf3d8b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.044+0000 7fa522ffd640 1 -- 172.21.15.70:0/4028364527 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa514037070 con 0x7fa524105bc0 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.044+0000 7fa522ffd640 1 -- 172.21.15.70:0/4028364527 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fa514032900 con 0x7fa524105bc0 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.044+0000 7fa522ffd640 1 -- 172.21.15.70:0/4028364527 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa514030840 con 0x7fa524105bc0 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 -- 172.21.15.70:0/4028364527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 msgr2=0x7fa524105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 --2- 172.21.15.70:0/4028364527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa524105fc0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fa514009820 tx=0x7fa51402a270 comp rx=0 tx=0).stop 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 -- 172.21.15.70:0/4028364527 shutdown_connections 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 --2- 172.21.15.70:0/4028364527 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa524105fc0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:32.738 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 -- 172.21.15.70:0/4028364527 >> 172.21.15.70:0/4028364527 conn(0x7fa524101750 msgr2=0x7fa524103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 -- 172.21.15.70:0/4028364527 shutdown_connections 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 -- 172.21.15.70:0/4028364527 wait complete. 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 Processor -- start 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.045+0000 7fa52a5e7640 1 -- start start 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa52a5e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa52419b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa52a5e7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa52410bdd0 con 0x7fa524105bc0 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa523fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa52419b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa523fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa52419b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56848/0 (socket says 172.21.15.70:56848) 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa523fff640 1 -- 172.21.15.70:0/18893131 learned_addr learned my addr 172.21.15.70:0/18893131 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa523fff640 1 -- 172.21.15.70:0/18893131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa52419bdb0 con 0x7fa524105bc0 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa523fff640 1 --2- 172.21.15.70:0/18893131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa52419b870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa514030590 tx=0x7fa514032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa5217fa640 1 -- 172.21.15.70:0/18893131 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa514037040 con 0x7fa524105bc0 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa52419c040 con 0x7fa524105bc0 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa5217fa640 1 -- 172.21.15.70:0/18893131 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fa514032be0 con 0x7fa524105bc0 2024-09-19T04:21:32.739 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa5217fa640 1 -- 172.21.15.70:0/18893131 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa51403a520 con 0x7fa524105bc0 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.046+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa52419ed30 con 0x7fa524105bc0 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.047+0000 7fa5217fa640 1 -- 172.21.15.70:0/18893131 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa51403a7e0 con 0x7fa524105bc0 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.047+0000 7fa5217fa640 1 -- 172.21.15.70:0/18893131 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa514044d70 con 0x7fa524105bc0 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.047+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa524106040 con 0x7fa524105bc0 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.050+0000 7fa5217fa640 1 -- 172.21.15.70:0/18893131 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fa514032d90 con 0x7fa524105bc0 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.107+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fa52419f2a0 con 0x7fa524105bc0 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.107+0000 7fa5217fa640 1 -- 172.21.15.70:0/18893131 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+175 (secure 0 0 0) 0x7fa514044400 con 0x7fa524105bc0 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.108+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 msgr2=0x7fa52419b870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.108+0000 7fa52a5e7640 1 --2- 172.21.15.70:0/18893131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa52419b870 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fa514030590 tx=0x7fa514032670 comp rx=0 tx=0).stop 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.108+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 shutdown_connections 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.108+0000 7fa52a5e7640 1 --2- 172.21.15.70:0/18893131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa524105bc0 0x7fa52419b870 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.108+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 >> 172.21.15.70:0/18893131 conn(0x7fa524101750 msgr2=0x7fa524102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.108+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 shutdown_connections 2024-09-19T04:21:32.740 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:32.108+0000 7fa52a5e7640 1 -- 172.21.15.70:0/18893131 wait complete. 2024-09-19T04:21:32.741 INFO:teuthology.orchestra.run.smithi070.stdout:Restarting the monitor... 2024-09-19T04:21:33.009 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:32 smithi070 systemd[1]: Stopping Ceph mon.a for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:21:33.385 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a[30562]: 2024-09-19T04:21:33.007+0000 7fe4cbe17640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:21:33.385 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a[30562]: 2024-09-19T04:21:33.007+0000 7fe4cbe17640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-09-19T04:21:33.385 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 podman[30817]: 2024-09-19 04:21:33.110166677 +0000 UTC m=+0.213473797 container died bd4faea5a576f33111bea83f9a7ab4f4000e34e20d240ea8f809337f77c224b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_CLEAN=True) 2024-09-19T04:21:33.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 podman[30817]: 2024-09-19 04:21:33.483186024 +0000 UTC m=+0.586493142 container cleanup bd4faea5a576f33111bea83f9a7ab4f4000e34e20d240ea8f809337f77c224b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T04:21:33.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 bash[30817]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a 2024-09-19T04:21:34.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 podman[30829]: 2024-09-19 04:21:33.734171873 +0000 UTC m=+0.619083324 container remove bd4faea5a576f33111bea83f9a7ab4f4000e34e20d240ea8f809337f77c224b6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T04:21:34.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 systemd[1]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T04:21:34.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 systemd[1]: Stopped Ceph mon.a for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:21:34.036 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:33 smithi070 systemd[1]: Starting Ceph mon.a for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:21:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 podman[30923]: 2024-09-19 04:21:34.035493338 +0000 UTC m=+0.087065194 container create c4cdef64a225b2de1f25cb52e99ad700b8c19f195ea17c5e25fc8ee51916ac5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:21:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 podman[30923]: 2024-09-19 04:21:33.964225571 +0000 UTC m=+0.015797371 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 2024-09-19T04:21:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 podman[30923]: 2024-09-19 04:21:34.226509701 +0000 UTC m=+0.278081499 container init c4cdef64a225b2de1f25cb52e99ad700b8c19f195ea17c5e25fc8ee51916ac5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T04:21:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 podman[30923]: 2024-09-19 04:21:34.229469236 +0000 UTC m=+0.281041029 container start c4cdef64a225b2de1f25cb52e99ad700b8c19f195ea17c5e25fc8ee51916ac5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T04:21:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T04:21:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: pidfile_write: ignore empty --pid-file 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: load: jerasure load: lrc 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: RocksDB version: 7.9.2 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Git sha 0 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: DB SUMMARY 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: DB Session ID: 85LHMGO1GWLM1QEGPA3G 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: CURRENT file: CURRENT 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 107148 ; 2024-09-19T04:21:34.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.error_if_exists: 0 2024-09-19T04:21:34.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.create_if_missing: 0 2024-09-19T04:21:34.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.paranoid_checks: 1 2024-09-19T04:21:34.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T04:21:34.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T04:21:34.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T04:21:34.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.env: 0x56500bc22940 2024-09-19T04:21:34.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T04:21:34.316 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.info_log: 0x56500e32f6e0 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.statistics: (nil) 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.use_fsync: 0 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_log_file_size: 0 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.allow_fallocate: 1 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T04:21:34.317 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.use_direct_reads: 0 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.db_log_dir: 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.wal_dir: 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.write_buffer_manager: 0x56500e33edc0 2024-09-19T04:21:34.318 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.unordered_write: 0 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.row_cache: None 2024-09-19T04:21:34.319 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.wal_filter: None 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.two_write_queues: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.wal_compression: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.atomic_flush: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.log_readahead_size: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T04:21:34.320 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_background_jobs: 2 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_background_compactions: -1 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_subcompactions: 1 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T04:21:34.321 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_open_files: -1 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_background_flushes: -1 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Compression algorithms supported: 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: kZSTD supported: 0 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: kXpressCompression supported: 0 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: kBZip2Compression supported: 0 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: kLZ4Compression supported: 1 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: kZlibCompression supported: 1 2024-09-19T04:21:34.322 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: kSnappyCompression supported: 1 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.merge_operator: 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_filter: None 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x56500e32f320) 2024-09-19T04:21:34.323 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks: 1 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: pin_top_level_index_and_filter: 1 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_type: 0 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_index_type: 0 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_shortening: 1 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: checksum: 4 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: no_block_cache: 0 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache: 0x56500e3231f0 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_name: BinnedLRUCache 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_options: 2024-09-19T04:21:34.324 INFO:journalctl@ceph.mon.a.smithi070.stdout: capacity : 536870912 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_shard_bits : 4 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: strict_capacity_limit : 0 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: high_pri_pool_ratio: 0.000 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_cache_compressed: (nil) 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: persistent_cache: (nil) 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size: 4096 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_size_deviation: 10 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_restart_interval: 16 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: index_block_restart_interval: 1 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: metadata_block_size: 4096 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: partition_filters: 0 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: use_delta_encoding: 1 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: filter_policy: bloomfilter 2024-09-19T04:21:34.325 INFO:journalctl@ceph.mon.a.smithi070.stdout: whole_key_filtering: 1 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: verify_compression: 0 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: read_amp_bytes_per_bit: 0 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: format_version: 5 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_index_compression: 1 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: block_align: 0 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: max_auto_readahead_size: 262144 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: prepopulate_block_cache: 0 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: initial_auto_readahead_size: 8192 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression: NoCompression 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T04:21:34.326 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.num_levels: 7 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T04:21:34.327 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T04:21:34.328 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T04:21:34.329 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T04:21:34.330 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.inplace_update_support: 0 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.bloom_locality: 0 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.max_successive_merges: 0 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T04:21:34.331 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.ttl: 2592000 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.enable_blob_files: false 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.min_blob_size: 0 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T04:21:34.332 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: c8ded40d-82bf-4168-8bad-ad0b29802250 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719694255210, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719694256231, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 102058, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 336, "table_properties": {"data_size": 99946, "index_size": 304, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14774, "raw_average_key_size": 50, "raw_value_size": 91929, "raw_average_value_size": 311, "num_data_blocks": 12, "num_entries": 295, "num_filter_entries": 295, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726719694, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "c8ded40d-82bf-4168-8bad-ad0b29802250", "db_session_id": "85LHMGO1GWLM1QEGPA3G", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719694256326, "job": 1, "event": "recovery_finished"} 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T04:21:34.333 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x56500e350e00 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: DB pointer 0x56500e44c000 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** DB Stats ** 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:21:34.334 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: L0 2/0 101.53 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: Sum 2/0 101.53 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 148.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** Compaction Stats [default] ** 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 148.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T04:21:34.335 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: Cumulative compaction: 0.00 GB write, 30.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: Interval compaction: 0.00 GB write, 30.11 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache BinnedLRUCache@0x56500e3231f0#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-09-19T04:21:34.336 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: starting mon.a rank 0 at public addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] at bind addrs [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a@-1(???) e1 preinit fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a@-1(???).mds e1 new map 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a@-1(???).mds e1 print_map 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout: e1 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout: btime 2024-09-19T04:21:29:502880+0000 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout: legacy client fscid: -1 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout: 2024-09-19T04:21:34.337 INFO:journalctl@ceph.mon.a.smithi070.stdout: No filesystems configured 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 bash[30923]: c4cdef64a225b2de1f25cb52e99ad700b8c19f195ea17c5e25fc8ee51916ac5b 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mon.a is new leader, mons a in quorum (ranks 0) 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: monmap epoch 1 2024-09-19T04:21:34.338 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: last_changed 2024-09-19T04:21:26.544673+0000 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: min_mon_release 19 (squid) 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: election_strategy: 1 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: fsmap 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: osdmap e1: 0 total, 0 up, 0 in 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 ceph-mon[30942]: mgrmap e1: no daemons active 2024-09-19T04:21:34.339 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:34 smithi070 systemd[1]: Started Ceph mon.a for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:21:34.339 INFO:teuthology.orchestra.run.smithi070.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-09-19T04:21:35.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.736+0000 7fc5c960f640 1 Processor -- start 2024-09-19T04:21:35.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.736+0000 7fc5c960f640 1 -- start start 2024-09-19T04:21:35.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.736+0000 7fc5c960f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c4107d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:35.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.736+0000 7fc5c960f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c4108260 con 0x7fc5c4107920 2024-09-19T04:21:35.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.737+0000 7fc5c2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c4107d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:35.334 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.737+0000 7fc5c2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c4107d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46170/0 (socket says 172.21.15.70:46170) 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.737+0000 7fc5c2ffd640 1 -- 172.21.15.70:0/1104655167 learned_addr learned my addr 172.21.15.70:0/1104655167 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.737+0000 7fc5c2ffd640 1 -- 172.21.15.70:0/1104655167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c41083e0 con 0x7fc5c4107920 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.739+0000 7fc5c2ffd640 1 --2- 172.21.15.70:0/1104655167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c4107d20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009820 tx=0x7fc5b402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63122844eddc5f2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.739+0000 7fc5c1ffb640 1 -- 172.21.15.70:0/1104655167 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b4037070 con 0x7fc5c4107920 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.739+0000 7fc5c1ffb640 1 -- 172.21.15.70:0/1104655167 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fc5b4032900 con 0x7fc5c4107920 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.739+0000 7fc5c1ffb640 1 -- 172.21.15.70:0/1104655167 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b4030840 con 0x7fc5c4107920 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.740+0000 7fc5c960f640 1 -- 172.21.15.70:0/1104655167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 msgr2=0x7fc5c4107d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.740+0000 7fc5c960f640 1 --2- 172.21.15.70:0/1104655167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c4107d20 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fc5b4009820 tx=0x7fc5b402a270 comp rx=0 tx=0).stop 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.740+0000 7fc5c960f640 1 -- 172.21.15.70:0/1104655167 shutdown_connections 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.740+0000 7fc5c960f640 1 --2- 172.21.15.70:0/1104655167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c4107d20 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.740+0000 7fc5c960f640 1 -- 172.21.15.70:0/1104655167 >> 172.21.15.70:0/1104655167 conn(0x7fc5c41031b0 msgr2=0x7fc5c41055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:35.335 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.740+0000 7fc5c960f640 1 -- 172.21.15.70:0/1104655167 shutdown_connections 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.740+0000 7fc5c960f640 1 -- 172.21.15.70:0/1104655167 wait complete. 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c960f640 1 Processor -- start 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c960f640 1 -- start start 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c960f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c419da30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c960f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc5c410bd90 con 0x7fc5c4107920 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c419da30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c419da30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46186/0 (socket says 172.21.15.70:46186) 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c2ffd640 1 -- 172.21.15.70:0/1855925360 learned_addr learned my addr 172.21.15.70:0/1855925360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c2ffd640 1 -- 172.21.15.70:0/1855925360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5c419df70 con 0x7fc5c4107920 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.741+0000 7fc5c2ffd640 1 --2- 172.21.15.70:0/1855925360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c419da30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40097f0 tx=0x7fc5b4030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.742+0000 7fc5abfff640 1 -- 172.21.15.70:0/1855925360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b4037040 con 0x7fc5c4107920 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.742+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5c419e200 con 0x7fc5c4107920 2024-09-19T04:21:35.336 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.742+0000 7fc5abfff640 1 -- 172.21.15.70:0/1855925360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fc5b403b3f0 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.742+0000 7fc5abfff640 1 -- 172.21.15.70:0/1855925360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc5b403a520 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.742+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5c41a0ef0 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.742+0000 7fc5abfff640 1 -- 172.21.15.70:0/1855925360 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fc5b403a760 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.742+0000 7fc5abfff640 1 -- 172.21.15.70:0/1855925360 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fc5b4044dc0 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.743+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5c410bf10 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.745+0000 7fc5abfff640 1 -- 172.21.15.70:0/1855925360 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7fc5b403ba30 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.802+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7fc5c41a11b0 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.803+0000 7fc5abfff640 1 -- 172.21.15.70:0/1855925360 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7fc5b403abe0 con 0x7fc5c4107920 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.804+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 msgr2=0x7fc5c419da30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.804+0000 7fc5c960f640 1 --2- 172.21.15.70:0/1855925360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c419da30 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fc5b40097f0 tx=0x7fc5b4030d70 comp rx=0 tx=0).stop 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.804+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 shutdown_connections 2024-09-19T04:21:35.337 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.804+0000 7fc5c960f640 1 --2- 172.21.15.70:0/1855925360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc5c4107920 0x7fc5c419da30 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:35.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.804+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 >> 172.21.15.70:0/1855925360 conn(0x7fc5c41031b0 msgr2=0x7fc5c4103c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:35.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.804+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 shutdown_connections 2024-09-19T04:21:35.338 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:34.804+0000 7fc5c960f640 1 -- 172.21.15.70:0/1855925360 wait complete. 2024-09-19T04:21:35.338 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote config to /etc/ceph/ceph.conf 2024-09-19T04:21:35.356 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:21:35.356 INFO:teuthology.orchestra.run.smithi070.stdout:Creating mgr... 2024-09-19T04:21:35.356 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:9283 ... 2024-09-19T04:21:35.357 INFO:teuthology.orchestra.run.smithi070.stdout:Verifying port 0.0.0.0:8765 ... 2024-09-19T04:21:35.617 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.x 2024-09-19T04:21:35.617 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.x.service: Unit ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.x.service not loaded. 2024-09-19T04:21:35.763 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7f15b24a-763e-11ef-bceb-c7b262605968.target.wants/ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-7f15b24a-763e-11ef-bceb-c7b262605968@.service. 2024-09-19T04:21:35.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:35 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1855925360' entity='client.admin' 2024-09-19T04:21:36.282 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 podman[31153]: 2024-09-19 04:21:36.183794168 +0000 UTC m=+0.305744481 container start 4ca48c3ce5fecbd995a754f9d8fb93ee21f313d74bd2bf1f26329c4aafb46e28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:21:36.282 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 bash[31153]: 4ca48c3ce5fecbd995a754f9d8fb93ee21f313d74bd2bf1f26329c4aafb46e28 2024-09-19T04:21:36.297 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:21:36.298 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-19T04:21:36.306 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:21:36.306 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-19T04:21:36.306 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-19T04:21:36.306 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to enable service . firewalld.service is not available 2024-09-19T04:21:36.316 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:21:36.316 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-19T04:21:36.325 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:21:36.325 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-19T04:21:36.325 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-19T04:21:36.325 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-09-19T04:21:36.325 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr to start... 2024-09-19T04:21:36.325 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr... 2024-09-19T04:21:36.543 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 systemd[1]: Started Ceph mgr.x for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:21:36.543 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:36.306+0000 7f17e7685040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:21:36.543 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:36.370+0000 7f17e7685040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:21:36.543 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:36.519+0000 7f17e7685040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:21:36.800 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:36.591+0000 7f17e7685040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:21:36.800 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:36.743+0000 7f17e7685040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:21:37.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:36 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4196206353' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T04:21:37.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:36 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:36.892+0000 7f17e7685040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:21:37.413 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:37 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:37.208+0000 7f17e7685040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:21:37.413 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:37 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:37.268+0000 7f17e7685040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:21:37.416 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:37.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:21:37.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "7f15b24a-763e-11ef-bceb-c7b262605968", 2024-09-19T04:21:37.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T04:21:37.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T04:21:37.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T04:21:37.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T04:21:37.419 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T04:21:37.420 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T04:21:37.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:37.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T04:21:37.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:21:37.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T04:21:37.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T04:21:37.421 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T04:21:37.429 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T04:21:29:502880+0000", 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": false, 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T04:21:37.430 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T04:21:29.503537+0000", 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:21:37.431 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.719+0000 7ffaf6069640 1 Processor -- start 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.719+0000 7ffaf6069640 1 -- start start 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.719+0000 7ffaf6069640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf010a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.719+0000 7ffaf6069640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf007bed0 con 0x7ffaf0108320 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.720+0000 7ffaef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf010a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.720+0000 7ffaef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf010a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46198/0 (socket says 172.21.15.70:46198) 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.720+0000 7ffaef7fe640 1 -- 172.21.15.70:0/1329968100 learned_addr learned my addr 172.21.15.70:0/1329968100 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.720+0000 7ffaef7fe640 1 -- 172.21.15.70:0/1329968100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf010ac50 con 0x7ffaf0108320 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.721+0000 7ffaef7fe640 1 --2- 172.21.15.70:0/1329968100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf010a710 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009820 tx=0x7ffae002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=852071e815acf929 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.721+0000 7ffaeeffd640 1 -- 172.21.15.70:0/1329968100 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae0037070 con 0x7ffaf0108320 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.721+0000 7ffaeeffd640 1 -- 172.21.15.70:0/1329968100 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7ffae0032900 con 0x7ffaf0108320 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.721+0000 7ffaeeffd640 1 -- 172.21.15.70:0/1329968100 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae0030840 con 0x7ffaf0108320 2024-09-19T04:21:37.432 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.722+0000 7ffaf6069640 1 -- 172.21.15.70:0/1329968100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 msgr2=0x7ffaf010a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.722+0000 7ffaf6069640 1 --2- 172.21.15.70:0/1329968100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf010a710 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7ffae0009820 tx=0x7ffae002a270 comp rx=0 tx=0).stop 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.722+0000 7ffaf6069640 1 -- 172.21.15.70:0/1329968100 shutdown_connections 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.722+0000 7ffaf6069640 1 --2- 172.21.15.70:0/1329968100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf010a710 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.722+0000 7ffaf6069640 1 -- 172.21.15.70:0/1329968100 >> 172.21.15.70:0/1329968100 conn(0x7ffaf0101f80 msgr2=0x7ffaf01043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.722+0000 7ffaf6069640 1 -- 172.21.15.70:0/1329968100 shutdown_connections 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.722+0000 7ffaf6069640 1 -- 172.21.15.70:0/1329968100 wait complete. 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.723+0000 7ffaf6069640 1 Processor -- start 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.723+0000 7ffaf6069640 1 -- start start 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.723+0000 7ffaf6069640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf019b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.723+0000 7ffaf6069640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffaf010bcf0 con 0x7ffaf0108320 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.723+0000 7ffaef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf019b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.723+0000 7ffaef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf019b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46200/0 (socket says 172.21.15.70:46200) 2024-09-19T04:21:37.433 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.723+0000 7ffaef7fe640 1 -- 172.21.15.70:0/4196206353 learned_addr learned my addr 172.21.15.70:0/4196206353 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.723+0000 7ffaef7fe640 1 -- 172.21.15.70:0/4196206353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffaf019bde0 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.724+0000 7ffaef7fe640 1 --2- 172.21.15.70:0/4196206353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf019b8a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffae0030480 tx=0x7ffae0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.724+0000 7ffaed7fa640 1 -- 172.21.15.70:0/4196206353 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae0037040 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.724+0000 7ffaed7fa640 1 -- 172.21.15.70:0/4196206353 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7ffae0040070 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.724+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffaf019c070 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.724+0000 7ffaed7fa640 1 -- 172.21.15.70:0/4196206353 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffae003a610 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.724+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffaf019ed60 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.724+0000 7ffaed7fa640 1 -- 172.21.15.70:0/4196206353 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffae003a8d0 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.724+0000 7ffaed7fa640 1 -- 172.21.15.70:0/4196206353 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7ffae0045b30 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.725+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffaf0108780 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.727+0000 7ffaed7fa640 1 -- 172.21.15.70:0/4196206353 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+74432 (secure 0 0 0) 0x7ffae003bb00 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.787+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7ffaf019f2d0 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.788+0000 7ffaed7fa640 1 -- 172.21.15.70:0/4196206353 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7ffae003ad50 con 0x7ffaf0108320 2024-09-19T04:21:37.434 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.789+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 msgr2=0x7ffaf019b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:37.435 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.789+0000 7ffaf6069640 1 --2- 172.21.15.70:0/4196206353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf019b8a0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7ffae0030480 tx=0x7ffae0032ce0 comp rx=0 tx=0).stop 2024-09-19T04:21:37.435 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.789+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 shutdown_connections 2024-09-19T04:21:37.435 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.789+0000 7ffaf6069640 1 --2- 172.21.15.70:0/4196206353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffaf0108320 0x7ffaf019b8a0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:37.435 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.789+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 >> 172.21.15.70:0/4196206353 conn(0x7ffaf0101f80 msgr2=0x7ffaf0102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:37.435 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.789+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 shutdown_connections 2024-09-19T04:21:37.435 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:36.789+0000 7ffaf6069640 1 -- 172.21.15.70:0/4196206353 wait complete. 2024-09-19T04:21:37.435 INFO:teuthology.orchestra.run.smithi070.stdout:mgr not available, waiting (1/15)... 2024-09-19T04:21:37.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:37 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:37.454+0000 7f17e7685040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:21:38.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:38 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:38.325+0000 7f17e7685040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:21:38.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:38 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:38.391+0000 7f17e7685040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:21:39.358 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.098+0000 7f17e7685040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:21:39.358 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.212+0000 7f17e7685040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:21:39.359 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.357+0000 7f17e7685040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:21:39.644 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.419+0000 7f17e7685040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:21:39.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.576+0000 7f17e7685040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:21:39.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.643+0000 7f17e7685040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:21:39.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.701+0000 7f17e7685040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:21:39.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.861+0000 7f17e7685040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:21:40.191 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.926+0000 7f17e7685040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:21:40.192 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:39 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:39.991+0000 7f17e7685040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:21:40.192 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:40 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:40.072+0000 7f17e7685040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:21:40.192 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:40 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:40.131+0000 7f17e7685040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:21:40.192 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:40 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:40.190+0000 7f17e7685040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:21:41.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:40 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:40.990+0000 7f17e7685040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:21:41.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: Activating manager daemon x 2024-09-19T04:21:41.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: mgrmap e2: x(active, starting, since 0.00310637s) 2024-09-19T04:21:41.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: Manager daemon x is now available 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' 2024-09-19T04:21:41.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:41 smithi070 ceph-mon[30942]: from='mgr.14100 172.21.15.70:0/407914637' entity='mgr.x' 2024-09-19T04:21:43.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:42 smithi070 ceph-mon[30942]: mgrmap e3: x(active, since 1.00702s) 2024-09-19T04:21:44.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:43 smithi070 ceph-mon[30942]: mgrmap e4: x(active, since 2s) 2024-09-19T04:21:44.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:43 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3509727747' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-09-19T04:21:48.474 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:48.474 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsid": "7f15b24a-763e-11ef-bceb-c7b262605968", 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "health": { 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 0 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "a" 2024-09-19T04:21:48.475 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "quorum_age": 8, 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "monmap": { 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-09-19T04:21:48.476 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-09-19T04:21:48.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-09-19T04:21:48.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-09-19T04:21:48.484 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-09-19T04:21:48.485 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "btime": "2024-09-19T04:21:29:502880+0000", 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modules": [ 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "iostat", 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "nfs", 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "restful" 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ], 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:48.486 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "modified": "2024-09-19T04:21:29.503537+0000", 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "services": {} 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout }, 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.926+0000 7f8132919640 1 Processor -- start 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.926+0000 7f8132919640 1 -- start start 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.926+0000 7f8132919640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c107cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.927+0000 7f8132919640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f812c108290 con 0x7f812c1078c0 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.927+0000 7f812bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c107cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:48.487 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.927+0000 7f812bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c107cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46276/0 (socket says 172.21.15.70:46276) 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.927+0000 7f812bfff640 1 -- 172.21.15.70:0/4191590391 learned_addr learned my addr 172.21.15.70:0/4191590391 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.927+0000 7f812bfff640 1 -- 172.21.15.70:0/4191590391 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c108a70 con 0x7f812c1078c0 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.928+0000 7f812bfff640 1 --2- 172.21.15.70:0/4191590391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c107cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f811c009820 tx=0x7f811c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de0117a93b7007b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.928+0000 7f812b7fe640 1 -- 172.21.15.70:0/4191590391 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c037070 con 0x7f812c1078c0 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.928+0000 7f812b7fe640 1 -- 172.21.15.70:0/4191590391 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f811c032900 con 0x7f812c1078c0 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.928+0000 7f812b7fe640 1 -- 172.21.15.70:0/4191590391 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c030840 con 0x7f812c1078c0 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.929+0000 7f8132919640 1 -- 172.21.15.70:0/4191590391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 msgr2=0x7f812c107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.929+0000 7f8132919640 1 --2- 172.21.15.70:0/4191590391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c107cc0 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f811c009820 tx=0x7f811c02a270 comp rx=0 tx=0).stop 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.929+0000 7f8132919640 1 -- 172.21.15.70:0/4191590391 shutdown_connections 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.929+0000 7f8132919640 1 --2- 172.21.15.70:0/4191590391 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c107cc0 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.929+0000 7f8132919640 1 -- 172.21.15.70:0/4191590391 >> 172.21.15.70:0/4191590391 conn(0x7f812c103090 msgr2=0x7f812c1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.929+0000 7f8132919640 1 -- 172.21.15.70:0/4191590391 shutdown_connections 2024-09-19T04:21:48.488 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.929+0000 7f8132919640 1 -- 172.21.15.70:0/4191590391 wait complete. 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.929+0000 7f8132919640 1 Processor -- start 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f8132919640 1 -- start start 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f8132919640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f8132919640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f812c10be20 con 0x7f812c1078c0 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f812bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f812bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46280/0 (socket says 172.21.15.70:46280) 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f812bfff640 1 -- 172.21.15.70:0/3509727747 learned_addr learned my addr 172.21.15.70:0/3509727747 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f812bfff640 1 -- 172.21.15.70:0/3509727747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f812c19bd80 con 0x7f812c1078c0 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f812bfff640 1 --2- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c19b840 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f811c030590 tx=0x7f811c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f8129ffb640 1 -- 172.21.15.70:0/3509727747 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c037040 con 0x7f812c1078c0 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f8129ffb640 1 -- 172.21.15.70:0/3509727747 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f811c032be0 con 0x7f812c1078c0 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f812c19c010 con 0x7f812c1078c0 2024-09-19T04:21:48.489 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.930+0000 7f8129ffb640 1 -- 172.21.15.70:0/3509727747 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f811c03a520 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.931+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f812c19ed00 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.931+0000 7f8129ffb640 1 -- 172.21.15.70:0/3509727747 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 3) ==== 46344+0+0 (secure 0 0 0) 0x7f811c03a7e0 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.932+0000 7f8129ffb640 1 --2- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f8118039050 0x7f811803b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.931+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f812c10bfa0 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.932+0000 7f8129ffb640 1 -- 172.21.15.70:0/3509727747 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f811c06c4b0 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.932+0000 7f8123fff640 1 --2- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f8118039050 0x7f811803b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.932+0000 7f8123fff640 1 --2- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f8118039050 0x7f811803b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f81140098c0 tx=0x7f8114006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.937+0000 7f8129ffb640 1 -- 172.21.15.70:0/3509727747 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f811c039bd0 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:42.999+0000 7f8129ffb640 1 -- 172.21.15.70:0/3509727747 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f811c044780 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.174+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f812c19f2f0 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.174+0000 7f8129ffb640 1 -- 172.21.15.70:0/3509727747 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f811c03b900 con 0x7f812c1078c0 2024-09-19T04:21:48.490 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f8118039050 msgr2=0x7f811803b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 --2- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f8118039050 0x7f811803b510 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f81140098c0 tx=0x7f8114006db0 comp rx=0 tx=0).stop 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 msgr2=0x7f812c19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 --2- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c19b840 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f811c030590 tx=0x7f811c032670 comp rx=0 tx=0).stop 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 shutdown_connections 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 --2- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f8118039050 0x7f811803b510 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 --2- 172.21.15.70:0/3509727747 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f812c1078c0 0x7f812c19b840 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 >> 172.21.15.70:0/3509727747 conn(0x7f812c103090 msgr2=0x7f812c103c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 shutdown_connections 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:43.176+0000 7f8132919640 1 -- 172.21.15.70:0/3509727747 wait complete. 2024-09-19T04:21:48.491 INFO:teuthology.orchestra.run.smithi070.stdout:mgr is available 2024-09-19T04:21:49.326 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:49 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/967599756' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [global] 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout fsid = 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.70:3300,v1:172.21.15.70:6789] 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:49.626 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [mgr] 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout [osd] 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.886+0000 7f68c86d0640 1 Processor -- start 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.886+0000 7f68c86d0640 1 -- start start 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.886+0000 7f68c86d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c0108120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.886+0000 7f68c86d0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68c01086f0 con 0x7f68c0107d20 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.886+0000 7f68c646c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c0108120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:49.627 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.886+0000 7f68c646c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c0108120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33840/0 (socket says 172.21.15.70:33840) 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.886+0000 7f68c646c640 1 -- 172.21.15.70:0/3770882748 learned_addr learned my addr 172.21.15.70:0/3770882748 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.887+0000 7f68c646c640 1 -- 172.21.15.70:0/3770882748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c0108870 con 0x7f68c0107d20 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.887+0000 7f68c646c640 1 --2- 172.21.15.70:0/3770882748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c0108120 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009820 tx=0x7f68bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503241e2e63f8d7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.887+0000 7f68c546a640 1 -- 172.21.15.70:0/3770882748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc037070 con 0x7f68c0107d20 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c546a640 1 -- 172.21.15.70:0/3770882748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f68bc032900 con 0x7f68c0107d20 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c546a640 1 -- 172.21.15.70:0/3770882748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc030840 con 0x7f68c0107d20 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c86d0640 1 -- 172.21.15.70:0/3770882748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 msgr2=0x7f68c0108120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c86d0640 1 --2- 172.21.15.70:0/3770882748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c0108120 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009820 tx=0x7f68bc02a270 comp rx=0 tx=0).stop 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c86d0640 1 -- 172.21.15.70:0/3770882748 shutdown_connections 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c86d0640 1 --2- 172.21.15.70:0/3770882748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c0108120 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c86d0640 1 -- 172.21.15.70:0/3770882748 >> 172.21.15.70:0/3770882748 conn(0x7f68c01016e0 msgr2=0x7f68c0103b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:49.628 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c86d0640 1 -- 172.21.15.70:0/3770882748 shutdown_connections 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.888+0000 7f68c86d0640 1 -- 172.21.15.70:0/3770882748 wait complete. 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c86d0640 1 Processor -- start 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c86d0640 1 -- start start 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c86d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c019d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c86d0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68c0106700 con 0x7f68c0107d20 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c646c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c019d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c646c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c019d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33850/0 (socket says 172.21.15.70:33850) 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c646c640 1 -- 172.21.15.70:0/967599756 learned_addr learned my addr 172.21.15.70:0/967599756 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c646c640 1 -- 172.21.15.70:0/967599756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c019df00 con 0x7f68c0107d20 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.889+0000 7f68c646c640 1 --2- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c019d9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f68bc030590 tx=0x7f68bc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.890+0000 7f68b77fe640 1 -- 172.21.15.70:0/967599756 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc037040 con 0x7f68c0107d20 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.890+0000 7f68b77fe640 1 -- 172.21.15.70:0/967599756 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f68bc032be0 con 0x7f68c0107d20 2024-09-19T04:21:49.629 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.890+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c019e190 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.890+0000 7f68b77fe640 1 -- 172.21.15.70:0/967599756 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f68bc03a520 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.890+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c01a0e80 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.890+0000 7f68b77fe640 1 -- 172.21.15.70:0/967599756 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f68bc03a7d0 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.891+0000 7f68b77fe640 1 --2- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f68ac0391b0 0x7f68ac03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.891+0000 7f68b77fe640 1 -- 172.21.15.70:0/967599756 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f68bc06c550 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.891+0000 7f68c5c6b640 1 --2- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f68ac0391b0 0x7f68ac03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.891+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c01081a0 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.891+0000 7f68c5c6b640 1 --2- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f68ac0391b0 0x7f68ac03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f68b00098c0 tx=0x7f68b0006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:48.896+0000 7f68b77fe640 1 -- 172.21.15.70:0/967599756 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68bc0371e0 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.061+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f68c01a25a0 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.062+0000 7f68b77fe640 1 -- 172.21.15.70:0/967599756 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+429 (secure 0 0 0) 0x7f68bc06bf70 con 0x7f68c0107d20 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f68ac0391b0 msgr2=0x7f68ac03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 --2- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f68ac0391b0 0x7f68ac03b670 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f68b00098c0 tx=0x7f68b0006db0 comp rx=0 tx=0).stop 2024-09-19T04:21:49.630 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 msgr2=0x7f68c019d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 --2- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c019d9c0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f68bc030590 tx=0x7f68bc032670 comp rx=0 tx=0).stop 2024-09-19T04:21:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 shutdown_connections 2024-09-19T04:21:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 --2- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f68ac0391b0 0x7f68ac03b670 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 --2- 172.21.15.70:0/967599756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c0107d20 0x7f68c019d9c0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 >> 172.21.15.70:0/967599756 conn(0x7f68c01016e0 msgr2=0x7f68c0193fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 shutdown_connections 2024-09-19T04:21:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:49.064+0000 7f68c86d0640 1 -- 172.21.15.70:0/967599756 wait complete. 2024-09-19T04:21:49.631 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling cephadm module... 2024-09-19T04:21:50.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1093134795' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-09-19T04:21:50.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ignoring --setuser ceph since I am not root 2024-09-19T04:21:50.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ignoring --setgroup ceph since I am not root 2024-09-19T04:21:50.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:50.447+0000 7f37c143a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:21:50.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:50.504+0000 7f37c143a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:21:50.922 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:50.655+0000 7f37c143a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:21:50.923 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:50.722+0000 7f37c143a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:21:50.923 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:50.871+0000 7f37c143a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:21:50.925 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.030+0000 7f2857311640 1 Processor -- start 2024-09-19T04:21:50.930 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.030+0000 7f2857311640 1 -- start start 2024-09-19T04:21:50.930 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.030+0000 7f2857311640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f2850106bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:50.930 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.030+0000 7f2857311640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2850107180 con 0x7f28501067b0 2024-09-19T04:21:50.930 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.031+0000 7f28550ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f2850106bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:50.930 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.031+0000 7f28550ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f2850106bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33866/0 (socket says 172.21.15.70:33866) 2024-09-19T04:21:50.930 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.031+0000 7f28550ad640 1 -- 172.21.15.70:0/898215243 learned_addr learned my addr 172.21.15.70:0/898215243 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.031+0000 7f28550ad640 1 -- 172.21.15.70:0/898215243 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28501079b0 con 0x7f28501067b0 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.032+0000 7f28550ad640 1 --2- 172.21.15.70:0/898215243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f2850106bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f284c009820 tx=0x7f284c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e145ff99f02135e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.032+0000 7f2843fff640 1 -- 172.21.15.70:0/898215243 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c037070 con 0x7f28501067b0 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.032+0000 7f2843fff640 1 -- 172.21.15.70:0/898215243 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f284c032900 con 0x7f28501067b0 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.032+0000 7f2843fff640 1 -- 172.21.15.70:0/898215243 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c030840 con 0x7f28501067b0 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 -- 172.21.15.70:0/898215243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 msgr2=0x7f2850106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 --2- 172.21.15.70:0/898215243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f2850106bb0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f284c009820 tx=0x7f284c02a270 comp rx=0 tx=0).stop 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 -- 172.21.15.70:0/898215243 shutdown_connections 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 --2- 172.21.15.70:0/898215243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f2850106bb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 -- 172.21.15.70:0/898215243 >> 172.21.15.70:0/898215243 conn(0x7f2850101f80 msgr2=0x7f28501043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 -- 172.21.15.70:0/898215243 shutdown_connections 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 -- 172.21.15.70:0/898215243 wait complete. 2024-09-19T04:21:50.931 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 Processor -- start 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.033+0000 7f2857311640 1 -- start start 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f2857311640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f285019b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f2857311640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f285010ad60 con 0x7f28501067b0 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f28550ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f285019b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f28550ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f285019b900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33880/0 (socket says 172.21.15.70:33880) 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f28550ad640 1 -- 172.21.15.70:0/1093134795 learned_addr learned my addr 172.21.15.70:0/1093134795 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f28550ad640 1 -- 172.21.15.70:0/1093134795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f285019be40 con 0x7f28501067b0 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f28550ad640 1 --2- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f285019b900 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f284c0097f0 tx=0x7f284c030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f28427fc640 1 -- 172.21.15.70:0/1093134795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c037040 con 0x7f28501067b0 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f28427fc640 1 -- 172.21.15.70:0/1093134795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f284c032be0 con 0x7f28501067b0 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f28427fc640 1 -- 172.21.15.70:0/1093134795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f284c03a520 con 0x7f28501067b0 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f285019c0d0 con 0x7f28501067b0 2024-09-19T04:21:50.932 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.034+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f285019edc0 con 0x7f28501067b0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.035+0000 7f28427fc640 1 -- 172.21.15.70:0/1093134795 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 4) ==== 46450+0+0 (secure 0 0 0) 0x7f284c03a710 con 0x7f28501067b0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.035+0000 7f28427fc640 1 --2- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f283c0391b0 0x7f283c03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.035+0000 7f28427fc640 1 -- 172.21.15.70:0/1093134795 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f284c06c4e0 con 0x7f28501067b0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.036+0000 7f28548ac640 1 --2- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f283c0391b0 0x7f283c03b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.036+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f285010aee0 con 0x7f28501067b0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.036+0000 7f28548ac640 1 --2- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f283c0391b0 0x7f283c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28440098c0 tx=0x7f2844006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.040+0000 7f28427fc640 1 -- 172.21.15.70:0/1093134795 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f284c032d90 con 0x7f28501067b0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.257+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7f285002d900 con 0x7f28501067b0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.309+0000 7f28427fc640 1 -- 172.21.15.70:0/1093134795 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7f284c06bf00 con 0x7f28501067b0 2024-09-19T04:21:50.933 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.310+0000 7f28427fc640 1 -- 172.21.15.70:0/1093134795 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f284c044920 con 0x7f28501067b0 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f283c0391b0 msgr2=0x7f283c03b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 --2- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f283c0391b0 0x7f283c03b670 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f28440098c0 tx=0x7f2844006db0 comp rx=0 tx=0).stop 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 msgr2=0x7f285019b900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 --2- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f285019b900 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f284c0097f0 tx=0x7f284c030d70 comp rx=0 tx=0).stop 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 shutdown_connections 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 --2- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f283c0391b0 0x7f283c03b670 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 --2- 172.21.15.70:0/1093134795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28501067b0 0x7f285019b900 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 >> 172.21.15.70:0/1093134795 conn(0x7f2850101f80 msgr2=0x7f2850102eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 shutdown_connections 2024-09-19T04:21:50.934 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:50.312+0000 7f2857311640 1 -- 172.21.15.70:0/1093134795 wait complete. 2024-09-19T04:21:51.178 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:51.021+0000 7f37c143a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:21:51.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:51 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1093134795' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-09-19T04:21:51.590 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:51 smithi070 ceph-mon[30942]: mgrmap e5: x(active, since 9s) 2024-09-19T04:21:51.590 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:51.344+0000 7f37c143a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:21:51.590 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:51.408+0000 7f37c143a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:21:51.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:51.599+0000 7f37c143a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:21:52.270 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:21:52.270 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.382+0000 7f21f65cb640 1 Processor -- start 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.382+0000 7f21f65cb640 1 -- start start 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.383+0000 7f21f65cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f0106590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.383+0000 7f21f65cb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f21f007be50 con 0x7f21f0106190 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.383+0000 7f21effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f0106590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.383+0000 7f21effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f0106590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33910/0 (socket says 172.21.15.70:33910) 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.383+0000 7f21effff640 1 -- 172.21.15.70:0/1152387959 learned_addr learned my addr 172.21.15.70:0/1152387959 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:52.271 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.383+0000 7f21effff640 1 -- 172.21.15.70:0/1152387959 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f0106ad0 con 0x7f21f0106190 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.384+0000 7f21effff640 1 --2- 172.21.15.70:0/1152387959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f0106590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009820 tx=0x7f21e002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa31095069f4b58a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.384+0000 7f21eeffd640 1 -- 172.21.15.70:0/1152387959 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e0037070 con 0x7f21f0106190 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.384+0000 7f21eeffd640 1 -- 172.21.15.70:0/1152387959 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f21e0032900 con 0x7f21f0106190 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.384+0000 7f21eeffd640 1 -- 172.21.15.70:0/1152387959 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e0030840 con 0x7f21f0106190 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.384+0000 7f21f65cb640 1 -- 172.21.15.70:0/1152387959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 msgr2=0x7f21f0106590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.384+0000 7f21f65cb640 1 --2- 172.21.15.70:0/1152387959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f0106590 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7f21e0009820 tx=0x7f21e002a270 comp rx=0 tx=0).stop 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.385+0000 7f21f65cb640 1 -- 172.21.15.70:0/1152387959 shutdown_connections 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.385+0000 7f21f65cb640 1 --2- 172.21.15.70:0/1152387959 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f0106590 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.385+0000 7f21f65cb640 1 -- 172.21.15.70:0/1152387959 >> 172.21.15.70:0/1152387959 conn(0x7f21f0101f80 msgr2=0x7f21f01043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.385+0000 7f21f65cb640 1 -- 172.21.15.70:0/1152387959 shutdown_connections 2024-09-19T04:21:52.272 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.385+0000 7f21f65cb640 1 -- 172.21.15.70:0/1152387959 wait complete. 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.385+0000 7f21f65cb640 1 Processor -- start 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.385+0000 7f21f65cb640 1 -- start start 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21f65cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f019da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21f65cb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f21f0107bd0 con 0x7f21f0106190 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f019da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f019da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33924/0 (socket says 172.21.15.70:33924) 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21effff640 1 -- 172.21.15.70:0/1642040055 learned_addr learned my addr 172.21.15.70:0/1642040055 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21effff640 1 -- 172.21.15.70:0/1642040055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f21f019dfc0 con 0x7f21f0106190 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21effff640 1 --2- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f019da80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f21e00097f0 tx=0x7f21e0030d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21ed7fa640 1 -- 172.21.15.70:0/1642040055 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e0037040 con 0x7f21f0106190 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21ed7fa640 1 -- 172.21.15.70:0/1642040055 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f21e0032be0 con 0x7f21f0106190 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f21f019e250 con 0x7f21f0106190 2024-09-19T04:21:52.273 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21ed7fa640 1 -- 172.21.15.70:0/1642040055 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f21e003a520 con 0x7f21f0106190 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.386+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f21f01a0f40 con 0x7f21f0106190 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.387+0000 7f21ed7fa640 1 -- 172.21.15.70:0/1642040055 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f21e003a760 con 0x7f21f0106190 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.387+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f21f019e730 con 0x7f21f0106190 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.387+0000 7f21ed7fa640 1 --2- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f21d80391b0 0x7f21d803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.387+0000 7f21ed7fa640 1 -- 172.21.15.70:0/1642040055 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f21e006d640 con 0x7f21f0106190 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.387+0000 7f21ef7fe640 1 -- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f21d80391b0 msgr2=0x7f21d803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1492093884 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.387+0000 7f21ef7fe640 1 --2- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f21d80391b0 0x7f21d803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.392+0000 7f21ed7fa640 1 -- 172.21.15.70:0/1642040055 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f21f019e730 con 0x7f21f0106190 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.588+0000 7f21ef7fe640 1 -- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f21d80391b0 msgr2=0x7f21d803b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1492093884 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.588+0000 7f21ef7fe640 1 --2- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f21d80391b0 0x7f21d803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.610+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f21f0196ef0 con 0x7f21f0106190 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.611+0000 7f21ed7fa640 1 -- 172.21.15.70:0/1642040055 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f21e0032d90 con 0x7f21f0106190 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f21d80391b0 msgr2=0x7f21d803b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:21:52.274 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 --2- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f21d80391b0 0x7f21d803b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 msgr2=0x7f21f019da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 --2- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f019da80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f21e00097f0 tx=0x7f21e0030d70 comp rx=0 tx=0).stop 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 shutdown_connections 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 --2- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f21d80391b0 0x7f21d803b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 --2- 172.21.15.70:0/1642040055 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f21f0106190 0x7f21f019da80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 >> 172.21.15.70:0/1642040055 conn(0x7f21f0101f80 msgr2=0x7f21f0191d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 shutdown_connections 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:51.613+0000 7f21f65cb640 1 -- 172.21.15.70:0/1642040055 wait complete. 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-09-19T04:21:52.275 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 5... 2024-09-19T04:21:52.514 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:52 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1642040055' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T04:21:52.515 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:52 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:52.510+0000 7f37c143a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:21:52.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:52 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:52.580+0000 7f37c143a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:21:53.559 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:53.294+0000 7f37c143a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:21:53.559 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:53.413+0000 7f37c143a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:21:53.840 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:53.557+0000 7f37c143a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:21:53.841 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:53.620+0000 7f37c143a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:21:53.841 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:53.771+0000 7f37c143a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:21:53.841 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:53.838+0000 7f37c143a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:21:54.101 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:53.898+0000 7f37c143a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:21:54.101 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:54.056+0000 7f37c143a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:21:54.388 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:54.121+0000 7f37c143a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:21:54.388 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:54.188+0000 7f37c143a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:21:54.388 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:54.270+0000 7f37c143a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:21:54.388 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:54.328+0000 7f37c143a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:21:54.388 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:54.386+0000 7f37c143a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:21:55.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:55.163+0000 7f37c143a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:21:55.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: Active manager daemon x restarted 2024-09-19T04:21:55.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: Activating manager daemon x 2024-09-19T04:21:55.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: osdmap e2: 0 total, 0 up, 0 in 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: mgrmap e6: x(active, starting, since 0.00315012s) 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: Manager daemon x is now available 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:21:55.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:55 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:21:56.455 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-mon[30942]: Found migration_current of "None". Setting to last migration. 2024-09-19T04:21:56.455 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:21:56.455 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:21:56.455 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-mon[30942]: mgrmap e7: x(active, since 1.00538s) 2024-09-19T04:21:56.455 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:56.394+0000 7f372df9f640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:04:21:56] ENGINE Error in HTTPServer.serve 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: Traceback (most recent call last): 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._connections.run(self.expiration_interval) 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._run(expiration_interval) 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: s = self.context.wrap_socket( 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:21:56.456 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: return self.sslsocket_class._create( 2024-09-19T04:21:56.457 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:21:56.457 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self.do_handshake() 2024-09-19T04:21:56.457 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:21:56.457 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._sslobj.do_handshake() 2024-09-19T04:21:56.457 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:21:56.457 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:21:56.699 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:21:56.699 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-09-19T04:21:56.699 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T04:21:56.699 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:21:56.699 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.691+0000 7f1304e1b640 1 Processor -- start 2024-09-19T04:21:56.699 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.691+0000 7f1304e1b640 1 -- start start 2024-09-19T04:21:56.699 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.692+0000 7f1304e1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f1300108180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.692+0000 7f1304e1b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1300108750 con 0x7f1300107d80 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.692+0000 7f12fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f1300108180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.692+0000 7f12fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f1300108180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33928/0 (socket says 172.21.15.70:33928) 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.692+0000 7f12fe59c640 1 -- 172.21.15.70:0/2496867315 learned_addr learned my addr 172.21.15.70:0/2496867315 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.692+0000 7f12fe59c640 1 -- 172.21.15.70:0/2496867315 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1300106990 con 0x7f1300107d80 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.693+0000 7f12fe59c640 1 --2- 172.21.15.70:0/2496867315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f1300108180 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009820 tx=0x7f12f002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e6ad284d49c407b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.693+0000 7f12fdd9b640 1 -- 172.21.15.70:0/2496867315 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12f0037070 con 0x7f1300107d80 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.693+0000 7f12fdd9b640 1 -- 172.21.15.70:0/2496867315 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f12f0032900 con 0x7f1300107d80 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.693+0000 7f12fdd9b640 1 -- 172.21.15.70:0/2496867315 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12f0030840 con 0x7f1300107d80 2024-09-19T04:21:56.700 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.693+0000 7f1304e1b640 1 -- 172.21.15.70:0/2496867315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 msgr2=0x7f1300108180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.693+0000 7f1304e1b640 1 --2- 172.21.15.70:0/2496867315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f1300108180 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f12f0009820 tx=0x7f12f002a270 comp rx=0 tx=0).stop 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.694+0000 7f1304e1b640 1 -- 172.21.15.70:0/2496867315 shutdown_connections 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.694+0000 7f1304e1b640 1 --2- 172.21.15.70:0/2496867315 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f1300108180 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.694+0000 7f1304e1b640 1 -- 172.21.15.70:0/2496867315 >> 172.21.15.70:0/2496867315 conn(0x7f13001016f0 msgr2=0x7f1300103b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.694+0000 7f1304e1b640 1 -- 172.21.15.70:0/2496867315 shutdown_connections 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.694+0000 7f1304e1b640 1 -- 172.21.15.70:0/2496867315 wait complete. 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.694+0000 7f1304e1b640 1 Processor -- start 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.694+0000 7f1304e1b640 1 -- start start 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f1304e1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f130019b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:56.701 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f1304e1b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f130010ad50 con 0x7f1300107d80 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f12fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f130019b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f12fe59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f130019b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33940/0 (socket says 172.21.15.70:33940) 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f12fe59c640 1 -- 172.21.15.70:0/3259046693 learned_addr learned my addr 172.21.15.70:0/3259046693 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f12fe59c640 1 -- 172.21.15.70:0/3259046693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f130019be30 con 0x7f1300107d80 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f12fe59c640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f130019b8f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f12f0030480 tx=0x7f12f0032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12f0037040 con 0x7f1300107d80 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f130019c0c0 con 0x7f1300107d80 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f12f0040070 con 0x7f1300107d80 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f12f003a610 con 0x7f1300107d80 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.695+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f130019edb0 con 0x7f1300107d80 2024-09-19T04:21:56.702 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.696+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 5) ==== 46461+0+0 (secure 0 0 0) 0x7f12f003a8d0 con 0x7f1300107d80 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.696+0000 7f12f77fe640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 0x7f12ec03b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.697+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 --> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f12ec03bd80 con 0x7f12ec0391b0 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.697+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f12f006c390 con 0x7f1300107d80 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.697+0000 7f12f7fff640 1 -- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 msgr2=0x7f12ec03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1492093884 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.697+0000 7f12f7fff640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 0x7f12ec03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.898+0000 7f12f7fff640 1 -- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 msgr2=0x7f12ec03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1492093884 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:52.898+0000 7f12f7fff640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 0x7f12ec03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:53.299+0000 7f12f7fff640 1 -- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 msgr2=0x7f12ec03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1492093884 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:53.299+0000 7f12f7fff640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 0x7f12ec03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T04:21:56.703 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:54.100+0000 7f12f7fff640 1 -- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 msgr2=0x7f12ec03b670 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/1492093884 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:54.100+0000 7f12f7fff640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 0x7f12ec03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:55.167+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mgrmap(e 6) ==== 46228+0+0 (secure 0 0 0) 0x7f12f006b190 con 0x7f1300107d80 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:55.167+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 msgr2=0x7f12ec03b670 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:55.167+0000 7f12f77fe640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 0x7f12ec03b670 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.168+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f12f0045460 con 0x7f1300107d80 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.168+0000 7f12f77fe640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f12ec03cae0 0x7f12ec03eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.168+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f12f003ad90 con 0x7f12ec03cae0 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.168+0000 7f12f7fff640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f12ec03cae0 0x7f12ec03eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.169+0000 7f12f7fff640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f12ec03cae0 0x7f12ec03eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f12e8003980 tx=0x7f12e8006e10 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.170+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mgr.14116 v2:172.21.15.70:6800/3440627608 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f12f003ad90 con 0x7f12ec03cae0 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.176+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f130010aed0 con 0x7f12ec03cae0 2024-09-19T04:21:56.704 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f12f77fe640 1 -- 172.21.15.70:0/3259046693 <== mgr.14116 v2:172.21.15.70:6800/3440627608 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7f130010aed0 con 0x7f12ec03cae0 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f12ec03cae0 msgr2=0x7f12ec03eed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f12ec03cae0 0x7f12ec03eed0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f12e8003980 tx=0x7f12e8006e10 comp rx=0 tx=0).stop 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 msgr2=0x7f130019b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f130019b8f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f12f0030480 tx=0x7f12f0032ce0 comp rx=0 tx=0).stop 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 shutdown_connections 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f12ec03cae0 0x7f12ec03eed0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:6800/1492093884,v1:172.21.15.70:6801/1492093884] conn(0x7f12ec0391b0 0x7f12ec03b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 --2- 172.21.15.70:0/3259046693 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1300107d80 0x7f130019b8f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 >> 172.21.15.70:0/3259046693 conn(0x7f13001016f0 msgr2=0x7f13001022a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 shutdown_connections 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:56.177+0000 7f1304e1b640 1 -- 172.21.15.70:0/3259046693 wait complete. 2024-09-19T04:21:56.705 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 5 is available 2024-09-19T04:21:56.706 INFO:teuthology.orchestra.run.smithi070.stdout:Setting orchestrator backend to cephadm... 2024-09-19T04:21:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:57 smithi070 ceph-mon[30942]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T04:21:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:57 smithi070 ceph-mon[30942]: from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T04:21:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:57 smithi070 ceph-mon[30942]: [19/Sep/2024:04:21:56] ENGINE Bus STARTING 2024-09-19T04:21:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:57 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:21:57.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.050+0000 7f4ba0dac640 1 Processor -- start 2024-09-19T04:21:57.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.050+0000 7f4ba0dac640 1 -- start start 2024-09-19T04:21:57.852 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.050+0000 7f4ba0dac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c10a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.050+0000 7f4ba0dac640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c07be70 con 0x7f4b9c108380 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.051+0000 7f4b9a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c10a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.051+0000 7f4b9a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c10a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42890/0 (socket says 172.21.15.70:42890) 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.051+0000 7f4b9a59c640 1 -- 172.21.15.70:0/826584809 learned_addr learned my addr 172.21.15.70:0/826584809 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.051+0000 7f4b9a59c640 1 -- 172.21.15.70:0/826584809 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c10acb0 con 0x7f4b9c108380 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.051+0000 7f4b9a59c640 1 --2- 172.21.15.70:0/826584809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c10a770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009e80 tx=0x7f4b8c02a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bd0b87278b898d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4b9959a640 1 -- 172.21.15.70:0/826584809 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8c036070 con 0x7f4b9c108380 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4b9959a640 1 -- 172.21.15.70:0/826584809 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f4b8c0318c0 con 0x7f4b9c108380 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4b9959a640 1 -- 172.21.15.70:0/826584809 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8c007a40 con 0x7f4b9c108380 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4ba0dac640 1 -- 172.21.15.70:0/826584809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 msgr2=0x7f4b9c10a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:57.853 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4ba0dac640 1 --2- 172.21.15.70:0/826584809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c10a770 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c009e80 tx=0x7f4b8c02a7a0 comp rx=0 tx=0).stop 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4ba0dac640 1 -- 172.21.15.70:0/826584809 shutdown_connections 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4ba0dac640 1 --2- 172.21.15.70:0/826584809 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c10a770 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4ba0dac640 1 -- 172.21.15.70:0/826584809 >> 172.21.15.70:0/826584809 conn(0x7f4b9c101f80 msgr2=0x7f4b9c1043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4ba0dac640 1 -- 172.21.15.70:0/826584809 shutdown_connections 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.052+0000 7f4ba0dac640 1 -- 172.21.15.70:0/826584809 wait complete. 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.053+0000 7f4ba0dac640 1 Processor -- start 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.053+0000 7f4ba0dac640 1 -- start start 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.053+0000 7f4ba0dac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.053+0000 7f4ba0dac640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b9c10bcf0 con 0x7f4b9c108380 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.053+0000 7f4b9a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.053+0000 7f4b9a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42900/0 (socket says 172.21.15.70:42900) 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.053+0000 7f4b9a59c640 1 -- 172.21.15.70:0/3038161860 learned_addr learned my addr 172.21.15.70:0/3038161860 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:57.854 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.054+0000 7f4b9a59c640 1 -- 172.21.15.70:0/3038161860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b9c19bdf0 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.054+0000 7f4b9a59c640 1 --2- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c19b8b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0317a0 tx=0x7f4b8c0317d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.054+0000 7f4b937fe640 1 -- 172.21.15.70:0/3038161860 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8c036050 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.054+0000 7f4b937fe640 1 -- 172.21.15.70:0/3038161860 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f4b8c042070 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.054+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b9c19c080 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.054+0000 7f4b937fe640 1 -- 172.21.15.70:0/3038161860 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4b8c03b930 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.054+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b9c19ed70 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.055+0000 7f4b937fe640 1 -- 172.21.15.70:0/3038161860 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 7) ==== 46355+0+0 (secure 0 0 0) 0x7f4b8c03bad0 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.055+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b9c1087e0 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.055+0000 7f4b937fe640 1 --2- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f4b880390f0 0x7f4b8803b5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.055+0000 7f4b937fe640 1 -- 172.21.15.70:0/3038161860 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f4b8c06d480 con 0x7f4b9c108380 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.055+0000 7f4b99d9b640 1 --2- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f4b880390f0 0x7f4b8803b5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.056+0000 7f4b99d9b640 1 --2- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f4b880390f0 0x7f4b8803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4b840098c0 tx=0x7f4b84006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:57.855 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.060+0000 7f4b937fe640 1 -- 172.21.15.70:0/3038161860 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b8c047980 con 0x7f4b9c108380 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.220+0000 7f4b937fe640 1 -- 172.21.15.70:0/3038161860 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f4b8c047460 con 0x7f4b9c108380 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.241+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7f4b9c103240 con 0x7f4b880390f0 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.245+0000 7f4b937fe640 1 -- 172.21.15.70:0/3038161860 <== mgr.14116 v2:172.21.15.70:6800/3440627608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f4b9c103240 con 0x7f4b880390f0 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f4b880390f0 msgr2=0x7f4b8803b5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 --2- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f4b880390f0 0x7f4b8803b5b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4b840098c0 tx=0x7f4b84006db0 comp rx=0 tx=0).stop 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 msgr2=0x7f4b9c19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 --2- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c19b8b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f4b8c0317a0 tx=0x7f4b8c0317d0 comp rx=0 tx=0).stop 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 shutdown_connections 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 --2- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f4b880390f0 0x7f4b8803b5b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 --2- 172.21.15.70:0/3038161860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b9c108380 0x7f4b9c19b8b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 >> 172.21.15.70:0/3038161860 conn(0x7f4b9c101f80 msgr2=0x7f4b9c102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 shutdown_connections 2024-09-19T04:21:57.856 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:57.248+0000 7f4ba0dac640 1 -- 172.21.15.70:0/3038161860 wait complete. 2024-09-19T04:21:58.432 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:58 smithi070 ceph-mon[30942]: [19/Sep/2024:04:21:56] ENGINE Serving on https://172.21.15.70:7150 2024-09-19T04:21:58.432 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:58 smithi070 ceph-mon[30942]: [19/Sep/2024:04:21:56] ENGINE Error in HTTPServer.serve 2024-09-19T04:21:58.432 INFO:journalctl@ceph.mon.a.smithi070.stdout: Traceback (most recent call last): 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._run(expiration_interval) 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: s = self.context.wrap_socket( 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: return self.sslsocket_class._create( 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:21:58.433 INFO:journalctl@ceph.mon.a.smithi070.stdout: self.do_handshake() 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._sslobj.do_handshake() 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:58 smithi070 ceph-mon[30942]: [19/Sep/2024:04:21:56] ENGINE Serving on http://172.21.15.70:8765 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:58 smithi070 ceph-mon[30942]: [19/Sep/2024:04:21:56] ENGINE Bus STARTED 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:58 smithi070 ceph-mon[30942]: mgrmap e8: x(active, since 2s) 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:58 smithi070 ceph-mon[30942]: from='client.14128 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:58 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:21:58.434 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:58 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:21:59.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout value unchanged 2024-09-19T04:21:59.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.252+0000 7f50ef9e5640 1 Processor -- start 2024-09-19T04:21:59.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.253+0000 7f50ef9e5640 1 -- start start 2024-09-19T04:21:59.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.253+0000 7f50ef9e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e8105fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:59.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.253+0000 7f50ef9e5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f50e8106590 con 0x7f50e8105bc0 2024-09-19T04:21:59.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.253+0000 7f50ed781640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e8105fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:59.010 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.253+0000 7f50ed781640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e8105fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42916/0 (socket says 172.21.15.70:42916) 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.253+0000 7f50ed781640 1 -- 172.21.15.70:0/4116462223 learned_addr learned my addr 172.21.15.70:0/4116462223 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.253+0000 7f50ed781640 1 -- 172.21.15.70:0/4116462223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e8108ba0 con 0x7f50e8105bc0 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.254+0000 7f50ed781640 1 --2- 172.21.15.70:0/4116462223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e8105fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009e80 tx=0x7f50e002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7834c00bbdc4b50 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.254+0000 7f50dffff640 1 -- 172.21.15.70:0/4116462223 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e0036070 con 0x7f50e8105bc0 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.254+0000 7f50dffff640 1 -- 172.21.15.70:0/4116462223 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f50e00318c0 con 0x7f50e8105bc0 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.254+0000 7f50dffff640 1 -- 172.21.15.70:0/4116462223 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e0007a40 con 0x7f50e8105bc0 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.255+0000 7f50ef9e5640 1 -- 172.21.15.70:0/4116462223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 msgr2=0x7f50e8105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.255+0000 7f50ef9e5640 1 --2- 172.21.15.70:0/4116462223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e8105fc0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f50e0009e80 tx=0x7f50e002a7a0 comp rx=0 tx=0).stop 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.255+0000 7f50ef9e5640 1 -- 172.21.15.70:0/4116462223 shutdown_connections 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.255+0000 7f50ef9e5640 1 --2- 172.21.15.70:0/4116462223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e8105fc0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.255+0000 7f50ef9e5640 1 -- 172.21.15.70:0/4116462223 >> 172.21.15.70:0/4116462223 conn(0x7f50e8101750 msgr2=0x7f50e8103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.255+0000 7f50ef9e5640 1 -- 172.21.15.70:0/4116462223 shutdown_connections 2024-09-19T04:21:59.011 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.255+0000 7f50ef9e5640 1 -- 172.21.15.70:0/4116462223 wait complete. 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.255+0000 7f50ef9e5640 1 Processor -- start 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ef9e5640 1 -- start start 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ef9e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e819b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ef9e5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f50e810bdd0 con 0x7f50e8105bc0 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ed781640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e819b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ed781640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e819b880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42930/0 (socket says 172.21.15.70:42930) 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ed781640 1 -- 172.21.15.70:0/2628332218 learned_addr learned my addr 172.21.15.70:0/2628332218 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ed781640 1 -- 172.21.15.70:0/2628332218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50e819bdc0 con 0x7f50e8105bc0 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ed781640 1 --2- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e819b880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50e002acc0 tx=0x7f50e0031ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50de7fc640 1 -- 172.21.15.70:0/2628332218 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e0036050 con 0x7f50e8105bc0 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50de7fc640 1 -- 172.21.15.70:0/2628332218 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f50e0037040 con 0x7f50e8105bc0 2024-09-19T04:21:59.012 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.256+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50e819c050 con 0x7f50e8105bc0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.257+0000 7f50de7fc640 1 -- 172.21.15.70:0/2628332218 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50e003b830 con 0x7f50e8105bc0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.257+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50e819ed40 con 0x7f50e8105bc0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.257+0000 7f50de7fc640 1 -- 172.21.15.70:0/2628332218 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f50e0044020 con 0x7f50e8105bc0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.257+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50e8106040 con 0x7f50e8105bc0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.258+0000 7f50de7fc640 1 --2- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f50d4039200 0x7f50d403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.258+0000 7f50de7fc640 1 -- 172.21.15.70:0/2628332218 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f50e0042020 con 0x7f50e8105bc0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.258+0000 7f50ecf80640 1 --2- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f50d4039200 0x7f50d403b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.258+0000 7f50ecf80640 1 --2- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f50d4039200 0x7f50d403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50d80098c0 tx=0x7f50d8006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.262+0000 7f50de7fc640 1 -- 172.21.15.70:0/2628332218 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f50e004b020 con 0x7f50e8105bc0 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.430+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7f50e8102990 con 0x7f50d4039200 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.431+0000 7f50de7fc640 1 -- 172.21.15.70:0/2628332218 <== mgr.14116 v2:172.21.15.70:6800/3440627608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7f50e8102990 con 0x7f50d4039200 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f50d4039200 msgr2=0x7f50d403b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:59.013 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 --2- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f50d4039200 0x7f50d403b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f50d80098c0 tx=0x7f50d8006db0 comp rx=0 tx=0).stop 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 msgr2=0x7f50e819b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 --2- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e819b880 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f50e002acc0 tx=0x7f50e0031ca0 comp rx=0 tx=0).stop 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 shutdown_connections 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 --2- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f50d4039200 0x7f50d403b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 --2- 172.21.15.70:0/2628332218 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f50e8105bc0 0x7f50e819b880 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 >> 172.21.15.70:0/2628332218 conn(0x7f50e8101750 msgr2=0x7f50e8102280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 shutdown_connections 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:58.433+0000 7f50ef9e5640 1 -- 172.21.15.70:0/2628332218 wait complete. 2024-09-19T04:21:59.014 INFO:teuthology.orchestra.run.smithi070.stdout:Generating ssh key... 2024-09-19T04:21:59.584 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-mon[30942]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:21:59.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: Generating public/private rsa key pair. 2024-09-19T04:21:59.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: Your identification has been saved in /tmp/tmpxsp0pn_p/key 2024-09-19T04:21:59.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: Your public key has been saved in /tmp/tmpxsp0pn_p/key.pub 2024-09-19T04:21:59.895 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: The key fingerprint is: 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: SHA256:HweCx4BqkCyjqG2vzHpchqbpciqBEN89wqh8/DsH/1k ceph-7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: The key's randomart image is: 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: +---[RSA 3072]----+ 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: |.. .. | 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: |*. . + | 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: |+= = .. + . | 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: |+ = + o. . . | 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: |=+.. . .S . . | 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: |=.=oo. . o | 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: | B.+. o .E | 2024-09-19T04:21:59.896 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: |=o+ .o o o | 2024-09-19T04:21:59.897 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: |**+. .+ .o | 2024-09-19T04:21:59.897 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:21:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: +----[SHA256]-----+ 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.402+0000 7fc52f150640 1 Processor -- start 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.402+0000 7fc52f150640 1 -- start start 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.402+0000 7fc52f150640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc528106590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.402+0000 7fc52f150640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc52807be50 con 0x7fc528106190 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.403+0000 7fc52ceec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc528106590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.403+0000 7fc52ceec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc528106590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42942/0 (socket says 172.21.15.70:42942) 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.403+0000 7fc52ceec640 1 -- 172.21.15.70:0/4098391968 learned_addr learned my addr 172.21.15.70:0/4098391968 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.403+0000 7fc52ceec640 1 -- 172.21.15.70:0/4098391968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc528106ad0 con 0x7fc528106190 2024-09-19T04:22:00.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.403+0000 7fc52ceec640 1 --2- 172.21.15.70:0/4098391968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc528106590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc518009820 tx=0x7fc51802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4682e9875f847d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc5277fe640 1 -- 172.21.15.70:0/4098391968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc518037070 con 0x7fc528106190 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc5277fe640 1 -- 172.21.15.70:0/4098391968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fc518032900 con 0x7fc528106190 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc5277fe640 1 -- 172.21.15.70:0/4098391968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc518030840 con 0x7fc528106190 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc52f150640 1 -- 172.21.15.70:0/4098391968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 msgr2=0x7fc528106590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc52f150640 1 --2- 172.21.15.70:0/4098391968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc528106590 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fc518009820 tx=0x7fc51802a270 comp rx=0 tx=0).stop 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc52f150640 1 -- 172.21.15.70:0/4098391968 shutdown_connections 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc52f150640 1 --2- 172.21.15.70:0/4098391968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc528106590 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc52f150640 1 -- 172.21.15.70:0/4098391968 >> 172.21.15.70:0/4098391968 conn(0x7fc528101f80 msgr2=0x7fc5281043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:00.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc52f150640 1 -- 172.21.15.70:0/4098391968 shutdown_connections 2024-09-19T04:22:00.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.404+0000 7fc52f150640 1 -- 172.21.15.70:0/4098391968 wait complete. 2024-09-19T04:22:00.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52f150640 1 Processor -- start 2024-09-19T04:22:00.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52f150640 1 -- start start 2024-09-19T04:22:00.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52f150640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc52819da80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:00.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52f150640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc528107bd0 con 0x7fc528106190 2024-09-19T04:22:00.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52ceec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc52819da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52ceec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc52819da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42952/0 (socket says 172.21.15.70:42952) 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52ceec640 1 -- 172.21.15.70:0/896217375 learned_addr learned my addr 172.21.15.70:0/896217375 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52ceec640 1 -- 172.21.15.70:0/896217375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc52819dfc0 con 0x7fc528106190 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.405+0000 7fc52ceec640 1 --2- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc52819da80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc518030480 tx=0x7fc518032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.406+0000 7fc525ffb640 1 -- 172.21.15.70:0/896217375 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc518037040 con 0x7fc528106190 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.406+0000 7fc525ffb640 1 -- 172.21.15.70:0/896217375 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fc518040070 con 0x7fc528106190 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.406+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc52819e250 con 0x7fc528106190 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.406+0000 7fc525ffb640 1 -- 172.21.15.70:0/896217375 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc51803a610 con 0x7fc528106190 2024-09-19T04:22:00.310 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.406+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5281a0f40 con 0x7fc528106190 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.407+0000 7fc525ffb640 1 -- 172.21.15.70:0/896217375 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fc51803a880 con 0x7fc528106190 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.407+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc528106590 con 0x7fc528106190 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.407+0000 7fc525ffb640 1 --2- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fc510039200 0x7fc51003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.407+0000 7fc525ffb640 1 -- 172.21.15.70:0/896217375 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fc51806c7e0 con 0x7fc528106190 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.407+0000 7fc527fff640 1 --2- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fc510039200 0x7fc51003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.407+0000 7fc527fff640 1 --2- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fc510039200 0x7fc51003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0098c0 tx=0x7fc51c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.412+0000 7fc525ffb640 1 -- 172.21.15.70:0/896217375 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc51803bb00 con 0x7fc528106190 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.582+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7fc528074b80 con 0x7fc510039200 2024-09-19T04:22:00.311 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.696+0000 7fc525ffb640 1 -- 172.21.15.70:0/896217375 <== mgr.14116 v2:172.21.15.70:6800/3440627608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fc528074b80 con 0x7fc510039200 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fc510039200 msgr2=0x7fc51003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 --2- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fc510039200 0x7fc51003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7fc51c0098c0 tx=0x7fc51c006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 msgr2=0x7fc52819da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 --2- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc52819da80 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fc518030480 tx=0x7fc518032ce0 comp rx=0 tx=0).stop 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 shutdown_connections 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 --2- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fc510039200 0x7fc51003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 --2- 172.21.15.70:0/896217375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc528106190 0x7fc52819da80 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 >> 172.21.15.70:0/896217375 conn(0x7fc528101f80 msgr2=0x7fc528191d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 shutdown_connections 2024-09-19T04:22:00.312 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:21:59.698+0000 7fc52f150640 1 -- 172.21.15.70:0/896217375 wait complete. 2024-09-19T04:22:00.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:00 smithi070 ceph-mon[30942]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:00.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:00 smithi070 ceph-mon[30942]: Generating ssh key... 2024-09-19T04:22:00.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:00 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:22:00.937 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:00 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUhpp3fBbrzTFdMg+mIYxInYNel20HXBqoQ6SRBH9YmQIh4rwgSwIN193TyTbGOnyqMGAxYJVTsMexItSF/WFHeZeH7WxOrE3vrWt/UryMyVBFzWV+SZy5t3FznoTY15AlPmbPOqcEQn1/b/iNxItOsBbjWhpGo19JtdRqIVbFeIrXA09PhJlcsU/P8Oy0UtkGV6d2MXtcCoaDTiI3poS0J1XMs2W2FTaL0nT8aUTWwfPYDYNUxdlJydoa71LE+GVhEcug6iHzJTw2dtMEpE2oTX60w0As7aQSzF7wtrtNVz9thXtrsUKgrWElPvVCnTVtLq02ThfyWIKW2rUZeDB9e+SfRkG08/7mSu3bZfgOjYlzzRCkfSLygdqmKsfTEMlOhQnDSanGe/wqhiV7Zj+qY7tM6PPD3ucG4f5ytckYVTcXoWHdhvVQcEQicJsKdZOESHP61ZWeThewpHPhb8T5YC8V2iW5iUv7m6Ka1I2sQ5aoXBZQvK5l8jsWCkZOhC0= ceph-7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.758+0000 7f1b53b0f640 1 Processor -- start 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.759+0000 7f1b53b0f640 1 -- start start 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.759+0000 7f1b53b0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c107ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.759+0000 7f1b53b0f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c108270 con 0x7f1b4c1078a0 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.759+0000 7f1b518ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c107ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.759+0000 7f1b518ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c107ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42966/0 (socket says 172.21.15.70:42966) 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.759+0000 7f1b518ab640 1 -- 172.21.15.70:0/562798006 learned_addr learned my addr 172.21.15.70:0/562798006 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.759+0000 7f1b518ab640 1 -- 172.21.15.70:0/562798006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c108a50 con 0x7f1b4c1078a0 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.760+0000 7f1b518ab640 1 --2- 172.21.15.70:0/562798006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c107ca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009820 tx=0x7f1b4802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3723de6d4b5df08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:01.530 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.760+0000 7f1b508a9640 1 -- 172.21.15.70:0/562798006 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b48037070 con 0x7f1b4c1078a0 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.760+0000 7f1b508a9640 1 -- 172.21.15.70:0/562798006 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f1b48032900 con 0x7f1b4c1078a0 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.760+0000 7f1b508a9640 1 -- 172.21.15.70:0/562798006 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b48030840 con 0x7f1b4c1078a0 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.760+0000 7f1b53b0f640 1 -- 172.21.15.70:0/562798006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 msgr2=0x7f1b4c107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.760+0000 7f1b53b0f640 1 --2- 172.21.15.70:0/562798006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c107ca0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f1b48009820 tx=0x7f1b4802a270 comp rx=0 tx=0).stop 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 -- 172.21.15.70:0/562798006 shutdown_connections 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 --2- 172.21.15.70:0/562798006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c107ca0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 -- 172.21.15.70:0/562798006 >> 172.21.15.70:0/562798006 conn(0x7f1b4c103070 msgr2=0x7f1b4c105490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 -- 172.21.15.70:0/562798006 shutdown_connections 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 -- 172.21.15.70:0/562798006 wait complete. 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 Processor -- start 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 -- start start 2024-09-19T04:22:01.531 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c19b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.761+0000 7f1b53b0f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b4c10be00 con 0x7f1b4c1078a0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b518ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c19b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b518ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c19b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42970/0 (socket says 172.21.15.70:42970) 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b518ab640 1 -- 172.21.15.70:0/459263552 learned_addr learned my addr 172.21.15.70:0/459263552 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b518ab640 1 -- 172.21.15.70:0/459263552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b4c19bd80 con 0x7f1b4c1078a0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b518ab640 1 --2- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c19b840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b48030590 tx=0x7f1b48032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b3effd640 1 -- 172.21.15.70:0/459263552 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b48037040 con 0x7f1b4c1078a0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b3effd640 1 -- 172.21.15.70:0/459263552 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f1b48032be0 con 0x7f1b4c1078a0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b4c19c010 con 0x7f1b4c1078a0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b3effd640 1 -- 172.21.15.70:0/459263552 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b4803a520 con 0x7f1b4c1078a0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.762+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b4c19ed00 con 0x7f1b4c1078a0 2024-09-19T04:22:01.532 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.763+0000 7f1b3effd640 1 -- 172.21.15.70:0/459263552 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f1b4803a7e0 con 0x7f1b4c1078a0 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.763+0000 7f1b3effd640 1 --2- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f1b380391b0 0x7f1b3803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.763+0000 7f1b3effd640 1 -- 172.21.15.70:0/459263552 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1b4806c640 con 0x7f1b4c1078a0 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.763+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b4c10bf80 con 0x7f1b4c1078a0 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.763+0000 7f1b510aa640 1 --2- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f1b380391b0 0x7f1b3803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.764+0000 7f1b510aa640 1 --2- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f1b380391b0 0x7f1b3803b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b400098c0 tx=0x7f1b40006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.768+0000 7f1b3effd640 1 -- 172.21.15.70:0/459263552 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1b48032d90 con 0x7f1b4c1078a0 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.935+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f1b4c104310 con 0x7f1b380391b0 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.936+0000 7f1b3effd640 1 -- 172.21.15.70:0/459263552 <== mgr.14116 v2:172.21.15.70:6800/3440627608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f1b4c104310 con 0x7f1b380391b0 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f1b380391b0 msgr2=0x7f1b3803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 --2- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f1b380391b0 0x7f1b3803b670 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f1b400098c0 tx=0x7f1b40006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 msgr2=0x7f1b4c19b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:01.533 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 --2- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c19b840 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f1b48030590 tx=0x7f1b48032670 comp rx=0 tx=0).stop 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 shutdown_connections 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 --2- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f1b380391b0 0x7f1b3803b670 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 --2- 172.21.15.70:0/459263552 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b4c1078a0 0x7f1b4c19b840 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 >> 172.21.15.70:0/459263552 conn(0x7f1b4c103070 msgr2=0x7f1b4c103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 shutdown_connections 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:00.938+0000 7f1b53b0f640 1 -- 172.21.15.70:0/459263552 wait complete. 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:Adding key to root@localhost authorized_keys... 2024-09-19T04:22:01.534 INFO:teuthology.orchestra.run.smithi070.stdout:Adding host smithi070... 2024-09-19T04:22:01.747 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:01 smithi070 ceph-mon[30942]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:02 smithi070 ceph-mon[30942]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:03.851 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:03 smithi070 ceph-mon[30942]: Deploying cephadm binary to smithi070 2024-09-19T04:22:05.812 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Added host 'smithi070' with addr '172.21.15.70' 2024-09-19T04:22:05.812 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.946+0000 7f45e1c88640 1 Processor -- start 2024-09-19T04:22:05.812 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.946+0000 7f45e1c88640 1 -- start start 2024-09-19T04:22:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.946+0000 7f45e1c88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc07c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.946+0000 7f45e1c88640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45dc07c880 con 0x7f45dc07ddd0 2024-09-19T04:22:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.946+0000 7f45db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc07c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.946+0000 7f45db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc07c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42976/0 (socket says 172.21.15.70:42976) 2024-09-19T04:22:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.946+0000 7f45db7fe640 1 -- 172.21.15.70:0/3941589346 learned_addr learned my addr 172.21.15.70:0/3941589346 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.947+0000 7f45db7fe640 1 -- 172.21.15.70:0/3941589346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45dc07ca00 con 0x7f45dc07ddd0 2024-09-19T04:22:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.947+0000 7f45db7fe640 1 --2- 172.21.15.70:0/3941589346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc07c340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009820 tx=0x7f45cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f284859deacc2b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:05.813 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.947+0000 7f45da7fc640 1 -- 172.21.15.70:0/3941589346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45cc037070 con 0x7f45dc07ddd0 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.947+0000 7f45da7fc640 1 -- 172.21.15.70:0/3941589346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f45cc032900 con 0x7f45dc07ddd0 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.947+0000 7f45da7fc640 1 -- 172.21.15.70:0/3941589346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45cc030840 con 0x7f45dc07ddd0 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.948+0000 7f45e1c88640 1 -- 172.21.15.70:0/3941589346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 msgr2=0x7f45dc07c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.948+0000 7f45e1c88640 1 --2- 172.21.15.70:0/3941589346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc07c340 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f45cc009820 tx=0x7f45cc02a270 comp rx=0 tx=0).stop 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.948+0000 7f45e1c88640 1 -- 172.21.15.70:0/3941589346 shutdown_connections 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.948+0000 7f45e1c88640 1 --2- 172.21.15.70:0/3941589346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc07c340 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.948+0000 7f45e1c88640 1 -- 172.21.15.70:0/3941589346 >> 172.21.15.70:0/3941589346 conn(0x7f45dc1031b0 msgr2=0x7f45dc1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.948+0000 7f45e1c88640 1 -- 172.21.15.70:0/3941589346 shutdown_connections 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.948+0000 7f45e1c88640 1 -- 172.21.15.70:0/3941589346 wait complete. 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.948+0000 7f45e1c88640 1 Processor -- start 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45e1c88640 1 -- start start 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45e1c88640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc19d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:05.814 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45e1c88640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45dc10ddd0 con 0x7f45dc07ddd0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc19d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc19d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42982/0 (socket says 172.21.15.70:42982) 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45db7fe640 1 -- 172.21.15.70:0/501715876 learned_addr learned my addr 172.21.15.70:0/501715876 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45db7fe640 1 -- 172.21.15.70:0/501715876 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45dc19df20 con 0x7f45dc07ddd0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45db7fe640 1 --2- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc19d9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45cc030590 tx=0x7f45cc032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45d8ff9640 1 -- 172.21.15.70:0/501715876 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45cc037040 con 0x7f45dc07ddd0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45dc19e1b0 con 0x7f45dc07ddd0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.949+0000 7f45d8ff9640 1 -- 172.21.15.70:0/501715876 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f45cc032be0 con 0x7f45dc07ddd0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.950+0000 7f45d8ff9640 1 -- 172.21.15.70:0/501715876 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45cc03a520 con 0x7f45dc07ddd0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.950+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45dc1a0ea0 con 0x7f45dc07ddd0 2024-09-19T04:22:05.815 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.951+0000 7f45d8ff9640 1 -- 172.21.15.70:0/501715876 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f45cc03a820 con 0x7f45dc07ddd0 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.951+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45dc07c3c0 con 0x7f45dc07ddd0 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.951+0000 7f45d8ff9640 1 --2- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f45c40391b0 0x7f45c403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.951+0000 7f45d8ff9640 1 -- 172.21.15.70:0/501715876 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f45cc06c700 con 0x7f45dc07ddd0 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.951+0000 7f45daffd640 1 --2- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f45c40391b0 0x7f45c403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.951+0000 7f45daffd640 1 --2- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f45c40391b0 0x7f45c403b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f45d00098c0 tx=0x7f45d0006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:01.955+0000 7f45d8ff9640 1 -- 172.21.15.70:0/501715876 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45cc03b3f0 con 0x7f45dc07ddd0 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:02.124+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi070", "addr": "172.21.15.70", "target": ["mon-mgr", ""]}) -- 0x7f45dc104470 con 0x7f45c40391b0 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.274+0000 7f45d8ff9640 1 -- 172.21.15.70:0/501715876 <== mgr.14116 v2:172.21.15.70:6800/3440627608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+48 (secure 0 0 0) 0x7f45dc104470 con 0x7f45c40391b0 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f45c40391b0 msgr2=0x7f45c403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 --2- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f45c40391b0 0x7f45c403b670 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f45d00098c0 tx=0x7f45d0006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 msgr2=0x7f45dc19d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:05.816 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 --2- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc19d9e0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f45cc030590 tx=0x7f45cc032670 comp rx=0 tx=0).stop 2024-09-19T04:22:05.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 shutdown_connections 2024-09-19T04:22:05.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 --2- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f45c40391b0 0x7f45c403b670 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:05.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 --2- 172.21.15.70:0/501715876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45dc07ddd0 0x7f45dc19d9e0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:05.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 >> 172.21.15.70:0/501715876 conn(0x7f45dc1031b0 msgr2=0x7f45dc103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:05.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 shutdown_connections 2024-09-19T04:22:05.817 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:05.277+0000 7f45e1c88640 1 -- 172.21.15.70:0/501715876 wait complete. 2024-09-19T04:22:05.817 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mon service... 2024-09-19T04:22:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:06 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:22:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:06 smithi070 ceph-mon[30942]: Added host smithi070 2024-09-19T04:22:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:06 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:07.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-09-19T04:22:07.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.209+0000 7f65e1efe640 1 Processor -- start 2024-09-19T04:22:07.004 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.209+0000 7f65e1efe640 1 -- start start 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.209+0000 7f65e1efe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc10a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.209+0000 7f65e1efe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc07be70 con 0x7f65dc108380 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.210+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc10a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.210+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc10a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49424/0 (socket says 172.21.15.70:49424) 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.210+0000 7f65db7fe640 1 -- 172.21.15.70:0/3695868099 learned_addr learned my addr 172.21.15.70:0/3695868099 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.210+0000 7f65db7fe640 1 -- 172.21.15.70:0/3695868099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc10acb0 con 0x7f65dc108380 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.211+0000 7f65db7fe640 1 --2- 172.21.15.70:0/3695868099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc10a770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009820 tx=0x7f65cc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2940ae5485e84f8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.211+0000 7f65daffd640 1 -- 172.21.15.70:0/3695868099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65cc037070 con 0x7f65dc108380 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.211+0000 7f65daffd640 1 -- 172.21.15.70:0/3695868099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f65cc032900 con 0x7f65dc108380 2024-09-19T04:22:07.005 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.211+0000 7f65daffd640 1 -- 172.21.15.70:0/3695868099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65cc030840 con 0x7f65dc108380 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 -- 172.21.15.70:0/3695868099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 msgr2=0x7f65dc10a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 --2- 172.21.15.70:0/3695868099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc10a770 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f65cc009820 tx=0x7f65cc02a270 comp rx=0 tx=0).stop 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 -- 172.21.15.70:0/3695868099 shutdown_connections 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 --2- 172.21.15.70:0/3695868099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc10a770 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 -- 172.21.15.70:0/3695868099 >> 172.21.15.70:0/3695868099 conn(0x7f65dc101f80 msgr2=0x7f65dc1043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 -- 172.21.15.70:0/3695868099 shutdown_connections 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 -- 172.21.15.70:0/3695868099 wait complete. 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 Processor -- start 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.212+0000 7f65e1efe640 1 -- start start 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65e1efe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc19b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65e1efe640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65dc10bcf0 con 0x7f65dc108380 2024-09-19T04:22:07.006 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc19b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc19b8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49438/0 (socket says 172.21.15.70:49438) 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65db7fe640 1 -- 172.21.15.70:0/3008968471 learned_addr learned my addr 172.21.15.70:0/3008968471 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65db7fe640 1 -- 172.21.15.70:0/3008968471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65dc19bdf0 con 0x7f65dc108380 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65db7fe640 1 --2- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc19b8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65cc030480 tx=0x7f65cc032ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65d97fa640 1 -- 172.21.15.70:0/3008968471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65cc037040 con 0x7f65dc108380 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65dc19c080 con 0x7f65dc108380 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65d97fa640 1 -- 172.21.15.70:0/3008968471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f65cc040070 con 0x7f65dc108380 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65d97fa640 1 -- 172.21.15.70:0/3008968471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f65cc03a610 con 0x7f65dc108380 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.213+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65dc19ed70 con 0x7f65dc108380 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.214+0000 7f65d97fa640 1 -- 172.21.15.70:0/3008968471 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f65cc03a8d0 con 0x7f65dc108380 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.214+0000 7f65d97fa640 1 --2- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f65c80391b0 0x7f65c803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.214+0000 7f65d97fa640 1 -- 172.21.15.70:0/3008968471 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f65cc03bb00 con 0x7f65dc108380 2024-09-19T04:22:07.007 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.214+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65dc1087e0 con 0x7f65dc108380 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.215+0000 7f65d2ffd640 1 --2- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f65c80391b0 0x7f65c803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.215+0000 7f65d2ffd640 1 --2- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f65c80391b0 0x7f65c803b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098c0 tx=0x7f65c4006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.219+0000 7f65d97fa640 1 -- 172.21.15.70:0/3008968471 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f65cc041270 con 0x7f65dc108380 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.410+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f65dc103240 con 0x7f65c80391b0 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.414+0000 7f65d97fa640 1 -- 172.21.15.70:0/3008968471 <== mgr.14116 v2:172.21.15.70:6800/3440627608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f65dc103240 con 0x7f65c80391b0 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f65c80391b0 msgr2=0x7f65c803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 --2- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f65c80391b0 0x7f65c803b670 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f65c40098c0 tx=0x7f65c4006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 msgr2=0x7f65dc19b8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 --2- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc19b8b0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f65cc030480 tx=0x7f65cc032ce0 comp rx=0 tx=0).stop 2024-09-19T04:22:07.008 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 shutdown_connections 2024-09-19T04:22:07.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 --2- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f65c80391b0 0x7f65c803b670 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:07.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 --2- 172.21.15.70:0/3008968471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65dc108380 0x7f65dc19b8b0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:07.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 >> 172.21.15.70:0/3008968471 conn(0x7f65dc101f80 msgr2=0x7f65dc102b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:07.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 shutdown_connections 2024-09-19T04:22:07.009 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:06.416+0000 7f65e1efe640 1 -- 172.21.15.70:0/3008968471 wait complete. 2024-09-19T04:22:07.009 INFO:teuthology.orchestra.run.smithi070.stdout:Deploying unmanaged mgr service... 2024-09-19T04:22:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:07 smithi070 ceph-mon[30942]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:07 smithi070 ceph-mon[30942]: Saving service mon spec with placement count:5 2024-09-19T04:22:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:07 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.390+0000 7fe963498640 1 Processor -- start 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.391+0000 7fe963498640 1 -- start start 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.391+0000 7fe963498640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.391+0000 7fe963498640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c07e190 con 0x7fe95c07dd90 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.391+0000 7fe961234640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.391+0000 7fe961234640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c07c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49442/0 (socket says 172.21.15.70:49442) 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.391+0000 7fe961234640 1 -- 172.21.15.70:0/620891983 learned_addr learned my addr 172.21.15.70:0/620891983 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:08.151 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.391+0000 7fe961234640 1 -- 172.21.15.70:0/620891983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c07c840 con 0x7fe95c07dd90 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.392+0000 7fe961234640 1 --2- 172.21.15.70:0/620891983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c07c300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe958009820 tx=0x7fe95802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf6f2d563a59300f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.392+0000 7fe953fff640 1 -- 172.21.15.70:0/620891983 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe958037070 con 0x7fe95c07dd90 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.392+0000 7fe953fff640 1 -- 172.21.15.70:0/620891983 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fe958032900 con 0x7fe95c07dd90 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.392+0000 7fe953fff640 1 -- 172.21.15.70:0/620891983 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe958030840 con 0x7fe95c07dd90 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.393+0000 7fe963498640 1 -- 172.21.15.70:0/620891983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 msgr2=0x7fe95c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.393+0000 7fe963498640 1 --2- 172.21.15.70:0/620891983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c07c300 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fe958009820 tx=0x7fe95802a270 comp rx=0 tx=0).stop 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.393+0000 7fe963498640 1 -- 172.21.15.70:0/620891983 shutdown_connections 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.393+0000 7fe963498640 1 --2- 172.21.15.70:0/620891983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c07c300 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.393+0000 7fe963498640 1 -- 172.21.15.70:0/620891983 >> 172.21.15.70:0/620891983 conn(0x7fe95c1031b0 msgr2=0x7fe95c1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.393+0000 7fe963498640 1 -- 172.21.15.70:0/620891983 shutdown_connections 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.393+0000 7fe963498640 1 -- 172.21.15.70:0/620891983 wait complete. 2024-09-19T04:22:08.152 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.393+0000 7fe963498640 1 Processor -- start 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe963498640 1 -- start start 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe963498640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c19da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe963498640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe95c10ddb0 con 0x7fe95c07dd90 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe961234640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c19da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe961234640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c19da20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49448/0 (socket says 172.21.15.70:49448) 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe961234640 1 -- 172.21.15.70:0/3427839455 learned_addr learned my addr 172.21.15.70:0/3427839455 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe961234640 1 -- 172.21.15.70:0/3427839455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe95c19df60 con 0x7fe95c07dd90 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe961234640 1 --2- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c19da20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe958030590 tx=0x7fe958032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe9527fc640 1 -- 172.21.15.70:0/3427839455 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe958037040 con 0x7fe95c07dd90 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe9527fc640 1 -- 172.21.15.70:0/3427839455 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7fe958032be0 con 0x7fe95c07dd90 2024-09-19T04:22:08.153 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe95c19e1f0 con 0x7fe95c07dd90 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe9527fc640 1 -- 172.21.15.70:0/3427839455 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe95803a520 con 0x7fe95c07dd90 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.394+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe95c1a0ee0 con 0x7fe95c07dd90 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.395+0000 7fe9527fc640 1 -- 172.21.15.70:0/3427839455 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fe95803b3f0 con 0x7fe95c07dd90 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.395+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe95c07c380 con 0x7fe95c07dd90 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.395+0000 7fe9527fc640 1 --2- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fe9480391b0 0x7fe94803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.395+0000 7fe9527fc640 1 -- 172.21.15.70:0/3427839455 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe95806c640 con 0x7fe95c07dd90 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.396+0000 7fe960a33640 1 --2- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fe9480391b0 0x7fe94803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.396+0000 7fe960a33640 1 --2- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fe9480391b0 0x7fe94803b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0098c0 tx=0x7fe94c006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.400+0000 7fe9527fc640 1 -- 172.21.15.70:0/3427839455 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe958042e10 con 0x7fe95c07dd90 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.576+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe95c104470 con 0x7fe9480391b0 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.580+0000 7fe9527fc640 1 -- 172.21.15.70:0/3427839455 <== mgr.14116 v2:172.21.15.70:6800/3440627608 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe95c104470 con 0x7fe9480391b0 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.582+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fe9480391b0 msgr2=0x7fe94803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:08.154 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.582+0000 7fe963498640 1 --2- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fe9480391b0 0x7fe94803b670 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe94c0098c0 tx=0x7fe94c006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.582+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 msgr2=0x7fe95c19da20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.582+0000 7fe963498640 1 --2- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c19da20 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe958030590 tx=0x7fe958032670 comp rx=0 tx=0).stop 2024-09-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.582+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 shutdown_connections 2024-09-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.582+0000 7fe963498640 1 --2- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fe9480391b0 0x7fe94803b670 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.582+0000 7fe963498640 1 --2- 172.21.15.70:0/3427839455 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe95c07dd90 0x7fe95c19da20 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.582+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 >> 172.21.15.70:0/3427839455 conn(0x7fe95c1031b0 msgr2=0x7fe95c103d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.583+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 shutdown_connections 2024-09-19T04:22:08.155 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:07.583+0000 7fe963498640 1 -- 172.21.15.70:0/3427839455 wait complete. 2024-09-19T04:22:08.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:08 smithi070 ceph-mon[30942]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:08.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:08 smithi070 ceph-mon[30942]: Saving service mgr spec with placement count:2 2024-09-19T04:22:08.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:08 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:22:09.552 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.705+0000 7f7b1ebaf640 1 Processor -- start 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.705+0000 7f7b1ebaf640 1 -- start start 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.705+0000 7f7b1ebaf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1810a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.705+0000 7f7b1ebaf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1807bed0 con 0x7f7b18108380 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.706+0000 7f7b1c94b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1810a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.706+0000 7f7b1c94b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1810a770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49462/0 (socket says 172.21.15.70:49462) 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.706+0000 7f7b1c94b640 1 -- 172.21.15.70:0/1818994851 learned_addr learned my addr 172.21.15.70:0/1818994851 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.706+0000 7f7b1c94b640 1 -- 172.21.15.70:0/1818994851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1810acb0 con 0x7f7b18108380 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b1c94b640 1 --2- 172.21.15.70:0/1818994851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1810a770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009820 tx=0x7f7b0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=826a88f836e4d101 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b177fe640 1 -- 172.21.15.70:0/1818994851 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c037070 con 0x7f7b18108380 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b177fe640 1 -- 172.21.15.70:0/1818994851 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f7b0c032900 con 0x7f7b18108380 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b177fe640 1 -- 172.21.15.70:0/1818994851 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c030840 con 0x7f7b18108380 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/1818994851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 msgr2=0x7f7b1810a770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:09.553 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b1ebaf640 1 --2- 172.21.15.70:0/1818994851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1810a770 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c009820 tx=0x7f7b0c02a270 comp rx=0 tx=0).stop 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/1818994851 shutdown_connections 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b1ebaf640 1 --2- 172.21.15.70:0/1818994851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1810a770 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/1818994851 >> 172.21.15.70:0/1818994851 conn(0x7f7b18102000 msgr2=0x7f7b18104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.707+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/1818994851 shutdown_connections 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.708+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/1818994851 wait complete. 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.708+0000 7f7b1ebaf640 1 Processor -- start 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.708+0000 7f7b1ebaf640 1 -- start start 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.708+0000 7f7b1ebaf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1819b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.708+0000 7f7b1ebaf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1810bce0 con 0x7f7b18108380 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.708+0000 7f7b1c94b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1819b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.708+0000 7f7b1c94b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1819b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49474/0 (socket says 172.21.15.70:49474) 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.708+0000 7f7b1c94b640 1 -- 172.21.15.70:0/2224639874 learned_addr learned my addr 172.21.15.70:0/2224639874 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:09.554 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.709+0000 7f7b1c94b640 1 -- 172.21.15.70:0/2224639874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1819bd80 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.709+0000 7f7b1c94b640 1 --2- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1819b840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c030590 tx=0x7f7b0c032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.709+0000 7f7b15ffb640 1 -- 172.21.15.70:0/2224639874 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c037040 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.709+0000 7f7b15ffb640 1 -- 172.21.15.70:0/2224639874 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1105+0+0 (secure 0 0 0) 0x7f7b0c032be0 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.709+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1819c010 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.709+0000 7f7b15ffb640 1 -- 172.21.15.70:0/2224639874 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7b0c03a520 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.709+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1819ed00 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.710+0000 7f7b15ffb640 1 -- 172.21.15.70:0/2224639874 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7f7b0c03b3f0 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.710+0000 7f7b15ffb640 1 --2- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f7b080391b0 0x7f7b0803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.710+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b181087e0 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.710+0000 7f7b15ffb640 1 -- 172.21.15.70:0/2224639874 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7b0c06c640 con 0x7f7b18108380 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.710+0000 7f7b17fff640 1 --2- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f7b080391b0 0x7f7b0803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:09.555 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.711+0000 7f7b17fff640 1 --2- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f7b080391b0 0x7f7b0803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7b040098c0 tx=0x7f7b04006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.715+0000 7f7b15ffb640 1 -- 172.21.15.70:0/2224639874 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b0c043e10 con 0x7f7b18108380 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.887+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7f7b1819f350 con 0x7f7b18108380 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.889+0000 7f7b15ffb640 1 -- 172.21.15.70:0/2224639874 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v6)=0 v6) ==== 142+0+0 (secure 0 0 0) 0x7f7b0c032860 con 0x7f7b18108380 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f7b080391b0 msgr2=0x7f7b0803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 --2- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f7b080391b0 0x7f7b0803b670 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7b040098c0 tx=0x7f7b04006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 msgr2=0x7f7b1819b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 --2- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1819b840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7b0c030590 tx=0x7f7b0c032670 comp rx=0 tx=0).stop 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 shutdown_connections 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 --2- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f7b080391b0 0x7f7b0803b670 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 --2- 172.21.15.70:0/2224639874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b18108380 0x7f7b1819b840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 >> 172.21.15.70:0/2224639874 conn(0x7f7b18102000 msgr2=0x7f7b18102bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:09.556 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 shutdown_connections 2024-09-19T04:22:09.557 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:08.892+0000 7f7b1ebaf640 1 -- 172.21.15.70:0/2224639874 wait complete. 2024-09-19T04:22:10.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:09 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2224639874' entity='client.admin' 2024-09-19T04:22:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.607+0000 7fa13222a640 1 Processor -- start 2024-09-19T04:22:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.607+0000 7fa13222a640 1 -- start start 2024-09-19T04:22:11.456 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.607+0000 7fa13222a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c106570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.607+0000 7fa13222a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c07be50 con 0x7fa12c106170 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.607+0000 7fa12b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c106570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.607+0000 7fa12b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c106570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49488/0 (socket says 172.21.15.70:49488) 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.607+0000 7fa12b7fe640 1 -- 172.21.15.70:0/278202537 learned_addr learned my addr 172.21.15.70:0/278202537 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.608+0000 7fa12b7fe640 1 -- 172.21.15.70:0/278202537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c106ab0 con 0x7fa12c106170 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.608+0000 7fa12b7fe640 1 --2- 172.21.15.70:0/278202537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c106570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009820 tx=0x7fa11c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9600d6944a0e69d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa12affd640 1 -- 172.21.15.70:0/278202537 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa11c037070 con 0x7fa12c106170 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa12affd640 1 -- 172.21.15.70:0/278202537 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa11c032910 con 0x7fa12c106170 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa12affd640 1 -- 172.21.15.70:0/278202537 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa11c0307d0 con 0x7fa12c106170 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa13222a640 1 -- 172.21.15.70:0/278202537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 msgr2=0x7fa12c106570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa13222a640 1 --2- 172.21.15.70:0/278202537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c106570 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa11c009820 tx=0x7fa11c02a270 comp rx=0 tx=0).stop 2024-09-19T04:22:11.457 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa13222a640 1 -- 172.21.15.70:0/278202537 shutdown_connections 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa13222a640 1 --2- 172.21.15.70:0/278202537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c106570 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa13222a640 1 -- 172.21.15.70:0/278202537 >> 172.21.15.70:0/278202537 conn(0x7fa12c101f40 msgr2=0x7fa12c104360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa13222a640 1 -- 172.21.15.70:0/278202537 shutdown_connections 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.609+0000 7fa13222a640 1 -- 172.21.15.70:0/278202537 wait complete. 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.610+0000 7fa13222a640 1 Processor -- start 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.610+0000 7fa13222a640 1 -- start start 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.610+0000 7fa13222a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c19da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.610+0000 7fa13222a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa12c107bf0 con 0x7fa12c106170 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.610+0000 7fa12b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c19da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.610+0000 7fa12b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c19da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49500/0 (socket says 172.21.15.70:49500) 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.610+0000 7fa12b7fe640 1 -- 172.21.15.70:0/1151087238 learned_addr learned my addr 172.21.15.70:0/1151087238 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:11.458 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.611+0000 7fa12b7fe640 1 -- 172.21.15.70:0/1151087238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa12c19df50 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.611+0000 7fa12b7fe640 1 --2- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c19da10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa11c030520 tx=0x7fa11c0327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.611+0000 7fa1297fa640 1 -- 172.21.15.70:0/1151087238 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa11c042070 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.611+0000 7fa1297fa640 1 -- 172.21.15.70:0/1151087238 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa11c030d50 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.611+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa12c19e1e0 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.611+0000 7fa1297fa640 1 -- 172.21.15.70:0/1151087238 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa11c037040 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.611+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa12c1a0ed0 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.612+0000 7fa1297fa640 1 -- 172.21.15.70:0/1151087238 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fa11c045070 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.612+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa12c106570 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.612+0000 7fa1297fa640 1 --2- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fa1180391b0 0x7fa11803b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.612+0000 7fa1297fa640 1 -- 172.21.15.70:0/1151087238 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa11c06c380 con 0x7fa12c106170 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.612+0000 7fa123fff640 1 --2- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fa1180391b0 0x7fa11803b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.613+0000 7fa123fff640 1 --2- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fa1180391b0 0x7fa11803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa1140098c0 tx=0x7fa114006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:11.459 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.617+0000 7fa1297fa640 1 -- 172.21.15.70:0/1151087238 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa11c045360 con 0x7fa12c106170 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.796+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7fa12c19e660 con 0x7fa12c106170 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.798+0000 7fa1297fa640 1 -- 172.21.15.70:0/1151087238 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7fa11c02ed90 con 0x7fa12c106170 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fa1180391b0 msgr2=0x7fa11803b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 --2- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fa1180391b0 0x7fa11803b670 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa1140098c0 tx=0x7fa114006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 msgr2=0x7fa12c19da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 --2- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c19da10 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa11c030520 tx=0x7fa11c0327b0 comp rx=0 tx=0).stop 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 shutdown_connections 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 --2- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fa1180391b0 0x7fa11803b670 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 --2- 172.21.15.70:0/1151087238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa12c106170 0x7fa12c19da10 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 >> 172.21.15.70:0/1151087238 conn(0x7fa12c101f40 msgr2=0x7fa12c1946d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 shutdown_connections 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:10.801+0000 7fa13222a640 1 -- 172.21.15.70:0/1151087238 wait complete. 2024-09-19T04:22:11.460 INFO:teuthology.orchestra.run.smithi070.stdout:Enabling the dashboard module... 2024-09-19T04:22:11.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:11 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:22:11.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:11 smithi070 ceph-mon[30942]: from='mgr.14116 172.21.15.70:0/2227192915' entity='mgr.x' 2024-09-19T04:22:11.698 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:11 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1151087238' entity='client.admin' 2024-09-19T04:22:12.664 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:12 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3388573192' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-09-19T04:22:12.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ignoring --setuser ceph since I am not root 2024-09-19T04:22:12.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ignoring --setgroup ceph since I am not root 2024-09-19T04:22:12.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:12.596+0000 7f0bc3da2040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:22:12.664 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:12.662+0000 7f0bc3da2040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:22:12.966 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:12.807+0000 7f0bc3da2040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:22:12.966 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:12.875+0000 7f0bc3da2040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:22:13.225 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:13.022+0000 7f0bc3da2040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:22:13.225 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:13.165+0000 7f0bc3da2040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.884+0000 7fb4322c4640 1 Processor -- start 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.884+0000 7fb4322c4640 1 -- start start 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.884+0000 7fb4322c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c07c300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.884+0000 7fb4322c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c07e190 con 0x7fb42c07dd90 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.884+0000 7fb42bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c07c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.884+0000 7fb42bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c07c300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49514/0 (socket says 172.21.15.70:49514) 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.884+0000 7fb42bfff640 1 -- 172.21.15.70:0/2182814776 learned_addr learned my addr 172.21.15.70:0/2182814776 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.884+0000 7fb42bfff640 1 -- 172.21.15.70:0/2182814776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c07c840 con 0x7fb42c07dd90 2024-09-19T04:22:13.233 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.885+0000 7fb42bfff640 1 --2- 172.21.15.70:0/2182814776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c07c300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009820 tx=0x7fb41c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f55e88044cfbae9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.885+0000 7fb42affd640 1 -- 172.21.15.70:0/2182814776 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41c037070 con 0x7fb42c07dd90 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.885+0000 7fb42affd640 1 -- 172.21.15.70:0/2182814776 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb41c032910 con 0x7fb42c07dd90 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.885+0000 7fb42affd640 1 -- 172.21.15.70:0/2182814776 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41c0307d0 con 0x7fb42c07dd90 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.886+0000 7fb4322c4640 1 -- 172.21.15.70:0/2182814776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 msgr2=0x7fb42c07c300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.886+0000 7fb4322c4640 1 --2- 172.21.15.70:0/2182814776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c07c300 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fb41c009820 tx=0x7fb41c02a270 comp rx=0 tx=0).stop 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.886+0000 7fb4322c4640 1 -- 172.21.15.70:0/2182814776 shutdown_connections 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.886+0000 7fb4322c4640 1 --2- 172.21.15.70:0/2182814776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c07c300 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.886+0000 7fb4322c4640 1 -- 172.21.15.70:0/2182814776 >> 172.21.15.70:0/2182814776 conn(0x7fb42c1031b0 msgr2=0x7fb42c1055d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.886+0000 7fb4322c4640 1 -- 172.21.15.70:0/2182814776 shutdown_connections 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.886+0000 7fb4322c4640 1 -- 172.21.15.70:0/2182814776 wait complete. 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.886+0000 7fb4322c4640 1 Processor -- start 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.887+0000 7fb4322c4640 1 -- start start 2024-09-19T04:22:13.234 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.887+0000 7fb4322c4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c19d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.887+0000 7fb4322c4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb42c10ddf0 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.887+0000 7fb42bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c19d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.887+0000 7fb42bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c19d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49516/0 (socket says 172.21.15.70:49516) 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.887+0000 7fb42bfff640 1 -- 172.21.15.70:0/3388573192 learned_addr learned my addr 172.21.15.70:0/3388573192 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.887+0000 7fb42bfff640 1 -- 172.21.15.70:0/3388573192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb42c19df00 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.887+0000 7fb42bfff640 1 --2- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c19d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb41c030d50 tx=0x7fb41c030d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.888+0000 7fb4297fa640 1 -- 172.21.15.70:0/3388573192 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41c042070 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.888+0000 7fb4297fa640 1 -- 172.21.15.70:0/3388573192 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb41c030870 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.888+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb42c19e190 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.888+0000 7fb4297fa640 1 -- 172.21.15.70:0/3388573192 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb41c037040 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.888+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb42c1a0e80 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.888+0000 7fb4297fa640 1 -- 172.21.15.70:0/3388573192 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 8) ==== 46461+0+0 (secure 0 0 0) 0x7fb41c045070 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.889+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb42c07c300 con 0x7fb42c07dd90 2024-09-19T04:22:13.235 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.889+0000 7fb4297fa640 1 --2- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fb4140391b0 0x7fb41403b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.889+0000 7fb4297fa640 1 -- 172.21.15.70:0/3388573192 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb41c06c590 con 0x7fb42c07dd90 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.889+0000 7fb42b7fe640 1 --2- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fb4140391b0 0x7fb41403b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.889+0000 7fb42b7fe640 1 --2- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fb4140391b0 0x7fb41403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb4200098c0 tx=0x7fb420006db0 comp rx=0 tx=0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:11.894+0000 7fb4297fa640 1 -- 172.21.15.70:0/3388573192 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb41c03dc70 con 0x7fb42c07dd90 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.120+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fb42c1a1470 con 0x7fb42c07dd90 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.451+0000 7fb4297fa640 1 -- 172.21.15.70:0/3388573192 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fb41c03cd00 con 0x7fb42c07dd90 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.452+0000 7fb4297fa640 1 -- 172.21.15.70:0/3388573192 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7fb41c03c760 con 0x7fb42c07dd90 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.453+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fb4140391b0 msgr2=0x7fb41403b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.453+0000 7fb4322c4640 1 --2- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fb4140391b0 0x7fb41403b670 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fb4200098c0 tx=0x7fb420006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.453+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 msgr2=0x7fb42c19d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.453+0000 7fb4322c4640 1 --2- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c19d9c0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fb41c030d50 tx=0x7fb41c030d80 comp rx=0 tx=0).stop 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.454+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 shutdown_connections 2024-09-19T04:22:13.236 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.454+0000 7fb4322c4640 1 --2- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7fb4140391b0 0x7fb41403b670 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:13.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.454+0000 7fb4322c4640 1 --2- 172.21.15.70:0/3388573192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb42c07dd90 0x7fb42c19d9c0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:13.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.454+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 >> 172.21.15.70:0/3388573192 conn(0x7fb42c1031b0 msgr2=0x7fb42c103ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:13.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.454+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 shutdown_connections 2024-09-19T04:22:13.237 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:12.454+0000 7fb4322c4640 1 -- 172.21.15.70:0/3388573192 wait complete. 2024-09-19T04:22:13.497 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:13 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3388573192' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-09-19T04:22:13.497 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:13 smithi070 ceph-mon[30942]: mgrmap e9: x(active, since 17s) 2024-09-19T04:22:13.756 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:13.495+0000 7f0bc3da2040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:22:13.756 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:13.557+0000 7f0bc3da2040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:22:13.756 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:13.754+0000 7f0bc3da2040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:22:14.556 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:14 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1230688356' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-09-19T04:22:14.559 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:22:14.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-09-19T04:22:14.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "available": true, 2024-09-19T04:22:14.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-09-19T04:22:14.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-09-19T04:22:14.565 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.638+0000 7f19065f0640 1 Processor -- start 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.638+0000 7f19065f0640 1 -- start start 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.638+0000 7f19065f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f1900106bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.638+0000 7f19065f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1900107180 con 0x7f19001067b0 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.638+0000 7f18fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f1900106bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.638+0000 7f18fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f1900106bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41892/0 (socket says 172.21.15.70:41892) 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.638+0000 7f18fffff640 1 -- 172.21.15.70:0/2261068800 learned_addr learned my addr 172.21.15.70:0/2261068800 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.639+0000 7f18fffff640 1 -- 172.21.15.70:0/2261068800 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19001079b0 con 0x7f19001067b0 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.639+0000 7f18fffff640 1 --2- 172.21.15.70:0/2261068800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f1900106bb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18f000bac0 tx=0x7f18f002c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4fb00fe42134be6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.639+0000 7f18feffd640 1 -- 172.21.15.70:0/2261068800 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18f00326d0 con 0x7f19001067b0 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f18feffd640 1 -- 172.21.15.70:0/2261068800 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f18f0038070 con 0x7f19001067b0 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f18feffd640 1 -- 172.21.15.70:0/2261068800 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18f0033cd0 con 0x7f19001067b0 2024-09-19T04:22:14.566 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f19065f0640 1 -- 172.21.15.70:0/2261068800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 msgr2=0x7f1900106bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f19065f0640 1 --2- 172.21.15.70:0/2261068800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f1900106bb0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f18f000bac0 tx=0x7f18f002c920 comp rx=0 tx=0).stop 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f19065f0640 1 -- 172.21.15.70:0/2261068800 shutdown_connections 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f19065f0640 1 --2- 172.21.15.70:0/2261068800 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f1900106bb0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f19065f0640 1 -- 172.21.15.70:0/2261068800 >> 172.21.15.70:0/2261068800 conn(0x7f1900101f80 msgr2=0x7f19001043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f19065f0640 1 -- 172.21.15.70:0/2261068800 shutdown_connections 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.640+0000 7f19065f0640 1 -- 172.21.15.70:0/2261068800 wait complete. 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.641+0000 7f19065f0640 1 Processor -- start 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.641+0000 7f19065f0640 1 -- start start 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.641+0000 7f19065f0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f190019db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.641+0000 7f19065f0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f190007b170 con 0x7f19001067b0 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.641+0000 7f18fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f190019db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.641+0000 7f18fffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f190019db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41896/0 (socket says 172.21.15.70:41896) 2024-09-19T04:22:14.567 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.641+0000 7f18fffff640 1 -- 172.21.15.70:0/1230688356 learned_addr learned my addr 172.21.15.70:0/1230688356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.642+0000 7f18fffff640 1 -- 172.21.15.70:0/1230688356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f190019e080 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.642+0000 7f18fffff640 1 --2- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f190019db40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18f002cee0 tx=0x7f18f0032b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.642+0000 7f18fd7fa640 1 -- 172.21.15.70:0/1230688356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18f0042070 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.642+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f190019e310 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.642+0000 7f18fd7fa640 1 -- 172.21.15.70:0/1230688356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f18f003e910 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.642+0000 7f18fd7fa640 1 -- 172.21.15.70:0/1230688356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f18f003c8a0 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.642+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19001a1000 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.643+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1900106bb0 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.643+0000 7f18fd7fa640 1 -- 172.21.15.70:0/1230688356 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f18f0045070 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.643+0000 7f18fd7fa640 1 --2- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f18e8039200 0x7f18e803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.643+0000 7f18fd7fa640 1 -- 172.21.15.70:0/1230688356 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f18f0030050 con 0x7f19001067b0 2024-09-19T04:22:14.568 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.643+0000 7f18ff7fe640 1 -- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f18e8039200 msgr2=0x7f18e803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3440627608 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.644+0000 7f18ff7fe640 1 --2- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f18e8039200 0x7f18e803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.648+0000 7f18fd7fa640 1 -- 172.21.15.70:0/1230688356 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f18f00469c0 con 0x7f19001067b0 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.845+0000 7f18ff7fe640 1 -- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f18e8039200 msgr2=0x7f18e803b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3440627608 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.845+0000 7f18ff7fe640 1 --2- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f18e8039200 0x7f18e803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.868+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f1900192ba0 con 0x7f19001067b0 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.869+0000 7f18fd7fa640 1 -- 172.21.15.70:0/1230688356 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f18f0046c20 con 0x7f19001067b0 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f18e8039200 msgr2=0x7f18e803b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 --2- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f18e8039200 0x7f18e803b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 msgr2=0x7f190019db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 --2- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f190019db40 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f18f002cee0 tx=0x7f18f0032b40 comp rx=0 tx=0).stop 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 shutdown_connections 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 --2- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f18e8039200 0x7f18e803b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:14.569 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 --2- 172.21.15.70:0/1230688356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f19001067b0 0x7f190019db40 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:14.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 >> 172.21.15.70:0/1230688356 conn(0x7f1900101f80 msgr2=0x7f190018fcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:14.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 shutdown_connections 2024-09-19T04:22:14.570 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:13.871+0000 7f19065f0640 1 -- 172.21.15.70:0/1230688356 wait complete. 2024-09-19T04:22:14.570 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for the mgr to restart... 2024-09-19T04:22:14.570 INFO:teuthology.orchestra.run.smithi070.stdout:Waiting for mgr epoch 9... 2024-09-19T04:22:14.806 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:14 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:14.667+0000 7f0bc3da2040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:22:14.807 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:14 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:14.736+0000 7f0bc3da2040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:22:15.711 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:15.452+0000 7f0bc3da2040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:22:15.711 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:15.567+0000 7f0bc3da2040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:22:15.986 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:15.709+0000 7f0bc3da2040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:22:15.986 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:15.770+0000 7f0bc3da2040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:22:15.986 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:15.917+0000 7f0bc3da2040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:22:15.986 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:15.984+0000 7f0bc3da2040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:22:16.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:16.045+0000 7f0bc3da2040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:22:16.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:16.200+0000 7f0bc3da2040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:22:16.269 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:16.264+0000 7f0bc3da2040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:22:16.529 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:16.330+0000 7f0bc3da2040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:22:16.529 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:16.412+0000 7f0bc3da2040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:22:16.530 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:16.470+0000 7f0bc3da2040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:22:16.530 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:16.527+0000 7f0bc3da2040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:22:17.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:17.305+0000 7f0bc3da2040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:22:17.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: Active manager daemon x restarted 2024-09-19T04:22:17.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: Activating manager daemon x 2024-09-19T04:22:17.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: osdmap e3: 0 total, 0 up, 0 in 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: mgrmap e10: x(active, starting, since 0.00301561s) 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: Manager daemon x is now available 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:22:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:22:19.033 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:18.683+0000 7f0b2f0b6640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:04:22:18] ENGINE Error in HTTPServer.serve 2024-09-19T04:22:19.033 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: Traceback (most recent call last): 2024-09-19T04:22:19.033 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:22:19.033 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._connections.run(self.expiration_interval) 2024-09-19T04:22:19.033 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:22:19.033 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._run(expiration_interval) 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: s = self.context.wrap_socket( 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: return self.sslsocket_class._create( 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self.do_handshake() 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._sslobj.do_handshake() 2024-09-19T04:22:19.034 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:22:19.035 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:22:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:22:19.041 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout { 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout "initialized": true 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout } 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.995+0000 7f03ce6c7640 1 Processor -- start 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.996+0000 7f03ce6c7640 1 -- start start 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.996+0000 7f03ce6c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c810a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.996+0000 7f03ce6c7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f03c807be10 con 0x7f03c81083e0 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.996+0000 7f03c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c810a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.996+0000 7f03c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c810a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41904/0 (socket says 172.21.15.70:41904) 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.996+0000 7f03c7fff640 1 -- 172.21.15.70:0/526795771 learned_addr learned my addr 172.21.15.70:0/526795771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.996+0000 7f03c7fff640 1 -- 172.21.15.70:0/526795771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c810ad10 con 0x7f03c81083e0 2024-09-19T04:22:19.042 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.997+0000 7f03c7fff640 1 --2- 172.21.15.70:0/526795771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c810a7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009820 tx=0x7f03b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=114afc78dedf395e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.997+0000 7f03c77fe640 1 -- 172.21.15.70:0/526795771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03b8037070 con 0x7f03c81083e0 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.997+0000 7f03c77fe640 1 -- 172.21.15.70:0/526795771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f03b8032910 con 0x7f03c81083e0 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.997+0000 7f03c77fe640 1 -- 172.21.15.70:0/526795771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03b80307d0 con 0x7f03c81083e0 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.998+0000 7f03ce6c7640 1 -- 172.21.15.70:0/526795771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 msgr2=0x7f03c810a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.998+0000 7f03ce6c7640 1 --2- 172.21.15.70:0/526795771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c810a7d0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f03b8009820 tx=0x7f03b802a270 comp rx=0 tx=0).stop 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.998+0000 7f03ce6c7640 1 -- 172.21.15.70:0/526795771 shutdown_connections 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.998+0000 7f03ce6c7640 1 --2- 172.21.15.70:0/526795771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c810a7d0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.998+0000 7f03ce6c7640 1 -- 172.21.15.70:0/526795771 >> 172.21.15.70:0/526795771 conn(0x7f03c8101f80 msgr2=0x7f03c81043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.998+0000 7f03ce6c7640 1 -- 172.21.15.70:0/526795771 shutdown_connections 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.998+0000 7f03ce6c7640 1 -- 172.21.15.70:0/526795771 wait complete. 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.998+0000 7f03ce6c7640 1 Processor -- start 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03ce6c7640 1 -- start start 2024-09-19T04:22:19.043 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03ce6c7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c819da70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03ce6c7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f03c810bd30 con 0x7f03c81083e0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c819da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03c7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c819da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41916/0 (socket says 172.21.15.70:41916) 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03c7fff640 1 -- 172.21.15.70:0/576408997 learned_addr learned my addr 172.21.15.70:0/576408997 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03c7fff640 1 -- 172.21.15.70:0/576408997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f03c819dfb0 con 0x7f03c81083e0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03c7fff640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c819da70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03b8030520 tx=0x7f03b80327b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03b8042070 con 0x7f03c81083e0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f03b8030d50 con 0x7f03c81083e0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:14.999+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f03c819e240 con 0x7f03c81083e0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.000+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f03b8037040 con 0x7f03c81083e0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.000+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f03c81a0f30 con 0x7f03c81083e0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.001+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 9) ==== 46474+0+0 (secure 0 0 0) 0x7f03b8045070 con 0x7f03c81083e0 2024-09-19T04:22:19.044 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.001+0000 7f03c5ffb640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 0x7f03b403b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.001+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 --> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f03b403bdd0 con 0x7f03b4039200 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.001+0000 7f03bffff640 1 -- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 msgr2=0x7f03b403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3440627608 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.001+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f03b806c430 con 0x7f03c81083e0 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.001+0000 7f03bffff640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 0x7f03b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.202+0000 7f03bffff640 1 -- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 msgr2=0x7f03b403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3440627608 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.202+0000 7f03bffff640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 0x7f03b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.603+0000 7f03bffff640 1 -- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 msgr2=0x7f03b403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3440627608 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:15.603+0000 7f03bffff640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 0x7f03b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:16.404+0000 7f03bffff640 1 -- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 msgr2=0x7f03b403b6c0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/3440627608 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:16.404+0000 7f03bffff640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 0x7f03b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:17.309+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mgrmap(e 10) ==== 46241+0+0 (secure 0 0 0) 0x7f03b806aee0 con 0x7f03c81083e0 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:17.309+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 msgr2=0x7f03b403b6c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:22:19.045 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:17.309+0000 7f03c5ffb640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 0x7f03b403b6c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.311+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 11) ==== 46368+0+0 (secure 0 0 0) 0x7f03b803c7f0 con 0x7f03c81083e0 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.311+0000 7f03c5ffb640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f03b403ccc0 0x7f03b403f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.311+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f03b8033e50 con 0x7f03b403ccc0 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.311+0000 7f03bffff640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f03b403ccc0 0x7f03b403f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.312+0000 7f03bffff640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f03b403ccc0 0x7f03b403f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f03b0003980 tx=0x7f03b0006e10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.313+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7f03b8033e50 con 0x7f03b403ccc0 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7f03c81087c0 con 0x7f03b403ccc0 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03c5ffb640 1 -- 172.21.15.70:0/576408997 <== mgr.14148 v2:172.21.15.70:6800/4212188848 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7f03c81087c0 con 0x7f03b403ccc0 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f03b403ccc0 msgr2=0x7f03b403f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:19.046 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f03b403ccc0 0x7f03b403f0b0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f03b0003980 tx=0x7f03b0006e10 comp rx=0 tx=0).stop 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 msgr2=0x7f03c819da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c819da70 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f03b8030520 tx=0x7f03b80327b0 comp rx=0 tx=0).stop 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 shutdown_connections 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f03b403ccc0 0x7f03b403f0b0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:6800/3440627608,v1:172.21.15.70:6801/3440627608] conn(0x7f03b4039200 0x7f03b403b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 --2- 172.21.15.70:0/576408997 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f03c81083e0 0x7f03c819da70 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 >> 172.21.15.70:0/576408997 conn(0x7f03c8101f80 msgr2=0x7f03c8102a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 shutdown_connections 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:18.320+0000 7f03ce6c7640 1 -- 172.21.15.70:0/576408997 wait complete. 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:mgr epoch 9 is available 2024-09-19T04:22:19.047 INFO:teuthology.orchestra.run.smithi070.stdout:Generating a dashboard self-signed certificate... 2024-09-19T04:22:19.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:19 smithi070 ceph-mon[30942]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-09-19T04:22:19.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:19 smithi070 ceph-mon[30942]: mgrmap e11: x(active, since 1.00645s) 2024-09-19T04:22:19.630 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:19 smithi070 ceph-mon[30942]: from='client.14152 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-09-19T04:22:20.305 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-09-19T04:22:20.305 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.428+0000 7fa305fc3640 1 Processor -- start 2024-09-19T04:22:20.305 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.428+0000 7fa305fc3640 1 -- start start 2024-09-19T04:22:20.305 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.428+0000 7fa305fc3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30007c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.428+0000 7fa305fc3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa30007c860 con 0x7fa30007de70 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.429+0000 7fa2ff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30007c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.429+0000 7fa2ff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30007c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42004/0 (socket says 172.21.15.70:42004) 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.429+0000 7fa2ff7fe640 1 -- 172.21.15.70:0/459380988 learned_addr learned my addr 172.21.15.70:0/459380988 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.429+0000 7fa2ff7fe640 1 -- 172.21.15.70:0/459380988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30007c9e0 con 0x7fa30007de70 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa2ff7fe640 1 --2- 172.21.15.70:0/459380988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30007c320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009820 tx=0x7fa2f002a300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=832de831e918c4e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa2fe7fc640 1 -- 172.21.15.70:0/459380988 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f0037070 con 0x7fa30007de70 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa2fe7fc640 1 -- 172.21.15.70:0/459380988 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa2f0032910 con 0x7fa30007de70 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa2fe7fc640 1 -- 172.21.15.70:0/459380988 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f0030860 con 0x7fa30007de70 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa305fc3640 1 -- 172.21.15.70:0/459380988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 msgr2=0x7fa30007c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa305fc3640 1 --2- 172.21.15.70:0/459380988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30007c320 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0009820 tx=0x7fa2f002a300 comp rx=0 tx=0).stop 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa305fc3640 1 -- 172.21.15.70:0/459380988 shutdown_connections 2024-09-19T04:22:20.306 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa305fc3640 1 --2- 172.21.15.70:0/459380988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30007c320 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa305fc3640 1 -- 172.21.15.70:0/459380988 >> 172.21.15.70:0/459380988 conn(0x7fa300103090 msgr2=0x7fa3001054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa305fc3640 1 -- 172.21.15.70:0/459380988 shutdown_connections 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.430+0000 7fa305fc3640 1 -- 172.21.15.70:0/459380988 wait complete. 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.431+0000 7fa305fc3640 1 Processor -- start 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.431+0000 7fa305fc3640 1 -- start start 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.431+0000 7fa305fc3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30019d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.431+0000 7fa305fc3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa30010ded0 con 0x7fa30007de70 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.431+0000 7fa2ff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30019d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.431+0000 7fa2ff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30019d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42020/0 (socket says 172.21.15.70:42020) 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.431+0000 7fa2ff7fe640 1 -- 172.21.15.70:0/4159250733 learned_addr learned my addr 172.21.15.70:0/4159250733 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.432+0000 7fa2ff7fe640 1 -- 172.21.15.70:0/4159250733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa30019df20 con 0x7fa30007de70 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.432+0000 7fa2ff7fe640 1 --2- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30019d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0000c00 tx=0x7fa2f0030880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:20.307 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.432+0000 7fa2fcff9640 1 -- 172.21.15.70:0/4159250733 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f0037040 con 0x7fa30007de70 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.432+0000 7fa2fcff9640 1 -- 172.21.15.70:0/4159250733 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa2f0040070 con 0x7fa30007de70 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.432+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa30019e1b0 con 0x7fa30007de70 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.432+0000 7fa2fcff9640 1 -- 172.21.15.70:0/4159250733 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa2f003a390 con 0x7fa30007de70 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.432+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3001a0ea0 con 0x7fa30007de70 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.433+0000 7fa2fcff9640 1 -- 172.21.15.70:0/4159250733 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fa2f003a610 con 0x7fa30007de70 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.433+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa30007c320 con 0x7fa30007de70 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.433+0000 7fa2fcff9640 1 --2- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa2e8039200 0x7fa2e803b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.433+0000 7fa2fcff9640 1 -- 172.21.15.70:0/4159250733 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fa2f006c870 con 0x7fa30007de70 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.433+0000 7fa2feffd640 1 --2- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa2e8039200 0x7fa2e803b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.434+0000 7fa2feffd640 1 --2- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa2e8039200 0x7fa2e803b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40098c0 tx=0x7fa2f4006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:20.308 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.438+0000 7fa2fcff9640 1 -- 172.21.15.70:0/4159250733 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa2f0043c60 con 0x7fa30007de70 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.628+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7fa3001042b0 con 0x7fa2e8039200 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.688+0000 7fa2fcff9640 1 -- 172.21.15.70:0/4159250733 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7fa3001042b0 con 0x7fa2e8039200 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa2e8039200 msgr2=0x7fa2e803b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 --2- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa2e8039200 0x7fa2e803b6c0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fa2f40098c0 tx=0x7fa2f4006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 msgr2=0x7fa30019d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 --2- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30019d9e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0000c00 tx=0x7fa2f0030880 comp rx=0 tx=0).stop 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 shutdown_connections 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 --2- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa2e8039200 0x7fa2e803b6c0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 --2- 172.21.15.70:0/4159250733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa30007de70 0x7fa30019d9e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 >> 172.21.15.70:0/4159250733 conn(0x7fa300103090 msgr2=0x7fa300103ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 shutdown_connections 2024-09-19T04:22:20.309 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:19.691+0000 7fa305fc3640 1 -- 172.21.15.70:0/4159250733 wait complete. 2024-09-19T04:22:20.310 INFO:teuthology.orchestra.run.smithi070.stdout:Creating initial admin user... 2024-09-19T04:22:20.426 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: [19/Sep/2024:04:22:18] ENGINE Bus STARTING 2024-09-19T04:22:20.426 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: [19/Sep/2024:04:22:18] ENGINE Serving on https://172.21.15.70:7150 2024-09-19T04:22:20.426 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: [19/Sep/2024:04:22:18] ENGINE Error in HTTPServer.serve 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: Traceback (most recent call last): 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._run(expiration_interval) 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: s = self.context.wrap_socket( 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: return self.sslsocket_class._create( 2024-09-19T04:22:20.427 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout: self.do_handshake() 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._sslobj.do_handshake() 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: [19/Sep/2024:04:22:18] ENGINE Serving on http://172.21.15.70:8765 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: [19/Sep/2024:04:22:18] ENGINE Bus STARTED 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: mgrmap e12: x(active, since 2s) 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:20.428 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:21 smithi070 ceph-mon[30942]: from='client.14160 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:21 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:21 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:22.451 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$tPWJTN49v.GQgs59MPe.fe/gZcMlFzRJUrv8xtBaIVVejh/wcG21S", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1726719741, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-09-19T04:22:22.451 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.775+0000 7fdc178ee640 1 Processor -- start 2024-09-19T04:22:22.451 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.775+0000 7fdc178ee640 1 -- start start 2024-09-19T04:22:22.451 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.775+0000 7fdc178ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1010a710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.775+0000 7fdc178ee640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1007bed0 con 0x7fdc10108320 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.775+0000 7fdc1568a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1010a710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.775+0000 7fdc1568a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1010a710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42028/0 (socket says 172.21.15.70:42028) 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.776+0000 7fdc1568a640 1 -- 172.21.15.70:0/684475764 learned_addr learned my addr 172.21.15.70:0/684475764 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.776+0000 7fdc1568a640 1 -- 172.21.15.70:0/684475764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1010ac50 con 0x7fdc10108320 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.776+0000 7fdc1568a640 1 --2- 172.21.15.70:0/684475764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1010a710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009820 tx=0x7fdc0c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86cdfb605f69d91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.777+0000 7fdc03fff640 1 -- 172.21.15.70:0/684475764 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c037070 con 0x7fdc10108320 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.777+0000 7fdc03fff640 1 -- 172.21.15.70:0/684475764 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdc0c032910 con 0x7fdc10108320 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.777+0000 7fdc03fff640 1 -- 172.21.15.70:0/684475764 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c0307d0 con 0x7fdc10108320 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.777+0000 7fdc178ee640 1 -- 172.21.15.70:0/684475764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 msgr2=0x7fdc1010a710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.777+0000 7fdc178ee640 1 --2- 172.21.15.70:0/684475764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1010a710 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c009820 tx=0x7fdc0c02a270 comp rx=0 tx=0).stop 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.777+0000 7fdc178ee640 1 -- 172.21.15.70:0/684475764 shutdown_connections 2024-09-19T04:22:22.452 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.777+0000 7fdc178ee640 1 --2- 172.21.15.70:0/684475764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1010a710 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.777+0000 7fdc178ee640 1 -- 172.21.15.70:0/684475764 >> 172.21.15.70:0/684475764 conn(0x7fdc10101f80 msgr2=0x7fdc101043a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc178ee640 1 -- 172.21.15.70:0/684475764 shutdown_connections 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc178ee640 1 -- 172.21.15.70:0/684475764 wait complete. 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc178ee640 1 Processor -- start 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc178ee640 1 -- start start 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc178ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1019b840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc178ee640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc1010bd30 con 0x7fdc10108320 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc1568a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1019b840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc1568a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1019b840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42040/0 (socket says 172.21.15.70:42040) 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.778+0000 7fdc1568a640 1 -- 172.21.15.70:0/1986627595 learned_addr learned my addr 172.21.15.70:0/1986627595 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.779+0000 7fdc1568a640 1 -- 172.21.15.70:0/1986627595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc1019bd80 con 0x7fdc10108320 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.779+0000 7fdc1568a640 1 --2- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1019b840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c02a790 tx=0x7fdc0c030d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:22.453 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.779+0000 7fdc027fc640 1 -- 172.21.15.70:0/1986627595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c042070 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.779+0000 7fdc027fc640 1 -- 172.21.15.70:0/1986627595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdc0c030860 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.779+0000 7fdc027fc640 1 -- 172.21.15.70:0/1986627595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc0c037040 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.779+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc1019c010 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.779+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc1019ed00 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.780+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc10108700 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.781+0000 7fdc027fc640 1 -- 172.21.15.70:0/1986627595 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7fdc0c045070 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.781+0000 7fdc027fc640 1 --2- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdbfc039200 0x7fdbfc03b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.781+0000 7fdc027fc640 1 -- 172.21.15.70:0/1986627595 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fdc0c06cc40 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.781+0000 7fdc14e89640 1 --2- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdbfc039200 0x7fdbfc03b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.782+0000 7fdc14e89640 1 --2- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdbfc039200 0x7fdbfc03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc040098c0 tx=0x7fdc04006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.785+0000 7fdc027fc640 1 -- 172.21.15.70:0/1986627595 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc0c0463b0 con 0x7fdc10108320 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:20.975+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7fdc1019c4f0 con 0x7fdbfc039200 2024-09-19T04:22:22.454 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.205+0000 7fdc027fc640 1 -- 172.21.15.70:0/1986627595 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7fdc1019c4f0 con 0x7fdbfc039200 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdbfc039200 msgr2=0x7fdbfc03b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 --2- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdbfc039200 0x7fdbfc03b6c0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fdc040098c0 tx=0x7fdc04006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 msgr2=0x7fdc1019b840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 --2- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1019b840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fdc0c02a790 tx=0x7fdc0c030d00 comp rx=0 tx=0).stop 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 shutdown_connections 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 --2- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdbfc039200 0x7fdbfc03b6c0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 --2- 172.21.15.70:0/1986627595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc10108320 0x7fdc1019b840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 >> 172.21.15.70:0/1986627595 conn(0x7fdc10101f80 msgr2=0x7fdc10102a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 shutdown_connections 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:21.207+0000 7fdc178ee640 1 -- 172.21.15.70:0/1986627595 wait complete. 2024-09-19T04:22:22.455 INFO:teuthology.orchestra.run.smithi070.stdout:Fetching dashboard port number... 2024-09-19T04:22:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:22 smithi070 ceph-mon[30942]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:23.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:23 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1909518967' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stdout 8443 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.907+0000 7f1da924b640 1 Processor -- start 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.907+0000 7f1da924b640 1 -- start start 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.907+0000 7f1da924b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da4106c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.907+0000 7f1da924b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1da41071e0 con 0x7f1da4106810 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.907+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da4106c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.907+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da4106c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42052/0 (socket says 172.21.15.70:42052) 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.907+0000 7f1da2d9d640 1 -- 172.21.15.70:0/4285554040 learned_addr learned my addr 172.21.15.70:0/4285554040 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.908+0000 7f1da2d9d640 1 -- 172.21.15.70:0/4285554040 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da4107a10 con 0x7f1da4106810 2024-09-19T04:22:23.676 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.908+0000 7f1da2d9d640 1 --2- 172.21.15.70:0/4285554040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da4106c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009e80 tx=0x7f1d9402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d7204c0db65893d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.908+0000 7f1da1d9b640 1 -- 172.21.15.70:0/4285554040 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d94036070 con 0x7f1da4106810 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da1d9b640 1 -- 172.21.15.70:0/4285554040 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1d940318d0 con 0x7f1da4106810 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da1d9b640 1 -- 172.21.15.70:0/4285554040 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d94007a10 con 0x7f1da4106810 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da924b640 1 -- 172.21.15.70:0/4285554040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 msgr2=0x7f1da4106c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da924b640 1 --2- 172.21.15.70:0/4285554040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da4106c10 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009e80 tx=0x7f1d9402a7a0 comp rx=0 tx=0).stop 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da924b640 1 -- 172.21.15.70:0/4285554040 shutdown_connections 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da924b640 1 --2- 172.21.15.70:0/4285554040 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da4106c10 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da924b640 1 -- 172.21.15.70:0/4285554040 >> 172.21.15.70:0/4285554040 conn(0x7f1da4102000 msgr2=0x7f1da4104420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da924b640 1 -- 172.21.15.70:0/4285554040 shutdown_connections 2024-09-19T04:22:23.677 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.909+0000 7f1da924b640 1 -- 172.21.15.70:0/4285554040 wait complete. 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.910+0000 7f1da924b640 1 Processor -- start 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.910+0000 7f1da924b640 1 -- start start 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.910+0000 7f1da924b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da419a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.910+0000 7f1da924b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1da410adc0 con 0x7f1da4106810 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.910+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da419a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.910+0000 7f1da2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da419a7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42060/0 (socket says 172.21.15.70:42060) 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.910+0000 7f1da2d9d640 1 -- 172.21.15.70:0/1909518967 learned_addr learned my addr 172.21.15.70:0/1909518967 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.911+0000 7f1da2d9d640 1 -- 172.21.15.70:0/1909518967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1da419ad00 con 0x7f1da4106810 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.911+0000 7f1da2d9d640 1 --2- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da419a7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009fa0 tx=0x7f1d94031cb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.911+0000 7f1d9bfff640 1 -- 172.21.15.70:0/1909518967 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d94041020 con 0x7f1da4106810 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.911+0000 7f1d9bfff640 1 -- 172.21.15.70:0/1909518967 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1d9403c940 con 0x7f1da4106810 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.911+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1da419af90 con 0x7f1da4106810 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.911+0000 7f1d9bfff640 1 -- 172.21.15.70:0/1909518967 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d94036040 con 0x7f1da4106810 2024-09-19T04:22:23.678 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.911+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1da419dc80 con 0x7f1da4106810 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.912+0000 7f1d9bfff640 1 -- 172.21.15.70:0/1909518967 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 12) ==== 46474+0+0 (secure 0 0 0) 0x7f1d94044020 con 0x7f1da4106810 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.912+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1da4106c90 con 0x7f1da4106810 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.912+0000 7f1d9bfff640 1 --2- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d90039200 0x7f1d9003b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.912+0000 7f1d9bfff640 1 -- 172.21.15.70:0/1909518967 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f1d9406d940 con 0x7f1da4106810 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.912+0000 7f1da259c640 1 --2- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d90039200 0x7f1d9003b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.913+0000 7f1da259c640 1 --2- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d90039200 0x7f1d9003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0098c0 tx=0x7f1d8c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:22.917+0000 7f1d9bfff640 1 -- 172.21.15.70:0/1909518967 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d9404b020 con 0x7f1da4106810 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.081+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7f1da419e360 con 0x7f1da4106810 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.081+0000 7f1d9bfff640 1 -- 172.21.15.70:0/1909518967 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7f1d94038df0 con 0x7f1da4106810 2024-09-19T04:22:23.679 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d90039200 msgr2=0x7f1d9003b6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 --2- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d90039200 0x7f1d9003b6c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f1d8c0098c0 tx=0x7f1d8c006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 msgr2=0x7f1da419a7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 --2- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da419a7c0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f1d94009fa0 tx=0x7f1d94031cb0 comp rx=0 tx=0).stop 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 shutdown_connections 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 --2- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d90039200 0x7f1d9003b6c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 --2- 172.21.15.70:0/1909518967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1da4106810 0x7f1da419a7c0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 >> 172.21.15.70:0/1909518967 conn(0x7f1da4102000 msgr2=0x7f1da4102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 shutdown_connections 2024-09-19T04:22:23.680 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:23.084+0000 7f1da924b640 1 -- 172.21.15.70:0/1909518967 wait complete. 2024-09-19T04:22:23.684 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-09-19T04:22:23.684 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout disabled 2024-09-19T04:22:23.691 INFO:teuthology.orchestra.run.smithi070.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-09-19T04:22:23.691 INFO:teuthology.orchestra.run.smithi070.stdout:systemctl: stdout inactive 2024-09-19T04:22:23.691 INFO:teuthology.orchestra.run.smithi070.stdout:firewalld.service is not enabled 2024-09-19T04:22:23.691 INFO:teuthology.orchestra.run.smithi070.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-09-19T04:22:23.694 INFO:teuthology.orchestra.run.smithi070.stdout:Ceph Dashboard is now available at: 2024-09-19T04:22:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:23.694 INFO:teuthology.orchestra.run.smithi070.stdout: URL: https://smithi070.front.sepia.ceph.com:8443/ 2024-09-19T04:22:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: User: admin 2024-09-19T04:22:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: Password: 46v5ajrxmq 2024-09-19T04:22:23.695 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:23.695 INFO:teuthology.orchestra.run.smithi070.stdout:Saving cluster configuration to /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config directory 2024-09-19T04:22:24.639 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:24 smithi070 ceph-mon[30942]: mgrmap e13: x(active, since 6s) 2024-09-19T04:22:24.639 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:24 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2870822462' entity='client.admin' 2024-09-19T04:22:24.897 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.072+0000 7f37d36d9640 1 Processor -- start 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.073+0000 7f37d36d9640 1 -- start start 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.073+0000 7f37d36d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc105fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.073+0000 7f37d36d9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc106590 con 0x7f37cc105bc0 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.073+0000 7f37d1475640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc105fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.073+0000 7f37d1475640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc105fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56438/0 (socket says 172.21.15.70:56438) 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.073+0000 7f37d1475640 1 -- 172.21.15.70:0/3032193744 learned_addr learned my addr 172.21.15.70:0/3032193744 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.073+0000 7f37d1475640 1 -- 172.21.15.70:0/3032193744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37cc108ba0 con 0x7f37cc105bc0 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.074+0000 7f37d1475640 1 --2- 172.21.15.70:0/3032193744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc105fc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009820 tx=0x7f37c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=653c805b392ea3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.074+0000 7f37bffff640 1 -- 172.21.15.70:0/3032193744 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0037070 con 0x7f37cc105bc0 2024-09-19T04:22:24.898 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.074+0000 7f37bffff640 1 -- 172.21.15.70:0/3032193744 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f37c0032910 con 0x7f37cc105bc0 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.074+0000 7f37bffff640 1 -- 172.21.15.70:0/3032193744 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c00307d0 con 0x7f37cc105bc0 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 -- 172.21.15.70:0/3032193744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 msgr2=0x7f37cc105fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 --2- 172.21.15.70:0/3032193744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc105fc0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009820 tx=0x7f37c002a270 comp rx=0 tx=0).stop 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 -- 172.21.15.70:0/3032193744 shutdown_connections 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 --2- 172.21.15.70:0/3032193744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc105fc0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 -- 172.21.15.70:0/3032193744 >> 172.21.15.70:0/3032193744 conn(0x7f37cc101750 msgr2=0x7f37cc103b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 -- 172.21.15.70:0/3032193744 shutdown_connections 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 -- 172.21.15.70:0/3032193744 wait complete. 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 Processor -- start 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 -- start start 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:24.899 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d36d9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f37cc10bdd0 con 0x7f37cc105bc0 2024-09-19T04:22:24.900 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.075+0000 7f37d1475640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:24.900 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37d1475640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc19b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56440/0 (socket says 172.21.15.70:56440) 2024-09-19T04:22:24.900 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37d1475640 1 -- 172.21.15.70:0/2870822462 learned_addr learned my addr 172.21.15.70:0/2870822462 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:24.900 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37d1475640 1 -- 172.21.15.70:0/2870822462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37cc19bd40 con 0x7f37cc105bc0 2024-09-19T04:22:24.900 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37d1475640 1 --2- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc19b800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009940 tx=0x7f37c0030d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37be7fc640 1 -- 172.21.15.70:0/2870822462 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0042070 con 0x7f37cc105bc0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37cc19bfd0 con 0x7f37cc105bc0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37be7fc640 1 -- 172.21.15.70:0/2870822462 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f37c0030870 con 0x7f37cc105bc0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37be7fc640 1 -- 172.21.15.70:0/2870822462 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37c0037040 con 0x7f37cc105bc0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.076+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37cc19ecc0 con 0x7f37cc105bc0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.077+0000 7f37be7fc640 1 -- 172.21.15.70:0/2870822462 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f37c0045070 con 0x7f37cc105bc0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.077+0000 7f37be7fc640 1 --2- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f37b80392a0 0x7f37b803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.077+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37cc105fc0 con 0x7f37cc105bc0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.077+0000 7f37be7fc640 1 -- 172.21.15.70:0/2870822462 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f37c006c590 con 0x7f37cc105bc0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.077+0000 7f37d0c74640 1 --2- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f37b80392a0 0x7f37b803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:24.901 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.078+0000 7f37d0c74640 1 --2- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f37b80392a0 0x7f37b803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f37c80098c0 tx=0x7f37c8006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.082+0000 7f37be7fc640 1 -- 172.21.15.70:0/2870822462 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f37c003cd30 con 0x7f37cc105bc0 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.332+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7f37cc19f2b0 con 0x7f37cc105bc0 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.335+0000 7f37be7fc640 1 -- 172.21.15.70:0/2870822462 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v26)=0 set mgr/dashboard/cluster/status v26) ==== 153+0+0 (secure 0 0 0) 0x7f37c003dc70 con 0x7f37cc105bc0 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f37b80392a0 msgr2=0x7f37b803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 --2- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f37b80392a0 0x7f37b803b760 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f37c80098c0 tx=0x7f37c8006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 msgr2=0x7f37cc19b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 --2- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc19b800 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f37c0009940 tx=0x7f37c0030d50 comp rx=0 tx=0).stop 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 shutdown_connections 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 --2- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f37b80392a0 0x7f37b803b760 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 --2- 172.21.15.70:0/2870822462 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f37cc105bc0 0x7f37cc19b800 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:24.902 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 >> 172.21.15.70:0/2870822462 conn(0x7f37cc101750 msgr2=0x7f37cc102250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 shutdown_connections 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout:/usr/bin/ceph: stderr 2024-09-19T04:22:24.338+0000 7f37d36d9640 1 -- 172.21.15.70:0/2870822462 wait complete. 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout:Or, if you are only running a single cluster on this host: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout:Please consider enabling telemetry to help improve Ceph: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: ceph telemetry on 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout:For more information see: 2024-09-19T04:22:24.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:24.904 INFO:teuthology.orchestra.run.smithi070.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-09-19T04:22:24.904 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:24.904 INFO:teuthology.orchestra.run.smithi070.stdout:Bootstrap complete. 2024-09-19T04:22:24.937 INFO:tasks.cephadm:Fetching config... 2024-09-19T04:22:24.938 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:22:24.938 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-09-19T04:22:24.955 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-09-19T04:22:24.955 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:22:24.955 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-09-19T04:22:25.012 INFO:tasks.cephadm:Fetching mon keyring... 2024-09-19T04:22:25.012 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:22:25.012 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/keyring of=/dev/stdout 2024-09-19T04:22:25.076 INFO:tasks.cephadm:Fetching pub ssh key... 2024-09-19T04:22:25.077 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:22:25.077 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-09-19T04:22:25.132 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-09-19T04:22:25.133 DEBUG:teuthology.orchestra.run.smithi070:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUhpp3fBbrzTFdMg+mIYxInYNel20HXBqoQ6SRBH9YmQIh4rwgSwIN193TyTbGOnyqMGAxYJVTsMexItSF/WFHeZeH7WxOrE3vrWt/UryMyVBFzWV+SZy5t3FznoTY15AlPmbPOqcEQn1/b/iNxItOsBbjWhpGo19JtdRqIVbFeIrXA09PhJlcsU/P8Oy0UtkGV6d2MXtcCoaDTiI3poS0J1XMs2W2FTaL0nT8aUTWwfPYDYNUxdlJydoa71LE+GVhEcug6iHzJTw2dtMEpE2oTX60w0As7aQSzF7wtrtNVz9thXtrsUKgrWElPvVCnTVtLq02ThfyWIKW2rUZeDB9e+SfRkG08/7mSu3bZfgOjYlzzRCkfSLygdqmKsfTEMlOhQnDSanGe/wqhiV7Zj+qY7tM6PPD3ucG4f5ytckYVTcXoWHdhvVQcEQicJsKdZOESHP61ZWeThewpHPhb8T5YC8V2iW5iUv7m6Ka1I2sQ5aoXBZQvK5l8jsWCkZOhC0= ceph-7f15b24a-763e-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:22:25.206 INFO:teuthology.orchestra.run.smithi070.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUhpp3fBbrzTFdMg+mIYxInYNel20HXBqoQ6SRBH9YmQIh4rwgSwIN193TyTbGOnyqMGAxYJVTsMexItSF/WFHeZeH7WxOrE3vrWt/UryMyVBFzWV+SZy5t3FznoTY15AlPmbPOqcEQn1/b/iNxItOsBbjWhpGo19JtdRqIVbFeIrXA09PhJlcsU/P8Oy0UtkGV6d2MXtcCoaDTiI3poS0J1XMs2W2FTaL0nT8aUTWwfPYDYNUxdlJydoa71LE+GVhEcug6iHzJTw2dtMEpE2oTX60w0As7aQSzF7wtrtNVz9thXtrsUKgrWElPvVCnTVtLq02ThfyWIKW2rUZeDB9e+SfRkG08/7mSu3bZfgOjYlzzRCkfSLygdqmKsfTEMlOhQnDSanGe/wqhiV7Zj+qY7tM6PPD3ucG4f5ytckYVTcXoWHdhvVQcEQicJsKdZOESHP61ZWeThewpHPhb8T5YC8V2iW5iUv7m6Ka1I2sQ5aoXBZQvK5l8jsWCkZOhC0= ceph-7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:25.220 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUhpp3fBbrzTFdMg+mIYxInYNel20HXBqoQ6SRBH9YmQIh4rwgSwIN193TyTbGOnyqMGAxYJVTsMexItSF/WFHeZeH7WxOrE3vrWt/UryMyVBFzWV+SZy5t3FznoTY15AlPmbPOqcEQn1/b/iNxItOsBbjWhpGo19JtdRqIVbFeIrXA09PhJlcsU/P8Oy0UtkGV6d2MXtcCoaDTiI3poS0J1XMs2W2FTaL0nT8aUTWwfPYDYNUxdlJydoa71LE+GVhEcug6iHzJTw2dtMEpE2oTX60w0As7aQSzF7wtrtNVz9thXtrsUKgrWElPvVCnTVtLq02ThfyWIKW2rUZeDB9e+SfRkG08/7mSu3bZfgOjYlzzRCkfSLygdqmKsfTEMlOhQnDSanGe/wqhiV7Zj+qY7tM6PPD3ucG4f5ytckYVTcXoWHdhvVQcEQicJsKdZOESHP61ZWeThewpHPhb8T5YC8V2iW5iUv7m6Ka1I2sQ5aoXBZQvK5l8jsWCkZOhC0= ceph-7f15b24a-763e-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:22:25.298 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUhpp3fBbrzTFdMg+mIYxInYNel20HXBqoQ6SRBH9YmQIh4rwgSwIN193TyTbGOnyqMGAxYJVTsMexItSF/WFHeZeH7WxOrE3vrWt/UryMyVBFzWV+SZy5t3FznoTY15AlPmbPOqcEQn1/b/iNxItOsBbjWhpGo19JtdRqIVbFeIrXA09PhJlcsU/P8Oy0UtkGV6d2MXtcCoaDTiI3poS0J1XMs2W2FTaL0nT8aUTWwfPYDYNUxdlJydoa71LE+GVhEcug6iHzJTw2dtMEpE2oTX60w0As7aQSzF7wtrtNVz9thXtrsUKgrWElPvVCnTVtLq02ThfyWIKW2rUZeDB9e+SfRkG08/7mSu3bZfgOjYlzzRCkfSLygdqmKsfTEMlOhQnDSanGe/wqhiV7Zj+qY7tM6PPD3ucG4f5ytckYVTcXoWHdhvVQcEQicJsKdZOESHP61ZWeThewpHPhb8T5YC8V2iW5iUv7m6Ka1I2sQ5aoXBZQvK5l8jsWCkZOhC0= ceph-7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:25.311 DEBUG:teuthology.orchestra.run.smithi167:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUhpp3fBbrzTFdMg+mIYxInYNel20HXBqoQ6SRBH9YmQIh4rwgSwIN193TyTbGOnyqMGAxYJVTsMexItSF/WFHeZeH7WxOrE3vrWt/UryMyVBFzWV+SZy5t3FznoTY15AlPmbPOqcEQn1/b/iNxItOsBbjWhpGo19JtdRqIVbFeIrXA09PhJlcsU/P8Oy0UtkGV6d2MXtcCoaDTiI3poS0J1XMs2W2FTaL0nT8aUTWwfPYDYNUxdlJydoa71LE+GVhEcug6iHzJTw2dtMEpE2oTX60w0As7aQSzF7wtrtNVz9thXtrsUKgrWElPvVCnTVtLq02ThfyWIKW2rUZeDB9e+SfRkG08/7mSu3bZfgOjYlzzRCkfSLygdqmKsfTEMlOhQnDSanGe/wqhiV7Zj+qY7tM6PPD3ucG4f5ytckYVTcXoWHdhvVQcEQicJsKdZOESHP61ZWeThewpHPhb8T5YC8V2iW5iUv7m6Ka1I2sQ5aoXBZQvK5l8jsWCkZOhC0= ceph-7f15b24a-763e-11ef-bceb-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-09-19T04:22:25.375 INFO:teuthology.orchestra.run.smithi167.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCUhpp3fBbrzTFdMg+mIYxInYNel20HXBqoQ6SRBH9YmQIh4rwgSwIN193TyTbGOnyqMGAxYJVTsMexItSF/WFHeZeH7WxOrE3vrWt/UryMyVBFzWV+SZy5t3FznoTY15AlPmbPOqcEQn1/b/iNxItOsBbjWhpGo19JtdRqIVbFeIrXA09PhJlcsU/P8Oy0UtkGV6d2MXtcCoaDTiI3poS0J1XMs2W2FTaL0nT8aUTWwfPYDYNUxdlJydoa71LE+GVhEcug6iHzJTw2dtMEpE2oTX60w0As7aQSzF7wtrtNVz9thXtrsUKgrWElPvVCnTVtLq02ThfyWIKW2rUZeDB9e+SfRkG08/7mSu3bZfgOjYlzzRCkfSLygdqmKsfTEMlOhQnDSanGe/wqhiV7Zj+qY7tM6PPD3ucG4f5ytckYVTcXoWHdhvVQcEQicJsKdZOESHP61ZWeThewpHPhb8T5YC8V2iW5iUv7m6Ka1I2sQ5aoXBZQvK5l8jsWCkZOhC0= ceph-7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:25.388 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-09-19T04:22:25.637 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:26.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.363+0000 7f082b482640 1 -- 172.21.15.70:0/530218611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 msgr2=0x7f0824100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:26.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.363+0000 7f082b482640 1 --2- 172.21.15.70:0/530218611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 0x7f0824100940 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f0820009880 tx=0x7f082002a5d0 comp rx=0 tx=0).stop 2024-09-19T04:22:26.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.363+0000 7f082b482640 1 -- 172.21.15.70:0/530218611 shutdown_connections 2024-09-19T04:22:26.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.363+0000 7f082b482640 1 --2- 172.21.15.70:0/530218611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 0x7f0824100940 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:26.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.363+0000 7f082b482640 1 -- 172.21.15.70:0/530218611 >> 172.21.15.70:0/530218611 conn(0x7f08240fbcd0 msgr2=0x7f08240fe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:26.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.363+0000 7f082b482640 1 -- 172.21.15.70:0/530218611 shutdown_connections 2024-09-19T04:22:26.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.363+0000 7f082b482640 1 -- 172.21.15.70:0/530218611 wait complete. 2024-09-19T04:22:26.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.364+0000 7f082b482640 1 Processor -- start 2024-09-19T04:22:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.364+0000 7f082b482640 1 -- start start 2024-09-19T04:22:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.364+0000 7f082b482640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 0x7f082419d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.364+0000 7f082b482640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f08241065f0 con 0x7f0824100540 2024-09-19T04:22:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f082921e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 0x7f082419d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f082921e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 0x7f082419d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56462/0 (socket says 172.21.15.70:56462) 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f082921e640 1 -- 172.21.15.70:0/1284216889 learned_addr learned my addr 172.21.15.70:0/1284216889 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f082921e640 1 -- 172.21.15.70:0/1284216889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f082419d8d0 con 0x7f0824100540 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f082921e640 1 --2- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 0x7f082419d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0820000c00 tx=0x7f08200048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f081a7fc640 1 -- 172.21.15.70:0/1284216889 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f082003f070 con 0x7f0824100540 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f082419db60 con 0x7f0824100540 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f081a7fc640 1 -- 172.21.15.70:0/1284216889 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0820004d10 con 0x7f0824100540 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f081a7fc640 1 -- 172.21.15.70:0/1284216889 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0820035030 con 0x7f0824100540 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.365+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08241a0850 con 0x7f0824100540 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.366+0000 7f081a7fc640 1 -- 172.21.15.70:0/1284216889 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0820042070 con 0x7f0824100540 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.366+0000 7f081a7fc640 1 --2- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08100392a0 0x7f081003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.366+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0824106d70 con 0x7f0824100540 2024-09-19T04:22:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.366+0000 7f081a7fc640 1 -- 172.21.15.70:0/1284216889 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f082006d0e0 con 0x7f0824100540 2024-09-19T04:22:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.366+0000 7f0828a1d640 1 --2- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08100392a0 0x7f081003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.367+0000 7f0828a1d640 1 --2- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08100392a0 0x7f081003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f08140098c0 tx=0x7f0814006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.371+0000 7f081a7fc640 1 -- 172.21.15.70:0/1284216889 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0820042360 con 0x7f0824100540 2024-09-19T04:22:26.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.540+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f08241009c0 con 0x7f0824100540 2024-09-19T04:22:26.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.543+0000 7f081a7fc640 1 -- 172.21.15.70:0/1284216889 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f08241009c0 con 0x7f0824100540 2024-09-19T04:22:26.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08100392a0 msgr2=0x7f081003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:26.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 --2- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08100392a0 0x7f081003b760 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f08140098c0 tx=0x7f0814006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:26.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 msgr2=0x7f082419d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:26.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 --2- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 0x7f082419d390 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f0820000c00 tx=0x7f08200048f0 comp rx=0 tx=0).stop 2024-09-19T04:22:26.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 shutdown_connections 2024-09-19T04:22:26.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 --2- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08100392a0 0x7f081003b760 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:26.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 --2- 172.21.15.70:0/1284216889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0824100540 0x7f082419d390 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:26.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 >> 172.21.15.70:0/1284216889 conn(0x7f08240fbcd0 msgr2=0x7f08240fc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:26.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 shutdown_connections 2024-09-19T04:22:26.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:26.545+0000 7f082b482640 1 -- 172.21.15.70:0/1284216889 wait complete. 2024-09-19T04:22:27.433 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-09-19T04:22:27.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-09-19T04:22:27.675 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:27.789 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:27 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1284216889' entity='client.admin' 2024-09-19T04:22:27.789 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:27 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:27.789 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:27 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:27.789 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:27 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi070", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:22:27.790 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:27 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:27.790 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:27 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:27.790 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:27 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:28.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.090+0000 7f10fd502640 1 -- 172.21.15.70:0/1179277920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 msgr2=0x7f10f8103010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.090+0000 7f10fd502640 1 --2- 172.21.15.70:0/1179277920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 0x7f10f8103010 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f10ec009880 tx=0x7f10ec02a5d0 comp rx=0 tx=0).stop 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.090+0000 7f10fd502640 1 -- 172.21.15.70:0/1179277920 shutdown_connections 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.090+0000 7f10fd502640 1 --2- 172.21.15.70:0/1179277920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 0x7f10f8103010 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.090+0000 7f10fd502640 1 -- 172.21.15.70:0/1179277920 >> 172.21.15.70:0/1179277920 conn(0x7f10f80fb400 msgr2=0x7f10f80fd860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.090+0000 7f10fd502640 1 -- 172.21.15.70:0/1179277920 shutdown_connections 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.090+0000 7f10fd502640 1 -- 172.21.15.70:0/1179277920 wait complete. 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.091+0000 7f10fd502640 1 Processor -- start 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.091+0000 7f10fd502640 1 -- start start 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.091+0000 7f10fd502640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 0x7f10f8196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.091+0000 7f10fd502640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f10f8107710 con 0x7f10f8102c10 2024-09-19T04:22:28.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.091+0000 7f10f6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 0x7f10f8196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:28.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.091+0000 7f10f6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 0x7f10f8196d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56494/0 (socket says 172.21.15.70:56494) 2024-09-19T04:22:28.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.091+0000 7f10f6ffd640 1 -- 172.21.15.70:0/2026114952 learned_addr learned my addr 172.21.15.70:0/2026114952 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:28.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.092+0000 7f10f6ffd640 1 -- 172.21.15.70:0/2026114952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10f81972d0 con 0x7f10f8102c10 2024-09-19T04:22:28.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.092+0000 7f10f6ffd640 1 --2- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 0x7f10f8196d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005940 tx=0x7f10ec0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:28.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.092+0000 7f10dffff640 1 -- 172.21.15.70:0/2026114952 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10ec03f070 con 0x7f10f8102c10 2024-09-19T04:22:28.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.092+0000 7f10dffff640 1 -- 172.21.15.70:0/2026114952 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f10ec004d10 con 0x7f10f8102c10 2024-09-19T04:22:28.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.092+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10f8197560 con 0x7f10f8102c10 2024-09-19T04:22:28.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.092+0000 7f10dffff640 1 -- 172.21.15.70:0/2026114952 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f10ec035030 con 0x7f10f8102c10 2024-09-19T04:22:28.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.092+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10f819a210 con 0x7f10f8102c10 2024-09-19T04:22:28.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.093+0000 7f10dffff640 1 -- 172.21.15.70:0/2026114952 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f10ec042070 con 0x7f10f8102c10 2024-09-19T04:22:28.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.093+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f10f8107e90 con 0x7f10f8102c10 2024-09-19T04:22:28.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.093+0000 7f10dffff640 1 --2- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f10e0039300 0x7f10e003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:28.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.093+0000 7f10dffff640 1 -- 172.21.15.70:0/2026114952 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f10ec06d0a0 con 0x7f10f8102c10 2024-09-19T04:22:28.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.093+0000 7f10f67fc640 1 --2- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f10e0039300 0x7f10e003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:28.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.094+0000 7f10f67fc640 1 --2- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f10e0039300 0x7f10e003b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098c0 tx=0x7f10e8006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:28.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.098+0000 7f10dffff640 1 -- 172.21.15.70:0/2026114952 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f10ec04c350 con 0x7f10f8102c10 2024-09-19T04:22:28.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.270+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f10f802d8a0 con 0x7f10e0039300 2024-09-19T04:22:28.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.273+0000 7f10dffff640 1 -- 172.21.15.70:0/2026114952 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f10f802d8a0 con 0x7f10e0039300 2024-09-19T04:22:28.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f10e0039300 msgr2=0x7f10e003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:28.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 --2- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f10e0039300 0x7f10e003b7c0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f10e80098c0 tx=0x7f10e8006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 msgr2=0x7f10f8196d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 --2- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 0x7f10f8196d90 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f10ec005940 tx=0x7f10ec0048f0 comp rx=0 tx=0).stop 2024-09-19T04:22:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 shutdown_connections 2024-09-19T04:22:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 --2- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f10e0039300 0x7f10e003b7c0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 --2- 172.21.15.70:0/2026114952 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f10f8102c10 0x7f10f8196d90 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 >> 172.21.15.70:0/2026114952 conn(0x7f10f80fb400 msgr2=0x7f10f80fbec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 shutdown_connections 2024-09-19T04:22:28.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:28.276+0000 7f10fd502640 1 -- 172.21.15.70:0/2026114952 wait complete. 2024-09-19T04:22:28.994 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-09-19T04:22:28.995 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:22:28.995 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-09-19T04:22:29.014 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:22:29.014 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:22:29.073 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-09-19T04:22:29.073 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch host add smithi134 2024-09-19T04:22:29.317 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:29.531 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: from='client.14170 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:29.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:29.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.731+0000 7f98aa18e640 1 -- 172.21.15.70:0/2130195820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 msgr2=0x7f98a4106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:29.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.731+0000 7f98aa18e640 1 --2- 172.21.15.70:0/2130195820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 0x7f98a4106940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f9894009c20 tx=0x7f989402aa90 comp rx=0 tx=0).stop 2024-09-19T04:22:29.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.731+0000 7f98aa18e640 1 -- 172.21.15.70:0/2130195820 shutdown_connections 2024-09-19T04:22:29.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.731+0000 7f98aa18e640 1 --2- 172.21.15.70:0/2130195820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 0x7f98a4106940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:29.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.731+0000 7f98aa18e640 1 -- 172.21.15.70:0/2130195820 >> 172.21.15.70:0/2130195820 conn(0x7f98a40fc1b0 msgr2=0x7f98a40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:29.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.731+0000 7f98aa18e640 1 -- 172.21.15.70:0/2130195820 shutdown_connections 2024-09-19T04:22:29.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.731+0000 7f98aa18e640 1 -- 172.21.15.70:0/2130195820 wait complete. 2024-09-19T04:22:29.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.732+0000 7f98aa18e640 1 Processor -- start 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.732+0000 7f98aa18e640 1 -- start start 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.732+0000 7f98aa18e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 0x7f98a4196020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.732+0000 7f98aa18e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f98a410ab80 con 0x7f98a4106560 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.732+0000 7f98a37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 0x7f98a4196020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.732+0000 7f98a37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 0x7f98a4196020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56508/0 (socket says 172.21.15.70:56508) 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.732+0000 7f98a37fe640 1 -- 172.21.15.70:0/1332246793 learned_addr learned my addr 172.21.15.70:0/1332246793 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.733+0000 7f98a37fe640 1 -- 172.21.15.70:0/1332246793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98a4196560 con 0x7f98a4106560 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.733+0000 7f98a37fe640 1 --2- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 0x7f98a4196020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9894005e30 tx=0x7f9894030ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.733+0000 7f98a0ff9640 1 -- 172.21.15.70:0/1332246793 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9894047070 con 0x7f98a4106560 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.733+0000 7f98a0ff9640 1 -- 172.21.15.70:0/1332246793 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f989402e890 con 0x7f98a4106560 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.733+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98a41967f0 con 0x7f98a4106560 2024-09-19T04:22:29.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.733+0000 7f98a0ff9640 1 -- 172.21.15.70:0/1332246793 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9894033050 con 0x7f98a4106560 2024-09-19T04:22:29.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.733+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98a419a8f0 con 0x7f98a4106560 2024-09-19T04:22:29.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.734+0000 7f98a0ff9640 1 -- 172.21.15.70:0/1332246793 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f989404a070 con 0x7f98a4106560 2024-09-19T04:22:29.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.734+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98a4101bd0 con 0x7f98a4106560 2024-09-19T04:22:29.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.734+0000 7f98a0ff9640 1 --2- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f98900392a0 0x7f989003b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:29.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.734+0000 7f98a0ff9640 1 -- 172.21.15.70:0/1332246793 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f989403e030 con 0x7f98a4106560 2024-09-19T04:22:29.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.735+0000 7f98a2ffd640 1 --2- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f98900392a0 0x7f989003b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:29.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.735+0000 7f98a2ffd640 1 --2- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f98900392a0 0x7f989003b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f988c0098c0 tx=0x7f988c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:29.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.739+0000 7f98a0ff9640 1 -- 172.21.15.70:0/1332246793 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9894040370 con 0x7f98a4106560 2024-09-19T04:22:29.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:29.910+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}) -- 0x7f98a4197380 con 0x7f98900392a0 2024-09-19T04:22:30.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:30 smithi070 ceph-mon[30942]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:22:30.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:30 smithi070 ceph-mon[30942]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:22:31.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:31 smithi070 ceph-mon[30942]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:32 smithi070 ceph-mon[30942]: Deploying cephadm binary to smithi134 2024-09-19T04:22:33.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.056+0000 7f98a0ff9640 1 -- 172.21.15.70:0/1332246793 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f98a4197380 con 0x7f98900392a0 2024-09-19T04:22:33.058 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f98900392a0 msgr2=0x7f989003b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 --2- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f98900392a0 0x7f989003b760 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f988c0098c0 tx=0x7f988c006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 msgr2=0x7f98a4196020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 --2- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 0x7f98a4196020 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f9894005e30 tx=0x7f9894030ea0 comp rx=0 tx=0).stop 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 shutdown_connections 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 --2- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f98900392a0 0x7f989003b760 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 --2- 172.21.15.70:0/1332246793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f98a4106560 0x7f98a4196020 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 >> 172.21.15.70:0/1332246793 conn(0x7f98a40fc1b0 msgr2=0x7f98a40fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:33.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 shutdown_connections 2024-09-19T04:22:33.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:33.058+0000 7f98aa18e640 1 -- 172.21.15.70:0/1332246793 wait complete. 2024-09-19T04:22:33.632 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T04:22:33.871 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:34 smithi070 ceph-mon[30942]: Added host smithi134 2024-09-19T04:22:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:34.313 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.311+0000 7f04d1784640 1 -- 172.21.15.70:0/2797092439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 msgr2=0x7f04cc107a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.311+0000 7f04d1784640 1 --2- 172.21.15.70:0/2797092439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 0x7f04cc107a40 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f04bc009880 tx=0x7f04bc02a5d0 comp rx=0 tx=0).stop 2024-09-19T04:22:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.311+0000 7f04d1784640 1 -- 172.21.15.70:0/2797092439 shutdown_connections 2024-09-19T04:22:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.311+0000 7f04d1784640 1 --2- 172.21.15.70:0/2797092439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 0x7f04cc107a40 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.311+0000 7f04d1784640 1 -- 172.21.15.70:0/2797092439 >> 172.21.15.70:0/2797092439 conn(0x7f04cc0fd290 msgr2=0x7f04cc0ff6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:34.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.311+0000 7f04d1784640 1 -- 172.21.15.70:0/2797092439 shutdown_connections 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.311+0000 7f04d1784640 1 -- 172.21.15.70:0/2797092439 wait complete. 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.311+0000 7f04d1784640 1 Processor -- start 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.312+0000 7f04d1784640 1 -- start start 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.312+0000 7f04d1784640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 0x7f04cc197180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.312+0000 7f04d1784640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f04cc10bc80 con 0x7f04cc107660 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.312+0000 7f04caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 0x7f04cc197180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.312+0000 7f04caffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 0x7f04cc197180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54928/0 (socket says 172.21.15.70:54928) 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.312+0000 7f04caffd640 1 -- 172.21.15.70:0/2198664857 learned_addr learned my addr 172.21.15.70:0/2198664857 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.312+0000 7f04caffd640 1 -- 172.21.15.70:0/2198664857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04cc1976c0 con 0x7f04cc107660 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.312+0000 7f04caffd640 1 --2- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 0x7f04cc197180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0099a0 tx=0x7f04bc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.313+0000 7f04c3fff640 1 -- 172.21.15.70:0/2198664857 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04bc03f070 con 0x7f04cc107660 2024-09-19T04:22:34.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.313+0000 7f04c3fff640 1 -- 172.21.15.70:0/2198664857 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f04bc003ac0 con 0x7f04cc107660 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.313+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04cc197950 con 0x7f04cc107660 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.313+0000 7f04c3fff640 1 -- 172.21.15.70:0/2198664857 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04bc035030 con 0x7f04cc107660 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.313+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04cc197db0 con 0x7f04cc107660 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.313+0000 7f04c3fff640 1 -- 172.21.15.70:0/2198664857 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f04bc042070 con 0x7f04cc107660 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.314+0000 7f04c3fff640 1 --2- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f04b80392a0 0x7f04b803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.314+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f04cc102cd0 con 0x7f04cc107660 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.314+0000 7f04c3fff640 1 -- 172.21.15.70:0/2198664857 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f04bc06d0b0 con 0x7f04cc107660 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.314+0000 7f04ca7fc640 1 --2- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f04b80392a0 0x7f04b803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.314+0000 7f04ca7fc640 1 --2- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f04b80392a0 0x7f04b803b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f04b40098c0 tx=0x7f04b4006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:34.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.319+0000 7f04c3fff640 1 -- 172.21.15.70:0/2198664857 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04bc0307a0 con 0x7f04cc107660 2024-09-19T04:22:34.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.491+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f04cc198540 con 0x7f04b80392a0 2024-09-19T04:22:34.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.492+0000 7f04c3fff640 1 -- 172.21.15.70:0/2198664857 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+160 (secure 0 0 0) 0x7f04cc198540 con 0x7f04b80392a0 2024-09-19T04:22:34.493 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:34.493 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-09-19T04:22:34.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f04b80392a0 msgr2=0x7f04b803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 --2- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f04b80392a0 0x7f04b803b760 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f04b40098c0 tx=0x7f04b4006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 msgr2=0x7f04cc197180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 --2- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 0x7f04cc197180 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f04bc0099a0 tx=0x7f04bc0048f0 comp rx=0 tx=0).stop 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 shutdown_connections 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 --2- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f04b80392a0 0x7f04b803b760 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 --2- 172.21.15.70:0/2198664857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f04cc107660 0x7f04cc197180 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 >> 172.21.15.70:0/2198664857 conn(0x7f04cc0fd290 msgr2=0x7f04cc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 shutdown_connections 2024-09-19T04:22:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:34.494+0000 7f04d1784640 1 -- 172.21.15.70:0/2198664857 wait complete. 2024-09-19T04:22:35.057 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi167 2024-09-19T04:22:35.057 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:22:35.057 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.conf 2024-09-19T04:22:35.078 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:22:35.079 DEBUG:teuthology.orchestra.run.smithi167:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:22:35.136 INFO:tasks.cephadm:Adding host smithi167 to orchestrator... 2024-09-19T04:22:35.136 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch host add smithi167 2024-09-19T04:22:35.377 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:35.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:35 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:35.705 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:35 smithi070 ceph-mon[30942]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:22:35.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.783+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/1283775367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 msgr2=0x7f2a08107a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.783+0000 7f2a0f0a6640 1 --2- 172.21.15.70:0/1283775367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 0x7f2a08107a30 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f29fc009880 tx=0x7f29fc02a5d0 comp rx=0 tx=0).stop 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.783+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/1283775367 shutdown_connections 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.783+0000 7f2a0f0a6640 1 --2- 172.21.15.70:0/1283775367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 0x7f2a08107a30 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.783+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/1283775367 >> 172.21.15.70:0/1283775367 conn(0x7f2a080fd260 msgr2=0x7f2a080ff680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.783+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/1283775367 shutdown_connections 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.783+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/1283775367 wait complete. 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.784+0000 7f2a0f0a6640 1 Processor -- start 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.784+0000 7f2a0f0a6640 1 -- start start 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.784+0000 7f2a0f0a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 0x7f2a08199380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.784+0000 7f2a0f0a6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a0810bc70 con 0x7f2a08107650 2024-09-19T04:22:35.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.784+0000 7f2a0ce42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 0x7f2a08199380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.784+0000 7f2a0ce42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 0x7f2a08199380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54936/0 (socket says 172.21.15.70:54936) 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.784+0000 7f2a0ce42640 1 -- 172.21.15.70:0/637526453 learned_addr learned my addr 172.21.15.70:0/637526453 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.785+0000 7f2a0ce42640 1 -- 172.21.15.70:0/637526453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a081998c0 con 0x7f2a08107650 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.785+0000 7f2a0ce42640 1 --2- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 0x7f2a08199380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0099a0 tx=0x7f29fc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.785+0000 7f2a05ffb640 1 -- 172.21.15.70:0/637526453 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc03f070 con 0x7f2a08107650 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.785+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a08199b50 con 0x7f2a08107650 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.785+0000 7f2a05ffb640 1 -- 172.21.15.70:0/637526453 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f29fc003ac0 con 0x7f2a08107650 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.785+0000 7f2a05ffb640 1 -- 172.21.15.70:0/637526453 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f29fc035030 con 0x7f2a08107650 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.785+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a0819dc50 con 0x7f2a08107650 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.786+0000 7f2a05ffb640 1 -- 172.21.15.70:0/637526453 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f29fc042070 con 0x7f2a08107650 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.786+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a08102cc0 con 0x7f2a08107650 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.786+0000 7f2a05ffb640 1 --2- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f29f80392a0 0x7f29f803b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:35.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.786+0000 7f2a05ffb640 1 -- 172.21.15.70:0/637526453 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f29fc06d050 con 0x7f2a08107650 2024-09-19T04:22:35.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.786+0000 7f2a07fff640 1 --2- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f29f80392a0 0x7f29f803b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:35.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.787+0000 7f2a07fff640 1 --2- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f29f80392a0 0x7f29f803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29f40098c0 tx=0x7f29f4006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:35.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.791+0000 7f2a05ffb640 1 -- 172.21.15.70:0/637526453 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f29fc0307a0 con 0x7f2a08107650 2024-09-19T04:22:35.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:35.958+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}) -- 0x7f2a0819a6e0 con 0x7f29f80392a0 2024-09-19T04:22:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:36 smithi070 ceph-mon[30942]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi167", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: Deploying cephadm binary to smithi167 2024-09-19T04:22:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:22:38.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:38.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:22:38.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-19T04:22:38.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:38.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:38 smithi070 ceph-mon[30942]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:22:39.183 INFO:teuthology.orchestra.run.smithi070.stdout:Added host 'smithi167' with addr '172.21.15.167' 2024-09-19T04:22:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.180+0000 7f2a05ffb640 1 -- 172.21.15.70:0/637526453 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f2a0819a6e0 con 0x7f29f80392a0 2024-09-19T04:22:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f29f80392a0 msgr2=0x7f29f803b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 --2- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f29f80392a0 0x7f29f803b760 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f29f40098c0 tx=0x7f29f4006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:39.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 msgr2=0x7f2a08199380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 --2- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 0x7f2a08199380 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f29fc0099a0 tx=0x7f29fc0048f0 comp rx=0 tx=0).stop 2024-09-19T04:22:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 shutdown_connections 2024-09-19T04:22:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 --2- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f29f80392a0 0x7f29f803b760 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 --2- 172.21.15.70:0/637526453 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a08107650 0x7f2a08199380 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 >> 172.21.15.70:0/637526453 conn(0x7f2a080fd260 msgr2=0x7f2a08075e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 shutdown_connections 2024-09-19T04:22:39.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:39.182+0000 7f2a0f0a6640 1 -- 172.21.15.70:0/637526453 wait complete. 2024-09-19T04:22:39.550 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:39 smithi070 ceph-mon[30942]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:22:39.550 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:39.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:39.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:39.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:39.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:22:39.835 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch host ls --format=json 2024-09-19T04:22:40.072 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:40.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.473+0000 7f279a10f640 1 -- 172.21.15.70:0/512809433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 msgr2=0x7f2794102b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:40.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.473+0000 7f279a10f640 1 --2- 172.21.15.70:0/512809433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 0x7f2794102b30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f2784009880 tx=0x7f278402a670 comp rx=0 tx=0).stop 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.473+0000 7f279a10f640 1 -- 172.21.15.70:0/512809433 shutdown_connections 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.473+0000 7f279a10f640 1 --2- 172.21.15.70:0/512809433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 0x7f2794102b30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.473+0000 7f279a10f640 1 -- 172.21.15.70:0/512809433 >> 172.21.15.70:0/512809433 conn(0x7f27940fc1b0 msgr2=0x7f27940fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.473+0000 7f279a10f640 1 -- 172.21.15.70:0/512809433 shutdown_connections 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.473+0000 7f279a10f640 1 -- 172.21.15.70:0/512809433 wait complete. 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.474+0000 7f279a10f640 1 Processor -- start 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.474+0000 7f279a10f640 1 -- start start 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.474+0000 7f279a10f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 0x7f27941003b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.474+0000 7f279a10f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f279410bcb0 con 0x7f2794102750 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.474+0000 7f27937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 0x7f27941003b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:40.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.474+0000 7f27937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 0x7f27941003b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54950/0 (socket says 172.21.15.70:54950) 2024-09-19T04:22:40.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.474+0000 7f27937fe640 1 -- 172.21.15.70:0/2819614618 learned_addr learned my addr 172.21.15.70:0/2819614618 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:40.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.475+0000 7f27937fe640 1 -- 172.21.15.70:0/2819614618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27941022a0 con 0x7f2794102750 2024-09-19T04:22:40.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.475+0000 7f27937fe640 1 --2- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 0x7f27941003b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27840099a0 tx=0x7f27840048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:40.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.475+0000 7f27917fa640 1 -- 172.21.15.70:0/2819614618 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f278403f070 con 0x7f2794102750 2024-09-19T04:22:40.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.475+0000 7f27917fa640 1 -- 172.21.15.70:0/2819614618 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2784003ac0 con 0x7f2794102750 2024-09-19T04:22:40.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.475+0000 7f27917fa640 1 -- 172.21.15.70:0/2819614618 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2784035030 con 0x7f2794102750 2024-09-19T04:22:40.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.475+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27941008f0 con 0x7f2794102750 2024-09-19T04:22:40.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.475+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2794100db0 con 0x7f2794102750 2024-09-19T04:22:40.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.476+0000 7f27917fa640 1 -- 172.21.15.70:0/2819614618 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f2784042070 con 0x7f2794102750 2024-09-19T04:22:40.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.476+0000 7f27917fa640 1 --2- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2780039300 0x7f278003b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:40.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.476+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f279406a7b0 con 0x7f2794102750 2024-09-19T04:22:40.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.476+0000 7f27917fa640 1 -- 172.21.15.70:0/2819614618 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f278406cfd0 con 0x7f2794102750 2024-09-19T04:22:40.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.476+0000 7f278bfff640 1 --2- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2780039300 0x7f278003b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:40.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.477+0000 7f278bfff640 1 --2- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2780039300 0x7f278003b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f277c0098c0 tx=0x7f277c006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:40.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.481+0000 7f27917fa640 1 -- 172.21.15.70:0/2819614618 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2784003ce0 con 0x7f2794102750 2024-09-19T04:22:40.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.651+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f27941018e0 con 0x7f2780039300 2024-09-19T04:22:40.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.652+0000 7f27917fa640 1 -- 172.21.15.70:0/2819614618 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+240 (secure 0 0 0) 0x7f27941018e0 con 0x7f2780039300 2024-09-19T04:22:40.654 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:22:40.654 INFO:teuthology.orchestra.run.smithi070.stdout:[{"addr": "172.21.15.70", "hostname": "smithi070", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}, {"addr": "172.21.15.167", "hostname": "smithi167", "labels": [], "status": ""}] 2024-09-19T04:22:40.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.654+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2780039300 msgr2=0x7f278003b7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:40.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.654+0000 7f279a10f640 1 --2- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2780039300 0x7f278003b7c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f277c0098c0 tx=0x7f277c006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:40.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.654+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 msgr2=0x7f27941003b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:40.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.654+0000 7f279a10f640 1 --2- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 0x7f27941003b0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f27840099a0 tx=0x7f27840048f0 comp rx=0 tx=0).stop 2024-09-19T04:22:40.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.654+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 shutdown_connections 2024-09-19T04:22:40.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.654+0000 7f279a10f640 1 --2- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2780039300 0x7f278003b7c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:40.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.654+0000 7f279a10f640 1 --2- 172.21.15.70:0/2819614618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2794102750 0x7f27941003b0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:40.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.654+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 >> 172.21.15.70:0/2819614618 conn(0x7f27940fc1b0 msgr2=0x7f27941034e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:40.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.655+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 shutdown_connections 2024-09-19T04:22:40.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:40.655+0000 7f279a10f640 1 -- 172.21.15.70:0/2819614618 wait complete. 2024-09-19T04:22:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:40 smithi070 ceph-mon[30942]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:22:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:40 smithi070 ceph-mon[30942]: Added host smithi167 2024-09-19T04:22:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:40 smithi070 ceph-mon[30942]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:41.261 INFO:tasks.cephadm:Setting crush tunables to default 2024-09-19T04:22:41.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd crush tunables default 2024-09-19T04:22:41.499 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:22:41.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:41 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:41.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:41 smithi070 ceph-mon[30942]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:22:41.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:41 smithi070 ceph-mon[30942]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:41.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.929+0000 7f4467ad9640 1 -- 172.21.15.70:0/491821070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 msgr2=0x7f4460106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:41.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.929+0000 7f4467ad9640 1 --2- 172.21.15.70:0/491821070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 0x7f4460106940 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f445c009880 tx=0x7f445c02a5d0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.929+0000 7f4467ad9640 1 -- 172.21.15.70:0/491821070 shutdown_connections 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.929+0000 7f4467ad9640 1 --2- 172.21.15.70:0/491821070 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 0x7f4460106940 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.929+0000 7f4467ad9640 1 -- 172.21.15.70:0/491821070 >> 172.21.15.70:0/491821070 conn(0x7f44600fc1b0 msgr2=0x7f44600fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.929+0000 7f4467ad9640 1 -- 172.21.15.70:0/491821070 shutdown_connections 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.929+0000 7f4467ad9640 1 -- 172.21.15.70:0/491821070 wait complete. 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4467ad9640 1 Processor -- start 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4467ad9640 1 -- start start 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4467ad9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 0x7f4460197150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4467ad9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f446010ab80 con 0x7f4460106560 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4465875640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 0x7f4460197150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4465875640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 0x7f4460197150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54978/0 (socket says 172.21.15.70:54978) 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4465875640 1 -- 172.21.15.70:0/4230740272 learned_addr learned my addr 172.21.15.70:0/4230740272 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4465875640 1 -- 172.21.15.70:0/4230740272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4460197690 con 0x7f4460106560 2024-09-19T04:22:41.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4465875640 1 --2- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 0x7f4460197150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f445c0099a0 tx=0x7f445c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4456ffd640 1 -- 172.21.15.70:0/4230740272 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f445c03f070 con 0x7f4460106560 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4456ffd640 1 -- 172.21.15.70:0/4230740272 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f445c003ac0 con 0x7f4460106560 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4456ffd640 1 -- 172.21.15.70:0/4230740272 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f445c035030 con 0x7f4460106560 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.930+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4460197920 con 0x7f4460106560 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.931+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f446019ba20 con 0x7f4460106560 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.931+0000 7f4456ffd640 1 -- 172.21.15.70:0/4230740272 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f445c042070 con 0x7f4460106560 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.932+0000 7f4456ffd640 1 --2- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f444c0392a0 0x7f444c03b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.932+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4460101bd0 con 0x7f4460106560 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.932+0000 7f4456ffd640 1 -- 172.21.15.70:0/4230740272 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f445c06cfd0 con 0x7f4460106560 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.932+0000 7f4465074640 1 --2- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f444c0392a0 0x7f444c03b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.932+0000 7f4465074640 1 --2- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f444c0392a0 0x7f444c03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44500098c0 tx=0x7f4450006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:41.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:41.936+0000 7f4456ffd640 1 -- 172.21.15.70:0/4230740272 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f445c069ec0 con 0x7f4460106560 2024-09-19T04:22:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.110+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f44601984b0 con 0x7f4460106560 2024-09-19T04:22:42.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.532+0000 7f4456ffd640 1 -- 172.21.15.70:0/4230740272 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f445c039350 con 0x7f4460106560 2024-09-19T04:22:42.534 INFO:teuthology.orchestra.run.smithi070.stderr:adjusted tunables profile to default 2024-09-19T04:22:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f444c0392a0 msgr2=0x7f444c03b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 --2- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f444c0392a0 0x7f444c03b760 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f44500098c0 tx=0x7f4450006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 msgr2=0x7f4460197150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 --2- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 0x7f4460197150 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f445c0099a0 tx=0x7f445c0048f0 comp rx=0 tx=0).stop 2024-09-19T04:22:42.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 shutdown_connections 2024-09-19T04:22:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 --2- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f444c0392a0 0x7f444c03b760 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 --2- 172.21.15.70:0/4230740272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4460106560 0x7f4460197150 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 >> 172.21.15.70:0/4230740272 conn(0x7f44600fc1b0 msgr2=0x7f4460069ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 shutdown_connections 2024-09-19T04:22:42.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:22:42.534+0000 7f4467ad9640 1 -- 172.21.15.70:0/4230740272 wait complete. 2024-09-19T04:22:42.829 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:42 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4230740272' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T04:22:43.128 INFO:tasks.cephadm:Adding mon.a on smithi070 2024-09-19T04:22:43.128 INFO:tasks.cephadm:Adding mon.b on smithi134 2024-09-19T04:22:43.129 INFO:tasks.cephadm:Adding mon.c on smithi167 2024-09-19T04:22:43.129 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch apply mon '3;smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c' 2024-09-19T04:22:43.377 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T04:22:43.422 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /etc/ceph/ceph.conf 2024-09-19T04:22:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4230740272' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:22:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:22:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:22:43.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:43.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:22:43.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:22:43.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:43 smithi070 ceph-mon[30942]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:43.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.927+0000 7f956cb3c640 1 -- 172.21.15.167:0/3241892847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 msgr2=0x7f95680ffd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:43.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.927+0000 7f956cb3c640 1 --2- 172.21.15.167:0/3241892847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 0x7f95680ffd20 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f9558009880 tx=0x7f955802a5d0 comp rx=0 tx=0).stop 2024-09-19T04:22:43.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.927+0000 7f956cb3c640 1 -- 172.21.15.167:0/3241892847 shutdown_connections 2024-09-19T04:22:43.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.927+0000 7f956cb3c640 1 --2- 172.21.15.167:0/3241892847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 0x7f95680ffd20 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:43.942 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.927+0000 7f956cb3c640 1 -- 172.21.15.167:0/3241892847 >> 172.21.15.167:0/3241892847 conn(0x7f95680fb450 msgr2=0x7f95680fd890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.927+0000 7f956cb3c640 1 -- 172.21.15.167:0/3241892847 shutdown_connections 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.927+0000 7f956cb3c640 1 -- 172.21.15.167:0/3241892847 wait complete. 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.928+0000 7f956cb3c640 1 Processor -- start 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.928+0000 7f956cb3c640 1 -- start start 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.928+0000 7f956cb3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 0x7f9568196d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.928+0000 7f956cb3c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9568107670 con 0x7f95680ff920 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.928+0000 7f956659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 0x7f9568196d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f956659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 0x7f9568196d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.167:36138/0 (socket says 172.21.15.167:36138) 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f956659c640 1 -- 172.21.15.167:0/1959348176 learned_addr learned my addr 172.21.15.167:0/1959348176 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f956659c640 1 -- 172.21.15.167:0/1959348176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9568197280 con 0x7f95680ff920 2024-09-19T04:22:43.943 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f956659c640 1 --2- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 0x7f9568196d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9558005940 tx=0x7f95580048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f955f7fe640 1 -- 172.21.15.167:0/1959348176 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f955803f070 con 0x7f95680ff920 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f955f7fe640 1 -- 172.21.15.167:0/1959348176 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9558004d10 con 0x7f95680ff920 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f955f7fe640 1 -- 172.21.15.167:0/1959348176 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9558035030 con 0x7f95680ff920 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9568197570 con 0x7f95680ff920 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.929+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f956819a200 con 0x7f95680ff920 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.930+0000 7f955f7fe640 1 -- 172.21.15.167:0/1959348176 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f9558042070 con 0x7f95680ff920 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.930+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9568107df0 con 0x7f95680ff920 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.931+0000 7f955f7fe640 1 --2- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f95540392a0 0x7f955403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.931+0000 7f955f7fe640 1 -- 172.21.15.167:0/1959348176 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f955806d100 con 0x7f95680ff920 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.931+0000 7f955ffff640 1 --2- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f95540392a0 0x7f955403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.931+0000 7f955ffff640 1 --2- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f95540392a0 0x7f955403b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f95500098c0 tx=0x7f9550006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:43.944 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:43.935+0000 7f955f7fe640 1 -- 172.21.15.167:0/1959348176 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9558042360 con 0x7f95680ff920 2024-09-19T04:22:44.137 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.136+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}) -- 0x7f956802da70 con 0x7f95540392a0 2024-09-19T04:22:44.142 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.142+0000 7f955f7fe640 1 -- 172.21.15.167:0/1959348176 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f956802da70 con 0x7f95540392a0 2024-09-19T04:22:44.143 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mon update... 2024-09-19T04:22:44.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f95540392a0 msgr2=0x7f955403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:44.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 --2- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f95540392a0 0x7f955403b760 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f95500098c0 tx=0x7f9550006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:44.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 msgr2=0x7f9568196d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:44.145 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 --2- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 0x7f9568196d40 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f9558005940 tx=0x7f95580048f0 comp rx=0 tx=0).stop 2024-09-19T04:22:44.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 shutdown_connections 2024-09-19T04:22:44.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 --2- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f95540392a0 0x7f955403b760 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:44.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 --2- 172.21.15.167:0/1959348176 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95680ff920 0x7f9568196d40 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:44.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 >> 172.21.15.167:0/1959348176 conn(0x7f95680fb450 msgr2=0x7f95680fbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:44.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 shutdown_connections 2024-09-19T04:22:44.146 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:44.144+0000 7f956cb3c640 1 -- 172.21.15.167:0/1959348176 wait complete. 2024-09-19T04:22:44.748 DEBUG:teuthology.orchestra.run.smithi134:mon.b> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.b.service 2024-09-19T04:22:44.751 DEBUG:teuthology.orchestra.run.smithi167:mon.c> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.c.service 2024-09-19T04:22:44.753 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:22:44.753 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:22:45.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:22:45.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:22:45.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:22:45.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:45.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c;count:3 2024-09-19T04:22:45.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:45.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:45.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:45.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:45.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:22:45.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:45.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:45 smithi070 ceph-mon[30942]: Deploying daemon mon.c on smithi167 2024-09-19T04:22:46.342 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:22:46.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:46 smithi070 ceph-mon[30942]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.331+0000 7f3bf08d6640 1 -- 172.21.15.167:0/4095379529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 msgr2=0x7f3bec102b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.331+0000 7f3bf08d6640 1 --2- 172.21.15.167:0/4095379529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 0x7f3bec102b50 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc009880 tx=0x7f3bdc02a670 comp rx=0 tx=0).stop 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.331+0000 7f3bf08d6640 1 -- 172.21.15.167:0/4095379529 shutdown_connections 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.331+0000 7f3bf08d6640 1 --2- 172.21.15.167:0/4095379529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 0x7f3bec102b50 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.331+0000 7f3bf08d6640 1 -- 172.21.15.167:0/4095379529 >> 172.21.15.167:0/4095379529 conn(0x7f3bec0fc190 msgr2=0x7f3bec0fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.331+0000 7f3bf08d6640 1 -- 172.21.15.167:0/4095379529 shutdown_connections 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.331+0000 7f3bf08d6640 1 -- 172.21.15.167:0/4095379529 wait complete. 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.332+0000 7f3bf08d6640 1 Processor -- start 2024-09-19T04:22:47.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.332+0000 7f3bf08d6640 1 -- start start 2024-09-19T04:22:47.334 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.332+0000 7f3bf08d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 0x7f3bec1971a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.332+0000 7f3bf08d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3bec10bcd0 con 0x7f3bec102770 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.332+0000 7f3bea59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 0x7f3bec1971a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.332+0000 7f3bea59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 0x7f3bec1971a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.167:36154/0 (socket says 172.21.15.167:36154) 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.332+0000 7f3bea59c640 1 -- 172.21.15.167:0/3218148433 learned_addr learned my addr 172.21.15.167:0/3218148433 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.333+0000 7f3bea59c640 1 -- 172.21.15.167:0/3218148433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bec1976e0 con 0x7f3bec102770 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.333+0000 7f3bea59c640 1 --2- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 0x7f3bec1971a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0099a0 tx=0x7f3bdc0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.333+0000 7f3bdb7fe640 1 -- 172.21.15.167:0/3218148433 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bdc03f070 con 0x7f3bec102770 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.333+0000 7f3bdb7fe640 1 -- 172.21.15.167:0/3218148433 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3bdc003ac0 con 0x7f3bec102770 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.333+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bec197970 con 0x7f3bec102770 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.333+0000 7f3bdb7fe640 1 -- 172.21.15.167:0/3218148433 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3bdc035030 con 0x7f3bec102770 2024-09-19T04:22:47.335 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.333+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bec197dd0 con 0x7f3bec102770 2024-09-19T04:22:47.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.334+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3bec06a7b0 con 0x7f3bec102770 2024-09-19T04:22:47.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.334+0000 7f3bdb7fe640 1 -- 172.21.15.167:0/3218148433 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f3bdc042070 con 0x7f3bec102770 2024-09-19T04:22:47.336 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.335+0000 7f3bdb7fe640 1 --2- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3bd40392a0 0x7f3bd403b760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:47.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.335+0000 7f3bdb7fe640 1 -- 172.21.15.167:0/3218148433 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f3bdc06d090 con 0x7f3bec102770 2024-09-19T04:22:47.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.335+0000 7f3be9d9b640 1 --2- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3bd40392a0 0x7f3bd403b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:47.337 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.335+0000 7f3be9d9b640 1 --2- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3bd40392a0 0x7f3bd403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3be00098c0 tx=0x7f3be0006db0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:47.341 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.340+0000 7f3bdb7fe640 1 -- 172.21.15.167:0/3218148433 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3bdc039350 con 0x7f3bec102770 2024-09-19T04:22:47.593 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.591+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f3bec198560 con 0x7f3bec102770 2024-09-19T04:22:47.594 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.592+0000 7f3bdb7fe640 1 -- 172.21.15.167:0/3218148433 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+745 (secure 0 0 0) 0x7f3bdc003ce0 con 0x7f3bec102770 2024-09-19T04:22:47.594 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:22:47.594 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":1,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","modified":"2024-09-19T04:21:26.544673Z","created":"2024-09-19T04:21:26.544673Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-09-19T04:22:47.594 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 1 2024-09-19T04:22:47.596 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3bd40392a0 msgr2=0x7f3bd403b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 --2- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3bd40392a0 0x7f3bd403b760 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f3be00098c0 tx=0x7f3be0006db0 comp rx=0 tx=0).stop 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 msgr2=0x7f3bec1971a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 --2- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 0x7f3bec1971a0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc0099a0 tx=0x7f3bdc0048f0 comp rx=0 tx=0).stop 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 shutdown_connections 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 --2- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3bd40392a0 0x7f3bd403b760 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 --2- 172.21.15.167:0/3218148433 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bec102770 0x7f3bec1971a0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 >> 172.21.15.167:0/3218148433 conn(0x7f3bec0fc190 msgr2=0x7f3bec103500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 shutdown_connections 2024-09-19T04:22:47.597 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:47.595+0000 7f3bf08d6640 1 -- 172.21.15.167:0/3218148433 wait complete. 2024-09-19T04:22:47.919 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:47 smithi167 systemd[1]: Starting Ceph mon.c for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:22:48.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:48 smithi070 ceph-mon[30942]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:48.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:48 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/3218148433' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:48.695 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 podman[34320]: 2024-09-19 04:22:48.443681036 +0000 UTC m=+0.109961678 container create a37b07fe580fd7f06ac50394c8868cdf5b0ea97188c7f19974b744bc34c99ce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-c, GIT_CLEAN=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:22:48.695 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 podman[34320]: 2024-09-19 04:22:48.350019024 +0000 UTC m=+0.016299666 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:22:48.695 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 podman[34320]: 2024-09-19 04:22:48.66286201 +0000 UTC m=+0.329142653 container init a37b07fe580fd7f06ac50394c8868cdf5b0ea97188c7f19974b744bc34c99ce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True) 2024-09-19T04:22:48.695 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 podman[34320]: 2024-09-19 04:22:48.66625132 +0000 UTC m=+0.332531960 container start a37b07fe580fd7f06ac50394c8868cdf5b0ea97188c7f19974b744bc34c99ce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-c, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4) 2024-09-19T04:22:48.695 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T04:22:48.695 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T04:22:48.695 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: pidfile_write: ignore empty --pid-file 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: load: jerasure load: lrc 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: RocksDB version: 7.9.2 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Git sha 0 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: DB SUMMARY 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: DB Session ID: XF5CO275FVWZXDFU0HEK 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: CURRENT file: CURRENT 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-09-19T04:22:48.696 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.error_if_exists: 0 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.create_if_missing: 0 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.paranoid_checks: 1 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.env: 0x55c218df7940 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.info_log: 0x55c21add76e0 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.statistics: (nil) 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.use_fsync: 0 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_log_file_size: 0 2024-09-19T04:22:48.697 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.allow_fallocate: 1 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.use_direct_reads: 0 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.db_log_dir: 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.wal_dir: 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T04:22:48.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T04:22:48.699 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T04:22:48.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T04:22:48.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.write_buffer_manager: 0x55c21ade6dc0 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T04:22:48.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.unordered_write: 0 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.row_cache: None 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.wal_filter: None 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.two_write_queues: 0 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.wal_compression: 0 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.atomic_flush: 0 2024-09-19T04:22:48.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.log_readahead_size: 0 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_background_jobs: 2 2024-09-19T04:22:48.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_background_compactions: -1 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_subcompactions: 1 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_open_files: -1 2024-09-19T04:22:48.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T04:22:48.966 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T04:22:48.966 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T04:22:48.966 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T04:22:48.966 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_background_flushes: -1 2024-09-19T04:22:48.966 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Compression algorithms supported: 2024-09-19T04:22:48.967 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: kZSTD supported: 0 2024-09-19T04:22:48.967 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: kXpressCompression supported: 0 2024-09-19T04:22:48.967 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: kBZip2Compression supported: 0 2024-09-19T04:22:48.967 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T04:22:48.967 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: kLZ4Compression supported: 1 2024-09-19T04:22:48.967 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: kZlibCompression supported: 1 2024-09-19T04:22:48.968 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T04:22:48.968 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: kSnappyCompression supported: 1 2024-09-19T04:22:48.968 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T04:22:48.968 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T04:22:48.968 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-09-19T04:22:48.969 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T04:22:48.969 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T04:22:48.969 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.merge_operator: 2024-09-19T04:22:48.969 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_filter: None 2024-09-19T04:22:48.969 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T04:22:48.969 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T04:22:48.970 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T04:22:48.970 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T04:22:48.970 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55c21add7320) 2024-09-19T04:22:48.970 INFO:journalctl@ceph.mon.c.smithi167.stdout: cache_index_and_filter_blocks: 1 2024-09-19T04:22:48.970 INFO:journalctl@ceph.mon.c.smithi167.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T04:22:48.971 INFO:journalctl@ceph.mon.c.smithi167.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T04:22:48.971 INFO:journalctl@ceph.mon.c.smithi167.stdout: pin_top_level_index_and_filter: 1 2024-09-19T04:22:48.971 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_type: 0 2024-09-19T04:22:48.971 INFO:journalctl@ceph.mon.c.smithi167.stdout: data_block_index_type: 0 2024-09-19T04:22:48.971 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_shortening: 1 2024-09-19T04:22:48.971 INFO:journalctl@ceph.mon.c.smithi167.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T04:22:48.972 INFO:journalctl@ceph.mon.c.smithi167.stdout: checksum: 4 2024-09-19T04:22:48.972 INFO:journalctl@ceph.mon.c.smithi167.stdout: no_block_cache: 0 2024-09-19T04:22:48.972 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache: 0x55c21adcb1f0 2024-09-19T04:22:48.973 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_name: BinnedLRUCache 2024-09-19T04:22:48.973 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_options: 2024-09-19T04:22:48.973 INFO:journalctl@ceph.mon.c.smithi167.stdout: capacity : 536870912 2024-09-19T04:22:48.973 INFO:journalctl@ceph.mon.c.smithi167.stdout: num_shard_bits : 4 2024-09-19T04:22:48.973 INFO:journalctl@ceph.mon.c.smithi167.stdout: strict_capacity_limit : 0 2024-09-19T04:22:48.974 INFO:journalctl@ceph.mon.c.smithi167.stdout: high_pri_pool_ratio: 0.000 2024-09-19T04:22:48.974 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_cache_compressed: (nil) 2024-09-19T04:22:48.974 INFO:journalctl@ceph.mon.c.smithi167.stdout: persistent_cache: (nil) 2024-09-19T04:22:48.974 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_size: 4096 2024-09-19T04:22:48.974 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_size_deviation: 10 2024-09-19T04:22:48.974 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_restart_interval: 16 2024-09-19T04:22:48.975 INFO:journalctl@ceph.mon.c.smithi167.stdout: index_block_restart_interval: 1 2024-09-19T04:22:48.975 INFO:journalctl@ceph.mon.c.smithi167.stdout: metadata_block_size: 4096 2024-09-19T04:22:48.975 INFO:journalctl@ceph.mon.c.smithi167.stdout: partition_filters: 0 2024-09-19T04:22:48.975 INFO:journalctl@ceph.mon.c.smithi167.stdout: use_delta_encoding: 1 2024-09-19T04:22:48.975 INFO:journalctl@ceph.mon.c.smithi167.stdout: filter_policy: bloomfilter 2024-09-19T04:22:48.976 INFO:journalctl@ceph.mon.c.smithi167.stdout: whole_key_filtering: 1 2024-09-19T04:22:48.976 INFO:journalctl@ceph.mon.c.smithi167.stdout: verify_compression: 0 2024-09-19T04:22:48.976 INFO:journalctl@ceph.mon.c.smithi167.stdout: read_amp_bytes_per_bit: 0 2024-09-19T04:22:48.976 INFO:journalctl@ceph.mon.c.smithi167.stdout: format_version: 5 2024-09-19T04:22:48.976 INFO:journalctl@ceph.mon.c.smithi167.stdout: enable_index_compression: 1 2024-09-19T04:22:48.977 INFO:journalctl@ceph.mon.c.smithi167.stdout: block_align: 0 2024-09-19T04:22:48.977 INFO:journalctl@ceph.mon.c.smithi167.stdout: max_auto_readahead_size: 262144 2024-09-19T04:22:48.977 INFO:journalctl@ceph.mon.c.smithi167.stdout: prepopulate_block_cache: 0 2024-09-19T04:22:48.977 INFO:journalctl@ceph.mon.c.smithi167.stdout: initial_auto_readahead_size: 8192 2024-09-19T04:22:48.977 INFO:journalctl@ceph.mon.c.smithi167.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T04:22:48.977 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T04:22:48.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T04:22:48.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression: NoCompression 2024-09-19T04:22:48.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T04:22:48.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T04:22:48.978 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T04:22:48.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.num_levels: 7 2024-09-19T04:22:48.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T04:22:48.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T04:22:48.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T04:22:48.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T04:22:48.979 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T04:22:48.980 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T04:22:48.980 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T04:22:48.980 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:22:48.980 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T04:22:48.980 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T04:22:48.981 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:22:48.983 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:22:48.983 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T04:22:48.983 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T04:22:48.983 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T04:22:48.983 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T04:22:48.983 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:22:48.984 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:22:48.984 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T04:22:48.984 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T04:22:48.984 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:22:48.984 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T04:22:48.984 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T04:22:48.985 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T04:22:48.985 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T04:22:48.985 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T04:22:48.985 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T04:22:48.985 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T04:22:48.986 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T04:22:48.986 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T04:22:48.986 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T04:22:48.986 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T04:22:48.986 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T04:22:48.987 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T04:22:48.987 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T04:22:48.987 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T04:22:48.987 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T04:22:48.987 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T04:22:48.988 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T04:22:48.988 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T04:22:48.988 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T04:22:48.988 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T04:22:48.989 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T04:22:48.989 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T04:22:48.989 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T04:22:48.989 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T04:22:48.989 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T04:22:48.989 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T04:22:48.990 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T04:22:48.990 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T04:22:48.990 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T04:22:48.990 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T04:22:48.990 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T04:22:48.991 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T04:22:48.991 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.inplace_update_support: 0 2024-09-19T04:22:48.991 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T04:22:48.991 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T04:22:48.991 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T04:22:48.991 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T04:22:48.992 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.bloom_locality: 0 2024-09-19T04:22:48.992 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.max_successive_merges: 0 2024-09-19T04:22:48.992 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T04:22:48.992 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T04:22:48.992 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T04:22:48.993 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T04:22:48.993 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.ttl: 2592000 2024-09-19T04:22:48.993 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T04:22:48.993 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T04:22:48.993 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T04:22:48.993 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.enable_blob_files: false 2024-09-19T04:22:48.994 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.min_blob_size: 0 2024-09-19T04:22:48.994 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T04:22:48.994 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T04:22:48.994 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T04:22:48.994 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T04:22:48.995 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T04:22:48.995 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T04:22:48.995 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T04:22:48.995 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T04:22:48.995 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1a128b0e-dc6b-4228-8584-963eae727e44 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719768695139, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719768695608, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726719768, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1a128b0e-dc6b-4228-8584-963eae727e44", "db_session_id": "XF5CO275FVWZXDFU0HEK", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719768695703, "job": 1, "event": "recovery_finished"} 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T04:22:48.996 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55c21adf8e00 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: DB pointer 0x55c21aef4000 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** DB Stats ** 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-19T04:22:48.997 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** Compaction Stats [default] ** 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.5 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T04:22:48.998 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: Cumulative compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: Interval compaction: 0.00 GB write, 0.54 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: Block cache BinnedLRUCache@0x55c21adcb1f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T04:22:48.999 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: using public_addr v2:172.21.15.167:0/0 -> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: starting mon.c rank -1 at public addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] at bind addrs [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(???) e0 preinit fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).mds e1 new map 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).mds e1 print_map 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout: e1 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout: btime 2024-09-19T04:21:29:502880+0000 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:22:49.000 INFO:journalctl@ceph.mon.c.smithi167.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout: legacy client fscid: -1 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout: 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout: No filesystems configured 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:22:49.001 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4230740272' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4230740272' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:49.002 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c;count:3 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: Deploying daemon mon.c on smithi167 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:49.003 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/3218148433' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:49.004 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 ceph-mon[34339]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T04:22:49.004 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 bash[34320]: a37b07fe580fd7f06ac50394c8868cdf5b0ea97188c7f19974b744bc34c99ce4 2024-09-19T04:22:49.004 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:48 smithi167 systemd[1]: Started Ceph mon.c for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:22:49.206 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:22:49.207 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:22:49.457 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: mon.a calling monitor election 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: mon.c calling monitor election 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: monmap epoch 2 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: last_changed 2024-09-19T04:22:48.721385+0000 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: min_mon_release 19 (squid) 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: election_strategy: 1 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: fsmap 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: mgrmap e13: x(active, since 36s) 2024-09-19T04:22:54.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: overall HEALTH_OK 2024-09-19T04:22:54.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:54.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:54.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:54.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:22:54.054 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:22:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: mon.a calling monitor election 2024-09-19T04:22:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: mon.c calling monitor election 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: monmap epoch 2 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: last_changed 2024-09-19T04:22:48.721385+0000 2024-09-19T04:22:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: min_mon_release 19 (squid) 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: election_strategy: 1 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: fsmap 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: mgrmap e13: x(active, since 36s) 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: overall HEALTH_OK 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:22:54.213 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:54.304 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.300+0000 7fba3f926640 1 -- 172.21.15.167:0/1495907110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba24003530 msgr2=0x7fba240059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.300+0000 7fba3f926640 1 --2- 172.21.15.167:0/1495907110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba24003530 0x7fba240059c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fba3806a9c0 tx=0x7fba3402c490 comp rx=0 tx=0).stop 2024-09-19T04:22:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.300+0000 7fba3f926640 1 -- 172.21.15.167:0/1495907110 shutdown_connections 2024-09-19T04:22:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.300+0000 7fba3f926640 1 --2- 172.21.15.167:0/1495907110 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba24003530 0x7fba240059c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.300+0000 7fba3f926640 1 -- 172.21.15.167:0/1495907110 >> 172.21.15.167:0/1495907110 conn(0x7fba380fc220 msgr2=0x7fba380fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.300+0000 7fba3f926640 1 -- 172.21.15.167:0/1495907110 shutdown_connections 2024-09-19T04:22:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.300+0000 7fba3f926640 1 -- 172.21.15.167:0/1495907110 wait complete. 2024-09-19T04:22:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3f926640 1 Processor -- start 2024-09-19T04:22:54.305 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3f926640 1 -- start start 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3f926640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 0x7fba38197350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3f926640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba38197890 0x7fba3819bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3f926640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fba38109760 con 0x7fba38197890 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3f926640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fba381095e0 con 0x7fba24003530 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3d6c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 0x7fba38197350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3d6c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 0x7fba38197350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:32780/0 (socket says 172.21.15.167:32780) 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.301+0000 7fba3d6c2640 1 -- 172.21.15.167:0/2677732805 learned_addr learned my addr 172.21.15.167:0/2677732805 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3d6c2640 1 -- 172.21.15.167:0/2677732805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 msgr2=0x7fba38197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3cec1640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba38197890 0x7fba3819bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3d6c2640 1 -- 172.21.15.167:0/2677732805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 msgr2=0x7fba38197350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3d6c2640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 0x7fba38197350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3d6c2640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 0x7fba38197350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:22:54.306 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3cec1640 1 -- 172.21.15.167:0/2677732805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 msgr2=0x7fba38197350 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:22:54.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3cec1640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 0x7fba38197350 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:54.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3cec1640 1 -- 172.21.15.167:0/2677732805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fba38197eb0 con 0x7fba38197890 2024-09-19T04:22:54.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba3cec1640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba38197890 0x7fba3819bc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b3d0 tx=0x7fba2c00b890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:54.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba2a7fc640 1 -- 172.21.15.167:0/2677732805 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fba2c011630 con 0x7fba38197890 2024-09-19T04:22:54.307 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.302+0000 7fba2a7fc640 1 -- 172.21.15.167:0/2677732805 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fba2c011ca0 con 0x7fba38197890 2024-09-19T04:22:54.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.303+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fba3819c160 con 0x7fba38197890 2024-09-19T04:22:54.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.303+0000 7fba2a7fc640 1 -- 172.21.15.167:0/2677732805 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7fba2c010e10 con 0x7fba38197890 2024-09-19T04:22:54.308 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.303+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fba3819c6a0 con 0x7fba38197890 2024-09-19T04:22:54.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.303+0000 7fba2a7fc640 1 -- 172.21.15.167:0/2677732805 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fba2c018020 con 0x7fba38197890 2024-09-19T04:22:54.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.304+0000 7fba2a7fc640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fba1c039040 0x7fba1c03b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:54.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.304+0000 7fba2a7fc640 1 -- 172.21.15.167:0/2677732805 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fba2c04c090 con 0x7fba38197890 2024-09-19T04:22:54.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.304+0000 7fba3d6c2640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fba1c039040 0x7fba1c03b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:54.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.304+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fba3806ac70 con 0x7fba38197890 2024-09-19T04:22:54.309 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.304+0000 7fba3d6c2640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fba1c039040 0x7fba1c03b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba3402ca80 tx=0x7fba3402c9b0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:54.311 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.309+0000 7fba2a7fc640 1 -- 172.21.15.167:0/2677732805 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fba2c01f020 con 0x7fba38197890 2024-09-19T04:22:54.544 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.542+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fba3810a900 con 0x7fba38197890 2024-09-19T04:22:54.545 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.543+0000 7fba2a7fc640 1 -- 172.21.15.167:0/2677732805 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7fba2c018310 con 0x7fba38197890 2024-09-19T04:22:54.545 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:22:54.545 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","modified":"2024-09-19T04:22:48.721385Z","created":"2024-09-19T04:21:26.544673Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T04:22:54.546 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 2 2024-09-19T04:22:54.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fba1c039040 msgr2=0x7fba1c03b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:54.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fba1c039040 0x7fba1c03b500 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fba3402ca80 tx=0x7fba3402c9b0 comp rx=0 tx=0).stop 2024-09-19T04:22:54.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba38197890 msgr2=0x7fba3819bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:54.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba38197890 0x7fba3819bc20 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fba2c00b3d0 tx=0x7fba2c00b890 comp rx=0 tx=0).stop 2024-09-19T04:22:54.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 shutdown_connections 2024-09-19T04:22:54.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fba1c039040 0x7fba1c03b500 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:54.547 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fba38197890 0x7fba3819bc20 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:54.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 --2- 172.21.15.167:0/2677732805 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fba24003530 0x7fba38197350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:54.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 >> 172.21.15.167:0/2677732805 conn(0x7fba380fc220 msgr2=0x7fba380fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:54.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 shutdown_connections 2024-09-19T04:22:54.548 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:54.545+0000 7fba3f926640 1 -- 172.21.15.167:0/2677732805 wait complete. 2024-09-19T04:22:54.903 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:54 smithi167 ceph-mon[34339]: Deploying daemon mon.b on smithi134 2024-09-19T04:22:54.903 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:54 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/2677732805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:54.903 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:54 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:55.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:54 smithi070 ceph-mon[30942]: Deploying daemon mon.b on smithi134 2024-09-19T04:22:55.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:54 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/2677732805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:55.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:54 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:56.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:55 smithi070 ceph-mon[30942]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:56.198 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:22:56.198 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:22:56.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:55 smithi167 ceph-mon[34339]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:56.453 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:22:56.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.885+0000 7f0bc59a0640 1 -- 172.21.15.167:0/1384644821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 msgr2=0x7f0bc0102ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:56.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.885+0000 7f0bc59a0640 1 --2- 172.21.15.167:0/1384644821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 0x7f0bc0102ca0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009880 tx=0x7f0bb002a670 comp rx=0 tx=0).stop 2024-09-19T04:22:56.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.885+0000 7f0bc59a0640 1 -- 172.21.15.167:0/1384644821 shutdown_connections 2024-09-19T04:22:56.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.885+0000 7f0bc59a0640 1 --2- 172.21.15.167:0/1384644821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 0x7f0bc0102ca0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:56.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.885+0000 7f0bc59a0640 1 -- 172.21.15.167:0/1384644821 >> 172.21.15.167:0/1384644821 conn(0x7f0bc00fc280 msgr2=0x7f0bc00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:56.888 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.885+0000 7f0bc59a0640 1 -- 172.21.15.167:0/1384644821 shutdown_connections 2024-09-19T04:22:56.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.885+0000 7f0bc59a0640 1 -- 172.21.15.167:0/1384644821 wait complete. 2024-09-19T04:22:56.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bc59a0640 1 Processor -- start 2024-09-19T04:22:56.889 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bc59a0640 1 -- start start 2024-09-19T04:22:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bc59a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 0x7f0bc0197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bc59a0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 0x7f0bc019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bc59a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc010bda0 con 0x7f0bc01028c0 2024-09-19T04:22:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bc59a0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0bc010bc20 con 0x7f0bc01979d0 2024-09-19T04:22:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bbe7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 0x7f0bc019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bbeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 0x7f0bc0197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:56.891 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bbe7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 0x7f0bc019bd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:32792/0 (socket says 172.21.15.167:32792) 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.886+0000 7f0bbe7fc640 1 -- 172.21.15.167:0/3882976547 learned_addr learned my addr 172.21.15.167:0/3882976547 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bbe7fc640 1 -- 172.21.15.167:0/3882976547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 msgr2=0x7f0bc019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bbe7fc640 1 -- 172.21.15.167:0/3882976547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 msgr2=0x7f0bc019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bbe7fc640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 0x7f0bc019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bbe7fc640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 0x7f0bc019bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bbeffd640 1 -- 172.21.15.167:0/3882976547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 msgr2=0x7f0bc019bd10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bbeffd640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 0x7f0bc019bd10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bbeffd640 1 -- 172.21.15.167:0/3882976547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0bc0197ff0 con 0x7f0bc01028c0 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bbeffd640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 0x7f0bc0197490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009230 tx=0x7f0bb0004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bc499e640 1 -- 172.21.15.167:0/3882976547 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0bb0035030 con 0x7f0bc01028c0 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0bc019c250 con 0x7f0bc01028c0 2024-09-19T04:22:56.892 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bc499e640 1 -- 172.21.15.167:0/3882976547 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0bb0031670 con 0x7f0bc01028c0 2024-09-19T04:22:56.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bc499e640 1 -- 172.21.15.167:0/3882976547 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f0bb0003880 con 0x7f0bc01028c0 2024-09-19T04:22:56.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.887+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0bc019c730 con 0x7f0bc01028c0 2024-09-19T04:22:56.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.888+0000 7f0bc499e640 1 -- 172.21.15.167:0/3882976547 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0bb0042070 con 0x7f0bc01028c0 2024-09-19T04:22:56.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.888+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0bc006a470 con 0x7f0bc01028c0 2024-09-19T04:22:56.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.888+0000 7f0bc499e640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0ba8039040 0x7f0ba803b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:22:56.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.888+0000 7f0bc499e640 1 -- 172.21.15.167:0/3882976547 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f0bb006cff0 con 0x7f0bc01028c0 2024-09-19T04:22:56.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.889+0000 7f0bbe7fc640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0ba8039040 0x7f0ba803b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:22:56.893 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.889+0000 7f0bbe7fc640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0ba8039040 0x7f0ba803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009100 tx=0x7f0bb4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:22:56.895 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:56.894+0000 7f0bc499e640 1 -- 172.21.15.167:0/3882976547 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0bb00372d0 con 0x7f0bc01028c0 2024-09-19T04:22:57.123 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.121+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f0bc019c9e0 con 0x7f0bc01028c0 2024-09-19T04:22:57.124 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.122+0000 7f0bc499e640 1 -- 172.21.15.167:0/3882976547 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1015 (secure 0 0 0) 0x7f0bb0003ab0 con 0x7f0bc01028c0 2024-09-19T04:22:57.124 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:22:57.125 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":2,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","modified":"2024-09-19T04:22:48.721385Z","created":"2024-09-19T04:21:26.544673Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T04:22:57.125 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 2 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.124+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0ba8039040 msgr2=0x7f0ba803b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.124+0000 7f0bc59a0640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0ba8039040 0x7f0ba803b500 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f0bb4009100 tx=0x7f0bb4008040 comp rx=0 tx=0).stop 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.124+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 msgr2=0x7f0bc0197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.124+0000 7f0bc59a0640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 0x7f0bc0197490 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f0bb0009230 tx=0x7f0bb0004ef0 comp rx=0 tx=0).stop 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.125+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 shutdown_connections 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.125+0000 7f0bc59a0640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0ba8039040 0x7f0ba803b500 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.125+0000 7f0bc59a0640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0bc01979d0 0x7f0bc019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.125+0000 7f0bc59a0640 1 --2- 172.21.15.167:0/3882976547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0bc01028c0 0x7f0bc0197490 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.125+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 >> 172.21.15.167:0/3882976547 conn(0x7f0bc00fc280 msgr2=0x7f0bc0105660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:22:57.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.125+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 shutdown_connections 2024-09-19T04:22:57.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:22:57.125+0000 7f0bc59a0640 1 -- 172.21.15.167:0/3882976547 wait complete. 2024-09-19T04:22:57.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 podman[34506]: 2024-09-19 04:22:57.214740934 +0000 UTC m=+0.125957202 container create 1db1e0a005e9c7f0d87bf757ed1d2e0a281b0896201dfdab4859cf2ee112f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-b, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2) 2024-09-19T04:22:57.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:22:57 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/3882976547' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:57.584 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 podman[34506]: 2024-09-19 04:22:57.42531054 +0000 UTC m=+0.336526807 container init 1db1e0a005e9c7f0d87bf757ed1d2e0a281b0896201dfdab4859cf2ee112f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-09-19T04:22:57.584 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 podman[34506]: 2024-09-19 04:22:57.428440266 +0000 UTC m=+0.339656527 container start 1db1e0a005e9c7f0d87bf757ed1d2e0a281b0896201dfdab4859cf2ee112f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-b, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T04:22:57.584 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: set uid:gid to 167:167 (ceph:ceph) 2024-09-19T04:22:57.584 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable), process ceph-mon, pid 2 2024-09-19T04:22:57.584 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: pidfile_write: ignore empty --pid-file 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: load: jerasure load: lrc 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: RocksDB version: 7.9.2 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Git sha 0 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Compile date 2024-09-18 16:29:48 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: DB SUMMARY 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: DB Session ID: 0T29T7U5X724O7UVL31I 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: CURRENT file: CURRENT 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: IDENTITY file: IDENTITY 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-09-19T04:22:57.585 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.error_if_exists: 0 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.create_if_missing: 0 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.paranoid_checks: 1 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.flush_verify_memtable_count: 1 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.env: 0x563761147940 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.fs: PosixFileSystem 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.info_log: 0x563762b116e0 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_file_opening_threads: 16 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.statistics: (nil) 2024-09-19T04:22:57.586 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.use_fsync: 0 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_log_file_size: 0 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.log_file_time_to_roll: 0 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.keep_log_file_num: 1000 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.recycle_log_file_num: 0 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.allow_fallocate: 1 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.allow_mmap_reads: 0 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.allow_mmap_writes: 0 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.use_direct_reads: 0 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-09-19T04:22:57.587 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.create_missing_column_families: 0 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.db_log_dir: 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.wal_dir: 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.table_cache_numshardbits: 6 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.WAL_ttl_seconds: 0 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.WAL_size_limit_MB: 0 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.is_fd_close_on_exec: 1 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.advise_random_on_open: 1 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.db_write_buffer_size: 0 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.write_buffer_manager: 0x563762b20dc0 2024-09-19T04:22:57.588 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.use_adaptive_mutex: 0 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.rate_limiter: (nil) 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.wal_recovery_mode: 2 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.enable_thread_tracking: 0 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.enable_pipelined_write: 0 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.unordered_write: 0 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-09-19T04:22:57.589 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-09-19T04:22:57.590 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-09-19T04:22:57.590 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-09-19T04:22:57.590 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.row_cache: None 2024-09-19T04:22:57.590 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.wal_filter: None 2024-09-19T04:22:57.591 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-09-19T04:22:57.591 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.allow_ingest_behind: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.two_write_queues: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.manual_wal_flush: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.wal_compression: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.atomic_flush: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.persist_stats_to_disk: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.write_dbid_to_manifest: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.log_readahead_size: 0 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-09-19T04:22:57.592 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.best_efforts_recovery: 0 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.allow_data_in_errors: 0 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.db_host_id: __hostname__ 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.enforce_single_del_contracts: true 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_background_jobs: 2 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_background_compactions: -1 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_subcompactions: 1 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-09-19T04:22:57.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.delayed_write_rate : 16777216 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_total_wal_size: 0 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.stats_dump_period_sec: 600 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.stats_persist_period_sec: 600 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_open_files: -1 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bytes_per_sync: 0 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.wal_bytes_per_sync: 0 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.strict_bytes_per_sync: 0 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_readahead_size: 0 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_background_flushes: -1 2024-09-19T04:22:57.594 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Compression algorithms supported: 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: kZSTD supported: 0 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: kXpressCompression supported: 0 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: kBZip2Compression supported: 0 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: kLZ4Compression supported: 1 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: kZlibCompression supported: 1 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: kLZ4HCCompression supported: 1 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: kSnappyCompression supported: 1 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Fast CRC32 supported: Supported on x86 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: DMutex implementation: pthread_mutex_t 2024-09-19T04:22:57.595 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.merge_operator: 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_filter: None 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_filter_factory: None 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.sst_partitioner_factory: None 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.memtable_factory: SkipListFactory 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.table_factory: BlockBasedTable 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x563762b11320) 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-09-19T04:22:57.596 INFO:journalctl@ceph.mon.b.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: index_type: 0 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: data_block_index_type: 0 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: index_shortening: 1 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: checksum: 4 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: no_block_cache: 0 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_cache: 0x563762b051f0 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-09-19T04:22:57.597 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_cache_options: 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: capacity : 536870912 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: num_shard_bits : 4 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: strict_capacity_limit : 0 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_cache_compressed: (nil) 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: persistent_cache: (nil) 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_size: 4096 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_size_deviation: 10 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_restart_interval: 16 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: index_block_restart_interval: 1 2024-09-19T04:22:57.598 INFO:journalctl@ceph.mon.b.smithi134.stdout: metadata_block_size: 4096 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: partition_filters: 0 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: use_delta_encoding: 1 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: filter_policy: bloomfilter 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: whole_key_filtering: 1 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: verify_compression: 0 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: format_version: 5 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: enable_index_compression: 1 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: block_align: 0 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: max_auto_readahead_size: 262144 2024-09-19T04:22:57.599 INFO:journalctl@ceph.mon.b.smithi134.stdout: prepopulate_block_cache: 0 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout: initial_auto_readahead_size: 8192 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.write_buffer_size: 33554432 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_write_buffer_number: 2 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression: NoCompression 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression: Disabled 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.prefix_extractor: nullptr 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.num_levels: 7 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-09-19T04:22:57.600 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:22:57.601 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.window_bits: -14 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.level: 32767 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.strategy: 0 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.enabled: false 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-09-19T04:22:57.602 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.target_file_size_base: 67108864 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.target_file_size_multiplier: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-09-19T04:22:57.603 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.arena_block_size: 1048576 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.disable_auto_compactions: 0 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-09-19T04:22:57.604 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.inplace_update_support: 0 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.inplace_update_num_locks: 10000 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.memtable_huge_page_size: 0 2024-09-19T04:22:57.605 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.bloom_locality: 0 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.max_successive_merges: 0 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.optimize_filters_for_hits: 0 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.paranoid_file_checks: 0 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.force_consistency_checks: 1 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.report_bg_io_stats: 0 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.ttl: 2592000 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.periodic_compaction_seconds: 0 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.enable_blob_files: false 2024-09-19T04:22:57.606 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.min_blob_size: 0 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.blob_file_size: 268435456 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.blob_compression_type: NoCompression 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.enable_blob_garbage_collection: false 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.blob_file_starting_level: 0 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-09-19T04:22:57.607 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: a5443a85-8815-49d2-a346-90c47e120a98 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719777456102, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719777456721, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1773, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1726719777, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "a5443a85-8815-49d2-a346-90c47e120a98", "db_session_id": "0T29T7U5X724O7UVL31I", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: EVENT_LOG_v1 {"time_micros": 1726719777456847, "job": 1, "event": "recovery_finished"} 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x563762b32e00 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: DB pointer 0x563762c2e000 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-09-19T04:22:57.608 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: ** DB Stats ** 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-09-19T04:22:57.609 INFO:journalctl@ceph.mon.b.smithi134.stdout: ** Compaction Stats [default] ** 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: L0 1/0 1.73 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: Sum 1/0 1.73 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: ** Compaction Stats [default] ** 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 2.8 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-09-19T04:22:57.610 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: Cumulative compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: Interval compaction: 0.00 GB write, 0.45 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-09-19T04:22:57.611 INFO:journalctl@ceph.mon.b.smithi134.stdout: Block cache BinnedLRUCache@0x563762b051f0#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: using public_addr v2:172.21.15.134:0/0 -> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: starting mon.b rank -1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(???) e0 preinit fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).mds e1 new map 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).mds e1 print_map 2024-09-19T04:22:57.612 INFO:journalctl@ceph.mon.b.smithi134.stdout: e1 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout: btime 2024-09-19T04:21:29:502880+0000 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout: legacy client fscid: -1 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout: 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout: No filesystems configured 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-09-19T04:22:57.613 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4230740272' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4230740272' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi167", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:22:57.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: Saving service mon spec with placement smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c;count:3 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: Deploying daemon mon.c on smithi167 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/3218148433' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:57.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.a calling monitor election 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.c calling monitor election 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:57.617 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: monmap epoch 2 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: last_changed 2024-09-19T04:22:48.721385+0000 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: min_mon_release 19 (squid) 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: election_strategy: 1 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: fsmap 2024-09-19T04:22:57.618 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:22:57.619 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mgrmap e13: x(active, since 36s) 2024-09-19T04:22:57.619 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: overall HEALTH_OK 2024-09-19T04:22:57.619 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.619 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.619 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:22:57.619 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:22:57.619 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:22:57.619 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: Deploying daemon mon.b on smithi134 2024-09-19T04:22:57.620 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/2677732805' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:57.620 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:22:57.620 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:22:57.620 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/3882976547' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:57.620 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 ceph-mon[34525]: mon.b@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-09-19T04:22:57.620 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 bash[34506]: 1db1e0a005e9c7f0d87bf757ed1d2e0a281b0896201dfdab4859cf2ee112f96f 2024-09-19T04:22:57.620 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:22:57 smithi134 systemd[1]: Started Ceph mon.b for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:22:57.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:22:57 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/3882976547' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:22:58.721 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-09-19T04:22:58.722 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph mon dump -f json 2024-09-19T04:22:58.983 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:23:02.610 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.607+0000 7f083ccb9640 1 -- 172.21.15.167:0/2773750007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0820003530 msgr2=0x7f08200059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:02.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.607+0000 7f083ccb9640 1 --2- 172.21.15.167:0/2773750007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0820003530 0x7f08200059c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f0838069620 tx=0x7f083002c150 comp rx=0 tx=0).stop 2024-09-19T04:23:02.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.607+0000 7f083ccb9640 1 -- 172.21.15.167:0/2773750007 shutdown_connections 2024-09-19T04:23:02.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.607+0000 7f083ccb9640 1 --2- 172.21.15.167:0/2773750007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0820003530 0x7f08200059c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:02.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.607+0000 7f083ccb9640 1 -- 172.21.15.167:0/2773750007 >> 172.21.15.167:0/2773750007 conn(0x7f08380fb9a0 msgr2=0x7f08380fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:02.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.608+0000 7f083ccb9640 1 -- 172.21.15.167:0/2773750007 shutdown_connections 2024-09-19T04:23:02.611 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.608+0000 7f083ccb9640 1 -- 172.21.15.167:0/2773750007 wait complete. 2024-09-19T04:23:02.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083ccb9640 1 Processor -- start 2024-09-19T04:23:02.613 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083ccb9640 1 -- start start 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083ccb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 0x7f08381972c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083ccb9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 0x7f083819bb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083ccb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083819c0d0 0x7f083819c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083ccb9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0838109770 con 0x7f083819c0d0 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083ccb9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08381095f0 con 0x7f0838197800 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083ccb9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f08381098f0 con 0x7f0820003530 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.609+0000 7f083659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 0x7f08381972c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f083659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 0x7f08381972c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42022/0 (socket says 172.21.15.167:42022) 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f083659c640 1 -- 172.21.15.167:0/3089098148 learned_addr learned my addr 172.21.15.167:0/3089098148 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f083659c640 1 -- 172.21.15.167:0/3089098148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 msgr2=0x7f08381972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-09-19T04:23:02.614 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f083659c640 1 -- 172.21.15.167:0/3089098148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 msgr2=0x7f08381972c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f083659c640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 0x7f08381972c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0836d9d640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083819c0d0 0x7f083819c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f083659c640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 0x7f08381972c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0835d9b640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 0x7f083819bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0835d9b640 1 -- 172.21.15.167:0/3089098148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 msgr2=0x7f083819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0835d9b640 1 -- 172.21.15.167:0/3089098148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 msgr2=0x7f083819bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0835d9b640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 0x7f083819bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0835d9b640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 0x7f083819bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0836d9d640 1 -- 172.21.15.167:0/3089098148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 msgr2=0x7f08381972c0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0836d9d640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 0x7f08381972c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0836d9d640 1 -- 172.21.15.167:0/3089098148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 msgr2=0x7f083819bb90 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0836d9d640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 0x7f083819bb90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0836d9d640 1 -- 172.21.15.167:0/3089098148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08381a3e40 con 0x7f083819c0d0 2024-09-19T04:23:02.615 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.610+0000 7f0836d9d640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083819c0d0 0x7f083819c580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0828009fd0 tx=0x7f082800b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:02.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.611+0000 7f08277fe640 1 -- 172.21.15.167:0/3089098148 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0828015020 con 0x7f083819c0d0 2024-09-19T04:23:02.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.611+0000 7f08277fe640 1 -- 172.21.15.167:0/3089098148 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0828011d00 con 0x7f083819c0d0 2024-09-19T04:23:02.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.611+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08381a4070 con 0x7f083819c0d0 2024-09-19T04:23:02.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.611+0000 7f08277fe640 1 -- 172.21.15.167:0/3089098148 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f082800f2e0 con 0x7f083819c0d0 2024-09-19T04:23:02.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.611+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08381a4580 con 0x7f083819c0d0 2024-09-19T04:23:02.616 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.612+0000 7f08277fe640 1 -- 172.21.15.167:0/3089098148 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f0828018020 con 0x7f083819c0d0 2024-09-19T04:23:02.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.612+0000 7f08277fe640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0818039730 0x7f081803bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:02.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.612+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f083810a890 con 0x7f083819c0d0 2024-09-19T04:23:02.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.612+0000 7f08277fe640 1 -- 172.21.15.167:0/3089098148 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f082804c0a0 con 0x7f083819c0d0 2024-09-19T04:23:02.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.612+0000 7f083659c640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0818039730 0x7f081803bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:02.617 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.613+0000 7f083659c640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0818039730 0x7f081803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0830005fd0 tx=0x7f0830005d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:02.619 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.617+0000 7f08277fe640 1 -- 172.21.15.167:0/3089098148 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f082801f020 con 0x7f083819c0d0 2024-09-19T04:23:02.864 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.862+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f083802d7c0 con 0x7f083819c0d0 2024-09-19T04:23:02.864 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:02.864 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:23:02.864 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: mon.a calling monitor election 2024-09-19T04:23:02.864 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: mon.c calling monitor election 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: monmap epoch 3 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:23:02.865 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: last_changed 2024-09-19T04:22:57.484052+0000 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: min_mon_release 19 (squid) 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: election_strategy: 1 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: fsmap 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: mgrmap e13: x(active, since 45s) 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: overall HEALTH_OK 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:02.866 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:02.867 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.862+0000 7f08277fe640 1 -- 172.21.15.167:0/3089098148 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1283 (secure 0 0 0) 0x7f0828018310 con 0x7f083819c0d0 2024-09-19T04:23:02.867 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:23:02.867 INFO:teuthology.orchestra.run.smithi167.stdout:{"epoch":3,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","modified":"2024-09-19T04:22:57.484052Z","created":"2024-09-19T04:21:26.544673Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:3300","nonce":0},{"type":"v1","addr":"172.21.15.70:6789","nonce":0}]},"addr":"172.21.15.70:6789/0","public_addr":"172.21.15.70:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:3300","nonce":0},{"type":"v1","addr":"172.21.15.167:6789","nonce":0}]},"addr":"172.21.15.167:6789/0","public_addr":"172.21.15.167:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:dumped monmap epoch 3 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0818039730 msgr2=0x7f081803bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0818039730 0x7f081803bbf0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f0830005fd0 tx=0x7f0830005d50 comp rx=0 tx=0).stop 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083819c0d0 msgr2=0x7f083819c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083819c0d0 0x7f083819c580 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f0828009fd0 tx=0x7f082800b870 comp rx=0 tx=0).stop 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 shutdown_connections 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0818039730 0x7f081803bbf0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f083819c0d0 0x7f083819c580 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0838197800 0x7f083819bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:02.868 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 --2- 172.21.15.167:0/3089098148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0820003530 0x7f08381972c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:02.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 >> 172.21.15.167:0/3089098148 conn(0x7f08380fb9a0 msgr2=0x7f08380fd900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:02.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 shutdown_connections 2024-09-19T04:23:02.869 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:02.865+0000 7f083ccb9640 1 -- 172.21.15.167:0/3089098148 wait complete. 2024-09-19T04:23:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:23:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: mon.a calling monitor election 2024-09-19T04:23:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: mon.c calling monitor election 2024-09-19T04:23:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: monmap epoch 3 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: last_changed 2024-09-19T04:22:57.484052+0000 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: min_mon_release 19 (squid) 2024-09-19T04:23:02.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: election_strategy: 1 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: fsmap 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: mgrmap e13: x(active, since 45s) 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: overall HEALTH_OK 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:02.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:03.493 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-09-19T04:23:03.493 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph config generate-minimal-conf 2024-09-19T04:23:03.752 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:23:03.826 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:03.827 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:03 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/3089098148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:23:03.827 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:03 smithi167 ceph-mon[34339]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:03.827 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:03.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:03.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:03 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/3089098148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:23:03.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:03 smithi070 ceph-mon[30942]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:03.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:04.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.199+0000 7f7adb081640 1 -- 172.21.15.70:0/2943152585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4106560 msgr2=0x7f7ad4106940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:04.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.199+0000 7f7adb081640 1 --2- 172.21.15.70:0/2943152585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4106560 0x7f7ad4106940 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7acc009880 tx=0x7f7acc02a5d0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.199+0000 7f7adb081640 1 -- 172.21.15.70:0/2943152585 shutdown_connections 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.199+0000 7f7adb081640 1 --2- 172.21.15.70:0/2943152585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4106560 0x7f7ad4106940 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.199+0000 7f7adb081640 1 -- 172.21.15.70:0/2943152585 >> 172.21.15.70:0/2943152585 conn(0x7f7ad40fc1b0 msgr2=0x7f7ad40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.199+0000 7f7adb081640 1 -- 172.21.15.70:0/2943152585 shutdown_connections 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.199+0000 7f7adb081640 1 -- 172.21.15.70:0/2943152585 wait complete. 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7adb081640 1 Processor -- start 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7adb081640 1 -- start start 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7adb081640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ad4106560 0x7f7ad41981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7adb081640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4198700 0x7f7ad4198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7adb081640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad41a1230 0x7f7ad41a3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7adb081640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad410ab30 con 0x7f7ad4198700 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7adb081640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad410a9b0 con 0x7f7ad4106560 2024-09-19T04:23:04.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7adb081640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad410acb0 con 0x7f7ad41a1230 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4198700 0x7f7ad4198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4198700 0x7f7ad4198b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43268/0 (socket says 172.21.15.70:43268) 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 -- 172.21.15.70:0/506051588 learned_addr learned my addr 172.21.15.70:0/506051588 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 -- 172.21.15.70:0/506051588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad41a1230 msgr2=0x7f7ad41a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad41a1230 0x7f7ad41a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 -- 172.21.15.70:0/506051588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ad4106560 msgr2=0x7f7ad41981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ad4106560 0x7f7ad41981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 -- 172.21.15.70:0/506051588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad41a3e70 con 0x7f7ad4198700 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad3fff640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4198700 0x7f7ad4198b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400bb00 tx=0x7f7ac4009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.200+0000 7f7ad1ffb640 1 -- 172.21.15.70:0/506051588 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac4003b90 con 0x7f7ad4198700 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.201+0000 7f7ad1ffb640 1 -- 172.21.15.70:0/506051588 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7ac400cd50 con 0x7f7ad4198700 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.201+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad41a4100 con 0x7f7ad4198700 2024-09-19T04:23:04.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.201+0000 7f7ad1ffb640 1 -- 172.21.15.70:0/506051588 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac40046c0 con 0x7f7ad4198700 2024-09-19T04:23:04.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.201+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad41a4640 con 0x7f7ad4198700 2024-09-19T04:23:04.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.201+0000 7f7ad1ffb640 1 -- 172.21.15.70:0/506051588 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f7ac401d440 con 0x7f7ad4198700 2024-09-19T04:23:04.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.202+0000 7f7ad1ffb640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7ac0039730 0x7f7ac003bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:04.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.202+0000 7f7ad1ffb640 1 -- 172.21.15.70:0/506051588 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f7ac404bcb0 con 0x7f7ad4198700 2024-09-19T04:23:04.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.202+0000 7f7ad8e1d640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7ac0039730 0x7f7ac003bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:04.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.202+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ad41069c0 con 0x7f7ad4198700 2024-09-19T04:23:04.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.202+0000 7f7ad8e1d640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7ac0039730 0x7f7ac003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0096c0 tx=0x7f7acc000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:04.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.206+0000 7f7ad1ffb640 1 -- 172.21.15.70:0/506051588 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ac401a8f0 con 0x7f7ad4198700 2024-09-19T04:23:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.394+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7f7ad41a49b0 con 0x7f7ad4198700 2024-09-19T04:23:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.395+0000 7f7ad1ffb640 1 -- 172.21.15.70:0/506051588 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+275 (secure 0 0 0) 0x7f7ac40160c0 con 0x7f7ad4198700 2024-09-19T04:23:04.397 INFO:teuthology.orchestra.run.smithi070.stdout:# minimal ceph.conf for 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:23:04.397 INFO:teuthology.orchestra.run.smithi070.stdout:[global] 2024-09-19T04:23:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: fsid = 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:23:04.397 INFO:teuthology.orchestra.run.smithi070.stdout: mon_host = [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] 2024-09-19T04:23:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7ac0039730 msgr2=0x7f7ac003bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7ac0039730 0x7f7ac003bbf0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f7acc0096c0 tx=0x7f7acc000bc0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4198700 msgr2=0x7f7ad4198b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4198700 0x7f7ad4198b60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f7ac400bb00 tx=0x7f7ac4009f70 comp rx=0 tx=0).stop 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 shutdown_connections 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7ac0039730 0x7f7ac003bbf0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ad41a1230 0x7f7ad41a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ad4198700 0x7f7ad4198b60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 --2- 172.21.15.70:0/506051588 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ad4106560 0x7f7ad41981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 >> 172.21.15.70:0/506051588 conn(0x7f7ad40fc1b0 msgr2=0x7f7ad40fc590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 shutdown_connections 2024-09-19T04:23:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:04.398+0000 7f7adb081640 1 -- 172.21.15.70:0/506051588 wait complete. 2024-09-19T04:23:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: mon.a calling monitor election 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: mon.c calling monitor election 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: monmap epoch 3 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: last_changed 2024-09-19T04:22:57.484052+0000 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: min_mon_release 19 (squid) 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: election_strategy: 1 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: fsmap 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: mgrmap e13: x(active, since 45s) 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: overall HEALTH_OK 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:04.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:04.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:04.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:04.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:04.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/3089098148' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-09-19T04:23:04.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:04.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:05.162 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-09-19T04:23:05.163 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:23:05.163 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:23:05.190 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:23:05.190 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:23:05.255 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:23:05.255 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:23:05.284 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:23:05.284 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:23:05.350 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:23:05.350 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.conf 2024-09-19T04:23:05.377 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:23:05.377 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: mon.b calling monitor election 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: mon.b calling monitor election 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: mon.c calling monitor election 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: mon.a calling monitor election 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:23:05.441 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: monmap epoch 3 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: last_changed 2024-09-19T04:22:57.484052+0000 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: min_mon_release 19 (squid) 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: election_strategy: 1 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: fsmap 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: mgrmap e13: x(active, since 47s) 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: overall HEALTH_OK 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.442 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:05.443 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:05.444 INFO:tasks.cephadm:Adding mgr.x on smithi070 2024-09-19T04:23:05.444 INFO:tasks.cephadm:Adding mgr.y on smithi134 2024-09-19T04:23:05.445 INFO:tasks.cephadm:Adding mgr.z on smithi167 2024-09-19T04:23:05.445 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch apply mgr '3;smithi070=x;smithi134=y;smithi167=z' 2024-09-19T04:23:05.507 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: mon.b calling monitor election 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: mon.b calling monitor election 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: mon.c calling monitor election 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: mon.a calling monitor election 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: monmap epoch 3 2024-09-19T04:23:05.508 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: last_changed 2024-09-19T04:22:57.484052+0000 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: min_mon_release 19 (squid) 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: election_strategy: 1 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: fsmap 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: mgrmap e13: x(active, since 47s) 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: overall HEALTH_OK 2024-09-19T04:23:05.509 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.510 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:05.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:05.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:05.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: mon.b calling monitor election 2024-09-19T04:23:05.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-19T04:23:05.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-19T04:23:05.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: mon.b calling monitor election 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: mon.c calling monitor election 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: mon.a calling monitor election 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: monmap epoch 3 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: last_changed 2024-09-19T04:22:57.484052+0000 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: created 2024-09-19T04:21:26.544673+0000 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: min_mon_release 19 (squid) 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: election_strategy: 1 2024-09-19T04:23:05.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: 0: [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] mon.a 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: 1: [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] mon.c 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: 2: [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon.b 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: fsmap 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: osdmap e4: 0 total, 0 up, 0 in 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: mgrmap e13: x(active, since 47s) 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: overall HEALTH_OK 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.537 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.538 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.538 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.538 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:05.538 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:05.538 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:05.538 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:05.724 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:23:06.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.120+0000 7fdcae234640 1 -- 172.21.15.167:0/3776889918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca81005f0 msgr2=0x7fdca81009f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:06.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.120+0000 7fdcae234640 1 --2- 172.21.15.167:0/3776889918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca81005f0 0x7fdca81009f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fdc98009880 tx=0x7fdc9802a5d0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.120+0000 7fdcae234640 1 -- 172.21.15.167:0/3776889918 shutdown_connections 2024-09-19T04:23:06.125 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.120+0000 7fdcae234640 1 --2- 172.21.15.167:0/3776889918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca81005f0 0x7fdca81009f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.120+0000 7fdcae234640 1 -- 172.21.15.167:0/3776889918 >> 172.21.15.167:0/3776889918 conn(0x7fdca80fbda0 msgr2=0x7fdca80fe1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.120+0000 7fdcae234640 1 -- 172.21.15.167:0/3776889918 shutdown_connections 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.120+0000 7fdcae234640 1 -- 172.21.15.167:0/3776889918 wait complete. 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdcae234640 1 Processor -- start 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdcae234640 1 -- start start 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdcae234640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca81005f0 0x7fdca81991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdcae234640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdca8199720 0x7fdca819e790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdcae234640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8199ba0 0x7fdca81a0d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdcae234640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdca81066f0 con 0x7fdca81005f0 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdcae234640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8106570 con 0x7fdca8199720 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdcae234640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdca8106870 con 0x7fdca8199ba0 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8199ba0 0x7fdca81a0d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:06.126 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8199ba0 0x7fdca81a0d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:42038/0 (socket says 172.21.15.167:42038) 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca7fff640 1 -- 172.21.15.167:0/206857160 learned_addr learned my addr 172.21.15.167:0/206857160 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca77fe640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca81005f0 0x7fdca81991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdc9ffff640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdca8199720 0x7fdca819e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca7fff640 1 -- 172.21.15.167:0/206857160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdca8199720 msgr2=0x7fdca819e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca7fff640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdca8199720 0x7fdca819e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca7fff640 1 -- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca81005f0 msgr2=0x7fdca81991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca7fff640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca81005f0 0x7fdca81991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.121+0000 7fdca7fff640 1 -- 172.21.15.167:0/206857160 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdca81a15e0 con 0x7fdca8199ba0 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.122+0000 7fdca7fff640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8199ba0 0x7fdca81a0d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdca000ba50 tx=0x7fdca000bf10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.122+0000 7fdca57fa640 1 -- 172.21.15.167:0/206857160 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca0019070 con 0x7fdca8199ba0 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.122+0000 7fdca57fa640 1 -- 172.21.15.167:0/206857160 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdca000cbe0 con 0x7fdca8199ba0 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.122+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdca81a18d0 con 0x7fdca8199ba0 2024-09-19T04:23:06.127 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.122+0000 7fdca57fa640 1 -- 172.21.15.167:0/206857160 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdca00076c0 con 0x7fdca8199ba0 2024-09-19T04:23:06.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.122+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdca81a1e90 con 0x7fdca8199ba0 2024-09-19T04:23:06.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.122+0000 7fdca57fa640 1 -- 172.21.15.167:0/206857160 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7fdca001c070 con 0x7fdca8199ba0 2024-09-19T04:23:06.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.123+0000 7fdca57fa640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc94039730 0x7fdc9403bbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:06.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.123+0000 7fdca57fa640 1 -- 172.21.15.167:0/206857160 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fdca004bd70 con 0x7fdca8199ba0 2024-09-19T04:23:06.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.123+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdca8192fd0 con 0x7fdca8199ba0 2024-09-19T04:23:06.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.123+0000 7fdca77fe640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc94039730 0x7fdc9403bbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:06.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.123+0000 7fdca77fe640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc94039730 0x7fdc9403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdc9802ab40 tx=0x7fdc9802aad0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:06.130 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.128+0000 7fdca57fa640 1 -- 172.21.15.167:0/206857160 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdca000e0a0 con 0x7fdca8199ba0 2024-09-19T04:23:06.315 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.313+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi134=y;smithi167=z", "target": ["mon-mgr", ""]}) -- 0x7fdca80626c0 con 0x7fdc94039730 2024-09-19T04:23:06.320 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.318+0000 7fdca57fa640 1 -- 172.21.15.167:0/206857160 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fdca80626c0 con 0x7fdc94039730 2024-09-19T04:23:06.320 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mgr update... 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc94039730 msgr2=0x7fdc9403bbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc94039730 0x7fdc9403bbf0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fdc9802ab40 tx=0x7fdc9802aad0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8199ba0 msgr2=0x7fdca81a0d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8199ba0 0x7fdca81a0d20 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fdca000ba50 tx=0x7fdca000bf10 comp rx=0 tx=0).stop 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 shutdown_connections 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc94039730 0x7fdc9403bbf0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdca8199ba0 0x7fdca81a0d20 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdca8199720 0x7fdca819e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.323 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 --2- 172.21.15.167:0/206857160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdca81005f0 0x7fdca81991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:06.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.320+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 >> 172.21.15.167:0/206857160 conn(0x7fdca80fbda0 msgr2=0x7fdca81901a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:06.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.321+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 shutdown_connections 2024-09-19T04:23:06.324 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:23:06.321+0000 7fdcae234640 1 -- 172.21.15.167:0/206857160 wait complete. 2024-09-19T04:23:06.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:06 smithi167 ceph-mon[34339]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:23:06.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:06 smithi167 ceph-mon[34339]: Reconfiguring daemon mon.a on smithi070 2024-09-19T04:23:06.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:06 smithi167 ceph-mon[34339]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:06.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:06 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:06.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:06 smithi134 ceph-mon[34525]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:23:06.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:06 smithi134 ceph-mon[34525]: Reconfiguring daemon mon.a on smithi070 2024-09-19T04:23:06.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:06 smithi134 ceph-mon[34525]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:06.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:06 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:06 smithi070 ceph-mon[30942]: Reconfiguring mon.a (unknown last config time)... 2024-09-19T04:23:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:06 smithi070 ceph-mon[30942]: Reconfiguring daemon mon.a on smithi070 2024-09-19T04:23:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:06 smithi070 ceph-mon[30942]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:06 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:23:06.945 DEBUG:teuthology.orchestra.run.smithi134:mgr.y> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.y.service 2024-09-19T04:23:06.948 DEBUG:teuthology.orchestra.run.smithi167:mgr.z> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.z.service 2024-09-19T04:23:06.987 INFO:tasks.cephadm:Deploying OSDs... 2024-09-19T04:23:06.987 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:23:06.987 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:23:07.005 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:23:07.005 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_1 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-19 04:22:25.757823847 +0000 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-19 04:18:13.750384031 +0000 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-19 04:18:13.750384031 +0000 2024-09-19T04:23:07.062 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-19 04:18:13.750384031 +0000 2024-09-19T04:23:07.063 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:23:07.128 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-19T04:23:07.128 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-19T04:23:07.128 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 9.9871e-05 s, 5.1 MB/s 2024-09-19T04:23:07.129 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:23:07.187 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_2 2024-09-19T04:23:07.243 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:23:07.243 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:07.243 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 686 Links: 1 2024-09-19T04:23:07.243 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:07.243 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:07.244 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-19 04:22:25.783823497 +0000 2024-09-19T04:23:07.244 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-19 04:18:14.075379777 +0000 2024-09-19T04:23:07.244 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-19 04:18:14.075379777 +0000 2024-09-19T04:23:07.244 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-19 04:18:14.075379777 +0000 2024-09-19T04:23:07.244 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:23:07.307 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-19T04:23:07.307 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-19T04:23:07.307 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 0.000113113 s, 4.5 MB/s 2024-09-19T04:23:07.309 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:23:07.366 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_3 2024-09-19T04:23:07.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:23:07.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:07.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:07.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:07.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: Reconfiguring daemon mon.b on smithi134 2024-09-19T04:23:07.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi134=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:07.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: Saving service mgr spec with placement smithi070=x;smithi134=y;smithi167=z;count:3 2024-09-19T04:23:07.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 706 Links: 1 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-19 04:22:25.810823135 +0000 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-19 04:18:14.382375759 +0000 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-19 04:18:14.382375759 +0000 2024-09-19T04:23:07.411 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-19 04:18:14.382375759 +0000 2024-09-19T04:23:07.411 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:23:07.474 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-19T04:23:07.474 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-19T04:23:07.474 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 9.4864e-05 s, 5.4 MB/s 2024-09-19T04:23:07.475 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:23:07.531 DEBUG:teuthology.orchestra.run.smithi070:> stat /dev/vg_nvme/lv_4 2024-09-19T04:23:07.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:23:07.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:07.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:07.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:07.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: Reconfiguring daemon mon.b on smithi134 2024-09-19T04:23:07.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi134=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:07.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: Saving service mgr spec with placement smithi070=x;smithi134=y;smithi167=z;count:3 2024-09-19T04:23:07.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.586 INFO:teuthology.orchestra.run.smithi070.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:23:07.587 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:07.587 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-09-19T04:23:07.587 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:07.587 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:07.587 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-19 04:22:25.835822799 +0000 2024-09-19T04:23:07.587 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-19 04:18:14.696371650 +0000 2024-09-19T04:23:07.587 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-19 04:18:14.696371650 +0000 2024-09-19T04:23:07.587 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: 2024-09-19 04:18:14.696371650 +0000 2024-09-19T04:23:07.587 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:23:07.650 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records in 2024-09-19T04:23:07.651 INFO:teuthology.orchestra.run.smithi070.stderr:1+0 records out 2024-09-19T04:23:07.651 INFO:teuthology.orchestra.run.smithi070.stderr:512 bytes copied, 9.4977e-05 s, 5.4 MB/s 2024-09-19T04:23:07.652 DEBUG:teuthology.orchestra.run.smithi070:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:23:07.709 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-09-19T04:23:07.709 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:23:07.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: Reconfiguring mon.b (monmap changed)... 2024-09-19T04:23:07.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:07.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:07.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:07.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: Reconfiguring daemon mon.b on smithi134 2024-09-19T04:23:07.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: from='client.24100 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi070=x;smithi134=y;smithi167=z", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:07.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: Saving service mgr spec with placement smithi070=x;smithi134=y;smithi167=z;count:3 2024-09-19T04:23:07.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:07.725 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:23:07.725 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-09-19T04:23:07.780 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:23:07.780 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:07.780 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T04:23:07.781 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:07.781 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:07.781 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-19 04:22:56.893646834 +0000 2024-09-19T04:23:07.781 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-19 04:18:16.005130959 +0000 2024-09-19T04:23:07.781 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-19 04:18:16.005130959 +0000 2024-09-19T04:23:07.781 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-19 04:18:16.005130959 +0000 2024-09-19T04:23:07.781 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:23:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-19T04:23:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-19T04:23:07.845 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000194646 s, 2.6 MB/s 2024-09-19T04:23:07.846 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:23:07.902 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-09-19T04:23:07.957 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:23:07.957 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:07.958 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T04:23:07.958 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:07.958 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:07.958 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-19 04:22:56.894646811 +0000 2024-09-19T04:23:07.958 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-19 04:18:16.344123112 +0000 2024-09-19T04:23:07.958 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-19 04:18:16.344123112 +0000 2024-09-19T04:23:07.958 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-19 04:18:16.344123112 +0000 2024-09-19T04:23:07.958 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:23:08.021 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-19T04:23:08.021 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-19T04:23:08.021 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000201911 s, 2.5 MB/s 2024-09-19T04:23:08.023 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:23:08.079 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-09-19T04:23:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:23:08.134 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:08.134 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T04:23:08.134 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:08.134 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:08.134 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-19 04:22:56.894646811 +0000 2024-09-19T04:23:08.135 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-19 04:18:16.670115566 +0000 2024-09-19T04:23:08.135 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-19 04:18:16.670115566 +0000 2024-09-19T04:23:08.135 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-19 04:18:16.670115566 +0000 2024-09-19T04:23:08.135 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:23:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-19T04:23:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-19T04:23:08.197 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000200524 s, 2.6 MB/s 2024-09-19T04:23:08.198 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:23:08.254 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-09-19T04:23:08.309 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:23:08.309 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:08.309 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T04:23:08.310 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:08.310 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:08.310 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-09-19 04:22:56.894646811 +0000 2024-09-19T04:23:08.310 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-09-19 04:18:16.998107973 +0000 2024-09-19T04:23:08.310 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-09-19 04:18:16.998107973 +0000 2024-09-19T04:23:08.310 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: 2024-09-19 04:18:16.998107973 +0000 2024-09-19T04:23:08.310 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:23:08.373 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-09-19T04:23:08.373 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-09-19T04:23:08.373 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000185356 s, 2.8 MB/s 2024-09-19T04:23:08.375 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:23:08.431 DEBUG:teuthology.orchestra.run.smithi167:> set -ex 2024-09-19T04:23:08.431 DEBUG:teuthology.orchestra.run.smithi167:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T04:23:08.447 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T04:23:08.447 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_1 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-19 04:22:47.700062139 +0000 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-19 04:18:18.942515780 +0000 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-19 04:18:18.942515780 +0000 2024-09-19T04:23:08.502 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-19 04:18:18.942515780 +0000 2024-09-19T04:23:08.502 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T04:23:08.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:08 smithi134 ceph-mon[34525]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:08.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:08.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:08.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:08.564 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:08 smithi167 ceph-mon[34339]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:08.564 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.565 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.565 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.565 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:08.565 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:08.565 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:08.567 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-19T04:23:08.567 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-19T04:23:08.567 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000288377 s, 1.8 MB/s 2024-09-19T04:23:08.568 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T04:23:08.625 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_2 2024-09-19T04:23:08.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:08 smithi070 ceph-mon[30942]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:08.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:08.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-09-19T04:23:08.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-09-19T04:23:08.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-19 04:22:47.701062122 +0000 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-19 04:18:19.282509906 +0000 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-19 04:18:19.282509906 +0000 2024-09-19T04:23:08.680 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-19 04:18:19.282509906 +0000 2024-09-19T04:23:08.681 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T04:23:08.743 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-19T04:23:08.743 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-19T04:23:08.744 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000198446 s, 2.6 MB/s 2024-09-19T04:23:08.745 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T04:23:08.801 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_3 2024-09-19T04:23:08.857 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T04:23:08.857 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:08.857 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T04:23:08.858 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:08.858 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:08.858 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-19 04:22:47.701062122 +0000 2024-09-19T04:23:08.858 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-19 04:18:19.622504032 +0000 2024-09-19T04:23:08.858 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-19 04:18:19.622504032 +0000 2024-09-19T04:23:08.858 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-19 04:18:19.622504032 +0000 2024-09-19T04:23:08.858 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T04:23:08.920 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-19T04:23:08.921 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-19T04:23:08.921 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000224186 s, 2.3 MB/s 2024-09-19T04:23:08.922 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T04:23:08.979 DEBUG:teuthology.orchestra.run.smithi167:> stat /dev/vg_nvme/lv_4 2024-09-19T04:23:09.035 INFO:teuthology.orchestra.run.smithi167.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T04:23:09.035 INFO:teuthology.orchestra.run.smithi167.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T04:23:09.035 INFO:teuthology.orchestra.run.smithi167.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-09-19T04:23:09.035 INFO:teuthology.orchestra.run.smithi167.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:23:09.035 INFO:teuthology.orchestra.run.smithi167.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T04:23:09.035 INFO:teuthology.orchestra.run.smithi167.stdout:Access: 2024-09-19 04:22:47.701062122 +0000 2024-09-19T04:23:09.036 INFO:teuthology.orchestra.run.smithi167.stdout:Modify: 2024-09-19 04:18:19.956498263 +0000 2024-09-19T04:23:09.036 INFO:teuthology.orchestra.run.smithi167.stdout:Change: 2024-09-19 04:18:19.956498263 +0000 2024-09-19T04:23:09.036 INFO:teuthology.orchestra.run.smithi167.stdout: Birth: 2024-09-19 04:18:19.956498263 +0000 2024-09-19T04:23:09.036 DEBUG:teuthology.orchestra.run.smithi167:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T04:23:09.099 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records in 2024-09-19T04:23:09.099 INFO:teuthology.orchestra.run.smithi167.stderr:1+0 records out 2024-09-19T04:23:09.099 INFO:teuthology.orchestra.run.smithi167.stderr:512 bytes copied, 0.000193896 s, 2.6 MB/s 2024-09-19T04:23:09.100 DEBUG:teuthology.orchestra.run.smithi167:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T04:23:09.157 INFO:tasks.cephadm:Deploying osd.0 on smithi070 with /dev/vg_nvme/lv_4... 2024-09-19T04:23:09.157 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:23:09.404 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:23:09.509 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: Reconfiguring daemon mon.c on smithi167 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:09.510 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:09.654 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:23:09.665 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: Reconfiguring daemon mon.c on smithi167 2024-09-19T04:23:09.665 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.665 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.665 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:09.665 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:09.665 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:09.666 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.666 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:09.666 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:23:09.666 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:09.666 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: Reconfiguring mon.c (monmap changed)... 2024-09-19T04:23:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: Reconfiguring daemon mon.c on smithi167 2024-09-19T04:23:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:09.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:09.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:09.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:09.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:09.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:23:09.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:09.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:10.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:10 smithi070 ceph-mon[30942]: Deploying daemon mgr.z on smithi167 2024-09-19T04:23:10.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:10 smithi070 ceph-mon[30942]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:10.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:10 smithi167 ceph-mon[34339]: Deploying daemon mgr.z on smithi167 2024-09-19T04:23:10.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:10 smithi167 ceph-mon[34339]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:10 smithi134 ceph-mon[34525]: Deploying daemon mgr.z on smithi167 2024-09-19T04:23:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:10 smithi134 ceph-mon[34525]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:11.355 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:11.285+0000 7f8806064040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:23:11.356 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:11.353+0000 7f8806064040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:23:11.682 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:23:11.706 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_4 2024-09-19T04:23:11.710 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:11.501+0000 7f8806064040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:23:11.710 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:11.566+0000 7f8806064040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:23:11.948 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:23:12.163 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:11.711+0000 7f8806064040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:23:12.163 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:11.849+0000 7f8806064040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:23:12.163 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:12.161+0000 7f8806064040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- 172.21.15.70:0/1975055833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 msgr2=0x7f7594100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 --2- 172.21.15.70:0/1975055833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 0x7f7594100ed0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f758c009900 tx=0x7f758c02a410 comp rx=0 tx=0).stop 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- 172.21.15.70:0/1975055833 shutdown_connections 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 --2- 172.21.15.70:0/1975055833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7594102690 0x7f7594108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 --2- 172.21.15.70:0/1975055833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7594101cd0 0x7f7594102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 --2- 172.21.15.70:0/1975055833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 0x7f7594100ed0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- 172.21.15.70:0/1975055833 >> 172.21.15.70:0/1975055833 conn(0x7f75940fc280 msgr2=0x7f75940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- 172.21.15.70:0/1975055833 shutdown_connections 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- 172.21.15.70:0/1975055833 wait complete. 2024-09-19T04:23:12.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 Processor -- start 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- start start 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 0x7f759406bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7594101cd0 0x7f759406c520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7594102690 0x7f75940735a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f759410c780 con 0x7f7594100ad0 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f759410c600 con 0x7f7594102690 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f759abcc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f759410c900 con 0x7f7594101cd0 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.372+0000 7f7598968640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 0x7f759406bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7598968640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 0x7f759406bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43286/0 (socket says 172.21.15.70:43286) 2024-09-19T04:23:12.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7598968640 1 -- 172.21.15.70:0/3726928234 learned_addr learned my addr 172.21.15.70:0/3726928234 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7593fff640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7594101cd0 0x7f759406c520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7599169640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7594102690 0x7f75940735a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7598968640 1 -- 172.21.15.70:0/3726928234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7594101cd0 msgr2=0x7f759406c520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7598968640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7594101cd0 0x7f759406c520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7598968640 1 -- 172.21.15.70:0/3726928234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7594102690 msgr2=0x7f75940735a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7598968640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7594102690 0x7f75940735a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7598968640 1 -- 172.21.15.70:0/3726928234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7594073c10 con 0x7f7594100ad0 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7598968640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 0x7f759406bfe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f758c02a930 tx=0x7f758c004ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c035070 con 0x7f7594100ad0 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f758c005330 con 0x7f7594100ad0 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7594073ea0 con 0x7f7594100ad0 2024-09-19T04:23:12.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f758c003a10 con 0x7f7594100ad0 2024-09-19T04:23:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.373+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7594069f70 con 0x7f7594100ad0 2024-09-19T04:23:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.374+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 13) ==== 46517+0+0 (secure 0 0 0) 0x7f758c003bb0 con 0x7f7594100ad0 2024-09-19T04:23:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.374+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f759406a990 con 0x7f7594100ad0 2024-09-19T04:23:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.374+0000 7f7591ffb640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7580039500 0x7f758003b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.375+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f758c06e9e0 con 0x7f7594100ad0 2024-09-19T04:23:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.375+0000 7f7593fff640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7580039500 0x7f758003b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.375+0000 7f7593fff640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7580039500 0x7f758003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f759406d500 tx=0x7f7584009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:12.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.379+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f758c0461c0 con 0x7f7594100ad0 2024-09-19T04:23:12.461 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:12.220+0000 7f8806064040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:23:12.461 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:12.405+0000 7f8806064040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:23:12.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:12.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:12.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:23:12.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:12.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:12.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:12 smithi167 ceph-mon[34339]: Deploying daemon mgr.y on smithi134 2024-09-19T04:23:12.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:12.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:12.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:23:12.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:12.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:12.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:12 smithi134 ceph-mon[34525]: Deploying daemon mgr.y on smithi134 2024-09-19T04:23:12.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:12.555+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f7594107960 con 0x7f7580039500 2024-09-19T04:23:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-09-19T04:23:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:12.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:12 smithi070 ceph-mon[30942]: Deploying daemon mgr.y on smithi134 2024-09-19T04:23:13.461 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:13 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:23:13.461 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:13 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:23:13.461 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:13 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:13.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:13 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:23:13.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:13 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:23:13.614 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:13 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:13.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:13 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:23:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:13 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:23:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:13 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:13.711 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:13.277+0000 7f8806064040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:23:13.711 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:13.343+0000 7f8806064040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:23:13.921 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:13.763+0000 7f14bcb90040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:23:13.921 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:13.919+0000 7f14bcb90040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:23:14.285 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:13.988+0000 7f14bcb90040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:23:14.285 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:14.146+0000 7f14bcb90040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:23:14.352 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.086+0000 7f8806064040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:23:14.352 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.252+0000 7f8806064040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:23:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:14 smithi070 ceph-mon[30942]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:14 smithi070 ceph-mon[30942]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.545 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.546 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:14.599 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:14.297+0000 7f14bcb90040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:23:14.599 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-mon[34525]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:14.599 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-mon[34525]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:14.599 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.599 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.599 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.599 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.599 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:14.630 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-mon[34339]: from='client.14217 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:14.630 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-mon[34339]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:14.630 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.630 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.630 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.630 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:14.630 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:14.631 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.408+0000 7f8806064040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:23:14.631 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.472+0000 7f8806064040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:23:14.631 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.627+0000 7f8806064040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:23:14.871 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:14.623+0000 7f14bcb90040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:23:14.872 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:14.683+0000 7f14bcb90040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:23:14.928 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.697+0000 7f8806064040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:23:14.928 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.757+0000 7f8806064040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:23:15.208 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.926+0000 7f8806064040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:23:15.208 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:14.992+0000 7f8806064040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:23:15.208 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:15.060+0000 7f8806064040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:23:15.208 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:15.144+0000 7f8806064040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:23:15.208 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:15.205+0000 7f8806064040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:23:15.285 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:14.870+0000 7f14bcb90040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:23:15.461 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:15.264+0000 7f8806064040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:23:16.035 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:15.760+0000 7f14bcb90040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:23:16.035 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:15.827+0000 7f14bcb90040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1707620332' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f4e9a42-7846-4760-aaa3-fd08543625d3"}]: dispatch 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1707620332' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f4e9a42-7846-4760-aaa3-fd08543625d3"}]': finished 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:23:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: Reconfiguring daemon mgr.x on smithi070 2024-09-19T04:23:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:15 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/54169381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:23:16.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1707620332' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f4e9a42-7846-4760-aaa3-fd08543625d3"}]: dispatch 2024-09-19T04:23:16.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1707620332' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f4e9a42-7846-4760-aaa3-fd08543625d3"}]': finished 2024-09-19T04:23:16.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:23:16.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: Reconfiguring daemon mgr.x on smithi070 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:16.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:15 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/54169381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:23:16.210 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:23:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:23:16.048+0000 7f8806064040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1707620332' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4f4e9a42-7846-4760-aaa3-fd08543625d3"}]: dispatch 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1707620332' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4f4e9a42-7846-4760-aaa3-fd08543625d3"}]': finished 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: osdmap e5: 1 total, 0 up, 1 in 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:16.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:16.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: Reconfiguring mgr.x (unknown last config time)... 2024-09-19T04:23:16.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-09-19T04:23:16.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-09-19T04:23:16.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:16.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: Reconfiguring daemon mgr.x on smithi070 2024-09-19T04:23:16.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:16.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:15 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/54169381' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:23:16.798 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:16.541+0000 7f14bcb90040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:23:16.798 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:16.655+0000 7f14bcb90040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:23:16.798 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:16.796+0000 7f14bcb90040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:23:16.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:16.985+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 14) ==== 92408+0+0 (secure 0 0 0) 0x7f758c0054e0 con 0x7f7594100ad0 2024-09-19T04:23:17.075 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-mon[34525]: Standby manager daemon z started 2024-09-19T04:23:17.075 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:23:17.075 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:23:17.075 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:23:17.075 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:23:17.076 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:16.857+0000 7f14bcb90040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:23:17.076 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.006+0000 7f14bcb90040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:23:17.076 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.073+0000 7f14bcb90040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:23:17.354 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.132+0000 7f14bcb90040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:23:17.354 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.288+0000 7f14bcb90040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:23:17.354 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.352+0000 7f14bcb90040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:23:17.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:16 smithi070 ceph-mon[30942]: Standby manager daemon z started 2024-09-19T04:23:17.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:16 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:23:17.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:16 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:23:17.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:16 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:23:17.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:16 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:23:17.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:16 smithi167 ceph-mon[34339]: Standby manager daemon z started 2024-09-19T04:23:17.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:16 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:23:17.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:16 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:23:17.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:16 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:23:17.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:16 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.167:0/33123435' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:23:17.620 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.418+0000 7f14bcb90040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:23:17.620 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.501+0000 7f14bcb90040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:23:17.620 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.559+0000 7f14bcb90040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:23:17.620 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:17.618+0000 7f14bcb90040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:23:18.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-mon[34525]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T04:23:18.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:23:18.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-mon[34525]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:18.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:18.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:17 smithi070 ceph-mon[30942]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T04:23:18.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:23:18.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:17 smithi070 ceph-mon[30942]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:18.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:18.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:17 smithi167 ceph-mon[34339]: mgrmap e14: x(active, since 59s), standbys: z 2024-09-19T04:23:18.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:23:18.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:17 smithi167 ceph-mon[34339]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:18.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:18.785 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:23:18 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:23:18.403+0000 7f14bcb90040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:23:18.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:18.997+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f758c040370 con 0x7f7594100ad0 2024-09-19T04:23:19.288 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:18 smithi134 ceph-mon[34525]: Standby manager daemon y started 2024-09-19T04:23:19.288 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:18 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:23:19.288 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:18 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:23:19.288 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:18 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:23:19.288 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:18 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:23:19.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:18 smithi070 ceph-mon[30942]: Standby manager daemon y started 2024-09-19T04:23:19.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:18 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:23:19.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:18 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:23:19.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:18 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:23:19.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:18 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:23:19.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:18 smithi167 ceph-mon[34339]: Standby manager daemon y started 2024-09-19T04:23:19.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:18 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:23:19.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:18 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:23:19.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:18 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:23:19.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:18 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.134:0/1900598980' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:23:20.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:20 smithi134 ceph-mon[34525]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-09-19T04:23:20.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:23:20.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:20 smithi134 ceph-mon[34525]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:20.304 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:20 smithi070 ceph-mon[30942]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-09-19T04:23:20.304 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:23:20.304 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:20 smithi070 ceph-mon[30942]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:20 smithi167 ceph-mon[34339]: mgrmap e15: x(active, since 61s), standbys: z, y 2024-09-19T04:23:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:23:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:20 smithi167 ceph-mon[34339]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:22 smithi070 ceph-mon[30942]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:22 smithi167 ceph-mon[34339]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:22 smithi134 ceph-mon[34525]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:23.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:23 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:23.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:23 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:23.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:23 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:23.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:23 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:23.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:23 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:23.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:23 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:23.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:23 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:23.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:23 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:23.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:23 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:24 smithi070 ceph-mon[30942]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:23:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:24 smithi134 ceph-mon[34525]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:23:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:24.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:24 smithi167 ceph-mon[34339]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:24.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-09-19T04:23:24.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:25.627 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:25 smithi070 ceph-mon[30942]: Deploying daemon osd.0 on smithi070 2024-09-19T04:23:25.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:25 smithi134 ceph-mon[34525]: Deploying daemon osd.0 on smithi070 2024-09-19T04:23:25.862 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:25 smithi167 ceph-mon[34339]: Deploying daemon osd.0 on smithi070 2024-09-19T04:23:26.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:26 smithi070 ceph-mon[30942]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:26.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:26 smithi134 ceph-mon[34525]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:26.874 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:26 smithi167 ceph-mon[34339]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:28 smithi134 ceph-mon[34525]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:28.891 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:28 smithi070 ceph-mon[30942]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:28.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:28 smithi167 ceph-mon[34339]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:30 smithi134 ceph-mon[34525]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:30.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:30 smithi070 ceph-mon[30942]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:30.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:30.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:30.870 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:30.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:30 smithi167 ceph-mon[34339]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:30.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:32 smithi070 ceph-mon[30942]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:32.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:32 smithi134 ceph-mon[34525]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:32.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:32 smithi167 ceph-mon[34339]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:34.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:34.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:34.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:33 smithi070 ceph-mon[30942]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:34.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:34.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:34.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:33 smithi167 ceph-mon[34339]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:34.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:34.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:34.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:34.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:33 smithi134 ceph-mon[34525]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:34.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.466+0000 7f7591ffb640 1 -- 172.21.15.70:0/3726928234 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f7594107960 con 0x7f7580039500 2024-09-19T04:23:34.468 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 0 on host 'smithi070' 2024-09-19T04:23:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7580039500 msgr2=0x7f758003b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7580039500 0x7f758003b9c0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f759406d500 tx=0x7f7584009680 comp rx=0 tx=0).stop 2024-09-19T04:23:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 msgr2=0x7f759406bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 0x7f759406bfe0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f758c02a930 tx=0x7f758c004ef0 comp rx=0 tx=0).stop 2024-09-19T04:23:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 shutdown_connections 2024-09-19T04:23:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7580039500 0x7f758003b9c0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7594102690 0x7f75940735a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:34.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7594101cd0 0x7f759406c520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:34.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 --2- 172.21.15.70:0/3726928234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7594100ad0 0x7f759406bfe0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:34.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 >> 172.21.15.70:0/3726928234 conn(0x7f75940fc280 msgr2=0x7f7594105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:34.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 shutdown_connections 2024-09-19T04:23:34.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:23:34.468+0000 7f759abcc640 1 -- 172.21.15.70:0/3726928234 wait complete. 2024-09-19T04:23:35.076 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:35.076 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:35.076 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:35.112 DEBUG:teuthology.orchestra.run.smithi070:osd.0> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.0.service 2024-09-19T04:23:35.115 INFO:tasks.cephadm:Deploying osd.1 on smithi134 with /dev/vg_nvme/lv_4... 2024-09-19T04:23:35.115 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:23:35.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:35.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:35.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:35.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:35.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:35.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:35.351 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:23:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:35 smithi134 ceph-mon[34525]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:36.184 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:35 smithi070 ceph-mon[30942]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:36.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:35 smithi167 ceph-mon[34339]: pgmap v34: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:36 smithi134 ceph-mon[34525]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:23:37.138 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:36 smithi070 ceph-mon[30942]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:23:37.139 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:23:36 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0[41985]: 2024-09-19T04:23:36.736+0000 7f1f5ad56640 -1 osd.0 0 log_to_monitors true 2024-09-19T04:23:37.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:36 smithi167 ceph-mon[34339]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-09-19T04:23:37.734 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:23:37.760 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-09-19T04:23:38.006 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:23:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:23:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:23:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:23:38.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:23:38.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:23:38.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:38.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:38.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:38.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:38.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:38.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: osdmap e6: 1 total, 0 up, 1 in 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: pgmap v36: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:23:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:38.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:38.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:38.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.431+0000 7f4cc1c29640 1 -- 172.21.15.134:0/3306102288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc100b00 msgr2=0x7f4cbc100f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:38.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.431+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/3306102288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc100b00 0x7f4cbc100f00 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f4cac009900 tx=0x7f4cac02a410 comp rx=0 tx=0).stop 2024-09-19T04:23:38.433 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.432+0000 7f4cc1c29640 1 -- 172.21.15.134:0/3306102288 shutdown_connections 2024-09-19T04:23:38.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.432+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/3306102288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cbc1026c0 0x7f4cbc108f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:38.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.432+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/3306102288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cbc101d00 0x7f4cbc102180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:38.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.432+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/3306102288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc100b00 0x7f4cbc100f00 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:38.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.432+0000 7f4cc1c29640 1 -- 172.21.15.134:0/3306102288 >> 172.21.15.134:0/3306102288 conn(0x7f4cbc0fc290 msgr2=0x7f4cbc0fe6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:38.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.432+0000 7f4cc1c29640 1 -- 172.21.15.134:0/3306102288 shutdown_connections 2024-09-19T04:23:38.434 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.432+0000 7f4cc1c29640 1 -- 172.21.15.134:0/3306102288 wait complete. 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.432+0000 7f4cc1c29640 1 Processor -- start 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cc1c29640 1 -- start start 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cc1c29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cbc100b00 0x7f4cbc196e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cc1c29640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc101d00 0x7f4cbc197360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cc1c29640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cbc1026c0 0x7f4cbc19e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cc1c29640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc10c760 con 0x7f4cbc100b00 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cc1c29640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc10c5e0 con 0x7f4cbc101d00 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cc1c29640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4cbc10c8e0 con 0x7f4cbc1026c0 2024-09-19T04:23:38.436 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc101d00 0x7f4cbc197360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc101d00 0x7f4cbc197360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:39226/0 (socket says 172.21.15.134:39226) 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbaffd640 1 -- 172.21.15.134:0/4199408626 learned_addr learned my addr 172.21.15.134:0/4199408626 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbbfff640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cbc1026c0 0x7f4cbc19e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbb7fe640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cbc100b00 0x7f4cbc196e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbaffd640 1 -- 172.21.15.134:0/4199408626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cbc1026c0 msgr2=0x7f4cbc19e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbaffd640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cbc1026c0 0x7f4cbc19e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbaffd640 1 -- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cbc100b00 msgr2=0x7f4cbc196e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbaffd640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cbc100b00 0x7f4cbc196e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.433+0000 7f4cbaffd640 1 -- 172.21.15.134:0/4199408626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cbc19ea50 con 0x7f4cbc101d00 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.434+0000 7f4cbaffd640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc101d00 0x7f4cbc197360 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000eb00 tx=0x7f4cb0009f20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.434+0000 7f4cb8ff9640 1 -- 172.21.15.134:0/4199408626 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb001c070 con 0x7f4cbc101d00 2024-09-19T04:23:38.437 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.434+0000 7f4cb8ff9640 1 -- 172.21.15.134:0/4199408626 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4cb000bc30 con 0x7f4cbc101d00 2024-09-19T04:23:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.434+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cbc06a7f0 con 0x7f4cbc101d00 2024-09-19T04:23:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.434+0000 7f4cb8ff9640 1 -- 172.21.15.134:0/4199408626 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb00166a0 con 0x7f4cbc101d00 2024-09-19T04:23:38.438 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.434+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cbc06ad80 con 0x7f4cbc101d00 2024-09-19T04:23:38.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.435+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4cbc100f00 con 0x7f4cbc101d00 2024-09-19T04:23:38.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.436+0000 7f4cb8ff9640 1 -- 172.21.15.134:0/4199408626 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7f4cb001f070 con 0x7f4cbc101d00 2024-09-19T04:23:38.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.437+0000 7f4cb8ff9640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4ca40a3260 0x7f4ca40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:23:38.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.437+0000 7f4cb8ff9640 1 -- 172.21.15.134:0/4199408626 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(7..7 src has 1..7) ==== 1487+0+0 (secure 0 0 0) 0x7f4cb00cf230 con 0x7f4cbc101d00 2024-09-19T04:23:38.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.437+0000 7f4cbb7fe640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4ca40a3260 0x7f4ca40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:23:38.439 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.437+0000 7f4cbb7fe640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4ca40a3260 0x7f4ca40a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4cac006010 tx=0x7f4cac031510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:23:38.442 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.441+0000 7f4cb8ff9640 1 -- 172.21.15.134:0/4199408626 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4cb009d490 con 0x7f4cbc101d00 2024-09-19T04:23:38.621 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:38.619+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f4cbc06afe0 con 0x7f4ca40a3260 2024-09-19T04:23:38.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0[41985]: 2024-09-19T04:23:38.609+0000 7f1f564b6640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T04:23:38.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0[41985]: 2024-09-19T04:23:38.612+0000 7f1f4eae8640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:23:39.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi070 2024-09-19T04:23:39.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-19T04:23:39.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:23:39.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:23:39.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:39.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:39.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' 2024-09-19T04:23:39.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:23:39.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:23:39.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:39.236 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi070 2024-09-19T04:23:39.236 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-19T04:23:39.236 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:23:39.236 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:23:39.236 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:39.236 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:39.236 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' 2024-09-19T04:23:39.236 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:23:39.237 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:23:39.237 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:39.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi070 2024-09-19T04:23:39.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi070 to 17088M 2024-09-19T04:23:39.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:23:39.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: osdmap e7: 1 total, 0 up, 1 in 2024-09-19T04:23:39.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:39.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:39.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: from='osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577]' entity='osd.0' 2024-09-19T04:23:39.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:23:39.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:23:39.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:40.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:39 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:23:40.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:39 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:23:40.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:39 smithi134 ceph-mon[34525]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:40.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:39 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:40.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:39 smithi134 ceph-mon[34525]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:40.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:39 smithi134 ceph-mon[34525]: osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] boot 2024-09-19T04:23:40.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:39 smithi134 ceph-mon[34525]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:23:40.191 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:39 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:40.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:39 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:23:40.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:39 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:23:40.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:39 smithi167 ceph-mon[34339]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:40.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:39 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:40.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:39 smithi167 ceph-mon[34339]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:40.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:39 smithi167 ceph-mon[34339]: osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] boot 2024-09-19T04:23:40.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:39 smithi167 ceph-mon[34339]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:23:40.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:39 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:40.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:39 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:23:40.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:39 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:23:40.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:39 smithi070 ceph-mon[30942]: from='client.24140 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:23:40.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:40.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:39 smithi070 ceph-mon[30942]: pgmap v38: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-09-19T04:23:40.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:39 smithi070 ceph-mon[30942]: osd.0 [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] boot 2024-09-19T04:23:40.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:39 smithi070 ceph-mon[30942]: osdmap e8: 1 total, 1 up, 1 in 2024-09-19T04:23:40.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:23:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:41 smithi134 ceph-mon[34525]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T04:23:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:41 smithi134 ceph-mon[34525]: from='client.? 172.21.15.134:0/1651607978' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]: dispatch 2024-09-19T04:23:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:41 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]: dispatch 2024-09-19T04:23:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:41 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]': finished 2024-09-19T04:23:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:41 smithi134 ceph-mon[34525]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:23:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:41 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:23:41.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:41 smithi134 ceph-mon[34525]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:41.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:41 smithi134 ceph-mon[34525]: from='client.? 172.21.15.134:0/702674308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:23:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:41 smithi070 ceph-mon[30942]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T04:23:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:41 smithi070 ceph-mon[30942]: from='client.? 172.21.15.134:0/1651607978' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]: dispatch 2024-09-19T04:23:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:41 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]: dispatch 2024-09-19T04:23:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:41 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]': finished 2024-09-19T04:23:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:41 smithi070 ceph-mon[30942]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:23:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:41 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:23:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:41 smithi070 ceph-mon[30942]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:41 smithi070 ceph-mon[30942]: from='client.? 172.21.15.134:0/702674308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:23:41.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:41 smithi167 ceph-mon[34339]: osdmap e9: 1 total, 1 up, 1 in 2024-09-19T04:23:41.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:41 smithi167 ceph-mon[34339]: from='client.? 172.21.15.134:0/1651607978' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]: dispatch 2024-09-19T04:23:41.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:41 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]: dispatch 2024-09-19T04:23:41.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:41 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "cbfe06a1-eca7-4785-8b9e-89a170a13ea2"}]': finished 2024-09-19T04:23:41.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:41 smithi167 ceph-mon[34339]: osdmap e10: 2 total, 1 up, 2 in 2024-09-19T04:23:41.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:41 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:23:41.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:41 smithi167 ceph-mon[34339]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:41.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:41 smithi167 ceph-mon[34339]: from='client.? 172.21.15.134:0/702674308' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:23:44.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:44 smithi070 ceph-mon[30942]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:44.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:44 smithi167 ceph-mon[34339]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:44 smithi134 ceph-mon[34525]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:46.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:46 smithi070 ceph-mon[30942]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:46.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:46 smithi167 ceph-mon[34339]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:46.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:46 smithi134 ceph-mon[34525]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:48.593 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:48 smithi134 ceph-mon[34525]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:48.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:48 smithi070 ceph-mon[30942]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:48.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:48 smithi167 ceph-mon[34339]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:50.517 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:50 smithi134 ceph-mon[34525]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:50.517 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:23:50.517 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:50.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:50 smithi070 ceph-mon[30942]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:50.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:23:50.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:50.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:50 smithi167 ceph-mon[34339]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:50.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-09-19T04:23:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:51.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:51 smithi070 ceph-mon[30942]: Deploying daemon osd.1 on smithi134 2024-09-19T04:23:51.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:51 smithi167 ceph-mon[34339]: Deploying daemon osd.1 on smithi134 2024-09-19T04:23:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:51 smithi134 ceph-mon[34525]: Deploying daemon osd.1 on smithi134 2024-09-19T04:23:52.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:52 smithi134 ceph-mon[34525]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:52.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:52 smithi070 ceph-mon[30942]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:52.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:52 smithi167 ceph-mon[34339]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:54.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:54 smithi134 ceph-mon[34525]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:54.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:54 smithi167 ceph-mon[34339]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:54.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:54 smithi070 ceph-mon[30942]: pgmap v48: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:56.479 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:56 smithi134 ceph-mon[34525]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:56.479 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:56 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:56.479 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:56 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:56.479 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:56 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:56.686 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:56 smithi070 ceph-mon[30942]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:56.686 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:56 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:56.686 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:56 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:56.686 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:56 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:56.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:56 smithi167 ceph-mon[34339]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:56 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:23:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:56 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:56 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:58 smithi167 ceph-mon[34339]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:23:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:58 smithi134 ceph-mon[34525]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:23:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:58 smithi070 ceph-mon[30942]: pgmap v50: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:23:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:23:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:23:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:23:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:23:59.949 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.948+0000 7f4cb8ff9640 1 -- 172.21.15.134:0/4199408626 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4cbc06afe0 con 0x7f4ca40a3260 2024-09-19T04:23:59.950 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 1 on host 'smithi134' 2024-09-19T04:23:59.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4ca40a3260 msgr2=0x7f4ca40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:59.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4ca40a3260 0x7f4ca40a5720 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f4cac006010 tx=0x7f4cac031510 comp rx=0 tx=0).stop 2024-09-19T04:23:59.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc101d00 msgr2=0x7f4cbc197360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc101d00 0x7f4cbc197360 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f4cb000eb00 tx=0x7f4cb0009f20 comp rx=0 tx=0).stop 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 shutdown_connections 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4ca40a3260 0x7f4ca40a5720 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cbc1026c0 0x7f4cbc19e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cbc101d00 0x7f4cbc197360 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 --2- 172.21.15.134:0/4199408626 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cbc100b00 0x7f4cbc196e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 >> 172.21.15.134:0/4199408626 conn(0x7f4cbc0fc290 msgr2=0x7f4cbc105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 shutdown_connections 2024-09-19T04:23:59.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:23:59.951+0000 7f4cc1c29640 1 -- 172.21.15.134:0/4199408626 wait complete. 2024-09-19T04:24:00.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:00 smithi134 ceph-mon[34525]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:00.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:00 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:00.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:00 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:00.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:00 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:00.642 DEBUG:teuthology.orchestra.run.smithi134:osd.1> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.1.service 2024-09-19T04:24:00.645 INFO:tasks.cephadm:Deploying osd.2 on smithi167 with /dev/vg_nvme/lv_4... 2024-09-19T04:24:00.645 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-09-19T04:24:00.673 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:00 smithi167 ceph-mon[34339]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:00.673 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:00 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:00.673 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:00 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:00.673 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:00 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:00.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:00 smithi070 ceph-mon[30942]: pgmap v51: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:00.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:00 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:00.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:00 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:00.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:00 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:00.899 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:24:02.286 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:02 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1[38969]: 2024-09-19T04:24:02.000+0000 7fceb7f62640 -1 osd.1 0 log_to_monitors true 2024-09-19T04:24:02.632 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:02 smithi167 ceph-mon[34339]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:02.633 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:02 smithi167 ceph-mon[34339]: from='osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:24:02.633 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:02 smithi167 ceph-mon[34339]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:24:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:02 smithi134 ceph-mon[34525]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:02 smithi134 ceph-mon[34525]: from='osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:24:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:02 smithi134 ceph-mon[34525]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:24:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:02 smithi070 ceph-mon[30942]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:02 smithi070 ceph-mon[30942]: from='osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:24:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:02 smithi070 ceph-mon[30942]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-09-19T04:24:03.346 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:24:03.379 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_4 2024-09-19T04:24:03.673 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:24:03.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.785 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1[38969]: 2024-09-19T04:24:03.418+0000 7fceb36c2640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T04:24:03.785 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1[38969]: 2024-09-19T04:24:03.421+0000 7fceafcfc640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:03.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-09-19T04:24:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:24:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: osdmap e11: 2 total, 1 up, 2 in 2024-09-19T04:24:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:24:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:03.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:03.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:03.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:03.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 -- 172.21.15.167:0/2422088535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 msgr2=0x7fa4c4100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/2422088535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 0x7fa4c4100ed0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa4b8009900 tx=0x7fa4b802a410 comp rx=0 tx=0).stop 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 -- 172.21.15.167:0/2422088535 shutdown_connections 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/2422088535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4102690 0x7fa4c4108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/2422088535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c4101cd0 0x7fa4c4102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/2422088535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 0x7fa4c4100ed0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 -- 172.21.15.167:0/2422088535 >> 172.21.15.167:0/2422088535 conn(0x7fa4c40fc280 msgr2=0x7fa4c40fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 -- 172.21.15.167:0/2422088535 shutdown_connections 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.154+0000 7fa4c8b44640 1 -- 172.21.15.167:0/2422088535 wait complete. 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c8b44640 1 Processor -- start 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c8b44640 1 -- start start 2024-09-19T04:24:04.159 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c8b44640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 0x7fa4c4196e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c8b44640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4101cd0 0x7fa4c41973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c8b44640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c4102690 0x7fa4c419e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c8b44640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c410c7f0 con 0x7fa4c4101cd0 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 0x7fa4c4196e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c8b44640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c410c670 con 0x7fa4c4102690 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c8b44640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa4c410c970 con 0x7fa4c4100ad0 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 0x7fa4c4196e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:40174/0 (socket says 172.21.15.167:40174) 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c259c640 1 -- 172.21.15.167:0/105422483 learned_addr learned my addr 172.21.15.167:0/105422483 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c2d9d640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c4102690 0x7fa4c419e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c1d9b640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4101cd0 0x7fa4c41973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:04.160 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c259c640 1 -- 172.21.15.167:0/105422483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c4102690 msgr2=0x7fa4c419e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c259c640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c4102690 0x7fa4c419e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.155+0000 7fa4c259c640 1 -- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4101cd0 msgr2=0x7fa4c41973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.156+0000 7fa4c259c640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4101cd0 0x7fa4c41973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.156+0000 7fa4c259c640 1 -- 172.21.15.167:0/105422483 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa4c419eaa0 con 0x7fa4c4100ad0 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.156+0000 7fa4c259c640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 0x7fa4c4196e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa4b802a930 tx=0x7fa4b8004f70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.156+0000 7fa4b37fe640 1 -- 172.21.15.167:0/105422483 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b803f070 con 0x7fa4c4100ad0 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.156+0000 7fa4b37fe640 1 -- 172.21.15.167:0/105422483 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa4b80055b0 con 0x7fa4c4100ad0 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.156+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa4c419ed30 con 0x7fa4c4100ad0 2024-09-19T04:24:04.161 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.156+0000 7fa4b37fe640 1 -- 172.21.15.167:0/105422483 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa4b8035030 con 0x7fa4c4100ad0 2024-09-19T04:24:04.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.156+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4c419f1c0 con 0x7fa4c4100ad0 2024-09-19T04:24:04.162 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.157+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa4c4107ea0 con 0x7fa4c4100ad0 2024-09-19T04:24:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.158+0000 7fa4b37fe640 1 -- 172.21.15.167:0/105422483 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fa4b8042070 con 0x7fa4c4100ad0 2024-09-19T04:24:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.159+0000 7fa4b37fe640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa4ac0a31e0 0x7fa4ac0a56a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.159+0000 7fa4b37fe640 1 -- 172.21.15.167:0/105422483 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2029+0+0 (secure 0 0 0) 0x7fa4b80eec30 con 0x7fa4c4100ad0 2024-09-19T04:24:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.159+0000 7fa4c1d9b640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa4ac0a31e0 0x7fa4ac0a56a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:04.163 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.160+0000 7fa4c1d9b640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa4ac0a31e0 0x7fa4ac0a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4198390 tx=0x7fa4b4009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:04.164 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.163+0000 7fa4b37fe640 1 -- 172.21.15.167:0/105422483 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa4b80bd2c0 con 0x7fa4c4100ad0 2024-09-19T04:24:04.344 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:04.342+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7fa4c4062630 con 0x7fa4ac0a31e0 2024-09-19T04:24:04.628 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi134 2024-09-19T04:24:04.628 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-19T04:24:04.629 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:04.629 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:24:04.629 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T04:24:04.629 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:04.629 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:04.629 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:04.629 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:04.629 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi134 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi134 2024-09-19T04:24:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi134 to 17088M 2024-09-19T04:24:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: pgmap v54: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:24:04.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: osdmap e12: 2 total, 1 up, 2 in 2024-09-19T04:24:04.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:04.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:04.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:04.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:04.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:05.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:05 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:24:05.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:05 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:24:05.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:05 smithi167 ceph-mon[34339]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:05.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:05 smithi167 ceph-mon[34339]: osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] boot 2024-09-19T04:24:05.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:05 smithi167 ceph-mon[34339]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T04:24:05.586 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:05.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:05 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:24:05.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:05 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:24:05.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:05 smithi134 ceph-mon[34525]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:05.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:05 smithi134 ceph-mon[34525]: osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] boot 2024-09-19T04:24:05.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:05 smithi134 ceph-mon[34525]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T04:24:05.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:05.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:05 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:24:05.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:05 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:24:05.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:05 smithi070 ceph-mon[30942]: from='client.24160 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:05.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:05 smithi070 ceph-mon[30942]: osd.1 [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] boot 2024-09-19T04:24:05.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:05 smithi070 ceph-mon[30942]: osdmap e13: 2 total, 2 up, 2 in 2024-09-19T04:24:05.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:24:06.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:06 smithi167 ceph-mon[34339]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:06.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:06 smithi167 ceph-mon[34339]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T04:24:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:06 smithi070 ceph-mon[30942]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:06 smithi070 ceph-mon[30942]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T04:24:06.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:06 smithi134 ceph-mon[34525]: pgmap v57: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-09-19T04:24:06.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:06 smithi134 ceph-mon[34525]: osdmap e14: 2 total, 2 up, 2 in 2024-09-19T04:24:07.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:07 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/1849789266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]: dispatch 2024-09-19T04:24:07.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:07 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]: dispatch 2024-09-19T04:24:07.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:07 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]': finished 2024-09-19T04:24:07.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:07 smithi134 ceph-mon[34525]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:24:07.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:07.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:07 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/1845088319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:07 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/1849789266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]: dispatch 2024-09-19T04:24:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:07 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]: dispatch 2024-09-19T04:24:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:07 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]': finished 2024-09-19T04:24:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:07 smithi070 ceph-mon[30942]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:24:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:07 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/1845088319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:07.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:07 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/1849789266' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]: dispatch 2024-09-19T04:24:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:07 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]: dispatch 2024-09-19T04:24:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:07 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "d4529395-6d0b-43a9-ab1c-00c5588e4bab"}]': finished 2024-09-19T04:24:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:07 smithi167 ceph-mon[34339]: osdmap e15: 3 total, 2 up, 3 in 2024-09-19T04:24:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:07 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/1845088319' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:08.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:08 smithi167 ceph-mon[34339]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:08.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:08 smithi134 ceph-mon[34525]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:08.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:08 smithi070 ceph-mon[30942]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:10.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:10 smithi167 ceph-mon[34339]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:10 smithi134 ceph-mon[34525]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:10.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:10 smithi070 ceph-mon[30942]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:12.553 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:12 smithi167 ceph-mon[34339]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:12 smithi134 ceph-mon[34525]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:12.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:12 smithi070 ceph-mon[30942]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:14 smithi134 ceph-mon[34525]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:14.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:14 smithi070 ceph-mon[30942]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:14.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:14 smithi167 ceph-mon[34339]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:15.735 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:24:15.736 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:24:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-09-19T04:24:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:16.776 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:16 smithi167 ceph-mon[34339]: Deploying daemon osd.2 on smithi167 2024-09-19T04:24:16.776 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:16 smithi167 ceph-mon[34339]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:16.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:16 smithi134 ceph-mon[34525]: Deploying daemon osd.2 on smithi167 2024-09-19T04:24:16.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:16 smithi134 ceph-mon[34525]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:16.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:16 smithi070 ceph-mon[30942]: Deploying daemon osd.2 on smithi167 2024-09-19T04:24:16.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:16 smithi070 ceph-mon[30942]: pgmap v64: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:18 smithi134 ceph-mon[34525]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:18.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:18 smithi070 ceph-mon[30942]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:18 smithi167 ceph-mon[34339]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:20.704 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:20 smithi167 ceph-mon[34339]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:20 smithi134 ceph-mon[34525]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:20.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:20 smithi070 ceph-mon[30942]: pgmap v66: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:21.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:21 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:21.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:21 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:21.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:21 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:21.796 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:21 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:21.796 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:21 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:21.796 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:21 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:21.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:21 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:21.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:21 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:21.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:21 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:22.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:22 smithi167 ceph-mon[34339]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:22 smithi134 ceph-mon[34525]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:22.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:22 smithi070 ceph-mon[30942]: pgmap v67: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:24.756 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:24 smithi167 ceph-mon[34339]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:24.756 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:24.756 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:24.756 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:24.756 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:24.756 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:24 smithi134 ceph-mon[34525]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:24.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:24 smithi070 ceph-mon[30942]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:24.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:24.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:24.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:24.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:24.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:25.355 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.354+0000 7fa4b37fe640 1 -- 172.21.15.167:0/105422483 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fa4c4062630 con 0x7fa4ac0a31e0 2024-09-19T04:24:25.355 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 2 on host 'smithi167' 2024-09-19T04:24:25.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa4ac0a31e0 msgr2=0x7fa4ac0a56a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:25.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa4ac0a31e0 0x7fa4ac0a56a0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fa4c4198390 tx=0x7fa4b4009110 comp rx=0 tx=0).stop 2024-09-19T04:24:25.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 msgr2=0x7fa4c4196e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:25.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 0x7fa4c4196e70 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fa4b802a930 tx=0x7fa4b8004f70 comp rx=0 tx=0).stop 2024-09-19T04:24:25.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 shutdown_connections 2024-09-19T04:24:25.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa4ac0a31e0 0x7fa4ac0a56a0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:25.357 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4c4102690 0x7fa4c419e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:25.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa4c4101cd0 0x7fa4c41973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:25.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 --2- 172.21.15.167:0/105422483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa4c4100ad0 0x7fa4c4196e70 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:25.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 >> 172.21.15.167:0/105422483 conn(0x7fa4c40fc280 msgr2=0x7fa4c4105070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:25.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 shutdown_connections 2024-09-19T04:24:25.358 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:24:25.356+0000 7fa4c8b44640 1 -- 172.21.15.167:0/105422483 wait complete. 2024-09-19T04:24:25.709 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:25 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:25.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:25 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:25.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:25 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:25.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:25 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:25.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:25 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:25.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:25 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:25 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:25 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:25 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:26.003 DEBUG:teuthology.orchestra.run.smithi167:osd.2> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.2.service 2024-09-19T04:24:26.005 INFO:tasks.cephadm:Deploying osd.3 on smithi070 with /dev/vg_nvme/lv_3... 2024-09-19T04:24:26.005 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:24:26.244 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:24:26.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:26 smithi070 ceph-mon[30942]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:26.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:26 smithi167 ceph-mon[34339]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:26.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:26 smithi134 ceph-mon[34525]: pgmap v69: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:27.670 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:27 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2[39317]: 2024-09-19T04:24:27.563+0000 7f318231d640 -1 osd.2 0 log_to_monitors true 2024-09-19T04:24:28.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:28 smithi070 ceph-mon[30942]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:28.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:28 smithi070 ceph-mon[30942]: from='osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:24:28.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:28 smithi070 ceph-mon[30942]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:24:28.692 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:24:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:28 smithi167 ceph-mon[34339]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:28 smithi167 ceph-mon[34339]: from='osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:24:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:28 smithi167 ceph-mon[34339]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:24:28.718 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_3 2024-09-19T04:24:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:28 smithi134 ceph-mon[34525]: pgmap v70: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:28 smithi134 ceph-mon[34525]: from='osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:24:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:28 smithi134 ceph-mon[34525]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-09-19T04:24:28.981 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:24:29.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 -- 172.21.15.70:0/3436974871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 msgr2=0x7fd20c102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 --2- 172.21.15.70:0/3436974871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 0x7fd20c102190 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7fd200009900 tx=0x7fd20002a410 comp rx=0 tx=0).stop 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 -- 172.21.15.70:0/3436974871 shutdown_connections 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 --2- 172.21.15.70:0/3436974871 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd20c1026d0 0x7fd20c108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 --2- 172.21.15.70:0/3436974871 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 0x7fd20c102190 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 --2- 172.21.15.70:0/3436974871 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c100b10 0x7fd20c100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 -- 172.21.15.70:0/3436974871 >> 172.21.15.70:0/3436974871 conn(0x7fd20c0fc2a0 msgr2=0x7fd20c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 -- 172.21.15.70:0/3436974871 shutdown_connections 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 -- 172.21.15.70:0/3436974871 wait complete. 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.426+0000 7fd211a6c640 1 Processor -- start 2024-09-19T04:24:29.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd211a6c640 1 -- start start 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd211a6c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd20c100b10 0x7fd20c197fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd211a6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 0x7fd20c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd211a6c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c1026d0 0x7fd20c19f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd211a6c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c10c870 con 0x7fd20c101d10 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd211a6c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c10c6f0 con 0x7fd20c1026d0 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd211a6c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd20c10c9f0 con 0x7fd20c100b10 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 0x7fd20c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 0x7fd20c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58184/0 (socket says 172.21.15.70:58184) 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 -- 172.21.15.70:0/1574846795 learned_addr learned my addr 172.21.15.70:0/1574846795 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20b7fe640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd20c100b10 0x7fd20c197fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:29.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 -- 172.21.15.70:0/1574846795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd20c100b10 msgr2=0x7fd20c197fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd20c100b10 0x7fd20c197fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 -- 172.21.15.70:0/1574846795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c1026d0 msgr2=0x7fd20c19f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20bfff640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c1026d0 0x7fd20c19f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c1026d0 0x7fd20c19f570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 -- 172.21.15.70:0/1574846795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd20c19fbe0 con 0x7fd20c101d10 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20b7fe640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd20c100b10 0x7fd20c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd20affd640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 0x7fd20c1984f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd20002a930 tx=0x7fd200004f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.427+0000 7fd208ff9640 1 -- 172.21.15.70:0/1574846795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd20003f070 con 0x7fd20c101d10 2024-09-19T04:24:29.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.428+0000 7fd208ff9640 1 -- 172.21.15.70:0/1574846795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd2000055b0 con 0x7fd20c101d10 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.428+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd20c19fe70 con 0x7fd20c101d10 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.428+0000 7fd208ff9640 1 -- 172.21.15.70:0/1574846795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd200035030 con 0x7fd20c101d10 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.428+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd20c1a0350 con 0x7fd20c101d10 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.429+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd20c1a0580 con 0x7fd20c101d10 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.430+0000 7fd208ff9640 1 -- 172.21.15.70:0/1574846795 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 15) ==== 138299+0+0 (secure 0 0 0) 0x7fd200042070 con 0x7fd20c101d10 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.430+0000 7fd208ff9640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1f40a3260 0x7fd1f40a5720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.430+0000 7fd20b7fe640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1f40a3260 0x7fd1f40a5720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.430+0000 7fd208ff9640 1 -- 172.21.15.70:0/1574846795 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 2445+0+0 (secure 0 0 0) 0x7fd2000eea80 con 0x7fd20c101d10 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.431+0000 7fd20b7fe640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1f40a3260 0x7fd1f40a5720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd20c101b70 tx=0x7fd1fc009570 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:29.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.434+0000 7fd208ff9640 1 -- 172.21.15.70:0/1574846795 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2000bcf70 con 0x7fd20c101d10 2024-09-19T04:24:29.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:29.613+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7fd20c06aea0 con 0x7fd1f40a3260 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:29.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:29.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:24:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T04:24:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:24:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:24:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.961 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2[39317]: 2024-09-19T04:24:29.503+0000 7f317da7d640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T04:24:29.961 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2[39317]: 2024-09-19T04:24:29.507+0000 7f317a0b7640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:24:29.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-09-19T04:24:29.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: osdmap e16: 3 total, 2 up, 3 in 2024-09-19T04:24:29.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:29.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:30.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi167 2024-09-19T04:24:30.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-19T04:24:30.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:30.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:24:30.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T04:24:30.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:30.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:30.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:30.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:30.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi167 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:30.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi167 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi167 to 17088M 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: pgmap v72: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: osdmap e17: 3 total, 2 up, 3 in 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:30.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:31 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:24:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:31 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:24:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:31 smithi070 ceph-mon[30942]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:31 smithi070 ceph-mon[30942]: osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] boot 2024-09-19T04:24:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:31 smithi070 ceph-mon[30942]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T04:24:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:31 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:31 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:24:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:31 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:24:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:31 smithi167 ceph-mon[34339]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:31 smithi167 ceph-mon[34339]: osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] boot 2024-09-19T04:24:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:31 smithi167 ceph-mon[34339]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T04:24:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:31 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:32.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:31 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:24:32.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:31 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:24:32.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:31 smithi134 ceph-mon[34525]: from='client.14295 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:32.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:31 smithi134 ceph-mon[34525]: osd.2 [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] boot 2024-09-19T04:24:32.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:31 smithi134 ceph-mon[34525]: osdmap e18: 3 total, 3 up, 3 in 2024-09-19T04:24:32.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:31 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:24:32.560 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:24:32 smithi070 sudo[46455]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:24:32.561 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:24:32 smithi070 sudo[46455]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:32.561 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:24:32 smithi070 sudo[46455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:32.561 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:24:32 smithi070 sudo[46455]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:32.867 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/79516854' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef"}]: dispatch 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/79516854' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef"}]': finished 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:32.868 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:32 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3167889825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:32.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:24:32 smithi070 sudo[46463]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:24:32.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:24:32 smithi070 sudo[46463]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:32.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:24:32 smithi070 sudo[46463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:32.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:24:32 smithi070 sudo[46463]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:24:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:24:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T04:24:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:24:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/79516854' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef"}]: dispatch 2024-09-19T04:24:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:24:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/79516854' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef"}]': finished 2024-09-19T04:24:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:24:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:32 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3167889825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: pgmap v75: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: osdmap e19: 3 total, 3 up, 3 in 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/79516854' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef"}]: dispatch 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/79516854' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef"}]': finished 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: osdmap e20: 4 total, 3 up, 4 in 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:32 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3167889825' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:33.123 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:32 smithi134 sudo[43088]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:24:33.124 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:32 smithi134 sudo[43088]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:33.124 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:32 smithi134 sudo[43088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:33.124 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:32 smithi134 sudo[43088]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:33.535 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:33 smithi134 sudo[43091]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:24:33.535 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:33 smithi134 sudo[43091]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:33.535 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:33 smithi134 sudo[43091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:33.535 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:24:33 smithi134 sudo[43091]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:33.645 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:33 smithi167 sudo[43079]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:24:33.645 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:33 smithi167 sudo[43079]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:33.645 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:33 smithi167 sudo[43079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:33.645 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:33 smithi167 sudo[43079]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:33.646 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:33.646 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:33 smithi167 ceph-mon[34339]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:24:33.646 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:33.646 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:33.646 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:33 smithi167 ceph-mon[34339]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 ceph-mon[30942]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:24:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 ceph-mon[30942]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:33.960 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:33 smithi167 sudo[43082]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:24:33.961 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:33 smithi167 sudo[43082]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:33.961 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:33 smithi167 sudo[43082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:33.961 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:24:33 smithi167 sudo[43082]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:33 smithi134 ceph-mon[34525]: osdmap e21: 4 total, 3 up, 4 in 2024-09-19T04:24:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:33 smithi134 ceph-mon[34525]: pgmap v79: 1 pgs: 1 unknown; 0 B data, 88 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:34.177 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 sudo[46699]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:24:34.177 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 sudo[46699]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:34.177 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 sudo[46699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:34.177 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:33 smithi070 sudo[46699]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:34.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:34.194+0000 7fd208ff9640 1 -- 172.21.15.70:0/1574846795 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd2000b8ee0 con 0x7fd20c101d10 2024-09-19T04:24:34.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 sudo[46886]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:24:34.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 sudo[46886]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:34.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 sudo[46886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:34.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 sudo[46886]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:34.676 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 sudo[43085]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:24:34.676 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 sudo[43085]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:34.676 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 sudo[43085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:34.676 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 sudo[43085]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 sudo[43088]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 sudo[43088]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 sudo[43088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 sudo[43088]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:34.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:34.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:34.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:34.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:34.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:34 smithi167 ceph-mon[34339]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:24:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:35.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:35.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:34 smithi070 ceph-mon[30942]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:24:35.171 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:34 smithi134 sudo[43094]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-09-19T04:24:35.171 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:34 smithi134 sudo[43094]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:35.171 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:34 smithi134 sudo[43094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:35.171 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:34 smithi134 sudo[43094]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:35.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 sudo[43097]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-09-19T04:24:35.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 sudo[43097]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-09-19T04:24:35.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 sudo[43097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-09-19T04:24:35.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 sudo[43097]: pam_unix(sudo:session): session closed for user root 2024-09-19T04:24:35.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:35.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-09-19T04:24:35.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:35 smithi167 ceph-mon[34339]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:35.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:35 smithi167 ceph-mon[34339]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:35.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:35 smithi167 ceph-mon[34339]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:35.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:35 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:35.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:35 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:35.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:35 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:35.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:35 smithi167 ceph-mon[34339]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:35.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:35 smithi167 ceph-mon[34339]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:36.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:35 smithi134 ceph-mon[34525]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:36.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:35 smithi070 ceph-mon[30942]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:36.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:35 smithi070 ceph-mon[30942]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:36.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:35 smithi070 ceph-mon[30942]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-09-19T04:24:36.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:35 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:24:36.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:35 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:24:36.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:35 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:24:36.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:35 smithi070 ceph-mon[30942]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-09-19T04:24:36.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:35 smithi070 ceph-mon[30942]: pgmap v80: 1 pgs: 1 unknown; 0 B data, 89 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:38.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:38 smithi167 ceph-mon[34339]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:38.527 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:38 smithi070 ceph-mon[30942]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:38 smithi134 ceph-mon[34525]: pgmap v81: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:40.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:40 smithi070 ceph-mon[30942]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:40.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:40 smithi167 ceph-mon[34339]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:40.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:40 smithi134 ceph-mon[34525]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 91 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:41.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:41 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:24:41.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:41 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:41.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:41 smithi070 ceph-mon[30942]: Deploying daemon osd.3 on smithi070 2024-09-19T04:24:41.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:41 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:24:41.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:41 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:41.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:41 smithi167 ceph-mon[34339]: Deploying daemon osd.3 on smithi070 2024-09-19T04:24:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:41 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-09-19T04:24:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:41 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:41 smithi134 ceph-mon[34525]: Deploying daemon osd.3 on smithi070 2024-09-19T04:24:42.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:42 smithi070 ceph-mon[30942]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:42 smithi167 ceph-mon[34339]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:42 smithi134 ceph-mon[34525]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:44.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:44 smithi167 ceph-mon[34339]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:44 smithi134 ceph-mon[34525]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:44.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:44 smithi070 ceph-mon[30942]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:46 smithi167 ceph-mon[34339]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:46 smithi134 ceph-mon[34525]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:46 smithi070 ceph-mon[30942]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:47.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:47.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:47.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:47.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:47.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:47.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:47.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:48.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:48 smithi070 ceph-mon[30942]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:48.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:48 smithi167 ceph-mon[34339]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:48 smithi134 ceph-mon[34525]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:49.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.942+0000 7fd208ff9640 1 -- 172.21.15.70:0/1574846795 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fd20c06aea0 con 0x7fd1f40a3260 2024-09-19T04:24:49.945 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 3 on host 'smithi070' 2024-09-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1f40a3260 msgr2=0x7fd1f40a5720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:49.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1f40a3260 0x7fd1f40a5720 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fd20c101b70 tx=0x7fd1fc009570 comp rx=0 tx=0).stop 2024-09-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 msgr2=0x7fd20c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 0x7fd20c1984f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fd20002a930 tx=0x7fd200004f70 comp rx=0 tx=0).stop 2024-09-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 shutdown_connections 2024-09-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1f40a3260 0x7fd1f40a5720 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd20c1026d0 0x7fd20c19f570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd20c101d10 0x7fd20c1984f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:49.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 --2- 172.21.15.70:0/1574846795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd20c100b10 0x7fd20c197fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 >> 172.21.15.70:0/1574846795 conn(0x7fd20c0fc2a0 msgr2=0x7fd20c06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 shutdown_connections 2024-09-19T04:24:49.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:24:49.945+0000 7fd211a6c640 1 -- 172.21.15.70:0/1574846795 wait complete. 2024-09-19T04:24:50.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:50 smithi070 ceph-mon[30942]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:50.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:50.532 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:50.561 DEBUG:teuthology.orchestra.run.smithi070:osd.3> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.3.service 2024-09-19T04:24:50.563 INFO:tasks.cephadm:Deploying osd.4 on smithi134 with /dev/vg_nvme/lv_3... 2024-09-19T04:24:50.563 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:24:50.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:50 smithi167 ceph-mon[34339]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:50 smithi134 ceph-mon[34525]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:50.815 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:24:51.880 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:51 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:51.880 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:51 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:51.880 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:51 smithi134 ceph-mon[34525]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:51.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:51 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:51.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:51 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:51.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:51 smithi070 ceph-mon[30942]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:51.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:51 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:51.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:51 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:51 smithi167 ceph-mon[34339]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:53.106 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:24:53.134 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-09-19T04:24:53.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:52 smithi070 ceph-mon[30942]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:24:53.145 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:24:52 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3[48477]: 2024-09-19T04:24:52.891+0000 7f1d2bd53640 -1 osd.3 0 log_to_monitors true 2024-09-19T04:24:53.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:52 smithi167 ceph-mon[34339]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:24:53.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:52 smithi134 ceph-mon[34525]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-09-19T04:24:53.393 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:24:53.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.846+0000 7f4b871f7640 1 -- 172.21.15.134:0/1463938127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 msgr2=0x7f4b80103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:53.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.846+0000 7f4b871f7640 1 --2- 172.21.15.134:0/1463938127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 0x7f4b80103280 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009900 tx=0x7f4b6c02a410 comp rx=0 tx=0).stop 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 -- 172.21.15.134:0/1463938127 shutdown_connections 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 --2- 172.21.15.134:0/1463938127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b801037c0 0x7f4b8010a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 --2- 172.21.15.134:0/1463938127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 0x7f4b80103280 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 --2- 172.21.15.134:0/1463938127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b80101c00 0x7f4b80102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 -- 172.21.15.134:0/1463938127 >> 172.21.15.134:0/1463938127 conn(0x7f4b800fd390 msgr2=0x7f4b800ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 -- 172.21.15.134:0/1463938127 shutdown_connections 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 -- 172.21.15.134:0/1463938127 wait complete. 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 Processor -- start 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.847+0000 7f4b871f7640 1 -- start start 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b871f7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b80101c00 0x7f4b80197ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b871f7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 0x7f4b80198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:53.865 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b871f7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801037c0 0x7f4b8019f490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b871f7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8010d8d0 con 0x7f4b801037c0 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b871f7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8010d750 con 0x7f4b80102e00 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b871f7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4b8010da50 con 0x7f4b80101c00 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 0x7f4b80198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 0x7f4b80198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:58622/0 (socket says 172.21.15.134:58622) 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 -- 172.21.15.134:0/2007391854 learned_addr learned my addr 172.21.15.134:0/2007391854 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b85794640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801037c0 0x7f4b8019f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 -- 172.21.15.134:0/2007391854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b80101c00 msgr2=0x7f4b80197ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b80101c00 0x7f4b80197ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 -- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801037c0 msgr2=0x7f4b8019f490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:24:53.866 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801037c0 0x7f4b8019f490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 -- 172.21.15.134:0/2007391854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b8019fb00 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b85794640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801037c0 0x7f4b8019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7ffff640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 0x7f4b80198410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009230 tx=0x7f4b6c004360 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7dffb640 1 -- 172.21.15.134:0/2007391854 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c03f030 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b8019fd90 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7dffb640 1 -- 172.21.15.134:0/2007391854 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4b6c003ac0 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.848+0000 7f4b7dffb640 1 -- 172.21.15.134:0/2007391854 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4b6c035070 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.849+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b801a02e0 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.850+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4b80109000 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.851+0000 7f4b7dffb640 1 -- 172.21.15.134:0/2007391854 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4b6c042030 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.852+0000 7f4b7dffb640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4b700a32f0 0x7f4b700a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.852+0000 7f4b7dffb640 1 -- 172.21.15.134:0/2007391854 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 3373+0+0 (secure 0 0 0) 0x7f4b6c0eedb0 con 0x7f4b80102e00 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.852+0000 7f4b84f93640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4b700a32f0 0x7f4b700a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:24:53.867 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.852+0000 7f4b84f93640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4b700a32f0 0x7f4b700a57b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b80102c60 tx=0x7f4b74005c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:24:53.868 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:53.856+0000 7f4b7dffb640 1 -- 172.21.15.134:0/2007391854 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4b6c0bce20 con 0x7f4b80102e00 2024-09-19T04:24:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:24:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:24:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:54.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:24:54.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T04:24:54.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:54.042 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:24:54.039+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f4b80062630 con 0x7f4b700a32f0 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T04:24:54.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:54.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-09-19T04:24:54.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: osdmap e22: 4 total, 3 up, 4 in 2024-09-19T04:24:54.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: pgmap v90: 1 pgs: 1 active+clean; 577 KiB data, 90 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:54.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:24:54.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:24:54.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:24:54.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: osdmap e23: 4 total, 3 up, 4 in 2024-09-19T04:24:54.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:54.895 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3[48477]: 2024-09-19T04:24:54.603+0000 7f1d274b3640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T04:24:54.895 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3[48477]: 2024-09-19T04:24:54.608+0000 7f1d1fae5640 -1 osd.3 24 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:24:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi070 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' 2024-09-19T04:24:55.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:54 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi070 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T04:24:55.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:55.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' 2024-09-19T04:24:55.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:54 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:55.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi070 2024-09-19T04:24:55.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi070 to 8544M 2024-09-19T04:24:55.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:55.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: from='client.24206 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:24:55.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:24:55.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:24:55.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:24:55.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: osdmap e24: 4 total, 3 up, 4 in 2024-09-19T04:24:55.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:55.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: from='osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763]' entity='osd.3' 2024-09-19T04:24:55.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:54 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] boot 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: from='client.? 172.21.15.134:0/1090602864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]: dispatch 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]: dispatch 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]': finished 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:24:56.623 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:56 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:24:56.625 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] boot 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: from='client.? 172.21.15.134:0/1090602864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]: dispatch 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]: dispatch 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]': finished 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:24:56.626 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:56 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: osd.3 [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] boot 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: osdmap e25: 4 total, 4 up, 4 in 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: from='client.? 172.21.15.134:0/1090602864' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]: dispatch 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]: dispatch 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81b280f6-42d4-4e66-91d5-8119a66b7e23"}]': finished 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: osdmap e26: 5 total, 4 up, 5 in 2024-09-19T04:24:56.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:56 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:24:57.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:57 smithi070 ceph-mon[30942]: from='client.? 172.21.15.134:0/4055377129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:57.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:57 smithi070 ceph-mon[30942]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:24:57.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:24:57.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:57 smithi167 ceph-mon[34339]: from='client.? 172.21.15.134:0/4055377129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:57.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:57 smithi167 ceph-mon[34339]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:24:57.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:24:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.134:0/4055377129' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:24:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:57 smithi134 ceph-mon[34525]: osdmap e27: 5 total, 4 up, 5 in 2024-09-19T04:24:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:24:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:58 smithi070 ceph-mon[30942]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:24:58.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:58 smithi167 ceph-mon[34339]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:24:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:58 smithi134 ceph-mon[34525]: pgmap v97: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:24:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:59 smithi070 ceph-mon[30942]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:24:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:24:59 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:24:59.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:59 smithi167 ceph-mon[34339]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:24:59.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:24:59 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:24:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:59 smithi134 ceph-mon[34525]: osdmap e28: 5 total, 4 up, 5 in 2024-09-19T04:24:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:24:59 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:00 smithi070 ceph-mon[30942]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:00 smithi070 ceph-mon[30942]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:25:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:00 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:00.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:00 smithi167 ceph-mon[34339]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:00.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:00 smithi167 ceph-mon[34339]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:25:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:00 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:00 smithi134 ceph-mon[34525]: pgmap v100: 1 pgs: 1 remapped+peering; 577 KiB data, 128 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:00 smithi134 ceph-mon[34525]: osdmap e29: 5 total, 4 up, 5 in 2024-09-19T04:25:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:00 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:02.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:02 smithi070 ceph-mon[30942]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T04:25:02.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:02 smithi167 ceph-mon[34339]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T04:25:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:02 smithi134 ceph-mon[34525]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 114 KiB/s, 0 objects/s recovering 2024-09-19T04:25:04.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:04 smithi070 ceph-mon[30942]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T04:25:04.673 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:04 smithi134 ceph-mon[34525]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T04:25:04.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:04 smithi167 ceph-mon[34339]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 95 KiB/s, 0 objects/s recovering 2024-09-19T04:25:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:25:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:05 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:05.651 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:25:05.651 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:05 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:05.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-09-19T04:25:05.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:05 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:06.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:06 smithi070 ceph-mon[30942]: Deploying daemon osd.4 on smithi134 2024-09-19T04:25:06.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:06 smithi070 ceph-mon[30942]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T04:25:06.523 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:06 smithi134 ceph-mon[34525]: Deploying daemon osd.4 on smithi134 2024-09-19T04:25:06.523 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:06 smithi134 ceph-mon[34525]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T04:25:06.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:06 smithi167 ceph-mon[34339]: Deploying daemon osd.4 on smithi134 2024-09-19T04:25:06.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:06 smithi167 ceph-mon[34339]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-09-19T04:25:08.532 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:08 smithi134 ceph-mon[34525]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T04:25:08.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:08 smithi070 ceph-mon[30942]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T04:25:08.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:08 smithi167 ceph-mon[34339]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 64 KiB/s, 0 objects/s recovering 2024-09-19T04:25:10.526 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:10 smithi134 ceph-mon[34525]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:25:10.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:10 smithi070 ceph-mon[30942]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:25:10.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:10 smithi167 ceph-mon[34339]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:25:11.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:11.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:11.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:11.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:11.729 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:11.729 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:11.729 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:12.621 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:12 smithi134 ceph-mon[34525]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:25:12.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:12 smithi070 ceph-mon[30942]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:25:12.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:12 smithi167 ceph-mon[34339]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:25:14.287 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.285+0000 7f4b7dffb640 1 -- 172.21.15.134:0/2007391854 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4b80062630 con 0x7f4b700a32f0 2024-09-19T04:25:14.287 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 4 on host 'smithi134' 2024-09-19T04:25:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4b700a32f0 msgr2=0x7f4b700a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4b700a32f0 0x7f4b700a57b0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f4b80102c60 tx=0x7f4b74005c90 comp rx=0 tx=0).stop 2024-09-19T04:25:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 msgr2=0x7f4b80198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 0x7f4b80198410 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c009230 tx=0x7f4b6c004360 comp rx=0 tx=0).stop 2024-09-19T04:25:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 shutdown_connections 2024-09-19T04:25:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4b700a32f0 0x7f4b700a57b0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4b801037c0 0x7f4b8019f490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.291 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4b80102e00 0x7f4b80198410 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 --2- 172.21.15.134:0/2007391854 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4b80101c00 0x7f4b80197ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 >> 172.21.15.134:0/2007391854 conn(0x7f4b800fd390 msgr2=0x7f4b801061d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.289+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 shutdown_connections 2024-09-19T04:25:14.292 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:25:14.290+0000 7f4b871f7640 1 -- 172.21.15.134:0/2007391854 wait complete. 2024-09-19T04:25:14.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:14 smithi134 ceph-mon[34525]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:14.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:14 smithi070 ceph-mon[30942]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:14.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:14 smithi167 ceph-mon[34339]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:14.919 DEBUG:teuthology.orchestra.run.smithi134:osd.4> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.4.service 2024-09-19T04:25:14.922 INFO:tasks.cephadm:Deploying osd.5 on smithi167 with /dev/vg_nvme/lv_3... 2024-09-19T04:25:14.922 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-09-19T04:25:15.178 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:25:16.489 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:16 smithi167 ceph-mon[34339]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:16.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:16 smithi070 ceph-mon[30942]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:16.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:16 smithi134 ceph-mon[34525]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:17.596 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:25:17.621 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_3 2024-09-19T04:25:17.744 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:25:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:25:17.417+0000 7f79c6cac640 -1 osd.4 0 log_to_monitors true 2024-09-19T04:25:17.876 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:25:18.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/4208533168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 msgr2=0x7f8bf810a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:18.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/4208533168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 0x7f8bf810a060 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f8bf0009ca0 tx=0x7f8bf002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:25:18.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/4208533168 shutdown_connections 2024-09-19T04:25:18.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/4208533168 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 0x7f8bf810a060 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:18.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/4208533168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8102e10 0x7f8bf8103290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/4208533168 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bf8101c10 0x7f8bf8102010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/4208533168 >> 172.21.15.167:0/4208533168 conn(0x7f8bf80fd3c0 msgr2=0x7f8bf80ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/4208533168 shutdown_connections 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.322+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/4208533168 wait complete. 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfe2b2640 1 Processor -- start 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfe2b2640 1 -- start start 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfe2b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8101c10 0x7f8bf8197d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfe2b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bf8102e10 0x7f8bf81982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfe2b2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 0x7f8bf819f310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfe2b2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf810d880 con 0x7f8bf8102e10 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfe2b2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf810d700 con 0x7f8bf8101c10 2024-09-19T04:25:18.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfe2b2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8bf810da00 con 0x7f8bf81037d0 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.323+0000 7f8bfc84f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 0x7f8bf819f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfc84f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 0x7f8bf819f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:46610/0 (socket says 172.21.15.167:46610) 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfc84f640 1 -- 172.21.15.167:0/1878066671 learned_addr learned my addr 172.21.15.167:0/1878066671 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bf77fe640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bf8102e10 0x7f8bf81982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bf7fff640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8101c10 0x7f8bf8197d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfc84f640 1 -- 172.21.15.167:0/1878066671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8101c10 msgr2=0x7f8bf8197d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfc84f640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8101c10 0x7f8bf8197d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfc84f640 1 -- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bf8102e10 msgr2=0x7f8bf81982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfc84f640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bf8102e10 0x7f8bf81982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfc84f640 1 -- 172.21.15.167:0/1878066671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bf819f9b0 con 0x7f8bf81037d0 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bf77fe640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bf8102e10 0x7f8bf81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfc84f640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 0x7f8bf819f310 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8bf002f500 tx=0x7f8bf0003970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:18.331 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bf57fa640 1 -- 172.21.15.167:0/1878066671 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf0003e20 con 0x7f8bf81037d0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bf819fc40 con 0x7f8bf81037d0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bf57fa640 1 -- 172.21.15.167:0/1878066671 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8bf0004510 con 0x7f8bf81037d0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bf57fa640 1 -- 172.21.15.167:0/1878066671 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bf002fe50 con 0x7f8bf81037d0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.324+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bf81a0180 con 0x7f8bf81037d0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.326+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8bf8108ee0 con 0x7f8bf81037d0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.326+0000 7f8bf57fa640 1 -- 172.21.15.167:0/1878066671 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8bf0004040 con 0x7f8bf81037d0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.327+0000 7f8bf57fa640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8be00a3240 0x7f8be00a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.327+0000 7f8bf57fa640 1 -- 172.21.15.167:0/1878066671 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 3784+0+0 (secure 0 0 0) 0x7f8bf00f00f0 con 0x7f8bf81037d0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.327+0000 7f8bf7fff640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8be00a3240 0x7f8be00a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:18.332 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.328+0000 7f8bf7fff640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8be00a3240 0x7f8be00a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8be80058c0 tx=0x7f8be8005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:18.333 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.332+0000 7f8bf57fa640 1 -- 172.21.15.167:0/1878066671 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8bf0004330 con 0x7f8bf81037d0 2024-09-19T04:25:18.511 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:18.509+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f8bf8062630 con 0x7f8be00a3240 2024-09-19T04:25:18.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:18.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:25:18.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:25:18.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:18.511 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:18.512 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.512 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:18.512 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:18.512 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.512 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:18.512 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:18.512 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:18.512 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:18.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:25:18.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:25:18.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:18.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:18.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:19.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi134 2024-09-19T04:25:19.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-19T04:25:19.610 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:25:19.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T04:25:19.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:19.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: from='osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:25:19.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:25:19.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:25:19.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:25:19.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:25:19.611 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:19 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:19.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi134 2024-09-19T04:25:19.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-19T04:25:19.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:25:19.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T04:25:19.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:19.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: from='osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:25:19.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:25:19.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:25:19.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:25:19.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:25:19.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:19 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:19.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi134 2024-09-19T04:25:19.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi134 to 8544M 2024-09-19T04:25:19.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-09-19T04:25:19.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: osdmap e30: 5 total, 4 up, 5 in 2024-09-19T04:25:19.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:19.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: from='osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:25:19.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:25:19.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: from='client.24226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:25:19.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:25:19.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:25:19.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:19 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:20.389 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:25:20 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:25:20.131+0000 7f79c240c640 -1 osd.4 0 waiting for initial osdmap 2024-09-19T04:25:20.389 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:25:20 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:25:20.141+0000 7f79baa3e640 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:25:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:20 smithi167 ceph-mon[34339]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:20 smithi167 ceph-mon[34339]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:25:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:20 smithi167 ceph-mon[34339]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T04:25:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:20.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:20 smithi167 ceph-mon[34339]: from='osd.4 ' entity='osd.4' 2024-09-19T04:25:20.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:20 smithi070 ceph-mon[30942]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:20.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:20 smithi070 ceph-mon[30942]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:25:20.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:20 smithi070 ceph-mon[30942]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T04:25:20.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:20.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:20.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:20 smithi070 ceph-mon[30942]: from='osd.4 ' entity='osd.4' 2024-09-19T04:25:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:20 smithi134 ceph-mon[34525]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 129 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:20 smithi134 ceph-mon[34525]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:25:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:20 smithi134 ceph-mon[34525]: osdmap e31: 5 total, 4 up, 5 in 2024-09-19T04:25:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:20 smithi134 ceph-mon[34525]: from='osd.4 ' entity='osd.4' 2024-09-19T04:25:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:25:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:25:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/2118646948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]: dispatch 2024-09-19T04:25:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]: dispatch 2024-09-19T04:25:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]': finished 2024-09-19T04:25:21.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] boot 2024-09-19T04:25:21.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T04:25:21.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:21.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:21 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/2118646948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]: dispatch 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]: dispatch 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]': finished 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] boot 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:21.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:21 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:21.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:25:21.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:25:21.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:21.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/2118646948' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]: dispatch 2024-09-19T04:25:21.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]: dispatch 2024-09-19T04:25:21.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4980fc29-7eaf-4f69-a034-1c10dafe1318"}]': finished 2024-09-19T04:25:21.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: osd.4 [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] boot 2024-09-19T04:25:21.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: osdmap e32: 6 total, 5 up, 6 in 2024-09-19T04:25:21.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:25:21.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:21 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:22 smithi070 ceph-mon[30942]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:22 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/1078744991' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:25:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:22 smithi070 ceph-mon[30942]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:25:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:22.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:22 smithi167 ceph-mon[34339]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:22.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:22 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/1078744991' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:25:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:22 smithi167 ceph-mon[34339]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:25:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:22 smithi134 ceph-mon[34525]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 133 MiB used, 357 GiB / 358 GiB avail 2024-09-19T04:25:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:22 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/1078744991' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:25:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:22 smithi134 ceph-mon[34525]: osdmap e33: 6 total, 5 up, 6 in 2024-09-19T04:25:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:24 smithi070 ceph-mon[30942]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:24.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:24 smithi167 ceph-mon[34339]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:24 smithi134 ceph-mon[34525]: pgmap v116: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:26.701 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:26 smithi167 ceph-mon[34339]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:26.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:26 smithi134 ceph-mon[34525]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:26.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:26 smithi070 ceph-mon[30942]: pgmap v117: 1 pgs: 1 active+clean; 577 KiB data, 163 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:28.539 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:28 smithi167 ceph-mon[34339]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:28 smithi134 ceph-mon[34525]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:28.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:28 smithi070 ceph-mon[30942]: pgmap v118: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:30.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:30 smithi167 ceph-mon[34339]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:30.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:25:30.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:30 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:30.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:30 smithi167 ceph-mon[34339]: Deploying daemon osd.5 on smithi167 2024-09-19T04:25:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:30 smithi134 ceph-mon[34525]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:25:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:30 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:30 smithi134 ceph-mon[34525]: Deploying daemon osd.5 on smithi167 2024-09-19T04:25:30.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:30 smithi070 ceph-mon[30942]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:30.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-09-19T04:25:30.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:30 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:30.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:30 smithi070 ceph-mon[30942]: Deploying daemon osd.5 on smithi167 2024-09-19T04:25:32.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:32 smithi167 ceph-mon[34339]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:32 smithi134 ceph-mon[34525]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:32 smithi070 ceph-mon[30942]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:34.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:34 smithi167 ceph-mon[34339]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:34 smithi134 ceph-mon[34525]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:34 smithi070 ceph-mon[30942]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:36.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:36 smithi167 ceph-mon[34339]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:36.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:36 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:36.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:36 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:36.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:36 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:36.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:36 smithi134 ceph-mon[34525]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:36.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:36 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:36.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:36 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:36.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:36 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:36 smithi070 ceph-mon[30942]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:36 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:36 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:36 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.673 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:38 smithi167 ceph-mon[34339]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:38.674 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.674 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.674 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:38.674 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:38.674 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:38 smithi134 ceph-mon[34525]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:38 smithi070 ceph-mon[30942]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:38.989 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.988+0000 7f8bf57fa640 1 -- 172.21.15.167:0/1878066671 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8bf8062630 con 0x7f8be00a3240 2024-09-19T04:25:38.990 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 5 on host 'smithi167' 2024-09-19T04:25:38.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8be00a3240 msgr2=0x7f8be00a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:38.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8be00a3240 0x7f8be00a5700 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8be80058c0 tx=0x7f8be8005850 comp rx=0 tx=0).stop 2024-09-19T04:25:38.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 msgr2=0x7f8bf819f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:38.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 0x7f8bf819f310 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f8bf002f500 tx=0x7f8bf0003970 comp rx=0 tx=0).stop 2024-09-19T04:25:38.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 shutdown_connections 2024-09-19T04:25:38.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8be00a3240 0x7f8be00a5700 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:38.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8bf81037d0 0x7f8bf819f310 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:38.992 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8bf8102e10 0x7f8bf81982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:38.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 --2- 172.21.15.167:0/1878066671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf8101c10 0x7f8bf8197d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:38.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 >> 172.21.15.167:0/1878066671 conn(0x7f8bf80fd3c0 msgr2=0x7f8bf81060b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:38.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 shutdown_connections 2024-09-19T04:25:38.993 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:25:38.991+0000 7f8bfe2b2640 1 -- 172.21.15.167:0/1878066671 wait complete. 2024-09-19T04:25:39.561 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:39 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:39.561 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:39 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:39.561 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:39 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:39.588 DEBUG:teuthology.orchestra.run.smithi167:osd.5> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.5.service 2024-09-19T04:25:39.591 INFO:tasks.cephadm:Deploying osd.6 on smithi070 with /dev/vg_nvme/lv_2... 2024-09-19T04:25:39.591 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:25:39.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:39 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:39.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:39 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:39.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:39 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:39.846 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:25:39.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:25:39.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:39.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:40.415 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:40 smithi167 ceph-mon[34339]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:40.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:40 smithi070 ceph-mon[30942]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:40.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:40 smithi134 ceph-mon[34525]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:42.092 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:25:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:25:41.882+0000 7fedaeaa7640 -1 osd.5 0 log_to_monitors true 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:42.594 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.597 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:25:42.623 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_2 2024-09-19T04:25:42.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:25:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-09-19T04:25:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:25:42.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:42.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:25:42.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:25:42.880 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:25:43.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/236791399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc0fff10 msgr2=0x7ff2dc100310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/236791399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc0fff10 0x7ff2dc100310 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc009930 tx=0x7ff2cc02a420 comp rx=0 tx=0).stop 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/236791399 shutdown_connections 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/236791399 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc1038b0 0x7ff2dc10a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/236791399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2dc102ef0 0x7ff2dc103370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/236791399 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc0fff10 0x7ff2dc100310 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/236791399 >> 172.21.15.70:0/236791399 conn(0x7ff2dc0fba80 msgr2=0x7ff2dc0fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/236791399 shutdown_connections 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/236791399 wait complete. 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 Processor -- start 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.313+0000 7ff2e2a0b640 1 -- start start 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2e2a0b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2dc0fff10 0x7ff2dc197ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:43.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2e2a0b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc102ef0 0x7ff2dc198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2e2a0b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc1038b0 0x7ff2dc19f480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2e2a0b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc10d850 con 0x7ff2dc102ef0 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2e2a0b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc10d6d0 con 0x7ff2dc0fff10 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2e2a0b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2dc10d9d0 con 0x7ff2dc1038b0 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc102ef0 0x7ff2dc198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc102ef0 0x7ff2dc198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40774/0 (socket says 172.21.15.70:40774) 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 -- 172.21.15.70:0/1146669882 learned_addr learned my addr 172.21.15.70:0/1146669882 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2dbfff640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2dc0fff10 0x7ff2dc197ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2e0fa8640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc1038b0 0x7ff2dc19f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 -- 172.21.15.70:0/1146669882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc1038b0 msgr2=0x7ff2dc19f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc1038b0 0x7ff2dc19f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 -- 172.21.15.70:0/1146669882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2dc0fff10 msgr2=0x7ff2dc197ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:25:43.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2dc0fff10 0x7ff2dc197ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 -- 172.21.15.70:0/1146669882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2dc19faf0 con 0x7ff2dc102ef0 2024-09-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.314+0000 7ff2d3fff640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc102ef0 0x7ff2dc198400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400d950 tx=0x7ff2c400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.315+0000 7ff2d9ffb640 1 -- 172.21.15.70:0/1146669882 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c4017030 con 0x7ff2dc102ef0 2024-09-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.315+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2dc19fde0 con 0x7ff2dc102ef0 2024-09-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.315+0000 7ff2d9ffb640 1 -- 172.21.15.70:0/1146669882 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff2c4004020 con 0x7ff2dc102ef0 2024-09-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.315+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2dc1a02e0 con 0x7ff2dc102ef0 2024-09-19T04:25:43.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.315+0000 7ff2d9ffb640 1 -- 172.21.15.70:0/1146669882 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2c40047a0 con 0x7ff2dc102ef0 2024-09-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.316+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2dc109190 con 0x7ff2dc102ef0 2024-09-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.317+0000 7ff2d9ffb640 1 -- 172.21.15.70:0/1146669882 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ff2c40041d0 con 0x7ff2dc102ef0 2024-09-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.317+0000 7ff2d9ffb640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ff2c80a3270 0x7ff2c80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.317+0000 7ff2d9ffb640 1 -- 172.21.15.70:0/1146669882 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(34..34 src has 1..34) ==== 4237+0+0 (secure 0 0 0) 0x7ff2c40ce2e0 con 0x7ff2dc102ef0 2024-09-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.317+0000 7ff2dbfff640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ff2c80a3270 0x7ff2c80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:25:43.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.318+0000 7ff2dbfff640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ff2c80a3270 0x7ff2c80a5730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc005ab0 tx=0x7ff2cc031510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:25:43.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.322+0000 7ff2d9ffb640 1 -- 172.21.15.70:0/1146669882 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2c409bff0 con 0x7ff2dc102ef0 2024-09-19T04:25:43.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:25:43.504+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7ff2dc062630 con 0x7ff2c80a3270 2024-09-19T04:25:43.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:43 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi167 2024-09-19T04:25:43.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:43 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-19T04:25:43.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:43 smithi070 ceph-mon[30942]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:25:43.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:43 smithi070 ceph-mon[30942]: from='osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:25:43.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:43 smithi070 ceph-mon[30942]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:25:43.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:43.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:43 smithi070 ceph-mon[30942]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:25:43.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi167 2024-09-19T04:25:43.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-19T04:25:43.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-mon[34339]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:25:43.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-mon[34339]: from='osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:25:43.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-mon[34339]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:25:43.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:43.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-mon[34339]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:25:43.711 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:25:43.430+0000 7fedaa207640 -1 osd.5 0 waiting for initial osdmap 2024-09-19T04:25:43.711 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:25:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:25:43.438+0000 7feda6841640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:25:43.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:43 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi167 2024-09-19T04:25:43.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:43 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi167 to 8544M 2024-09-19T04:25:43.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:43 smithi134 ceph-mon[34525]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-09-19T04:25:43.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:43 smithi134 ceph-mon[34525]: from='osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:25:43.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:43 smithi134 ceph-mon[34525]: osdmap e34: 6 total, 5 up, 6 in 2024-09-19T04:25:43.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:43 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:43.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:43 smithi134 ceph-mon[34525]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:25:44.612 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:44.612 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:25:44.612 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T04:25:44.612 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:44.612 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:44.612 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:25:44.612 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:25:44.613 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:25:44.613 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:44.613 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] boot 2024-09-19T04:25:44.613 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:25:44.613 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:44 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:44.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] boot 2024-09-19T04:25:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:25:44.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:44 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: pgmap v127: 1 pgs: 1 active+clean; 577 KiB data, 164 MiB used, 447 GiB / 447 GiB avail 2024-09-19T04:25:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:25:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: osdmap e35: 6 total, 5 up, 6 in 2024-09-19T04:25:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: from='client.14355 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:25:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:25:44.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:25:44.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:44.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: osd.5 [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] boot 2024-09-19T04:25:44.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: osdmap e36: 6 total, 6 up, 6 in 2024-09-19T04:25:44.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:44 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:25:45.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:45 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:25:45.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:45 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:25:45.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:45 smithi167 ceph-mon[34339]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T04:25:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:45 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:25:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:45 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:25:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:45 smithi134 ceph-mon[34525]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T04:25:45.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:45 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:25:45.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:45 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:25:45.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:45 smithi070 ceph-mon[30942]: osdmap e37: 6 total, 6 up, 6 in 2024-09-19T04:25:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:46 smithi167 ceph-mon[34339]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:46 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1499096857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b5fe84-82d8-4beb-b050-fc03c492ab85"}]: dispatch 2024-09-19T04:25:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:46 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1499096857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1b5fe84-82d8-4beb-b050-fc03c492ab85"}]': finished 2024-09-19T04:25:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:46 smithi167 ceph-mon[34339]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T04:25:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:46 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2792108066' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:25:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:46 smithi134 ceph-mon[34525]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:46 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1499096857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b5fe84-82d8-4beb-b050-fc03c492ab85"}]: dispatch 2024-09-19T04:25:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:46 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1499096857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1b5fe84-82d8-4beb-b050-fc03c492ab85"}]': finished 2024-09-19T04:25:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:46 smithi134 ceph-mon[34525]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T04:25:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:46 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2792108066' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:25:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:46 smithi070 ceph-mon[30942]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:46 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1499096857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "f1b5fe84-82d8-4beb-b050-fc03c492ab85"}]: dispatch 2024-09-19T04:25:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:46 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1499096857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "f1b5fe84-82d8-4beb-b050-fc03c492ab85"}]': finished 2024-09-19T04:25:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:46 smithi070 ceph-mon[30942]: osdmap e38: 7 total, 6 up, 7 in 2024-09-19T04:25:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:46 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2792108066' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:25:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:47 smithi070 ceph-mon[30942]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:25:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:47 smithi070 ceph-mon[30942]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:48.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:47 smithi167 ceph-mon[34339]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:25:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:47 smithi167 ceph-mon[34339]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:47 smithi134 ceph-mon[34525]: osdmap e39: 7 total, 6 up, 7 in 2024-09-19T04:25:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:47 smithi134 ceph-mon[34525]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:49.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:48 smithi070 ceph-mon[30942]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:25:49.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:48 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:49.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:48 smithi167 ceph-mon[34339]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:25:49.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:48 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:49.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:48 smithi134 ceph-mon[34525]: osdmap e40: 7 total, 6 up, 7 in 2024-09-19T04:25:49.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:48 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:25:50.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:49 smithi070 ceph-mon[30942]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:50.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:49 smithi167 ceph-mon[34339]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:50.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:49 smithi134 ceph-mon[34525]: pgmap v136: 1 pgs: 1 remapped+peering; 577 KiB data, 190 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:25:52.474 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:52 smithi070 ceph-mon[30942]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:25:52.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:52 smithi167 ceph-mon[34339]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:25:52.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:52 smithi134 ceph-mon[34525]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:25:54.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:54 smithi167 ceph-mon[34339]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T04:25:54.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:54 smithi134 ceph-mon[34525]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T04:25:54.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:54 smithi070 ceph-mon[30942]: pgmap v138: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 77 KiB/s, 0 objects/s recovering 2024-09-19T04:25:55.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:25:55.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:55.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:55 smithi167 ceph-mon[34339]: Deploying daemon osd.6 on smithi070 2024-09-19T04:25:55.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:25:55.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:55.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:55 smithi134 ceph-mon[34525]: Deploying daemon osd.6 on smithi070 2024-09-19T04:25:55.823 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-09-19T04:25:55.823 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:25:55.823 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:55 smithi070 ceph-mon[30942]: Deploying daemon osd.6 on smithi070 2024-09-19T04:25:56.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:56 smithi070 ceph-mon[30942]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T04:25:56.686 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:56 smithi134 ceph-mon[34525]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T04:25:56.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:56 smithi167 ceph-mon[34339]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 68 KiB/s, 0 objects/s recovering 2024-09-19T04:25:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:25:58 smithi167 ceph-mon[34339]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:25:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:25:58 smithi134 ceph-mon[34525]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:25:58.830 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:25:58 smithi070 ceph-mon[30942]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:26:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:00 smithi070 ceph-mon[30942]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T04:26:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:00 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:00 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:00 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:00.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:00 smithi167 ceph-mon[34339]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T04:26:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:00 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:00 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:00 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:00 smithi134 ceph-mon[34525]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-09-19T04:26:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:00 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:00 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:00 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:02.666 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:02 smithi070 ceph-mon[30942]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:26:02.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:02 smithi167 ceph-mon[34339]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:26:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:02 smithi134 ceph-mon[34525]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:26:03.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.996+0000 7ff2d9ffb640 1 -- 172.21.15.70:0/1146669882 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7ff2dc062630 con 0x7ff2c80a3270 2024-09-19T04:26:03.998 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 6 on host 'smithi070' 2024-09-19T04:26:03.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ff2c80a3270 msgr2=0x7ff2c80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:03.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ff2c80a3270 0x7ff2c80a5730 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7ff2cc005ab0 tx=0x7ff2cc031510 comp rx=0 tx=0).stop 2024-09-19T04:26:03.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc102ef0 msgr2=0x7ff2dc198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc102ef0 0x7ff2dc198400 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff2c400d950 tx=0x7ff2c400de10 comp rx=0 tx=0).stop 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 shutdown_connections 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ff2c80a3270 0x7ff2c80a5730 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2dc1038b0 0x7ff2dc19f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2dc102ef0 0x7ff2dc198400 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 --2- 172.21.15.70:0/1146669882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2dc0fff10 0x7ff2dc197ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 >> 172.21.15.70:0/1146669882 conn(0x7ff2dc0fba80 msgr2=0x7ff2dc106360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 shutdown_connections 2024-09-19T04:26:04.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:03.998+0000 7ff2e2a0b640 1 -- 172.21.15.70:0/1146669882 wait complete. 2024-09-19T04:26:04.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:04.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:04.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:03 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:03 smithi167 ceph-mon[34339]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:04.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:03 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:03 smithi134 ceph-mon[34525]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:03 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:04.286 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:03 smithi070 ceph-mon[30942]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:04.579 DEBUG:teuthology.orchestra.run.smithi070:osd.6> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.6.service 2024-09-19T04:26:04.582 INFO:tasks.cephadm:Deploying osd.7 on smithi134 with /dev/vg_nvme/lv_2... 2024-09-19T04:26:04.582 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:26:04.838 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:26:05.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:05.130 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:05.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:05.207 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:05.207 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:05.207 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:05.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:05.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:05.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:06.044 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:05 smithi070 ceph-mon[30942]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:06.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:05 smithi167 ceph-mon[34339]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:06.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:05 smithi134 ceph-mon[34525]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:06.917 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:26:06 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:26:06.661+0000 7f8dd1696640 -1 osd.6 0 log_to_monitors true 2024-09-19T04:26:07.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:06 smithi134 ceph-mon[34525]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:26:07.291 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:06 smithi070 ceph-mon[30942]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:26:07.363 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:06 smithi167 ceph-mon[34339]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-09-19T04:26:07.381 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:26:07.410 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-09-19T04:26:07.673 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:26:08.089 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:26:08.090 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:26:08.090 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:26:08.090 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:08.090 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:08.090 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.090 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.090 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:08.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:08.091 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 -- 172.21.15.134:0/4201743739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 msgr2=0x7fc994108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 --2- 172.21.15.134:0/4201743739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 0x7fc994108f20 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009ca0 tx=0x7fc98c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:26:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 -- 172.21.15.134:0/4201743739 shutdown_connections 2024-09-19T04:26:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 --2- 172.21.15.134:0/4201743739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 0x7fc994108f20 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 --2- 172.21.15.134:0/4201743739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc994101cd0 0x7fc994102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 --2- 172.21.15.134:0/4201743739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc994100ad0 0x7fc994100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:08.181 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 -- 172.21.15.134:0/4201743739 >> 172.21.15.134:0/4201743739 conn(0x7fc9940fc280 msgr2=0x7fc9940fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 -- 172.21.15.134:0/4201743739 shutdown_connections 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.174+0000 7fc999c4d640 1 -- 172.21.15.134:0/4201743739 wait complete. 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc999c4d640 1 Processor -- start 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc999c4d640 1 -- start start 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc999c4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc994100ad0 0x7fc994197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc999c4d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc994101cd0 0x7fc9941983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc999c4d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 0x7fc99419f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc999c4d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc99410c730 con 0x7fc994100ad0 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc999c4d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc99410c5b0 con 0x7fc994102690 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc999c4d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc99410c8b0 con 0x7fc994101cd0 2024-09-19T04:26:08.182 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc993fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 0x7fc99419f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc993fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 0x7fc99419f470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49828/0 (socket says 172.21.15.134:49828) 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc993fff640 1 -- 172.21.15.134:0/1284997201 learned_addr learned my addr 172.21.15.134:0/1284997201 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc992ffd640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc994101cd0 0x7fc9941983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.175+0000 7fc9937fe640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc994100ad0 0x7fc994197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc993fff640 1 -- 172.21.15.134:0/1284997201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc994101cd0 msgr2=0x7fc9941983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc993fff640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc994101cd0 0x7fc9941983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc993fff640 1 -- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc994100ad0 msgr2=0x7fc994197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc993fff640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc994100ad0 0x7fc994197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc993fff640 1 -- 172.21.15.134:0/1284997201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc99419fae0 con 0x7fc994102690 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc9937fe640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc994100ad0 0x7fc994197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc993fff640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 0x7fc99419f470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009430 tx=0x7fc98c02f380 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:08.183 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc990ff9640 1 -- 172.21.15.134:0/1284997201 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c003bf0 con 0x7fc994102690 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc990ff9640 1 -- 172.21.15.134:0/1284997201 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc98c003d90 con 0x7fc994102690 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc99419fd70 con 0x7fc994102690 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc990ff9640 1 -- 172.21.15.134:0/1284997201 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc98c02fcc0 con 0x7fc994102690 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.176+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9941a0270 con 0x7fc994102690 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.177+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9941a04d0 con 0x7fc994102690 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.178+0000 7fc990ff9640 1 -- 172.21.15.134:0/1284997201 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc98c004b40 con 0x7fc994102690 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.179+0000 7fc990ff9640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc9800a32f0 0x7fc9800a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.179+0000 7fc990ff9640 1 -- 172.21.15.134:0/1284997201 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(42..42 src has 1..42) ==== 4685+0+0 (secure 0 0 0) 0x7fc98c0f0140 con 0x7fc994102690 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.179+0000 7fc9937fe640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc9800a32f0 0x7fc9800a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.180+0000 7fc9937fe640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc9800a32f0 0x7fc9800a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc994101b30 tx=0x7fc984005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:08.184 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.182+0000 7fc990ff9640 1 -- 172.21.15.134:0/1284997201 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc98c0bdd20 con 0x7fc994102690 2024-09-19T04:26:08.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:26:08.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.362 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:08.360+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fc9941a06a0 con 0x7fc9800a32f0 2024-09-19T04:26:08.395 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:26:07.972+0000 7f8dccdf6640 -1 osd.6 0 waiting for initial osdmap 2024-09-19T04:26:08.395 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:26:07.981+0000 7f8dc9430640 -1 osd.6 42 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:26:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-09-19T04:26:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: osdmap e41: 7 total, 6 up, 7 in 2024-09-19T04:26:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi070 2024-09-19T04:26:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-19T04:26:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:26:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T04:26:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:09.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:09.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:09.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:09.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:09.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:08 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:09.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi070 2024-09-19T04:26:09.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-19T04:26:09.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:26:09.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T04:26:09.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:09.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:09.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:09.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:09.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:09.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:08 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi070 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi070 to 5696M 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: from='osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: osdmap e42: 7 total, 6 up, 7 in 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: from='client.24275 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:09.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:08 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:10.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:09 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:26:10.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:09 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:26:10.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:09 smithi134 ceph-mon[34525]: osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] boot 2024-09-19T04:26:10.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:09 smithi134 ceph-mon[34525]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T04:26:10.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:10.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:09 smithi134 ceph-mon[34525]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:10.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:09 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:26:10.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:09 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:26:10.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:09 smithi070 ceph-mon[30942]: osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] boot 2024-09-19T04:26:10.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:09 smithi070 ceph-mon[30942]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T04:26:10.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:10.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:09 smithi070 ceph-mon[30942]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:10.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:09 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:26:10.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:09 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:26:10.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:09 smithi167 ceph-mon[34339]: osd.6 [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] boot 2024-09-19T04:26:10.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:09 smithi167 ceph-mon[34339]: osdmap e43: 7 total, 7 up, 7 in 2024-09-19T04:26:10.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:26:10.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:09 smithi167 ceph-mon[34339]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 191 MiB used, 536 GiB / 536 GiB avail 2024-09-19T04:26:11.269 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:10 smithi134 ceph-mon[34525]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T04:26:11.269 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:10 smithi134 ceph-mon[34525]: from='client.? 172.21.15.134:0/1681145297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]: dispatch 2024-09-19T04:26:11.269 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:10 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]: dispatch 2024-09-19T04:26:11.269 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:10 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]': finished 2024-09-19T04:26:11.269 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:10 smithi134 ceph-mon[34525]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:26:11.269 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:10 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:11.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:10 smithi070 ceph-mon[30942]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T04:26:11.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:10 smithi070 ceph-mon[30942]: from='client.? 172.21.15.134:0/1681145297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]: dispatch 2024-09-19T04:26:11.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:10 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]: dispatch 2024-09-19T04:26:11.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:10 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]': finished 2024-09-19T04:26:11.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:10 smithi070 ceph-mon[30942]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:26:11.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:10 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:11.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:10 smithi167 ceph-mon[34339]: osdmap e44: 7 total, 7 up, 7 in 2024-09-19T04:26:11.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:10 smithi167 ceph-mon[34339]: from='client.? 172.21.15.134:0/1681145297' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]: dispatch 2024-09-19T04:26:11.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:10 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]: dispatch 2024-09-19T04:26:11.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:10 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ed960d6e-6426-4124-addf-efddb5b1a800"}]': finished 2024-09-19T04:26:11.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:10 smithi167 ceph-mon[34339]: osdmap e45: 8 total, 7 up, 8 in 2024-09-19T04:26:11.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:10 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:12.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:11 smithi134 ceph-mon[34525]: from='client.? 172.21.15.134:0/4059985247' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:26:12.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:11 smithi134 ceph-mon[34525]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:12.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:11 smithi070 ceph-mon[30942]: from='client.? 172.21.15.134:0/4059985247' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:26:12.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:11 smithi070 ceph-mon[30942]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:12.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:11 smithi167 ceph-mon[34339]: from='client.? 172.21.15.134:0/4059985247' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:26:12.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:11 smithi167 ceph-mon[34339]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:14.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:14 smithi167 ceph-mon[34339]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:14 smithi134 ceph-mon[34525]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:14.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:14 smithi070 ceph-mon[30942]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:16.695 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:16 smithi134 ceph-mon[34525]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:16.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:16 smithi167 ceph-mon[34339]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:16.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:16 smithi070 ceph-mon[30942]: pgmap v154: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:18.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:18 smithi167 ceph-mon[34339]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:18.753 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:18 smithi134 ceph-mon[34525]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:18.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:18 smithi070 ceph-mon[30942]: pgmap v155: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:19.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:19 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:26:19.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:19 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:19.781 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:19 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:26:19.781 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:19 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:19.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:19 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-09-19T04:26:19.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:19 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:20.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:20 smithi167 ceph-mon[34339]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:20.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:20 smithi167 ceph-mon[34339]: Deploying daemon osd.7 on smithi134 2024-09-19T04:26:20.730 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:20 smithi134 ceph-mon[34525]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:20.730 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:20 smithi134 ceph-mon[34525]: Deploying daemon osd.7 on smithi134 2024-09-19T04:26:20.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:20 smithi070 ceph-mon[30942]: pgmap v156: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:20.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:20 smithi070 ceph-mon[30942]: Deploying daemon osd.7 on smithi134 2024-09-19T04:26:22.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:22 smithi167 ceph-mon[34339]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:22.734 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:22 smithi134 ceph-mon[34525]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:22.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:22 smithi070 ceph-mon[30942]: pgmap v157: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:24.627 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:24 smithi134 ceph-mon[34525]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:24.697 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:24 smithi070 ceph-mon[30942]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:24.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:24 smithi167 ceph-mon[34339]: pgmap v158: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:25.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:25 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:25.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:25 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:25.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:25 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:25.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:25 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:25.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:25 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:25.748 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:25 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:25 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:25 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:25 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:26.688 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:26 smithi134 ceph-mon[34525]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:26.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:26 smithi167 ceph-mon[34339]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:26.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:26 smithi070 ceph-mon[30942]: pgmap v159: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:28.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:28 smithi134 ceph-mon[34525]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:28.524 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.523+0000 7fc990ff9640 1 -- 172.21.15.134:0/1284997201 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc9941a06a0 con 0x7fc9800a32f0 2024-09-19T04:26:28.525 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 7 on host 'smithi134' 2024-09-19T04:26:28.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc9800a32f0 msgr2=0x7fc9800a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:28.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc9800a32f0 0x7fc9800a57b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fc994101b30 tx=0x7fc984005f90 comp rx=0 tx=0).stop 2024-09-19T04:26:28.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 msgr2=0x7fc99419f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:28.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 0x7fc99419f470 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fc98c009430 tx=0x7fc98c02f380 comp rx=0 tx=0).stop 2024-09-19T04:26:28.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 shutdown_connections 2024-09-19T04:26:28.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc9800a32f0 0x7fc9800a57b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:28.527 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc994102690 0x7fc99419f470 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:28.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc994101cd0 0x7fc9941983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:28.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 --2- 172.21.15.134:0/1284997201 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc994100ad0 0x7fc994197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:28.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.525+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 >> 172.21.15.134:0/1284997201 conn(0x7fc9940fc280 msgr2=0x7fc99406a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:28.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.526+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 shutdown_connections 2024-09-19T04:26:28.528 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:26:28.526+0000 7fc999c4d640 1 -- 172.21.15.134:0/1284997201 wait complete. 2024-09-19T04:26:28.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:28 smithi167 ceph-mon[34339]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:28.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:28 smithi070 ceph-mon[30942]: pgmap v160: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:29.125 DEBUG:teuthology.orchestra.run.smithi134:osd.7> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.7.service 2024-09-19T04:26:29.128 INFO:tasks.cephadm:Deploying osd.8 on smithi167 with /dev/vg_nvme/lv_2... 2024-09-19T04:26:29.128 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-09-19T04:26:29.384 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:26:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.826 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.826 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.826 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.826 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:29.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:30.614 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:30 smithi134 ceph-mon[34525]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:30.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:30 smithi167 ceph-mon[34339]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:30.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:30 smithi070 ceph-mon[30942]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:31.530 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:26:31 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:26:31.237+0000 7fdf36415640 -1 osd.7 0 log_to_monitors true 2024-09-19T04:26:31.625 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:31 smithi167 ceph-mon[34339]: from='osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:26:31.625 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:31 smithi167 ceph-mon[34339]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:26:31.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:31 smithi134 ceph-mon[34525]: from='osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:26:31.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:31 smithi134 ceph-mon[34525]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:26:31.835 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:26:31.860 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_2 2024-09-19T04:26:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:31 smithi070 ceph-mon[30942]: from='osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:26:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:31 smithi070 ceph-mon[30942]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-09-19T04:26:32.112 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:26:32.531 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:32.531 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:26:32.531 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:26:32.531 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:32.531 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:26:32.531 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:26:32.531 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.531 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.582 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3301400873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f241037c0 msgr2=0x7f4f2410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3301400873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f241037c0 0x7f4f2410a050 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f4f1c009ca0 tx=0x7f4f1c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3301400873 shutdown_connections 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3301400873 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f241037c0 0x7f4f2410a050 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3301400873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f24102e00 0x7f4f24103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3301400873 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f24101c00 0x7f4f24102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3301400873 >> 172.21.15.167:0/3301400873 conn(0x7f4f240fd390 msgr2=0x7f4f240ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3301400873 shutdown_connections 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.566+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3301400873 wait complete. 2024-09-19T04:26:32.583 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f2a69a640 1 Processor -- start 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f2a69a640 1 -- start start 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f2a69a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f24101c00 0x7f4f24197ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f2a69a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f24102e00 0x7f4f241983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f2a69a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f241037c0 0x7f4f2419f460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f2a69a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2410d870 con 0x7f4f24102e00 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f2a69a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2410d6f0 con 0x7f4f241037c0 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f2a69a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4f2410d9f0 con 0x7f4f24101c00 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f23fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f24101c00 0x7f4f24197ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f23fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f24101c00 0x7f4f24197ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:43086/0 (socket says 172.21.15.167:43086) 2024-09-19T04:26:32.584 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f23fff640 1 -- 172.21.15.167:0/3875127886 learned_addr learned my addr 172.21.15.167:0/3875127886 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f237fe640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f24102e00 0x7f4f241983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.567+0000 7f4f28c37640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f241037c0 0x7f4f2419f460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f23fff640 1 -- 172.21.15.167:0/3875127886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f241037c0 msgr2=0x7f4f2419f460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f23fff640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f241037c0 0x7f4f2419f460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f23fff640 1 -- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f24102e00 msgr2=0x7f4f241983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f23fff640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f24102e00 0x7f4f241983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f23fff640 1 -- 172.21.15.167:0/3875127886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4f2419fad0 con 0x7f4f24101c00 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f237fe640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f24102e00 0x7f4f241983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f23fff640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f24101c00 0x7f4f24197ea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400e9c0 tx=0x7f4f1400ee80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f217fa640 1 -- 172.21.15.167:0/3875127886 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f1400cd80 con 0x7f4f24101c00 2024-09-19T04:26:32.585 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4f2419fdc0 con 0x7f4f24101c00 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f217fa640 1 -- 172.21.15.167:0/3875127886 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4f140035f0 con 0x7f4f24101c00 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f217fa640 1 -- 172.21.15.167:0/3875127886 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4f14010690 con 0x7f4f24101c00 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.568+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4f241a0220 con 0x7f4f24101c00 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.569+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4f24109050 con 0x7f4f24101c00 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.570+0000 7f4f217fa640 1 -- 172.21.15.167:0/3875127886 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f4f140037a0 con 0x7f4f24101c00 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.571+0000 7f4f217fa640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4f0c0a3270 0x7f4f0c0a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.571+0000 7f4f217fa640 1 -- 172.21.15.167:0/3875127886 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(47..47 src has 1..47) ==== 5117+0+0 (secure 0 0 0) 0x7f4f140cf150 con 0x7f4f24101c00 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.571+0000 7f4f237fe640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4f0c0a3270 0x7f4f0c0a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.572+0000 7f4f237fe640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4f0c0a3270 0x7f4f0c0a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f241993c0 tx=0x7f4f18005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:32.586 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.575+0000 7f4f217fa640 1 -- 172.21.15.167:0/3875127886 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4f1409cae0 con 0x7f4f24101c00 2024-09-19T04:26:32.751 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:32.750+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f4f24062630 con 0x7f4f0c0a3270 2024-09-19T04:26:32.751 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.752 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.753 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:32.753 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:32.753 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.753 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:32.753 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:32.753 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:32.753 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:26:32.531+0000 7fdf31b75640 -1 osd.7 0 waiting for initial osdmap 2024-09-19T04:26:32.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:26:32.544+0000 7fdf2e1af640 -1 osd.7 47 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:26:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-09-19T04:26:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: osdmap e46: 8 total, 7 up, 8 in 2024-09-19T04:26:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:26:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:32.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:33.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi134 2024-09-19T04:26:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-19T04:26:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:26:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T04:26:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:33.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi134 2024-09-19T04:26:33.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-19T04:26:33.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:26:33.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T04:26:33.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:33.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:33.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:33.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:33.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi134 2024-09-19T04:26:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi134 to 5696M 2024-09-19T04:26:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:26:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: osdmap e47: 8 total, 7 up, 8 in 2024-09-19T04:26:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:33.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:33.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:33.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:34.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:26:34.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:26:34.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:34.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:34.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:34.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] boot 2024-09-19T04:26:34.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:26:34.887 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:34.888 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:34 smithi167 ceph-mon[34339]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T04:26:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:26:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:26:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:34.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] boot 2024-09-19T04:26:34.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:26:34.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:34.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:34 smithi070 ceph-mon[30942]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T04:26:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:26:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:26:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: from='client.24277 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 218 MiB used, 626 GiB / 626 GiB avail 2024-09-19T04:26:35.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:35.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: osd.7 [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] boot 2024-09-19T04:26:35.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: osdmap e48: 8 total, 8 up, 8 in 2024-09-19T04:26:35.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:26:35.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:34 smithi134 ceph-mon[34525]: osdmap e49: 8 total, 8 up, 8 in 2024-09-19T04:26:35.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:35 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/1790379083' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]: dispatch 2024-09-19T04:26:35.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:35 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]: dispatch 2024-09-19T04:26:35.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:35 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]': finished 2024-09-19T04:26:35.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:35 smithi167 ceph-mon[34339]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T04:26:35.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:35 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:35.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:35 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/1790379083' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]: dispatch 2024-09-19T04:26:35.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:35 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]: dispatch 2024-09-19T04:26:35.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:35 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]': finished 2024-09-19T04:26:35.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:35 smithi070 ceph-mon[30942]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T04:26:35.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:35 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:35 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/1790379083' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]: dispatch 2024-09-19T04:26:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:35 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]: dispatch 2024-09-19T04:26:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:35 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abb19a65-c197-4a87-a223-38297eb046e9"}]': finished 2024-09-19T04:26:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:35 smithi134 ceph-mon[34525]: osdmap e50: 9 total, 8 up, 9 in 2024-09-19T04:26:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:36 smithi070 ceph-mon[30942]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:36 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/3263696571' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:26:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:36 smithi070 ceph-mon[30942]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:26:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:36 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:36 smithi167 ceph-mon[34339]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:36 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/3263696571' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:26:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:36 smithi167 ceph-mon[34339]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:26:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:36 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:36 smithi134 ceph-mon[34525]: pgmap v169: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:36 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/3263696571' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:26:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:36 smithi134 ceph-mon[34525]: osdmap e51: 9 total, 8 up, 9 in 2024-09-19T04:26:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:36 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:38 smithi070 ceph-mon[30942]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:26:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:38 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:38 smithi070 ceph-mon[30942]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:38.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:38 smithi167 ceph-mon[34339]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:26:38.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:38 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:38.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:38 smithi167 ceph-mon[34339]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:38 smithi134 ceph-mon[34525]: osdmap e52: 9 total, 8 up, 9 in 2024-09-19T04:26:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:38 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:38 smithi134 ceph-mon[34525]: pgmap v172: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:40.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:40 smithi167 ceph-mon[34339]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:40.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:40 smithi134 ceph-mon[34525]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:40 smithi070 ceph-mon[30942]: pgmap v173: 1 pgs: 1 remapped+peering; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:42.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:42 smithi167 ceph-mon[34339]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:42 smithi134 ceph-mon[34525]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:42.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:42 smithi070 ceph-mon[30942]: pgmap v174: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:44.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:44 smithi167 ceph-mon[34339]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:44 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:26:44.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:44 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:44 smithi134 ceph-mon[34525]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:44 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:26:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:44 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:44.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:44 smithi070 ceph-mon[30942]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:44.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:44 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-09-19T04:26:44.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:44 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:45.573 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:45 smithi167 ceph-mon[34339]: Deploying daemon osd.8 on smithi167 2024-09-19T04:26:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:45 smithi134 ceph-mon[34525]: Deploying daemon osd.8 on smithi167 2024-09-19T04:26:45.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:45 smithi070 ceph-mon[30942]: Deploying daemon osd.8 on smithi167 2024-09-19T04:26:46.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:46 smithi167 ceph-mon[34339]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:46 smithi134 ceph-mon[34525]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:46 smithi070 ceph-mon[30942]: pgmap v176: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:48.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:48 smithi167 ceph-mon[34339]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:48 smithi134 ceph-mon[34525]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:48.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:48 smithi070 ceph-mon[30942]: pgmap v177: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:50.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:50 smithi167 ceph-mon[34339]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:50 smithi134 ceph-mon[34525]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:50 smithi070 ceph-mon[30942]: pgmap v178: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:50.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:52 smithi167 ceph-mon[34339]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:52.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:52 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:52 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:52 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:52.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:52 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:52.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:52 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:52 smithi134 ceph-mon[34525]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:52.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:52 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:52 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:52 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:52.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:52 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:52.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:52 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:52 smithi070 ceph-mon[30942]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:52 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:52 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:52 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:52 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:52 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:53.103 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.101+0000 7f4f217fa640 1 -- 172.21.15.167:0/3875127886 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f4f24062630 con 0x7f4f0c0a3270 2024-09-19T04:26:53.104 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 8 on host 'smithi167' 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4f0c0a3270 msgr2=0x7f4f0c0a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4f0c0a3270 0x7f4f0c0a5730 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4f241993c0 tx=0x7f4f18005f90 comp rx=0 tx=0).stop 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f24101c00 msgr2=0x7f4f24197ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f24101c00 0x7f4f24197ea0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f4f1400e9c0 tx=0x7f4f1400ee80 comp rx=0 tx=0).stop 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 shutdown_connections 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4f0c0a3270 0x7f4f0c0a5730 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4f241037c0 0x7f4f2419f460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4f24102e00 0x7f4f241983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.106 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 --2- 172.21.15.167:0/3875127886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4f24101c00 0x7f4f24197ea0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:53.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 >> 172.21.15.167:0/3875127886 conn(0x7f4f240fd390 msgr2=0x7f4f24106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:53.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 shutdown_connections 2024-09-19T04:26:53.107 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:26:53.104+0000 7f4f2a69a640 1 -- 172.21.15.167:0/3875127886 wait complete. 2024-09-19T04:26:53.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:53.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:53.693 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:53.695 DEBUG:teuthology.orchestra.run.smithi167:osd.8> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.8.service 2024-09-19T04:26:53.697 INFO:tasks.cephadm:Deploying osd.9 on smithi070 with /dev/vg_nvme/lv_1... 2024-09-19T04:26:53.697 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:26:53.724 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:53.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:53.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:53.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:26:53.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:53.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:53.951 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:54.608 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:54 smithi167 ceph-mon[34339]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:54.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:54 smithi070 ceph-mon[30942]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:54.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:54 smithi134 ceph-mon[34525]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:56.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:26:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:26:56.013+0000 7f7fdc025640 -1 osd.8 0 log_to_monitors true 2024-09-19T04:26:56.549 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:56 smithi167 ceph-mon[34339]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:56.549 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:56 smithi167 ceph-mon[34339]: from='osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:26:56.549 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:56 smithi167 ceph-mon[34339]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:26:56.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:56 smithi070 ceph-mon[30942]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:56.610 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:56 smithi070 ceph-mon[30942]: from='osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:26:56.610 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:56 smithi070 ceph-mon[30942]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:26:56.698 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:26:56.723 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi070:vg_nvme/lv_1 2024-09-19T04:26:56.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:56 smithi134 ceph-mon[34525]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:56.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:56 smithi134 ceph-mon[34525]: from='osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:26:56.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:56 smithi134 ceph-mon[34525]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-09-19T04:26:57.007 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:26:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 -- 172.21.15.70:0/1200286466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc824101d10 msgr2=0x7fc824102190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1200286466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc824101d10 0x7fc824102190 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fc814009900 tx=0x7fc81402a410 comp rx=0 tx=0).stop 2024-09-19T04:26:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 -- 172.21.15.70:0/1200286466 shutdown_connections 2024-09-19T04:26:57.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1200286466 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8241026d0 0x7fc824108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1200286466 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc824101d10 0x7fc824102190 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1200286466 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824100b10 0x7fc824100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 -- 172.21.15.70:0/1200286466 >> 172.21.15.70:0/1200286466 conn(0x7fc8240fc2a0 msgr2=0x7fc8240fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 -- 172.21.15.70:0/1200286466 shutdown_connections 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 -- 172.21.15.70:0/1200286466 wait complete. 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 Processor -- start 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 -- start start 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.438+0000 7fc82c34a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824100b10 0x7fc824197f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82c34a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc824101d10 0x7fc824198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82c34a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8241026d0 0x7fc82419f500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:57.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82c34a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc82410d890 con 0x7fc8241026d0 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82c34a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc82410d710 con 0x7fc824101d10 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82c34a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc82410da10 con 0x7fc824100b10 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8241026d0 0x7fc82419f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8241026d0 0x7fc82419f500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54584/0 (socket says 172.21.15.70:54584) 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 -- 172.21.15.70:0/1243458616 learned_addr learned my addr 172.21.15.70:0/1243458616 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc8298e5640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc824101d10 0x7fc824198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a0e6640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824100b10 0x7fc824197f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 -- 172.21.15.70:0/1243458616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824100b10 msgr2=0x7fc824197f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824100b10 0x7fc824197f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 -- 172.21.15.70:0/1243458616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc824101d10 msgr2=0x7fc824198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:26:57.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc824101d10 0x7fc824198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 -- 172.21.15.70:0/1243458616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc82419fb70 con 0x7fc8241026d0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a0e6640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824100b10 0x7fc824197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc82a8e7640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8241026d0 0x7fc82419f500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00eb10 tx=0x7fc81c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.439+0000 7fc81b7fe640 1 -- 172.21.15.70:0/1243458616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c004b20 con 0x7fc8241026d0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.440+0000 7fc81b7fe640 1 -- 172.21.15.70:0/1243458616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc81c004cc0 con 0x7fc8241026d0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.440+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc82419fe60 con 0x7fc8241026d0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.440+0000 7fc81b7fe640 1 -- 172.21.15.70:0/1243458616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc81c010700 con 0x7fc8241026d0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.440+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8241a0310 con 0x7fc8241026d0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.441+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc824107f60 con 0x7fc8241026d0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.442+0000 7fc81b7fe640 1 -- 172.21.15.70:0/1243458616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc81c004e70 con 0x7fc8241026d0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.442+0000 7fc81b7fe640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc8100a32f0 0x7fc8100a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.443+0000 7fc82a0e6640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc8100a32f0 0x7fc8100a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:26:57.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.443+0000 7fc81b7fe640 1 -- 172.21.15.70:0/1243458616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(53..53 src has 1..53) ==== 5533+0+0 (secure 0 0 0) 0x7fc81c0cf560 con 0x7fc8241026d0 2024-09-19T04:26:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.443+0000 7fc82a0e6640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc8100a32f0 0x7fc8100a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8200058c0 tx=0x7fc820005d50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:26:57.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.448+0000 7fc81b7fe640 1 -- 172.21.15.70:0/1243458616 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc81c054210 con 0x7fc8241026d0 2024-09-19T04:26:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:26:57.627+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7fc824062630 con 0x7fc8100a32f0 2024-09-19T04:26:57.711 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:26:57.452+0000 7f7fd7785640 -1 osd.8 0 waiting for initial osdmap 2024-09-19T04:26:57.711 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:26:57.464+0000 7f7fd3dbf640 -1 osd.8 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:26:57.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:26:57.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:26:57.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:57.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:26:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:26:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:26:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-09-19T04:26:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: osdmap e53: 9 total, 8 up, 9 in 2024-09-19T04:26:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:26:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:26:57.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:26:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi167 2024-09-19T04:26:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-19T04:26:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:26:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T04:26:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:58.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:58.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:58.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:58.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:58.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi167 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi167 2024-09-19T04:26:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi167 to 5696M 2024-09-19T04:26:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:26:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:26:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: osdmap e54: 9 total, 8 up, 9 in 2024-09-19T04:26:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:26:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:26:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:26:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:59 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:26:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:59 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:26:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:59 smithi070 ceph-mon[30942]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:59 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:59 smithi070 ceph-mon[30942]: osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] boot 2024-09-19T04:26:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:59 smithi070 ceph-mon[30942]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:26:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:59 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:59.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:26:59 smithi070 ceph-mon[30942]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:26:59.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:59 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:26:59.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:59 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:26:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:59 smithi167 ceph-mon[34339]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:59 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:59 smithi167 ceph-mon[34339]: osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] boot 2024-09-19T04:26:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:59 smithi167 ceph-mon[34339]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:26:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:59 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:26:59 smithi167 ceph-mon[34339]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:26:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:59 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:26:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:59 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:26:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:59 smithi134 ceph-mon[34525]: from='client.14421 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi070:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:26:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:59 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:59 smithi134 ceph-mon[34525]: osd.8 [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] boot 2024-09-19T04:26:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:59 smithi134 ceph-mon[34525]: osdmap e55: 9 total, 9 up, 9 in 2024-09-19T04:26:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:59 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:26:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:26:59 smithi134 ceph-mon[34525]: osdmap e56: 9 total, 9 up, 9 in 2024-09-19T04:27:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:00 smithi070 ceph-mon[30942]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:27:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:00 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1035940127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14c34016-a6ec-45d9-8a5a-181af66bd84b"}]: dispatch 2024-09-19T04:27:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:00 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1035940127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14c34016-a6ec-45d9-8a5a-181af66bd84b"}]': finished 2024-09-19T04:27:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:00 smithi070 ceph-mon[30942]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:27:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:00 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:00 smithi167 ceph-mon[34339]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:27:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:00 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1035940127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14c34016-a6ec-45d9-8a5a-181af66bd84b"}]: dispatch 2024-09-19T04:27:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:00 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1035940127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14c34016-a6ec-45d9-8a5a-181af66bd84b"}]': finished 2024-09-19T04:27:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:00 smithi167 ceph-mon[34339]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:27:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:00 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:00 smithi134 ceph-mon[34525]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 245 MiB used, 715 GiB / 715 GiB avail 2024-09-19T04:27:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:00 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1035940127' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "14c34016-a6ec-45d9-8a5a-181af66bd84b"}]: dispatch 2024-09-19T04:27:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:00 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1035940127' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "14c34016-a6ec-45d9-8a5a-181af66bd84b"}]': finished 2024-09-19T04:27:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:00 smithi134 ceph-mon[34525]: osdmap e57: 10 total, 9 up, 10 in 2024-09-19T04:27:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:00 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:01 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/666598893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:01 smithi167 ceph-mon[34339]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:27:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:01 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:01 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/666598893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:01 smithi134 ceph-mon[34525]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:27:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:01 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:01.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:01 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/666598893' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:01.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:01 smithi070 ceph-mon[30942]: osdmap e58: 10 total, 9 up, 10 in 2024-09-19T04:27:01.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:01 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:02.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:02 smithi167 ceph-mon[34339]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:02.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:02 smithi167 ceph-mon[34339]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:27:02.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:02 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:02 smithi134 ceph-mon[34525]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:02 smithi134 ceph-mon[34525]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:27:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:02 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:02 smithi070 ceph-mon[30942]: pgmap v190: 1 pgs: 1 remapped+peering; 577 KiB data, 272 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:02 smithi070 ceph-mon[30942]: osdmap e59: 10 total, 9 up, 10 in 2024-09-19T04:27:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:02 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:04.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:04 smithi167 ceph-mon[34339]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:04 smithi134 ceph-mon[34525]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:04 smithi070 ceph-mon[30942]: pgmap v192: 1 pgs: 1 remapped+peering; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:06.550 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:06 smithi070 ceph-mon[30942]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:27:06.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:06 smithi134 ceph-mon[34525]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:27:06.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:06 smithi167 ceph-mon[34339]: pgmap v193: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-09-19T04:27:08.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:08 smithi070 ceph-mon[30942]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T04:27:08.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:08 smithi167 ceph-mon[34339]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T04:27:08.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:08 smithi134 ceph-mon[34525]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 79 KiB/s, 0 objects/s recovering 2024-09-19T04:27:09.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:27:09.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:09 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:27:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:09 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:09.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-09-19T04:27:09.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:09 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:10.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:10 smithi070 ceph-mon[30942]: Deploying daemon osd.9 on smithi070 2024-09-19T04:27:10.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:10 smithi070 ceph-mon[30942]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:27:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:10 smithi134 ceph-mon[34525]: Deploying daemon osd.9 on smithi070 2024-09-19T04:27:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:10 smithi134 ceph-mon[34525]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:27:10.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:10 smithi167 ceph-mon[34339]: Deploying daemon osd.9 on smithi070 2024-09-19T04:27:10.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:10 smithi167 ceph-mon[34339]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 70 KiB/s, 0 objects/s recovering 2024-09-19T04:27:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:12 smithi134 ceph-mon[34525]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:27:12.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:12 smithi070 ceph-mon[30942]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:27:12.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:12 smithi167 ceph-mon[34339]: pgmap v196: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:27:14.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:14 smithi070 ceph-mon[30942]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T04:27:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:14 smithi134 ceph-mon[34525]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T04:27:14.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:14 smithi167 ceph-mon[34339]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 51 KiB/s, 0 objects/s recovering 2024-09-19T04:27:15.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:15.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:15.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:15 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:15 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:15 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:16.843 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:16 smithi070 ceph-mon[30942]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:27:16.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:16 smithi167 ceph-mon[34339]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:27:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:16 smithi134 ceph-mon[34525]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:27:17.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.916+0000 7fc81b7fe640 1 -- 172.21.15.70:0/1243458616 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fc824062630 con 0x7fc8100a32f0 2024-09-19T04:27:17.918 INFO:teuthology.orchestra.run.smithi070.stdout:Created osd(s) 9 on host 'smithi070' 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc8100a32f0 msgr2=0x7fc8100a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc8100a32f0 0x7fc8100a57b0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fc8200058c0 tx=0x7fc820005d50 comp rx=0 tx=0).stop 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8241026d0 msgr2=0x7fc82419f500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8241026d0 0x7fc82419f500 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fc81c00eb10 tx=0x7fc81c00c2d0 comp rx=0 tx=0).stop 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 shutdown_connections 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc8100a32f0 0x7fc8100a57b0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc8241026d0 0x7fc82419f500 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc824101d10 0x7fc824198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:17.921 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 --2- 172.21.15.70:0/1243458616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc824100b10 0x7fc824197f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 >> 172.21.15.70:0/1243458616 conn(0x7fc8240fc2a0 msgr2=0x7fc824105130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 shutdown_connections 2024-09-19T04:27:17.922 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:27:17.919+0000 7fc82c34a640 1 -- 172.21.15.70:0/1243458616 wait complete. 2024-09-19T04:27:18.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:18.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:18.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:18.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:18.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:18.640 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:18.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:18.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:18.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.641 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.668 DEBUG:teuthology.orchestra.run.smithi070:osd.9> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.9.service 2024-09-19T04:27:18.670 INFO:tasks.cephadm:Deploying osd.10 on smithi134 with /dev/vg_nvme/lv_1... 2024-09-19T04:27:18.671 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:27:18.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:18.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:18.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:18.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:18.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:18.927 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:27:20.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:20 smithi134 ceph-mon[34525]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:20.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:20 smithi070 ceph-mon[30942]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:20.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:20 smithi167 ceph-mon[34339]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:21.145 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:27:20 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:27:20.847+0000 7efeca35e640 -1 osd.9 0 log_to_monitors true 2024-09-19T04:27:21.408 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-09-19T04:27:21.443 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi134:vg_nvme/lv_1 2024-09-19T04:27:21.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:21 smithi070 ceph-mon[30942]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:27:21.700 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:27:21.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:21 smithi167 ceph-mon[34339]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:27:21.722 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:21 smithi134 ceph-mon[34525]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-09-19T04:27:22.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 -- 172.21.15.134:0/1140937716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c102e00 msgr2=0x7f1b0c103280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 --2- 172.21.15.134:0/1140937716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c102e00 0x7f1b0c103280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1b00009900 tx=0x7f1b0002a410 comp rx=0 tx=0).stop 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 -- 172.21.15.134:0/1140937716 shutdown_connections 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 --2- 172.21.15.134:0/1140937716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b0c1037c0 0x7f1b0c10a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 --2- 172.21.15.134:0/1140937716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c102e00 0x7f1b0c103280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 --2- 172.21.15.134:0/1140937716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c101c00 0x7f1b0c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 -- 172.21.15.134:0/1140937716 >> 172.21.15.134:0/1140937716 conn(0x7f1b0c0fd390 msgr2=0x7f1b0c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 -- 172.21.15.134:0/1140937716 shutdown_connections 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.153+0000 7f1b113d6640 1 -- 172.21.15.134:0/1140937716 wait complete. 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b113d6640 1 Processor -- start 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b113d6640 1 -- start start 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b113d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c101c00 0x7f1b0c197f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:22.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b113d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b0c102e00 0x7f1b0c1984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b113d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c1037c0 0x7f1b0c19f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b113d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c10d870 con 0x7f1b0c102e00 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b113d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c10d6f0 con 0x7f1b0c101c00 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b113d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1b0c10d9f0 con 0x7f1b0c1037c0 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b0affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c101c00 0x7f1b0c197f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b0affd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c101c00 0x7f1b0c197f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:49478/0 (socket says 172.21.15.134:49478) 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.154+0000 7f1b0affd640 1 -- 172.21.15.134:0/2129089753 learned_addr learned my addr 172.21.15.134:0/2129089753 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b0b7fe640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c1037c0 0x7f1b0c19f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b0a7fc640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b0c102e00 0x7f1b0c1984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b0affd640 1 -- 172.21.15.134:0/2129089753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c1037c0 msgr2=0x7f1b0c19f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b0affd640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c1037c0 0x7f1b0c19f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:22.167 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b0affd640 1 -- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b0c102e00 msgr2=0x7f1b0c1984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b0affd640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b0c102e00 0x7f1b0c1984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b0affd640 1 -- 172.21.15.134:0/2129089753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b0c19fb90 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b0affd640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c101c00 0x7f1b0c197f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00d950 tx=0x7f1afc00de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1af3fff640 1 -- 172.21.15.134:0/2129089753 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc017070 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1af3fff640 1 -- 172.21.15.134:0/2129089753 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1afc009c30 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b0c074480 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1af3fff640 1 -- 172.21.15.134:0/2129089753 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1afc00f620 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.155+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b0c0749c0 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.156+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b0c109020 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.158+0000 7f1af3fff640 1 -- 172.21.15.134:0/2129089753 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1afc01a070 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.158+0000 7f1af3fff640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1af40a32f0 0x7f1af40a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.158+0000 7f1af3fff640 1 -- 172.21.15.134:0/2129089753 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(60..60 src has 1..60) ==== 5965+0+0 (secure 0 0 0) 0x7f1afc0cea60 con 0x7f1b0c101c00 2024-09-19T04:27:22.168 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.158+0000 7f1b0a7fc640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1af40a32f0 0x7f1af40a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:22.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.159+0000 7f1b0a7fc640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1af40a32f0 0x7f1af40a57b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c199480 tx=0x7f1b00031510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:22.169 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.162+0000 7f1af3fff640 1 -- 172.21.15.134:0/2129089753 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1afc09c130 con 0x7f1b0c101c00 2024-09-19T04:27:22.345 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:22.344+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f1b0c075e10 con 0x7f1af40a32f0 2024-09-19T04:27:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:27:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:27:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:27:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:27:22.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:22.736 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:22.736 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:27:22.736 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:27:22.736 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:27:22.736 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:22.736 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.736 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:27:22.737 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:22.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:27:22.430+0000 7efec5abe640 -1 osd.9 0 waiting for initial osdmap 2024-09-19T04:27:22.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:27:22.447+0000 7efec20f8640 -1 osd.9 61 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:27:22.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:22.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-09-19T04:27:22.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: osdmap e60: 10 total, 9 up, 10 in 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]: dispatch 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:22.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:27:22.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:27:22.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:23.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:23 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi070 2024-09-19T04:27:23.663 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:23 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-19T04:27:23.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:23 smithi134 ceph-mon[34525]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:27:23.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:23 smithi134 ceph-mon[34525]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:27:23.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:23 smithi134 ceph-mon[34525]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T04:27:23.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:23 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:23.664 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:23 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:23.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:23 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi070 2024-09-19T04:27:23.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:23 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-19T04:27:23.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:23 smithi167 ceph-mon[34339]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:27:23.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:23 smithi167 ceph-mon[34339]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:27:23.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:23 smithi167 ceph-mon[34339]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T04:27:23.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:23 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:23.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:23 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:23 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi070 2024-09-19T04:27:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:23 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi070 to 4272M 2024-09-19T04:27:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:23 smithi070 ceph-mon[30942]: from='client.24338 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:27:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:23 smithi070 ceph-mon[30942]: from='osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi070", "root=default"]}]': finished 2024-09-19T04:27:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:23 smithi070 ceph-mon[30942]: osdmap e61: 10 total, 9 up, 10 in 2024-09-19T04:27:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:23 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:23 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:24.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:24 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:27:24.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:24 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:27:24.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:24 smithi134 ceph-mon[34525]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:24.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:24.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:24 smithi134 ceph-mon[34525]: osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] boot 2024-09-19T04:27:24.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:24 smithi134 ceph-mon[34525]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T04:27:24.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:24 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:24.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:24 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:27:24.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:24 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:27:24.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:24 smithi167 ceph-mon[34339]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:24.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:24.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:24 smithi167 ceph-mon[34339]: osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] boot 2024-09-19T04:27:24.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:24 smithi167 ceph-mon[34339]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T04:27:24.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:24 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:24.796 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:24 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:27:24.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:24 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:27:24.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:24 smithi070 ceph-mon[30942]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 273 MiB used, 804 GiB / 805 GiB avail 2024-09-19T04:27:24.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:24.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:24 smithi070 ceph-mon[30942]: osd.9 [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] boot 2024-09-19T04:27:24.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:24 smithi070 ceph-mon[30942]: osdmap e62: 10 total, 10 up, 10 in 2024-09-19T04:27:24.797 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:24 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:27:25.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:25 smithi167 ceph-mon[34339]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T04:27:25.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:25 smithi167 ceph-mon[34339]: from='client.? 172.21.15.134:0/963788263' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]: dispatch 2024-09-19T04:27:25.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:25 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]: dispatch 2024-09-19T04:27:25.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:25 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]': finished 2024-09-19T04:27:25.713 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:25 smithi167 ceph-mon[34339]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:27:25.714 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:25 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:25.714 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:25 smithi167 ceph-mon[34339]: from='client.? 172.21.15.134:0/3902689228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:25.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:25 smithi134 ceph-mon[34525]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T04:27:25.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:25 smithi134 ceph-mon[34525]: from='client.? 172.21.15.134:0/963788263' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]: dispatch 2024-09-19T04:27:25.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:25 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]: dispatch 2024-09-19T04:27:25.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:25 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]': finished 2024-09-19T04:27:25.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:25 smithi134 ceph-mon[34525]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:27:25.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:25 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:25.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:25 smithi134 ceph-mon[34525]: from='client.? 172.21.15.134:0/3902689228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:25 smithi070 ceph-mon[30942]: osdmap e63: 10 total, 10 up, 10 in 2024-09-19T04:27:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:25 smithi070 ceph-mon[30942]: from='client.? 172.21.15.134:0/963788263' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]: dispatch 2024-09-19T04:27:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:25 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]: dispatch 2024-09-19T04:27:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:25 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfad740c-5443-45df-b7d6-523d91197fe2"}]': finished 2024-09-19T04:27:25.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:25 smithi070 ceph-mon[30942]: osdmap e64: 11 total, 10 up, 11 in 2024-09-19T04:27:25.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:25 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:25.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:25 smithi070 ceph-mon[30942]: from='client.? 172.21.15.134:0/3902689228' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:26.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:26 smithi167 ceph-mon[34339]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:26.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:26 smithi134 ceph-mon[34525]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:26.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:26 smithi070 ceph-mon[30942]: pgmap v208: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:28.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:28 smithi167 ceph-mon[34339]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:28 smithi134 ceph-mon[34525]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:28.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:28 smithi070 ceph-mon[30942]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:30.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:30 smithi167 ceph-mon[34339]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:30.747 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:30 smithi134 ceph-mon[34525]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:30.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:30 smithi070 ceph-mon[30942]: pgmap v210: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:32.689 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:32 smithi134 ceph-mon[34525]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:32.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:32 smithi167 ceph-mon[34339]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:32 smithi070 ceph-mon[30942]: pgmap v211: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:33.725 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:27:33.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:27:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:33.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-09-19T04:27:33.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:34.729 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:34 smithi134 ceph-mon[34525]: Deploying daemon osd.10 on smithi134 2024-09-19T04:27:34.729 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:34 smithi134 ceph-mon[34525]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:34 smithi070 ceph-mon[30942]: Deploying daemon osd.10 on smithi134 2024-09-19T04:27:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:34 smithi070 ceph-mon[30942]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:34.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:34 smithi167 ceph-mon[34339]: Deploying daemon osd.10 on smithi134 2024-09-19T04:27:34.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:34 smithi167 ceph-mon[34339]: pgmap v212: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:36.698 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:36 smithi134 ceph-mon[34525]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:36 smithi070 ceph-mon[30942]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:36.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:36 smithi167 ceph-mon[34339]: pgmap v213: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:38.745 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:38 smithi134 ceph-mon[34525]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:38 smithi070 ceph-mon[30942]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:38.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:38 smithi167 ceph-mon[34339]: pgmap v214: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:39.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:39 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:39.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:39 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:39.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:39 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:39.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:39.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:39.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:39 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:39.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:39 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:39.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:39 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:39.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:39 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:40.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:40 smithi134 ceph-mon[34525]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:40 smithi070 ceph-mon[30942]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:40.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:40 smithi167 ceph-mon[34339]: pgmap v215: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:42.491 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.489+0000 7f1af3fff640 1 -- 172.21.15.134:0/2129089753 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f1b0c075e10 con 0x7f1af40a32f0 2024-09-19T04:27:42.492 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 10 on host 'smithi134' 2024-09-19T04:27:42.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1af40a32f0 msgr2=0x7f1af40a57b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:42.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1af40a32f0 0x7f1af40a57b0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1b0c199480 tx=0x7f1b00031510 comp rx=0 tx=0).stop 2024-09-19T04:27:42.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c101c00 msgr2=0x7f1b0c197f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:42.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c101c00 0x7f1b0c197f60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f1afc00d950 tx=0x7f1afc00de10 comp rx=0 tx=0).stop 2024-09-19T04:27:42.494 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 shutdown_connections 2024-09-19T04:27:42.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1af40a32f0 0x7f1af40a57b0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:42.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1b0c1037c0 0x7f1b0c19f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:42.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1b0c102e00 0x7f1b0c1984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:42.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 --2- 172.21.15.134:0/2129089753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1b0c101c00 0x7f1b0c197f60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:42.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.491+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 >> 172.21.15.134:0/2129089753 conn(0x7f1b0c0fd390 msgr2=0x7f1b0c1061f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:42.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.492+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 shutdown_connections 2024-09-19T04:27:42.495 INFO:teuthology.orchestra.run.smithi134.stderr:2024-09-19T04:27:42.492+0000 7f1b113d6640 1 -- 172.21.15.134:0/2129089753 wait complete. 2024-09-19T04:27:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:42 smithi134 ceph-mon[34525]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:42.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:42 smithi070 ceph-mon[30942]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:42.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:42.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:42.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:42.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:42.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:42.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:42 smithi167 ceph-mon[34339]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:42.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:42.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:42.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:42.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:42.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:43.088 DEBUG:teuthology.orchestra.run.smithi134:osd.10> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.10.service 2024-09-19T04:27:43.091 INFO:tasks.cephadm:Deploying osd.11 on smithi167 with /dev/vg_nvme/lv_1... 2024-09-19T04:27:43.091 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-09-19T04:27:43.348 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:27:43.665 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:43 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:43.665 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:43 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:43.665 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:43 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:43.757 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:43 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:43.757 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:43 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:43.757 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:43 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:27:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:44.598 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:44 smithi134 ceph-mon[34525]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:44.746 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:44 smithi167 ceph-mon[34339]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:44.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:44 smithi070 ceph-mon[30942]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:45.499 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:27:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:27:45.192+0000 7f73d27b8640 -1 osd.10 0 log_to_monitors true 2024-09-19T04:27:45.660 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:45 smithi167 ceph-mon[34339]: from='osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:27:45.660 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:45 smithi167 ceph-mon[34339]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:27:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:45 smithi134 ceph-mon[34525]: from='osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:27:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:45 smithi134 ceph-mon[34525]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:27:45.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:45 smithi070 ceph-mon[30942]: from='osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:27:45.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:45 smithi070 ceph-mon[30942]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-09-19T04:27:46.231 INFO:teuthology.orchestra.run.smithi167.stdout: 2024-09-19T04:27:46.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch daemon add osd smithi167:vg_nvme/lv_1 2024-09-19T04:27:46.507 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.758 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.759 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.759 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.759 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.759 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.759 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:46.759 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:46.759 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:46 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:27:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T04:27:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:46.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:46 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-09-19T04:27:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: osdmap e65: 11 total, 10 up, 11 in 2024-09-19T04:27:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:27:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:27:46.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:46 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:27:46.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 -- 172.21.15.167:0/593396562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c101bf0 msgr2=0x7f8c8c101ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:46.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 --2- 172.21.15.167:0/593396562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c101bf0 0x7f8c8c101ff0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c009900 tx=0x7f8c7c02a410 comp rx=0 tx=0).stop 2024-09-19T04:27:46.948 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 -- 172.21.15.167:0/593396562 shutdown_connections 2024-09-19T04:27:46.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 --2- 172.21.15.167:0/593396562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c8c1037b0 0x7f8c8c10a040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:46.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 --2- 172.21.15.167:0/593396562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c8c102df0 0x7f8c8c103270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:46.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 --2- 172.21.15.167:0/593396562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c101bf0 0x7f8c8c101ff0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:46.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 -- 172.21.15.167:0/593396562 >> 172.21.15.167:0/593396562 conn(0x7f8c8c0fd3c0 msgr2=0x7f8c8c0ff7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:27:46.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 -- 172.21.15.167:0/593396562 shutdown_connections 2024-09-19T04:27:46.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.946+0000 7f8c917e0640 1 -- 172.21.15.167:0/593396562 wait complete. 2024-09-19T04:27:46.949 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c917e0640 1 Processor -- start 2024-09-19T04:27:46.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c917e0640 1 -- start start 2024-09-19T04:27:46.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c917e0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c8c101bf0 0x7f8c8c197eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:46.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c917e0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c102df0 0x7f8c8c1983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:46.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c917e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c8c1037b0 0x7f8c8c19f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:46.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c917e0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c10d860 con 0x7f8c8c1037b0 2024-09-19T04:27:46.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c917e0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c10d6e0 con 0x7f8c8c101bf0 2024-09-19T04:27:46.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c917e0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8c8c10d9e0 con 0x7f8c8c102df0 2024-09-19T04:27:46.951 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c827fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c102df0 0x7f8c8c1983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c827fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c102df0 0x7f8c8c1983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:36828/0 (socket says 172.21.15.167:36828) 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c827fc640 1 -- 172.21.15.167:0/4001581931 learned_addr learned my addr 172.21.15.167:0/4001581931 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c8affd640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c8c101bf0 0x7f8c8c197eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.947+0000 7f8c8b7fe640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c8c1037b0 0x7f8c8c19f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c827fc640 1 -- 172.21.15.167:0/4001581931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c8c101bf0 msgr2=0x7f8c8c197eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c827fc640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c8c101bf0 0x7f8c8c197eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c827fc640 1 -- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c8c1037b0 msgr2=0x7f8c8c19f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c827fc640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c8c1037b0 0x7f8c8c19f470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c827fc640 1 -- 172.21.15.167:0/4001581931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c8c19fae0 con 0x7f8c8c102df0 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c8b7fe640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c8c1037b0 0x7f8c8c19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c827fc640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c102df0 0x7f8c8c1983f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400e9f0 tx=0x7f8c7400edf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c88ff9640 1 -- 172.21.15.167:0/4001581931 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c7400cd80 con 0x7f8c8c102df0 2024-09-19T04:27:46.952 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c88ff9640 1 -- 172.21.15.167:0/4001581931 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8c740054f0 con 0x7f8c8c102df0 2024-09-19T04:27:46.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c8c19fdd0 con 0x7f8c8c102df0 2024-09-19T04:27:46.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c88ff9640 1 -- 172.21.15.167:0/4001581931 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c74010690 con 0x7f8c8c102df0 2024-09-19T04:27:46.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.948+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c8c1a0230 con 0x7f8c8c102df0 2024-09-19T04:27:46.953 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.949+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8c8c109040 con 0x7f8c8c102df0 2024-09-19T04:27:46.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.950+0000 7f8c88ff9640 1 -- 172.21.15.167:0/4001581931 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8c74004ec0 con 0x7f8c8c102df0 2024-09-19T04:27:46.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.951+0000 7f8c88ff9640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8c780a3270 0x7f8c780a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:27:46.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.951+0000 7f8c88ff9640 1 -- 172.21.15.167:0/4001581931 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(66..66 src has 1..66) ==== 6414+0+0 (secure 0 0 0) 0x7f8c740cf7c0 con 0x7f8c8c102df0 2024-09-19T04:27:46.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.951+0000 7f8c8affd640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8c780a3270 0x7f8c780a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:27:46.954 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.952+0000 7f8c8affd640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8c780a3270 0x7f8c780a5730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c006010 tx=0x7f8c7c031510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:27:46.956 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:46.955+0000 7f8c88ff9640 1 -- 172.21.15.167:0/4001581931 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8c74054210 con 0x7f8c8c102df0 2024-09-19T04:27:47.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:27:47.130+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f8c8c062630 con 0x7f8c780a3270 2024-09-19T04:27:47.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:27:47.277+0000 7f73cdf18640 -1 osd.10 0 waiting for initial osdmap 2024-09-19T04:27:47.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:27:47.293+0000 7f73c654a640 -1 osd.10 66 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:27:47.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi134 2024-09-19T04:27:47.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-19T04:27:47.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: from='osd.10 ' entity='osd.10' 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] boot 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T04:27:47.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:47.869 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi134 2024-09-19T04:27:47.869 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-19T04:27:47.869 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:27:47.869 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T04:27:47.869 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:47.869 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:47.870 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:27:47.870 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:27:47.870 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:47.870 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: from='osd.10 ' entity='osd.10' 2024-09-19T04:27:47.870 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] boot 2024-09-19T04:27:47.870 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T04:27:47.870 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi134 2024-09-19T04:27:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi134 to 4272M 2024-09-19T04:27:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-09-19T04:27:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: osdmap e66: 11 total, 10 up, 11 in 2024-09-19T04:27:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-09-19T04:27:47.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-09-19T04:27:47.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:47.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: from='osd.10 ' entity='osd.10' 2024-09-19T04:27:47.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: osd.10 [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] boot 2024-09-19T04:27:47.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: osdmap e67: 11 total, 11 up, 11 in 2024-09-19T04:27:47.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:27:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:48 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:27:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:48 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:27:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:48 smithi134 ceph-mon[34525]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:27:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:48 smithi134 ceph-mon[34525]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:48.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:48 smithi134 ceph-mon[34525]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T04:27:48.814 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:48 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:27:48.814 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:48 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:27:48.814 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:48 smithi167 ceph-mon[34339]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:27:48.814 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:48 smithi167 ceph-mon[34339]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:48.815 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:48 smithi167 ceph-mon[34339]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T04:27:48.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:48 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:27:48.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:48 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:27:48.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:48 smithi070 ceph-mon[30942]: from='client.24337 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi167:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:27:48.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:48 smithi070 ceph-mon[30942]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 300 MiB used, 894 GiB / 894 GiB avail 2024-09-19T04:27:48.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:48 smithi070 ceph-mon[30942]: osdmap e68: 11 total, 11 up, 11 in 2024-09-19T04:27:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:50 smithi134 ceph-mon[34525]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 735 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:27:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:50 smithi134 ceph-mon[34525]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T04:27:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:50 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/3635545401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]: dispatch 2024-09-19T04:27:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:50 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]: dispatch 2024-09-19T04:27:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:50 smithi134 ceph-mon[34525]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]': finished 2024-09-19T04:27:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:50 smithi134 ceph-mon[34525]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:27:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:50 smithi134 ceph-mon[34525]: from='client.? 172.21.15.167:0/2028118639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:50 smithi070 ceph-mon[30942]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 735 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:27:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:50 smithi070 ceph-mon[30942]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T04:27:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/3635545401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]: dispatch 2024-09-19T04:27:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:50 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]: dispatch 2024-09-19T04:27:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:50 smithi070 ceph-mon[30942]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]': finished 2024-09-19T04:27:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:50 smithi070 ceph-mon[30942]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:27:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:50.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.167:0/2028118639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:50.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:50 smithi167 ceph-mon[34339]: pgmap v224: 1 pgs: 1 active+clean; 577 KiB data, 735 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:27:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:50 smithi167 ceph-mon[34339]: osdmap e69: 11 total, 11 up, 11 in 2024-09-19T04:27:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:50 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/3635545401' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]: dispatch 2024-09-19T04:27:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:50 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]: dispatch 2024-09-19T04:27:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:50 smithi167 ceph-mon[34339]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c23990f1-2aae-47b0-a906-4075d086633d"}]': finished 2024-09-19T04:27:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:50 smithi167 ceph-mon[34339]: osdmap e70: 12 total, 11 up, 12 in 2024-09-19T04:27:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:50 smithi167 ceph-mon[34339]: from='client.? 172.21.15.167:0/2028118639' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-09-19T04:27:51.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:51 smithi070 ceph-mon[30942]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:27:51.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:51 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:51.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:51 smithi070 ceph-mon[30942]: pgmap v228: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 735 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:27:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:51 smithi167 ceph-mon[34339]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:27:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:51 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:51 smithi167 ceph-mon[34339]: pgmap v228: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 735 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:27:52.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:51 smithi134 ceph-mon[34525]: osdmap e71: 12 total, 11 up, 12 in 2024-09-19T04:27:52.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:51 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:52.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:51 smithi134 ceph-mon[34525]: pgmap v228: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 735 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:27:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:52 smithi070 ceph-mon[30942]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:27:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:52 smithi070 ceph-mon[30942]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T04:27:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:52 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:52.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:52 smithi167 ceph-mon[34339]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:27:52.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:52 smithi167 ceph-mon[34339]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T04:27:52.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:52 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:52 smithi134 ceph-mon[34525]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-09-19T04:27:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:52 smithi134 ceph-mon[34525]: osdmap e72: 12 total, 11 up, 12 in 2024-09-19T04:27:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:52 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:27:53.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:53 smithi070 ceph-mon[30942]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:27:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:53 smithi167 ceph-mon[34339]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:27:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:53 smithi134 ceph-mon[34525]: pgmap v230: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 2/6 objects degraded (33.333%) 2024-09-19T04:27:55.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:55 smithi167 ceph-mon[34339]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:27:55.698 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:55 smithi167 ceph-mon[34339]: Cluster is now healthy 2024-09-19T04:27:55.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:55 smithi134 ceph-mon[34525]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:27:55.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:55 smithi134 ceph-mon[34525]: Cluster is now healthy 2024-09-19T04:27:55.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:55 smithi070 ceph-mon[30942]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-09-19T04:27:55.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:55 smithi070 ceph-mon[30942]: Cluster is now healthy 2024-09-19T04:27:56.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:56 smithi167 ceph-mon[34339]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T04:27:56.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:56 smithi134 ceph-mon[34525]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T04:27:56.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:56 smithi070 ceph-mon[30942]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 98 KiB/s, 0 objects/s recovering 2024-09-19T04:27:58.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:58 smithi167 ceph-mon[34339]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T04:27:58.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:27:58.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:58 smithi134 ceph-mon[34525]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T04:27:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:27:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:58 smithi070 ceph-mon[30942]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 73 KiB/s, 0 objects/s recovering 2024-09-19T04:27:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-09-19T04:27:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:27:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:27:59 smithi134 ceph-mon[34525]: Deploying daemon osd.11 on smithi167 2024-09-19T04:27:59.843 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:27:59 smithi167 ceph-mon[34339]: Deploying daemon osd.11 on smithi167 2024-09-19T04:27:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:27:59 smithi070 ceph-mon[30942]: Deploying daemon osd.11 on smithi167 2024-09-19T04:28:00.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:00 smithi167 ceph-mon[34339]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T04:28:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:00 smithi134 ceph-mon[34525]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T04:28:00.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:00 smithi070 ceph-mon[30942]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 66 KiB/s, 0 objects/s recovering 2024-09-19T04:28:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:02 smithi134 ceph-mon[34525]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:28:02.823 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:02 smithi167 ceph-mon[34339]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:28:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:02 smithi070 ceph-mon[30942]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 58 KiB/s, 0 objects/s recovering 2024-09-19T04:28:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:04 smithi134 ceph-mon[34525]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T04:28:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:04 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:04.800 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:04 smithi167 ceph-mon[34339]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T04:28:04.800 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:04.800 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:04.800 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:04 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:04 smithi070 ceph-mon[30942]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 49 KiB/s, 0 objects/s recovering 2024-09-19T04:28:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:04 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:06.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:06 smithi134 ceph-mon[34525]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:28:06.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:06 smithi167 ceph-mon[34339]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:28:06.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:06 smithi070 ceph-mon[30942]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-09-19T04:28:07.571 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.569+0000 7f8c88ff9640 1 -- 172.21.15.167:0/4001581931 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f8c8c062630 con 0x7f8c780a3270 2024-09-19T04:28:07.571 INFO:teuthology.orchestra.run.smithi167.stdout:Created osd(s) 11 on host 'smithi167' 2024-09-19T04:28:07.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8c780a3270 msgr2=0x7f8c780a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:07.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8c780a3270 0x7f8c780a5730 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f8c7c006010 tx=0x7f8c7c031510 comp rx=0 tx=0).stop 2024-09-19T04:28:07.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c102df0 msgr2=0x7f8c8c1983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:07.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c102df0 0x7f8c8c1983f0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f8c7400e9f0 tx=0x7f8c7400edf0 comp rx=0 tx=0).stop 2024-09-19T04:28:07.573 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 shutdown_connections 2024-09-19T04:28:07.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8c780a3270 0x7f8c780a5730 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:07.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c8c1037b0 0x7f8c8c19f470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:07.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c8c102df0 0x7f8c8c1983f0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:07.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 --2- 172.21.15.167:0/4001581931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c8c101bf0 0x7f8c8c197eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:07.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 >> 172.21.15.167:0/4001581931 conn(0x7f8c8c0fd3c0 msgr2=0x7f8c8c106210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:07.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 shutdown_connections 2024-09-19T04:28:07.574 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:07.571+0000 7f8c917e0640 1 -- 172.21.15.167:0/4001581931 wait complete. 2024-09-19T04:28:08.143 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.143 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.143 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:08.144 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:08.144 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.144 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:08.144 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:08.144 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.144 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:08.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:08.552 DEBUG:teuthology.orchestra.run.smithi167:osd.11> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.11.service 2024-09-19T04:28:08.554 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-09-19T04:28:08.554 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:28:08.810 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 -- 172.21.15.70:0/2543993063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c1037c0 msgr2=0x7f909c10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 --2- 172.21.15.70:0/2543993063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c1037c0 0x7f909c10a050 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f9094009ca0 tx=0x7f909402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 -- 172.21.15.70:0/2543993063 shutdown_connections 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 --2- 172.21.15.70:0/2543993063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c1037c0 0x7f909c10a050 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 --2- 172.21.15.70:0/2543993063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f909c102e00 0x7f909c103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 --2- 172.21.15.70:0/2543993063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f909c101c00 0x7f909c102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 -- 172.21.15.70:0/2543993063 >> 172.21.15.70:0/2543993063 conn(0x7f909c0fd390 msgr2=0x7f909c0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 -- 172.21.15.70:0/2543993063 shutdown_connections 2024-09-19T04:28:09.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.259+0000 7f90a120e640 1 -- 172.21.15.70:0/2543993063 wait complete. 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.260+0000 7f90a120e640 1 Processor -- start 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.260+0000 7f90a120e640 1 -- start start 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.260+0000 7f90a120e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c101c00 0x7f909c197df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.260+0000 7f90a120e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f909c102e00 0x7f909c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.260+0000 7f90a120e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f909c1037c0 0x7f909c19f3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.260+0000 7f90a120e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f909c10d870 con 0x7f909c101c00 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.260+0000 7f90a120e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f909c10d6f0 con 0x7f909c102e00 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.260+0000 7f90a120e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f909c10d9f0 con 0x7f909c1037c0 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c101c00 0x7f909c197df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c101c00 0x7f909c197df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40826/0 (socket says 172.21.15.70:40826) 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 -- 172.21.15.70:0/1639020717 learned_addr learned my addr 172.21.15.70:0/1639020717 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:09.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909b59e640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f909c1037c0 0x7f909c19f3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909a59c640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f909c102e00 0x7f909c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 -- 172.21.15.70:0/1639020717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f909c1037c0 msgr2=0x7f909c19f3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f909c1037c0 0x7f909c19f3b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 -- 172.21.15.70:0/1639020717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f909c102e00 msgr2=0x7f909c198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f909c102e00 0x7f909c198330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 -- 172.21.15.70:0/1639020717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f909c19fa20 con 0x7f909c101c00 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f909ad9d640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c101c00 0x7f909c197df0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f908c00e9c0 tx=0x7f908c00edc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f9083fff640 1 -- 172.21.15.70:0/1639020717 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c00ccc0 con 0x7f909c101c00 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f909c19fd10 con 0x7f909c101c00 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f9083fff640 1 -- 172.21.15.70:0/1639020717 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f908c0035f0 con 0x7f909c101c00 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f9083fff640 1 -- 172.21.15.70:0/1639020717 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f908c00ce60 con 0x7f909c101c00 2024-09-19T04:28:09.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.261+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f909c1a01e0 con 0x7f909c101c00 2024-09-19T04:28:09.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.263+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f909c108f80 con 0x7f909c101c00 2024-09-19T04:28:09.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.264+0000 7f9083fff640 1 -- 172.21.15.70:0/1639020717 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f908c0037a0 con 0x7f909c101c00 2024-09-19T04:28:09.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.264+0000 7f9083fff640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f90840a3270 0x7f90840a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:09.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.264+0000 7f909a59c640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f90840a3270 0x7f90840a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:09.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.264+0000 7f9083fff640 1 -- 172.21.15.70:0/1639020717 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(72..72 src has 1..72) ==== 6809+0+0 (secure 0 0 0) 0x7f908c0cf660 con 0x7f909c101c00 2024-09-19T04:28:09.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.265+0000 7f909a59c640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f90840a3270 0x7f90840a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f909c199310 tx=0x7f909000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:09.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.268+0000 7f9083fff640 1 -- 172.21.15.70:0/1639020717 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f908c09c960 con 0x7f909c101c00 2024-09-19T04:28:09.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.441+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f909c062ec0 con 0x7f909c101c00 2024-09-19T04:28:09.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.442+0000 7f9083fff640 1 -- 172.21.15.70:0/1639020717 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v72) ==== 74+0+133 (secure 0 0 0) 0x7f908c09c260 con 0x7f909c101c00 2024-09-19T04:28:09.443 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f90840a3270 msgr2=0x7f90840a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f90840a3270 0x7f90840a5730 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f909c199310 tx=0x7f909000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c101c00 msgr2=0x7f909c197df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c101c00 0x7f909c197df0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f908c00e9c0 tx=0x7f908c00edc0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 shutdown_connections 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f90840a3270 0x7f90840a5730 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f909c1037c0 0x7f909c19f3b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f909c102e00 0x7f909c198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 --2- 172.21.15.70:0/1639020717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f909c101c00 0x7f909c197df0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 >> 172.21.15.70:0/1639020717 conn(0x7f909c0fd390 msgr2=0x7f909c106150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 shutdown_connections 2024-09-19T04:28:09.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:09.445+0000 7f90a120e640 1 -- 172.21.15.70:0/1639020717 wait complete. 2024-09-19T04:28:10.235 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":72,"num_osds":12,"num_up_osds":11,"osd_up_since":1726720067,"num_in_osds":12,"osd_in_since":1726720069,"num_remapped_pgs":0} 2024-09-19T04:28:10.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:10 smithi070 ceph-mon[30942]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:10.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:10 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1639020717' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:10.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:10 smithi167 ceph-mon[34339]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:10.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:10 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1639020717' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:10.679 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:28:10 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:28:10.425+0000 7f99611ac640 -1 osd.11 0 log_to_monitors true 2024-09-19T04:28:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:10 smithi134 ceph-mon[34525]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:10 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1639020717' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:11.236 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:28:11.498 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.619 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:11.620 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:11.620 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:11 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:11 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:28:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-09-19T04:28:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:11.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:11 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:11.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- 172.21.15.70:0/954652782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 msgr2=0x7f2a78100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 --2- 172.21.15.70:0/954652782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 0x7f2a78100ed0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f2a74009900 tx=0x7f2a7402a410 comp rx=0 tx=0).stop 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- 172.21.15.70:0/954652782 shutdown_connections 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 --2- 172.21.15.70:0/954652782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a78102690 0x7f2a78108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 --2- 172.21.15.70:0/954652782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78101cd0 0x7f2a78102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 --2- 172.21.15.70:0/954652782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 0x7f2a78100ed0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- 172.21.15.70:0/954652782 >> 172.21.15.70:0/954652782 conn(0x7f2a780fc280 msgr2=0x7f2a780fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- 172.21.15.70:0/954652782 shutdown_connections 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- 172.21.15.70:0/954652782 wait complete. 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 Processor -- start 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- start start 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 0x7f2a7806ab10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:11.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78101cd0 0x7f2a7819cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a78102690 0x7f2a7819f250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7810c740 con 0x7f2a78100ad0 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7810c5c0 con 0x7f2a78101cd0 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.981+0000 7f2a7f474640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a7810c8c0 con 0x7f2a78102690 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 0x7f2a7806ab10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 0x7f2a7806ab10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40858/0 (socket says 172.21.15.70:40858) 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 -- 172.21.15.70:0/320980534 learned_addr learned my addr 172.21.15.70:0/320980534 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7ca0f640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78101cd0 0x7f2a7819cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7da11640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a78102690 0x7f2a7819f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 -- 172.21.15.70:0/320980534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a78102690 msgr2=0x7f2a7819f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a78102690 0x7f2a7819f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:11.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 -- 172.21.15.70:0/320980534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78101cd0 msgr2=0x7f2a7819cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78101cd0 0x7f2a7819cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 -- 172.21.15.70:0/320980534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7819fb10 con 0x7f2a78100ad0 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7da11640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a78102690 0x7f2a7819f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7ca0f640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78101cd0 0x7f2a7819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7d210640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 0x7f2a7806ab10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a74005ab0 tx=0x7f2a740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a6e7fc640 1 -- 172.21.15.70:0/320980534 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7403f030 con 0x7f2a78100ad0 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7819fda0 con 0x7f2a78100ad0 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a6e7fc640 1 -- 172.21.15.70:0/320980534 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a74003ac0 con 0x7f2a78100ad0 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a6e7fc640 1 -- 172.21.15.70:0/320980534 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74035070 con 0x7f2a78100ad0 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.982+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a781a0210 con 0x7f2a78100ad0 2024-09-19T04:28:11.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.983+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a78107f20 con 0x7f2a78100ad0 2024-09-19T04:28:11.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.985+0000 7f2a6e7fc640 1 -- 172.21.15.70:0/320980534 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2a74042030 con 0x7f2a78100ad0 2024-09-19T04:28:11.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.985+0000 7f2a6e7fc640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2a640a3240 0x7f2a640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:11.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.985+0000 7f2a7ca0f640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2a640a3240 0x7f2a640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:11.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.986+0000 7f2a6e7fc640 1 -- 172.21.15.70:0/320980534 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6831+0+0 (secure 0 0 0) 0x7f2a740efa20 con 0x7f2a78100ad0 2024-09-19T04:28:11.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.986+0000 7f2a7ca0f640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2a640a3240 0x7f2a640a5700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a7806a890 tx=0x7f2a68005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:11.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:11.990+0000 7f2a6e7fc640 1 -- 172.21.15.70:0/320980534 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2a740bcd10 con 0x7f2a78100ad0 2024-09-19T04:28:12.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.155+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f2a78062df0 con 0x7f2a78100ad0 2024-09-19T04:28:12.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.155+0000 7f2a6e7fc640 1 -- 172.21.15.70:0/320980534 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f2a740bc610 con 0x7f2a78100ad0 2024-09-19T04:28:12.157 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:12.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2a640a3240 msgr2=0x7f2a640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:12.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2a640a3240 0x7f2a640a5700 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f2a7806a890 tx=0x7f2a68005f90 comp rx=0 tx=0).stop 2024-09-19T04:28:12.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 msgr2=0x7f2a7806ab10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:12.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 0x7f2a7806ab10 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2a74005ab0 tx=0x7f2a740042f0 comp rx=0 tx=0).stop 2024-09-19T04:28:12.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 shutdown_connections 2024-09-19T04:28:12.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2a640a3240 0x7f2a640a5700 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:12.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a78102690 0x7f2a7819f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:12.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a78101cd0 0x7f2a7819cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:12.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 --2- 172.21.15.70:0/320980534 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a78100ad0 0x7f2a7806ab10 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:12.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 >> 172.21.15.70:0/320980534 conn(0x7f2a780fc280 msgr2=0x7f2a781050f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:12.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 shutdown_connections 2024-09-19T04:28:12.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:12.157+0000 7f2a7f474640 1 -- 172.21.15.70:0/320980534 wait complete. 2024-09-19T04:28:12.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: Detected new or changed devices on smithi167 2024-09-19T04:28:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-19T04:28:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:28:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: from='osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:28:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T04:28:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:28:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:12 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/320980534' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: Detected new or changed devices on smithi167 2024-09-19T04:28:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-19T04:28:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:28:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: from='osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:28:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T04:28:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:28:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:12 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/320980534' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:12.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: Detected new or changed devices on smithi167 2024-09-19T04:28:12.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi167 to 4272M 2024-09-19T04:28:12.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:12.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-09-19T04:28:12.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: from='osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:28:12.840 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: osdmap e73: 12 total, 11 up, 12 in 2024-09-19T04:28:12.840 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:12.840 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]: dispatch 2024-09-19T04:28:12.840 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:12 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/320980534' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:12.866 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1726720067,"num_in_osds":12,"osd_in_since":1726720069,"num_remapped_pgs":0} 2024-09-19T04:28:13.710 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:28:13.229+0000 7f995c90c640 -1 osd.11 0 waiting for initial osdmap 2024-09-19T04:28:13.711 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:28:13.245+0000 7f9954f3e640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T04:28:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-mon[34339]: purged_snaps scrub starts 2024-09-19T04:28:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-mon[34339]: purged_snaps scrub ok 2024-09-19T04:28:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-mon[34339]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:28:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-mon[34339]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T04:28:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:13 smithi167 ceph-mon[34339]: from='osd.11 ' entity='osd.11' 2024-09-19T04:28:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:13 smithi134 ceph-mon[34525]: purged_snaps scrub starts 2024-09-19T04:28:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:13 smithi134 ceph-mon[34525]: purged_snaps scrub ok 2024-09-19T04:28:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:13 smithi134 ceph-mon[34525]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:28:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:13 smithi134 ceph-mon[34525]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T04:28:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:13 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:13.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:13 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:13.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:13 smithi134 ceph-mon[34525]: from='osd.11 ' entity='osd.11' 2024-09-19T04:28:13.867 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd stat -f json 2024-09-19T04:28:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:13 smithi070 ceph-mon[30942]: purged_snaps scrub starts 2024-09-19T04:28:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:13 smithi070 ceph-mon[30942]: purged_snaps scrub ok 2024-09-19T04:28:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:13 smithi070 ceph-mon[30942]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi167", "root=default"]}]': finished 2024-09-19T04:28:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:13 smithi070 ceph-mon[30942]: osdmap e74: 12 total, 11 up, 12 in 2024-09-19T04:28:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:13 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:13 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:13 smithi070 ceph-mon[30942]: from='osd.11 ' entity='osd.11' 2024-09-19T04:28:14.123 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:14.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:14 smithi070 ceph-mon[30942]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:14.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:14.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:14 smithi070 ceph-mon[30942]: osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] boot 2024-09-19T04:28:14.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:14 smithi070 ceph-mon[30942]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:28:14.518 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:14 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:14.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 -- 172.21.15.70:0/4200728008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 msgr2=0x7fd0fc10a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:14.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 --2- 172.21.15.70:0/4200728008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 0x7fd0fc10a050 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fd0f4009ca0 tx=0x7fd0f402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 -- 172.21.15.70:0/4200728008 shutdown_connections 2024-09-19T04:28:14.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 --2- 172.21.15.70:0/4200728008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 0x7fd0fc10a050 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 --2- 172.21.15.70:0/4200728008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102e00 0x7fd0fc103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 --2- 172.21.15.70:0/4200728008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0fc101c00 0x7fd0fc102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 -- 172.21.15.70:0/4200728008 >> 172.21.15.70:0/4200728008 conn(0x7fd0fc0fd390 msgr2=0x7fd0fc0ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 -- 172.21.15.70:0/4200728008 shutdown_connections 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.594+0000 7fd100ded640 1 -- 172.21.15.70:0/4200728008 wait complete. 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd100ded640 1 Processor -- start 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd100ded640 1 -- start start 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd100ded640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0fc101c00 0x7fd0fc198030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd100ded640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102e00 0x7fd0fc198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd100ded640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 0x7fd0fc19f5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd100ded640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc10d970 con 0x7fd0fc1037c0 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd100ded640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc10d7f0 con 0x7fd0fc102e00 2024-09-19T04:28:14.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd100ded640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd0fc10daf0 con 0x7fd0fc101c00 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd0fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 0x7fd0fc19f5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd0fad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 0x7fd0fc19f5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53968/0 (socket says 172.21.15.70:53968) 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd0fad9d640 1 -- 172.21.15.70:0/4066684508 learned_addr learned my addr 172.21.15.70:0/4066684508 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.595+0000 7fd0fa59c640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0fc101c00 0x7fd0fc198030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0f9d9b640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102e00 0x7fd0fc198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0fad9d640 1 -- 172.21.15.70:0/4066684508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0fc101c00 msgr2=0x7fd0fc198030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0fad9d640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0fc101c00 0x7fd0fc198030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0fad9d640 1 -- 172.21.15.70:0/4066684508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102e00 msgr2=0x7fd0fc198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:14.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0fad9d640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102e00 0x7fd0fc198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0fad9d640 1 -- 172.21.15.70:0/4066684508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0fc19fc60 con 0x7fd0fc1037c0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0fad9d640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 0x7fd0fc19f5f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0f402f500 tx=0x7fd0f4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0f37fe640 1 -- 172.21.15.70:0/4066684508 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f4003d60 con 0x7fd0fc1037c0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0f37fe640 1 -- 172.21.15.70:0/4066684508 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd0f4004510 con 0x7fd0fc1037c0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0fc19fef0 con 0x7fd0fc1037c0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd0f37fe640 1 -- 172.21.15.70:0/4066684508 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0f402fd90 con 0x7fd0fc1037c0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.596+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0fc1a0420 con 0x7fd0fc1037c0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.597+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0fc109050 con 0x7fd0fc1037c0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.598+0000 7fd0f37fe640 1 -- 172.21.15.70:0/4066684508 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd0f4004040 con 0x7fd0fc1037c0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.599+0000 7fd0f37fe640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd0e80a3270 0x7fd0e80a5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.599+0000 7fd0fa59c640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd0e80a3270 0x7fd0e80a5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:14.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.599+0000 7fd0f37fe640 1 -- 172.21.15.70:0/4066684508 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7fd0f40f0ca0 con 0x7fd0fc1037c0 2024-09-19T04:28:14.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.600+0000 7fd0fa59c640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd0e80a3270 0x7fd0e80a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc102c60 tx=0x7fd0e4009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:14.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.603+0000 7fd0f37fe640 1 -- 172.21.15.70:0/4066684508 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd0f4004330 con 0x7fd0fc1037c0 2024-09-19T04:28:14.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:14 smithi167 ceph-mon[34339]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:14 smithi167 ceph-mon[34339]: osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] boot 2024-09-19T04:28:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:14 smithi167 ceph-mon[34339]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:28:14.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:14 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:14.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.771+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7fd0fc02d970 con 0x7fd0fc1037c0 2024-09-19T04:28:14.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.771+0000 7fd0f37fe640 1 -- 172.21.15.70:0/4066684508 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7fd0f40bde60 con 0x7fd0fc1037c0 2024-09-19T04:28:14.773 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd0e80a3270 msgr2=0x7fd0e80a5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd0e80a3270 0x7fd0e80a5730 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fd0fc102c60 tx=0x7fd0e4009110 comp rx=0 tx=0).stop 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 msgr2=0x7fd0fc19f5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 0x7fd0fc19f5f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fd0f402f500 tx=0x7fd0f4003970 comp rx=0 tx=0).stop 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 shutdown_connections 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd0e80a3270 0x7fd0e80a5730 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd0fc1037c0 0x7fd0fc19f5f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0fc102e00 0x7fd0fc198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 --2- 172.21.15.70:0/4066684508 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd0fc101c00 0x7fd0fc198030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:14.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 >> 172.21.15.70:0/4066684508 conn(0x7fd0fc0fd390 msgr2=0x7fd0fc106220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:14.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.773+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 shutdown_connections 2024-09-19T04:28:14.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:14.774+0000 7fd100ded640 1 -- 172.21.15.70:0/4066684508 wait complete. 2024-09-19T04:28:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:14 smithi134 ceph-mon[34525]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 333 MiB used, 983 GiB / 983 GiB avail 2024-09-19T04:28:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:14 smithi134 ceph-mon[34525]: osd.11 [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] boot 2024-09-19T04:28:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:14 smithi134 ceph-mon[34525]: osdmap e75: 12 total, 12 up, 12 in 2024-09-19T04:28:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:14 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:28:15.451 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1726720094,"num_in_osds":12,"osd_in_since":1726720069,"num_remapped_pgs":0} 2024-09-19T04:28:15.451 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:28:15.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:15 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4066684508' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:15.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:15 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4066684508' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:15.732 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:15 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4066684508' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-09-19T04:28:16.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.176+0000 7f8e05d13640 1 -- 172.21.15.70:0/2305586230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 msgr2=0x7f8e00101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.176+0000 7f8e05d13640 1 --2- 172.21.15.70:0/2305586230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 0x7f8e00101200 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f8df0009900 tx=0x7f8df002a480 comp rx=0 tx=0).stop 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.176+0000 7f8e05d13640 1 -- 172.21.15.70:0/2305586230 shutdown_connections 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.176+0000 7f8e05d13640 1 --2- 172.21.15.70:0/2305586230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e00102ef0 0x7f8e0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.176+0000 7f8e05d13640 1 --2- 172.21.15.70:0/2305586230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e00102570 0x7f8e001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.176+0000 7f8e05d13640 1 --2- 172.21.15.70:0/2305586230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 0x7f8e00101200 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.177+0000 7f8e05d13640 1 -- 172.21.15.70:0/2305586230 >> 172.21.15.70:0/2305586230 conn(0x7f8e000fc7d0 msgr2=0x7f8e000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.177+0000 7f8e05d13640 1 -- 172.21.15.70:0/2305586230 shutdown_connections 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.177+0000 7f8e05d13640 1 -- 172.21.15.70:0/2305586230 wait complete. 2024-09-19T04:28:16.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.177+0000 7f8e05d13640 1 Processor -- start 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.177+0000 7f8e05d13640 1 -- start start 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.177+0000 7f8e05d13640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 0x7f8e00197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.177+0000 7f8e05d13640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e00102570 0x7f8e00197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.177+0000 7f8e05d13640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e00102ef0 0x7f8e0019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8e05d13640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00111010 con 0x7f8e00100e20 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8e05d13640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00110e90 con 0x7f8e00102570 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8e05d13640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8e00111190 con 0x7f8e00102ef0 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 0x7f8e00197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 0x7f8e00197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53984/0 (socket says 172.21.15.70:53984) 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 -- 172.21.15.70:0/1409546730 learned_addr learned my addr 172.21.15.70:0/1409546730 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:16.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8df7fff640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e00102570 0x7f8e00197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dfffff640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e00102ef0 0x7f8e0019be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 -- 172.21.15.70:0/1409546730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e00102ef0 msgr2=0x7f8e0019be40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e00102ef0 0x7f8e0019be40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 -- 172.21.15.70:0/1409546730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e00102570 msgr2=0x7f8e00197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e00102570 0x7f8e00197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 -- 172.21.15.70:0/1409546730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8e0019c520 con 0x7f8e00100e20 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dfffff640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e00102ef0 0x7f8e0019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dff7fe640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 0x7f8e00197570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8df0005940 tx=0x7f8df0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dfd7fa640 1 -- 172.21.15.70:0/1409546730 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df003f030 con 0x7f8e00100e20 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8e0019c7b0 con 0x7f8e00100e20 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dfd7fa640 1 -- 172.21.15.70:0/1409546730 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8df0003ac0 con 0x7f8e00100e20 2024-09-19T04:28:16.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8dfd7fa640 1 -- 172.21.15.70:0/1409546730 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8df0035070 con 0x7f8e00100e20 2024-09-19T04:28:16.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.178+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8e001a40f0 con 0x7f8e00100e20 2024-09-19T04:28:16.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.179+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8e00101280 con 0x7f8e00100e20 2024-09-19T04:28:16.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.180+0000 7f8dfd7fa640 1 -- 172.21.15.70:0/1409546730 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f8df0042030 con 0x7f8e00100e20 2024-09-19T04:28:16.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.181+0000 7f8dfd7fa640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8dec0a3240 0x7f8dec0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:16.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.181+0000 7f8df7fff640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8dec0a3240 0x7f8dec0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:16.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.181+0000 7f8dfd7fa640 1 -- 172.21.15.70:0/1409546730 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f8df00efca0 con 0x7f8e00100e20 2024-09-19T04:28:16.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.181+0000 7f8df7fff640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8dec0a3240 0x7f8dec0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e000ffea0 tx=0x7f8de8009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:16.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.185+0000 7f8dfd7fa640 1 -- 172.21.15.70:0/1409546730 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8df00bce60 con 0x7f8e00100e20 2024-09-19T04:28:16.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.352+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8e00109090 con 0x7f8e00100e20 2024-09-19T04:28:16.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.353+0000 7f8dfd7fa640 1 -- 172.21.15.70:0/1409546730 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18482 (secure 0 0 0) 0x7f8df00bc760 con 0x7f8e00100e20 2024-09-19T04:28:16.355 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:16.355 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":76,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:28:15.441293+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:28:16.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8dec0a3240 msgr2=0x7f8dec0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8dec0a3240 0x7f8dec0a5700 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8e000ffea0 tx=0x7f8de8009110 comp rx=0 tx=0).stop 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 msgr2=0x7f8e00197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 0x7f8e00197570 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f8df0005940 tx=0x7f8df0004270 comp rx=0 tx=0).stop 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 shutdown_connections 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f8dec0a3240 0x7f8dec0a5700 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8e00102ef0 0x7f8e0019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e00102570 0x7f8e00197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 --2- 172.21.15.70:0/1409546730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8e00100e20 0x7f8e00197570 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 >> 172.21.15.70:0/1409546730 conn(0x7f8e000fc7d0 msgr2=0x7f8e000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:16.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 shutdown_connections 2024-09-19T04:28:16.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:16.355+0000 7f8e05d13640 1 -- 172.21.15.70:0/1409546730 wait complete. 2024-09-19T04:28:16.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:16 smithi167 ceph-mon[34339]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:16.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:16 smithi167 ceph-mon[34339]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:28:16.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:16 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1409546730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:28:16.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:16 smithi134 ceph-mon[34525]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:16.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:16 smithi134 ceph-mon[34525]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:28:16.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:16 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1409546730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:28:16.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:16 smithi070 ceph-mon[30942]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:16.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:16 smithi070 ceph-mon[30942]: osdmap e76: 12 total, 12 up, 12 in 2024-09-19T04:28:16.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:16 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1409546730' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:28:16.964 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T04:24:31.609825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T04:28:16.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-09-19T04:28:17.206 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 -- 172.21.15.70:0/2660558266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484105a70 msgr2=0x7f3484105e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 --2- 172.21.15.70:0/2660558266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484105a70 0x7f3484105e50 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3480009900 tx=0x7f348002a410 comp rx=0 tx=0).stop 2024-09-19T04:28:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 -- 172.21.15.70:0/2660558266 shutdown_connections 2024-09-19T04:28:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 --2- 172.21.15.70:0/2660558266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484101ba0 0x7f348410d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 --2- 172.21.15.70:0/2660558266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3484101220 0x7f3484101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 --2- 172.21.15.70:0/2660558266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484105a70 0x7f3484105e50 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 -- 172.21.15.70:0/2660558266 >> 172.21.15.70:0/2660558266 conn(0x7f34840fbee0 msgr2=0x7f34840fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 -- 172.21.15.70:0/2660558266 shutdown_connections 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.663+0000 7f348b774640 1 -- 172.21.15.70:0/2660558266 wait complete. 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f348b774640 1 Processor -- start 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f348b774640 1 -- start start 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f348b774640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3484101220 0x7f3484197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f348b774640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484101ba0 0x7f3484197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f348b774640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484105a70 0x7f3484197b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f348b774640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3484110f80 con 0x7f3484101ba0 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f348b774640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3484110e00 con 0x7f3484101220 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f348b774640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3484111100 con 0x7f3484105a70 2024-09-19T04:28:17.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3488d0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484101ba0 0x7f3484197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3488d0f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484101ba0 0x7f3484197640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54002/0 (socket says 172.21.15.70:54002) 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3488d0f640 1 -- 172.21.15.70:0/3195306146 learned_addr learned my addr 172.21.15.70:0/3195306146 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3488d0f640 1 -- 172.21.15.70:0/3195306146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484105a70 msgr2=0x7f3484197b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3489d11640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484105a70 0x7f3484197b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3488d0f640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484105a70 0x7f3484197b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3489510640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3484101220 0x7f3484197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3488d0f640 1 -- 172.21.15.70:0/3195306146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3484101220 msgr2=0x7f3484197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3488d0f640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3484101220 0x7f3484197100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.664+0000 7f3488d0f640 1 -- 172.21.15.70:0/3195306146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34841a6970 con 0x7f3484101ba0 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.665+0000 7f3488d0f640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484101ba0 0x7f3484197640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f347400c920 tx=0x7f347400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.665+0000 7f347a7fc640 1 -- 172.21.15.70:0/3195306146 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474007c70 con 0x7f3484101ba0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.665+0000 7f347a7fc640 1 -- 172.21.15.70:0/3195306146 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3474007e10 con 0x7f3484101ba0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.665+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34841a6c60 con 0x7f3484101ba0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.665+0000 7f347a7fc640 1 -- 172.21.15.70:0/3195306146 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3474018850 con 0x7f3484101ba0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.665+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34841a71a0 con 0x7f3484101ba0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.666+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3484101660 con 0x7f3484101ba0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.667+0000 7f347a7fc640 1 -- 172.21.15.70:0/3195306146 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3474018a30 con 0x7f3484101ba0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.667+0000 7f347a7fc640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f34700a3240 0x7f34700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.667+0000 7f3489510640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f34700a3240 0x7f34700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.667+0000 7f347a7fc640 1 -- 172.21.15.70:0/3195306146 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f34740cf680 con 0x7f3484101ba0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.668+0000 7f3489510640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f34700a3240 0x7f34700a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f348002a930 tx=0x7f3480000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.671+0000 7f347a7fc640 1 -- 172.21.15.70:0/3195306146 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3474014030 con 0x7f3484101ba0 2024-09-19T04:28:17.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.839+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f34841a74e0 con 0x7f3484101ba0 2024-09-19T04:28:17.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.839+0000 7f347a7fc640 1 -- 172.21.15.70:0/3195306146 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7f347400de20 con 0x7f3484101ba0 2024-09-19T04:28:17.841 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-19T04:28:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f34700a3240 msgr2=0x7f34700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f34700a3240 0x7f34700a5700 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f348002a930 tx=0x7f3480000bc0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484101ba0 msgr2=0x7f3484197640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484101ba0 0x7f3484197640 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f347400c920 tx=0x7f347400cde0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 shutdown_connections 2024-09-19T04:28:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f34700a3240 0x7f34700a5700 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3484105a70 0x7f3484197b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3484101ba0 0x7f3484197640 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 --2- 172.21.15.70:0/3195306146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3484101220 0x7f3484197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:17.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.842+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 >> 172.21.15.70:0/3195306146 conn(0x7f34840fbee0 msgr2=0x7f34840fc610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:17.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.843+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 shutdown_connections 2024-09-19T04:28:17.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:17.843+0000 7f348b774640 1 -- 172.21.15.70:0/3195306146 wait complete. 2024-09-19T04:28:18.456 INFO:tasks.cephadm:Adding mds.a on smithi070 2024-09-19T04:28:18.456 INFO:tasks.cephadm:Adding mds.d on smithi070 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.g on smithi070 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.j on smithi070 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.b on smithi134 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.e on smithi134 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.h on smithi134 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.k on smithi134 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.c on smithi167 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.f on smithi167 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.i on smithi167 2024-09-19T04:28:18.457 INFO:tasks.cephadm:Adding mds.l on smithi167 2024-09-19T04:28:18.457 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph orch apply mds all '12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l' 2024-09-19T04:28:18.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:18 smithi167 ceph-mon[34339]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:18.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:18 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3195306146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:28:18.717 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:28:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:18 smithi134 ceph-mon[34525]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:18 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3195306146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:28:18.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:18 smithi070 ceph-mon[30942]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:18.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:18 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3195306146' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:28:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.126+0000 7f89b228e640 1 -- 172.21.15.167:0/3002010010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac1026a0 msgr2=0x7f89ac104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.126+0000 7f89b228e640 1 --2- 172.21.15.167:0/3002010010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac1026a0 0x7f89ac104a90 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f899c009900 tx=0x7f899c02a410 comp rx=0 tx=0).stop 2024-09-19T04:28:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 -- 172.21.15.167:0/3002010010 shutdown_connections 2024-09-19T04:28:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 --2- 172.21.15.167:0/3002010010 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89ac107900 0x7f89ac109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 --2- 172.21.15.167:0/3002010010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89ac104fd0 0x7f89ac1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.128 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 --2- 172.21.15.167:0/3002010010 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac1026a0 0x7f89ac104a90 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 -- 172.21.15.167:0/3002010010 >> 172.21.15.167:0/3002010010 conn(0x7f89ac0fc2a0 msgr2=0x7f89ac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:19.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 -- 172.21.15.167:0/3002010010 shutdown_connections 2024-09-19T04:28:19.129 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 -- 172.21.15.167:0/3002010010 wait complete. 2024-09-19T04:28:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 Processor -- start 2024-09-19T04:28:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.127+0000 7f89b228e640 1 -- start start 2024-09-19T04:28:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b228e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89ac1026a0 0x7f89ac102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b228e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89ac104fd0 0x7f89ac100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b228e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac107900 0x7f89ac100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b228e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac10d920 con 0x7f89ac104fd0 2024-09-19T04:28:19.131 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b228e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac10d7a0 con 0x7f89ac1026a0 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b228e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f89ac10daa0 con 0x7f89ac107900 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac107900 0x7f89ac100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac107900 0x7f89ac100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.167:48700/0 (socket says 172.21.15.167:48700) 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 -- 172.21.15.167:0/1656785908 learned_addr learned my addr 172.21.15.167:0/1656785908 (peer_addr_for_me v2:172.21.15.167:0/0) 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89abfff640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89ac1026a0 0x7f89ac102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89ab7fe640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89ac104fd0 0x7f89ac100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 -- 172.21.15.167:0/1656785908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89ac1026a0 msgr2=0x7f89ac102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89ac1026a0 0x7f89ac102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.132 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 -- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89ac104fd0 msgr2=0x7f89ac100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89ac104fd0 0x7f89ac100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 -- 172.21.15.167:0/1656785908 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f89ac1010d0 con 0x7f89ac107900 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89ab7fe640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89ac104fd0 0x7f89ac100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.128+0000 7f89b082b640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac107900 0x7f89ac100b90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89a400b970 tx=0x7f89a400be30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.129+0000 7f89a97fa640 1 -- 172.21.15.167:0/1656785908 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4019070 con 0x7f89ac107900 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.129+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f89ac1013c0 con 0x7f89ac107900 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.129+0000 7f89a97fa640 1 -- 172.21.15.167:0/1656785908 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f89a400cb40 con 0x7f89ac107900 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.129+0000 7f89a97fa640 1 -- 172.21.15.167:0/1656785908 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89a4007650 con 0x7f89ac107900 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.129+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89ac1a6ae0 con 0x7f89ac107900 2024-09-19T04:28:19.133 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.130+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f89ac0fdd90 con 0x7f89ac107900 2024-09-19T04:28:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.131+0000 7f89a97fa640 1 -- 172.21.15.167:0/1656785908 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f89a401c070 con 0x7f89ac107900 2024-09-19T04:28:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.132+0000 7f89a97fa640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89940a3240 0x7f89940a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.132+0000 7f89a97fa640 1 -- 172.21.15.167:0/1656785908 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f89a40cefe0 con 0x7f89ac107900 2024-09-19T04:28:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.132+0000 7f89abfff640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89940a3240 0x7f89940a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:19.134 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.133+0000 7f89abfff640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89940a3240 0x7f89940a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f899c000c00 tx=0x7f899c031510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:19.136 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.135+0000 7f89a97fa640 1 -- 172.21.15.167:0/1656785908 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f89a409bad0 con 0x7f89ac107900 2024-09-19T04:28:19.319 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.318+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}) -- 0x7f89ac062730 con 0x7f89940a3240 2024-09-19T04:28:19.326 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.326+0000 7f89a97fa640 1 -- 172.21.15.167:0/1656785908 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7f89ac062730 con 0x7f89940a3240 2024-09-19T04:28:19.327 INFO:teuthology.orchestra.run.smithi167.stdout:Scheduled mds.all update... 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89940a3240 msgr2=0x7f89940a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89940a3240 0x7f89940a5700 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f899c000c00 tx=0x7f899c031510 comp rx=0 tx=0).stop 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac107900 msgr2=0x7f89ac100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac107900 0x7f89ac100b90 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f89a400b970 tx=0x7f89a400be30 comp rx=0 tx=0).stop 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 shutdown_connections 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89940a3240 0x7f89940a5700 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f89ac107900 0x7f89ac100b90 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f89ac104fd0 0x7f89ac100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.329 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 --2- 172.21.15.167:0/1656785908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89ac1026a0 0x7f89ac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 >> 172.21.15.167:0/1656785908 conn(0x7f89ac0fc2a0 msgr2=0x7f89ac102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 shutdown_connections 2024-09-19T04:28:19.330 INFO:teuthology.orchestra.run.smithi167.stderr:2024-09-19T04:28:19.328+0000 7f89b228e640 1 -- 172.21.15.167:0/1656785908 wait complete. 2024-09-19T04:28:20.054 DEBUG:teuthology.orchestra.run.smithi070:mds.a> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.a.service 2024-09-19T04:28:20.057 DEBUG:teuthology.orchestra.run.smithi070:mds.d> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.d.service 2024-09-19T04:28:20.100 DEBUG:teuthology.orchestra.run.smithi070:mds.g> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.g.service 2024-09-19T04:28:20.143 DEBUG:teuthology.orchestra.run.smithi070:mds.j> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.j.service 2024-09-19T04:28:20.186 DEBUG:teuthology.orchestra.run.smithi134:mds.b> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.b.service 2024-09-19T04:28:20.189 DEBUG:teuthology.orchestra.run.smithi134:mds.e> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.e.service 2024-09-19T04:28:20.233 DEBUG:teuthology.orchestra.run.smithi134:mds.h> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.h.service 2024-09-19T04:28:20.276 DEBUG:teuthology.orchestra.run.smithi134:mds.k> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.k.service 2024-09-19T04:28:20.319 DEBUG:teuthology.orchestra.run.smithi167:mds.c> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.c.service 2024-09-19T04:28:20.322 DEBUG:teuthology.orchestra.run.smithi167:mds.f> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.f.service 2024-09-19T04:28:20.364 DEBUG:teuthology.orchestra.run.smithi167:mds.i> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.i.service 2024-09-19T04:28:20.409 DEBUG:teuthology.orchestra.run.smithi167:mds.l> sudo journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.l.service 2024-09-19T04:28:20.452 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-09-19T04:28:20.453 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:20.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:28:20.477 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:20.478 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:20 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:20.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:28:20.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-09-19T04:28:20.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:20.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:20.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:20.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:20.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:20.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:20.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:20.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:20.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:20 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:20.576 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='client.24379 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: Saving service mds.all spec with placement smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:20.577 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:20 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:20.700 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:21.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 -- 172.21.15.70:0/910043837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 msgr2=0x7fbb701029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:21.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 --2- 172.21.15.70:0/910043837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 0x7fbb701029b0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fbb64009900 tx=0x7fbb6402a480 comp rx=0 tx=0).stop 2024-09-19T04:28:21.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 -- 172.21.15.70:0/910043837 shutdown_connections 2024-09-19T04:28:21.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 --2- 172.21.15.70:0/910043837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb70102ef0 0x7fbb7010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 --2- 172.21.15.70:0/910043837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 0x7fbb701029b0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 --2- 172.21.15.70:0/910043837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb70100e20 0x7fbb70101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 -- 172.21.15.70:0/910043837 >> 172.21.15.70:0/910043837 conn(0x7fbb700fc7d0 msgr2=0x7fbb700febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:21.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 -- 172.21.15.70:0/910043837 shutdown_connections 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.150+0000 7fbb7831b640 1 -- 172.21.15.70:0/910043837 wait complete. 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb7831b640 1 Processor -- start 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb7831b640 1 -- start start 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb7831b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb70100e20 0x7fbb701984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb7831b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 0x7fbb70198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb7831b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb70102ef0 0x7fbb7019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb7831b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70110f50 con 0x7fbb70102570 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb7831b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbb70110dd0 con 0x7fbb70102ef0 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb7831b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbb701110d0 con 0x7fbb70100e20 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 0x7fbb70198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 0x7fbb70198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54026/0 (socket says 172.21.15.70:54026) 2024-09-19T04:28:21.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 -- 172.21.15.70:0/336679606 learned_addr learned my addr 172.21.15.70:0/336679606 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb768b8640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb70102ef0 0x7fbb7019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb760b7640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb70100e20 0x7fbb701984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 -- 172.21.15.70:0/336679606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb70100e20 msgr2=0x7fbb701984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb70100e20 0x7fbb701984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 -- 172.21.15.70:0/336679606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb70102ef0 msgr2=0x7fbb7019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb70102ef0 0x7fbb7019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 -- 172.21.15.70:0/336679606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb7019d490 con 0x7fbb70102570 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb768b8640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb70102ef0 0x7fbb7019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb758b6640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 0x7fbb70198a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb64004770 tx=0x7fbb640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.151+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/336679606 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb6403f030 con 0x7fbb70102570 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.152+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/336679606 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbb64003ac0 con 0x7fbb70102570 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.152+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb7019d720 con 0x7fbb70102570 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.152+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/336679606 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb64035070 con 0x7fbb70102570 2024-09-19T04:28:21.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.152+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb701a5060 con 0x7fbb70102570 2024-09-19T04:28:21.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.152+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb701021b0 con 0x7fbb70102570 2024-09-19T04:28:21.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.154+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/336679606 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fbb64042030 con 0x7fbb70102570 2024-09-19T04:28:21.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.154+0000 7fbb6f7fe640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbb580a3240 0x7fbb580a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:21.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.154+0000 7fbb760b7640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbb580a3240 0x7fbb580a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:21.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.154+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/336679606 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fbb640efa90 con 0x7fbb70102570 2024-09-19T04:28:21.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.155+0000 7fbb760b7640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbb580a3240 0x7fbb580a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb68005fd0 tx=0x7fbb68005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:21.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.159+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/336679606 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbb640bcc50 con 0x7fbb70102570 2024-09-19T04:28:21.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.360+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb701a5230 con 0x7fbb70102570 2024-09-19T04:28:21.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.360+0000 7fbb6f7fe640 1 -- 172.21.15.70:0/336679606 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7fbb640bc550 con 0x7fbb70102570 2024-09-19T04:28:21.362 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:21.362 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":1,"btime":"2024-09-19T04:21:29:502880+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-09-19T04:28:21.362 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 1 2024-09-19T04:28:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbb580a3240 msgr2=0x7fbb580a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbb580a3240 0x7fbb580a5700 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fbb68005fd0 tx=0x7fbb68005850 comp rx=0 tx=0).stop 2024-09-19T04:28:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 msgr2=0x7fbb70198a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 0x7fbb70198a20 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7fbb64004770 tx=0x7fbb640042f0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 shutdown_connections 2024-09-19T04:28:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbb580a3240 0x7fbb580a5700 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbb70102ef0 0x7fbb7019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbb70102570 0x7fbb70198a20 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 --2- 172.21.15.70:0/336679606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbb70100e20 0x7fbb701984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 >> 172.21.15.70:0/336679606 conn(0x7fbb700fc7d0 msgr2=0x7fbb70069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 shutdown_connections 2024-09-19T04:28:21.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:21.362+0000 7fbb7831b640 1 -- 172.21.15.70:0/336679606 wait complete. 2024-09-19T04:28:21.547 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:21 smithi167 ceph-mon[34339]: Deploying daemon mds.l on smithi167 2024-09-19T04:28:21.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:21 smithi070 ceph-mon[30942]: Deploying daemon mds.l on smithi167 2024-09-19T04:28:21.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:21 smithi134 ceph-mon[34525]: Deploying daemon mds.l on smithi167 2024-09-19T04:28:21.942 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:21 smithi167 systemd[1]: Starting Ceph mds.l for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:22.211 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:21 smithi167 podman[63672]: 2024-09-19 04:28:21.843606128 +0000 UTC m=+0.015874205 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:22.211 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:21 smithi167 podman[63672]: 2024-09-19 04:28:21.948782838 +0000 UTC m=+0.121050951 container create 3c554b56acb65223331d5c61d66f5c19d68b3521fd142c340295927c255927a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T04:28:22.211 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:22 smithi167 podman[63672]: 2024-09-19 04:28:22.142938373 +0000 UTC m=+0.315206451 container init 3c554b56acb65223331d5c61d66f5c19d68b3521fd142c340295927c255927a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T04:28:22.211 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:22 smithi167 podman[63672]: 2024-09-19 04:28:22.145754826 +0000 UTC m=+0.318022887 container start 3c554b56acb65223331d5c61d66f5c19d68b3521fd142c340295927c255927a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T04:28:22.211 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mds[63691]: -- 172.21.15.167:0/3788273857 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x564651c07860 con 0x564651be5400 2024-09-19T04:28:22.211 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l[63687]: starting mds.l at 2024-09-19T04:28:22.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/336679606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:22.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:22.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.167:6832/460081986,v1:172.21.15.167:6833/460081986] up:boot 2024-09-19T04:28:22.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: fsmap 1 up:standby 2024-09-19T04:28:22.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:28:22.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:22.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:22.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:22 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:22.710 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:22 smithi167 bash[63672]: 3c554b56acb65223331d5c61d66f5c19d68b3521fd142c340295927c255927a7 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:28:22 smithi167 systemd[1]: Started Ceph mds.l for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/336679606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.167:6832/460081986,v1:172.21.15.167:6833/460081986] up:boot 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: fsmap 1 up:standby 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:22.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:22 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:22.725 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/336679606' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:22.725 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.167:6832/460081986,v1:172.21.15.167:6833/460081986] up:boot 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: fsmap 1 up:standby 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:22.726 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:22 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:23.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:23 smithi070 ceph-mon[30942]: Deploying daemon mds.k on smithi134 2024-09-19T04:28:23.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:23 smithi167 ceph-mon[34339]: Deploying daemon mds.k on smithi134 2024-09-19T04:28:23.784 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:23 smithi134 ceph-mon[34525]: Deploying daemon mds.k on smithi134 2024-09-19T04:28:24.121 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:24.378 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:24.499 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:24 smithi070 ceph-mon[30942]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:24.507 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:24 smithi134 ceph-mon[34525]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:24.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:24 smithi167 ceph-mon[34339]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:24.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 -- 172.21.15.70:0/1523730556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 msgr2=0x7f9dec100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:24.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 --2- 172.21.15.70:0/1523730556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 0x7f9dec100ee0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f9dd4009930 tx=0x7f9dd402a420 comp rx=0 tx=0).stop 2024-09-19T04:28:24.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 -- 172.21.15.70:0/1523730556 shutdown_connections 2024-09-19T04:28:24.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 --2- 172.21.15.70:0/1523730556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dec101420 0x7f9dec10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:24.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 --2- 172.21.15.70:0/1523730556 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 0x7f9dec100ee0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:24.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 --2- 172.21.15.70:0/1523730556 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dec106a80 0x7f9dec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 -- 172.21.15.70:0/1523730556 >> 172.21.15.70:0/1523730556 conn(0x7f9dec0fc7a0 msgr2=0x7f9dec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 -- 172.21.15.70:0/1523730556 shutdown_connections 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 -- 172.21.15.70:0/1523730556 wait complete. 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.939+0000 7f9df0adb640 1 Processor -- start 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9df0adb640 1 -- start start 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9df0adb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 0x7f9dec198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9df0adb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dec101420 0x7f9dec1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9df0adb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dec106a80 0x7f9dec19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9df0adb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec110e50 con 0x7f9dec100a80 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9df0adb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec110cd0 con 0x7f9dec101420 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9df0adb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9dec110fd0 con 0x7f9dec106a80 2024-09-19T04:28:24.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 0x7f9dec198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 0x7f9dec198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46818/0 (socket says 172.21.15.70:46818) 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 -- 172.21.15.70:0/3039891667 learned_addr learned my addr 172.21.15.70:0/3039891667 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9de3fff640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dec101420 0x7f9dec1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 -- 172.21.15.70:0/3039891667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dec106a80 msgr2=0x7f9dec19cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dead9d640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dec106a80 0x7f9dec19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dec106a80 0x7f9dec19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 -- 172.21.15.70:0/3039891667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dec101420 msgr2=0x7f9dec1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dec101420 0x7f9dec1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 -- 172.21.15.70:0/3039891667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dec19d420 con 0x7f9dec100a80 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9dea59c640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 0x7f9dec198470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00d770 tx=0x7f9ddc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9de37fe640 1 -- 172.21.15.70:0/3039891667 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc017070 con 0x7f9dec100a80 2024-09-19T04:28:24.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.940+0000 7f9de37fe640 1 -- 172.21.15.70:0/3039891667 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9ddc0054f0 con 0x7f9dec100a80 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.941+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dec19d710 con 0x7f9dec100a80 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.941+0000 7f9de37fe640 1 -- 172.21.15.70:0/3039891667 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9ddc004d60 con 0x7f9dec100a80 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.941+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dec1a4ff0 con 0x7f9dec100a80 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.942+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dec1021c0 con 0x7f9dec100a80 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.943+0000 7f9de37fe640 1 -- 172.21.15.70:0/3039891667 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9ddc004f00 con 0x7f9dec100a80 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.943+0000 7f9de37fe640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9dd80a3240 0x7f9dd80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.943+0000 7f9de3fff640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9dd80a3240 0x7f9dd80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.943+0000 7f9de37fe640 1 -- 172.21.15.70:0/3039891667 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f9ddc0cf230 con 0x7f9dec100a80 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.944+0000 7f9de3fff640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9dd80a3240 0x7f9dd80a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40314b0 tx=0x7f9dd40058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:24.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:24.947+0000 7f9de37fe640 1 -- 172.21.15.70:0/3039891667 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9ddc09c3f0 con 0x7f9dec100a80 2024-09-19T04:28:25.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.155+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9dec100ee0 con 0x7f9dec100a80 2024-09-19T04:28:25.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.155+0000 7f9de37fe640 1 -- 172.21.15.70:0/3039891667 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1435 (secure 0 0 0) 0x7f9dec100ee0 con 0x7f9dec100a80 2024-09-19T04:28:25.157 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:25.157 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":2,"btime":"2024-09-19T04:28:22:174588+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-09-19T04:28:25.157 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 2 2024-09-19T04:28:25.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9dd80a3240 msgr2=0x7f9dd80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:25.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9dd80a3240 0x7f9dd80a5700 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f9dd40314b0 tx=0x7f9dd40058d0 comp rx=0 tx=0).stop 2024-09-19T04:28:25.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 msgr2=0x7f9dec198470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:25.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 0x7f9dec198470 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9ddc00d770 tx=0x7f9ddc00dc30 comp rx=0 tx=0).stop 2024-09-19T04:28:25.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 shutdown_connections 2024-09-19T04:28:25.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9dd80a3240 0x7f9dd80a5700 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:25.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9dec106a80 0x7f9dec19cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:25.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9dec101420 0x7f9dec1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:25.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 --2- 172.21.15.70:0/3039891667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9dec100a80 0x7f9dec198470 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:25.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.157+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 >> 172.21.15.70:0/3039891667 conn(0x7f9dec0fc7a0 msgr2=0x7f9dec104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:25.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.158+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 shutdown_connections 2024-09-19T04:28:25.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:25.158+0000 7f9df0adb640 1 -- 172.21.15.70:0/3039891667 wait complete. 2024-09-19T04:28:25.285 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 19 04:28:24 smithi134 systemd[1]: Started Ceph mds.k for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:26.110 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.110 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.110 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.110 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:26.110 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:26.110 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:26.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: Deploying daemon mds.j on smithi070 2024-09-19T04:28:26.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3039891667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:26.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6832/2796874112,v1:172.21.15.134:6833/2796874112] up:boot 2024-09-19T04:28:26.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: fsmap 2 up:standby 2024-09-19T04:28:26.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:28:26.111 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:26 smithi070 ceph-mon[30942]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: Deploying daemon mds.j on smithi070 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3039891667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6832/2796874112,v1:172.21.15.134:6833/2796874112] up:boot 2024-09-19T04:28:26.302 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: fsmap 2 up:standby 2024-09-19T04:28:26.303 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:28:26.303 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:26 smithi134 ceph-mon[34525]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: Deploying daemon mds.j on smithi070 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3039891667' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6832/2796874112,v1:172.21.15.134:6833/2796874112] up:boot 2024-09-19T04:28:26.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: fsmap 2 up:standby 2024-09-19T04:28:26.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:28:26.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:26 smithi167 ceph-mon[34339]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:27.645 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:27 smithi070 systemd[1]: Starting Ceph mds.j for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:27.880 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:27.979 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:27 smithi070 podman[67563]: 2024-09-19 04:28:27.607137816 +0000 UTC m=+0.015874480 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:27.979 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:27 smithi070 podman[67563]: 2024-09-19 04:28:27.725783693 +0000 UTC m=+0.134520384 container create f3e72a5f4ed087a91a689ba70cf1e6bb7e1f1f258aa3395485b618beaf5791e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-09-19T04:28:28.159 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:28.282 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:27 smithi070 podman[67563]: 2024-09-19 04:28:27.978219164 +0000 UTC m=+0.386955818 container init f3e72a5f4ed087a91a689ba70cf1e6bb7e1f1f258aa3395485b618beaf5791e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True) 2024-09-19T04:28:28.282 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:27 smithi070 podman[67563]: 2024-09-19 04:28:27.982174866 +0000 UTC m=+0.390911515 container start f3e72a5f4ed087a91a689ba70cf1e6bb7e1f1f258aa3395485b618beaf5791e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T04:28:28.282 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-mds[67600]: -- 172.21.15.70:0/1966938541 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dffc765860 con 0x55dffc742800 2024-09-19T04:28:28.282 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j[67578]: starting mds.j at 2024-09-19T04:28:28.282 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:28 smithi070 bash[67563]: f3e72a5f4ed087a91a689ba70cf1e6bb7e1f1f258aa3395485b618beaf5791e5 2024-09-19T04:28:28.282 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:28:28 smithi070 systemd[1]: Started Ceph mds.j for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:28.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-mon[30942]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:28.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:28.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:28.609 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:28 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:28 smithi167 ceph-mon[34339]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:28 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:28 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:28 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:28 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:28 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:28.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:28 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 -- 172.21.15.70:0/1465500631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 msgr2=0x7f2d8410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 --2- 172.21.15.70:0/1465500631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 0x7f2d8410da40 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c009ca0 tx=0x7f2d7c02a950 comp rx=0 tx=0).stop 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 -- 172.21.15.70:0/1465500631 shutdown_connections 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 --2- 172.21.15.70:0/1465500631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 0x7f2d8410da40 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 --2- 172.21.15.70:0/1465500631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d84102570 0x7f2d841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 --2- 172.21.15.70:0/1465500631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d84100e20 0x7f2d84101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 -- 172.21.15.70:0/1465500631 >> 172.21.15.70:0/1465500631 conn(0x7f2d840fc7d0 msgr2=0x7f2d840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 -- 172.21.15.70:0/1465500631 shutdown_connections 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.689+0000 7f2d89235640 1 -- 172.21.15.70:0/1465500631 wait complete. 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.690+0000 7f2d89235640 1 Processor -- start 2024-09-19T04:28:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.690+0000 7f2d89235640 1 -- start start 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.690+0000 7f2d89235640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d84100e20 0x7f2d84198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.690+0000 7f2d89235640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d84102570 0x7f2d84198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.690+0000 7f2d89235640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 0x7f2d8419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.690+0000 7f2d89235640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2d84110f50 con 0x7f2d84102ef0 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.690+0000 7f2d89235640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2d84110dd0 con 0x7f2d84100e20 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.690+0000 7f2d89235640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2d841110d0 con 0x7f2d84102570 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 0x7f2d8419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 0x7f2d8419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46848/0 (socket says 172.21.15.70:46848) 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 -- 172.21.15.70:0/2426011563 learned_addr learned my addr 172.21.15.70:0/2426011563 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d82d9d640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d84100e20 0x7f2d84198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d7bfff640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d84102570 0x7f2d84198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 -- 172.21.15.70:0/2426011563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d84102570 msgr2=0x7f2d84198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d84102570 0x7f2d84198970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 -- 172.21.15.70:0/2426011563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d84100e20 msgr2=0x7f2d84198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d84100e20 0x7f2d84198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 -- 172.21.15.70:0/2426011563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d8419d3e0 con 0x7f2d84102ef0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d82d9d640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d84100e20 0x7f2d84198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d8359e640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 0x7f2d8419cd00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c005cc0 tx=0x7f2d7c02f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d80d99640 1 -- 172.21.15.70:0/2426011563 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c003d80 con 0x7f2d84102ef0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d8419d670 con 0x7f2d84102ef0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d80d99640 1 -- 172.21.15.70:0/2426011563 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d7c030910 con 0x7f2d84102ef0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d80d99640 1 -- 172.21.15.70:0/2426011563 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d7c039680 con 0x7f2d84102ef0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.691+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d8419db40 con 0x7f2d84102ef0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.692+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2d84101200 con 0x7f2d84102ef0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.693+0000 7f2d80d99640 1 -- 172.21.15.70:0/2426011563 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f2d7c037020 con 0x7f2d84102ef0 2024-09-19T04:28:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.694+0000 7f2d80d99640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d700a3240 0x7f2d700a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.694+0000 7f2d82d9d640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d700a3240 0x7f2d700a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.695+0000 7f2d80d99640 1 -- 172.21.15.70:0/2426011563 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f2d7c0f0050 con 0x7f2d84102ef0 2024-09-19T04:28:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.695+0000 7f2d82d9d640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d700a3240 0x7f2d700a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2d740058c0 tx=0x7f2d74005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.699+0000 7f2d80d99640 1 -- 172.21.15.70:0/2426011563 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2d7c03f070 con 0x7f2d84102ef0 2024-09-19T04:28:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:28 smithi134 ceph-mon[34525]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:28.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:28 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:28 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:28 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:28.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:28 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:28.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:28 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:28.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:28 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:28.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.909+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2d8410a0a0 con 0x7f2d84102ef0 2024-09-19T04:28:28.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.909+0000 7f2d80d99640 1 -- 172.21.15.70:0/2426011563 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f2d7c0bd210 con 0x7f2d84102ef0 2024-09-19T04:28:28.911 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:28.911 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":4,"btime":"2024-09-19T04:28:28:430459+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T04:28:28.911 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 4 2024-09-19T04:28:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d700a3240 msgr2=0x7f2d700a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d700a3240 0x7f2d700a5700 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f2d740058c0 tx=0x7f2d74005ec0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 msgr2=0x7f2d8419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 0x7f2d8419cd00 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f2d7c005cc0 tx=0x7f2d7c02f6a0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 shutdown_connections 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d700a3240 0x7f2d700a5700 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2d84102ef0 0x7f2d8419cd00 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2d84102570 0x7f2d84198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 --2- 172.21.15.70:0/2426011563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2d84100e20 0x7f2d84198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.911+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 >> 172.21.15.70:0/2426011563 conn(0x7f2d840fc7d0 msgr2=0x7f2d8406a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.912+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 shutdown_connections 2024-09-19T04:28:28.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:28.912+0000 7f2d89235640 1 -- 172.21.15.70:0/2426011563 wait complete. 2024-09-19T04:28:29.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:29 smithi070 ceph-mon[30942]: Deploying daemon mds.d on smithi070 2024-09-19T04:28:29.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:29 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.70:6834/1596262416,v1:172.21.15.70:6835/1596262416] up:boot 2024-09-19T04:28:29.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:29 smithi070 ceph-mon[30942]: fsmap 3 up:standby 2024-09-19T04:28:29.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:29 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:28:29.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:29 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2426011563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:29.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:29 smithi167 ceph-mon[34339]: Deploying daemon mds.d on smithi070 2024-09-19T04:28:29.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:29 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.70:6834/1596262416,v1:172.21.15.70:6835/1596262416] up:boot 2024-09-19T04:28:29.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:29 smithi167 ceph-mon[34339]: fsmap 3 up:standby 2024-09-19T04:28:29.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:29 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:28:29.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:29 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2426011563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:29 smithi134 ceph-mon[34525]: Deploying daemon mds.d on smithi070 2024-09-19T04:28:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:29 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.70:6834/1596262416,v1:172.21.15.70:6835/1596262416] up:boot 2024-09-19T04:28:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:29 smithi134 ceph-mon[34525]: fsmap 3 up:standby 2024-09-19T04:28:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:29 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:28:29.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:29 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2426011563' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:30.535 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:30 smithi070 ceph-mon[30942]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:30.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:30 smithi167 ceph-mon[34339]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:30 smithi134 ceph-mon[34525]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:31.145 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 systemd[1]: Starting Ceph mds.d for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:31.483 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 podman[67979]: 2024-09-19 04:28:31.114758401 +0000 UTC m=+0.015411334 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:31.483 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 podman[67979]: 2024-09-19 04:28:31.236445081 +0000 UTC m=+0.137097999 container create 8968a2ee3f41c7e3f3e33352eb201bee960b3197cadbdbc6054916ceaf515e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-09-19T04:28:31.483 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 podman[67979]: 2024-09-19 04:28:31.455736633 +0000 UTC m=+0.356389556 container init 8968a2ee3f41c7e3f3e33352eb201bee960b3197cadbdbc6054916ceaf515e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T04:28:31.483 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 podman[67979]: 2024-09-19 04:28:31.458714521 +0000 UTC m=+0.359367441 container start 8968a2ee3f41c7e3f3e33352eb201bee960b3197cadbdbc6054916ceaf515e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0) 2024-09-19T04:28:31.483 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 ceph-mds[67999]: -- 172.21.15.70:0/3643186436 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d33d51f860 con 0x55d33d4fd000 2024-09-19T04:28:31.712 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:31.735 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d[67995]: starting mds.d at 2024-09-19T04:28:31.735 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 bash[67979]: 8968a2ee3f41c7e3f3e33352eb201bee960b3197cadbdbc6054916ceaf515e66 2024-09-19T04:28:31.735 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:28:31 smithi070 systemd[1]: Started Ceph mds.d for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:31.958 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:32.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.437+0000 7fdc6d59d640 1 -- 172.21.15.70:0/429525276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68100e20 msgr2=0x7fdc68101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:32.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.437+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/429525276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68100e20 0x7fdc68101200 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdc58009900 tx=0x7fdc5802a480 comp rx=0 tx=0).stop 2024-09-19T04:28:32.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 -- 172.21.15.70:0/429525276 shutdown_connections 2024-09-19T04:28:32.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/429525276 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc68102ef0 0x7fdc6810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/429525276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc68102570 0x7fdc681029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/429525276 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68100e20 0x7fdc68101200 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 -- 172.21.15.70:0/429525276 >> 172.21.15.70:0/429525276 conn(0x7fdc680fc7d0 msgr2=0x7fdc680febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 -- 172.21.15.70:0/429525276 shutdown_connections 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 -- 172.21.15.70:0/429525276 wait complete. 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 Processor -- start 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.438+0000 7fdc6d59d640 1 -- start start 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc6d59d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc68100e20 0x7fdc68198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc6d59d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68102570 0x7fdc68198bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc6d59d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc68102ef0 0x7fdc6819cf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc6d59d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc68112110 con 0x7fdc68102570 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc6d59d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc68111f90 con 0x7fdc68102ef0 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc6d59d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc68112290 con 0x7fdc68100e20 2024-09-19T04:28:32.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68102570 0x7fdc68198bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68102570 0x7fdc68198bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46872/0 (socket says 172.21.15.70:46872) 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 -- 172.21.15.70:0/4261501049 learned_addr learned my addr 172.21.15.70:0/4261501049 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc677fe640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc68102ef0 0x7fdc6819cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc66ffd640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc68100e20 0x7fdc68198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 -- 172.21.15.70:0/4261501049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc68100e20 msgr2=0x7fdc68198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc68100e20 0x7fdc68198670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 -- 172.21.15.70:0/4261501049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc68102ef0 msgr2=0x7fdc6819cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc68102ef0 0x7fdc6819cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 -- 172.21.15.70:0/4261501049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc6819d620 con 0x7fdc68102570 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc667fc640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68102570 0x7fdc68198bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b4a0 tx=0x7fdc5000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc5ffff640 1 -- 172.21.15.70:0/4261501049 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50014070 con 0x7fdc68102570 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.439+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc6819d910 con 0x7fdc68102570 2024-09-19T04:28:32.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.440+0000 7fdc5ffff640 1 -- 172.21.15.70:0/4261501049 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdc50010ae0 con 0x7fdc68102570 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.440+0000 7fdc5ffff640 1 -- 172.21.15.70:0/4261501049 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc50017c70 con 0x7fdc68102570 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.440+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc681a51f0 con 0x7fdc68102570 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.441+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc68101280 con 0x7fdc68102570 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.442+0000 7fdc5ffff640 1 -- 172.21.15.70:0/4261501049 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fdc50017070 con 0x7fdc68102570 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.442+0000 7fdc5ffff640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc540a3240 0x7fdc540a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.442+0000 7fdc66ffd640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc540a3240 0x7fdc540a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.442+0000 7fdc5ffff640 1 -- 172.21.15.70:0/4261501049 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fdc500ce8c0 con 0x7fdc68102570 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.443+0000 7fdc66ffd640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc540a3240 0x7fdc540a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc5802a9a0 tx=0x7fdc58000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:32.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.446+0000 7fdc5ffff640 1 -- 172.21.15.70:0/4261501049 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc5009ba80 con 0x7fdc68102570 2024-09-19T04:28:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:32 smithi070 ceph-mon[30942]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:32.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:32 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:32.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.651+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc68109090 con 0x7fdc68102570 2024-09-19T04:28:32.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.652+0000 7fdc5ffff640 1 -- 172.21.15.70:0/4261501049 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3907 (secure 0 0 0) 0x7fdc5009b380 con 0x7fdc68102570 2024-09-19T04:28:32.654 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:32.654 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":5,"btime":"2024-09-19T04:28:32:447633+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-09-19T04:28:32.654 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 5 2024-09-19T04:28:32.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc540a3240 msgr2=0x7fdc540a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc540a3240 0x7fdc540a5700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7fdc5802a9a0 tx=0x7fdc58000bc0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68102570 msgr2=0x7fdc68198bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68102570 0x7fdc68198bb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fdc5000b4a0 tx=0x7fdc5000b960 comp rx=0 tx=0).stop 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 shutdown_connections 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc540a3240 0x7fdc540a5700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc68102ef0 0x7fdc6819cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc68102570 0x7fdc68198bb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 --2- 172.21.15.70:0/4261501049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc68100e20 0x7fdc68198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 >> 172.21.15.70:0/4261501049 conn(0x7fdc680fc7d0 msgr2=0x7fdc680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 shutdown_connections 2024-09-19T04:28:32.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:32.654+0000 7fdc6d59d640 1 -- 172.21.15.70:0/4261501049 wait complete. 2024-09-19T04:28:32.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:32 smithi167 ceph-mon[34339]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:32.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:32.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:32.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:32 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:32 smithi134 ceph-mon[34525]: pgmap v253: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:32.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:32 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:33.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:33 smithi134 ceph-mon[34525]: Deploying daemon mds.e on smithi134 2024-09-19T04:28:33.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:33 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.70:6836/53186803,v1:172.21.15.70:6837/53186803] up:boot 2024-09-19T04:28:33.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:33 smithi134 ceph-mon[34525]: fsmap 4 up:standby 2024-09-19T04:28:33.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:33 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:28:33.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:33 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4261501049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:33.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:33 smithi167 ceph-mon[34339]: Deploying daemon mds.e on smithi134 2024-09-19T04:28:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:33 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.70:6836/53186803,v1:172.21.15.70:6837/53186803] up:boot 2024-09-19T04:28:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:33 smithi167 ceph-mon[34339]: fsmap 4 up:standby 2024-09-19T04:28:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:33 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:28:33.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:33 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4261501049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:33 smithi070 ceph-mon[30942]: Deploying daemon mds.e on smithi134 2024-09-19T04:28:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:33 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.70:6836/53186803,v1:172.21.15.70:6837/53186803] up:boot 2024-09-19T04:28:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:33 smithi070 ceph-mon[30942]: fsmap 4 up:standby 2024-09-19T04:28:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:33 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:28:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:33 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4261501049' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:33.912 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:28:33 smithi134 ceph-mds[63756]: -- 172.21.15.134:0/3260241066 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558b590b9860 con 0x558b59096800 2024-09-19T04:28:34.285 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:28:33 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e[63752]: starting mds.e at 2024-09-19T04:28:34.285 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:28:33 smithi134 bash[63737]: 94ad4b08ce3186dac51559df168bda10cb4270a8bdb5cd31178c2de4755c8cf3 2024-09-19T04:28:34.285 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:28:33 smithi134 systemd[1]: Started Ceph mds.e for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:34.730 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:34 smithi167 ceph-mon[34339]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:34.730 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.731 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.731 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.731 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:34.731 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:34.731 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:34 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:34 smithi134 ceph-mon[34525]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:34 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:34 smithi070 ceph-mon[30942]: pgmap v254: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:34.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:34.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:34.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:34 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:35.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:35.694 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:35.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:35 smithi167 ceph-mon[34339]: Deploying daemon mds.f on smithi167 2024-09-19T04:28:35.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:35 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6834/1711007693,v1:172.21.15.134:6835/1711007693] up:boot 2024-09-19T04:28:35.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:35 smithi167 ceph-mon[34339]: fsmap 5 up:standby 2024-09-19T04:28:35.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:35 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:28:35.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:35 smithi134 ceph-mon[34525]: Deploying daemon mds.f on smithi167 2024-09-19T04:28:35.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:35 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6834/1711007693,v1:172.21.15.134:6835/1711007693] up:boot 2024-09-19T04:28:35.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:35 smithi134 ceph-mon[34525]: fsmap 5 up:standby 2024-09-19T04:28:35.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:35 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:28:35.815 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:35 smithi070 ceph-mon[30942]: Deploying daemon mds.f on smithi167 2024-09-19T04:28:35.815 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:35 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6834/1711007693,v1:172.21.15.134:6835/1711007693] up:boot 2024-09-19T04:28:35.815 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:35 smithi070 ceph-mon[30942]: fsmap 5 up:standby 2024-09-19T04:28:35.815 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:35 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:28:36.127 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:35 smithi167 systemd[1]: Starting Ceph mds.f for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:36.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 -- 172.21.15.70:0/2178240066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 msgr2=0x7fdc2810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:36.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 --2- 172.21.15.70:0/2178240066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 0x7fdc2810d950 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fdc20009cd0 tx=0x7fdc2002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 -- 172.21.15.70:0/2178240066 shutdown_connections 2024-09-19T04:28:36.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 --2- 172.21.15.70:0/2178240066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 0x7fdc2810d950 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 --2- 172.21.15.70:0/2178240066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc28100a80 0x7fdc28100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 --2- 172.21.15.70:0/2178240066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28106a80 0x7fdc28106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 -- 172.21.15.70:0/2178240066 >> 172.21.15.70:0/2178240066 conn(0x7fdc280fc7a0 msgr2=0x7fdc280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 -- 172.21.15.70:0/2178240066 shutdown_connections 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.169+0000 7fdc306cb640 1 -- 172.21.15.70:0/2178240066 wait complete. 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc306cb640 1 Processor -- start 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc306cb640 1 -- start start 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc306cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc28100a80 0x7fdc28196f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc306cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 0x7fdc28197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc306cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28106a80 0x7fdc281979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc306cb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc28110e50 con 0x7fdc28101420 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc306cb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc28110cd0 con 0x7fdc28106a80 2024-09-19T04:28:36.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc306cb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc28110fd0 con 0x7fdc28100a80 2024-09-19T04:28:36.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 0x7fdc28197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:36.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 0x7fdc28197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45880/0 (socket says 172.21.15.70:45880) 2024-09-19T04:28:36.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 -- 172.21.15.70:0/1237813655 learned_addr learned my addr 172.21.15.70:0/1237813655 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:36.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2e467640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc28100a80 0x7fdc28196f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:36.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 -- 172.21.15.70:0/1237813655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc28100a80 msgr2=0x7fdc28196f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc28100a80 0x7fdc28196f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 -- 172.21.15.70:0/1237813655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28106a80 msgr2=0x7fdc281979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2ec68640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28106a80 0x7fdc281979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28106a80 0x7fdc281979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 -- 172.21.15.70:0/1237813655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc281a67c0 con 0x7fdc28101420 2024-09-19T04:28:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2ec68640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28106a80 0x7fdc281979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:28:36.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc2dc66640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 0x7fdc28197490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800c920 tx=0x7fdc1800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.170+0000 7fdc1f7fe640 1 -- 172.21.15.70:0/1237813655 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18007c70 con 0x7fdc28101420 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.171+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc281a6ab0 con 0x7fdc28101420 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.171+0000 7fdc1f7fe640 1 -- 172.21.15.70:0/1237813655 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdc18007e10 con 0x7fdc28101420 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.171+0000 7fdc1f7fe640 1 -- 172.21.15.70:0/1237813655 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc18018850 con 0x7fdc28101420 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.171+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc281a6ff0 con 0x7fdc28101420 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.171+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc28100ee0 con 0x7fdc28101420 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.173+0000 7fdc1f7fe640 1 -- 172.21.15.70:0/1237813655 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fdc18018a10 con 0x7fdc28101420 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.173+0000 7fdc1f7fe640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc140a3240 0x7fdc140a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.173+0000 7fdc2e467640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc140a3240 0x7fdc140a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.173+0000 7fdc1f7fe640 1 -- 172.21.15.70:0/1237813655 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fdc180cf660 con 0x7fdc28101420 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.174+0000 7fdc2e467640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc140a3240 0x7fdc140a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc24005d90 tx=0x7fdc24005d20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:36.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.177+0000 7fdc1f7fe640 1 -- 172.21.15.70:0/1237813655 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc18014030 con 0x7fdc28101420 2024-09-19T04:28:36.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.379+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdc281a73e0 con 0x7fdc28101420 2024-09-19T04:28:36.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.379+0000 7fdc1f7fe640 1 -- 172.21.15.70:0/1237813655 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4735 (secure 0 0 0) 0x7fdc1801f300 con 0x7fdc28101420 2024-09-19T04:28:36.382 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:36.382 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":6,"btime":"2024-09-19T04:28:34:457921+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T04:28:36.382 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 6 2024-09-19T04:28:36.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.381+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc140a3240 msgr2=0x7fdc140a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:36.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.381+0000 7fdc306cb640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc140a3240 0x7fdc140a5700 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fdc24005d90 tx=0x7fdc24005d20 comp rx=0 tx=0).stop 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 msgr2=0x7fdc28197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 0x7fdc28197490 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdc1800c920 tx=0x7fdc1800cde0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 shutdown_connections 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdc140a3240 0x7fdc140a5700 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc28106a80 0x7fdc281979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc28101420 0x7fdc28197490 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 --2- 172.21.15.70:0/1237813655 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc28100a80 0x7fdc28196f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 >> 172.21.15.70:0/1237813655 conn(0x7fdc280fc7a0 msgr2=0x7fdc280fce70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 shutdown_connections 2024-09-19T04:28:36.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:36.382+0000 7fdc306cb640 1 -- 172.21.15.70:0/1237813655 wait complete. 2024-09-19T04:28:36.397 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:36 smithi167 podman[63970]: 2024-09-19 04:28:36.029161255 +0000 UTC m=+0.016148014 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:36.397 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:36 smithi167 podman[63970]: 2024-09-19 04:28:36.144146962 +0000 UTC m=+0.131133763 container create 4a0ecc9ccf6845bbcb79d00e0d83bd196a300aa15eb9bf72057af36ce49ea27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=) 2024-09-19T04:28:36.397 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:36 smithi167 podman[63970]: 2024-09-19 04:28:36.396739295 +0000 UTC m=+0.383726058 container init 4a0ecc9ccf6845bbcb79d00e0d83bd196a300aa15eb9bf72057af36ce49ea27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4) 2024-09-19T04:28:36.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:36 smithi070 ceph-mon[30942]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:36.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:36 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1237813655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:36.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:36 smithi167 ceph-mon[34339]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:36.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:36 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1237813655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:36.711 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:36 smithi167 podman[63970]: 2024-09-19 04:28:36.399511576 +0000 UTC m=+0.386498342 container start 4a0ecc9ccf6845bbcb79d00e0d83bd196a300aa15eb9bf72057af36ce49ea27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:36.711 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:36 smithi167 ceph-mds[63989]: -- 172.21.15.167:0/1908375731 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f1d0305c20 con 0x55f1d02e3000 2024-09-19T04:28:36.711 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:36 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f[63985]: starting mds.f at 2024-09-19T04:28:36.711 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:36 smithi167 bash[63970]: 4a0ecc9ccf6845bbcb79d00e0d83bd196a300aa15eb9bf72057af36ce49ea27d 2024-09-19T04:28:36.711 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:28:36 smithi167 systemd[1]: Started Ceph mds.f for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:36.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:36 smithi134 ceph-mon[34525]: pgmap v255: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:36.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:36 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1237813655' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.167:6834/3330741295,v1:172.21.15.167:6835/3330741295] up:boot 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: fsmap 6 up:standby 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:37.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:37 smithi167 ceph-mon[34339]: Deploying daemon mds.c on smithi167 2024-09-19T04:28:37.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.167:6834/3330741295,v1:172.21.15.167:6835/3330741295] up:boot 2024-09-19T04:28:37.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: fsmap 6 up:standby 2024-09-19T04:28:37.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:28:37.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:37.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:37.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:37.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:37 smithi134 ceph-mon[34525]: Deploying daemon mds.c on smithi167 2024-09-19T04:28:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.167:6834/3330741295,v1:172.21.15.167:6835/3330741295] up:boot 2024-09-19T04:28:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: fsmap 6 up:standby 2024-09-19T04:28:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:28:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:37.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:37.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:37.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:37.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:37 smithi070 ceph-mon[30942]: Deploying daemon mds.c on smithi167 2024-09-19T04:28:38.569 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:38 smithi167 systemd[1]: Starting Ceph mds.c for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:38 smithi070 ceph-mon[30942]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:38.901 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:38 smithi167 ceph-mon[34339]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:38.901 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:38 smithi167 podman[64267]: 2024-09-19 04:28:38.578780801 +0000 UTC m=+0.016634817 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:38.901 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:38 smithi167 podman[64267]: 2024-09-19 04:28:38.681015615 +0000 UTC m=+0.118869674 container create d11fa244cb39eac06b4540db4b097cb963a95bcf0a0d00bca01144e175988edd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T04:28:38.901 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:38 smithi167 podman[64267]: 2024-09-19 04:28:38.900656406 +0000 UTC m=+0.338510435 container init d11fa244cb39eac06b4540db4b097cb963a95bcf0a0d00bca01144e175988edd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T04:28:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:38 smithi134 ceph-mon[34525]: pgmap v256: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:39.191 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:39.210 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:38 smithi167 podman[64267]: 2024-09-19 04:28:38.903698169 +0000 UTC m=+0.341552188 container start d11fa244cb39eac06b4540db4b097cb963a95bcf0a0d00bca01144e175988edd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T04:28:39.210 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:38 smithi167 ceph-mds[64286]: -- 172.21.15.167:0/2029691343 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558c334d7860 con 0x558c334b5400 2024-09-19T04:28:39.211 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:38 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c[64282]: starting mds.c at 2024-09-19T04:28:39.211 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:39 smithi167 bash[64267]: d11fa244cb39eac06b4540db4b097cb963a95bcf0a0d00bca01144e175988edd 2024-09-19T04:28:39.211 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:28:39 smithi167 systemd[1]: Started Ceph mds.c for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:39.447 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 -- 172.21.15.70:0/2886512077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc100a80 msgr2=0x7fd2fc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 --2- 172.21.15.70:0/2886512077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc100a80 0x7fd2fc100ee0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009930 tx=0x7fd2e402a420 comp rx=0 tx=0).stop 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 -- 172.21.15.70:0/2886512077 shutdown_connections 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 --2- 172.21.15.70:0/2886512077 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2fc101420 0x7fd2fc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 --2- 172.21.15.70:0/2886512077 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc100a80 0x7fd2fc100ee0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 --2- 172.21.15.70:0/2886512077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2fc106a80 0x7fd2fc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 -- 172.21.15.70:0/2886512077 >> 172.21.15.70:0/2886512077 conn(0x7fd2fc0fc7a0 msgr2=0x7fd2fc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 -- 172.21.15.70:0/2886512077 shutdown_connections 2024-09-19T04:28:39.916 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.895+0000 7fd301880640 1 -- 172.21.15.70:0/2886512077 wait complete. 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd301880640 1 Processor -- start 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd301880640 1 -- start start 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd301880640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2fc100a80 0x7fd2fc197110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd301880640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc101420 0x7fd2fc197650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd301880640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2fc106a80 0x7fd2fc197b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd301880640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc110e90 con 0x7fd2fc101420 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd301880640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc110d10 con 0x7fd2fc106a80 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd301880640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd2fc111010 con 0x7fd2fc100a80 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd2f3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc101420 0x7fd2fc197650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd2f3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc101420 0x7fd2fc197650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45894/0 (socket says 172.21.15.70:45894) 2024-09-19T04:28:39.917 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd2f3fff640 1 -- 172.21.15.70:0/3775308013 learned_addr learned my addr 172.21.15.70:0/3775308013 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd2fb7fe640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2fc106a80 0x7fd2fc197b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.896+0000 7fd2faffd640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2fc100a80 0x7fd2fc197110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd2f3fff640 1 -- 172.21.15.70:0/3775308013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2fc100a80 msgr2=0x7fd2fc197110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd2f3fff640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2fc100a80 0x7fd2fc197110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd2f3fff640 1 -- 172.21.15.70:0/3775308013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2fc106a80 msgr2=0x7fd2fc197b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd2f3fff640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2fc106a80 0x7fd2fc197b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd2f3fff640 1 -- 172.21.15.70:0/3775308013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2fc1a6980 con 0x7fd2fc101420 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd2fb7fe640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2fc106a80 0x7fd2fc197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd2f3fff640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc101420 0x7fd2fc197650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4005940 tx=0x7fd2e40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd30087e640 1 -- 172.21.15.70:0/3775308013 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e403f030 con 0x7fd2fc101420 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd30087e640 1 -- 172.21.15.70:0/3775308013 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd2e4003ac0 con 0x7fd2fc101420 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2fc1a6c10 con 0x7fd2fc101420 2024-09-19T04:28:39.918 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd30087e640 1 -- 172.21.15.70:0/3775308013 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4035070 con 0x7fd2fc101420 2024-09-19T04:28:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.897+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2fc1a70f0 con 0x7fd2fc101420 2024-09-19T04:28:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.898+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2fc100ee0 con 0x7fd2fc101420 2024-09-19T04:28:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.899+0000 7fd30087e640 1 -- 172.21.15.70:0/3775308013 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fd2e4042030 con 0x7fd2fc101420 2024-09-19T04:28:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.900+0000 7fd30087e640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd2e80a3240 0x7fd2e80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.900+0000 7fd2faffd640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd2e80a3240 0x7fd2e80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.900+0000 7fd30087e640 1 -- 172.21.15.70:0/3775308013 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd2e40ef9c0 con 0x7fd2fc101420 2024-09-19T04:28:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.900+0000 7fd2faffd640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd2e80a3240 0x7fd2e80a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005fd0 tx=0x7fd2ec00b590 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:39.919 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:39.904+0000 7fd30087e640 1 -- 172.21.15.70:0/3775308013 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd2e40f1e20 con 0x7fd2fc101420 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: Deploying daemon mds.h on smithi134 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:40.092 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.167:6836/3495956228,v1:172.21.15.167:6837/3495956228] up:boot 2024-09-19T04:28:40.093 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: fsmap 7 up:standby 2024-09-19T04:28:40.093 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:40 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:28:40.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.114+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd2fc02d7c0 con 0x7fd2fc101420 2024-09-19T04:28:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.115+0000 7fd30087e640 1 -- 172.21.15.70:0/3775308013 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6391 (secure 0 0 0) 0x7fd2e40bcb80 con 0x7fd2fc101420 2024-09-19T04:28:40.116 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:40.116 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":8,"btime":"2024-09-19T04:28:39:567165+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-09-19T04:28:40.116 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 8 2024-09-19T04:28:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd2e80a3240 msgr2=0x7fd2e80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd2e80a3240 0x7fd2e80a5700 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec005fd0 tx=0x7fd2ec00b590 comp rx=0 tx=0).stop 2024-09-19T04:28:40.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc101420 msgr2=0x7fd2fc197650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc101420 0x7fd2fc197650 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4005940 tx=0x7fd2e40042f0 comp rx=0 tx=0).stop 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 shutdown_connections 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd2e80a3240 0x7fd2e80a5700 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2fc106a80 0x7fd2fc197b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd2fc101420 0x7fd2fc197650 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 --2- 172.21.15.70:0/3775308013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd2fc100a80 0x7fd2fc197110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 >> 172.21.15.70:0/3775308013 conn(0x7fd2fc0fc7a0 msgr2=0x7fd2fc0fcee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 shutdown_connections 2024-09-19T04:28:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:40.117+0000 7fd301880640 1 -- 172.21.15.70:0/3775308013 wait complete. 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: Deploying daemon mds.h on smithi134 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.167:6836/3495956228,v1:172.21.15.167:6837/3495956228] up:boot 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: fsmap 7 up:standby 2024-09-19T04:28:40.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:40 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:28:40.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: Deploying daemon mds.h on smithi134 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: pgmap v257: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.167:6836/3495956228,v1:172.21.15.167:6837/3495956228] up:boot 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: fsmap 7 up:standby 2024-09-19T04:28:40.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:40 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:28:41.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:41 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3775308013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:41.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:41 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3775308013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:41.285 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 systemd[1]: Starting Ceph mds.h for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:41.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:41 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3775308013' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:41.663 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 podman[64039]: 2024-09-19 04:28:41.256285274 +0000 UTC m=+0.016179405 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:41.663 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 podman[64039]: 2024-09-19 04:28:41.393031404 +0000 UTC m=+0.152925534 container create 47d6773c6ecba519ba9c1acf17edf6014a089c7e4bca7c06d641657f6cc0e504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2) 2024-09-19T04:28:41.663 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 podman[64039]: 2024-09-19 04:28:41.662526467 +0000 UTC m=+0.422420597 container init 47d6773c6ecba519ba9c1acf17edf6014a089c7e4bca7c06d641657f6cc0e504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-09-19T04:28:42.035 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 podman[64039]: 2024-09-19 04:28:41.6653542 +0000 UTC m=+0.425248325 container start 47d6773c6ecba519ba9c1acf17edf6014a089c7e4bca7c06d641657f6cc0e504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:28:42.035 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 ceph-mds[64058]: -- 172.21.15.134:0/3219893428 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55921a9b1860 con 0x55921a98f400 2024-09-19T04:28:42.035 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h[64054]: starting mds.h at 2024-09-19T04:28:42.035 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 bash[64039]: 47d6773c6ecba519ba9c1acf17edf6014a089c7e4bca7c06d641657f6cc0e504 2024-09-19T04:28:42.036 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:28:41 smithi134 systemd[1]: Started Ceph mds.h for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:42.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:42 smithi070 ceph-mon[30942]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:42.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:42.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:42.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:42 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:42.414 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:42 smithi167 ceph-mon[34339]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:42.414 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.414 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.415 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.415 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:42.415 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:42.415 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:42 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:42.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:42 smithi134 ceph-mon[34525]: pgmap v258: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:42.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:42.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:42.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:42.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:42 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:42.882 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:43.141 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:43.261 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:43 smithi070 ceph-mon[30942]: Deploying daemon mds.i on smithi167 2024-09-19T04:28:43.262 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:43 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] up:boot 2024-09-19T04:28:43.262 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:43 smithi070 ceph-mon[30942]: fsmap 8 up:standby 2024-09-19T04:28:43.262 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:43 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:28:43.349 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:43 smithi167 ceph-mon[34339]: Deploying daemon mds.i on smithi167 2024-09-19T04:28:43.350 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:43 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] up:boot 2024-09-19T04:28:43.350 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:43 smithi167 ceph-mon[34339]: fsmap 8 up:standby 2024-09-19T04:28:43.350 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:43 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:28:43.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:43 smithi134 ceph-mon[34525]: Deploying daemon mds.i on smithi167 2024-09-19T04:28:43.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:43 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] up:boot 2024-09-19T04:28:43.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:43 smithi134 ceph-mon[34525]: fsmap 8 up:standby 2024-09-19T04:28:43.536 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:43 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:28:43.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 -- 172.21.15.70:0/805266208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 msgr2=0x7f96e810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 --2- 172.21.15.70:0/805266208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 0x7f96e810ea90 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f96e0009ca0 tx=0x7f96e002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 -- 172.21.15.70:0/805266208 shutdown_connections 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 --2- 172.21.15.70:0/805266208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 0x7f96e810ea90 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 --2- 172.21.15.70:0/805266208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8102790 0x7f96e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 --2- 172.21.15.70:0/805266208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8101de0 0x7f96e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 -- 172.21.15.70:0/805266208 >> 172.21.15.70:0/805266208 conn(0x7f96e80fd8c0 msgr2=0x7f96e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 -- 172.21.15.70:0/805266208 shutdown_connections 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 -- 172.21.15.70:0/805266208 wait complete. 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.643+0000 7f96ef49a640 1 Processor -- start 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96ef49a640 1 -- start start 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96ef49a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8101de0 0x7f96e81985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:43.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96ef49a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8102790 0x7f96e8198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96ef49a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 0x7f96e819ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96ef49a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8112000 con 0x7f96e8106f10 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96ef49a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8111e80 con 0x7f96e8102790 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96ef49a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96e8112180 con 0x7f96e8101de0 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 0x7f96e819ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 0x7f96e819ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51650/0 (socket says 172.21.15.70:51650) 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 -- 172.21.15.70:0/781291681 learned_addr learned my addr 172.21.15.70:0/781291681 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96ed236640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8101de0 0x7f96e81985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eca35640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8102790 0x7f96e8198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 -- 172.21.15.70:0/781291681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8101de0 msgr2=0x7f96e81985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8101de0 0x7f96e81985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 -- 172.21.15.70:0/781291681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8102790 msgr2=0x7f96e8198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8102790 0x7f96e8198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 -- 172.21.15.70:0/781291681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96e819d550 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eca35640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8102790 0x7f96e8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.644+0000 7f96eda37640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 0x7f96e819ce70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f96e00097b0 tx=0x7f96e0003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.645+0000 7f96da7fc640 1 -- 172.21.15.70:0/781291681 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e00317d0 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.645+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96e819d7e0 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.645+0000 7f96da7fc640 1 -- 172.21.15.70:0/781291681 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96e0031970 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.645+0000 7f96da7fc640 1 -- 172.21.15.70:0/781291681 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96e002fc70 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.645+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96e81a5120 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.646+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96e8102240 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.647+0000 7f96da7fc640 1 -- 172.21.15.70:0/781291681 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f96e0004b40 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.647+0000 7f96da7fc640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f96d40a3240 0x7f96d40a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.648+0000 7f96ed236640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f96d40a3240 0x7f96d40a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.648+0000 7f96da7fc640 1 -- 172.21.15.70:0/781291681 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f96e00f0d90 con 0x7f96e8106f10 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.648+0000 7f96ed236640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f96d40a3240 0x7f96d40a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009990 tx=0x7f96dc009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:43.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.651+0000 7f96da7fc640 1 -- 172.21.15.70:0/781291681 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f96e00bdf50 con 0x7f96e8106f10 2024-09-19T04:28:43.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.855+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f96e810a150 con 0x7f96e8106f10 2024-09-19T04:28:43.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.855+0000 7f96da7fc640 1 -- 172.21.15.70:0/781291681 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7219 (secure 0 0 0) 0x7f96e00bd850 con 0x7f96e8106f10 2024-09-19T04:28:43.857 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:43.857 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":9,"btime":"2024-09-19T04:28:42:076025+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24452,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T04:28:43.857 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 9 2024-09-19T04:28:43.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.857+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f96d40a3240 msgr2=0x7f96d40a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:43.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.857+0000 7f96ef49a640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f96d40a3240 0x7f96d40a5700 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f96dc009990 tx=0x7f96dc009110 comp rx=0 tx=0).stop 2024-09-19T04:28:43.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.857+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 msgr2=0x7f96e819ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:43.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.857+0000 7f96ef49a640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 0x7f96e819ce70 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f96e00097b0 tx=0x7f96e0003f30 comp rx=0 tx=0).stop 2024-09-19T04:28:43.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.858+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 shutdown_connections 2024-09-19T04:28:43.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.858+0000 7f96ef49a640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f96d40a3240 0x7f96d40a5700 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.858+0000 7f96ef49a640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96e8106f10 0x7f96e819ce70 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.858+0000 7f96ef49a640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96e8102790 0x7f96e8198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.858+0000 7f96ef49a640 1 --2- 172.21.15.70:0/781291681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f96e8101de0 0x7f96e81985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:43.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.858+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 >> 172.21.15.70:0/781291681 conn(0x7f96e80fd8c0 msgr2=0x7f96e80fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:43.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.858+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 shutdown_connections 2024-09-19T04:28:43.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:43.858+0000 7f96ef49a640 1 -- 172.21.15.70:0/781291681 wait complete. 2024-09-19T04:28:44.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:44 smithi070 ceph-mon[30942]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:44.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:44 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/781291681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:44.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:44 smithi167 ceph-mon[34339]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:44.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:44 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/781291681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:44.461 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:28:44 smithi167 systemd[1]: Started Ceph mds.i for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:44.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:44 smithi134 ceph-mon[34525]: pgmap v259: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:44.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:44 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/781291681' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:45.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:45.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:45.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:45.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: Deploying daemon mds.g on smithi070 2024-09-19T04:28:45.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] up:boot 2024-09-19T04:28:45.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: fsmap 9 up:standby 2024-09-19T04:28:45.647 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:45 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:28:45.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:45.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:45.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:45.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: Deploying daemon mds.g on smithi070 2024-09-19T04:28:45.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] up:boot 2024-09-19T04:28:45.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: fsmap 9 up:standby 2024-09-19T04:28:45.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:45 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:28:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:45.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:45.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:45.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:45.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: Deploying daemon mds.g on smithi070 2024-09-19T04:28:45.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] up:boot 2024-09-19T04:28:45.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: fsmap 9 up:standby 2024-09-19T04:28:45.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:45 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:28:46.336 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 systemd[1]: Starting Ceph mds.g for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:46.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:46.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:46 smithi070 ceph-mon[30942]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:46.646 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 podman[68747]: 2024-09-19 04:28:46.451667244 +0000 UTC m=+0.099961322 container create 5baf0eb5de1e5efc62e6f5334e9992a95fba0ebfd410667d3c8ecffe55eb4104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T04:28:46.646 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 podman[68747]: 2024-09-19 04:28:46.36773894 +0000 UTC m=+0.016033029 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:46 smithi167 ceph-mon[34339]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:46 smithi134 ceph-mon[34525]: pgmap v260: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:46.839 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:46.961 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 podman[68747]: 2024-09-19 04:28:46.67413737 +0000 UTC m=+0.322431457 container init 5baf0eb5de1e5efc62e6f5334e9992a95fba0ebfd410667d3c8ecffe55eb4104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g, GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T04:28:46.961 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 podman[68747]: 2024-09-19 04:28:46.677256058 +0000 UTC m=+0.325550138 container start 5baf0eb5de1e5efc62e6f5334e9992a95fba0ebfd410667d3c8ecffe55eb4104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T04:28:46.961 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 ceph-mds[68784]: -- 172.21.15.70:0/3872176863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556d2baedc20 con 0x556d2baca800 2024-09-19T04:28:46.961 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g[68780]: starting mds.g at 2024-09-19T04:28:46.961 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 bash[68747]: 5baf0eb5de1e5efc62e6f5334e9992a95fba0ebfd410667d3c8ecffe55eb4104 2024-09-19T04:28:46.961 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:28:46 smithi070 systemd[1]: Started Ceph mds.g for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.311+0000 7fc669eba640 1 -- 172.21.15.70:0/3048634156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664106f10 msgr2=0x7fc66410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.311+0000 7fc669eba640 1 --2- 172.21.15.70:0/3048634156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664106f10 0x7fc66410ea90 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009ca0 tx=0x7fc65c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 -- 172.21.15.70:0/3048634156 shutdown_connections 2024-09-19T04:28:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 --2- 172.21.15.70:0/3048634156 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664106f10 0x7fc66410ea90 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 --2- 172.21.15.70:0/3048634156 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc664102790 0x7fc6641067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 --2- 172.21.15.70:0/3048634156 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc664101de0 0x7fc6641021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 -- 172.21.15.70:0/3048634156 >> 172.21.15.70:0/3048634156 conn(0x7fc6640fd8c0 msgr2=0x7fc6640ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 -- 172.21.15.70:0/3048634156 shutdown_connections 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 -- 172.21.15.70:0/3048634156 wait complete. 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 Processor -- start 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.312+0000 7fc669eba640 1 -- start start 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc669eba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664101de0 0x7fc664198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc669eba640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc664102790 0x7fc6641989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc669eba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc664106f10 0x7fc66419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc669eba640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc664111f40 con 0x7fc664101de0 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc669eba640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc664111dc0 con 0x7fc664106f10 2024-09-19T04:28:47.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc669eba640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6641120c0 con 0x7fc664102790 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664101de0 0x7fc664198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664101de0 0x7fc664198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51674/0 (socket says 172.21.15.70:51674) 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 -- 172.21.15.70:0/928458594 learned_addr learned my addr 172.21.15.70:0/928458594 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc65bfff640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc664102790 0x7fc6641989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 -- 172.21.15.70:0/928458594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc664102790 msgr2=0x7fc6641989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc664102790 0x7fc6641989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 -- 172.21.15.70:0/928458594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc664106f10 msgr2=0x7fc66419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc664106f10 0x7fc66419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 -- 172.21.15.70:0/928458594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc66419d410 con 0x7fc664101de0 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6637fe640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664101de0 0x7fc664198460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc65400d950 tx=0x7fc65400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6617fa640 1 -- 172.21.15.70:0/928458594 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc654017070 con 0x7fc664101de0 2024-09-19T04:28:47.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc66419d700 con 0x7fc664101de0 2024-09-19T04:28:47.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6617fa640 1 -- 172.21.15.70:0/928458594 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc654009c30 con 0x7fc664101de0 2024-09-19T04:28:47.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc6617fa640 1 -- 172.21.15.70:0/928458594 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc65400f6b0 con 0x7fc664101de0 2024-09-19T04:28:47.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.313+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6641a4fe0 con 0x7fc664101de0 2024-09-19T04:28:47.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.315+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc6641021c0 con 0x7fc664101de0 2024-09-19T04:28:47.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.316+0000 7fc6617fa640 1 -- 172.21.15.70:0/928458594 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fc654010a50 con 0x7fc664101de0 2024-09-19T04:28:47.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.317+0000 7fc6617fa640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc6500a3240 0x7fc6500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:47.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.317+0000 7fc65bfff640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc6500a3240 0x7fc6500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:47.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.317+0000 7fc6617fa640 1 -- 172.21.15.70:0/928458594 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fc6540cf180 con 0x7fc664101de0 2024-09-19T04:28:47.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.317+0000 7fc65bfff640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc6500a3240 0x7fc6500a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc6641087d0 tx=0x7fc64c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:47.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.321+0000 7fc6617fa640 1 -- 172.21.15.70:0/928458594 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc654009de0 con 0x7fc664101de0 2024-09-19T04:28:47.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.537+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc66410a0f0 con 0x7fc664101de0 2024-09-19T04:28:47.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.538+0000 7fc6617fa640 1 -- 172.21.15.70:0/928458594 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8872 (secure 0 0 0) 0x7fc65409c340 con 0x7fc664101de0 2024-09-19T04:28:47.539 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:47.540 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":11,"btime":"2024-09-19T04:28:47:335670+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24433,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24452,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T04:28:47.540 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 11 2024-09-19T04:28:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc6500a3240 msgr2=0x7fc6500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc6500a3240 0x7fc6500a5700 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fc6641087d0 tx=0x7fc64c005f90 comp rx=0 tx=0).stop 2024-09-19T04:28:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664101de0 msgr2=0x7fc664198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:47.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664101de0 0x7fc664198460 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fc65400d950 tx=0x7fc65400de10 comp rx=0 tx=0).stop 2024-09-19T04:28:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 shutdown_connections 2024-09-19T04:28:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fc6500a3240 0x7fc6500a5700 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc664106f10 0x7fc66419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc664102790 0x7fc6641989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 --2- 172.21.15.70:0/928458594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc664101de0 0x7fc664198460 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 >> 172.21.15.70:0/928458594 conn(0x7fc6640fd8c0 msgr2=0x7fc6640fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 shutdown_connections 2024-09-19T04:28:47.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:47.540+0000 7fc669eba640 1 -- 172.21.15.70:0/928458594 wait complete. 2024-09-19T04:28:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:48.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:48.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: Deploying daemon mds.a on smithi070 2024-09-19T04:28:48.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.70:6838/302466091,v1:172.21.15.70:6839/302466091] up:boot 2024-09-19T04:28:48.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: fsmap 10 up:standby 2024-09-19T04:28:48.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:28:48.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:48.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:47 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/928458594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: Deploying daemon mds.a on smithi070 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.70:6838/302466091,v1:172.21.15.70:6839/302466091] up:boot 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: fsmap 10 up:standby 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:28:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:48.212 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:47 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/928458594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:48.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:48.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: Deploying daemon mds.a on smithi070 2024-09-19T04:28:48.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.70:6838/302466091,v1:172.21.15.70:6839/302466091] up:boot 2024-09-19T04:28:48.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: fsmap 10 up:standby 2024-09-19T04:28:48.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:28:48.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: pgmap v261: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:48.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:47 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/928458594' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:49.645 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:49 smithi070 systemd[1]: Starting Ceph mds.a for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:49.984 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:49 smithi070 podman[69165]: 2024-09-19 04:28:49.6285104 +0000 UTC m=+0.016163769 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:49.984 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:49 smithi070 podman[69165]: 2024-09-19 04:28:49.739353519 +0000 UTC m=+0.127006923 container create 3392ae3361d785ad4b6810b221ebf3bc22dd870061da538082e7edf588cbe934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T04:28:49.984 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:49 smithi070 podman[69165]: 2024-09-19 04:28:49.983689754 +0000 UTC m=+0.371343113 container init 3392ae3361d785ad4b6810b221ebf3bc22dd870061da538082e7edf588cbe934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T04:28:50.234 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:50.258 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:49 smithi070 podman[69165]: 2024-09-19 04:28:49.986799683 +0000 UTC m=+0.374453048 container start 3392ae3361d785ad4b6810b221ebf3bc22dd870061da538082e7edf588cbe934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:28:50.259 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-mds[69184]: -- 172.21.15.70:0/3500966429 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55dec867f860 con 0x55dec865d400 2024-09-19T04:28:50.259 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a[69180]: starting mds.a at 2024-09-19T04:28:50.259 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:50 smithi070 bash[69165]: 3392ae3361d785ad4b6810b221ebf3bc22dd870061da538082e7edf588cbe934 2024-09-19T04:28:50.259 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:28:50 smithi070 systemd[1]: Started Ceph mds.a for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:50.486 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:50.558 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-mon[30942]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:50.559 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.559 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.559 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.559 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:50.559 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:50.560 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:50 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:50.705 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:50 smithi134 ceph-mon[34525]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:50.708 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.708 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.708 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.708 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:50.708 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:50.708 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:50 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:50.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:50 smithi167 ceph-mon[34339]: pgmap v262: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:50.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-09-19T04:28:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-09-19T04:28:50.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:50 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:50.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 -- 172.21.15.70:0/3582765532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 msgr2=0x7f5140107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:50.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 --2- 172.21.15.70:0/3582765532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 0x7f5140107b90 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f5128009930 tx=0x7f512802a420 comp rx=0 tx=0).stop 2024-09-19T04:28:50.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 -- 172.21.15.70:0/3582765532 shutdown_connections 2024-09-19T04:28:50.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 --2- 172.21.15.70:0/3582765532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51401082a0 0x7f514010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 --2- 172.21.15.70:0/3582765532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 0x7f5140107b90 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 --2- 172.21.15.70:0/3582765532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5140102d30 0x7f5140103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 -- 172.21.15.70:0/3582765532 >> 172.21.15.70:0/3582765532 conn(0x7f51400fc7d0 msgr2=0x7f51400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 -- 172.21.15.70:0/3582765532 shutdown_connections 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.943+0000 7f51463fc640 1 -- 172.21.15.70:0/3582765532 wait complete. 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f51463fc640 1 Processor -- start 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f51463fc640 1 -- start start 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f51463fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5140102d30 0x7f51401985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f51463fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 0x7f5140198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f51463fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51401082a0 0x7f514019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f51463fc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f51401120b0 con 0x7f51401036e0 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f51463fc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5140111f30 con 0x7f5140102d30 2024-09-19T04:28:50.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f51463fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5140112230 con 0x7f51401082a0 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5137fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 0x7f5140198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5137fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 0x7f5140198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51730/0 (socket says 172.21.15.70:51730) 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5137fff640 1 -- 172.21.15.70:0/1765317022 learned_addr learned my addr 172.21.15.70:0/1765317022 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5144999640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51401082a0 0x7f514019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f513ffff640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5140102d30 0x7f51401985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5137fff640 1 -- 172.21.15.70:0/1765317022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51401082a0 msgr2=0x7f514019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5137fff640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51401082a0 0x7f514019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5137fff640 1 -- 172.21.15.70:0/1765317022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5140102d30 msgr2=0x7f51401985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5137fff640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5140102d30 0x7f51401985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.944+0000 7f5137fff640 1 -- 172.21.15.70:0/1765317022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f514019d580 con 0x7f51401036e0 2024-09-19T04:28:50.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.945+0000 7f5137fff640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 0x7f5140198b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5128005940 tx=0x7f51280042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.945+0000 7f513dffb640 1 -- 172.21.15.70:0/1765317022 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f512803f030 con 0x7f51401036e0 2024-09-19T04:28:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.945+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f514019d810 con 0x7f51401036e0 2024-09-19T04:28:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.945+0000 7f513dffb640 1 -- 172.21.15.70:0/1765317022 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5128003ac0 con 0x7f51401036e0 2024-09-19T04:28:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.945+0000 7f513dffb640 1 -- 172.21.15.70:0/1765317022 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5128035070 con 0x7f51401036e0 2024-09-19T04:28:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.945+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51401a5150 con 0x7f51401036e0 2024-09-19T04:28:50.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.946+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5140103110 con 0x7f51401036e0 2024-09-19T04:28:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.947+0000 7f513dffb640 1 -- 172.21.15.70:0/1765317022 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f5128042030 con 0x7f51401036e0 2024-09-19T04:28:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.948+0000 7f513dffb640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f512c0a3240 0x7f512c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.948+0000 7f513ffff640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f512c0a3240 0x7f512c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.948+0000 7f513dffb640 1 -- 172.21.15.70:0/1765317022 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f51280efe10 con 0x7f51401036e0 2024-09-19T04:28:50.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.948+0000 7f513ffff640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f512c0a3240 0x7f512c0a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5130009990 tx=0x7f5130009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:50.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:50.951+0000 7f513dffb640 1 -- 172.21.15.70:0/1765317022 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51280bcfd0 con 0x7f51401036e0 2024-09-19T04:28:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.152+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f514010a2b0 con 0x7f51401036e0 2024-09-19T04:28:51.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.153+0000 7f513dffb640 1 -- 172.21.15.70:0/1765317022 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9698 (secure 0 0 0) 0x7f51280bc8d0 con 0x7f51401036e0 2024-09-19T04:28:51.155 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:51.155 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":12,"btime":"2024-09-19T04:28:50:434479+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24433,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24452,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9}],"filesystems":[]} 2024-09-19T04:28:51.155 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 12 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f512c0a3240 msgr2=0x7f512c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f512c0a3240 0x7f512c0a5700 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f5130009990 tx=0x7f5130009110 comp rx=0 tx=0).stop 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 msgr2=0x7f5140198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 0x7f5140198b10 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5128005940 tx=0x7f51280042f0 comp rx=0 tx=0).stop 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 shutdown_connections 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f512c0a3240 0x7f512c0a5700 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51401082a0 0x7f514019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51401036e0 0x7f5140198b10 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:51.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 --2- 172.21.15.70:0/1765317022 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5140102d30 0x7f51401985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 >> 172.21.15.70:0/1765317022 conn(0x7f51400fc7d0 msgr2=0x7f5140105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 shutdown_connections 2024-09-19T04:28:51.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:51.155+0000 7f51463fc640 1 -- 172.21.15.70:0/1765317022 wait complete. 2024-09-19T04:28:51.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:51 smithi134 ceph-mon[34525]: Deploying daemon mds.b on smithi134 2024-09-19T04:28:51.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:51 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.70:6840/3197291261,v1:172.21.15.70:6841/3197291261] up:boot 2024-09-19T04:28:51.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:51 smithi134 ceph-mon[34525]: fsmap 11 up:standby 2024-09-19T04:28:51.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:51 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:28:51.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:51 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1765317022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:51.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:51 smithi167 ceph-mon[34339]: Deploying daemon mds.b on smithi134 2024-09-19T04:28:51.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:51 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.70:6840/3197291261,v1:172.21.15.70:6841/3197291261] up:boot 2024-09-19T04:28:51.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:51 smithi167 ceph-mon[34339]: fsmap 11 up:standby 2024-09-19T04:28:51.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:51 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:28:51.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:51 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1765317022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:51.743 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:51 smithi070 ceph-mon[30942]: Deploying daemon mds.b on smithi134 2024-09-19T04:28:51.743 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:51 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.70:6840/3197291261,v1:172.21.15.70:6841/3197291261] up:boot 2024-09-19T04:28:51.743 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:51 smithi070 ceph-mon[30942]: fsmap 11 up:standby 2024-09-19T04:28:51.743 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:51 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:28:51.743 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:51 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1765317022' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:52.285 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 systemd[1]: Starting Ceph mds.b for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:28:52.583 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:52 smithi134 ceph-mon[34525]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:52.584 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 podman[64342]: 2024-09-19 04:28:52.229521442 +0000 UTC m=+0.015573202 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:28:52.584 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 podman[64342]: 2024-09-19 04:28:52.337271795 +0000 UTC m=+0.123323577 container create 28ec9eeea4944e707bdcbe4b5146897805e331f6c35231b5d06a5d1ac74d7e14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:28:52.584 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 podman[64342]: 2024-09-19 04:28:52.556393959 +0000 UTC m=+0.342445709 container init 28ec9eeea4944e707bdcbe4b5146897805e331f6c35231b5d06a5d1ac74d7e14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T04:28:52.584 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 podman[64342]: 2024-09-19 04:28:52.559644331 +0000 UTC m=+0.345696071 container start 28ec9eeea4944e707bdcbe4b5146897805e331f6c35231b5d06a5d1ac74d7e14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-09-19T04:28:52.584 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 ceph-mds[64362]: -- 172.21.15.134:0/3483378062 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0358c7860 con 0x55e0358a5000 2024-09-19T04:28:52.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:52 smithi167 ceph-mon[34339]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:52 smithi070 ceph-mon[30942]: pgmap v263: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:53.035 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: starting mds.b at 2024-09-19T04:28:53.035 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 bash[64342]: 28ec9eeea4944e707bdcbe4b5146897805e331f6c35231b5d06a5d1ac74d7e14 2024-09-19T04:28:53.035 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:28:52 smithi134 systemd[1]: Started Ceph mds.b for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:28:53.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:28:53.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] up:boot 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: fsmap 12 up:standby 2024-09-19T04:28:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:53 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] up:boot 2024-09-19T04:28:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: fsmap 12 up:standby 2024-09-19T04:28:54.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:53 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:28:54.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:54.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:54.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: pgmap v264: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:54.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] up:boot 2024-09-19T04:28:54.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: fsmap 12 up:standby 2024-09-19T04:28:54.146 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:53 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:28:54.146 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:54.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/2896821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54105f40 msgr2=0x7f1d541063d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:54.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/2896821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54105f40 0x7f1d541063d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1d4c009ca0 tx=0x7f1d4c02a940 comp rx=0 tx=0).stop 2024-09-19T04:28:54.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/2896821 shutdown_connections 2024-09-19T04:28:54.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/2896821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54105f40 0x7f1d541063d0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/2896821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d54101450 0x7f1d54105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/2896821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d54100b30 0x7f1d54100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/2896821 >> 172.21.15.70:0/2896821 conn(0x7f1d540fc7a0 msgr2=0x7f1d540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:54.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/2896821 shutdown_connections 2024-09-19T04:28:54.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/2896821 wait complete. 2024-09-19T04:28:54.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 Processor -- start 2024-09-19T04:28:54.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.639+0000 7f1d5b3b9640 1 -- start start 2024-09-19T04:28:54.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d5b3b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d54100b30 0x7f1d541a4620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:54.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d5b3b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54101450 0x7f1d541a4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:54.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d5b3b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d54105f40 0x7f1d5419e7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:54.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d5b3b9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1d54118550 con 0x7f1d54101450 2024-09-19T04:28:54.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d5b3b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541183d0 con 0x7f1d54105f40 2024-09-19T04:28:54.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d5b3b9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1d541186d0 con 0x7f1d54100b30 2024-09-19T04:28:54.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54101450 0x7f1d541a4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:54.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54101450 0x7f1d541a4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45462/0 (socket says 172.21.15.70:45462) 2024-09-19T04:28:54.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 -- 172.21.15.70:0/3408098926 learned_addr learned my addr 172.21.15.70:0/3408098926 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:54.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d59155640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d54100b30 0x7f1d541a4620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:54.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d59956640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d54105f40 0x7f1d5419e7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:54.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 -- 172.21.15.70:0/3408098926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d54100b30 msgr2=0x7f1d541a4620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:54.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d54100b30 0x7f1d541a4620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 -- 172.21.15.70:0/3408098926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d54105f40 msgr2=0x7f1d5419e7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:54.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d54105f40 0x7f1d5419e7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 -- 172.21.15.70:0/3408098926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d5419ef40 con 0x7f1d54101450 2024-09-19T04:28:54.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d59956640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d54105f40 0x7f1d5419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:28:54.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d58954640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54101450 0x7f1d541a4b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c970 tx=0x7f1d4400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:54.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d4a7fc640 1 -- 172.21.15.70:0/3408098926 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44007bb0 con 0x7f1d54101450 2024-09-19T04:28:54.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d4a7fc640 1 -- 172.21.15.70:0/3408098926 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1d44007d50 con 0x7f1d54101450 2024-09-19T04:28:54.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d4a7fc640 1 -- 172.21.15.70:0/3408098926 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d44018820 con 0x7f1d54101450 2024-09-19T04:28:54.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d5419f230 con 0x7f1d54101450 2024-09-19T04:28:54.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.640+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d541ab480 con 0x7f1d54101450 2024-09-19T04:28:54.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.642+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d5406b070 con 0x7f1d54101450 2024-09-19T04:28:54.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.643+0000 7f1d4a7fc640 1 -- 172.21.15.70:0/3408098926 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f1d440189c0 con 0x7f1d54101450 2024-09-19T04:28:54.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.643+0000 7f1d4a7fc640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d400a32c0 0x7f1d400a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:54.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.643+0000 7f1d59155640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d400a32c0 0x7f1d400a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:54.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.643+0000 7f1d4a7fc640 1 -- 172.21.15.70:0/3408098926 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f1d440cf400 con 0x7f1d54101450 2024-09-19T04:28:54.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.644+0000 7f1d59155640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d400a32c0 0x7f1d400a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d50005fd0 tx=0x7f1d5000b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:54.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.647+0000 7f1d4a7fc640 1 -- 172.21.15.70:0/3408098926 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1d44014030 con 0x7f1d54101450 2024-09-19T04:28:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.881+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1d541ab710 con 0x7f1d54101450 2024-09-19T04:28:54.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.882+0000 7f1d4a7fc640 1 -- 172.21.15.70:0/3408098926 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10527 (secure 0 0 0) 0x7f1d4409c5c0 con 0x7f1d54101450 2024-09-19T04:28:54.884 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:54.884 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":13,"btime":"2024-09-19T04:28:53:446568+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24412,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24418,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24428,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24433,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24452,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24470,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-09-19T04:28:54.884 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 13 2024-09-19T04:28:54.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.884+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d400a32c0 msgr2=0x7f1d400a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:54.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.884+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d400a32c0 0x7f1d400a5780 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f1d50005fd0 tx=0x7f1d5000b390 comp rx=0 tx=0).stop 2024-09-19T04:28:54.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.884+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54101450 msgr2=0x7f1d541a4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:54.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.884+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54101450 0x7f1d541a4b60 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f1d4400c970 tx=0x7f1d4400ce30 comp rx=0 tx=0).stop 2024-09-19T04:28:54.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.885+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 shutdown_connections 2024-09-19T04:28:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.885+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1d400a32c0 0x7f1d400a5780 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.885+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d54105f40 0x7f1d5419e7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.885+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1d54101450 0x7f1d541a4b60 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.885+0000 7f1d5b3b9640 1 --2- 172.21.15.70:0/3408098926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1d54100b30 0x7f1d541a4620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.885+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 >> 172.21.15.70:0/3408098926 conn(0x7f1d540fc7a0 msgr2=0x7f1d541038f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.885+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 shutdown_connections 2024-09-19T04:28:54.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:54.885+0000 7f1d5b3b9640 1 -- 172.21.15.70:0/3408098926 wait complete. 2024-09-19T04:28:55.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:55.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:55.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3408098926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:55.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:55 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:55.515 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.615 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3408098926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:55.616 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:55 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3408098926' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:28:55.640 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:55 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:28:56.444 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:56.585 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:56 smithi070 ceph-mon[30942]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:56.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:56 smithi167 ceph-mon[34339]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:56.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:56 smithi134 ceph-mon[34525]: pgmap v265: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 -- 172.21.15.70:0/1049180427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0110101280 msgr2=0x7f011010df40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 --2- 172.21.15.70:0/1049180427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0110101280 0x7f011010df40 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f010c009900 tx=0x7f010c02a410 comp rx=0 tx=0).stop 2024-09-19T04:28:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 -- 172.21.15.70:0/1049180427 shutdown_connections 2024-09-19T04:28:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 --2- 172.21.15.70:0/1049180427 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011010e480 0x7f0110110870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 --2- 172.21.15.70:0/1049180427 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0110101280 0x7f011010df40 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 --2- 172.21.15.70:0/1049180427 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01101008d0 0x7f0110100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 -- 172.21.15.70:0/1049180427 >> 172.21.15.70:0/1049180427 conn(0x7f01100fc7a0 msgr2=0x7f01100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 -- 172.21.15.70:0/1049180427 shutdown_connections 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.933+0000 7f0117a2f640 1 -- 172.21.15.70:0/1049180427 wait complete. 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0117a2f640 1 Processor -- start 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0117a2f640 1 -- start start 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0117a2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01101008d0 0x7f011019a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0117a2f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0110101280 0x7f011019ac10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0117a2f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011010e480 0x7f011019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0117a2f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0110114190 con 0x7f01101008d0 2024-09-19T04:28:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0117a2f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0110114010 con 0x7f0110101280 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0117a2f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0110114310 con 0x7f011010e480 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f01157cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01101008d0 0x7f011019a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f01157cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01101008d0 0x7f011019a6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45486/0 (socket says 172.21.15.70:45486) 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f01157cb640 1 -- 172.21.15.70:0/3815282253 learned_addr learned my addr 172.21.15.70:0/3815282253 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0114fca640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0110101280 0x7f011019ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.934+0000 7f0115fcc640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011010e480 0x7f011019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01157cb640 1 -- 172.21.15.70:0/3815282253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011010e480 msgr2=0x7f011019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01157cb640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011010e480 0x7f011019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01157cb640 1 -- 172.21.15.70:0/3815282253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0110101280 msgr2=0x7f011019ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01157cb640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0110101280 0x7f011019ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01157cb640 1 -- 172.21.15.70:0/3815282253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011019f680 con 0x7f01101008d0 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01157cb640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01101008d0 0x7f011019a6d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f010000e9f0 tx=0x7f010000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01067fc640 1 -- 172.21.15.70:0/3815282253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f010000cd80 con 0x7f01101008d0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01067fc640 1 -- 172.21.15.70:0/3815282253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0100010900 con 0x7f01101008d0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f01067fc640 1 -- 172.21.15.70:0/3815282253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01000189e0 con 0x7f01101008d0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011019f970 con 0x7f01101008d0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.935+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01101a7250 con 0x7f01101008d0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.936+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f011006b070 con 0x7f01101008d0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.938+0000 7f01067fc640 1 -- 172.21.15.70:0/3815282253 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0100018b80 con 0x7f01101008d0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.938+0000 7f01067fc640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f00fc0a3240 0x7f00fc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.939+0000 7f0114fca640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f00fc0a3240 0x7f00fc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.939+0000 7f01067fc640 1 -- 172.21.15.70:0/3815282253 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f01000cf7b0 con 0x7f01101008d0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.939+0000 7f0114fca640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f00fc0a3240 0x7f00fc0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f010c006010 tx=0x7f010c0058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:56.943+0000 7f01067fc640 1 -- 172.21.15.70:0/3815282253 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f010009c320 con 0x7f01101008d0 2024-09-19T04:28:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.133+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f0110109610 con 0x7f01101008d0 2024-09-19T04:28:57.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.134+0000 7f01067fc640 1 -- 172.21.15.70:0/3815282253 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f01000a0620 con 0x7f01101008d0 2024-09-19T04:28:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:28:57.135 INFO:teuthology.orchestra.run.smithi070.stdout:[ 2024-09-19T04:28:57.135 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:28:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "poolnum": 1, 2024-09-19T04:28:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: "poolname": ".mgr" 2024-09-19T04:28:57.136 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:28:57.136 INFO:teuthology.orchestra.run.smithi070.stdout:] 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f00fc0a3240 msgr2=0x7f00fc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f00fc0a3240 0x7f00fc0a5700 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f010c006010 tx=0x7f010c0058d0 comp rx=0 tx=0).stop 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01101008d0 msgr2=0x7f011019a6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01101008d0 0x7f011019a6d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f010000e9f0 tx=0x7f010000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 shutdown_connections 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f00fc0a3240 0x7f00fc0a5700 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f011010e480 0x7f011019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0110101280 0x7f011019ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 --2- 172.21.15.70:0/3815282253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f01101008d0 0x7f011019a6d0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 >> 172.21.15.70:0/3815282253 conn(0x7f01100fc7a0 msgr2=0x7f011010f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:57.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 shutdown_connections 2024-09-19T04:28:57.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:57.136+0000 7f0117a2f640 1 -- 172.21.15.70:0/3815282253 wait complete. 2024-09-19T04:28:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:57 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:57 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3815282253' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:28:57.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:57 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:57 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3815282253' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:28:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:57 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3815282253' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-09-19T04:28:57.823 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-09-19T04:28:57.830 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-09-19T04:28:58.112 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:28:58.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:58 smithi070 ceph-mon[30942]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:58.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:58.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:58.529 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 -- 172.21.15.70:0/39980647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24101de0 msgr2=0x7fae241021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:58.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 --2- 172.21.15.70:0/39980647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24101de0 0x7fae241021c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fae14009900 tx=0x7fae1402a410 comp rx=0 tx=0).stop 2024-09-19T04:28:58.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 -- 172.21.15.70:0/39980647 shutdown_connections 2024-09-19T04:28:58.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 --2- 172.21.15.70:0/39980647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae24106f10 0x7fae2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:58.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 --2- 172.21.15.70:0/39980647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae24102790 0x7fae241067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 --2- 172.21.15.70:0/39980647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24101de0 0x7fae241021c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 -- 172.21.15.70:0/39980647 >> 172.21.15.70:0/39980647 conn(0x7fae240fd8c0 msgr2=0x7fae240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 -- 172.21.15.70:0/39980647 shutdown_connections 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.610+0000 7fae28fd6640 1 -- 172.21.15.70:0/39980647 wait complete. 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae28fd6640 1 Processor -- start 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae28fd6640 1 -- start start 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae28fd6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae24101de0 0x7fae24198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae28fd6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24102790 0x7fae24198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae28fd6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae24106f10 0x7fae2419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae28fd6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fae24111f40 con 0x7fae24102790 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae28fd6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fae24111dc0 con 0x7fae24101de0 2024-09-19T04:28:58.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae28fd6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fae241120c0 con 0x7fae24106f10 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24102790 0x7fae24198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae1bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24102790 0x7fae24198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45494/0 (socket says 172.21.15.70:45494) 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae1bfff640 1 -- 172.21.15.70:0/1937879724 learned_addr learned my addr 172.21.15.70:0/1937879724 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.611+0000 7fae22d9d640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae24106f10 0x7fae2419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae2259c640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae24101de0 0x7fae24198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1bfff640 1 -- 172.21.15.70:0/1937879724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae24106f10 msgr2=0x7fae2419cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1bfff640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae24106f10 0x7fae2419cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1bfff640 1 -- 172.21.15.70:0/1937879724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae24101de0 msgr2=0x7fae24198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1bfff640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae24101de0 0x7fae24198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1bfff640 1 -- 172.21.15.70:0/1937879724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae2419d3f0 con 0x7fae24102790 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1bfff640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24102790 0x7fae24198980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c890 tx=0x7fae0c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:58.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1b7fe640 1 -- 172.21.15.70:0/1937879724 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c004220 con 0x7fae24102790 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae2419d6e0 con 0x7fae24102790 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1b7fe640 1 -- 172.21.15.70:0/1937879724 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fae0c0043c0 con 0x7fae24102790 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae1b7fe640 1 -- 172.21.15.70:0/1937879724 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae0c004a00 con 0x7fae24102790 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.612+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae241a4fc0 con 0x7fae24102790 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.613+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae241021c0 con 0x7fae24102790 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.614+0000 7fae1b7fe640 1 -- 172.21.15.70:0/1937879724 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fae0c004ba0 con 0x7fae24102790 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.615+0000 7fae1b7fe640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fae100a3240 0x7fae100a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.615+0000 7fae1b7fe640 1 -- 172.21.15.70:0/1937879724 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fae0c0cf260 con 0x7fae24102790 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.615+0000 7fae2259c640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fae100a3240 0x7fae100a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.615+0000 7fae2259c640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fae100a3240 0x7fae100a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fae14005ab0 tx=0x7fae14005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:28:58.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.619+0000 7fae1b7fe640 1 -- 172.21.15.70:0/1937879724 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fae0c014030 con 0x7fae24102790 2024-09-19T04:28:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:58 smithi167 ceph-mon[34339]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:58 smithi134 ceph-mon[34525]: pgmap v266: 1 pgs: 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:28:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:28:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:28:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:28:58.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:58.791+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fae2402d7c0 con 0x7fae24102790 2024-09-19T04:28:59.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.374+0000 7fae1b7fe640 1 -- 172.21.15.70:0/1937879724 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7fae0c09c380 con 0x7fae24102790 2024-09-19T04:28:59.376 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' created 2024-09-19T04:28:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.376+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fae100a3240 msgr2=0x7fae100a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.376+0000 7fae28fd6640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fae100a3240 0x7fae100a5700 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fae14005ab0 tx=0x7fae14005a20 comp rx=0 tx=0).stop 2024-09-19T04:28:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.376+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24102790 msgr2=0x7fae24198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:28:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.376+0000 7fae28fd6640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24102790 0x7fae24198980 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7fae0c00c890 tx=0x7fae0c00cd50 comp rx=0 tx=0).stop 2024-09-19T04:28:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.377+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 shutdown_connections 2024-09-19T04:28:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.377+0000 7fae28fd6640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fae100a3240 0x7fae100a5700 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.377+0000 7fae28fd6640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fae24106f10 0x7fae2419cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.377+0000 7fae28fd6640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fae24102790 0x7fae24198980 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.377+0000 7fae28fd6640 1 --2- 172.21.15.70:0/1937879724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae24101de0 0x7fae24198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:28:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.377+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 >> 172.21.15.70:0/1937879724 conn(0x7fae240fd8c0 msgr2=0x7fae240fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:28:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.377+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 shutdown_connections 2024-09-19T04:28:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:28:59.377+0000 7fae28fd6640 1 -- 172.21.15.70:0/1937879724 wait complete. 2024-09-19T04:28:59.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:28:59 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1937879724' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:28:59.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:28:59 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1937879724' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:28:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:28:59 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1937879724' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-09-19T04:29:00.011 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2024-09-19T04:29:00.256 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:00 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1937879724' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:29:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:00 smithi070 ceph-mon[30942]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:29:00.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:00 smithi070 ceph-mon[30942]: pgmap v268: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:00.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:00 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1937879724' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:29:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:00 smithi167 ceph-mon[34339]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:29:00.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:00 smithi167 ceph-mon[34339]: pgmap v268: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:00.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/333402782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0108290 msgr2=0x7f7ce010ec30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:00.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/333402782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0108290 0x7f7ce010ec30 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7cd8009cd0 tx=0x7f7cd802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:29:00.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/333402782 shutdown_connections 2024-09-19T04:29:00.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/333402782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0108290 0x7f7ce010ec30 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:00.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/333402782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ce0103740 0x7f7ce0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:00.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/333402782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0102d90 0x7f7ce0103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:00.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/333402782 >> 172.21.15.70:0/333402782 conn(0x7f7ce00fc7d0 msgr2=0x7f7ce00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/333402782 shutdown_connections 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.731+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/333402782 wait complete. 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7ce4ad6640 1 Processor -- start 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7ce4ad6640 1 -- start start 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7ce4ad6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0102d90 0x7f7ce01985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7ce4ad6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0103740 0x7f7ce0198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7ce4ad6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ce0108290 0x7f7ce019ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7ce4ad6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce01120e0 con 0x7f7ce0102d90 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7ce4ad6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce0111f60 con 0x7f7ce0103740 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7ce4ad6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7ce0112260 con 0x7f7ce0108290 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7cde59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0102d90 0x7f7ce01985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7cde59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0102d90 0x7f7ce01985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45506/0 (socket says 172.21.15.70:45506) 2024-09-19T04:29:00.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7cde59c640 1 -- 172.21.15.70:0/5625941 learned_addr learned my addr 172.21.15.70:0/5625941 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.732+0000 7f7cddd9b640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0103740 0x7f7ce0198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7cded9d640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ce0108290 0x7f7ce019ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7cde59c640 1 -- 172.21.15.70:0/5625941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ce0108290 msgr2=0x7f7ce019ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7cde59c640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ce0108290 0x7f7ce019ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7cde59c640 1 -- 172.21.15.70:0/5625941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0103740 msgr2=0x7f7ce0198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7cde59c640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0103740 0x7f7ce0198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7cde59c640 1 -- 172.21.15.70:0/5625941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ce019d570 con 0x7f7ce0102d90 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7cde59c640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0102d90 0x7f7ce01985c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000b4a0 tx=0x7f7cd000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7ccf7fe640 1 -- 172.21.15.70:0/5625941 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0014070 con 0x7f7ce0102d90 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7ccf7fe640 1 -- 172.21.15.70:0/5625941 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7cd0010ae0 con 0x7f7ce0102d90 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ce019d860 con 0x7f7ce0102d90 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7ccf7fe640 1 -- 172.21.15.70:0/5625941 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7cd0017c70 con 0x7f7ce0102d90 2024-09-19T04:29:00.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.733+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ce01a5140 con 0x7f7ce0102d90 2024-09-19T04:29:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.734+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ce006a7f0 con 0x7f7ce0102d90 2024-09-19T04:29:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.735+0000 7f7ccf7fe640 1 -- 172.21.15.70:0/5625941 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f7cd0017070 con 0x7f7ce0102d90 2024-09-19T04:29:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.736+0000 7f7ccf7fe640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7cc80a3240 0x7f7cc80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.736+0000 7f7cddd9b640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7cc80a3240 0x7f7cc80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.736+0000 7f7ccf7fe640 1 -- 172.21.15.70:0/5625941 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f7cd00cf160 con 0x7f7ce0102d90 2024-09-19T04:29:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.736+0000 7f7cddd9b640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7cc80a3240 0x7f7cc80a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00fede0 tx=0x7f7cd400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:00.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.740+0000 7f7ccf7fe640 1 -- 172.21.15.70:0/5625941 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7cd009c110 con 0x7f7ce0102d90 2024-09-19T04:29:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:00 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1937879724' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-09-19T04:29:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:00 smithi134 ceph-mon[34525]: osdmap e77: 12 total, 12 up, 12 in 2024-09-19T04:29:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:00 smithi134 ceph-mon[34525]: pgmap v268: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:00.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:00.907+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f7ce0103170 con 0x7f7ce0102d90 2024-09-19T04:29:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.386+0000 7f7ccf7fe640 1 -- 172.21.15.70:0/5625941 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v79) ==== 170+0+0 (secure 0 0 0) 0x7f7cd009ba10 con 0x7f7ce0102d90 2024-09-19T04:29:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' created 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7cc80a3240 msgr2=0x7f7cc80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7cc80a3240 0x7f7cc80a5700 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7ce00fede0 tx=0x7f7cd400b390 comp rx=0 tx=0).stop 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0102d90 msgr2=0x7f7ce01985c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0102d90 0x7f7ce01985c0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f7cd000b4a0 tx=0x7f7cd000b960 comp rx=0 tx=0).stop 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 shutdown_connections 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f7cc80a3240 0x7f7cc80a5700 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7ce0108290 0x7f7ce019ce90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ce0103740 0x7f7ce0198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:01.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 --2- 172.21.15.70:0/5625941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7ce0102d90 0x7f7ce01985c0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:01.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 >> 172.21.15.70:0/5625941 conn(0x7f7ce00fc7d0 msgr2=0x7f7ce0106350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:01.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 shutdown_connections 2024-09-19T04:29:01.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:01.389+0000 7f7ce4ad6640 1 -- 172.21.15.70:0/5625941 wait complete. 2024-09-19T04:29:01.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:01 smithi070 ceph-mon[30942]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:29:01.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:01 smithi070 ceph-mon[30942]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:29:01.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:01 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/5625941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:29:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:01 smithi167 ceph-mon[34339]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:29:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:01 smithi167 ceph-mon[34339]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:29:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:01 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/5625941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:29:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:01 smithi134 ceph-mon[34525]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-09-19T04:29:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:01 smithi134 ceph-mon[34525]: osdmap e78: 12 total, 12 up, 12 in 2024-09-19T04:29:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:01 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/5625941' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-09-19T04:29:02.047 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-09-19T04:29:02.297 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:02.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:02 smithi070 ceph-mon[30942]: pgmap v270: 33 pgs: 1 creating+activating, 20 creating+peering, 3 active+clean, 9 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:02.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:02 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/5625941' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:29:02.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:02 smithi070 ceph-mon[30942]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:29:02.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:02 smithi167 ceph-mon[34339]: pgmap v270: 33 pgs: 1 creating+activating, 20 creating+peering, 3 active+clean, 9 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:02.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:02 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/5625941' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:29:02.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:02 smithi167 ceph-mon[34339]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:29:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:02 smithi134 ceph-mon[34525]: pgmap v270: 33 pgs: 1 creating+activating, 20 creating+peering, 3 active+clean, 9 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:02 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/5625941' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-09-19T04:29:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:02 smithi134 ceph-mon[34525]: osdmap e79: 12 total, 12 up, 12 in 2024-09-19T04:29:02.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.775+0000 7f0dd4539640 1 -- 172.21.15.70:0/2732099088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc0ffc40 msgr2=0x7f0dcc1000c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.775+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2732099088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc0ffc40 0x7f0dcc1000c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8009930 tx=0x7f0dc802a420 comp rx=0 tx=0).stop 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 -- 172.21.15.70:0/2732099088 shutdown_connections 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2732099088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dcc100600 0x7f0dcc10e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2732099088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc0ffc40 0x7f0dcc1000c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2732099088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dcc106c80 0x7f0dcc107060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 -- 172.21.15.70:0/2732099088 >> 172.21.15.70:0/2732099088 conn(0x7f0dcc0fba90 msgr2=0x7f0dcc0fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 -- 172.21.15.70:0/2732099088 shutdown_connections 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 -- 172.21.15.70:0/2732099088 wait complete. 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 Processor -- start 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 -- start start 2024-09-19T04:29:02.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dcc0ffc40 0x7f0dcc1983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc100600 0x7f0dcc198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dcc106c80 0x7f0dcc19ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc111f40 con 0x7f0dcc100600 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc111dc0 con 0x7f0dcc106c80 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.776+0000 7f0dd4539640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0dcc1120c0 con 0x7f0dcc0ffc40 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc100600 0x7f0dcc198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc100600 0x7f0dcc198920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45532/0 (socket says 172.21.15.70:45532) 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 -- 172.21.15.70:0/2412406919 learned_addr learned my addr 172.21.15.70:0/2412406919 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd22d5640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dcc0ffc40 0x7f0dcc1983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd2ad6640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dcc106c80 0x7f0dcc19ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 -- 172.21.15.70:0/2412406919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dcc0ffc40 msgr2=0x7f0dcc1983e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dcc0ffc40 0x7f0dcc1983e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 -- 172.21.15.70:0/2412406919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dcc106c80 msgr2=0x7f0dcc19ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:02.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dcc106c80 0x7f0dcc19ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 -- 172.21.15.70:0/2412406919 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0dcc19d390 con 0x7f0dcc100600 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd22d5640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dcc0ffc40 0x7f0dcc1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd1ad4640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc100600 0x7f0dcc198920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8031440 tx=0x7f0dc8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dc37fe640 1 -- 172.21.15.70:0/2412406919 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc803f030 con 0x7f0dcc100600 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dc37fe640 1 -- 172.21.15.70:0/2412406919 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0dc8003ac0 con 0x7f0dcc100600 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0dcc19d620 con 0x7f0dcc100600 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dc37fe640 1 -- 172.21.15.70:0/2412406919 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dc8035070 con 0x7f0dcc100600 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.777+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0dcc1a4f60 con 0x7f0dcc100600 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.778+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0dcc101080 con 0x7f0dcc100600 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.779+0000 7f0dc37fe640 1 -- 172.21.15.70:0/2412406919 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f0dc8042030 con 0x7f0dcc100600 2024-09-19T04:29:02.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.780+0000 7f0dc37fe640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0db80a3240 0x7f0db80a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:02.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.780+0000 7f0dd22d5640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0db80a3240 0x7f0db80a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:02.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.780+0000 7f0dc37fe640 1 -- 172.21.15.70:0/2412406919 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f0dc80f0320 con 0x7f0dcc100600 2024-09-19T04:29:02.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.780+0000 7f0dd22d5640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0db80a3240 0x7f0db80a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc005fd0 tx=0x7f0dbc00b5f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:02.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.783+0000 7f0dc37fe640 1 -- 172.21.15.70:0/2412406919 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0dc80bd1f0 con 0x7f0dcc100600 2024-09-19T04:29:02.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:02.987+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f0dcc1a5130 con 0x7f0dcc100600 2024-09-19T04:29:03.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.401+0000 7f0dc37fe640 1 -- 172.21.15.70:0/2412406919 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f0dc80bcaf0 con 0x7f0dcc100600 2024-09-19T04:29:03.403 INFO:teuthology.orchestra.run.smithi070.stderr:new fs with metadata pool 2 and data pool 3 2024-09-19T04:29:03.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0db80a3240 msgr2=0x7f0db80a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0db80a3240 0x7f0db80a5700 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f0dbc005fd0 tx=0x7f0dbc00b5f0 comp rx=0 tx=0).stop 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc100600 msgr2=0x7f0dcc198920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc100600 0x7f0dcc198920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0dc8031440 tx=0x7f0dc8004270 comp rx=0 tx=0).stop 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 shutdown_connections 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0db80a3240 0x7f0db80a5700 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0dcc106c80 0x7f0dcc19ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0dcc100600 0x7f0dcc198920 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 --2- 172.21.15.70:0/2412406919 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0dcc0ffc40 0x7f0dcc1983e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 >> 172.21.15.70:0/2412406919 conn(0x7f0dcc0fba90 msgr2=0x7f0dcc0fd1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 shutdown_connections 2024-09-19T04:29:03.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:03.404+0000 7f0dd4539640 1 -- 172.21.15.70:0/2412406919 wait complete. 2024-09-19T04:29:03.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:03 smithi167 ceph-mon[34339]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:29:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:03 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2412406919' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:29:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:03 smithi167 ceph-mon[34339]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T04:29:03.732 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:03 smithi070 ceph-mon[30942]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:29:03.732 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:03 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2412406919' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:29:03.732 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:03 smithi070 ceph-mon[30942]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T04:29:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:03 smithi134 ceph-mon[34525]: osdmap e80: 12 total, 12 up, 12 in 2024-09-19T04:29:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:03 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2412406919' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-09-19T04:29:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:03 smithi134 ceph-mon[34525]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-09-19T04:29:04.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:29:04.356 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:04.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:04 smithi070 ceph-mon[30942]: pgmap v273: 97 pgs: 1 creating+activating, 26 creating+peering, 16 active+clean, 54 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:04.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:04 smithi070 ceph-mon[30942]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:29:04.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:04 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2412406919' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:29:04.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:04 smithi070 ceph-mon[30942]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T04:29:04.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:04 smithi070 ceph-mon[30942]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T04:29:04.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:04 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] up:active 2024-09-19T04:29:04.656 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:04 smithi070 ceph-mon[30942]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:04.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:04 smithi167 ceph-mon[34339]: pgmap v273: 97 pgs: 1 creating+activating, 26 creating+peering, 16 active+clean, 54 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:04.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:04 smithi167 ceph-mon[34339]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:29:04.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:04 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2412406919' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:29:04.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:04 smithi167 ceph-mon[34339]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T04:29:04.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:04 smithi167 ceph-mon[34339]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T04:29:04.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:04 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] up:active 2024-09-19T04:29:04.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:04 smithi167 ceph-mon[34339]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:04 smithi134 ceph-mon[34525]: pgmap v273: 97 pgs: 1 creating+activating, 26 creating+peering, 16 active+clean, 54 unknown; 577 KiB data, 364 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:29:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:04 smithi134 ceph-mon[34525]: osdmap e81: 12 total, 12 up, 12 in 2024-09-19T04:29:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:04 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2412406919' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-09-19T04:29:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:04 smithi134 ceph-mon[34525]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-09-19T04:29:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:04 smithi134 ceph-mon[34525]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-09-19T04:29:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:04 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] up:active 2024-09-19T04:29:04.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:04 smithi134 ceph-mon[34525]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.853+0000 7f426fd93640 1 -- 172.21.15.70:0/3009178699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42681000d0 msgr2=0x7f4268100530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.853+0000 7f426fd93640 1 --2- 172.21.15.70:0/3009178699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42681000d0 0x7f4268100530 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f425c009900 tx=0x7f425c02a410 comp rx=0 tx=0).stop 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.853+0000 7f426fd93640 1 -- 172.21.15.70:0/3009178699 shutdown_connections 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.853+0000 7f426fd93640 1 --2- 172.21.15.70:0/3009178699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268100a70 0x7f426810ea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.853+0000 7f426fd93640 1 --2- 172.21.15.70:0/3009178699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f42681000d0 0x7f4268100530 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.853+0000 7f426fd93640 1 --2- 172.21.15.70:0/3009178699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4268106ba0 0x7f4268106f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.853+0000 7f426fd93640 1 -- 172.21.15.70:0/3009178699 >> 172.21.15.70:0/3009178699 conn(0x7f4268077210 msgr2=0x7f42680fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.853+0000 7f426fd93640 1 -- 172.21.15.70:0/3009178699 shutdown_connections 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 -- 172.21.15.70:0/3009178699 wait complete. 2024-09-19T04:29:04.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 Processor -- start 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 -- start start 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42681000d0 0x7f4268198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268100a70 0x7f4268198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4268106ba0 0x7f426819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42681120a0 con 0x7f4268106ba0 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4268111f20 con 0x7f42681000d0 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426fd93640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4268112220 con 0x7f4268100a70 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426e330640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4268106ba0 0x7f426819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426e330640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4268106ba0 0x7f426819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59562/0 (socket says 172.21.15.70:59562) 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.854+0000 7f426e330640 1 -- 172.21.15.70:0/2664260449 learned_addr learned my addr 172.21.15.70:0/2664260449 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:04.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426d32e640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268100a70 0x7f4268198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426db2f640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42681000d0 0x7f4268198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426e330640 1 -- 172.21.15.70:0/2664260449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268100a70 msgr2=0x7f4268198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426e330640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268100a70 0x7f4268198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426e330640 1 -- 172.21.15.70:0/2664260449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42681000d0 msgr2=0x7f4268198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426e330640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42681000d0 0x7f4268198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426e330640 1 -- 172.21.15.70:0/2664260449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f426819d4f0 con 0x7f4268106ba0 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426db2f640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42681000d0 0x7f4268198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426e330640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4268106ba0 0x7f426819ce10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f425800b970 tx=0x7f425800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f4266ffd640 1 -- 172.21.15.70:0/2664260449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258019070 con 0x7f4268106ba0 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f4266ffd640 1 -- 172.21.15.70:0/2664260449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f425800cb40 con 0x7f4268106ba0 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f426819d7e0 con 0x7f4268106ba0 2024-09-19T04:29:04.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f4266ffd640 1 -- 172.21.15.70:0/2664260449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4258007650 con 0x7f4268106ba0 2024-09-19T04:29:04.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.855+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42681a50c0 con 0x7f4268106ba0 2024-09-19T04:29:04.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.856+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4268100530 con 0x7f4268106ba0 2024-09-19T04:29:04.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.857+0000 7f4266ffd640 1 -- 172.21.15.70:0/2664260449 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f425801c070 con 0x7f4268106ba0 2024-09-19T04:29:04.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.858+0000 7f4266ffd640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f42500a3240 0x7f42500a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:04.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.858+0000 7f426db2f640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f42500a3240 0x7f42500a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:04.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.858+0000 7f4266ffd640 1 -- 172.21.15.70:0/2664260449 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f42580cede0 con 0x7f4268106ba0 2024-09-19T04:29:04.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.858+0000 7f426db2f640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f42500a3240 0x7f42500a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42600058c0 tx=0x7f4260005ec0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:04.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:04.862+0000 7f4266ffd640 1 -- 172.21.15.70:0/2664260449 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f425809b600 con 0x7f4268106ba0 2024-09-19T04:29:05.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.028+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f426810a080 con 0x7f4268106ba0 2024-09-19T04:29:05.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.030+0000 7f4266ffd640 1 -- 172.21.15.70:0/2664260449 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22293 (secure 0 0 0) 0x7f425809f900 con 0x7f4268106ba0 2024-09-19T04:29:05.032 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:05.032 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":81,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:29:02.988906+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:29:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.032+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f42500a3240 msgr2=0x7f42500a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.032+0000 7f426fd93640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f42500a3240 0x7f42500a5700 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f42600058c0 tx=0x7f4260005ec0 comp rx=0 tx=0).stop 2024-09-19T04:29:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.032+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4268106ba0 msgr2=0x7f426819ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.032+0000 7f426fd93640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4268106ba0 0x7f426819ce10 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f425800b970 tx=0x7f425800be30 comp rx=0 tx=0).stop 2024-09-19T04:29:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.033+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 shutdown_connections 2024-09-19T04:29:05.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.033+0000 7f426fd93640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f42500a3240 0x7f42500a5700 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.033+0000 7f426fd93640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4268106ba0 0x7f426819ce10 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.033+0000 7f426fd93640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4268100a70 0x7f4268198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.033+0000 7f426fd93640 1 --2- 172.21.15.70:0/2664260449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42681000d0 0x7f4268198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.033+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 >> 172.21.15.70:0/2664260449 conn(0x7f4268077210 msgr2=0x7f42680fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.033+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 shutdown_connections 2024-09-19T04:29:05.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:05.033+0000 7f426fd93640 1 -- 172.21.15.70:0/2664260449 wait complete. 2024-09-19T04:29:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:05 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2664260449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:05.694 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:29:05.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:05 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2664260449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:05.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:05 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2664260449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:05.939 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 -- 172.21.15.70:0/3295318454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102570 msgr2=0x7fcb641029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/3295318454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102570 0x7fcb641029b0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fcb58009900 tx=0x7fcb5802a480 comp rx=0 tx=0).stop 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 -- 172.21.15.70:0/3295318454 shutdown_connections 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/3295318454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb64102ef0 0x7fcb6410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/3295318454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102570 0x7fcb641029b0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/3295318454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb64100e20 0x7fcb64101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 -- 172.21.15.70:0/3295318454 >> 172.21.15.70:0/3295318454 conn(0x7fcb640fc7d0 msgr2=0x7fcb640febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 -- 172.21.15.70:0/3295318454 shutdown_connections 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.387+0000 7fcb6ad18640 1 -- 172.21.15.70:0/3295318454 wait complete. 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb6ad18640 1 Processor -- start 2024-09-19T04:29:06.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb6ad18640 1 -- start start 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb6ad18640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb64100e20 0x7fcb64199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb6ad18640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb64102570 0x7fcb64199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb6ad18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102ef0 0x7fcb641a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb6ad18640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcb64110fb0 con 0x7fcb64102ef0 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb6ad18640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcb64110e30 con 0x7fcb64100e20 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb6ad18640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcb64111130 con 0x7fcb64102570 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb692b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102ef0 0x7fcb641a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb692b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102ef0 0x7fcb641a44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59578/0 (socket says 172.21.15.70:59578) 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb692b5640 1 -- 172.21.15.70:0/268577639 learned_addr learned my addr 172.21.15.70:0/268577639 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb63fff640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb64102570 0x7fcb64199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.388+0000 7fcb68ab4640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb64100e20 0x7fcb64199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb692b5640 1 -- 172.21.15.70:0/268577639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb64102570 msgr2=0x7fcb64199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb692b5640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb64102570 0x7fcb64199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb692b5640 1 -- 172.21.15.70:0/268577639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb64100e20 msgr2=0x7fcb64199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb692b5640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb64100e20 0x7fcb64199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb692b5640 1 -- 172.21.15.70:0/268577639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcb641a4a00 con 0x7fcb64102ef0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb692b5640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102ef0 0x7fcb641a44c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00eaa0 tx=0x7fcb5c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb61ffb640 1 -- 172.21.15.70:0/268577639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c00cdb0 con 0x7fcb64102ef0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb61ffb640 1 -- 172.21.15.70:0/268577639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcb5c005020 con 0x7fcb64102ef0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcb641a4bd0 con 0x7fcb64102ef0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb61ffb640 1 -- 172.21.15.70:0/268577639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcb5c0116b0 con 0x7fcb64102ef0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.389+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcb641a5110 con 0x7fcb64102ef0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.390+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcb64101200 con 0x7fcb64102ef0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.391+0000 7fcb61ffb640 1 -- 172.21.15.70:0/268577639 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7fcb5c0051d0 con 0x7fcb64102ef0 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.392+0000 7fcb61ffb640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcb4c0a32c0 0x7fcb4c0a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.392+0000 7fcb68ab4640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcb4c0a32c0 0x7fcb4c0a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:06.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.392+0000 7fcb61ffb640 1 -- 172.21.15.70:0/268577639 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7fcb5c0cfa20 con 0x7fcb64102ef0 2024-09-19T04:29:06.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.392+0000 7fcb68ab4640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcb4c0a32c0 0x7fcb4c0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009890 tx=0x7fcb54008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:06.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.396+0000 7fcb61ffb640 1 -- 172.21.15.70:0/268577639 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcb5c016030 con 0x7fcb64102ef0 2024-09-19T04:29:06.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.564+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcb64109090 con 0x7fcb64102ef0 2024-09-19T04:29:06.566 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:06 smithi070 ceph-mon[30942]: pgmap v275: 97 pgs: 1 creating+activating, 6 creating+peering, 76 active+clean, 14 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s wr, 6 op/s 2024-09-19T04:29:06.566 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:06 smithi070 ceph-mon[30942]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:29:06.566 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:06 smithi070 ceph-mon[30942]: Cluster is now healthy 2024-09-19T04:29:06.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.566+0000 7fcb61ffb640 1 -- 172.21.15.70:0/268577639 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) ==== 74+0+22293 (secure 0 0 0) 0x7fcb5c09c890 con 0x7fcb64102ef0 2024-09-19T04:29:06.568 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:06.569 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":81,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:29:02.988906+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:29:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcb4c0a32c0 msgr2=0x7fcb4c0a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcb4c0a32c0 0x7fcb4c0a5780 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fcb54009890 tx=0x7fcb54008040 comp rx=0 tx=0).stop 2024-09-19T04:29:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102ef0 msgr2=0x7fcb641a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102ef0 0x7fcb641a44c0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fcb5c00eaa0 tx=0x7fcb5c00ef60 comp rx=0 tx=0).stop 2024-09-19T04:29:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 shutdown_connections 2024-09-19T04:29:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcb4c0a32c0 0x7fcb4c0a5780 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcb64102ef0 0x7fcb641a44c0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcb64102570 0x7fcb64199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 --2- 172.21.15.70:0/268577639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb64100e20 0x7fcb64199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 >> 172.21.15.70:0/268577639 conn(0x7fcb640fc7d0 msgr2=0x7fcb640febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 shutdown_connections 2024-09-19T04:29:06.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:06.569+0000 7fcb6ad18640 1 -- 172.21.15.70:0/268577639 wait complete. 2024-09-19T04:29:06.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:06 smithi167 ceph-mon[34339]: pgmap v275: 97 pgs: 1 creating+activating, 6 creating+peering, 76 active+clean, 14 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s wr, 6 op/s 2024-09-19T04:29:06.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:06 smithi167 ceph-mon[34339]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:29:06.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:06 smithi167 ceph-mon[34339]: Cluster is now healthy 2024-09-19T04:29:06.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:06 smithi134 ceph-mon[34525]: pgmap v275: 97 pgs: 1 creating+activating, 6 creating+peering, 76 active+clean, 14 unknown; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 818 B/s wr, 6 op/s 2024-09-19T04:29:06.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:06 smithi134 ceph-mon[34525]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-09-19T04:29:06.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:06 smithi134 ceph-mon[34525]: Cluster is now healthy 2024-09-19T04:29:07.243 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-09-19T04:29:07.494 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:07.699 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:07 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/268577639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:07.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:07 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/268577639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:07.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:07 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/268577639' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:07.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 -- 172.21.15.70:0/422786812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 msgr2=0x7ffb04101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:07.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/422786812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 0x7ffb04101200 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ffb00009900 tx=0x7ffb0002a480 comp rx=0 tx=0).stop 2024-09-19T04:29:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 -- 172.21.15.70:0/422786812 shutdown_connections 2024-09-19T04:29:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/422786812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb04102ef0 0x7ffb0410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/422786812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb04102570 0x7ffb041029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/422786812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 0x7ffb04101200 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:07.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 -- 172.21.15.70:0/422786812 >> 172.21.15.70:0/422786812 conn(0x7ffb040fc7d0 msgr2=0x7ffb040febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 -- 172.21.15.70:0/422786812 shutdown_connections 2024-09-19T04:29:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.910+0000 7ffb0c0db640 1 -- 172.21.15.70:0/422786812 wait complete. 2024-09-19T04:29:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0c0db640 1 Processor -- start 2024-09-19T04:29:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0c0db640 1 -- start start 2024-09-19T04:29:07.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0c0db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 0x7ffb040fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0c0db640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb04102570 0x7ffb040fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0c0db640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb04102ef0 0x7ffb040fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0c0db640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb04110f90 con 0x7ffb04100e20 2024-09-19T04:29:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0c0db640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb04110e10 con 0x7ffb04102570 2024-09-19T04:29:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0c0db640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb04111110 con 0x7ffb04102ef0 2024-09-19T04:29:07.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09e77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 0x7ffb040fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09e77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 0x7ffb040fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59598/0 (socket says 172.21.15.70:59598) 2024-09-19T04:29:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09e77640 1 -- 172.21.15.70:0/3699247678 learned_addr learned my addr 172.21.15.70:0/3699247678 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb0a678640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb04102ef0 0x7ffb040fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09676640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb04102570 0x7ffb040fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:07.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09e77640 1 -- 172.21.15.70:0/3699247678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb04102ef0 msgr2=0x7ffb040fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09e77640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb04102ef0 0x7ffb040fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09e77640 1 -- 172.21.15.70:0/3699247678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb04102570 msgr2=0x7ffb040fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09e77640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb04102570 0x7ffb040fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.911+0000 7ffb09e77640 1 -- 172.21.15.70:0/3699247678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb041a6a10 con 0x7ffb04100e20 2024-09-19T04:29:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.912+0000 7ffb09676640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb04102570 0x7ffb040fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:07.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.912+0000 7ffb09e77640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 0x7ffb040fcc80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb00005940 tx=0x7ffb00004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.912+0000 7ffafaffd640 1 -- 172.21.15.70:0/3699247678 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb0003f030 con 0x7ffb04100e20 2024-09-19T04:29:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.912+0000 7ffafaffd640 1 -- 172.21.15.70:0/3699247678 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ffb00003ac0 con 0x7ffb04100e20 2024-09-19T04:29:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.912+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb041a6ca0 con 0x7ffb04100e20 2024-09-19T04:29:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.912+0000 7ffafaffd640 1 -- 172.21.15.70:0/3699247678 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb00035070 con 0x7ffb04100e20 2024-09-19T04:29:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.912+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb041a7180 con 0x7ffb04100e20 2024-09-19T04:29:07.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.913+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb04101200 con 0x7ffb04100e20 2024-09-19T04:29:07.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.914+0000 7ffafaffd640 1 -- 172.21.15.70:0/3699247678 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7ffb00042030 con 0x7ffb04100e20 2024-09-19T04:29:07.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.915+0000 7ffafaffd640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffaf00a32c0 0x7ffaf00a5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:07.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.915+0000 7ffb09676640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffaf00a32c0 0x7ffaf00a5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.915+0000 7ffafaffd640 1 -- 172.21.15.70:0/3699247678 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7ffb000f01d0 con 0x7ffb04100e20 2024-09-19T04:29:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.915+0000 7ffb09676640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffaf00a32c0 0x7ffaf00a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4006fd0 tx=0x7ffaf4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:07.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:07.918+0000 7ffafaffd640 1 -- 172.21.15.70:0/3699247678 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb000bd040 con 0x7ffb04100e20 2024-09-19T04:29:08.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.122+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7ffb040fe1b0 con 0x7ffb04100e20 2024-09-19T04:29:08.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.419+0000 7ffafaffd640 1 -- 172.21.15.70:0/3699247678 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v16) ==== 118+0+0 (secure 0 0 0) 0x7ffb040fe1b0 con 0x7ffb04100e20 2024-09-19T04:29:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffaf00a32c0 msgr2=0x7ffaf00a5780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffaf00a32c0 0x7ffaf00a5780 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7ffaf4006fd0 tx=0x7ffaf4008040 comp rx=0 tx=0).stop 2024-09-19T04:29:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 msgr2=0x7ffb040fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 0x7ffb040fcc80 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7ffb00005940 tx=0x7ffb00004270 comp rx=0 tx=0).stop 2024-09-19T04:29:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 shutdown_connections 2024-09-19T04:29:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffaf00a32c0 0x7ffaf00a5780 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb04102ef0 0x7ffb040fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb04102570 0x7ffb040fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 --2- 172.21.15.70:0/3699247678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb04100e20 0x7ffb040fcc80 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 >> 172.21.15.70:0/3699247678 conn(0x7ffb040fc7d0 msgr2=0x7ffb0406a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.421+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 shutdown_connections 2024-09-19T04:29:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:08.422+0000 7ffb0c0db640 1 -- 172.21.15.70:0/3699247678 wait complete. 2024-09-19T04:29:08.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:08 smithi167 ceph-mon[34339]: pgmap v276: 97 pgs: 97 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-19T04:29:08.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:08 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3699247678' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:29:08.754 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:08 smithi070 ceph-mon[30942]: pgmap v276: 97 pgs: 97 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-19T04:29:08.754 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:08 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3699247678' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:29:08.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:08 smithi134 ceph-mon[34525]: pgmap v276: 97 pgs: 97 active+clean; 577 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 6 op/s 2024-09-19T04:29:08.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:08 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3699247678' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-09-19T04:29:08.785 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:29:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: 2024-09-19T04:29:08.454+0000 7f365e315640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-09-19T04:29:09.101 DEBUG:tasks.cephfs.filesystem:fs_config: {'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-09-19T04:29:09.101 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-09-19T04:29:09.347 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:09.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:09 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3699247678' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:29:09.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:09 smithi070 ceph-mon[30942]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:09.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:09 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3699247678' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:29:09.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:09 smithi167 ceph-mon[34339]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:09 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3699247678' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-09-19T04:29:09.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:09 smithi134 ceph-mon[34525]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 -- 172.21.15.70:0/2307181079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10103780 msgr2=0x7f3f10107bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:09.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 --2- 172.21.15.70:0/2307181079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10103780 0x7f3f10107bc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f3ef8009930 tx=0x7f3ef802a420 comp rx=0 tx=0).stop 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 -- 172.21.15.70:0/2307181079 shutdown_connections 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 --2- 172.21.15.70:0/2307181079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f10108300 0x7f3f1010ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 --2- 172.21.15.70:0/2307181079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10103780 0x7f3f10107bc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 --2- 172.21.15.70:0/2307181079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f10102dd0 0x7f3f101031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 -- 172.21.15.70:0/2307181079 >> 172.21.15.70:0/2307181079 conn(0x7f3f100fc7d0 msgr2=0x7f3f100febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 -- 172.21.15.70:0/2307181079 shutdown_connections 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 -- 172.21.15.70:0/2307181079 wait complete. 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 Processor -- start 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.790+0000 7f3f15f25640 1 -- start start 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f15f25640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f10102dd0 0x7f3f10198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f15f25640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f10103780 0x7f3f10198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:09.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f15f25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10108300 0x7f3f1019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f15f25640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f101120a0 con 0x7f3f10108300 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f15f25640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f10111f20 con 0x7f3f10102dd0 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f15f25640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f10112220 con 0x7f3f10103780 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10108300 0x7f3f1019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10108300 0x7f3f1019ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59610/0 (socket says 172.21.15.70:59610) 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 -- 172.21.15.70:0/8646185 learned_addr learned my addr 172.21.15.70:0/8646185 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0f7fe640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f10102dd0 0x7f3f10198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f07fff640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f10103780 0x7f3f10198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 -- 172.21.15.70:0/8646185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f10103780 msgr2=0x7f3f10198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f10103780 0x7f3f10198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 -- 172.21.15.70:0/8646185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f10102dd0 msgr2=0x7f3f10198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f10102dd0 0x7f3f10198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:09.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 -- 172.21.15.70:0/8646185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1019d4f0 con 0x7f3f10108300 2024-09-19T04:29:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0ffff640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10108300 0x7f3f1019ce10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800eaa0 tx=0x7f3f0800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0d7fa640 1 -- 172.21.15.70:0/8646185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08004d20 con 0x7f3f10108300 2024-09-19T04:29:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1019d7e0 con 0x7f3f10108300 2024-09-19T04:29:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.791+0000 7f3f0d7fa640 1 -- 172.21.15.70:0/8646185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3f08005020 con 0x7f3f10108300 2024-09-19T04:29:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.792+0000 7f3f0d7fa640 1 -- 172.21.15.70:0/8646185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f080116d0 con 0x7f3f10108300 2024-09-19T04:29:09.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.792+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f101a50c0 con 0x7f3f10108300 2024-09-19T04:29:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.792+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f101031b0 con 0x7f3f10108300 2024-09-19T04:29:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.794+0000 7f3f0d7fa640 1 -- 172.21.15.70:0/8646185 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3f080051d0 con 0x7f3f10108300 2024-09-19T04:29:09.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.794+0000 7f3f0d7fa640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3efc0a3240 0x7f3efc0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.794+0000 7f3f0f7fe640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3efc0a3240 0x7f3efc0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.794+0000 7f3f0d7fa640 1 -- 172.21.15.70:0/8646185 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f3f080cf8b0 con 0x7f3f10108300 2024-09-19T04:29:09.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.795+0000 7f3f0f7fe640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3efc0a3240 0x7f3efc0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000abe0 tx=0x7f3f0000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:09.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:09.798+0000 7f3f0d7fa640 1 -- 172.21.15.70:0/8646185 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f08016030 con 0x7f3f10108300 2024-09-19T04:29:10.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.003+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7f3f1010a2e0 con 0x7f3f10108300 2024-09-19T04:29:10.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.426+0000 7f3f0d7fa640 1 -- 172.21.15.70:0/8646185 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v17) ==== 105+0+0 (secure 0 0 0) 0x7f3f0809c720 con 0x7f3f10108300 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3efc0a3240 msgr2=0x7f3efc0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3efc0a3240 0x7f3efc0a5700 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3f0000abe0 tx=0x7f3f0000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10108300 msgr2=0x7f3f1019ce10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10108300 0x7f3f1019ce10 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800eaa0 tx=0x7f3f0800eea0 comp rx=0 tx=0).stop 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 shutdown_connections 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3efc0a3240 0x7f3efc0a5700 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f10108300 0x7f3f1019ce10 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f10103780 0x7f3f10198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 --2- 172.21.15.70:0/8646185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f10102dd0 0x7f3f10198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:10.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 >> 172.21.15.70:0/8646185 conn(0x7f3f100fc7d0 msgr2=0x7f3f10105dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:10.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 shutdown_connections 2024-09-19T04:29:10.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:10.428+0000 7f3f15f25640 1 -- 172.21.15.70:0/8646185 wait complete. 2024-09-19T04:29:10.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:10 smithi070 ceph-mon[30942]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T04:29:10.710 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:10 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/8646185' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T04:29:10.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:10 smithi167 ceph-mon[34339]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T04:29:10.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:10 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/8646185' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T04:29:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:10 smithi134 ceph-mon[34525]: pgmap v277: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s wr, 5 op/s 2024-09-19T04:29:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:10 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/8646185' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-09-19T04:29:11.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-09-19T04:29:11.383 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:11.708 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:11 smithi070 ceph-mon[30942]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T04:29:11.708 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:11 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/8646185' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T04:29:11.708 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:11 smithi070 ceph-mon[30942]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T04:29:11.708 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:11 smithi070 ceph-mon[30942]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:11.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:11 smithi070 ceph-mon[30942]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T04:29:11.709 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:11 smithi070 ceph-mon[30942]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T04:29:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:11 smithi167 ceph-mon[34339]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T04:29:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:11 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/8646185' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T04:29:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:11 smithi167 ceph-mon[34339]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T04:29:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:11 smithi167 ceph-mon[34339]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:11 smithi167 ceph-mon[34339]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T04:29:11.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:11 smithi167 ceph-mon[34339]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T04:29:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:11 smithi134 ceph-mon[34525]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-09-19T04:29:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:11 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/8646185' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-09-19T04:29:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:11 smithi134 ceph-mon[34525]: daemon mds.h assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-09-19T04:29:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:11 smithi134 ceph-mon[34525]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-09-19T04:29:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:11 smithi134 ceph-mon[34525]: fsmap cephfs:2 {0=b=up:active,1=h=up:creating} 10 up:standby 2024-09-19T04:29:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:11 smithi134 ceph-mon[34525]: daemon mds.h is now active in filesystem cephfs as rank 1 2024-09-19T04:29:11.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.882+0000 7efe1f458640 1 -- 172.21.15.70:0/1931172784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100e30 msgr2=0x7efe18104e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.882+0000 7efe1f458640 1 --2- 172.21.15.70:0/1931172784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100e30 0x7efe18104e80 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7efe08009900 tx=0x7efe0802a410 comp rx=0 tx=0).stop 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.882+0000 7efe1f458640 1 -- 172.21.15.70:0/1931172784 shutdown_connections 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.882+0000 7efe1f458640 1 --2- 172.21.15.70:0/1931172784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181055b0 0x7efe1810d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.882+0000 7efe1f458640 1 --2- 172.21.15.70:0/1931172784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100e30 0x7efe18104e80 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.882+0000 7efe1f458640 1 --2- 172.21.15.70:0/1931172784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18100480 0x7efe18100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.882+0000 7efe1f458640 1 -- 172.21.15.70:0/1931172784 >> 172.21.15.70:0/1931172784 conn(0x7efe18077210 msgr2=0x7efe180fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 -- 172.21.15.70:0/1931172784 shutdown_connections 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 -- 172.21.15.70:0/1931172784 wait complete. 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 Processor -- start 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 -- start start 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100480 0x7efe181970a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:11.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18100e30 0x7efe181975e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181055b0 0x7efe18197b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efe18110e60 con 0x7efe18100480 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe18110ce0 con 0x7efe18100e30 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1f458640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efe18110fe0 con 0x7efe181055b0 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1d1f4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100480 0x7efe181970a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1d1f4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100480 0x7efe181970a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59626/0 (socket says 172.21.15.70:59626) 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.883+0000 7efe1d1f4640 1 -- 172.21.15.70:0/2485473244 learned_addr learned my addr 172.21.15.70:0/2485473244 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1d9f5640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181055b0 0x7efe18197b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1c9f3640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18100e30 0x7efe181975e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1d1f4640 1 -- 172.21.15.70:0/2485473244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181055b0 msgr2=0x7efe18197b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1d1f4640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181055b0 0x7efe18197b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:11.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1d1f4640 1 -- 172.21.15.70:0/2485473244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18100e30 msgr2=0x7efe181975e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1d1f4640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18100e30 0x7efe181975e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1d1f4640 1 -- 172.21.15.70:0/2485473244 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe181a6910 con 0x7efe18100480 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1c9f3640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18100e30 0x7efe181975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1d9f5640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181055b0 0x7efe18197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1d1f4640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100480 0x7efe181970a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c920 tx=0x7efe1400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe0e7fc640 1 -- 172.21.15.70:0/2485473244 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14007c70 con 0x7efe18100480 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe181a6c00 con 0x7efe18100480 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe0e7fc640 1 -- 172.21.15.70:0/2485473244 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efe14007e10 con 0x7efe18100480 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe0e7fc640 1 -- 172.21.15.70:0/2485473244 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe14018800 con 0x7efe18100480 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.884+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe181a7140 con 0x7efe18100480 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.885+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe18100860 con 0x7efe18100480 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.886+0000 7efe0e7fc640 1 -- 172.21.15.70:0/2485473244 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7efe14018a00 con 0x7efe18100480 2024-09-19T04:29:11.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.887+0000 7efe0e7fc640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efe040a3240 0x7efe040a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:11.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.887+0000 7efe1c9f3640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efe040a3240 0x7efe040a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:11.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.887+0000 7efe0e7fc640 1 -- 172.21.15.70:0/2485473244 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7efe140cf9c0 con 0x7efe18100480 2024-09-19T04:29:11.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.887+0000 7efe1c9f3640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efe040a3240 0x7efe040a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efe08006010 tx=0x7efe08000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:11.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:11.891+0000 7efe0e7fc640 1 -- 172.21.15.70:0/2485473244 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe140d1e20 con 0x7efe18100480 2024-09-19T04:29:12.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.093+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7efe1802d7c0 con 0x7efe18100480 2024-09-19T04:29:12.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.444+0000 7efe0e7fc640 1 -- 172.21.15.70:0/2485473244 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v21) ==== 121+0+0 (secure 0 0 0) 0x7efe14014030 con 0x7efe18100480 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efe040a3240 msgr2=0x7efe040a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efe040a3240 0x7efe040a5700 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7efe08006010 tx=0x7efe08000bc0 comp rx=0 tx=0).stop 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100480 msgr2=0x7efe181970a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100480 0x7efe181970a0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7efe1400c920 tx=0x7efe1400cde0 comp rx=0 tx=0).stop 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 shutdown_connections 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efe040a3240 0x7efe040a5700 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe181055b0 0x7efe18197b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe18100e30 0x7efe181975e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 --2- 172.21.15.70:0/2485473244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe18100480 0x7efe181970a0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:12.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 >> 172.21.15.70:0/2485473244 conn(0x7efe18077210 msgr2=0x7efe18103e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:12.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 shutdown_connections 2024-09-19T04:29:12.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:12.448+0000 7efe1f458640 1 -- 172.21.15.70:0/2485473244 wait complete. 2024-09-19T04:29:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T04:29:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] up:active 2024-09-19T04:29:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T04:29:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T04:29:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: Cluster is now healthy 2024-09-19T04:29:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T04:29:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T04:29:12.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T04:29:12.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:12 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2485473244' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] up:active 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: Cluster is now healthy 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T04:29:12.746 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:12 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2485473244' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:29:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: pgmap v278: 97 pgs: 97 active+clean; 579 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.7 KiB/s wr, 5 op/s 2024-09-19T04:29:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] up:active 2024-09-19T04:29:12.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: daemon mds.i assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-09-19T04:29:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-09-19T04:29:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: Cluster is now healthy 2024-09-19T04:29:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: fsmap cephfs:2 {0=b=up:active,1=h=up:active} 10 up:standby 2024-09-19T04:29:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:creating} 9 up:standby 2024-09-19T04:29:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: daemon mds.i is now active in filesystem cephfs as rank 2 2024-09-19T04:29:12.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:12 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2485473244' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-09-19T04:29:13.084 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-09-19T04:29:13.332 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:13.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:13 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2485473244' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:29:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:13 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] up:active 2024-09-19T04:29:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:13 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T04:29:13.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:13 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:29:13.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:13 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2485473244' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:29:13.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:13 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] up:active 2024-09-19T04:29:13.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:13 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T04:29:13.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:13 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:29:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:13 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2485473244' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-09-19T04:29:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:13 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] up:active 2024-09-19T04:29:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:13 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 9 up:standby 2024-09-19T04:29:13.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:13 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:29:13.785 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:29:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: 2024-09-19T04:29:13.455+0000 7f365e315640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-09-19T04:29:13.786 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:29:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: 2024-09-19T04:29:13.455+0000 7f365e315640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-09-19T04:29:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 -- 172.21.15.70:0/3796049550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c101420 msgr2=0x7f694c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 --2- 172.21.15.70:0/3796049550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c101420 0x7f694c10d950 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f693c009930 tx=0x7f693c02a420 comp rx=0 tx=0).stop 2024-09-19T04:29:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 -- 172.21.15.70:0/3796049550 shutdown_connections 2024-09-19T04:29:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 --2- 172.21.15.70:0/3796049550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c101420 0x7f694c10d950 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 --2- 172.21.15.70:0/3796049550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c100a80 0x7f694c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 --2- 172.21.15.70:0/3796049550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f694c106a80 0x7f694c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:13.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 -- 172.21.15.70:0/3796049550 >> 172.21.15.70:0/3796049550 conn(0x7f694c0fc7a0 msgr2=0x7f694c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:13.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 -- 172.21.15.70:0/3796049550 shutdown_connections 2024-09-19T04:29:13.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.815+0000 7f695443f640 1 -- 172.21.15.70:0/3796049550 wait complete. 2024-09-19T04:29:13.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f695443f640 1 Processor -- start 2024-09-19T04:29:13.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f695443f640 1 -- start start 2024-09-19T04:29:13.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f695443f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c100a80 0x7f694c1974a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f695443f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f694c101420 0x7f694c1979e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f695443f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c106a80 0x7f694c19bd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f695443f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f694c110f60 con 0x7f694c100a80 2024-09-19T04:29:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f695443f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f694c110de0 con 0x7f694c101420 2024-09-19T04:29:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f695443f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f694c1110e0 con 0x7f694c106a80 2024-09-19T04:29:13.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f69521db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c100a80 0x7f694c1974a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f69521db640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c100a80 0x7f694c1974a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40328/0 (socket says 172.21.15.70:40328) 2024-09-19T04:29:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.816+0000 7f69521db640 1 -- 172.21.15.70:0/1226364001 learned_addr learned my addr 172.21.15.70:0/1226364001 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f69519da640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f694c101420 0x7f694c1979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f69529dc640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c106a80 0x7f694c19bd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f69521db640 1 -- 172.21.15.70:0/1226364001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c106a80 msgr2=0x7f694c19bd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f69521db640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c106a80 0x7f694c19bd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:13.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f69521db640 1 -- 172.21.15.70:0/1226364001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f694c101420 msgr2=0x7f694c1979e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f69521db640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f694c101420 0x7f694c1979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f69521db640 1 -- 172.21.15.70:0/1226364001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f694c19c450 con 0x7f694c100a80 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f69521db640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c100a80 0x7f694c1974a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f694400ba50 tx=0x7f694400bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f694b7fe640 1 -- 172.21.15.70:0/1226364001 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6944019070 con 0x7f694c100a80 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f694c19c740 con 0x7f694c100a80 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f694b7fe640 1 -- 172.21.15.70:0/1226364001 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f694400cbe0 con 0x7f694c100a80 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f694b7fe640 1 -- 172.21.15.70:0/1226364001 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69440075f0 con 0x7f694c100a80 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.817+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f694c1a4020 con 0x7f694c100a80 2024-09-19T04:29:13.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.818+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f694c100f60 con 0x7f694c100a80 2024-09-19T04:29:13.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.819+0000 7f694b7fe640 1 -- 172.21.15.70:0/1226364001 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f694401c070 con 0x7f694c100a80 2024-09-19T04:29:13.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.820+0000 7f694b7fe640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f69340a3240 0x7f69340a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:13.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.820+0000 7f69519da640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f69340a3240 0x7f69340a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:13.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.820+0000 7f694b7fe640 1 -- 172.21.15.70:0/1226364001 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f69440cee30 con 0x7f694c100a80 2024-09-19T04:29:13.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.820+0000 7f69519da640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f69340a3240 0x7f69340a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f694c0feda0 tx=0x7f6940008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:13.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:13.824+0000 7f694b7fe640 1 -- 172.21.15.70:0/1226364001 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f694409bca0 con 0x7f694c100a80 2024-09-19T04:29:14.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.026+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f694c109040 con 0x7f694c100a80 2024-09-19T04:29:14.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.453+0000 7f694b7fe640 1 -- 172.21.15.70:0/1226364001 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v23) ==== 115+0+0 (secure 0 0 0) 0x7f694409b5a0 con 0x7f694c100a80 2024-09-19T04:29:14.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.455+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f69340a3240 msgr2=0x7f69340a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:14.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.455+0000 7f695443f640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f69340a3240 0x7f69340a5700 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f694c0feda0 tx=0x7f6940008040 comp rx=0 tx=0).stop 2024-09-19T04:29:14.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.455+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c100a80 msgr2=0x7f694c1974a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:14.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.455+0000 7f695443f640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c100a80 0x7f694c1974a0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f694400ba50 tx=0x7f694400bf10 comp rx=0 tx=0).stop 2024-09-19T04:29:14.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.456+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 shutdown_connections 2024-09-19T04:29:14.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.456+0000 7f695443f640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f69340a3240 0x7f69340a5700 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:14.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.456+0000 7f695443f640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f694c106a80 0x7f694c19bd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:14.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.456+0000 7f695443f640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f694c101420 0x7f694c1979e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:14.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.456+0000 7f695443f640 1 --2- 172.21.15.70:0/1226364001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f694c100a80 0x7f694c1974a0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:14.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.456+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 >> 172.21.15.70:0/1226364001 conn(0x7f694c0fc7a0 msgr2=0x7f694c0fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:14.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.456+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 shutdown_connections 2024-09-19T04:29:14.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:14.456+0000 7f695443f640 1 -- 172.21.15.70:0/1226364001 wait complete. 2024-09-19T04:29:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:14 smithi134 ceph-mon[34525]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 409 B/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T04:29:14.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:14 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1226364001' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:29:14.819 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:14 smithi070 ceph-mon[30942]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 409 B/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T04:29:14.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:14 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1226364001' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:29:14.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:14 smithi167 ceph-mon[34339]: pgmap v279: 97 pgs: 97 active+clean; 580 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 409 B/s rd, 2.3 KiB/s wr, 8 op/s 2024-09-19T04:29:14.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:14 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1226364001' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-09-19T04:29:15.134 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-09-19T04:29:15.134 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-09-19T04:29:15.384 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:15.732 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:15 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1226364001' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:29:15.733 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:15 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:29:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:15 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1226364001' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:29:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:15 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:29:15.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 -- 172.21.15.70:0/1961515840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c102ef0 msgr2=0x7f9a7c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 --2- 172.21.15.70:0/1961515840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c102ef0 0x7f9a7c10da40 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f9a74009ca0 tx=0x7f9a7402a950 comp rx=0 tx=0).stop 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 -- 172.21.15.70:0/1961515840 shutdown_connections 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 --2- 172.21.15.70:0/1961515840 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c102ef0 0x7f9a7c10da40 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 --2- 172.21.15.70:0/1961515840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c102570 0x7f9a7c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 --2- 172.21.15.70:0/1961515840 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c100e20 0x7f9a7c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 -- 172.21.15.70:0/1961515840 >> 172.21.15.70:0/1961515840 conn(0x7f9a7c0fc7d0 msgr2=0x7f9a7c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 -- 172.21.15.70:0/1961515840 shutdown_connections 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.813+0000 7f9a83160640 1 -- 172.21.15.70:0/1961515840 wait complete. 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a83160640 1 Processor -- start 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a83160640 1 -- start start 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a83160640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c100e20 0x7f9a7c197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a83160640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c102570 0x7f9a7c197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:15.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a83160640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c102ef0 0x7f9a7c19bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a83160640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c110f50 con 0x7f9a7c100e20 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a83160640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c110dd0 con 0x7f9a7c102570 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a83160640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9a7c1110d0 con 0x7f9a7c102ef0 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a80efc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c100e20 0x7f9a7c197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a80efc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c100e20 0x7f9a7c197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40336/0 (socket says 172.21.15.70:40336) 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a80efc640 1 -- 172.21.15.70:0/3785263346 learned_addr learned my addr 172.21.15.70:0/3785263346 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.814+0000 7f9a816fd640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c102ef0 0x7f9a7c19bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a73fff640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c102570 0x7f9a7c197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a80efc640 1 -- 172.21.15.70:0/3785263346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c102ef0 msgr2=0x7f9a7c19bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a80efc640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c102ef0 0x7f9a7c19bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a80efc640 1 -- 172.21.15.70:0/3785263346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c102570 msgr2=0x7f9a7c197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:15.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a80efc640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c102570 0x7f9a7c197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a80efc640 1 -- 172.21.15.70:0/3785263346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9a7c19c2c0 con 0x7f9a7c100e20 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a73fff640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c102570 0x7f9a7c197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a80efc640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c100e20 0x7f9a7c197310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d770 tx=0x7f9a7800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a71ffb640 1 -- 172.21.15.70:0/3785263346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78017070 con 0x7f9a7c100e20 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a71ffb640 1 -- 172.21.15.70:0/3785263346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9a780054f0 con 0x7f9a7c100e20 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9a7c19c5b0 con 0x7f9a7c100e20 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a71ffb640 1 -- 172.21.15.70:0/3785263346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9a78004d60 con 0x7f9a7c100e20 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.815+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9a7c1a3e90 con 0x7f9a7c100e20 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.816+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9a7c101200 con 0x7f9a7c100e20 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.817+0000 7f9a71ffb640 1 -- 172.21.15.70:0/3785263346 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f9a78004f00 con 0x7f9a7c100e20 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.818+0000 7f9a71ffb640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9a640a3240 0x7f9a640a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.818+0000 7f9a73fff640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9a640a3240 0x7f9a640a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:15.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.818+0000 7f9a71ffb640 1 -- 172.21.15.70:0/3785263346 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f9a780cf310 con 0x7f9a7c100e20 2024-09-19T04:29:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.818+0000 7f9a73fff640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9a640a3240 0x7f9a640a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0fec10 tx=0x7f9a6c005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:15.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:15.822+0000 7f9a71ffb640 1 -- 172.21.15.70:0/3785263346 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9a7809c180 con 0x7f9a7c100e20 2024-09-19T04:29:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:15 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1226364001' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-09-19T04:29:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:15 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:29:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.012+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f9a7c106ee0 con 0x7f9a640a3240 2024-09-19T04:29:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.036+0000 7f9a71ffb640 1 -- 172.21.15.70:0/3785263346 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f9a7c106ee0 con 0x7f9a640a3240 2024-09-19T04:29:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9a640a3240 msgr2=0x7f9a640a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9a640a3240 0x7f9a640a5700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f9a7c0fec10 tx=0x7f9a6c005d90 comp rx=0 tx=0).stop 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c100e20 msgr2=0x7f9a7c197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c100e20 0x7f9a7c197310 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f9a7800d770 tx=0x7f9a7800dc30 comp rx=0 tx=0).stop 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 shutdown_connections 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9a640a3240 0x7f9a640a5700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9a7c102ef0 0x7f9a7c19bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a7c102570 0x7f9a7c197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 --2- 172.21.15.70:0/3785263346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9a7c100e20 0x7f9a7c197310 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 >> 172.21.15.70:0/3785263346 conn(0x7f9a7c0fc7d0 msgr2=0x7f9a7c1067d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 shutdown_connections 2024-09-19T04:29:16.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:16.038+0000 7f9a83160640 1 -- 172.21.15.70:0/3785263346 wait complete. 2024-09-19T04:29:16.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:29:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:29:16.017+0000 7f0b2f937640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:29:16.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:29:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:29:16.017+0000 7f0b2f937640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:29:16.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:29:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:29:16.017+0000 7f0b2f937640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:29:16.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:29:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:29:16.017+0000 7f0b2f937640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:29:16.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:29:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:29:16.017+0000 7f0b2f937640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:29:16.708 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:16 smithi070 ceph-mon[30942]: pgmap v280: 97 pgs: 97 active+clean; 581 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-19T04:29:16.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-09-19T04:29:16.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:16 smithi134 ceph-mon[34525]: pgmap v280: 97 pgs: 97 active+clean; 581 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-19T04:29:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:16 smithi167 ceph-mon[34339]: pgmap v280: 97 pgs: 97 active+clean; 581 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 KiB/s rd, 3.0 KiB/s wr, 11 op/s 2024-09-19T04:29:16.979 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:17.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 -- 172.21.15.70:0/754933321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 msgr2=0x7f3320100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:17.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 --2- 172.21.15.70:0/754933321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 0x7f3320100ee0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f3308009930 tx=0x7f330802a420 comp rx=0 tx=0).stop 2024-09-19T04:29:17.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 -- 172.21.15.70:0/754933321 shutdown_connections 2024-09-19T04:29:17.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 --2- 172.21.15.70:0/754933321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3320101420 0x7f332010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 --2- 172.21.15.70:0/754933321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 0x7f3320100ee0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 --2- 172.21.15.70:0/754933321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3320106a80 0x7f3320106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 -- 172.21.15.70:0/754933321 >> 172.21.15.70:0/754933321 conn(0x7f33200fc7a0 msgr2=0x7f33200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 -- 172.21.15.70:0/754933321 shutdown_connections 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.454+0000 7f332696b640 1 -- 172.21.15.70:0/754933321 wait complete. 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f332696b640 1 Processor -- start 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f332696b640 1 -- start start 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f332696b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 0x7f3320199460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f332696b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3320101420 0x7f33201999a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f332696b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3320106a80 0x7f33201a44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f332696b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3320110f10 con 0x7f3320100a80 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f332696b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3320110d90 con 0x7f3320106a80 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f332696b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3320111090 con 0x7f3320101420 2024-09-19T04:29:17.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f331ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 0x7f3320199460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f331ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 0x7f3320199460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40366/0 (socket says 172.21.15.70:40366) 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f331ffff640 1 -- 172.21.15.70:0/3064678762 learned_addr learned my addr 172.21.15.70:0/3064678762 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.455+0000 7f3324f08640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3320106a80 0x7f33201a44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331ffff640 1 -- 172.21.15.70:0/3064678762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3320101420 msgr2=0x7f33201999a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f3317fff640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3320101420 0x7f33201999a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331ffff640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3320101420 0x7f33201999a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331ffff640 1 -- 172.21.15.70:0/3064678762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3320106a80 msgr2=0x7f33201a44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331ffff640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3320106a80 0x7f33201a44e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331ffff640 1 -- 172.21.15.70:0/3064678762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33201a4a20 con 0x7f3320100a80 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f3324f08640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3320106a80 0x7f33201a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331ffff640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 0x7f3320199460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f331000b4a0 tx=0x7f331000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331dffb640 1 -- 172.21.15.70:0/3064678762 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310014070 con 0x7f3320100a80 2024-09-19T04:29:17.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331dffb640 1 -- 172.21.15.70:0/3064678762 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3310010ae0 con 0x7f3320100a80 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33201a4bf0 con 0x7f3320100a80 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f331dffb640 1 -- 172.21.15.70:0/3064678762 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3310017c70 con 0x7f3320100a80 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.456+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33201a50b0 con 0x7f3320100a80 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.457+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3320100f60 con 0x7f3320100a80 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.458+0000 7f331dffb640 1 -- 172.21.15.70:0/3064678762 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 16) ==== 138355+0+0 (secure 0 0 0) 0x7f3310017070 con 0x7f3320100a80 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.459+0000 7f331dffb640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f330c0a3240 0x7f330c0a5700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.459+0000 7f3317fff640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f330c0a3240 0x7f330c0a5700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.459+0000 7f331dffb640 1 -- 172.21.15.70:0/3064678762 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f33100cec40 con 0x7f3320100a80 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.459+0000 7f3317fff640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f330c0a3240 0x7f330c0a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f33080096c0 tx=0x7f3308005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:17.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.463+0000 7f331dffb640 1 -- 172.21.15.70:0/3064678762 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f331009bab0 con 0x7f3320100a80 2024-09-19T04:29:17.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.487+0000 7f331dffb640 1 -- 172.21.15.70:0/3064678762 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3310097a20 con 0x7f3320100a80 2024-09-19T04:29:17.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:17 smithi070 ceph-mon[30942]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:17.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-19T04:29:17.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-19T04:29:17.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-09-19T04:29:17.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T04:29:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T04:29:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T04:29:17.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:17 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T04:29:17.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.664+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f3320109080 con 0x7f330c0a3240 2024-09-19T04:29:17.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.689+0000 7f331dffb640 1 -- 172.21.15.70:0/3064678762 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f3308031510 con 0x7f330c0a3240 2024-09-19T04:29:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f330c0a3240 msgr2=0x7f330c0a5700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f330c0a3240 0x7f330c0a5700 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f33080096c0 tx=0x7f3308005fd0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 msgr2=0x7f3320199460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 0x7f3320199460 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f331000b4a0 tx=0x7f331000b960 comp rx=0 tx=0).stop 2024-09-19T04:29:17.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 shutdown_connections 2024-09-19T04:29:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f330c0a3240 0x7f330c0a5700 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3320106a80 0x7f33201a44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3320101420 0x7f33201999a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 --2- 172.21.15.70:0/3064678762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3320100a80 0x7f3320199460 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 >> 172.21.15.70:0/3064678762 conn(0x7f33200fc7a0 msgr2=0x7f33200fd0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 shutdown_connections 2024-09-19T04:29:17.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:17.691+0000 7f332696b640 1 -- 172.21.15.70:0/3064678762 wait complete. 2024-09-19T04:29:17.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:17 smithi134 ceph-mon[34525]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:17.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-19T04:29:17.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-19T04:29:17.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-09-19T04:29:17.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T04:29:17.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T04:29:17.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T04:29:17.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:17 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T04:29:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:17 smithi167 ceph-mon[34339]: from='client.14688 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]: dispatch 2024-09-19T04:29:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]: dispatch 2024-09-19T04:29:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]: dispatch 2024-09-19T04:29:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]: dispatch 2024-09-19T04:29:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]: dispatch 2024-09-19T04:29:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]: dispatch 2024-09-19T04:29:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:17 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]: dispatch 2024-09-19T04:29:18.373 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-09-19T04:29:18.628 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:18.748 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: pgmap v281: 97 pgs: 97 active+clean; 582 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:29:18.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:18 smithi070 ceph-mon[30942]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:29:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: pgmap v281: 97 pgs: 97 active+clean; 582 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T04:29:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-19T04:29:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-19T04:29:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-19T04:29:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T04:29:18.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T04:29:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T04:29:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T04:29:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:29:18.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:18 smithi134 ceph-mon[34525]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: pgmap v281: 97 pgs: 97 active+clean; 582 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 2.1 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.4", "id": [2, 11]}]': finished 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.5", "id": [8, 11]}]': finished 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [3, 6]}]': finished 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.20", "id": [5, 9]}]': finished 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.24", "id": [4, 9]}]': finished 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.34", "id": [4, 9]}]': finished 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3a", "id": [4, 8]}]': finished 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: osdmap e82: 12 total, 12 up, 12 in 2024-09-19T04:29:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:18 smithi167 ceph-mon[34339]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-09-19T04:29:19.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 -- 172.21.15.70:0/2679766515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 msgr2=0x7f6d841067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2679766515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 0x7f6d841067e0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009900 tx=0x7f6d8002a410 comp rx=0 tx=0).stop 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 -- 172.21.15.70:0/2679766515 shutdown_connections 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2679766515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d84106f10 0x7f6d8410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2679766515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 0x7f6d841067e0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2679766515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d84101de0 0x7f6d841021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 -- 172.21.15.70:0/2679766515 >> 172.21.15.70:0/2679766515 conn(0x7f6d840fd8c0 msgr2=0x7f6d840ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 -- 172.21.15.70:0/2679766515 shutdown_connections 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.114+0000 7f6d8c034640 1 -- 172.21.15.70:0/2679766515 wait complete. 2024-09-19T04:29:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8c034640 1 Processor -- start 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8c034640 1 -- start start 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8c034640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d84101de0 0x7f6d84198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8c034640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 0x7f6d84198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8c034640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d84106f10 0x7f6d8419ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8c034640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84111f80 con 0x7f6d84102790 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8c034640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84111e00 con 0x7f6d84101de0 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8c034640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84112100 con 0x7f6d84106f10 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d895cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 0x7f6d84198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d895cf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 0x7f6d84198a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40392/0 (socket says 172.21.15.70:40392) 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d895cf640 1 -- 172.21.15.70:0/2996946220 learned_addr learned my addr 172.21.15.70:0/2996946220 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d89dd0640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d84101de0 0x7f6d84198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d8a5d1640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d84106f10 0x7f6d8419ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d895cf640 1 -- 172.21.15.70:0/2996946220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d84106f10 msgr2=0x7f6d8419ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d895cf640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d84106f10 0x7f6d8419ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d895cf640 1 -- 172.21.15.70:0/2996946220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d84101de0 msgr2=0x7f6d84198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d895cf640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d84101de0 0x7f6d84198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d895cf640 1 -- 172.21.15.70:0/2996946220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d8419d4e0 con 0x7f6d84102790 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.115+0000 7f6d89dd0640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d84101de0 0x7f6d84198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.116+0000 7f6d895cf640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 0x7f6d84198a70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009a20 tx=0x7f6d800043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.116+0000 7f6d76ffd640 1 -- 172.21.15.70:0/2996946220 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d8003f030 con 0x7f6d84102790 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.116+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8419d770 con 0x7f6d84102790 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.116+0000 7f6d76ffd640 1 -- 172.21.15.70:0/2996946220 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6d80031b80 con 0x7f6d84102790 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.116+0000 7f6d76ffd640 1 -- 172.21.15.70:0/2996946220 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d80035070 con 0x7f6d84102790 2024-09-19T04:29:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.116+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d841a50b0 con 0x7f6d84102790 2024-09-19T04:29:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.117+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d841021c0 con 0x7f6d84102790 2024-09-19T04:29:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.118+0000 7f6d76ffd640 1 -- 172.21.15.70:0/2996946220 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6d800035f0 con 0x7f6d84102790 2024-09-19T04:29:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.118+0000 7f6d76ffd640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6d700a32d0 0x7f6d700a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.119+0000 7f6d89dd0640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6d700a32d0 0x7f6d700a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.119+0000 7f6d76ffd640 1 -- 172.21.15.70:0/2996946220 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f6d800f0630 con 0x7f6d84102790 2024-09-19T04:29:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.119+0000 7f6d89dd0640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6d700a32d0 0x7f6d700a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009930 tx=0x7f6d78008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.123+0000 7f6d76ffd640 1 -- 172.21.15.70:0/2996946220 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6d800bd220 con 0x7f6d84102790 2024-09-19T04:29:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.315+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f6d84062630 con 0x7f6d700a32d0 2024-09-19T04:29:19.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.320+0000 7f6d76ffd640 1 -- 172.21.15.70:0/2996946220 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f6d84062630 con 0x7f6d700a32d0 2024-09-19T04:29:19.322 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_0/3a651188-3a6f-40c4-92bf-62db8c710383 2024-09-19T04:29:19.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6d700a32d0 msgr2=0x7f6d700a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:19.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6d700a32d0 0x7f6d700a5790 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f6d78009930 tx=0x7f6d78008040 comp rx=0 tx=0).stop 2024-09-19T04:29:19.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 msgr2=0x7f6d84198a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:19.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 0x7f6d84198a70 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6d80009a20 tx=0x7f6d800043b0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 shutdown_connections 2024-09-19T04:29:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6d700a32d0 0x7f6d700a5790 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d84106f10 0x7f6d8419ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d84102790 0x7f6d84198a70 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 --2- 172.21.15.70:0/2996946220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d84101de0 0x7f6d84198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 >> 172.21.15.70:0/2996946220 conn(0x7f6d840fd8c0 msgr2=0x7f6d840fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 shutdown_connections 2024-09-19T04:29:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:19.322+0000 7f6d8c034640 1 -- 172.21.15.70:0/2996946220 wait complete. 2024-09-19T04:29:19.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:19 smithi070 ceph-mon[30942]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:19.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:19 smithi070 ceph-mon[30942]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:29:19.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:19 smithi134 ceph-mon[34525]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:19.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:19 smithi134 ceph-mon[34525]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:29:19.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:19 smithi167 ceph-mon[34339]: from='client.14700 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:19.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:19 smithi167 ceph-mon[34339]: osdmap e83: 12 total, 12 up, 12 in 2024-09-19T04:29:20.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-09-19T04:29:20.299 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:20.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:20 smithi070 ceph-mon[30942]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:20.672 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:20 smithi070 ceph-mon[30942]: pgmap v284: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-19T04:29:20.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 -- 172.21.15.70:0/2163828157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f810c180 msgr2=0x7f26f810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2163828157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f810c180 0x7f26f810e610 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f26e8009ca0 tx=0x7f26e802a950 comp rx=0 tx=0).stop 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 -- 172.21.15.70:0/2163828157 shutdown_connections 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2163828157 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f810c180 0x7f26f810e610 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2163828157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26f8103700 0x7f26f810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2163828157 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f8102de0 0x7f26f81031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 -- 172.21.15.70:0/2163828157 >> 172.21.15.70:0/2163828157 conn(0x7f26f80fc7a0 msgr2=0x7f26f80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 -- 172.21.15.70:0/2163828157 shutdown_connections 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.756+0000 7f26ff35a640 1 -- 172.21.15.70:0/2163828157 wait complete. 2024-09-19T04:29:20.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26ff35a640 1 Processor -- start 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26ff35a640 1 -- start start 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26ff35a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f8102de0 0x7f26f8198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26ff35a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26f8103700 0x7f26f8198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26ff35a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f810c180 0x7f26f819ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26ff35a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8112020 con 0x7f26f8102de0 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26ff35a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f26f8111ea0 con 0x7f26f8103700 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26ff35a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f26f81121a0 con 0x7f26f810c180 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd0f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f8102de0 0x7f26f8198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd0f6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f8102de0 0x7f26f8198540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40408/0 (socket says 172.21.15.70:40408) 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd0f6640 1 -- 172.21.15.70:0/2552534977 learned_addr learned my addr 172.21.15.70:0/2552534977 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fc8f5640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26f8103700 0x7f26f8198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:20.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd8f7640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f810c180 0x7f26f819ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd0f6640 1 -- 172.21.15.70:0/2552534977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f810c180 msgr2=0x7f26f819ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd0f6640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f810c180 0x7f26f819ce10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd0f6640 1 -- 172.21.15.70:0/2552534977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26f8103700 msgr2=0x7f26f8198a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd0f6640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26f8103700 0x7f26f8198a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fd0f6640 1 -- 172.21.15.70:0/2552534977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26f819d4f0 con 0x7f26f8102de0 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.757+0000 7f26fc8f5640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26f8103700 0x7f26f8198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.758+0000 7f26fd0f6640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f8102de0 0x7f26f8198540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b4a0 tx=0x7f26f000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.758+0000 7f26f67fc640 1 -- 172.21.15.70:0/2552534977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0014070 con 0x7f26f8102de0 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.758+0000 7f26f67fc640 1 -- 172.21.15.70:0/2552534977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f26f0010ae0 con 0x7f26f8102de0 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.758+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26f819d7e0 con 0x7f26f8102de0 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.758+0000 7f26f67fc640 1 -- 172.21.15.70:0/2552534977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26f0017c70 con 0x7f26f8102de0 2024-09-19T04:29:20.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.758+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26f8100970 con 0x7f26f8102de0 2024-09-19T04:29:20.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.759+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26f8103240 con 0x7f26f8102de0 2024-09-19T04:29:20.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.760+0000 7f26f67fc640 1 -- 172.21.15.70:0/2552534977 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f26f0017070 con 0x7f26f8102de0 2024-09-19T04:29:20.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.761+0000 7f26f67fc640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f26e00a32d0 0x7f26e00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:20.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.761+0000 7f26fc8f5640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f26e00a32d0 0x7f26e00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:20.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.761+0000 7f26f67fc640 1 -- 172.21.15.70:0/2552534977 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f26f00cf4f0 con 0x7f26f8102de0 2024-09-19T04:29:20.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.761+0000 7f26fc8f5640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f26e00a32d0 0x7f26e00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f26ec006fd0 tx=0x7f26ec008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:20.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.764+0000 7f26f67fc640 1 -- 172.21.15.70:0/2552534977 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26f009c1f0 con 0x7f26f8102de0 2024-09-19T04:29:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:20 smithi134 ceph-mon[34525]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:20 smithi134 ceph-mon[34525]: pgmap v284: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-19T04:29:20.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.954+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f26f81072b0 con 0x7f26e00a32d0 2024-09-19T04:29:20.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:20 smithi167 ceph-mon[34339]: from='client.14706 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:20.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:20 smithi167 ceph-mon[34339]: pgmap v284: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 4.0 KiB/s wr, 15 op/s 2024-09-19T04:29:20.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.982+0000 7f26f67fc640 1 -- 172.21.15.70:0/2552534977 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f26ec00ae20 con 0x7f26e00a32d0 2024-09-19T04:29:20.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f26e00a32d0 msgr2=0x7f26e00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:20.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f26e00a32d0 0x7f26e00a5790 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f26ec006fd0 tx=0x7f26ec008040 comp rx=0 tx=0).stop 2024-09-19T04:29:20.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f8102de0 msgr2=0x7f26f8198540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:20.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f8102de0 0x7f26f8198540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f26f000b4a0 tx=0x7f26f000b960 comp rx=0 tx=0).stop 2024-09-19T04:29:20.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 shutdown_connections 2024-09-19T04:29:20.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f26e00a32d0 0x7f26e00a5790 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f26f810c180 0x7f26f819ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26f8103700 0x7f26f8198a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 --2- 172.21.15.70:0/2552534977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f26f8102de0 0x7f26f8198540 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:20.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.984+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 >> 172.21.15.70:0/2552534977 conn(0x7f26f80fc7a0 msgr2=0x7f26f80fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:20.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.985+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 shutdown_connections 2024-09-19T04:29:20.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:20.985+0000 7f26ff35a640 1 -- 172.21.15.70:0/2552534977 wait complete. 2024-09-19T04:29:21.679 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-09-19T04:29:21.940 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:22.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 -- 172.21.15.70:0/1545115605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 msgr2=0x7f1148106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:22.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 --2- 172.21.15.70:0/1545115605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 0x7f1148106e60 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f1138009930 tx=0x7f113802a420 comp rx=0 tx=0).stop 2024-09-19T04:29:22.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 -- 172.21.15.70:0/1545115605 shutdown_connections 2024-09-19T04:29:22.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 --2- 172.21.15.70:0/1545115605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1148101420 0x7f114810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 --2- 172.21.15.70:0/1545115605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1148100a80 0x7f1148100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 --2- 172.21.15.70:0/1545115605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 0x7f1148106e60 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 -- 172.21.15.70:0/1545115605 >> 172.21.15.70:0/1545115605 conn(0x7f11480fc7a0 msgr2=0x7f11480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 -- 172.21.15.70:0/1545115605 shutdown_connections 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.412+0000 7f114e749640 1 -- 172.21.15.70:0/1545115605 wait complete. 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114e749640 1 Processor -- start 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114e749640 1 -- start start 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114e749640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1148100a80 0x7f1148198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114e749640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1148101420 0x7f1148198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114e749640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 0x7f114819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114e749640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1148110e50 con 0x7f1148106a80 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114e749640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1148110cd0 con 0x7f1148100a80 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114e749640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1148110fd0 con 0x7f1148101420 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114cce6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 0x7f114819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:22.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114cce6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 0x7f114819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40432/0 (socket says 172.21.15.70:40432) 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114cce6640 1 -- 172.21.15.70:0/452085810 learned_addr learned my addr 172.21.15.70:0/452085810 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f11477fe640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1148101420 0x7f1148198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114cce6640 1 -- 172.21.15.70:0/452085810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1148101420 msgr2=0x7f1148198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114cce6640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1148101420 0x7f1148198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f1147fff640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1148100a80 0x7f1148198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114cce6640 1 -- 172.21.15.70:0/452085810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1148100a80 msgr2=0x7f1148198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114cce6640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1148100a80 0x7f1148198430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.413+0000 7f114cce6640 1 -- 172.21.15.70:0/452085810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f114819d3e0 con 0x7f1148106a80 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.414+0000 7f114cce6640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 0x7f114819cd00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f114000cce0 tx=0x7f114000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.414+0000 7f11457fa640 1 -- 172.21.15.70:0/452085810 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f114000f450 con 0x7f1148106a80 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.414+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f114819d6d0 con 0x7f1148106a80 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.414+0000 7f11457fa640 1 -- 172.21.15.70:0/452085810 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f114000fac0 con 0x7f1148106a80 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.414+0000 7f11457fa640 1 -- 172.21.15.70:0/452085810 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1140018be0 con 0x7f1148106a80 2024-09-19T04:29:22.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.414+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f11481a4fb0 con 0x7f1148106a80 2024-09-19T04:29:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.415+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1148100ee0 con 0x7f1148106a80 2024-09-19T04:29:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.416+0000 7f11457fa640 1 -- 172.21.15.70:0/452085810 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f114000fc70 con 0x7f1148106a80 2024-09-19T04:29:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.417+0000 7f11457fa640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f11300a32d0 0x7f11300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.417+0000 7f1147fff640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f11300a32d0 0x7f11300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.417+0000 7f11457fa640 1 -- 172.21.15.70:0/452085810 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f11400d00f0 con 0x7f1148106a80 2024-09-19T04:29:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.417+0000 7f1147fff640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f11300a32d0 0x7f11300a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f11380096c0 tx=0x7f1138005fd0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:22.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.421+0000 7f11457fa640 1 -- 172.21.15.70:0/452085810 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1140014030 con 0x7f1148106a80 2024-09-19T04:29:22.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.619+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f1148062630 con 0x7f11300a32d0 2024-09-19T04:29:22.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:22 smithi070 ceph-mon[30942]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:22.621 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:22 smithi070 ceph-mon[30942]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:22.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.624+0000 7f11457fa640 1 -- 172.21.15.70:0/452085810 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f1148062630 con 0x7f11300a32d0 2024-09-19T04:29:22.625 INFO:teuthology.orchestra.run.smithi070.stdout:/volumes/qa/sv_1/c83b22ac-e902-41fa-958c-b2daba4cdeec 2024-09-19T04:29:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f11300a32d0 msgr2=0x7f11300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f11300a32d0 0x7f11300a5790 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f11380096c0 tx=0x7f1138005fd0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 msgr2=0x7f114819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 0x7f114819cd00 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f114000cce0 tx=0x7f114000a620 comp rx=0 tx=0).stop 2024-09-19T04:29:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 shutdown_connections 2024-09-19T04:29:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f11300a32d0 0x7f11300a5790 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1148106a80 0x7f114819cd00 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1148101420 0x7f1148198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 --2- 172.21.15.70:0/452085810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1148100a80 0x7f1148198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:22.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.626+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 >> 172.21.15.70:0/452085810 conn(0x7f11480fc7a0 msgr2=0x7f114806aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:22.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.627+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 shutdown_connections 2024-09-19T04:29:22.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:22.627+0000 7f114e749640 1 -- 172.21.15.70:0/452085810 wait complete. 2024-09-19T04:29:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:22 smithi134 ceph-mon[34525]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:22 smithi134 ceph-mon[34525]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:22.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:22 smithi167 ceph-mon[34339]: from='client.14712 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:22.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:22 smithi167 ceph-mon[34339]: pgmap v285: 97 pgs: 1 peering, 96 active+clean; 588 KiB data, 365 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 3.2 KiB/s wr, 13 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:23.323 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:29:23.571 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:24.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 -- 172.21.15.70:0/3154547791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 msgr2=0x7f1f3c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:24.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 --2- 172.21.15.70:0/3154547791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 0x7f1f3c10ea90 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f1f34009ca0 tx=0x7f1f3402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 -- 172.21.15.70:0/3154547791 shutdown_connections 2024-09-19T04:29:24.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 --2- 172.21.15.70:0/3154547791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 0x7f1f3c10ea90 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 --2- 172.21.15.70:0/3154547791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3c102790 0x7f1f3c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 --2- 172.21.15.70:0/3154547791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f3c101de0 0x7f1f3c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 -- 172.21.15.70:0/3154547791 >> 172.21.15.70:0/3154547791 conn(0x7f1f3c0fd8c0 msgr2=0x7f1f3c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 -- 172.21.15.70:0/3154547791 shutdown_connections 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.066+0000 7f1f43095640 1 -- 172.21.15.70:0/3154547791 wait complete. 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f43095640 1 Processor -- start 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f43095640 1 -- start start 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f43095640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3c101de0 0x7f1f3c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f43095640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f3c102790 0x7f1f3c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f43095640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 0x7f1f3c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f43095640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c111fa0 con 0x7f1f3c106f10 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f43095640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c111e20 con 0x7f1f3c102790 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f43095640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1f3c112120 con 0x7f1f3c101de0 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f41632640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 0x7f1f3c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:24.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f41632640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 0x7f1f3c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46028/0 (socket says 172.21.15.70:46028) 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f41632640 1 -- 172.21.15.70:0/3193253844 learned_addr learned my addr 172.21.15.70:0/3193253844 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f40e31640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3c101de0 0x7f1f3c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f3bfff640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f3c102790 0x7f1f3c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f41632640 1 -- 172.21.15.70:0/3193253844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3c101de0 msgr2=0x7f1f3c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f41632640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3c101de0 0x7f1f3c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f41632640 1 -- 172.21.15.70:0/3193253844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f3c102790 msgr2=0x7f1f3c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f41632640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f3c102790 0x7f1f3c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f41632640 1 -- 172.21.15.70:0/3193253844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1f3c1a6940 con 0x7f1f3c106f10 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.067+0000 7f1f3bfff640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f3c102790 0x7f1f3c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.068+0000 7f1f41632640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 0x7f1f3c074f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1f34033040 tx=0x7f1f34003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.068+0000 7f1f39ffb640 1 -- 172.21.15.70:0/3193253844 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f340316d0 con 0x7f1f3c106f10 2024-09-19T04:29:24.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.068+0000 7f1f39ffb640 1 -- 172.21.15.70:0/3193253844 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1f34031870 con 0x7f1f3c106f10 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.068+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1f3c1a6bd0 con 0x7f1f3c106f10 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.068+0000 7f1f39ffb640 1 -- 172.21.15.70:0/3193253844 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1f3402fbf0 con 0x7f1f3c106f10 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.068+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1f3c1a7160 con 0x7f1f3c106f10 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.069+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1f3c1021c0 con 0x7f1f3c106f10 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.070+0000 7f1f39ffb640 1 -- 172.21.15.70:0/3193253844 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f1f340046a0 con 0x7f1f3c106f10 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.071+0000 7f1f39ffb640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1f2c0a3350 0x7f1f2c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.071+0000 7f1f40e31640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1f2c0a3350 0x7f1f2c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.071+0000 7f1f39ffb640 1 -- 172.21.15.70:0/3193253844 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f1f340f0f80 con 0x7f1f3c106f10 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.071+0000 7f1f40e31640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1f2c0a3350 0x7f1f2c0a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009990 tx=0x7f1f30009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:24.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.075+0000 7f1f39ffb640 1 -- 172.21.15.70:0/3193253844 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1f340bdd20 con 0x7f1f3c106f10 2024-09-19T04:29:24.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.278+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1f3c10a0f0 con 0x7f1f3c106f10 2024-09-19T04:29:24.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.279+0000 7f1f39ffb640 1 -- 172.21.15.70:0/3193253844 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11914 (secure 0 0 0) 0x7f1f340098b0 con 0x7f1f3c106f10 2024-09-19T04:29:24.281 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:24.281 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"btime":"2024-09-19T04:29:14:453215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:29:14.027648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:29:24.281 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 23 2024-09-19T04:29:24.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.281+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1f2c0a3350 msgr2=0x7f1f2c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:24.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.281+0000 7f1f43095640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1f2c0a3350 0x7f1f2c0a5810 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f1f30009990 tx=0x7f1f30009110 comp rx=0 tx=0).stop 2024-09-19T04:29:24.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.281+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 msgr2=0x7f1f3c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:24.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.281+0000 7f1f43095640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 0x7f1f3c074f70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f1f34033040 tx=0x7f1f34003f10 comp rx=0 tx=0).stop 2024-09-19T04:29:24.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.281+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 shutdown_connections 2024-09-19T04:29:24.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.282+0000 7f1f43095640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f1f2c0a3350 0x7f1f2c0a5810 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.282+0000 7f1f43095640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1f3c106f10 0x7f1f3c074f70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.282+0000 7f1f43095640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f3c102790 0x7f1f3c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.282+0000 7f1f43095640 1 --2- 172.21.15.70:0/3193253844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1f3c101de0 0x7f1f3c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.282+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 >> 172.21.15.70:0/3193253844 conn(0x7f1f3c0fd8c0 msgr2=0x7f1f3c0fec90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.282+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 shutdown_connections 2024-09-19T04:29:24.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:24.282+0000 7f1f43095640 1 -- 172.21.15.70:0/3193253844 wait complete. 2024-09-19T04:29:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:24 smithi070 ceph-mon[30942]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:24 smithi070 ceph-mon[30942]: pgmap v286: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:24 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3193253844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:29:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:24 smithi134 ceph-mon[34525]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:24 smithi134 ceph-mon[34525]: pgmap v286: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:24 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3193253844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:29:24.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:29:24.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:24 smithi167 ceph-mon[34339]: from='client.14718 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:29:24.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:24 smithi167 ceph-mon[34339]: pgmap v286: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:24.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:24 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3193253844' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:29:25.182 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:25.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 -- 172.21.15.70:0/3856973221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c102d90 msgr2=0x7f089c103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:25.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 --2- 172.21.15.70:0/3856973221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c102d90 0x7f089c103170 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f0890009930 tx=0x7f089002a420 comp rx=0 tx=0).stop 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 -- 172.21.15.70:0/3856973221 shutdown_connections 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 --2- 172.21.15.70:0/3856973221 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c108290 0x7f089c10ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 --2- 172.21.15.70:0/3856973221 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c103740 0x7f089c107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 --2- 172.21.15.70:0/3856973221 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c102d90 0x7f089c103170 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 -- 172.21.15.70:0/3856973221 >> 172.21.15.70:0/3856973221 conn(0x7f089c0fc7d0 msgr2=0x7f089c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 -- 172.21.15.70:0/3856973221 shutdown_connections 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 -- 172.21.15.70:0/3856973221 wait complete. 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 Processor -- start 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.640+0000 7f08a3dce640 1 -- start start 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a3dce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c102d90 0x7f089c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a3dce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c103740 0x7f089c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:25.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a3dce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c108290 0x7f089c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a3dce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f089c112060 con 0x7f089c103740 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a3dce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f089c111ee0 con 0x7f089c102d90 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a3dce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f089c1121e0 con 0x7f089c108290 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c103740 0x7f089c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c103740 0x7f089c198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46044/0 (socket says 172.21.15.70:46044) 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 -- 172.21.15.70:0/2280805543 learned_addr learned my addr 172.21.15.70:0/2280805543 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1b6a640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c102d90 0x7f089c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a236b640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c108290 0x7f089c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 -- 172.21.15.70:0/2280805543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c108290 msgr2=0x7f089c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c108290 0x7f089c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 -- 172.21.15.70:0/2280805543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c102d90 msgr2=0x7f089c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:25.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c102d90 0x7f089c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 -- 172.21.15.70:0/2280805543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f089c19d550 con 0x7f089c103740 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a236b640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c108290 0x7f089c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1b6a640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c102d90 0x7f089c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a1369640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c103740 0x7f089c198ae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f089800d770 tx=0x7f089800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f088effd640 1 -- 172.21.15.70:0/2280805543 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0898017070 con 0x7f089c103740 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f089c19d840 con 0x7f089c103740 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f088effd640 1 -- 172.21.15.70:0/2280805543 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0898009c30 con 0x7f089c103740 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f088effd640 1 -- 172.21.15.70:0/2280805543 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089800f620 con 0x7f089c103740 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.641+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f089c1a5120 con 0x7f089c103740 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.642+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f089c06a7f0 con 0x7f089c103740 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.644+0000 7f088effd640 1 -- 172.21.15.70:0/2280805543 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f089801a070 con 0x7f089c103740 2024-09-19T04:29:25.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.644+0000 7f088effd640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08880a32d0 0x7f08880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:25.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.644+0000 7f088effd640 1 -- 172.21.15.70:0/2280805543 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f08980cf5b0 con 0x7f089c103740 2024-09-19T04:29:25.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.644+0000 7f08a1b6a640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08880a32d0 0x7f08880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:25.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.645+0000 7f08a1b6a640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08880a32d0 0x7f08880a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0890000c00 tx=0x7f0890005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:25.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.648+0000 7f088effd640 1 -- 172.21.15.70:0/2280805543 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0898009de0 con 0x7f089c103740 2024-09-19T04:29:25.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.813+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f089c10a2a0 con 0x7f089c103740 2024-09-19T04:29:25.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.816+0000 7f088effd640 1 -- 172.21.15.70:0/2280805543 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22679 (secure 0 0 0) 0x7f089809c1a0 con 0x7f089c103740 2024-09-19T04:29:25.817 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:25.818 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:29:18.471871+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:29:25.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08880a32d0 msgr2=0x7f08880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:25.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08880a32d0 0x7f08880a5790 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f0890000c00 tx=0x7f0890005a20 comp rx=0 tx=0).stop 2024-09-19T04:29:25.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c103740 msgr2=0x7f089c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:25.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c103740 0x7f089c198ae0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f089800d770 tx=0x7f089800dc30 comp rx=0 tx=0).stop 2024-09-19T04:29:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 shutdown_connections 2024-09-19T04:29:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f08880a32d0 0x7f08880a5790 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f089c108290 0x7f089c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f089c103740 0x7f089c198ae0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 --2- 172.21.15.70:0/2280805543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f089c102d90 0x7f089c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 >> 172.21.15.70:0/2280805543 conn(0x7f089c0fc7d0 msgr2=0x7f089c105db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 shutdown_connections 2024-09-19T04:29:25.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:25.818+0000 7f08a3dce640 1 -- 172.21.15.70:0/2280805543 wait complete. 2024-09-19T04:29:26.561 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T04:29:26.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:29:26.763 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:26 smithi167 ceph-mon[34339]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:26.763 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:26 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2280805543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:26.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:26 smithi134 ceph-mon[34525]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:26.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:26 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2280805543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:26.813 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:26.834 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:26 smithi070 ceph-mon[30942]: pgmap v287: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 8.7 KiB/s rd, 6.0 KiB/s wr, 10 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:26.834 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:26 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2280805543' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:27.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 -- 172.21.15.70:0/3538813175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0102d90 msgr2=0x7f70c0103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 --2- 172.21.15.70:0/3538813175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0102d90 0x7f70c0103170 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f70b0009930 tx=0x7f70b002a420 comp rx=0 tx=0).stop 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 -- 172.21.15.70:0/3538813175 shutdown_connections 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 --2- 172.21.15.70:0/3538813175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c0108290 0x7f70c010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 --2- 172.21.15.70:0/3538813175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70c0103740 0x7f70c0107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 --2- 172.21.15.70:0/3538813175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0102d90 0x7f70c0103170 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 -- 172.21.15.70:0/3538813175 >> 172.21.15.70:0/3538813175 conn(0x7f70c00fc7d0 msgr2=0x7f70c00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 -- 172.21.15.70:0/3538813175 shutdown_connections 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.259+0000 7f70c52a8640 1 -- 172.21.15.70:0/3538813175 wait complete. 2024-09-19T04:29:27.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.260+0000 7f70c52a8640 1 Processor -- start 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.260+0000 7f70c52a8640 1 -- start start 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.260+0000 7f70c52a8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70c0102d90 0x7f70c01009f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.260+0000 7f70c52a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0103740 0x7f70c0100f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.260+0000 7f70c52a8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c0108290 0x7f70c0101470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.260+0000 7f70c52a8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f70c0112140 con 0x7f70c0103740 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.260+0000 7f70c52a8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f70c0111fc0 con 0x7f70c0108290 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.260+0000 7f70c52a8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70c01122c0 con 0x7f70c0102d90 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0103740 0x7f70c0100f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0103740 0x7f70c0100f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46064/0 (socket says 172.21.15.70:46064) 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 -- 172.21.15.70:0/417080733 learned_addr learned my addr 172.21.15.70:0/417080733 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:27.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70beffd640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70c0102d90 0x7f70c01009f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70bf7fe640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c0108290 0x7f70c0101470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 -- 172.21.15.70:0/417080733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70c0102d90 msgr2=0x7f70c01009f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70c0102d90 0x7f70c01009f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 -- 172.21.15.70:0/417080733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c0108290 msgr2=0x7f70c0101470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c0108290 0x7f70c0101470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 -- 172.21.15.70:0/417080733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70c01a6be0 con 0x7f70c0103740 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70be7fc640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0103740 0x7f70c0100f30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70b400b450 tx=0x7f70b400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70a7fff640 1 -- 172.21.15.70:0/417080733 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b4015020 con 0x7f70c0103740 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70a7fff640 1 -- 172.21.15.70:0/417080733 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f70b4011d60 con 0x7f70c0103740 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70c01a6ed0 con 0x7f70c0103740 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.261+0000 7f70a7fff640 1 -- 172.21.15.70:0/417080733 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70b400f340 con 0x7f70c0103740 2024-09-19T04:29:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.262+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70c01a7330 con 0x7f70c0103740 2024-09-19T04:29:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.263+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70c006a7f0 con 0x7f70c0103740 2024-09-19T04:29:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.264+0000 7f70a7fff640 1 -- 172.21.15.70:0/417080733 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f70b4018020 con 0x7f70c0103740 2024-09-19T04:29:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.264+0000 7f70a7fff640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f70a80a32d0 0x7f70a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.264+0000 7f70beffd640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f70a80a32d0 0x7f70a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.264+0000 7f70a7fff640 1 -- 172.21.15.70:0/417080733 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f70b40cf480 con 0x7f70c0103740 2024-09-19T04:29:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.265+0000 7f70beffd640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f70a80a32d0 0x7f70a80a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f70b0005ec0 tx=0x7f70b00058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.268+0000 7f70a7fff640 1 -- 172.21.15.70:0/417080733 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70b401f020 con 0x7f70c0103740 2024-09-19T04:29:27.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.438+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f70c010a310 con 0x7f70a80a32d0 2024-09-19T04:29:27.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.445+0000 7f70a7fff640 1 -- 172.21.15.70:0/417080733 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258707 (secure 0 0 0) 0x7f70b0031510 con 0x7f70a80a32d0 2024-09-19T04:29:27.450 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:27.451 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f70a80a32d0 msgr2=0x7f70a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f70a80a32d0 0x7f70a80a5790 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f70b0005ec0 tx=0x7f70b00058d0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0103740 msgr2=0x7f70c0100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0103740 0x7f70c0100f30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f70b400b450 tx=0x7f70b400b910 comp rx=0 tx=0).stop 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 shutdown_connections 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f70a80a32d0 0x7f70a80a5790 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70c0108290 0x7f70c0101470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70c0103740 0x7f70c0100f30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 --2- 172.21.15.70:0/417080733 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70c0102d90 0x7f70c01009f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 >> 172.21.15.70:0/417080733 conn(0x7f70c00fc7d0 msgr2=0x7f70c0105df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 shutdown_connections 2024-09-19T04:29:27.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:27.449+0000 7f70c52a8640 1 -- 172.21.15.70:0/417080733 wait complete. 2024-09-19T04:29:28.189 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-19T04:29:27.391280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635670,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":231,"num_read_kb":214,"num_write":330,"num_write_kb":3025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374432,"kb_used_data":12688,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567392,"statfs":{"total":1151940427776,"available":1151557009408,"internally_reserved":0,"allocated":12992512,"data_stored":7201664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39687,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":70,"num_write":23,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.918695"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478067+0000","last_change":"2024-09-19T04:29:02.416257+0000","last_active":"2024-09-19T04:29:18.478067+0000","last_peered":"2024-09-19T04:29:18.478067+0000","last_clean":"2024-09-19T04:29:18.478067+0000","last_became_active":"2024-09-19T04:29:02.415681+0000","last_became_peered":"2024-09-19T04:29:02.415681+0000","last_unstale":"2024-09-19T04:29:18.478067+0000","last_undegraded":"2024-09-19T04:29:18.478067+0000","last_fullsized":"2024-09-19T04:29:18.478067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:31.765859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479437+0000","last_change":"2024-09-19T04:29:02.417591+0000","last_active":"2024-09-19T04:29:18.479437+0000","last_peered":"2024-09-19T04:29:18.479437+0000","last_clean":"2024-09-19T04:29:18.479437+0000","last_became_active":"2024-09-19T04:29:02.417277+0000","last_became_peered":"2024-09-19T04:29:02.417277+0000","last_unstale":"2024-09-19T04:29:18.479437+0000","last_undegraded":"2024-09-19T04:29:18.479437+0000","last_fullsized":"2024-09-19T04:29:18.479437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:22.680000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479531+0000","last_change":"2024-09-19T04:29:02.416270+0000","last_active":"2024-09-19T04:29:18.479531+0000","last_peered":"2024-09-19T04:29:18.479531+0000","last_clean":"2024-09-19T04:29:18.479531+0000","last_became_active":"2024-09-19T04:29:02.415878+0000","last_became_peered":"2024-09-19T04:29:02.415878+0000","last_unstale":"2024-09-19T04:29:18.479531+0000","last_undegraded":"2024-09-19T04:29:18.479531+0000","last_fullsized":"2024-09-19T04:29:18.479531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:25.302575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353266+0000","last_change":"2024-09-19T04:29:02.414586+0000","last_active":"2024-09-19T04:29:19.353266+0000","last_peered":"2024-09-19T04:29:19.353266+0000","last_clean":"2024-09-19T04:29:19.353266+0000","last_became_active":"2024-09-19T04:29:02.414267+0000","last_became_peered":"2024-09-19T04:29:02.414267+0000","last_unstale":"2024-09-19T04:29:19.353266+0000","last_undegraded":"2024-09-19T04:29:19.353266+0000","last_fullsized":"2024-09-19T04:29:19.353266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:01.436793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479997+0000","last_change":"2024-09-19T04:29:02.412243+0000","last_active":"2024-09-19T04:29:18.479997+0000","last_peered":"2024-09-19T04:29:18.479997+0000","last_clean":"2024-09-19T04:29:18.479997+0000","last_became_active":"2024-09-19T04:29:02.411411+0000","last_became_peered":"2024-09-19T04:29:02.411411+0000","last_unstale":"2024-09-19T04:29:18.479997+0000","last_undegraded":"2024-09-19T04:29:18.479997+0000","last_fullsized":"2024-09-19T04:29:18.479997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:21.966542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.482295+0000","last_change":"2024-09-19T04:29:18.482295+0000","last_active":"2024-09-19T04:29:18.482295+0000","last_peered":"2024-09-19T04:29:18.482295+0000","last_clean":"2024-09-19T04:29:18.482295+0000","last_became_active":"2024-09-19T04:29:18.481929+0000","last_became_peered":"2024-09-19T04:29:18.481929+0000","last_unstale":"2024-09-19T04:29:18.482295+0000","last_undegraded":"2024-09-19T04:29:18.482295+0000","last_fullsized":"2024-09-19T04:29:18.482295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:17.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352359+0000","last_change":"2024-09-19T04:29:02.418029+0000","last_active":"2024-09-19T04:29:19.352359+0000","last_peered":"2024-09-19T04:29:19.352359+0000","last_clean":"2024-09-19T04:29:19.352359+0000","last_became_active":"2024-09-19T04:29:02.417676+0000","last_became_peered":"2024-09-19T04:29:02.417676+0000","last_unstale":"2024-09-19T04:29:19.352359+0000","last_undegraded":"2024-09-19T04:29:19.352359+0000","last_fullsized":"2024-09-19T04:29:19.352359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:12:03.148693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351553+0000","last_change":"2024-09-19T04:29:02.406657+0000","last_active":"2024-09-19T04:29:19.351553+0000","last_peered":"2024-09-19T04:29:19.351553+0000","last_clean":"2024-09-19T04:29:19.351553+0000","last_became_active":"2024-09-19T04:29:02.406203+0000","last_became_peered":"2024-09-19T04:29:02.406203+0000","last_unstale":"2024-09-19T04:29:19.351553+0000","last_undegraded":"2024-09-19T04:29:19.351553+0000","last_fullsized":"2024-09-19T04:29:19.351553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:06.842516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475951+0000","last_change":"2024-09-19T04:29:02.426478+0000","last_active":"2024-09-19T04:29:18.475951+0000","last_peered":"2024-09-19T04:29:18.475951+0000","last_clean":"2024-09-19T04:29:18.475951+0000","last_became_active":"2024-09-19T04:29:02.425938+0000","last_became_peered":"2024-09-19T04:29:02.425938+0000","last_unstale":"2024-09-19T04:29:18.475951+0000","last_undegraded":"2024-09-19T04:29:18.475951+0000","last_fullsized":"2024-09-19T04:29:18.475951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:01.439087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476878+0000","last_change":"2024-09-19T04:29:02.423380+0000","last_active":"2024-09-19T04:29:18.476878+0000","last_peered":"2024-09-19T04:29:18.476878+0000","last_clean":"2024-09-19T04:29:18.476878+0000","last_became_active":"2024-09-19T04:29:02.422894+0000","last_became_peered":"2024-09-19T04:29:02.422894+0000","last_unstale":"2024-09-19T04:29:18.476878+0000","last_undegraded":"2024-09-19T04:29:18.476878+0000","last_fullsized":"2024-09-19T04:29:18.476878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:55.082196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352800+0000","last_change":"2024-09-19T04:29:02.419929+0000","last_active":"2024-09-19T04:29:19.352800+0000","last_peered":"2024-09-19T04:29:19.352800+0000","last_clean":"2024-09-19T04:29:19.352800+0000","last_became_active":"2024-09-19T04:29:02.419432+0000","last_became_peered":"2024-09-19T04:29:02.419432+0000","last_unstale":"2024-09-19T04:29:19.352800+0000","last_undegraded":"2024-09-19T04:29:19.352800+0000","last_fullsized":"2024-09-19T04:29:19.352800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:50:03.896524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481806+0000","last_change":"2024-09-19T04:29:18.481426+0000","last_active":"2024-09-19T04:29:18.481806+0000","last_peered":"2024-09-19T04:29:18.481806+0000","last_clean":"2024-09-19T04:29:18.481806+0000","last_became_active":"2024-09-19T04:29:18.481042+0000","last_became_peered":"2024-09-19T04:29:18.481042+0000","last_unstale":"2024-09-19T04:29:18.481806+0000","last_undegraded":"2024-09-19T04:29:18.481806+0000","last_fullsized":"2024-09-19T04:29:18.481806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:16.251818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478854+0000","last_change":"2024-09-19T04:29:02.405545+0000","last_active":"2024-09-19T04:29:18.478854+0000","last_peered":"2024-09-19T04:29:18.478854+0000","last_clean":"2024-09-19T04:29:18.478854+0000","last_became_active":"2024-09-19T04:29:02.405247+0000","last_became_peered":"2024-09-19T04:29:02.405247+0000","last_unstale":"2024-09-19T04:29:18.478854+0000","last_undegraded":"2024-09-19T04:29:18.478854+0000","last_fullsized":"2024-09-19T04:29:18.478854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:26.673842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478732+0000","last_change":"2024-09-19T04:29:02.420647+0000","last_active":"2024-09-19T04:29:18.478732+0000","last_peered":"2024-09-19T04:29:18.478732+0000","last_clean":"2024-09-19T04:29:18.478732+0000","last_became_active":"2024-09-19T04:29:02.420310+0000","last_became_peered":"2024-09-19T04:29:02.420310+0000","last_unstale":"2024-09-19T04:29:18.478732+0000","last_undegraded":"2024-09-19T04:29:18.478732+0000","last_fullsized":"2024-09-19T04:29:18.478732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:47.893734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478550+0000","last_change":"2024-09-19T04:29:02.419199+0000","last_active":"2024-09-19T04:29:18.478550+0000","last_peered":"2024-09-19T04:29:18.478550+0000","last_clean":"2024-09-19T04:29:18.478550+0000","last_became_active":"2024-09-19T04:29:02.418902+0000","last_became_peered":"2024-09-19T04:29:02.418902+0000","last_unstale":"2024-09-19T04:29:18.478550+0000","last_undegraded":"2024-09-19T04:29:18.478550+0000","last_fullsized":"2024-09-19T04:29:18.478550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:04.958933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475374+0000","last_change":"2024-09-19T04:29:02.415284+0000","last_active":"2024-09-19T04:29:18.475374+0000","last_peered":"2024-09-19T04:29:18.475374+0000","last_clean":"2024-09-19T04:29:18.475374+0000","last_became_active":"2024-09-19T04:29:02.414947+0000","last_became_peered":"2024-09-19T04:29:02.414947+0000","last_unstale":"2024-09-19T04:29:18.475374+0000","last_undegraded":"2024-09-19T04:29:18.475374+0000","last_fullsized":"2024-09-19T04:29:18.475374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:08.525325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478189+0000","last_change":"2024-09-19T04:29:02.422294+0000","last_active":"2024-09-19T04:29:18.478189+0000","last_peered":"2024-09-19T04:29:18.478189+0000","last_clean":"2024-09-19T04:29:18.478189+0000","last_became_active":"2024-09-19T04:29:02.421014+0000","last_became_peered":"2024-09-19T04:29:02.421014+0000","last_unstale":"2024-09-19T04:29:18.478189+0000","last_undegraded":"2024-09-19T04:29:18.478189+0000","last_fullsized":"2024-09-19T04:29:18.478189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:34.197168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474734+0000","last_change":"2024-09-19T04:29:02.415319+0000","last_active":"2024-09-19T04:29:18.474734+0000","last_peered":"2024-09-19T04:29:18.474734+0000","last_clean":"2024-09-19T04:29:18.474734+0000","last_became_active":"2024-09-19T04:29:02.415030+0000","last_became_peered":"2024-09-19T04:29:02.415030+0000","last_unstale":"2024-09-19T04:29:18.474734+0000","last_undegraded":"2024-09-19T04:29:18.474734+0000","last_fullsized":"2024-09-19T04:29:18.474734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:11.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478695+0000","last_change":"2024-09-19T04:29:02.415938+0000","last_active":"2024-09-19T04:29:18.478695+0000","last_peered":"2024-09-19T04:29:18.478695+0000","last_clean":"2024-09-19T04:29:18.478695+0000","last_became_active":"2024-09-19T04:29:02.411665+0000","last_became_peered":"2024-09-19T04:29:02.411665+0000","last_unstale":"2024-09-19T04:29:18.478695+0000","last_undegraded":"2024-09-19T04:29:18.478695+0000","last_fullsized":"2024-09-19T04:29:18.478695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:12.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477535+0000","last_change":"2024-09-19T04:29:02.417489+0000","last_active":"2024-09-19T04:29:18.477535+0000","last_peered":"2024-09-19T04:29:18.477535+0000","last_clean":"2024-09-19T04:29:18.477535+0000","last_became_active":"2024-09-19T04:29:02.417164+0000","last_became_peered":"2024-09-19T04:29:02.417164+0000","last_unstale":"2024-09-19T04:29:18.477535+0000","last_undegraded":"2024-09-19T04:29:18.477535+0000","last_fullsized":"2024-09-19T04:29:18.477535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:28.055517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478961+0000","last_change":"2024-09-19T04:29:02.407559+0000","last_active":"2024-09-19T04:29:18.478961+0000","last_peered":"2024-09-19T04:29:18.478961+0000","last_clean":"2024-09-19T04:29:18.478961+0000","last_became_active":"2024-09-19T04:29:02.407241+0000","last_became_peered":"2024-09-19T04:29:02.407241+0000","last_unstale":"2024-09-19T04:29:18.478961+0000","last_undegraded":"2024-09-19T04:29:18.478961+0000","last_fullsized":"2024-09-19T04:29:18.478961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:13.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475575+0000","last_change":"2024-09-19T04:29:02.418341+0000","last_active":"2024-09-19T04:29:18.475575+0000","last_peered":"2024-09-19T04:29:18.475575+0000","last_clean":"2024-09-19T04:29:18.475575+0000","last_became_active":"2024-09-19T04:29:02.418028+0000","last_became_peered":"2024-09-19T04:29:02.418028+0000","last_unstale":"2024-09-19T04:29:18.475575+0000","last_undegraded":"2024-09-19T04:29:18.475575+0000","last_fullsized":"2024-09-19T04:29:18.475575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:03.264803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351574+0000","last_change":"2024-09-19T04:29:02.419191+0000","last_active":"2024-09-19T04:29:19.351574+0000","last_peered":"2024-09-19T04:29:19.351574+0000","last_clean":"2024-09-19T04:29:19.351574+0000","last_became_active":"2024-09-19T04:29:02.418587+0000","last_became_peered":"2024-09-19T04:29:02.418587+0000","last_unstale":"2024-09-19T04:29:19.351574+0000","last_undegraded":"2024-09-19T04:29:19.351574+0000","last_fullsized":"2024-09-19T04:29:19.351574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:58.185492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627644+0000","last_change":"2024-09-19T04:29:02.407961+0000","last_active":"2024-09-19T04:29:18.627644+0000","last_peered":"2024-09-19T04:29:18.627644+0000","last_clean":"2024-09-19T04:29:18.627644+0000","last_became_active":"2024-09-19T04:29:02.406888+0000","last_became_peered":"2024-09-19T04:29:02.406888+0000","last_unstale":"2024-09-19T04:29:18.627644+0000","last_undegraded":"2024-09-19T04:29:18.627644+0000","last_fullsized":"2024-09-19T04:29:18.627644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:47.360605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351914+0000","last_change":"2024-09-19T04:29:02.415234+0000","last_active":"2024-09-19T04:29:19.351914+0000","last_peered":"2024-09-19T04:29:19.351914+0000","last_clean":"2024-09-19T04:29:19.351914+0000","last_became_active":"2024-09-19T04:29:02.414929+0000","last_became_peered":"2024-09-19T04:29:02.414929+0000","last_unstale":"2024-09-19T04:29:19.351914+0000","last_undegraded":"2024-09-19T04:29:19.351914+0000","last_fullsized":"2024-09-19T04:29:19.351914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:48.077114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478990+0000","last_change":"2024-09-19T04:29:02.416072+0000","last_active":"2024-09-19T04:29:18.478990+0000","last_peered":"2024-09-19T04:29:18.478990+0000","last_clean":"2024-09-19T04:29:18.478990+0000","last_became_active":"2024-09-19T04:29:02.415714+0000","last_became_peered":"2024-09-19T04:29:02.415714+0000","last_unstale":"2024-09-19T04:29:18.478990+0000","last_undegraded":"2024-09-19T04:29:18.478990+0000","last_fullsized":"2024-09-19T04:29:18.478990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:45.000850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477913+0000","last_change":"2024-09-19T04:29:02.426071+0000","last_active":"2024-09-19T04:29:18.477913+0000","last_peered":"2024-09-19T04:29:18.477913+0000","last_clean":"2024-09-19T04:29:18.477913+0000","last_became_active":"2024-09-19T04:29:02.425717+0000","last_became_peered":"2024-09-19T04:29:02.425717+0000","last_unstale":"2024-09-19T04:29:18.477913+0000","last_undegraded":"2024-09-19T04:29:18.477913+0000","last_fullsized":"2024-09-19T04:29:18.477913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:11.989191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481675+0000","last_change":"2024-09-19T04:29:18.481675+0000","last_active":"2024-09-19T04:29:18.481675+0000","last_peered":"2024-09-19T04:29:18.481675+0000","last_clean":"2024-09-19T04:29:18.481675+0000","last_became_active":"2024-09-19T04:29:18.481224+0000","last_became_peered":"2024-09-19T04:29:18.481224+0000","last_unstale":"2024-09-19T04:29:18.481675+0000","last_undegraded":"2024-09-19T04:29:18.481675+0000","last_fullsized":"2024-09-19T04:29:18.481675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:10.928554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479403+0000","last_change":"2024-09-19T04:29:02.413973+0000","last_active":"2024-09-19T04:29:18.479403+0000","last_peered":"2024-09-19T04:29:18.479403+0000","last_clean":"2024-09-19T04:29:18.479403+0000","last_became_active":"2024-09-19T04:29:02.413695+0000","last_became_peered":"2024-09-19T04:29:02.413695+0000","last_unstale":"2024-09-19T04:29:18.479403+0000","last_undegraded":"2024-09-19T04:29:18.479403+0000","last_fullsized":"2024-09-19T04:29:18.479403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:11.961493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478960+0000","last_change":"2024-09-19T04:29:02.413943+0000","last_active":"2024-09-19T04:29:18.478960+0000","last_peered":"2024-09-19T04:29:18.478960+0000","last_clean":"2024-09-19T04:29:18.478960+0000","last_became_active":"2024-09-19T04:29:02.411977+0000","last_became_peered":"2024-09-19T04:29:02.411977+0000","last_unstale":"2024-09-19T04:29:18.478960+0000","last_undegraded":"2024-09-19T04:29:18.478960+0000","last_fullsized":"2024-09-19T04:29:18.478960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:38.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478817+0000","last_change":"2024-09-19T04:29:02.420995+0000","last_active":"2024-09-19T04:29:18.478817+0000","last_peered":"2024-09-19T04:29:18.478817+0000","last_clean":"2024-09-19T04:29:18.478817+0000","last_became_active":"2024-09-19T04:29:02.420552+0000","last_became_peered":"2024-09-19T04:29:02.420552+0000","last_unstale":"2024-09-19T04:29:18.478817+0000","last_undegraded":"2024-09-19T04:29:18.478817+0000","last_fullsized":"2024-09-19T04:29:18.478817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:12.560776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481041+0000","last_change":"2024-09-19T04:29:18.481041+0000","last_active":"2024-09-19T04:29:18.481041+0000","last_peered":"2024-09-19T04:29:18.481041+0000","last_clean":"2024-09-19T04:29:18.481041+0000","last_became_active":"2024-09-19T04:29:18.480478+0000","last_became_peered":"2024-09-19T04:29:18.480478+0000","last_unstale":"2024-09-19T04:29:18.481041+0000","last_undegraded":"2024-09-19T04:29:18.481041+0000","last_fullsized":"2024-09-19T04:29:18.481041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480094+0000","last_change":"2024-09-19T04:29:02.411380+0000","last_active":"2024-09-19T04:29:18.480094+0000","last_peered":"2024-09-19T04:29:18.480094+0000","last_clean":"2024-09-19T04:29:18.480094+0000","last_became_active":"2024-09-19T04:29:02.410977+0000","last_became_peered":"2024-09-19T04:29:02.410977+0000","last_unstale":"2024-09-19T04:29:18.480094+0000","last_undegraded":"2024-09-19T04:29:18.480094+0000","last_fullsized":"2024-09-19T04:29:18.480094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.147856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:22.475503+0000","last_change":"2024-09-19T04:29:00.394886+0000","last_active":"2024-09-19T04:29:22.475503+0000","last_peered":"2024-09-19T04:29:22.475503+0000","last_clean":"2024-09-19T04:29:22.475503+0000","last_became_active":"2024-09-19T04:29:00.394412+0000","last_became_peered":"2024-09-19T04:29:00.394412+0000","last_unstale":"2024-09-19T04:29:22.475503+0000","last_undegraded":"2024-09-19T04:29:22.475503+0000","last_fullsized":"2024-09-19T04:29:22.475503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:43.929791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627230+0000","last_change":"2024-09-19T04:29:02.413258+0000","last_active":"2024-09-19T04:29:18.627230+0000","last_peered":"2024-09-19T04:29:18.627230+0000","last_clean":"2024-09-19T04:29:18.627230+0000","last_became_active":"2024-09-19T04:29:02.412887+0000","last_became_peered":"2024-09-19T04:29:02.412887+0000","last_unstale":"2024-09-19T04:29:18.627230+0000","last_undegraded":"2024-09-19T04:29:18.627230+0000","last_fullsized":"2024-09-19T04:29:18.627230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:26.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476972+0000","last_change":"2024-09-19T04:29:00.395696+0000","last_active":"2024-09-19T04:29:18.476972+0000","last_peered":"2024-09-19T04:29:18.476972+0000","last_clean":"2024-09-19T04:29:18.476972+0000","last_became_active":"2024-09-19T04:29:00.395363+0000","last_became_peered":"2024-09-19T04:29:00.395363+0000","last_unstale":"2024-09-19T04:29:18.476972+0000","last_undegraded":"2024-09-19T04:29:18.476972+0000","last_fullsized":"2024-09-19T04:29:18.476972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:50.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478415+0000","last_change":"2024-09-19T04:29:00.391765+0000","last_active":"2024-09-19T04:29:18.478415+0000","last_peered":"2024-09-19T04:29:18.478415+0000","last_clean":"2024-09-19T04:29:18.478415+0000","last_became_active":"2024-09-19T04:29:00.391412+0000","last_became_peered":"2024-09-19T04:29:00.391412+0000","last_unstale":"2024-09-19T04:29:18.478415+0000","last_undegraded":"2024-09-19T04:29:18.478415+0000","last_fullsized":"2024-09-19T04:29:18.478415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:27.423046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351584+0000","last_change":"2024-09-19T04:29:02.417820+0000","last_active":"2024-09-19T04:29:19.351584+0000","last_peered":"2024-09-19T04:29:19.351584+0000","last_clean":"2024-09-19T04:29:19.351584+0000","last_became_active":"2024-09-19T04:29:02.417452+0000","last_became_peered":"2024-09-19T04:29:02.417452+0000","last_unstale":"2024-09-19T04:29:19.351584+0000","last_undegraded":"2024-09-19T04:29:19.351584+0000","last_fullsized":"2024-09-19T04:29:19.351584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:34.767829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627792+0000","last_change":"2024-09-19T04:29:00.393075+0000","last_active":"2024-09-19T04:29:18.627792+0000","last_peered":"2024-09-19T04:29:18.627792+0000","last_clean":"2024-09-19T04:29:18.627792+0000","last_became_active":"2024-09-19T04:29:00.392695+0000","last_became_peered":"2024-09-19T04:29:00.392695+0000","last_unstale":"2024-09-19T04:29:18.627792+0000","last_undegraded":"2024-09-19T04:29:18.627792+0000","last_fullsized":"2024-09-19T04:29:18.627792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:43.122636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474573+0000","last_change":"2024-09-19T04:29:02.403886+0000","last_active":"2024-09-19T04:29:18.474573+0000","last_peered":"2024-09-19T04:29:18.474573+0000","last_clean":"2024-09-19T04:29:18.474573+0000","last_became_active":"2024-09-19T04:29:02.403530+0000","last_became_peered":"2024-09-19T04:29:02.403530+0000","last_unstale":"2024-09-19T04:29:18.474573+0000","last_undegraded":"2024-09-19T04:29:18.474573+0000","last_fullsized":"2024-09-19T04:29:18.474573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:57.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:21.473945+0000","last_change":"2024-09-19T04:29:00.390081+0000","last_active":"2024-09-19T04:29:21.473945+0000","last_peered":"2024-09-19T04:29:21.473945+0000","last_clean":"2024-09-19T04:29:21.473945+0000","last_became_active":"2024-09-19T04:29:00.389701+0000","last_became_peered":"2024-09-19T04:29:00.389701+0000","last_unstale":"2024-09-19T04:29:21.473945+0000","last_undegraded":"2024-09-19T04:29:21.473945+0000","last_fullsized":"2024-09-19T04:29:21.473945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:42.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475842+0000","last_change":"2024-09-19T04:29:02.424712+0000","last_active":"2024-09-19T04:29:18.475842+0000","last_peered":"2024-09-19T04:29:18.475842+0000","last_clean":"2024-09-19T04:29:18.475842+0000","last_became_active":"2024-09-19T04:29:02.424316+0000","last_became_peered":"2024-09-19T04:29:02.424316+0000","last_unstale":"2024-09-19T04:29:18.475842+0000","last_undegraded":"2024-09-19T04:29:18.475842+0000","last_fullsized":"2024-09-19T04:29:18.475842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:06:21.246473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352814+0000","last_change":"2024-09-19T04:29:00.396085+0000","last_active":"2024-09-19T04:29:19.352814+0000","last_peered":"2024-09-19T04:29:19.352814+0000","last_clean":"2024-09-19T04:29:19.352814+0000","last_became_active":"2024-09-19T04:29:00.395737+0000","last_became_peered":"2024-09-19T04:29:00.395737+0000","last_unstale":"2024-09-19T04:29:19.352814+0000","last_undegraded":"2024-09-19T04:29:19.352814+0000","last_fullsized":"2024-09-19T04:29:19.352814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:59.429917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479755+0000","last_change":"2024-09-19T04:29:02.412318+0000","last_active":"2024-09-19T04:29:18.479755+0000","last_peered":"2024-09-19T04:29:18.479755+0000","last_clean":"2024-09-19T04:29:18.479755+0000","last_became_active":"2024-09-19T04:29:02.412020+0000","last_became_peered":"2024-09-19T04:29:02.412020+0000","last_unstale":"2024-09-19T04:29:18.479755+0000","last_undegraded":"2024-09-19T04:29:18.479755+0000","last_fullsized":"2024-09-19T04:29:18.479755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:45.341633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627499+0000","last_change":"2024-09-19T04:29:00.507027+0000","last_active":"2024-09-19T04:29:18.627499+0000","last_peered":"2024-09-19T04:29:18.627499+0000","last_clean":"2024-09-19T04:29:18.627499+0000","last_became_active":"2024-09-19T04:29:00.506660+0000","last_became_peered":"2024-09-19T04:29:00.506660+0000","last_unstale":"2024-09-19T04:29:18.627499+0000","last_undegraded":"2024-09-19T04:29:18.627499+0000","last_fullsized":"2024-09-19T04:29:18.627499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:54.629719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475693+0000","last_change":"2024-09-19T04:29:02.415423+0000","last_active":"2024-09-19T04:29:18.475693+0000","last_peered":"2024-09-19T04:29:18.475693+0000","last_clean":"2024-09-19T04:29:18.475693+0000","last_became_active":"2024-09-19T04:29:02.415105+0000","last_became_peered":"2024-09-19T04:29:02.415105+0000","last_unstale":"2024-09-19T04:29:18.475693+0000","last_undegraded":"2024-09-19T04:29:18.475693+0000","last_fullsized":"2024-09-19T04:29:18.475693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:00.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'20","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:22.474572+0000","last_change":"2024-09-19T04:29:00.396021+0000","last_active":"2024-09-19T04:29:22.474572+0000","last_peered":"2024-09-19T04:29:22.474572+0000","last_clean":"2024-09-19T04:29:22.474572+0000","last_became_active":"2024-09-19T04:29:00.395649+0000","last_became_peered":"2024-09-19T04:29:00.395649+0000","last_unstale":"2024-09-19T04:29:22.474572+0000","last_undegraded":"2024-09-19T04:29:22.474572+0000","last_fullsized":"2024-09-19T04:29:22.474572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:56.800573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":53,"num_write":21,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480153+0000","last_change":"2024-09-19T04:29:02.416081+0000","last_active":"2024-09-19T04:29:18.480153+0000","last_peered":"2024-09-19T04:29:18.480153+0000","last_clean":"2024-09-19T04:29:18.480153+0000","last_became_active":"2024-09-19T04:29:02.415780+0000","last_became_peered":"2024-09-19T04:29:02.415780+0000","last_unstale":"2024-09-19T04:29:18.480153+0000","last_undegraded":"2024-09-19T04:29:18.480153+0000","last_fullsized":"2024-09-19T04:29:18.480153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:23.438141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479168+0000","last_change":"2024-09-19T04:29:00.396397+0000","last_active":"2024-09-19T04:29:18.479168+0000","last_peered":"2024-09-19T04:29:18.479168+0000","last_clean":"2024-09-19T04:29:18.479168+0000","last_became_active":"2024-09-19T04:29:00.395896+0000","last_became_peered":"2024-09-19T04:29:00.395896+0000","last_unstale":"2024-09-19T04:29:18.479168+0000","last_undegraded":"2024-09-19T04:29:18.479168+0000","last_fullsized":"2024-09-19T04:29:18.479168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:06.174262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478226+0000","last_change":"2024-09-19T04:29:02.408299+0000","last_active":"2024-09-19T04:29:18.478226+0000","last_peered":"2024-09-19T04:29:18.478226+0000","last_clean":"2024-09-19T04:29:18.478226+0000","last_became_active":"2024-09-19T04:29:02.407970+0000","last_became_peered":"2024-09-19T04:29:02.407970+0000","last_unstale":"2024-09-19T04:29:18.478226+0000","last_undegraded":"2024-09-19T04:29:18.478226+0000","last_fullsized":"2024-09-19T04:29:18.478226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:50.758517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627276+0000","last_change":"2024-09-19T04:29:00.393163+0000","last_active":"2024-09-19T04:29:18.627276+0000","last_peered":"2024-09-19T04:29:18.627276+0000","last_clean":"2024-09-19T04:29:18.627276+0000","last_became_active":"2024-09-19T04:29:00.392749+0000","last_became_peered":"2024-09-19T04:29:00.392749+0000","last_unstale":"2024-09-19T04:29:18.627276+0000","last_undegraded":"2024-09-19T04:29:18.627276+0000","last_fullsized":"2024-09-19T04:29:18.627276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:41.999124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352661+0000","last_change":"2024-09-19T04:29:02.412754+0000","last_active":"2024-09-19T04:29:19.352661+0000","last_peered":"2024-09-19T04:29:19.352661+0000","last_clean":"2024-09-19T04:29:19.352661+0000","last_became_active":"2024-09-19T04:29:02.412445+0000","last_became_peered":"2024-09-19T04:29:02.412445+0000","last_unstale":"2024-09-19T04:29:19.352661+0000","last_undegraded":"2024-09-19T04:29:19.352661+0000","last_fullsized":"2024-09-19T04:29:19.352661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:52:31.531672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:24.478544+0000","last_change":"2024-09-19T04:29:00.393863+0000","last_active":"2024-09-19T04:29:24.478544+0000","last_peered":"2024-09-19T04:29:24.478544+0000","last_clean":"2024-09-19T04:29:24.478544+0000","last_became_active":"2024-09-19T04:29:00.393502+0000","last_became_peered":"2024-09-19T04:29:00.393502+0000","last_unstale":"2024-09-19T04:29:24.478544+0000","last_undegraded":"2024-09-19T04:29:24.478544+0000","last_fullsized":"2024-09-19T04:29:24.478544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:26.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352213+0000","last_change":"2024-09-19T04:29:02.412624+0000","last_active":"2024-09-19T04:29:19.352213+0000","last_peered":"2024-09-19T04:29:19.352213+0000","last_clean":"2024-09-19T04:29:19.352213+0000","last_became_active":"2024-09-19T04:29:02.412299+0000","last_became_peered":"2024-09-19T04:29:02.412299+0000","last_unstale":"2024-09-19T04:29:19.352213+0000","last_undegraded":"2024-09-19T04:29:19.352213+0000","last_fullsized":"2024-09-19T04:29:19.352213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.062422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479881+0000","last_change":"2024-09-19T04:29:00.504931+0000","last_active":"2024-09-19T04:29:18.479881+0000","last_peered":"2024-09-19T04:29:18.479881+0000","last_clean":"2024-09-19T04:29:18.479881+0000","last_became_active":"2024-09-19T04:29:00.504526+0000","last_became_peered":"2024-09-19T04:29:00.504526+0000","last_unstale":"2024-09-19T04:29:18.479881+0000","last_undegraded":"2024-09-19T04:29:18.479881+0000","last_fullsized":"2024-09-19T04:29:18.479881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:31.096516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627169+0000","last_change":"2024-09-19T04:29:02.424492+0000","last_active":"2024-09-19T04:29:18.627169+0000","last_peered":"2024-09-19T04:29:18.627169+0000","last_clean":"2024-09-19T04:29:18.627169+0000","last_became_active":"2024-09-19T04:29:02.424013+0000","last_became_peered":"2024-09-19T04:29:02.424013+0000","last_unstale":"2024-09-19T04:29:18.627169+0000","last_undegraded":"2024-09-19T04:29:18.627169+0000","last_fullsized":"2024-09-19T04:29:18.627169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:41.021945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480275+0000","last_change":"2024-09-19T04:29:00.396707+0000","last_active":"2024-09-19T04:29:18.480275+0000","last_peered":"2024-09-19T04:29:18.480275+0000","last_clean":"2024-09-19T04:29:18.480275+0000","last_became_active":"2024-09-19T04:29:00.394876+0000","last_became_peered":"2024-09-19T04:29:00.394876+0000","last_unstale":"2024-09-19T04:29:18.480275+0000","last_undegraded":"2024-09-19T04:29:18.480275+0000","last_fullsized":"2024-09-19T04:29:18.480275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:06.648377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477755+0000","last_change":"2024-09-19T04:29:02.425106+0000","last_active":"2024-09-19T04:29:18.477755+0000","last_peered":"2024-09-19T04:29:18.477755+0000","last_clean":"2024-09-19T04:29:18.477755+0000","last_became_active":"2024-09-19T04:29:02.424597+0000","last_became_peered":"2024-09-19T04:29:02.424597+0000","last_unstale":"2024-09-19T04:29:18.477755+0000","last_undegraded":"2024-09-19T04:29:18.477755+0000","last_fullsized":"2024-09-19T04:29:18.477755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:02.998519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478154+0000","last_change":"2024-09-19T04:29:00.396369+0000","last_active":"2024-09-19T04:29:18.478154+0000","last_peered":"2024-09-19T04:29:18.478154+0000","last_clean":"2024-09-19T04:29:18.478154+0000","last_became_active":"2024-09-19T04:29:00.395980+0000","last_became_peered":"2024-09-19T04:29:00.395980+0000","last_unstale":"2024-09-19T04:29:18.478154+0000","last_undegraded":"2024-09-19T04:29:18.478154+0000","last_fullsized":"2024-09-19T04:29:18.478154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.941729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352958+0000","last_change":"2024-09-19T04:29:02.415771+0000","last_active":"2024-09-19T04:29:19.352958+0000","last_peered":"2024-09-19T04:29:19.352958+0000","last_clean":"2024-09-19T04:29:19.352958+0000","last_became_active":"2024-09-19T04:29:02.415404+0000","last_became_peered":"2024-09-19T04:29:02.415404+0000","last_unstale":"2024-09-19T04:29:19.352958+0000","last_undegraded":"2024-09-19T04:29:19.352958+0000","last_fullsized":"2024-09-19T04:29:19.352958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:04.509294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627625+0000","last_change":"2024-09-19T04:29:00.389015+0000","last_active":"2024-09-19T04:29:18.627625+0000","last_peered":"2024-09-19T04:29:18.627625+0000","last_clean":"2024-09-19T04:29:18.627625+0000","last_became_active":"2024-09-19T04:29:00.388621+0000","last_became_peered":"2024-09-19T04:29:00.388621+0000","last_unstale":"2024-09-19T04:29:18.627625+0000","last_undegraded":"2024-09-19T04:29:18.627625+0000","last_fullsized":"2024-09-19T04:29:18.627625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:49.509697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352821+0000","last_change":"2024-09-19T04:29:02.411379+0000","last_active":"2024-09-19T04:29:19.352821+0000","last_peered":"2024-09-19T04:29:19.352821+0000","last_clean":"2024-09-19T04:29:19.352821+0000","last_became_active":"2024-09-19T04:29:02.411069+0000","last_became_peered":"2024-09-19T04:29:02.411069+0000","last_unstale":"2024-09-19T04:29:19.352821+0000","last_undegraded":"2024-09-19T04:29:19.352821+0000","last_fullsized":"2024-09-19T04:29:19.352821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:10.953422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479146+0000","last_change":"2024-09-19T04:29:00.505088+0000","last_active":"2024-09-19T04:29:18.479146+0000","last_peered":"2024-09-19T04:29:18.479146+0000","last_clean":"2024-09-19T04:29:18.479146+0000","last_became_active":"2024-09-19T04:29:00.504734+0000","last_became_peered":"2024-09-19T04:29:00.504734+0000","last_unstale":"2024-09-19T04:29:18.479146+0000","last_undegraded":"2024-09-19T04:29:18.479146+0000","last_fullsized":"2024-09-19T04:29:18.479146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:38.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352950+0000","last_change":"2024-09-19T04:29:02.420752+0000","last_active":"2024-09-19T04:29:19.352950+0000","last_peered":"2024-09-19T04:29:19.352950+0000","last_clean":"2024-09-19T04:29:19.352950+0000","last_became_active":"2024-09-19T04:29:02.419136+0000","last_became_peered":"2024-09-19T04:29:02.419136+0000","last_unstale":"2024-09-19T04:29:19.352950+0000","last_undegraded":"2024-09-19T04:29:19.352950+0000","last_fullsized":"2024-09-19T04:29:19.352950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:40.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352515+0000","last_change":"2024-09-19T04:27:51.622607+0000","last_active":"2024-09-19T04:29:19.352515+0000","last_peered":"2024-09-19T04:29:19.352515+0000","last_clean":"2024-09-19T04:29:19.352515+0000","last_became_active":"2024-09-19T04:27:51.622000+0000","last_became_peered":"2024-09-19T04:27:51.622000+0000","last_unstale":"2024-09-19T04:29:19.352515+0000","last_undegraded":"2024-09-19T04:29:19.352515+0000","last_fullsized":"2024-09-19T04:29:19.352515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_clean_scrub_stamp":"2024-09-19T04:24:31.610268+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:20:05.335499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353048+0000","last_change":"2024-09-19T04:29:00.393618+0000","last_active":"2024-09-19T04:29:19.353048+0000","last_peered":"2024-09-19T04:29:19.353048+0000","last_clean":"2024-09-19T04:29:19.353048+0000","last_became_active":"2024-09-19T04:29:00.393248+0000","last_became_peered":"2024-09-19T04:29:00.393248+0000","last_unstale":"2024-09-19T04:29:19.353048+0000","last_undegraded":"2024-09-19T04:29:19.353048+0000","last_fullsized":"2024-09-19T04:29:19.353048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:35.271531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351694+0000","last_change":"2024-09-19T04:29:02.415147+0000","last_active":"2024-09-19T04:29:19.351694+0000","last_peered":"2024-09-19T04:29:19.351694+0000","last_clean":"2024-09-19T04:29:19.351694+0000","last_became_active":"2024-09-19T04:29:02.414275+0000","last_became_peered":"2024-09-19T04:29:02.414275+0000","last_unstale":"2024-09-19T04:29:19.351694+0000","last_undegraded":"2024-09-19T04:29:19.351694+0000","last_fullsized":"2024-09-19T04:29:19.351694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:32.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352368+0000","last_change":"2024-09-19T04:29:00.398007+0000","last_active":"2024-09-19T04:29:19.352368+0000","last_peered":"2024-09-19T04:29:19.352368+0000","last_clean":"2024-09-19T04:29:19.352368+0000","last_became_active":"2024-09-19T04:29:00.397644+0000","last_became_peered":"2024-09-19T04:29:00.397644+0000","last_unstale":"2024-09-19T04:29:19.352368+0000","last_undegraded":"2024-09-19T04:29:19.352368+0000","last_fullsized":"2024-09-19T04:29:19.352368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:34.476893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478405+0000","last_change":"2024-09-19T04:29:02.414957+0000","last_active":"2024-09-19T04:29:18.478405+0000","last_peered":"2024-09-19T04:29:18.478405+0000","last_clean":"2024-09-19T04:29:18.478405+0000","last_became_active":"2024-09-19T04:29:02.414641+0000","last_became_peered":"2024-09-19T04:29:02.414641+0000","last_unstale":"2024-09-19T04:29:18.478405+0000","last_undegraded":"2024-09-19T04:29:18.478405+0000","last_fullsized":"2024-09-19T04:29:18.478405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:18.824972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:23.476888+0000","last_change":"2024-09-19T04:29:00.504872+0000","last_active":"2024-09-19T04:29:23.476888+0000","last_peered":"2024-09-19T04:29:23.476888+0000","last_clean":"2024-09-19T04:29:23.476888+0000","last_became_active":"2024-09-19T04:29:00.504520+0000","last_became_peered":"2024-09-19T04:29:00.504520+0000","last_unstale":"2024-09-19T04:29:23.476888+0000","last_undegraded":"2024-09-19T04:29:23.476888+0000","last_fullsized":"2024-09-19T04:29:23.476888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:39.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627739+0000","last_change":"2024-09-19T04:29:02.416451+0000","last_active":"2024-09-19T04:29:18.627739+0000","last_peered":"2024-09-19T04:29:18.627739+0000","last_clean":"2024-09-19T04:29:18.627739+0000","last_became_active":"2024-09-19T04:29:02.415271+0000","last_became_peered":"2024-09-19T04:29:02.415271+0000","last_unstale":"2024-09-19T04:29:18.627739+0000","last_undegraded":"2024-09-19T04:29:18.627739+0000","last_fullsized":"2024-09-19T04:29:18.627739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:06.371572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352591+0000","last_change":"2024-09-19T04:29:00.390999+0000","last_active":"2024-09-19T04:29:19.352591+0000","last_peered":"2024-09-19T04:29:19.352591+0000","last_clean":"2024-09-19T04:29:19.352591+0000","last_became_active":"2024-09-19T04:29:00.390639+0000","last_became_peered":"2024-09-19T04:29:00.390639+0000","last_unstale":"2024-09-19T04:29:19.352591+0000","last_undegraded":"2024-09-19T04:29:19.352591+0000","last_fullsized":"2024-09-19T04:29:19.352591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:26.504171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476998+0000","last_change":"2024-09-19T04:29:02.419534+0000","last_active":"2024-09-19T04:29:18.476998+0000","last_peered":"2024-09-19T04:29:18.476998+0000","last_clean":"2024-09-19T04:29:18.476998+0000","last_became_active":"2024-09-19T04:29:02.419192+0000","last_became_peered":"2024-09-19T04:29:02.419192+0000","last_unstale":"2024-09-19T04:29:18.476998+0000","last_undegraded":"2024-09-19T04:29:18.476998+0000","last_fullsized":"2024-09-19T04:29:18.476998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:33.866859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480950+0000","last_change":"2024-09-19T04:29:18.480950+0000","last_active":"2024-09-19T04:29:18.480950+0000","last_peered":"2024-09-19T04:29:18.480950+0000","last_clean":"2024-09-19T04:29:18.480950+0000","last_became_active":"2024-09-19T04:29:18.480542+0000","last_became_peered":"2024-09-19T04:29:18.480542+0000","last_unstale":"2024-09-19T04:29:18.480950+0000","last_undegraded":"2024-09-19T04:29:18.480950+0000","last_fullsized":"2024-09-19T04:29:18.480950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.647586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476904+0000","last_change":"2024-09-19T04:29:02.415075+0000","last_active":"2024-09-19T04:29:18.476904+0000","last_peered":"2024-09-19T04:29:18.476904+0000","last_clean":"2024-09-19T04:29:18.476904+0000","last_became_active":"2024-09-19T04:29:02.414635+0000","last_became_peered":"2024-09-19T04:29:02.414635+0000","last_unstale":"2024-09-19T04:29:18.476904+0000","last_undegraded":"2024-09-19T04:29:18.476904+0000","last_fullsized":"2024-09-19T04:29:18.476904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:12.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.485631+0000","last_change":"2024-09-19T04:29:18.485218+0000","last_active":"2024-09-19T04:29:18.485631+0000","last_peered":"2024-09-19T04:29:18.485631+0000","last_clean":"2024-09-19T04:29:18.485631+0000","last_became_active":"2024-09-19T04:29:18.481618+0000","last_became_peered":"2024-09-19T04:29:18.481618+0000","last_unstale":"2024-09-19T04:29:18.485631+0000","last_undegraded":"2024-09-19T04:29:18.485631+0000","last_fullsized":"2024-09-19T04:29:18.485631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:26.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479189+0000","last_change":"2024-09-19T04:29:02.412647+0000","last_active":"2024-09-19T04:29:18.479189+0000","last_peered":"2024-09-19T04:29:18.479189+0000","last_clean":"2024-09-19T04:29:18.479189+0000","last_became_active":"2024-09-19T04:29:02.412014+0000","last_became_peered":"2024-09-19T04:29:02.412014+0000","last_unstale":"2024-09-19T04:29:18.479189+0000","last_undegraded":"2024-09-19T04:29:18.479189+0000","last_fullsized":"2024-09-19T04:29:18.479189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:32.341462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:21.411483+0000","last_change":"2024-09-19T04:29:00.397860+0000","last_active":"2024-09-19T04:29:21.411483+0000","last_peered":"2024-09-19T04:29:21.411483+0000","last_clean":"2024-09-19T04:29:21.411483+0000","last_became_active":"2024-09-19T04:29:00.397501+0000","last_became_peered":"2024-09-19T04:29:00.397501+0000","last_unstale":"2024-09-19T04:29:21.411483+0000","last_undegraded":"2024-09-19T04:29:21.411483+0000","last_fullsized":"2024-09-19T04:29:21.411483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:51.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351919+0000","last_change":"2024-09-19T04:29:02.418639+0000","last_active":"2024-09-19T04:29:19.351919+0000","last_peered":"2024-09-19T04:29:19.351919+0000","last_clean":"2024-09-19T04:29:19.351919+0000","last_became_active":"2024-09-19T04:29:02.418334+0000","last_became_peered":"2024-09-19T04:29:02.418334+0000","last_unstale":"2024-09-19T04:29:19.351919+0000","last_undegraded":"2024-09-19T04:29:19.351919+0000","last_fullsized":"2024-09-19T04:29:19.351919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.161642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353459+0000","last_change":"2024-09-19T04:29:00.504849+0000","last_active":"2024-09-19T04:29:19.353459+0000","last_peered":"2024-09-19T04:29:19.353459+0000","last_clean":"2024-09-19T04:29:19.353459+0000","last_became_active":"2024-09-19T04:29:00.504618+0000","last_became_peered":"2024-09-19T04:29:00.504618+0000","last_unstale":"2024-09-19T04:29:19.353459+0000","last_undegraded":"2024-09-19T04:29:19.353459+0000","last_fullsized":"2024-09-19T04:29:19.353459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:31.038078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.354455+0000","last_change":"2024-09-19T04:29:19.354455+0000","last_active":"2024-09-19T04:29:19.354455+0000","last_peered":"2024-09-19T04:29:19.354455+0000","last_clean":"2024-09-19T04:29:19.354455+0000","last_became_active":"2024-09-19T04:29:19.354062+0000","last_became_peered":"2024-09-19T04:29:19.354062+0000","last_unstale":"2024-09-19T04:29:19.354455+0000","last_undegraded":"2024-09-19T04:29:19.354455+0000","last_fullsized":"2024-09-19T04:29:19.354455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:17.134082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475475+0000","last_change":"2024-09-19T04:29:00.506294+0000","last_active":"2024-09-19T04:29:18.475475+0000","last_peered":"2024-09-19T04:29:18.475475+0000","last_clean":"2024-09-19T04:29:18.475475+0000","last_became_active":"2024-09-19T04:29:00.506028+0000","last_became_peered":"2024-09-19T04:29:00.506028+0000","last_unstale":"2024-09-19T04:29:18.475475+0000","last_undegraded":"2024-09-19T04:29:18.475475+0000","last_fullsized":"2024-09-19T04:29:18.475475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.972980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479845+0000","last_change":"2024-09-19T04:29:02.414995+0000","last_active":"2024-09-19T04:29:18.479845+0000","last_peered":"2024-09-19T04:29:18.479845+0000","last_clean":"2024-09-19T04:29:18.479845+0000","last_became_active":"2024-09-19T04:29:02.414675+0000","last_became_peered":"2024-09-19T04:29:02.414675+0000","last_unstale":"2024-09-19T04:29:18.479845+0000","last_undegraded":"2024-09-19T04:29:18.479845+0000","last_fullsized":"2024-09-19T04:29:18.479845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:40.466483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351703+0000","last_change":"2024-09-19T04:29:00.389510+0000","last_active":"2024-09-19T04:29:19.351703+0000","last_peered":"2024-09-19T04:29:19.351703+0000","last_clean":"2024-09-19T04:29:19.351703+0000","last_became_active":"2024-09-19T04:29:00.389222+0000","last_became_peered":"2024-09-19T04:29:00.389222+0000","last_unstale":"2024-09-19T04:29:19.351703+0000","last_undegraded":"2024-09-19T04:29:19.351703+0000","last_fullsized":"2024-09-19T04:29:19.351703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:00.290076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477405+0000","last_change":"2024-09-19T04:29:02.422356+0000","last_active":"2024-09-19T04:29:18.477405+0000","last_peered":"2024-09-19T04:29:18.477405+0000","last_clean":"2024-09-19T04:29:18.477405+0000","last_became_active":"2024-09-19T04:29:02.422037+0000","last_became_peered":"2024-09-19T04:29:02.422037+0000","last_unstale":"2024-09-19T04:29:18.477405+0000","last_undegraded":"2024-09-19T04:29:18.477405+0000","last_fullsized":"2024-09-19T04:29:18.477405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:40.192439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478547+0000","last_change":"2024-09-19T04:29:00.399188+0000","last_active":"2024-09-19T04:29:18.478547+0000","last_peered":"2024-09-19T04:29:18.478547+0000","last_clean":"2024-09-19T04:29:18.478547+0000","last_became_active":"2024-09-19T04:29:00.398880+0000","last_became_peered":"2024-09-19T04:29:00.398880+0000","last_unstale":"2024-09-19T04:29:18.478547+0000","last_undegraded":"2024-09-19T04:29:18.478547+0000","last_fullsized":"2024-09-19T04:29:18.478547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:55.581504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351701+0000","last_change":"2024-09-19T04:29:02.408174+0000","last_active":"2024-09-19T04:29:19.351701+0000","last_peered":"2024-09-19T04:29:19.351701+0000","last_clean":"2024-09-19T04:29:19.351701+0000","last_became_active":"2024-09-19T04:29:02.407822+0000","last_became_peered":"2024-09-19T04:29:02.407822+0000","last_unstale":"2024-09-19T04:29:19.351701+0000","last_undegraded":"2024-09-19T04:29:19.351701+0000","last_fullsized":"2024-09-19T04:29:19.351701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480127+0000","last_change":"2024-09-19T04:29:00.398445+0000","last_active":"2024-09-19T04:29:18.480127+0000","last_peered":"2024-09-19T04:29:18.480127+0000","last_clean":"2024-09-19T04:29:18.480127+0000","last_became_active":"2024-09-19T04:29:00.397923+0000","last_became_peered":"2024-09-19T04:29:00.397923+0000","last_unstale":"2024-09-19T04:29:18.480127+0000","last_undegraded":"2024-09-19T04:29:18.480127+0000","last_fullsized":"2024-09-19T04:29:18.480127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:32.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352593+0000","last_change":"2024-09-19T04:29:02.416685+0000","last_active":"2024-09-19T04:29:19.352593+0000","last_peered":"2024-09-19T04:29:19.352593+0000","last_clean":"2024-09-19T04:29:19.352593+0000","last_became_active":"2024-09-19T04:29:02.416311+0000","last_became_peered":"2024-09-19T04:29:02.416311+0000","last_unstale":"2024-09-19T04:29:19.352593+0000","last_undegraded":"2024-09-19T04:29:19.352593+0000","last_fullsized":"2024-09-19T04:29:19.352593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:47.988318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627371+0000","last_change":"2024-09-19T04:29:02.424585+0000","last_active":"2024-09-19T04:29:18.627371+0000","last_peered":"2024-09-19T04:29:18.627371+0000","last_clean":"2024-09-19T04:29:18.627371+0000","last_became_active":"2024-09-19T04:29:02.424253+0000","last_became_peered":"2024-09-19T04:29:02.424253+0000","last_unstale":"2024-09-19T04:29:18.627371+0000","last_undegraded":"2024-09-19T04:29:18.627371+0000","last_fullsized":"2024-09-19T04:29:18.627371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:55.865599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480500+0000","last_change":"2024-09-19T04:29:00.396490+0000","last_active":"2024-09-19T04:29:18.480500+0000","last_peered":"2024-09-19T04:29:18.480500+0000","last_clean":"2024-09-19T04:29:18.480500+0000","last_became_active":"2024-09-19T04:29:00.394727+0000","last_became_peered":"2024-09-19T04:29:00.394727+0000","last_unstale":"2024-09-19T04:29:18.480500+0000","last_undegraded":"2024-09-19T04:29:18.480500+0000","last_fullsized":"2024-09-19T04:29:18.480500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:43.724257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475575+0000","last_change":"2024-09-19T04:29:02.425557+0000","last_active":"2024-09-19T04:29:18.475575+0000","last_peered":"2024-09-19T04:29:18.475575+0000","last_clean":"2024-09-19T04:29:18.475575+0000","last_became_active":"2024-09-19T04:29:02.425261+0000","last_became_peered":"2024-09-19T04:29:02.425261+0000","last_unstale":"2024-09-19T04:29:18.475575+0000","last_undegraded":"2024-09-19T04:29:18.475575+0000","last_fullsized":"2024-09-19T04:29:18.475575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:20.204026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480250+0000","last_change":"2024-09-19T04:29:00.397849+0000","last_active":"2024-09-19T04:29:18.480250+0000","last_peered":"2024-09-19T04:29:18.480250+0000","last_clean":"2024-09-19T04:29:18.480250+0000","last_became_active":"2024-09-19T04:29:00.397226+0000","last_became_peered":"2024-09-19T04:29:00.397226+0000","last_unstale":"2024-09-19T04:29:18.480250+0000","last_undegraded":"2024-09-19T04:29:18.480250+0000","last_fullsized":"2024-09-19T04:29:18.480250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:04.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479555+0000","last_change":"2024-09-19T04:29:02.416202+0000","last_active":"2024-09-19T04:29:18.479555+0000","last_peered":"2024-09-19T04:29:18.479555+0000","last_clean":"2024-09-19T04:29:18.479555+0000","last_became_active":"2024-09-19T04:29:02.415886+0000","last_became_peered":"2024-09-19T04:29:02.415886+0000","last_unstale":"2024-09-19T04:29:18.479555+0000","last_undegraded":"2024-09-19T04:29:18.479555+0000","last_fullsized":"2024-09-19T04:29:18.479555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:06.217254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352054+0000","last_change":"2024-09-19T04:29:00.505162+0000","last_active":"2024-09-19T04:29:19.352054+0000","last_peered":"2024-09-19T04:29:19.352054+0000","last_clean":"2024-09-19T04:29:19.352054+0000","last_became_active":"2024-09-19T04:29:00.504584+0000","last_became_peered":"2024-09-19T04:29:00.504584+0000","last_unstale":"2024-09-19T04:29:19.352054+0000","last_undegraded":"2024-09-19T04:29:19.352054+0000","last_fullsized":"2024-09-19T04:29:19.352054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:44.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351873+0000","last_change":"2024-09-19T04:29:02.415095+0000","last_active":"2024-09-19T04:29:19.351873+0000","last_peered":"2024-09-19T04:29:19.351873+0000","last_clean":"2024-09-19T04:29:19.351873+0000","last_became_active":"2024-09-19T04:29:02.414576+0000","last_became_peered":"2024-09-19T04:29:02.414576+0000","last_unstale":"2024-09-19T04:29:19.351873+0000","last_undegraded":"2024-09-19T04:29:19.351873+0000","last_fullsized":"2024-09-19T04:29:19.351873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:52.744011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474926+0000","last_change":"2024-09-19T04:29:00.397737+0000","last_active":"2024-09-19T04:29:18.474926+0000","last_peered":"2024-09-19T04:29:18.474926+0000","last_clean":"2024-09-19T04:29:18.474926+0000","last_became_active":"2024-09-19T04:29:00.397397+0000","last_became_peered":"2024-09-19T04:29:00.397397+0000","last_unstale":"2024-09-19T04:29:18.474926+0000","last_undegraded":"2024-09-19T04:29:18.474926+0000","last_fullsized":"2024-09-19T04:29:18.474926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:49:16.108744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45068,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":147,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":440869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712424,"statfs":{"total":95995035648,"available":95961522176,"internally_reserved":0,"allocated":1581056,"data_stored":1073786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972378,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":440981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1032935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":440472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1527808,"data_stored":1032226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":441302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":440783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":488417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":487067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":441743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:29:28.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:29:28.439 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:28 smithi134 ceph-mon[34525]: pgmap v288: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 KiB/s wr, 8 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:28 smithi134 ceph-mon[34525]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:29:28.821 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:28 smithi070 ceph-mon[30942]: pgmap v288: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 KiB/s wr, 8 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:28.821 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:28 smithi070 ceph-mon[30942]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 -- 172.21.15.70:0/1348108531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 msgr2=0x7f26301067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1348108531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 0x7f26301067e0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f2620009900 tx=0x7f262002a410 comp rx=0 tx=0).stop 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 -- 172.21.15.70:0/1348108531 shutdown_connections 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1348108531 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2630106f10 0x7f263010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1348108531 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 0x7f26301067e0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1348108531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2630101de0 0x7f26301021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 -- 172.21.15.70:0/1348108531 >> 172.21.15.70:0/1348108531 conn(0x7f26300fd8c0 msgr2=0x7f26300ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 -- 172.21.15.70:0/1348108531 shutdown_connections 2024-09-19T04:29:28.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.899+0000 7f2637d0d640 1 -- 172.21.15.70:0/1348108531 wait complete. 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f2637d0d640 1 Processor -- start 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f2637d0d640 1 -- start start 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f2637d0d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2630101de0 0x7f2630198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f2637d0d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 0x7f26301989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f2637d0d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2630106f10 0x7f263019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f2637d0d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2630111f40 con 0x7f2630102790 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f2637d0d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2630111dc0 con 0x7f2630101de0 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f2637d0d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f26301120c0 con 0x7f2630106f10 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f26352a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 0x7f26301989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:28.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f26352a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 0x7f26301989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46082/0 (socket says 172.21.15.70:46082) 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.900+0000 7f26352a8640 1 -- 172.21.15.70:0/1612116898 learned_addr learned my addr 172.21.15.70:0/1612116898 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f26352a8640 1 -- 172.21.15.70:0/1612116898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2630106f10 msgr2=0x7f263019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f26362aa640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2630106f10 0x7f263019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f26352a8640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2630106f10 0x7f263019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f26352a8640 1 -- 172.21.15.70:0/1612116898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2630101de0 msgr2=0x7f2630198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f26352a8640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2630101de0 0x7f2630198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f26352a8640 1 -- 172.21.15.70:0/1612116898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f263019d440 con 0x7f2630102790 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f26352a8640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 0x7f26301989d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f26200314b0 tx=0x7f2620004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f2626ffd640 1 -- 172.21.15.70:0/1612116898 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f262003f030 con 0x7f2630102790 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f2626ffd640 1 -- 172.21.15.70:0/1612116898 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2620003ac0 con 0x7f2630102790 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f263019d6d0 con 0x7f2630102790 2024-09-19T04:29:28.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f2626ffd640 1 -- 172.21.15.70:0/1612116898 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2620035070 con 0x7f2630102790 2024-09-19T04:29:28.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.901+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26301a5010 con 0x7f2630102790 2024-09-19T04:29:28.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.902+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26301032c0 con 0x7f2630102790 2024-09-19T04:29:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.903+0000 7f2626ffd640 1 -- 172.21.15.70:0/1612116898 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2620042030 con 0x7f2630102790 2024-09-19T04:29:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.904+0000 7f2626ffd640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f261c0a32d0 0x7f261c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.904+0000 7f2626ffd640 1 -- 172.21.15.70:0/1612116898 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f26200f0530 con 0x7f2630102790 2024-09-19T04:29:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.904+0000 7f2635aa9640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f261c0a32d0 0x7f261c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.904+0000 7f2635aa9640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f261c0a32d0 0x7f261c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f262c005fd0 tx=0x7f262c005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:28.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:28.907+0000 7f2626ffd640 1 -- 172.21.15.70:0/1612116898 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f26200bd120 con 0x7f2630102790 2024-09-19T04:29:28.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:28 smithi167 ceph-mon[34339]: pgmap v288: 97 pgs: 97 active+clean; 621 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 4.8 KiB/s wr, 8 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:28.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:28 smithi167 ceph-mon[34339]: from='client.14736 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:29:29.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.070+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2630062630 con 0x7f261c0a32d0 2024-09-19T04:29:29.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.076+0000 7f2626ffd640 1 -- 172.21.15.70:0/1612116898 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258707 (secure 0 0 0) 0x7f2630062630 con 0x7f261c0a32d0 2024-09-19T04:29:29.080 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:29.081 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f261c0a32d0 msgr2=0x7f261c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f261c0a32d0 0x7f261c0a5790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f262c005fd0 tx=0x7f262c005850 comp rx=0 tx=0).stop 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 msgr2=0x7f26301989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 0x7f26301989d0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f26200314b0 tx=0x7f2620004270 comp rx=0 tx=0).stop 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 shutdown_connections 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f261c0a32d0 0x7f261c0a5790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2630106f10 0x7f263019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2630102790 0x7f26301989d0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 --2- 172.21.15.70:0/1612116898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2630101de0 0x7f2630198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:29.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 >> 172.21.15.70:0/1612116898 conn(0x7f26300fd8c0 msgr2=0x7f26300fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 shutdown_connections 2024-09-19T04:29:29.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:29.079+0000 7f2637d0d640 1 -- 172.21.15.70:0/1612116898 wait complete. 2024-09-19T04:29:29.819 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":288,"stamp":"2024-09-19T04:29:27.391280+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":635670,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":231,"num_read_kb":214,"num_write":330,"num_write_kb":3025,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":265,"ondisk_log_size":265,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374432,"kb_used_data":12688,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567392,"statfs":{"total":1151940427776,"available":1151557009408,"internally_reserved":0,"allocated":12992512,"data_stored":7201664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":39687,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":63,"num_read_kb":70,"num_write":23,"num_write_kb":48,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"9.918695"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478067+0000","last_change":"2024-09-19T04:29:02.416257+0000","last_active":"2024-09-19T04:29:18.478067+0000","last_peered":"2024-09-19T04:29:18.478067+0000","last_clean":"2024-09-19T04:29:18.478067+0000","last_became_active":"2024-09-19T04:29:02.415681+0000","last_became_peered":"2024-09-19T04:29:02.415681+0000","last_unstale":"2024-09-19T04:29:18.478067+0000","last_undegraded":"2024-09-19T04:29:18.478067+0000","last_fullsized":"2024-09-19T04:29:18.478067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:31.765859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479437+0000","last_change":"2024-09-19T04:29:02.417591+0000","last_active":"2024-09-19T04:29:18.479437+0000","last_peered":"2024-09-19T04:29:18.479437+0000","last_clean":"2024-09-19T04:29:18.479437+0000","last_became_active":"2024-09-19T04:29:02.417277+0000","last_became_peered":"2024-09-19T04:29:02.417277+0000","last_unstale":"2024-09-19T04:29:18.479437+0000","last_undegraded":"2024-09-19T04:29:18.479437+0000","last_fullsized":"2024-09-19T04:29:18.479437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:22.680000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479531+0000","last_change":"2024-09-19T04:29:02.416270+0000","last_active":"2024-09-19T04:29:18.479531+0000","last_peered":"2024-09-19T04:29:18.479531+0000","last_clean":"2024-09-19T04:29:18.479531+0000","last_became_active":"2024-09-19T04:29:02.415878+0000","last_became_peered":"2024-09-19T04:29:02.415878+0000","last_unstale":"2024-09-19T04:29:18.479531+0000","last_undegraded":"2024-09-19T04:29:18.479531+0000","last_fullsized":"2024-09-19T04:29:18.479531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:25.302575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353266+0000","last_change":"2024-09-19T04:29:02.414586+0000","last_active":"2024-09-19T04:29:19.353266+0000","last_peered":"2024-09-19T04:29:19.353266+0000","last_clean":"2024-09-19T04:29:19.353266+0000","last_became_active":"2024-09-19T04:29:02.414267+0000","last_became_peered":"2024-09-19T04:29:02.414267+0000","last_unstale":"2024-09-19T04:29:19.353266+0000","last_undegraded":"2024-09-19T04:29:19.353266+0000","last_fullsized":"2024-09-19T04:29:19.353266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:01.436793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479997+0000","last_change":"2024-09-19T04:29:02.412243+0000","last_active":"2024-09-19T04:29:18.479997+0000","last_peered":"2024-09-19T04:29:18.479997+0000","last_clean":"2024-09-19T04:29:18.479997+0000","last_became_active":"2024-09-19T04:29:02.411411+0000","last_became_peered":"2024-09-19T04:29:02.411411+0000","last_unstale":"2024-09-19T04:29:18.479997+0000","last_undegraded":"2024-09-19T04:29:18.479997+0000","last_fullsized":"2024-09-19T04:29:18.479997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:21.966542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.482295+0000","last_change":"2024-09-19T04:29:18.482295+0000","last_active":"2024-09-19T04:29:18.482295+0000","last_peered":"2024-09-19T04:29:18.482295+0000","last_clean":"2024-09-19T04:29:18.482295+0000","last_became_active":"2024-09-19T04:29:18.481929+0000","last_became_peered":"2024-09-19T04:29:18.481929+0000","last_unstale":"2024-09-19T04:29:18.482295+0000","last_undegraded":"2024-09-19T04:29:18.482295+0000","last_fullsized":"2024-09-19T04:29:18.482295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:17.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352359+0000","last_change":"2024-09-19T04:29:02.418029+0000","last_active":"2024-09-19T04:29:19.352359+0000","last_peered":"2024-09-19T04:29:19.352359+0000","last_clean":"2024-09-19T04:29:19.352359+0000","last_became_active":"2024-09-19T04:29:02.417676+0000","last_became_peered":"2024-09-19T04:29:02.417676+0000","last_unstale":"2024-09-19T04:29:19.352359+0000","last_undegraded":"2024-09-19T04:29:19.352359+0000","last_fullsized":"2024-09-19T04:29:19.352359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:12:03.148693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351553+0000","last_change":"2024-09-19T04:29:02.406657+0000","last_active":"2024-09-19T04:29:19.351553+0000","last_peered":"2024-09-19T04:29:19.351553+0000","last_clean":"2024-09-19T04:29:19.351553+0000","last_became_active":"2024-09-19T04:29:02.406203+0000","last_became_peered":"2024-09-19T04:29:02.406203+0000","last_unstale":"2024-09-19T04:29:19.351553+0000","last_undegraded":"2024-09-19T04:29:19.351553+0000","last_fullsized":"2024-09-19T04:29:19.351553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:06.842516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475951+0000","last_change":"2024-09-19T04:29:02.426478+0000","last_active":"2024-09-19T04:29:18.475951+0000","last_peered":"2024-09-19T04:29:18.475951+0000","last_clean":"2024-09-19T04:29:18.475951+0000","last_became_active":"2024-09-19T04:29:02.425938+0000","last_became_peered":"2024-09-19T04:29:02.425938+0000","last_unstale":"2024-09-19T04:29:18.475951+0000","last_undegraded":"2024-09-19T04:29:18.475951+0000","last_fullsized":"2024-09-19T04:29:18.475951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:01.439087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476878+0000","last_change":"2024-09-19T04:29:02.423380+0000","last_active":"2024-09-19T04:29:18.476878+0000","last_peered":"2024-09-19T04:29:18.476878+0000","last_clean":"2024-09-19T04:29:18.476878+0000","last_became_active":"2024-09-19T04:29:02.422894+0000","last_became_peered":"2024-09-19T04:29:02.422894+0000","last_unstale":"2024-09-19T04:29:18.476878+0000","last_undegraded":"2024-09-19T04:29:18.476878+0000","last_fullsized":"2024-09-19T04:29:18.476878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:55.082196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352800+0000","last_change":"2024-09-19T04:29:02.419929+0000","last_active":"2024-09-19T04:29:19.352800+0000","last_peered":"2024-09-19T04:29:19.352800+0000","last_clean":"2024-09-19T04:29:19.352800+0000","last_became_active":"2024-09-19T04:29:02.419432+0000","last_became_peered":"2024-09-19T04:29:02.419432+0000","last_unstale":"2024-09-19T04:29:19.352800+0000","last_undegraded":"2024-09-19T04:29:19.352800+0000","last_fullsized":"2024-09-19T04:29:19.352800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:50:03.896524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481806+0000","last_change":"2024-09-19T04:29:18.481426+0000","last_active":"2024-09-19T04:29:18.481806+0000","last_peered":"2024-09-19T04:29:18.481806+0000","last_clean":"2024-09-19T04:29:18.481806+0000","last_became_active":"2024-09-19T04:29:18.481042+0000","last_became_peered":"2024-09-19T04:29:18.481042+0000","last_unstale":"2024-09-19T04:29:18.481806+0000","last_undegraded":"2024-09-19T04:29:18.481806+0000","last_fullsized":"2024-09-19T04:29:18.481806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:16.251818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478854+0000","last_change":"2024-09-19T04:29:02.405545+0000","last_active":"2024-09-19T04:29:18.478854+0000","last_peered":"2024-09-19T04:29:18.478854+0000","last_clean":"2024-09-19T04:29:18.478854+0000","last_became_active":"2024-09-19T04:29:02.405247+0000","last_became_peered":"2024-09-19T04:29:02.405247+0000","last_unstale":"2024-09-19T04:29:18.478854+0000","last_undegraded":"2024-09-19T04:29:18.478854+0000","last_fullsized":"2024-09-19T04:29:18.478854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:26.673842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478732+0000","last_change":"2024-09-19T04:29:02.420647+0000","last_active":"2024-09-19T04:29:18.478732+0000","last_peered":"2024-09-19T04:29:18.478732+0000","last_clean":"2024-09-19T04:29:18.478732+0000","last_became_active":"2024-09-19T04:29:02.420310+0000","last_became_peered":"2024-09-19T04:29:02.420310+0000","last_unstale":"2024-09-19T04:29:18.478732+0000","last_undegraded":"2024-09-19T04:29:18.478732+0000","last_fullsized":"2024-09-19T04:29:18.478732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:47.893734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478550+0000","last_change":"2024-09-19T04:29:02.419199+0000","last_active":"2024-09-19T04:29:18.478550+0000","last_peered":"2024-09-19T04:29:18.478550+0000","last_clean":"2024-09-19T04:29:18.478550+0000","last_became_active":"2024-09-19T04:29:02.418902+0000","last_became_peered":"2024-09-19T04:29:02.418902+0000","last_unstale":"2024-09-19T04:29:18.478550+0000","last_undegraded":"2024-09-19T04:29:18.478550+0000","last_fullsized":"2024-09-19T04:29:18.478550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:04.958933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475374+0000","last_change":"2024-09-19T04:29:02.415284+0000","last_active":"2024-09-19T04:29:18.475374+0000","last_peered":"2024-09-19T04:29:18.475374+0000","last_clean":"2024-09-19T04:29:18.475374+0000","last_became_active":"2024-09-19T04:29:02.414947+0000","last_became_peered":"2024-09-19T04:29:02.414947+0000","last_unstale":"2024-09-19T04:29:18.475374+0000","last_undegraded":"2024-09-19T04:29:18.475374+0000","last_fullsized":"2024-09-19T04:29:18.475374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:08.525325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478189+0000","last_change":"2024-09-19T04:29:02.422294+0000","last_active":"2024-09-19T04:29:18.478189+0000","last_peered":"2024-09-19T04:29:18.478189+0000","last_clean":"2024-09-19T04:29:18.478189+0000","last_became_active":"2024-09-19T04:29:02.421014+0000","last_became_peered":"2024-09-19T04:29:02.421014+0000","last_unstale":"2024-09-19T04:29:18.478189+0000","last_undegraded":"2024-09-19T04:29:18.478189+0000","last_fullsized":"2024-09-19T04:29:18.478189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:34.197168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474734+0000","last_change":"2024-09-19T04:29:02.415319+0000","last_active":"2024-09-19T04:29:18.474734+0000","last_peered":"2024-09-19T04:29:18.474734+0000","last_clean":"2024-09-19T04:29:18.474734+0000","last_became_active":"2024-09-19T04:29:02.415030+0000","last_became_peered":"2024-09-19T04:29:02.415030+0000","last_unstale":"2024-09-19T04:29:18.474734+0000","last_undegraded":"2024-09-19T04:29:18.474734+0000","last_fullsized":"2024-09-19T04:29:18.474734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:11.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478695+0000","last_change":"2024-09-19T04:29:02.415938+0000","last_active":"2024-09-19T04:29:18.478695+0000","last_peered":"2024-09-19T04:29:18.478695+0000","last_clean":"2024-09-19T04:29:18.478695+0000","last_became_active":"2024-09-19T04:29:02.411665+0000","last_became_peered":"2024-09-19T04:29:02.411665+0000","last_unstale":"2024-09-19T04:29:18.478695+0000","last_undegraded":"2024-09-19T04:29:18.478695+0000","last_fullsized":"2024-09-19T04:29:18.478695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:12.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477535+0000","last_change":"2024-09-19T04:29:02.417489+0000","last_active":"2024-09-19T04:29:18.477535+0000","last_peered":"2024-09-19T04:29:18.477535+0000","last_clean":"2024-09-19T04:29:18.477535+0000","last_became_active":"2024-09-19T04:29:02.417164+0000","last_became_peered":"2024-09-19T04:29:02.417164+0000","last_unstale":"2024-09-19T04:29:18.477535+0000","last_undegraded":"2024-09-19T04:29:18.477535+0000","last_fullsized":"2024-09-19T04:29:18.477535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:28.055517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478961+0000","last_change":"2024-09-19T04:29:02.407559+0000","last_active":"2024-09-19T04:29:18.478961+0000","last_peered":"2024-09-19T04:29:18.478961+0000","last_clean":"2024-09-19T04:29:18.478961+0000","last_became_active":"2024-09-19T04:29:02.407241+0000","last_became_peered":"2024-09-19T04:29:02.407241+0000","last_unstale":"2024-09-19T04:29:18.478961+0000","last_undegraded":"2024-09-19T04:29:18.478961+0000","last_fullsized":"2024-09-19T04:29:18.478961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:13.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475575+0000","last_change":"2024-09-19T04:29:02.418341+0000","last_active":"2024-09-19T04:29:18.475575+0000","last_peered":"2024-09-19T04:29:18.475575+0000","last_clean":"2024-09-19T04:29:18.475575+0000","last_became_active":"2024-09-19T04:29:02.418028+0000","last_became_peered":"2024-09-19T04:29:02.418028+0000","last_unstale":"2024-09-19T04:29:18.475575+0000","last_undegraded":"2024-09-19T04:29:18.475575+0000","last_fullsized":"2024-09-19T04:29:18.475575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:03.264803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351574+0000","last_change":"2024-09-19T04:29:02.419191+0000","last_active":"2024-09-19T04:29:19.351574+0000","last_peered":"2024-09-19T04:29:19.351574+0000","last_clean":"2024-09-19T04:29:19.351574+0000","last_became_active":"2024-09-19T04:29:02.418587+0000","last_became_peered":"2024-09-19T04:29:02.418587+0000","last_unstale":"2024-09-19T04:29:19.351574+0000","last_undegraded":"2024-09-19T04:29:19.351574+0000","last_fullsized":"2024-09-19T04:29:19.351574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:58.185492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627644+0000","last_change":"2024-09-19T04:29:02.407961+0000","last_active":"2024-09-19T04:29:18.627644+0000","last_peered":"2024-09-19T04:29:18.627644+0000","last_clean":"2024-09-19T04:29:18.627644+0000","last_became_active":"2024-09-19T04:29:02.406888+0000","last_became_peered":"2024-09-19T04:29:02.406888+0000","last_unstale":"2024-09-19T04:29:18.627644+0000","last_undegraded":"2024-09-19T04:29:18.627644+0000","last_fullsized":"2024-09-19T04:29:18.627644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:47.360605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351914+0000","last_change":"2024-09-19T04:29:02.415234+0000","last_active":"2024-09-19T04:29:19.351914+0000","last_peered":"2024-09-19T04:29:19.351914+0000","last_clean":"2024-09-19T04:29:19.351914+0000","last_became_active":"2024-09-19T04:29:02.414929+0000","last_became_peered":"2024-09-19T04:29:02.414929+0000","last_unstale":"2024-09-19T04:29:19.351914+0000","last_undegraded":"2024-09-19T04:29:19.351914+0000","last_fullsized":"2024-09-19T04:29:19.351914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:48.077114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478990+0000","last_change":"2024-09-19T04:29:02.416072+0000","last_active":"2024-09-19T04:29:18.478990+0000","last_peered":"2024-09-19T04:29:18.478990+0000","last_clean":"2024-09-19T04:29:18.478990+0000","last_became_active":"2024-09-19T04:29:02.415714+0000","last_became_peered":"2024-09-19T04:29:02.415714+0000","last_unstale":"2024-09-19T04:29:18.478990+0000","last_undegraded":"2024-09-19T04:29:18.478990+0000","last_fullsized":"2024-09-19T04:29:18.478990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:45.000850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477913+0000","last_change":"2024-09-19T04:29:02.426071+0000","last_active":"2024-09-19T04:29:18.477913+0000","last_peered":"2024-09-19T04:29:18.477913+0000","last_clean":"2024-09-19T04:29:18.477913+0000","last_became_active":"2024-09-19T04:29:02.425717+0000","last_became_peered":"2024-09-19T04:29:02.425717+0000","last_unstale":"2024-09-19T04:29:18.477913+0000","last_undegraded":"2024-09-19T04:29:18.477913+0000","last_fullsized":"2024-09-19T04:29:18.477913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:11.989191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481675+0000","last_change":"2024-09-19T04:29:18.481675+0000","last_active":"2024-09-19T04:29:18.481675+0000","last_peered":"2024-09-19T04:29:18.481675+0000","last_clean":"2024-09-19T04:29:18.481675+0000","last_became_active":"2024-09-19T04:29:18.481224+0000","last_became_peered":"2024-09-19T04:29:18.481224+0000","last_unstale":"2024-09-19T04:29:18.481675+0000","last_undegraded":"2024-09-19T04:29:18.481675+0000","last_fullsized":"2024-09-19T04:29:18.481675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:10.928554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479403+0000","last_change":"2024-09-19T04:29:02.413973+0000","last_active":"2024-09-19T04:29:18.479403+0000","last_peered":"2024-09-19T04:29:18.479403+0000","last_clean":"2024-09-19T04:29:18.479403+0000","last_became_active":"2024-09-19T04:29:02.413695+0000","last_became_peered":"2024-09-19T04:29:02.413695+0000","last_unstale":"2024-09-19T04:29:18.479403+0000","last_undegraded":"2024-09-19T04:29:18.479403+0000","last_fullsized":"2024-09-19T04:29:18.479403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:11.961493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478960+0000","last_change":"2024-09-19T04:29:02.413943+0000","last_active":"2024-09-19T04:29:18.478960+0000","last_peered":"2024-09-19T04:29:18.478960+0000","last_clean":"2024-09-19T04:29:18.478960+0000","last_became_active":"2024-09-19T04:29:02.411977+0000","last_became_peered":"2024-09-19T04:29:02.411977+0000","last_unstale":"2024-09-19T04:29:18.478960+0000","last_undegraded":"2024-09-19T04:29:18.478960+0000","last_fullsized":"2024-09-19T04:29:18.478960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:38.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478817+0000","last_change":"2024-09-19T04:29:02.420995+0000","last_active":"2024-09-19T04:29:18.478817+0000","last_peered":"2024-09-19T04:29:18.478817+0000","last_clean":"2024-09-19T04:29:18.478817+0000","last_became_active":"2024-09-19T04:29:02.420552+0000","last_became_peered":"2024-09-19T04:29:02.420552+0000","last_unstale":"2024-09-19T04:29:18.478817+0000","last_undegraded":"2024-09-19T04:29:18.478817+0000","last_fullsized":"2024-09-19T04:29:18.478817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:12.560776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481041+0000","last_change":"2024-09-19T04:29:18.481041+0000","last_active":"2024-09-19T04:29:18.481041+0000","last_peered":"2024-09-19T04:29:18.481041+0000","last_clean":"2024-09-19T04:29:18.481041+0000","last_became_active":"2024-09-19T04:29:18.480478+0000","last_became_peered":"2024-09-19T04:29:18.480478+0000","last_unstale":"2024-09-19T04:29:18.481041+0000","last_undegraded":"2024-09-19T04:29:18.481041+0000","last_fullsized":"2024-09-19T04:29:18.481041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480094+0000","last_change":"2024-09-19T04:29:02.411380+0000","last_active":"2024-09-19T04:29:18.480094+0000","last_peered":"2024-09-19T04:29:18.480094+0000","last_clean":"2024-09-19T04:29:18.480094+0000","last_became_active":"2024-09-19T04:29:02.410977+0000","last_became_peered":"2024-09-19T04:29:02.410977+0000","last_unstale":"2024-09-19T04:29:18.480094+0000","last_undegraded":"2024-09-19T04:29:18.480094+0000","last_fullsized":"2024-09-19T04:29:18.480094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.147856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":41,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:22.475503+0000","last_change":"2024-09-19T04:29:00.394886+0000","last_active":"2024-09-19T04:29:22.475503+0000","last_peered":"2024-09-19T04:29:22.475503+0000","last_clean":"2024-09-19T04:29:22.475503+0000","last_became_active":"2024-09-19T04:29:00.394412+0000","last_became_peered":"2024-09-19T04:29:00.394412+0000","last_unstale":"2024-09-19T04:29:22.475503+0000","last_undegraded":"2024-09-19T04:29:22.475503+0000","last_fullsized":"2024-09-19T04:29:22.475503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:43.929791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":14,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627230+0000","last_change":"2024-09-19T04:29:02.413258+0000","last_active":"2024-09-19T04:29:18.627230+0000","last_peered":"2024-09-19T04:29:18.627230+0000","last_clean":"2024-09-19T04:29:18.627230+0000","last_became_active":"2024-09-19T04:29:02.412887+0000","last_became_peered":"2024-09-19T04:29:02.412887+0000","last_unstale":"2024-09-19T04:29:18.627230+0000","last_undegraded":"2024-09-19T04:29:18.627230+0000","last_fullsized":"2024-09-19T04:29:18.627230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:26.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476972+0000","last_change":"2024-09-19T04:29:00.395696+0000","last_active":"2024-09-19T04:29:18.476972+0000","last_peered":"2024-09-19T04:29:18.476972+0000","last_clean":"2024-09-19T04:29:18.476972+0000","last_became_active":"2024-09-19T04:29:00.395363+0000","last_became_peered":"2024-09-19T04:29:00.395363+0000","last_unstale":"2024-09-19T04:29:18.476972+0000","last_undegraded":"2024-09-19T04:29:18.476972+0000","last_fullsized":"2024-09-19T04:29:18.476972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:50.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478415+0000","last_change":"2024-09-19T04:29:00.391765+0000","last_active":"2024-09-19T04:29:18.478415+0000","last_peered":"2024-09-19T04:29:18.478415+0000","last_clean":"2024-09-19T04:29:18.478415+0000","last_became_active":"2024-09-19T04:29:00.391412+0000","last_became_peered":"2024-09-19T04:29:00.391412+0000","last_unstale":"2024-09-19T04:29:18.478415+0000","last_undegraded":"2024-09-19T04:29:18.478415+0000","last_fullsized":"2024-09-19T04:29:18.478415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:27.423046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351584+0000","last_change":"2024-09-19T04:29:02.417820+0000","last_active":"2024-09-19T04:29:19.351584+0000","last_peered":"2024-09-19T04:29:19.351584+0000","last_clean":"2024-09-19T04:29:19.351584+0000","last_became_active":"2024-09-19T04:29:02.417452+0000","last_became_peered":"2024-09-19T04:29:02.417452+0000","last_unstale":"2024-09-19T04:29:19.351584+0000","last_undegraded":"2024-09-19T04:29:19.351584+0000","last_fullsized":"2024-09-19T04:29:19.351584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:34.767829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627792+0000","last_change":"2024-09-19T04:29:00.393075+0000","last_active":"2024-09-19T04:29:18.627792+0000","last_peered":"2024-09-19T04:29:18.627792+0000","last_clean":"2024-09-19T04:29:18.627792+0000","last_became_active":"2024-09-19T04:29:00.392695+0000","last_became_peered":"2024-09-19T04:29:00.392695+0000","last_unstale":"2024-09-19T04:29:18.627792+0000","last_undegraded":"2024-09-19T04:29:18.627792+0000","last_fullsized":"2024-09-19T04:29:18.627792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:43.122636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474573+0000","last_change":"2024-09-19T04:29:02.403886+0000","last_active":"2024-09-19T04:29:18.474573+0000","last_peered":"2024-09-19T04:29:18.474573+0000","last_clean":"2024-09-19T04:29:18.474573+0000","last_became_active":"2024-09-19T04:29:02.403530+0000","last_became_peered":"2024-09-19T04:29:02.403530+0000","last_unstale":"2024-09-19T04:29:18.474573+0000","last_undegraded":"2024-09-19T04:29:18.474573+0000","last_fullsized":"2024-09-19T04:29:18.474573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:57.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":36,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:21.473945+0000","last_change":"2024-09-19T04:29:00.390081+0000","last_active":"2024-09-19T04:29:21.473945+0000","last_peered":"2024-09-19T04:29:21.473945+0000","last_clean":"2024-09-19T04:29:21.473945+0000","last_became_active":"2024-09-19T04:29:00.389701+0000","last_became_peered":"2024-09-19T04:29:00.389701+0000","last_unstale":"2024-09-19T04:29:21.473945+0000","last_undegraded":"2024-09-19T04:29:21.473945+0000","last_fullsized":"2024-09-19T04:29:21.473945+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:42.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475842+0000","last_change":"2024-09-19T04:29:02.424712+0000","last_active":"2024-09-19T04:29:18.475842+0000","last_peered":"2024-09-19T04:29:18.475842+0000","last_clean":"2024-09-19T04:29:18.475842+0000","last_became_active":"2024-09-19T04:29:02.424316+0000","last_became_peered":"2024-09-19T04:29:02.424316+0000","last_unstale":"2024-09-19T04:29:18.475842+0000","last_undegraded":"2024-09-19T04:29:18.475842+0000","last_fullsized":"2024-09-19T04:29:18.475842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:06:21.246473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352814+0000","last_change":"2024-09-19T04:29:00.396085+0000","last_active":"2024-09-19T04:29:19.352814+0000","last_peered":"2024-09-19T04:29:19.352814+0000","last_clean":"2024-09-19T04:29:19.352814+0000","last_became_active":"2024-09-19T04:29:00.395737+0000","last_became_peered":"2024-09-19T04:29:00.395737+0000","last_unstale":"2024-09-19T04:29:19.352814+0000","last_undegraded":"2024-09-19T04:29:19.352814+0000","last_fullsized":"2024-09-19T04:29:19.352814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:59.429917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479755+0000","last_change":"2024-09-19T04:29:02.412318+0000","last_active":"2024-09-19T04:29:18.479755+0000","last_peered":"2024-09-19T04:29:18.479755+0000","last_clean":"2024-09-19T04:29:18.479755+0000","last_became_active":"2024-09-19T04:29:02.412020+0000","last_became_peered":"2024-09-19T04:29:02.412020+0000","last_unstale":"2024-09-19T04:29:18.479755+0000","last_undegraded":"2024-09-19T04:29:18.479755+0000","last_fullsized":"2024-09-19T04:29:18.479755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:45.341633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627499+0000","last_change":"2024-09-19T04:29:00.507027+0000","last_active":"2024-09-19T04:29:18.627499+0000","last_peered":"2024-09-19T04:29:18.627499+0000","last_clean":"2024-09-19T04:29:18.627499+0000","last_became_active":"2024-09-19T04:29:00.506660+0000","last_became_peered":"2024-09-19T04:29:00.506660+0000","last_unstale":"2024-09-19T04:29:18.627499+0000","last_undegraded":"2024-09-19T04:29:18.627499+0000","last_fullsized":"2024-09-19T04:29:18.627499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:54.629719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475693+0000","last_change":"2024-09-19T04:29:02.415423+0000","last_active":"2024-09-19T04:29:18.475693+0000","last_peered":"2024-09-19T04:29:18.475693+0000","last_clean":"2024-09-19T04:29:18.475693+0000","last_became_active":"2024-09-19T04:29:02.415105+0000","last_became_peered":"2024-09-19T04:29:02.415105+0000","last_unstale":"2024-09-19T04:29:18.475693+0000","last_undegraded":"2024-09-19T04:29:18.475693+0000","last_fullsized":"2024-09-19T04:29:18.475693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:00.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'20","reported_seq":69,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:22.474572+0000","last_change":"2024-09-19T04:29:00.396021+0000","last_active":"2024-09-19T04:29:22.474572+0000","last_peered":"2024-09-19T04:29:22.474572+0000","last_clean":"2024-09-19T04:29:22.474572+0000","last_became_active":"2024-09-19T04:29:00.395649+0000","last_became_peered":"2024-09-19T04:29:00.395649+0000","last_unstale":"2024-09-19T04:29:22.474572+0000","last_undegraded":"2024-09-19T04:29:22.474572+0000","last_fullsized":"2024-09-19T04:29:22.474572+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:56.800573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41065,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":53,"num_write":21,"num_write_kb":45,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480153+0000","last_change":"2024-09-19T04:29:02.416081+0000","last_active":"2024-09-19T04:29:18.480153+0000","last_peered":"2024-09-19T04:29:18.480153+0000","last_clean":"2024-09-19T04:29:18.480153+0000","last_became_active":"2024-09-19T04:29:02.415780+0000","last_became_peered":"2024-09-19T04:29:02.415780+0000","last_unstale":"2024-09-19T04:29:18.480153+0000","last_undegraded":"2024-09-19T04:29:18.480153+0000","last_fullsized":"2024-09-19T04:29:18.480153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:23.438141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479168+0000","last_change":"2024-09-19T04:29:00.396397+0000","last_active":"2024-09-19T04:29:18.479168+0000","last_peered":"2024-09-19T04:29:18.479168+0000","last_clean":"2024-09-19T04:29:18.479168+0000","last_became_active":"2024-09-19T04:29:00.395896+0000","last_became_peered":"2024-09-19T04:29:00.395896+0000","last_unstale":"2024-09-19T04:29:18.479168+0000","last_undegraded":"2024-09-19T04:29:18.479168+0000","last_fullsized":"2024-09-19T04:29:18.479168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:06.174262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478226+0000","last_change":"2024-09-19T04:29:02.408299+0000","last_active":"2024-09-19T04:29:18.478226+0000","last_peered":"2024-09-19T04:29:18.478226+0000","last_clean":"2024-09-19T04:29:18.478226+0000","last_became_active":"2024-09-19T04:29:02.407970+0000","last_became_peered":"2024-09-19T04:29:02.407970+0000","last_unstale":"2024-09-19T04:29:18.478226+0000","last_undegraded":"2024-09-19T04:29:18.478226+0000","last_fullsized":"2024-09-19T04:29:18.478226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:50.758517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627276+0000","last_change":"2024-09-19T04:29:00.393163+0000","last_active":"2024-09-19T04:29:18.627276+0000","last_peered":"2024-09-19T04:29:18.627276+0000","last_clean":"2024-09-19T04:29:18.627276+0000","last_became_active":"2024-09-19T04:29:00.392749+0000","last_became_peered":"2024-09-19T04:29:00.392749+0000","last_unstale":"2024-09-19T04:29:18.627276+0000","last_undegraded":"2024-09-19T04:29:18.627276+0000","last_fullsized":"2024-09-19T04:29:18.627276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:41.999124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352661+0000","last_change":"2024-09-19T04:29:02.412754+0000","last_active":"2024-09-19T04:29:19.352661+0000","last_peered":"2024-09-19T04:29:19.352661+0000","last_clean":"2024-09-19T04:29:19.352661+0000","last_became_active":"2024-09-19T04:29:02.412445+0000","last_became_peered":"2024-09-19T04:29:02.412445+0000","last_unstale":"2024-09-19T04:29:19.352661+0000","last_undegraded":"2024-09-19T04:29:19.352661+0000","last_fullsized":"2024-09-19T04:29:19.352661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:52:31.531672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":43,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:24.478544+0000","last_change":"2024-09-19T04:29:00.393863+0000","last_active":"2024-09-19T04:29:24.478544+0000","last_peered":"2024-09-19T04:29:24.478544+0000","last_clean":"2024-09-19T04:29:24.478544+0000","last_became_active":"2024-09-19T04:29:00.393502+0000","last_became_peered":"2024-09-19T04:29:00.393502+0000","last_unstale":"2024-09-19T04:29:24.478544+0000","last_undegraded":"2024-09-19T04:29:24.478544+0000","last_fullsized":"2024-09-19T04:29:24.478544+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:26.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":18,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352213+0000","last_change":"2024-09-19T04:29:02.412624+0000","last_active":"2024-09-19T04:29:19.352213+0000","last_peered":"2024-09-19T04:29:19.352213+0000","last_clean":"2024-09-19T04:29:19.352213+0000","last_became_active":"2024-09-19T04:29:02.412299+0000","last_became_peered":"2024-09-19T04:29:02.412299+0000","last_unstale":"2024-09-19T04:29:19.352213+0000","last_undegraded":"2024-09-19T04:29:19.352213+0000","last_fullsized":"2024-09-19T04:29:19.352213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.062422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479881+0000","last_change":"2024-09-19T04:29:00.504931+0000","last_active":"2024-09-19T04:29:18.479881+0000","last_peered":"2024-09-19T04:29:18.479881+0000","last_clean":"2024-09-19T04:29:18.479881+0000","last_became_active":"2024-09-19T04:29:00.504526+0000","last_became_peered":"2024-09-19T04:29:00.504526+0000","last_unstale":"2024-09-19T04:29:18.479881+0000","last_undegraded":"2024-09-19T04:29:18.479881+0000","last_fullsized":"2024-09-19T04:29:18.479881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:31.096516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627169+0000","last_change":"2024-09-19T04:29:02.424492+0000","last_active":"2024-09-19T04:29:18.627169+0000","last_peered":"2024-09-19T04:29:18.627169+0000","last_clean":"2024-09-19T04:29:18.627169+0000","last_became_active":"2024-09-19T04:29:02.424013+0000","last_became_peered":"2024-09-19T04:29:02.424013+0000","last_unstale":"2024-09-19T04:29:18.627169+0000","last_undegraded":"2024-09-19T04:29:18.627169+0000","last_fullsized":"2024-09-19T04:29:18.627169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:41.021945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480275+0000","last_change":"2024-09-19T04:29:00.396707+0000","last_active":"2024-09-19T04:29:18.480275+0000","last_peered":"2024-09-19T04:29:18.480275+0000","last_clean":"2024-09-19T04:29:18.480275+0000","last_became_active":"2024-09-19T04:29:00.394876+0000","last_became_peered":"2024-09-19T04:29:00.394876+0000","last_unstale":"2024-09-19T04:29:18.480275+0000","last_undegraded":"2024-09-19T04:29:18.480275+0000","last_fullsized":"2024-09-19T04:29:18.480275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:06.648377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477755+0000","last_change":"2024-09-19T04:29:02.425106+0000","last_active":"2024-09-19T04:29:18.477755+0000","last_peered":"2024-09-19T04:29:18.477755+0000","last_clean":"2024-09-19T04:29:18.477755+0000","last_became_active":"2024-09-19T04:29:02.424597+0000","last_became_peered":"2024-09-19T04:29:02.424597+0000","last_unstale":"2024-09-19T04:29:18.477755+0000","last_undegraded":"2024-09-19T04:29:18.477755+0000","last_fullsized":"2024-09-19T04:29:18.477755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:02.998519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478154+0000","last_change":"2024-09-19T04:29:00.396369+0000","last_active":"2024-09-19T04:29:18.478154+0000","last_peered":"2024-09-19T04:29:18.478154+0000","last_clean":"2024-09-19T04:29:18.478154+0000","last_became_active":"2024-09-19T04:29:00.395980+0000","last_became_peered":"2024-09-19T04:29:00.395980+0000","last_unstale":"2024-09-19T04:29:18.478154+0000","last_undegraded":"2024-09-19T04:29:18.478154+0000","last_fullsized":"2024-09-19T04:29:18.478154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.941729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352958+0000","last_change":"2024-09-19T04:29:02.415771+0000","last_active":"2024-09-19T04:29:19.352958+0000","last_peered":"2024-09-19T04:29:19.352958+0000","last_clean":"2024-09-19T04:29:19.352958+0000","last_became_active":"2024-09-19T04:29:02.415404+0000","last_became_peered":"2024-09-19T04:29:02.415404+0000","last_unstale":"2024-09-19T04:29:19.352958+0000","last_undegraded":"2024-09-19T04:29:19.352958+0000","last_fullsized":"2024-09-19T04:29:19.352958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:04.509294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627625+0000","last_change":"2024-09-19T04:29:00.389015+0000","last_active":"2024-09-19T04:29:18.627625+0000","last_peered":"2024-09-19T04:29:18.627625+0000","last_clean":"2024-09-19T04:29:18.627625+0000","last_became_active":"2024-09-19T04:29:00.388621+0000","last_became_peered":"2024-09-19T04:29:00.388621+0000","last_unstale":"2024-09-19T04:29:18.627625+0000","last_undegraded":"2024-09-19T04:29:18.627625+0000","last_fullsized":"2024-09-19T04:29:18.627625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:49.509697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352821+0000","last_change":"2024-09-19T04:29:02.411379+0000","last_active":"2024-09-19T04:29:19.352821+0000","last_peered":"2024-09-19T04:29:19.352821+0000","last_clean":"2024-09-19T04:29:19.352821+0000","last_became_active":"2024-09-19T04:29:02.411069+0000","last_became_peered":"2024-09-19T04:29:02.411069+0000","last_unstale":"2024-09-19T04:29:19.352821+0000","last_undegraded":"2024-09-19T04:29:19.352821+0000","last_fullsized":"2024-09-19T04:29:19.352821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:10.953422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479146+0000","last_change":"2024-09-19T04:29:00.505088+0000","last_active":"2024-09-19T04:29:18.479146+0000","last_peered":"2024-09-19T04:29:18.479146+0000","last_clean":"2024-09-19T04:29:18.479146+0000","last_became_active":"2024-09-19T04:29:00.504734+0000","last_became_peered":"2024-09-19T04:29:00.504734+0000","last_unstale":"2024-09-19T04:29:18.479146+0000","last_undegraded":"2024-09-19T04:29:18.479146+0000","last_fullsized":"2024-09-19T04:29:18.479146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:38.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352950+0000","last_change":"2024-09-19T04:29:02.420752+0000","last_active":"2024-09-19T04:29:19.352950+0000","last_peered":"2024-09-19T04:29:19.352950+0000","last_clean":"2024-09-19T04:29:19.352950+0000","last_became_active":"2024-09-19T04:29:02.419136+0000","last_became_peered":"2024-09-19T04:29:02.419136+0000","last_unstale":"2024-09-19T04:29:19.352950+0000","last_undegraded":"2024-09-19T04:29:19.352950+0000","last_fullsized":"2024-09-19T04:29:19.352950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:40.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352515+0000","last_change":"2024-09-19T04:27:51.622607+0000","last_active":"2024-09-19T04:29:19.352515+0000","last_peered":"2024-09-19T04:29:19.352515+0000","last_clean":"2024-09-19T04:29:19.352515+0000","last_became_active":"2024-09-19T04:27:51.622000+0000","last_became_peered":"2024-09-19T04:27:51.622000+0000","last_unstale":"2024-09-19T04:29:19.352515+0000","last_undegraded":"2024-09-19T04:29:19.352515+0000","last_fullsized":"2024-09-19T04:29:19.352515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_clean_scrub_stamp":"2024-09-19T04:24:31.610268+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:20:05.335499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353048+0000","last_change":"2024-09-19T04:29:00.393618+0000","last_active":"2024-09-19T04:29:19.353048+0000","last_peered":"2024-09-19T04:29:19.353048+0000","last_clean":"2024-09-19T04:29:19.353048+0000","last_became_active":"2024-09-19T04:29:00.393248+0000","last_became_peered":"2024-09-19T04:29:00.393248+0000","last_unstale":"2024-09-19T04:29:19.353048+0000","last_undegraded":"2024-09-19T04:29:19.353048+0000","last_fullsized":"2024-09-19T04:29:19.353048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:35.271531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351694+0000","last_change":"2024-09-19T04:29:02.415147+0000","last_active":"2024-09-19T04:29:19.351694+0000","last_peered":"2024-09-19T04:29:19.351694+0000","last_clean":"2024-09-19T04:29:19.351694+0000","last_became_active":"2024-09-19T04:29:02.414275+0000","last_became_peered":"2024-09-19T04:29:02.414275+0000","last_unstale":"2024-09-19T04:29:19.351694+0000","last_undegraded":"2024-09-19T04:29:19.351694+0000","last_fullsized":"2024-09-19T04:29:19.351694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:32.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352368+0000","last_change":"2024-09-19T04:29:00.398007+0000","last_active":"2024-09-19T04:29:19.352368+0000","last_peered":"2024-09-19T04:29:19.352368+0000","last_clean":"2024-09-19T04:29:19.352368+0000","last_became_active":"2024-09-19T04:29:00.397644+0000","last_became_peered":"2024-09-19T04:29:00.397644+0000","last_unstale":"2024-09-19T04:29:19.352368+0000","last_undegraded":"2024-09-19T04:29:19.352368+0000","last_fullsized":"2024-09-19T04:29:19.352368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:34.476893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478405+0000","last_change":"2024-09-19T04:29:02.414957+0000","last_active":"2024-09-19T04:29:18.478405+0000","last_peered":"2024-09-19T04:29:18.478405+0000","last_clean":"2024-09-19T04:29:18.478405+0000","last_became_active":"2024-09-19T04:29:02.414641+0000","last_became_peered":"2024-09-19T04:29:02.414641+0000","last_unstale":"2024-09-19T04:29:18.478405+0000","last_undegraded":"2024-09-19T04:29:18.478405+0000","last_fullsized":"2024-09-19T04:29:18.478405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:18.824972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":39,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:23.476888+0000","last_change":"2024-09-19T04:29:00.504872+0000","last_active":"2024-09-19T04:29:23.476888+0000","last_peered":"2024-09-19T04:29:23.476888+0000","last_clean":"2024-09-19T04:29:23.476888+0000","last_became_active":"2024-09-19T04:29:00.504520+0000","last_became_peered":"2024-09-19T04:29:00.504520+0000","last_unstale":"2024-09-19T04:29:23.476888+0000","last_undegraded":"2024-09-19T04:29:23.476888+0000","last_fullsized":"2024-09-19T04:29:23.476888+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:39.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":13,"num_read_kb":13,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627739+0000","last_change":"2024-09-19T04:29:02.416451+0000","last_active":"2024-09-19T04:29:18.627739+0000","last_peered":"2024-09-19T04:29:18.627739+0000","last_clean":"2024-09-19T04:29:18.627739+0000","last_became_active":"2024-09-19T04:29:02.415271+0000","last_became_peered":"2024-09-19T04:29:02.415271+0000","last_unstale":"2024-09-19T04:29:18.627739+0000","last_undegraded":"2024-09-19T04:29:18.627739+0000","last_fullsized":"2024-09-19T04:29:18.627739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:06.371572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352591+0000","last_change":"2024-09-19T04:29:00.390999+0000","last_active":"2024-09-19T04:29:19.352591+0000","last_peered":"2024-09-19T04:29:19.352591+0000","last_clean":"2024-09-19T04:29:19.352591+0000","last_became_active":"2024-09-19T04:29:00.390639+0000","last_became_peered":"2024-09-19T04:29:00.390639+0000","last_unstale":"2024-09-19T04:29:19.352591+0000","last_undegraded":"2024-09-19T04:29:19.352591+0000","last_fullsized":"2024-09-19T04:29:19.352591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:26.504171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476998+0000","last_change":"2024-09-19T04:29:02.419534+0000","last_active":"2024-09-19T04:29:18.476998+0000","last_peered":"2024-09-19T04:29:18.476998+0000","last_clean":"2024-09-19T04:29:18.476998+0000","last_became_active":"2024-09-19T04:29:02.419192+0000","last_became_peered":"2024-09-19T04:29:02.419192+0000","last_unstale":"2024-09-19T04:29:18.476998+0000","last_undegraded":"2024-09-19T04:29:18.476998+0000","last_fullsized":"2024-09-19T04:29:18.476998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:33.866859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480950+0000","last_change":"2024-09-19T04:29:18.480950+0000","last_active":"2024-09-19T04:29:18.480950+0000","last_peered":"2024-09-19T04:29:18.480950+0000","last_clean":"2024-09-19T04:29:18.480950+0000","last_became_active":"2024-09-19T04:29:18.480542+0000","last_became_peered":"2024-09-19T04:29:18.480542+0000","last_unstale":"2024-09-19T04:29:18.480950+0000","last_undegraded":"2024-09-19T04:29:18.480950+0000","last_fullsized":"2024-09-19T04:29:18.480950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.647586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476904+0000","last_change":"2024-09-19T04:29:02.415075+0000","last_active":"2024-09-19T04:29:18.476904+0000","last_peered":"2024-09-19T04:29:18.476904+0000","last_clean":"2024-09-19T04:29:18.476904+0000","last_became_active":"2024-09-19T04:29:02.414635+0000","last_became_peered":"2024-09-19T04:29:02.414635+0000","last_unstale":"2024-09-19T04:29:18.476904+0000","last_undegraded":"2024-09-19T04:29:18.476904+0000","last_fullsized":"2024-09-19T04:29:18.476904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:12.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.485631+0000","last_change":"2024-09-19T04:29:18.485218+0000","last_active":"2024-09-19T04:29:18.485631+0000","last_peered":"2024-09-19T04:29:18.485631+0000","last_clean":"2024-09-19T04:29:18.485631+0000","last_became_active":"2024-09-19T04:29:18.481618+0000","last_became_peered":"2024-09-19T04:29:18.481618+0000","last_unstale":"2024-09-19T04:29:18.485631+0000","last_undegraded":"2024-09-19T04:29:18.485631+0000","last_fullsized":"2024-09-19T04:29:18.485631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:26.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479189+0000","last_change":"2024-09-19T04:29:02.412647+0000","last_active":"2024-09-19T04:29:18.479189+0000","last_peered":"2024-09-19T04:29:18.479189+0000","last_clean":"2024-09-19T04:29:18.479189+0000","last_became_active":"2024-09-19T04:29:02.412014+0000","last_became_peered":"2024-09-19T04:29:02.412014+0000","last_unstale":"2024-09-19T04:29:18.479189+0000","last_undegraded":"2024-09-19T04:29:18.479189+0000","last_fullsized":"2024-09-19T04:29:18.479189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:32.341462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'7","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:21.411483+0000","last_change":"2024-09-19T04:29:00.397860+0000","last_active":"2024-09-19T04:29:21.411483+0000","last_peered":"2024-09-19T04:29:21.411483+0000","last_clean":"2024-09-19T04:29:21.411483+0000","last_became_active":"2024-09-19T04:29:00.397501+0000","last_became_peered":"2024-09-19T04:29:00.397501+0000","last_unstale":"2024-09-19T04:29:21.411483+0000","last_undegraded":"2024-09-19T04:29:21.411483+0000","last_fullsized":"2024-09-19T04:29:21.411483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:51.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351919+0000","last_change":"2024-09-19T04:29:02.418639+0000","last_active":"2024-09-19T04:29:19.351919+0000","last_peered":"2024-09-19T04:29:19.351919+0000","last_clean":"2024-09-19T04:29:19.351919+0000","last_became_active":"2024-09-19T04:29:02.418334+0000","last_became_peered":"2024-09-19T04:29:02.418334+0000","last_unstale":"2024-09-19T04:29:19.351919+0000","last_undegraded":"2024-09-19T04:29:19.351919+0000","last_fullsized":"2024-09-19T04:29:19.351919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.161642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353459+0000","last_change":"2024-09-19T04:29:00.504849+0000","last_active":"2024-09-19T04:29:19.353459+0000","last_peered":"2024-09-19T04:29:19.353459+0000","last_clean":"2024-09-19T04:29:19.353459+0000","last_became_active":"2024-09-19T04:29:00.504618+0000","last_became_peered":"2024-09-19T04:29:00.504618+0000","last_unstale":"2024-09-19T04:29:19.353459+0000","last_undegraded":"2024-09-19T04:29:19.353459+0000","last_fullsized":"2024-09-19T04:29:19.353459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:31.038078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.354455+0000","last_change":"2024-09-19T04:29:19.354455+0000","last_active":"2024-09-19T04:29:19.354455+0000","last_peered":"2024-09-19T04:29:19.354455+0000","last_clean":"2024-09-19T04:29:19.354455+0000","last_became_active":"2024-09-19T04:29:19.354062+0000","last_became_peered":"2024-09-19T04:29:19.354062+0000","last_unstale":"2024-09-19T04:29:19.354455+0000","last_undegraded":"2024-09-19T04:29:19.354455+0000","last_fullsized":"2024-09-19T04:29:19.354455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:17.134082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475475+0000","last_change":"2024-09-19T04:29:00.506294+0000","last_active":"2024-09-19T04:29:18.475475+0000","last_peered":"2024-09-19T04:29:18.475475+0000","last_clean":"2024-09-19T04:29:18.475475+0000","last_became_active":"2024-09-19T04:29:00.506028+0000","last_became_peered":"2024-09-19T04:29:00.506028+0000","last_unstale":"2024-09-19T04:29:18.475475+0000","last_undegraded":"2024-09-19T04:29:18.475475+0000","last_fullsized":"2024-09-19T04:29:18.475475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.972980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479845+0000","last_change":"2024-09-19T04:29:02.414995+0000","last_active":"2024-09-19T04:29:18.479845+0000","last_peered":"2024-09-19T04:29:18.479845+0000","last_clean":"2024-09-19T04:29:18.479845+0000","last_became_active":"2024-09-19T04:29:02.414675+0000","last_became_peered":"2024-09-19T04:29:02.414675+0000","last_unstale":"2024-09-19T04:29:18.479845+0000","last_undegraded":"2024-09-19T04:29:18.479845+0000","last_fullsized":"2024-09-19T04:29:18.479845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:40.466483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351703+0000","last_change":"2024-09-19T04:29:00.389510+0000","last_active":"2024-09-19T04:29:19.351703+0000","last_peered":"2024-09-19T04:29:19.351703+0000","last_clean":"2024-09-19T04:29:19.351703+0000","last_became_active":"2024-09-19T04:29:00.389222+0000","last_became_peered":"2024-09-19T04:29:00.389222+0000","last_unstale":"2024-09-19T04:29:19.351703+0000","last_undegraded":"2024-09-19T04:29:19.351703+0000","last_fullsized":"2024-09-19T04:29:19.351703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:00.290076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477405+0000","last_change":"2024-09-19T04:29:02.422356+0000","last_active":"2024-09-19T04:29:18.477405+0000","last_peered":"2024-09-19T04:29:18.477405+0000","last_clean":"2024-09-19T04:29:18.477405+0000","last_became_active":"2024-09-19T04:29:02.422037+0000","last_became_peered":"2024-09-19T04:29:02.422037+0000","last_unstale":"2024-09-19T04:29:18.477405+0000","last_undegraded":"2024-09-19T04:29:18.477405+0000","last_fullsized":"2024-09-19T04:29:18.477405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:40.192439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478547+0000","last_change":"2024-09-19T04:29:00.399188+0000","last_active":"2024-09-19T04:29:18.478547+0000","last_peered":"2024-09-19T04:29:18.478547+0000","last_clean":"2024-09-19T04:29:18.478547+0000","last_became_active":"2024-09-19T04:29:00.398880+0000","last_became_peered":"2024-09-19T04:29:00.398880+0000","last_unstale":"2024-09-19T04:29:18.478547+0000","last_undegraded":"2024-09-19T04:29:18.478547+0000","last_fullsized":"2024-09-19T04:29:18.478547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:55.581504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351701+0000","last_change":"2024-09-19T04:29:02.408174+0000","last_active":"2024-09-19T04:29:19.351701+0000","last_peered":"2024-09-19T04:29:19.351701+0000","last_clean":"2024-09-19T04:29:19.351701+0000","last_became_active":"2024-09-19T04:29:02.407822+0000","last_became_peered":"2024-09-19T04:29:02.407822+0000","last_unstale":"2024-09-19T04:29:19.351701+0000","last_undegraded":"2024-09-19T04:29:19.351701+0000","last_fullsized":"2024-09-19T04:29:19.351701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480127+0000","last_change":"2024-09-19T04:29:00.398445+0000","last_active":"2024-09-19T04:29:18.480127+0000","last_peered":"2024-09-19T04:29:18.480127+0000","last_clean":"2024-09-19T04:29:18.480127+0000","last_became_active":"2024-09-19T04:29:00.397923+0000","last_became_peered":"2024-09-19T04:29:00.397923+0000","last_unstale":"2024-09-19T04:29:18.480127+0000","last_undegraded":"2024-09-19T04:29:18.480127+0000","last_fullsized":"2024-09-19T04:29:18.480127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:32.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352593+0000","last_change":"2024-09-19T04:29:02.416685+0000","last_active":"2024-09-19T04:29:19.352593+0000","last_peered":"2024-09-19T04:29:19.352593+0000","last_clean":"2024-09-19T04:29:19.352593+0000","last_became_active":"2024-09-19T04:29:02.416311+0000","last_became_peered":"2024-09-19T04:29:02.416311+0000","last_unstale":"2024-09-19T04:29:19.352593+0000","last_undegraded":"2024-09-19T04:29:19.352593+0000","last_fullsized":"2024-09-19T04:29:19.352593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:47.988318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627371+0000","last_change":"2024-09-19T04:29:02.424585+0000","last_active":"2024-09-19T04:29:18.627371+0000","last_peered":"2024-09-19T04:29:18.627371+0000","last_clean":"2024-09-19T04:29:18.627371+0000","last_became_active":"2024-09-19T04:29:02.424253+0000","last_became_peered":"2024-09-19T04:29:02.424253+0000","last_unstale":"2024-09-19T04:29:18.627371+0000","last_undegraded":"2024-09-19T04:29:18.627371+0000","last_fullsized":"2024-09-19T04:29:18.627371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:55.865599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480500+0000","last_change":"2024-09-19T04:29:00.396490+0000","last_active":"2024-09-19T04:29:18.480500+0000","last_peered":"2024-09-19T04:29:18.480500+0000","last_clean":"2024-09-19T04:29:18.480500+0000","last_became_active":"2024-09-19T04:29:00.394727+0000","last_became_peered":"2024-09-19T04:29:00.394727+0000","last_unstale":"2024-09-19T04:29:18.480500+0000","last_undegraded":"2024-09-19T04:29:18.480500+0000","last_fullsized":"2024-09-19T04:29:18.480500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:43.724257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475575+0000","last_change":"2024-09-19T04:29:02.425557+0000","last_active":"2024-09-19T04:29:18.475575+0000","last_peered":"2024-09-19T04:29:18.475575+0000","last_clean":"2024-09-19T04:29:18.475575+0000","last_became_active":"2024-09-19T04:29:02.425261+0000","last_became_peered":"2024-09-19T04:29:02.425261+0000","last_unstale":"2024-09-19T04:29:18.475575+0000","last_undegraded":"2024-09-19T04:29:18.475575+0000","last_fullsized":"2024-09-19T04:29:18.475575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:20.204026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480250+0000","last_change":"2024-09-19T04:29:00.397849+0000","last_active":"2024-09-19T04:29:18.480250+0000","last_peered":"2024-09-19T04:29:18.480250+0000","last_clean":"2024-09-19T04:29:18.480250+0000","last_became_active":"2024-09-19T04:29:00.397226+0000","last_became_peered":"2024-09-19T04:29:00.397226+0000","last_unstale":"2024-09-19T04:29:18.480250+0000","last_undegraded":"2024-09-19T04:29:18.480250+0000","last_fullsized":"2024-09-19T04:29:18.480250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:04.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479555+0000","last_change":"2024-09-19T04:29:02.416202+0000","last_active":"2024-09-19T04:29:18.479555+0000","last_peered":"2024-09-19T04:29:18.479555+0000","last_clean":"2024-09-19T04:29:18.479555+0000","last_became_active":"2024-09-19T04:29:02.415886+0000","last_became_peered":"2024-09-19T04:29:02.415886+0000","last_unstale":"2024-09-19T04:29:18.479555+0000","last_undegraded":"2024-09-19T04:29:18.479555+0000","last_fullsized":"2024-09-19T04:29:18.479555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:06.217254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352054+0000","last_change":"2024-09-19T04:29:00.505162+0000","last_active":"2024-09-19T04:29:19.352054+0000","last_peered":"2024-09-19T04:29:19.352054+0000","last_clean":"2024-09-19T04:29:19.352054+0000","last_became_active":"2024-09-19T04:29:00.504584+0000","last_became_peered":"2024-09-19T04:29:00.504584+0000","last_unstale":"2024-09-19T04:29:19.352054+0000","last_undegraded":"2024-09-19T04:29:19.352054+0000","last_fullsized":"2024-09-19T04:29:19.352054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:44.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351873+0000","last_change":"2024-09-19T04:29:02.415095+0000","last_active":"2024-09-19T04:29:19.351873+0000","last_peered":"2024-09-19T04:29:19.351873+0000","last_clean":"2024-09-19T04:29:19.351873+0000","last_became_active":"2024-09-19T04:29:02.414576+0000","last_became_peered":"2024-09-19T04:29:02.414576+0000","last_unstale":"2024-09-19T04:29:19.351873+0000","last_undegraded":"2024-09-19T04:29:19.351873+0000","last_fullsized":"2024-09-19T04:29:19.351873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:52.744011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474926+0000","last_change":"2024-09-19T04:29:00.397737+0000","last_active":"2024-09-19T04:29:18.474926+0000","last_peered":"2024-09-19T04:29:18.474926+0000","last_clean":"2024-09-19T04:29:18.474926+0000","last_became_active":"2024-09-19T04:29:00.397397+0000","last_became_peered":"2024-09-19T04:29:00.397397+0000","last_unstale":"2024-09-19T04:29:18.474926+0000","last_undegraded":"2024-09-19T04:29:18.474926+0000","last_fullsized":"2024-09-19T04:29:18.474926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:49:16.108744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":45068,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":147,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":372736,"data_stored":146678,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":126,"ondisk_log_size":126,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547217,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":440869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808853,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32728,"kb_used_data":1544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712424,"statfs":{"total":95995035648,"available":95961522176,"internally_reserved":0,"allocated":1581056,"data_stored":1073786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972378,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201312,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":440981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430245,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1032935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593769,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":440472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822702,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1527808,"data_stored":1032226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953524,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":441302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182457,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":440783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411390,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27984,"kb_used_data":960,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717168,"statfs":{"total":95995035648,"available":95966380032,"internally_reserved":0,"allocated":983040,"data_stored":488417,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27960,"kb_used_data":936,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717192,"statfs":{"total":95995035648,"available":95966404608,"internally_reserved":0,"allocated":958464,"data_stored":487067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738440,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":441743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":46802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":48152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":81920,"data_stored":43036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:29:29.825 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T04:29:29.825 INFO:tasks.cephadm:Setting up client nodes... 2024-09-19T04:29:29.826 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-09-19T04:29:30.072 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:30.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 -- 172.21.15.70:0/2359895007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0102690 msgr2=0x7fdec0108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:30.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 --2- 172.21.15.70:0/2359895007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0102690 0x7fdec0108f20 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fdeb8009ca0 tx=0x7fdeb802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 -- 172.21.15.70:0/2359895007 shutdown_connections 2024-09-19T04:29:30.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 --2- 172.21.15.70:0/2359895007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0102690 0x7fdec0108f20 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 --2- 172.21.15.70:0/2359895007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec0101cd0 0x7fdec0102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 --2- 172.21.15.70:0/2359895007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec0100ad0 0x7fdec0100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 -- 172.21.15.70:0/2359895007 >> 172.21.15.70:0/2359895007 conn(0x7fdec00fc280 msgr2=0x7fdec00fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:30.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 -- 172.21.15.70:0/2359895007 shutdown_connections 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.517+0000 7fdec8237640 1 -- 172.21.15.70:0/2359895007 wait complete. 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec8237640 1 Processor -- start 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec8237640 1 -- start start 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec8237640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec0100ad0 0x7fdec0104a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec8237640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0101cd0 0x7fdec01030b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec8237640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec0102690 0x7fdec01035f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec8237640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdec010c740 con 0x7fdec0101cd0 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec8237640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdec010c5c0 con 0x7fdec0100ad0 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec8237640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdec010c8c0 con 0x7fdec0102690 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0101cd0 0x7fdec01030b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0101cd0 0x7fdec01030b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46100/0 (socket says 172.21.15.70:46100) 2024-09-19T04:29:30.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 -- 172.21.15.70:0/1667747321 learned_addr learned my addr 172.21.15.70:0/1667747321 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec5fd3640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec0100ad0 0x7fdec0104a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec67d4640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec0102690 0x7fdec01035f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 -- 172.21.15.70:0/1667747321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec0102690 msgr2=0x7fdec01035f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec0102690 0x7fdec01035f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 -- 172.21.15.70:0/1667747321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec0100ad0 msgr2=0x7fdec0104a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec0100ad0 0x7fdec0104a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 -- 172.21.15.70:0/1667747321 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec0103eb0 con 0x7fdec0101cd0 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec67d4640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec0102690 0x7fdec01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.518+0000 7fdec57d2640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0101cd0 0x7fdec01030b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000d950 tx=0x7fdeb000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.519+0000 7fdeb6ffd640 1 -- 172.21.15.70:0/1667747321 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb0017070 con 0x7fdec0101cd0 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.519+0000 7fdeb6ffd640 1 -- 172.21.15.70:0/1667747321 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdeb0009c30 con 0x7fdec0101cd0 2024-09-19T04:29:30.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.519+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec01a1ff0 con 0x7fdec0101cd0 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.519+0000 7fdeb6ffd640 1 -- 172.21.15.70:0/1667747321 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb000f6b0 con 0x7fdec0101cd0 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.519+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec01a24a0 con 0x7fdec0101cd0 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.520+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdec01a26d0 con 0x7fdec0101cd0 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.521+0000 7fdeb6ffd640 1 -- 172.21.15.70:0/1667747321 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fdeb0010a50 con 0x7fdec0101cd0 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.521+0000 7fdeb6ffd640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdeac0a32d0 0x7fdeac0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.521+0000 7fdec5fd3640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdeac0a32d0 0x7fdeac0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.521+0000 7fdeb6ffd640 1 -- 172.21.15.70:0/1667747321 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fdeb00cf690 con 0x7fdec0101cd0 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.522+0000 7fdec5fd3640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdeac0a32d0 0x7fdeac0a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0058c0 tx=0x7fdebc00a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:30.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.525+0000 7fdeb6ffd640 1 -- 172.21.15.70:0/1667747321 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdeb0009de0 con 0x7fdec0101cd0 2024-09-19T04:29:30.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.758+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7fdec01a2eb0 con 0x7fdec0101cd0 2024-09-19T04:29:30.760 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:30 smithi070 ceph-mon[30942]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:29:30.760 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:30 smithi070 ceph-mon[30942]: pgmap v289: 97 pgs: 97 active+clean; 626 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:30.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.760+0000 7fdeb6ffd640 1 -- 172.21.15.70:0/1667747321 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v31) ==== 170+0+59 (secure 0 0 0) 0x7fdeb009c280 con 0x7fdec0101cd0 2024-09-19T04:29:30.761 INFO:teuthology.orchestra.run.smithi070.stdout:[client.0] 2024-09-19T04:29:30.762 INFO:teuthology.orchestra.run.smithi070.stdout: key = AQCqqOtm8JVGLRAAyCjv65zkPdHtxn8C1Y/GDw== 2024-09-19T04:29:30.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdeac0a32d0 msgr2=0x7fdeac0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:30.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdeac0a32d0 0x7fdeac0a5790 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fdebc0058c0 tx=0x7fdebc00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0101cd0 msgr2=0x7fdec01030b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:30.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0101cd0 0x7fdec01030b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fdeb000d950 tx=0x7fdeb000de10 comp rx=0 tx=0).stop 2024-09-19T04:29:30.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 shutdown_connections 2024-09-19T04:29:30.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fdeac0a32d0 0x7fdeac0a5790 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec0102690 0x7fdec01035f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec0101cd0 0x7fdec01030b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 --2- 172.21.15.70:0/1667747321 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec0100ad0 0x7fdec0104a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:30.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.762+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 >> 172.21.15.70:0/1667747321 conn(0x7fdec00fc280 msgr2=0x7fdec0069fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:30.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.763+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 shutdown_connections 2024-09-19T04:29:30.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:30.763+0000 7fdec8237640 1 -- 172.21.15.70:0/1667747321 wait complete. 2024-09-19T04:29:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:30 smithi134 ceph-mon[34525]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:29:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:30 smithi134 ceph-mon[34525]: pgmap v289: 97 pgs: 97 active+clean; 626 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:30.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:30 smithi167 ceph-mon[34339]: from='client.14742 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:29:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:30 smithi167 ceph-mon[34339]: pgmap v289: 97 pgs: 97 active+clean; 626 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.3 KiB/s rd, 4.3 KiB/s wr, 7 op/s; 2 B/s, 0 objects/s recovering 2024-09-19T04:29:31.471 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:29:31.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-09-19T04:29:31.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T04:29:31.509 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T04:29:31.509 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-09-19T04:29:31.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph mgr dump --format=json 2024-09-19T04:29:31.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:31 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1667747321' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:29:31.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:31 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1667747321' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:29:31.793 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:31 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1667747321' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:29:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:31 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1667747321' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:29:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:31 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1667747321' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-09-19T04:29:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:31 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1667747321' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-09-19T04:29:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 -- 172.21.15.70:0/3886735594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944106f30 msgr2=0x7f994410eab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 --2- 172.21.15.70:0/3886735594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944106f30 0x7f994410eab0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f993c009ca0 tx=0x7f993c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 -- 172.21.15.70:0/3886735594 shutdown_connections 2024-09-19T04:29:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 --2- 172.21.15.70:0/3886735594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944106f30 0x7f994410eab0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 --2- 172.21.15.70:0/3886735594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9944100cc0 0x7f9944106800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 --2- 172.21.15.70:0/3886735594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9944100310 0x7f99441006f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 -- 172.21.15.70:0/3886735594 >> 172.21.15.70:0/3886735594 conn(0x7f9944077210 msgr2=0x7f99440fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:32.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 -- 172.21.15.70:0/3886735594 shutdown_connections 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.264+0000 7f994c40f640 1 -- 172.21.15.70:0/3886735594 wait complete. 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994c40f640 1 Processor -- start 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994c40f640 1 -- start start 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994c40f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9944100310 0x7f9944101290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994c40f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944100cc0 0x7f99441017d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994c40f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9944106f30 0x7f9944101d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994c40f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9944112070 con 0x7f9944100cc0 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994c40f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9944111ef0 con 0x7f9944100310 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994c40f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f99441121f0 con 0x7f9944106f30 2024-09-19T04:29:32.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f99499aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944100cc0 0x7f99441017d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f99499aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944100cc0 0x7f99441017d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46132/0 (socket says 172.21.15.70:46132) 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f99499aa640 1 -- 172.21.15.70:0/3225599043 learned_addr learned my addr 172.21.15.70:0/3225599043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994a9ac640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9944106f30 0x7f9944101d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f994a1ab640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9944100310 0x7f9944101290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f99499aa640 1 -- 172.21.15.70:0/3225599043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9944106f30 msgr2=0x7f9944101d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f99499aa640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9944106f30 0x7f9944101d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f99499aa640 1 -- 172.21.15.70:0/3225599043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9944100310 msgr2=0x7f9944101290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f99499aa640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9944100310 0x7f9944101290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.265+0000 7f99499aa640 1 -- 172.21.15.70:0/3225599043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99441a6ae0 con 0x7f9944100cc0 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.266+0000 7f994a9ac640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9944106f30 0x7f9944101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.266+0000 7f99499aa640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944100cc0 0x7f99441017d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993800b4a0 tx=0x7f993800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.266+0000 7f99377fe640 1 -- 172.21.15.70:0/3225599043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938014070 con 0x7f9944100cc0 2024-09-19T04:29:32.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.266+0000 7f99377fe640 1 -- 172.21.15.70:0/3225599043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9938010ae0 con 0x7f9944100cc0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.266+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99441a6dd0 con 0x7f9944100cc0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.266+0000 7f99377fe640 1 -- 172.21.15.70:0/3225599043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9938017c70 con 0x7f9944100cc0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.266+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99441a7280 con 0x7f9944100cc0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.267+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9944100770 con 0x7f9944100cc0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.268+0000 7f99377fe640 1 -- 172.21.15.70:0/3225599043 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9938017070 con 0x7f9944100cc0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.268+0000 7f99377fe640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a32d0 0x7f99300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.269+0000 7f994a1ab640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a32d0 0x7f99300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.269+0000 7f99377fe640 1 -- 172.21.15.70:0/3225599043 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f99380ced80 con 0x7f9944100cc0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.269+0000 7f994a1ab640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a32d0 0x7f99300a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f994000a810 tx=0x7f9940008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:32.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.273+0000 7f99377fe640 1 -- 172.21.15.70:0/3225599043 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f993809ba80 con 0x7f9944100cc0 2024-09-19T04:29:32.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.489+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f994410a170 con 0x7f9944100cc0 2024-09-19T04:29:32.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.494+0000 7f99377fe640 1 -- 172.21.15.70:0/3225599043 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+264048 (secure 0 0 0) 0x7f993809b380 con 0x7f9944100cc0 2024-09-19T04:29:32.498 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:32.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a32d0 msgr2=0x7f99300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a32d0 0x7f99300a5790 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f994000a810 tx=0x7f9940008040 comp rx=0 tx=0).stop 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944100cc0 msgr2=0x7f99441017d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944100cc0 0x7f99441017d0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f993800b4a0 tx=0x7f993800b960 comp rx=0 tx=0).stop 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 shutdown_connections 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a32d0 0x7f99300a5790 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9944106f30 0x7f9944101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9944100cc0 0x7f99441017d0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 --2- 172.21.15.70:0/3225599043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9944100310 0x7f9944101290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 >> 172.21.15.70:0/3225599043 conn(0x7f9944077210 msgr2=0x7f9944105170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 shutdown_connections 2024-09-19T04:29:32.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:32.497+0000 7f994c40f640 1 -- 172.21.15.70:0/3225599043 wait complete. 2024-09-19T04:29:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:32 smithi134 ceph-mon[34525]: pgmap v290: 97 pgs: 97 active+clean; 626 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T04:29:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:32 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3225599043' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:29:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:32 smithi070 ceph-mon[30942]: pgmap v290: 97 pgs: 97 active+clean; 626 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T04:29:32.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:32 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3225599043' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:29:32.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:32 smithi167 ceph-mon[34339]: pgmap v290: 97 pgs: 97 active+clean; 626 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 6.2 KiB/s rd, 3.9 KiB/s wr, 8 op/s; 1 B/s, 0 objects/s recovering 2024-09-19T04:29:32.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:32 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3225599043' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-09-19T04:29:33.094 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":17,"flags":0,"active_gid":14148,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6800","nonce":4212188848},{"type":"v1","addr":"172.21.15.70:6801","nonce":4212188848}]},"active_addr":"172.21.15.70:6801/4212188848","active_change":"2024-09-19T04:22:17.308371+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24106,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24116,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.70:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":544441745}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3933277587}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":3999565316}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":2420707462}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.70:0","nonce":999804527}]}]} 2024-09-19T04:29:33.102 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-09-19T04:29:33.103 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-09-19T04:29:33.103 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:29:33.347 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 -- 172.21.15.70:0/1677300839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8106a80 msgr2=0x7f5bb8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/1677300839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8106a80 0x7f5bb8106e60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009930 tx=0x7f5bb002a420 comp rx=0 tx=0).stop 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 -- 172.21.15.70:0/1677300839 shutdown_connections 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/1677300839 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bb8101420 0x7f5bb810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/1677300839 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb8100a80 0x7f5bb8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/1677300839 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8106a80 0x7f5bb8106e60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 -- 172.21.15.70:0/1677300839 >> 172.21.15.70:0/1677300839 conn(0x7f5bb80fc7a0 msgr2=0x7f5bb80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 -- 172.21.15.70:0/1677300839 shutdown_connections 2024-09-19T04:29:33.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 -- 172.21.15.70:0/1677300839 wait complete. 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.813+0000 7f5bc04d3640 1 Processor -- start 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 -- start start 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bb8100a80 0x7f5bb8198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8101420 0x7f5bb8198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb8106a80 0x7f5bb819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8110ee0 con 0x7f5bb8101420 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8110d60 con 0x7f5bb8100a80 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5bb8111060 con 0x7f5bb8106a80 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8101420 0x7f5bb8198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8101420 0x7f5bb8198950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45284/0 (socket says 172.21.15.70:45284) 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 -- 172.21.15.70:0/2822956028 learned_addr learned my addr 172.21.15.70:0/2822956028 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:33.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 -- 172.21.15.70:0/2822956028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb8106a80 msgr2=0x7f5bb819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb8106a80 0x7f5bb819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 -- 172.21.15.70:0/2822956028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bb8100a80 msgr2=0x7f5bb8198410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bb8100a80 0x7f5bb8198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 -- 172.21.15.70:0/2822956028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bb819d3c0 con 0x7f5bb8101420 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bbda6e640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8101420 0x7f5bb8198950 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c920 tx=0x7f5bac00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bb77fe640 1 -- 172.21.15.70:0/2822956028 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac007c70 con 0x7f5bb8101420 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bb77fe640 1 -- 172.21.15.70:0/2822956028 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5bac007e10 con 0x7f5bb8101420 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bb819d6b0 con 0x7f5bb8101420 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bb77fe640 1 -- 172.21.15.70:0/2822956028 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bac018850 con 0x7f5bb8101420 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.814+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bb81a4f90 con 0x7f5bb8101420 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.815+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bb8100ee0 con 0x7f5bb8101420 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.817+0000 7f5bb77fe640 1 -- 172.21.15.70:0/2822956028 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5bac018a10 con 0x7f5bb8101420 2024-09-19T04:29:33.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.817+0000 7f5bb77fe640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5ba00a32d0 0x7f5ba00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.817+0000 7f5bbe26f640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5ba00a32d0 0x7f5ba00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.817+0000 7f5bb77fe640 1 -- 172.21.15.70:0/2822956028 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f5bac0cfee0 con 0x7f5bb8101420 2024-09-19T04:29:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.818+0000 7f5bbe26f640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5ba00a32d0 0x7f5ba00a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009230 tx=0x7f5bb0000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:33.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.820+0000 7f5bb77fe640 1 -- 172.21.15.70:0/2822956028 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bac014030 con 0x7f5bb8101420 2024-09-19T04:29:33.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.987+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5bb8199770 con 0x7f5bb8101420 2024-09-19T04:29:33.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.988+0000 7f5bb77fe640 1 -- 172.21.15.70:0/2822956028 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22679 (secure 0 0 0) 0x7f5bb8199770 con 0x7f5bb8101420 2024-09-19T04:29:33.990 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:33.990 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:29:18.471871+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:29:33.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5ba00a32d0 msgr2=0x7f5ba00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5ba00a32d0 0x7f5ba00a5790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0009230 tx=0x7f5bb0000bc0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8101420 msgr2=0x7f5bb8198950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8101420 0x7f5bb8198950 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f5bac00c920 tx=0x7f5bac00cde0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 shutdown_connections 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5ba00a32d0 0x7f5ba00a5790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bb8106a80 0x7f5bb819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bb8101420 0x7f5bb8198950 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 --2- 172.21.15.70:0/2822956028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bb8100a80 0x7f5bb8198410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 >> 172.21.15.70:0/2822956028 conn(0x7f5bb80fc7a0 msgr2=0x7f5bb80fe460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 shutdown_connections 2024-09-19T04:29:33.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:33.991+0000 7f5bc04d3640 1 -- 172.21.15.70:0/2822956028 wait complete. 2024-09-19T04:29:34.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:34 smithi070 ceph-mon[30942]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-09-19T04:29:34.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:34 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2822956028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:34.741 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-09-19T04:29:34.741 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:29:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:34 smithi134 ceph-mon[34525]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-09-19T04:29:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:34 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2822956028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:34 smithi167 ceph-mon[34339]: pgmap v291: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 7.3 KiB/s rd, 4.6 KiB/s wr, 9 op/s 2024-09-19T04:29:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:34 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2822956028' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:34.987 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:35.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 -- 172.21.15.70:0/2016087078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 msgr2=0x7fa030100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 --2- 172.21.15.70:0/2016087078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 0x7fa030100730 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fa020009cd0 tx=0x7fa02002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 -- 172.21.15.70:0/2016087078 shutdown_connections 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 --2- 172.21.15.70:0/2016087078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030106f50 0x7fa03010eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 --2- 172.21.15.70:0/2016087078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa030100d00 0x7fa030106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 --2- 172.21.15.70:0/2016087078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 0x7fa030100730 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 -- 172.21.15.70:0/2016087078 >> 172.21.15.70:0/2016087078 conn(0x7fa030077210 msgr2=0x7fa0300fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 -- 172.21.15.70:0/2016087078 shutdown_connections 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.439+0000 7fa038732640 1 -- 172.21.15.70:0/2016087078 wait complete. 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa038732640 1 Processor -- start 2024-09-19T04:29:35.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa038732640 1 -- start start 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa038732640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 0x7fa0301012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa038732640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa030100d00 0x7fa030101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa038732640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030106f50 0x7fa030101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa038732640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa030112070 con 0x7fa030100350 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa038732640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa030111ef0 con 0x7fa030106f50 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa038732640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa0301121f0 con 0x7fa030100d00 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 0x7fa0301012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 0x7fa0301012d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45308/0 (socket says 172.21.15.70:45308) 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 -- 172.21.15.70:0/4034299557 learned_addr learned my addr 172.21.15.70:0/4034299557 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 -- 172.21.15.70:0/4034299557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa030100d00 msgr2=0x7fa030101810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa030100d00 0x7fa030101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 -- 172.21.15.70:0/4034299557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030106f50 msgr2=0x7fa030101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030106f50 0x7fa030101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 -- 172.21.15.70:0/4034299557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa0301a6b10 con 0x7fa030100350 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa0364ce640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 0x7fa0301012d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa0200097b0 tx=0x7fa020003ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.440+0000 7fa02f7fe640 1 -- 172.21.15.70:0/4034299557 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa020004240 con 0x7fa030100350 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.441+0000 7fa02f7fe640 1 -- 172.21.15.70:0/4034299557 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa0200305a0 con 0x7fa030100350 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.441+0000 7fa02f7fe640 1 -- 172.21.15.70:0/4034299557 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa0200466e0 con 0x7fa030100350 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.441+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0301a6da0 con 0x7fa030100350 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.441+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa0301a7250 con 0x7fa030100350 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.441+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa0301007b0 con 0x7fa030100350 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.443+0000 7fa02f7fe640 1 -- 172.21.15.70:0/4034299557 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa020030750 con 0x7fa030100350 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.443+0000 7fa02f7fe640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa0180a32d0 0x7fa0180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.443+0000 7fa035ccd640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa0180a32d0 0x7fa0180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:35.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.443+0000 7fa02f7fe640 1 -- 172.21.15.70:0/4034299557 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fa02002e030 con 0x7fa030100350 2024-09-19T04:29:35.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.444+0000 7fa035ccd640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa0180a32d0 0x7fa0180a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa030102d60 tx=0x7fa024006c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:35.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.448+0000 7fa02f7fe640 1 -- 172.21.15.70:0/4034299557 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa02004b060 con 0x7fa030100350 2024-09-19T04:29:35.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.617+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa03002d7c0 con 0x7fa030100350 2024-09-19T04:29:35.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.618+0000 7fa02f7fe640 1 -- 172.21.15.70:0/4034299557 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22679 (secure 0 0 0) 0x7fa0200453e0 con 0x7fa030100350 2024-09-19T04:29:35.620 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:29:35.620 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:29:18.471871+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:29:35.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa0180a32d0 msgr2=0x7fa0180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:35.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa0180a32d0 0x7fa0180a5790 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fa030102d60 tx=0x7fa024006c90 comp rx=0 tx=0).stop 2024-09-19T04:29:35.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 msgr2=0x7fa0301012d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:35.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 0x7fa0301012d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fa0200097b0 tx=0x7fa020003ba0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 shutdown_connections 2024-09-19T04:29:35.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa0180a32d0 0x7fa0180a5790 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa030106f50 0x7fa030101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa030100d00 0x7fa030101810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 --2- 172.21.15.70:0/4034299557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa030100350 0x7fa0301012d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:35.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 >> 172.21.15.70:0/4034299557 conn(0x7fa030077210 msgr2=0x7fa030105320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:35.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.620+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 shutdown_connections 2024-09-19T04:29:35.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:35.621+0000 7fa038732640 1 -- 172.21.15.70:0/4034299557 wait complete. 2024-09-19T04:29:36.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-09-19T04:29:36.304 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-09-19T04:29:36.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-09-19T04:29:36.305 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-09-19T04:29:36.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-09-19T04:29:36.306 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-09-19T04:29:36.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-09-19T04:29:36.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-09-19T04:29:36.307 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-09-19T04:29:36.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-09-19T04:29:36.308 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-09-19T04:29:36.309 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-09-19T04:29:36.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:36 smithi070 ceph-mon[30942]: pgmap v292: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T04:29:36.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:36 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4034299557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:36.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:36 smithi134 ceph-mon[34525]: pgmap v292: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T04:29:36.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:36 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4034299557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:36.880 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:36.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:36 smithi167 ceph-mon[34339]: pgmap v292: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T04:29:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:36 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4034299557' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:29:37.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 -- 172.21.15.70:0/3685773842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 msgr2=0x7f389c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 --2- 172.21.15.70:0/3685773842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 0x7f389c10d950 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f3894009cd0 tx=0x7f389402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 -- 172.21.15.70:0/3685773842 shutdown_connections 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 --2- 172.21.15.70:0/3685773842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 0x7f389c10d950 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 --2- 172.21.15.70:0/3685773842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f389c100a80 0x7f389c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 --2- 172.21.15.70:0/3685773842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c106a80 0x7f389c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 -- 172.21.15.70:0/3685773842 >> 172.21.15.70:0/3685773842 conn(0x7f389c0fc7a0 msgr2=0x7f389c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 -- 172.21.15.70:0/3685773842 shutdown_connections 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.469+0000 7f38a3943640 1 -- 172.21.15.70:0/3685773842 wait complete. 2024-09-19T04:29:37.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a3943640 1 Processor -- start 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a3943640 1 -- start start 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a3943640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c100a80 0x7f389c198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a3943640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 0x7f389c198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a3943640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f389c106a80 0x7f389c19ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a3943640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f389c110f10 con 0x7f389c101420 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a3943640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f389c110d90 con 0x7f389c106a80 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a3943640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f389c111090 con 0x7f389c100a80 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a0ede640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 0x7f389c198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a0ede640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 0x7f389c198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45324/0 (socket says 172.21.15.70:45324) 2024-09-19T04:29:37.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a0ede640 1 -- 172.21.15.70:0/859023960 learned_addr learned my addr 172.21.15.70:0/859023960 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a1ee0640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f389c106a80 0x7f389c19ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a16df640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c100a80 0x7f389c198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a0ede640 1 -- 172.21.15.70:0/859023960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c100a80 msgr2=0x7f389c198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a0ede640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f389c100a80 0x7f389c198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a0ede640 1 -- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f389c106a80 msgr2=0x7f389c19ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a0ede640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f389c106a80 0x7f389c19ce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a0ede640 1 -- 172.21.15.70:0/859023960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f389c19d510 con 0x7f389c101420 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.470+0000 7f38a1ee0640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f389c106a80 0x7f389c19ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.471+0000 7f38a0ede640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 0x7f389c198aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b4a0 tx=0x7f388c00b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.471+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c015020 con 0x7f389c101420 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.471+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f388c011d00 con 0x7f389c101420 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.471+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f389c19d800 con 0x7f389c101420 2024-09-19T04:29:37.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.471+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f388c010e50 con 0x7f389c101420 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.471+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f389c1a50e0 con 0x7f389c101420 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.472+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f389c0fd150 con 0x7f389c101420 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.473+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f388c018020 con 0x7f389c101420 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.473+0000 7f38927fc640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f38880a3470 0x7f38880a5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.474+0000 7f38a16df640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f38880a3470 0x7f38880a5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.474+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f388c0cf990 con 0x7f389c101420 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.474+0000 7f38927fc640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] conn(0x7f38880acf90 0x7f38880af430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.474+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 --> [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f388c018ec0 con 0x7f38880acf90 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.474+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f388c0cfde0 con 0x7f389c101420 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.474+0000 7f38a16df640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f38880a3470 0x7f38880a5930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3898009990 tx=0x7f3898009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.474+0000 7f38a1ee0640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] conn(0x7f38880acf90 0x7f38880af430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.474+0000 7f38a1ee0640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] conn(0x7f38880acf90 0x7f38880af430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:37.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.475+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 <== osd.1 v2:172.21.15.134:6800/3268047050 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f388c018ec0 con 0x7f38880acf90 2024-09-19T04:29:37.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 --> [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f389c1021c0 con 0x7f38880acf90 2024-09-19T04:29:37.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38927fc640 1 -- 172.21.15.70:0/859023960 <== osd.1 v2:172.21.15.134:6800/3268047050 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f389c1021c0 con 0x7f38880acf90 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] conn(0x7f38880acf90 msgr2=0x7f38880af430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] conn(0x7f38880acf90 0x7f38880af430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f38880a3470 msgr2=0x7f38880a5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f38880a3470 0x7f38880a5930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3898009990 tx=0x7f3898009110 comp rx=0 tx=0).stop 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 msgr2=0x7f389c198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 --2- 172.21.15.70:0/859023960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f389c101420 0x7f389c198aa0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f388c00b4a0 tx=0x7f388c00b8a0 comp rx=0 tx=0).stop 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a1ee0640 1 -- 172.21.15.70:0/859023960 reap_dead start 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 shutdown_connections 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 >> 172.21.15.70:0/859023960 conn(0x7f389c0fc7a0 msgr2=0x7f389c1048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 shutdown_connections 2024-09-19T04:29:37.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:37.489+0000 7f38a3943640 1 -- 172.21.15.70:0/859023960 wait complete. 2024-09-19T04:29:38.239 INFO:teuthology.orchestra.run.smithi070.stdout:55834574918 2024-09-19T04:29:38.240 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-09-19T04:29:38.295 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:38.299 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:38.336 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:38 smithi134 ceph-mon[34525]: pgmap v293: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T04:29:38.807 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:38 smithi070 ceph-mon[30942]: pgmap v293: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T04:29:38.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:38 smithi167 ceph-mon[34339]: pgmap v293: 97 pgs: 97 active+clean; 634 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 1.4 KiB/s wr, 6 op/s 2024-09-19T04:29:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.157+0000 7f2da8a70640 1 -- 172.21.15.70:0/3418607821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4102d90 msgr2=0x7f2da4103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.157+0000 7f2da8a70640 1 --2- 172.21.15.70:0/3418607821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4102d90 0x7f2da4103170 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f2d94009930 tx=0x7f2d9402a420 comp rx=0 tx=0).stop 2024-09-19T04:29:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.157+0000 7f2da8a70640 1 -- 172.21.15.70:0/3418607821 shutdown_connections 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.157+0000 7f2da8a70640 1 --2- 172.21.15.70:0/3418607821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da4108290 0x7f2da410ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.157+0000 7f2da8a70640 1 --2- 172.21.15.70:0/3418607821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4103740 0x7f2da4107b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.157+0000 7f2da8a70640 1 --2- 172.21.15.70:0/3418607821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4102d90 0x7f2da4103170 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.157+0000 7f2da8a70640 1 -- 172.21.15.70:0/3418607821 >> 172.21.15.70:0/3418607821 conn(0x7f2da40fc7d0 msgr2=0x7f2da40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.157+0000 7f2da8a70640 1 -- 172.21.15.70:0/3418607821 shutdown_connections 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.158+0000 7f2da8a70640 1 -- 172.21.15.70:0/3418607821 wait complete. 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.158+0000 7f2da8a70640 1 Processor -- start 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.158+0000 7f2da8a70640 1 -- start start 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da8a70640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4102d90 0x7f2da4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da8a70640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4103740 0x7f2da41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da8a70640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da4108290 0x7f2da419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da8a70640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2da4112060 con 0x7f2da4103740 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da8a70640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2da4111ee0 con 0x7f2da4108290 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da8a70640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2da41121e0 con 0x7f2da4102d90 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4103740 0x7f2da41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4103740 0x7f2da41989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45336/0 (socket says 172.21.15.70:45336) 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 -- 172.21.15.70:0/4247511370 learned_addr learned my addr 172.21.15.70:0/4247511370 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da2d9d640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da4108290 0x7f2da419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da259c640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4102d90 0x7f2da4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 -- 172.21.15.70:0/4247511370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4102d90 msgr2=0x7f2da4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2da4102d90 0x7f2da4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 -- 172.21.15.70:0/4247511370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da4108290 msgr2=0x7f2da419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2da4108290 0x7f2da419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 -- 172.21.15.70:0/4247511370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2da419d440 con 0x7f2da4103740 2024-09-19T04:29:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2da1d9b640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4103740 0x7f2da41989d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c970 tx=0x7f2d9800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d98014070 con 0x7f2da4103740 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.159+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2d98004440 con 0x7f2da4103740 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.160+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2da419d730 con 0x7f2da4103740 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.160+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d9800f450 con 0x7f2da4103740 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.160+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2da41a5010 con 0x7f2da4103740 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.160+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2da4062980 con 0x7f2da4103740 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.162+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2d98017070 con 0x7f2da4103740 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.162+0000 7f2d937fe640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d8c0a32d0 0x7f2d8c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.163+0000 7f2da259c640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d8c0a32d0 0x7f2d8c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.163+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f2d980cfd00 con 0x7f2da4103740 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.163+0000 7f2d937fe640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] conn(0x7f2d8c0ace00 0x7f2d8c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.163+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 --> [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d8c0af970 con 0x7f2d8c0ace00 2024-09-19T04:29:39.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.163+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2d980d0150 con 0x7f2da4103740 2024-09-19T04:29:39.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.163+0000 7f2da259c640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d8c0a32d0 0x7f2d8c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d94000c00 tx=0x7f2d940095f0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:39.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.164+0000 7f2da2d9d640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] conn(0x7f2d8c0ace00 0x7f2d8c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.164+0000 7f2da2d9d640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] conn(0x7f2d8c0ace00 0x7f2d8c0af2a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:39.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.165+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 <== osd.5 v2:172.21.15.167:6808/1206537032 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d8c0af970 con 0x7f2d8c0ace00 2024-09-19T04:29:39.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.179+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 --> [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2da4062e00 con 0x7f2d8c0ace00 2024-09-19T04:29:39.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.179+0000 7f2d937fe640 1 -- 172.21.15.70:0/4247511370 <== osd.5 v2:172.21.15.167:6808/1206537032 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2da4062e00 con 0x7f2d8c0ace00 2024-09-19T04:29:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 >> [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] conn(0x7f2d8c0ace00 msgr2=0x7f2d8c0af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] conn(0x7f2d8c0ace00 0x7f2d8c0af2a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d8c0a32d0 msgr2=0x7f2d8c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2d8c0a32d0 0x7f2d8c0a5790 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f2d94000c00 tx=0x7f2d940095f0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4103740 msgr2=0x7f2da41989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 --2- 172.21.15.70:0/4247511370 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2da4103740 0x7f2da41989d0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f2d9800c970 tx=0x7f2d9800ce30 comp rx=0 tx=0).stop 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da2d9d640 1 -- 172.21.15.70:0/4247511370 reap_dead start 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 shutdown_connections 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 >> 172.21.15.70:0/4247511370 conn(0x7f2da40fc7d0 msgr2=0x7f2da4106370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 shutdown_connections 2024-09-19T04:29:39.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.180+0000 7f2da8a70640 1 -- 172.21.15.70:0/4247511370 wait complete. 2024-09-19T04:29:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3522492573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 msgr2=0x7f2b781067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 --2- 172.21.15.70:0/3522492573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 0x7f2b781067f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c009900 tx=0x7f2b6c02a410 comp rx=0 tx=0).stop 2024-09-19T04:29:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3522492573 shutdown_connections 2024-09-19T04:29:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 --2- 172.21.15.70:0/3522492573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b78106f20 0x7f2b7810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 --2- 172.21.15.70:0/3522492573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 0x7f2b781067f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 --2- 172.21.15.70:0/3522492573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b78101df0 0x7f2b781021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3522492573 >> 172.21.15.70:0/3522492573 conn(0x7f2b780fd8f0 msgr2=0x7f2b780ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:39.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3522492573 shutdown_connections 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.367+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3522492573 wait complete. 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7cda6640 1 Processor -- start 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7cda6640 1 -- start start 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7cda6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b78101df0 0x7f2b78198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7cda6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 0x7f2b78198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7cda6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b78106f20 0x7f2b7819cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7cda6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b78111f50 con 0x7f2b781027a0 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7cda6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b78111dd0 con 0x7f2b78101df0 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7cda6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b781120d0 con 0x7f2b78106f20 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b75d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 0x7f2b78198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b75d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 0x7f2b78198990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45360/0 (socket says 172.21.15.70:45360) 2024-09-19T04:29:39.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b75d9b640 1 -- 172.21.15.70:0/3186893094 learned_addr learned my addr 172.21.15.70:0/3186893094 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.368+0000 7f2b7659c640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b78101df0 0x7f2b78198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b76d9d640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b78106f20 0x7f2b7819cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b75d9b640 1 -- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b78106f20 msgr2=0x7f2b7819cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b75d9b640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b78106f20 0x7f2b7819cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b75d9b640 1 -- 172.21.15.70:0/3186893094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b78101df0 msgr2=0x7f2b78198450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b75d9b640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b78101df0 0x7f2b78198450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b75d9b640 1 -- 172.21.15.70:0/3186893094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b7819d400 con 0x7f2b781027a0 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b7659c640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b78101df0 0x7f2b78198450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b76d9d640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b78106f20 0x7f2b7819cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b75d9b640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 0x7f2b78198990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0314b0 tx=0x7f2b6c004040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c03f030 con 0x7f2b781027a0 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b7819d690 con 0x7f2b781027a0 2024-09-19T04:29:39.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b6c004440 con 0x7f2b781027a0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6c035070 con 0x7f2b781027a0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.369+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b781a4fd0 con 0x7f2b781027a0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.370+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2b78062980 con 0x7f2b781027a0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.371+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2b6c042030 con 0x7f2b781027a0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.372+0000 7f2b677fe640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b600a3350 0x7f2b600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.372+0000 7f2b7659c640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b600a3350 0x7f2b600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.372+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f2b6c0f0500 con 0x7f2b781027a0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.372+0000 7f2b677fe640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] conn(0x7f2b600ace80 0x7f2b600af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.372+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 --> [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2b6c03ce50 con 0x7f2b600ace80 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.372+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f2b6c0f0940 con 0x7f2b781027a0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.372+0000 7f2b7659c640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b600a3350 0x7f2b600a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009c20 tx=0x7f2b68005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.372+0000 7f2b76d9d640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] conn(0x7f2b600ace80 0x7f2b600af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.373+0000 7f2b76d9d640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] conn(0x7f2b600ace80 0x7f2b600af320 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:39.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.374+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 <== osd.2 v2:172.21.15.167:6800/2534409375 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2b6c03ce50 con 0x7f2b600ace80 2024-09-19T04:29:39.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.387+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 --> [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2b78062d80 con 0x7f2b600ace80 2024-09-19T04:29:39.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.388+0000 7f2b677fe640 1 -- 172.21.15.70:0/3186893094 <== osd.2 v2:172.21.15.167:6800/2534409375 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f2b78062d80 con 0x7f2b600ace80 2024-09-19T04:29:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.388+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] conn(0x7f2b600ace80 msgr2=0x7f2b600af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.388+0000 7f2b7cda6640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] conn(0x7f2b600ace80 0x7f2b600af320 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b600a3350 msgr2=0x7f2b600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b7cda6640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b600a3350 0x7f2b600a5810 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2b68009c20 tx=0x7f2b68005f90 comp rx=0 tx=0).stop 2024-09-19T04:29:39.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 msgr2=0x7f2b78198990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b7cda6640 1 --2- 172.21.15.70:0/3186893094 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b781027a0 0x7f2b78198990 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2b6c0314b0 tx=0x7f2b6c004040 comp rx=0 tx=0).stop 2024-09-19T04:29:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b76d9d640 1 -- 172.21.15.70:0/3186893094 reap_dead start 2024-09-19T04:29:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 shutdown_connections 2024-09-19T04:29:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 >> 172.21.15.70:0/3186893094 conn(0x7f2b780fd8f0 msgr2=0x7f2b780fed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 shutdown_connections 2024-09-19T04:29:39.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:39.389+0000 7f2b7cda6640 1 -- 172.21.15.70:0/3186893094 wait complete. 2024-09-19T04:29:39.838 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:40.354 INFO:teuthology.orchestra.run.smithi070.stdout:154618822705 2024-09-19T04:29:40.354 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-09-19T04:29:40.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:40 smithi070 ceph-mon[30942]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T04:29:40.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:40 smithi134 ceph-mon[34525]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T04:29:40.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:40 smithi167 ceph-mon[34339]: pgmap v294: 97 pgs: 97 active+clean; 638 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.8 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-09-19T04:29:41.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 -- 172.21.15.70:0/2196071028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c100a80 msgr2=0x7f938c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 --2- 172.21.15.70:0/2196071028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c100a80 0x7f938c100ee0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f9380009930 tx=0x7f938002a420 comp rx=0 tx=0).stop 2024-09-19T04:29:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 -- 172.21.15.70:0/2196071028 shutdown_connections 2024-09-19T04:29:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 --2- 172.21.15.70:0/2196071028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f938c101420 0x7f938c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 --2- 172.21.15.70:0/2196071028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c100a80 0x7f938c100ee0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 --2- 172.21.15.70:0/2196071028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f938c106a80 0x7f938c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 -- 172.21.15.70:0/2196071028 >> 172.21.15.70:0/2196071028 conn(0x7f938c0fc7a0 msgr2=0x7f938c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 -- 172.21.15.70:0/2196071028 shutdown_connections 2024-09-19T04:29:41.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.413+0000 7f9392639640 1 -- 172.21.15.70:0/2196071028 wait complete. 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9392639640 1 Processor -- start 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9392639640 1 -- start start 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9392639640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f938c100a80 0x7f938c1985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9392639640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c101420 0x7f938c198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9392639640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f938c106a80 0x7f938c19ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9392639640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f938c110f10 con 0x7f938c101420 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9392639640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f938c110d90 con 0x7f938c106a80 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9392639640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f938c111090 con 0x7f938c100a80 2024-09-19T04:29:41.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c101420 0x7f938c198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c101420 0x7f938c198b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45394/0 (socket says 172.21.15.70:45394) 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938b7fe640 1 -- 172.21.15.70:0/3024305249 learned_addr learned my addr 172.21.15.70:0/3024305249 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938bfff640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f938c100a80 0x7f938c1985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f9390bd6640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f938c106a80 0x7f938c19ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938b7fe640 1 -- 172.21.15.70:0/3024305249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f938c100a80 msgr2=0x7f938c1985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938b7fe640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f938c100a80 0x7f938c1985c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938b7fe640 1 -- 172.21.15.70:0/3024305249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f938c106a80 msgr2=0x7f938c19ce90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938b7fe640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f938c106a80 0x7f938c19ce90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:41.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.414+0000 7f938b7fe640 1 -- 172.21.15.70:0/3024305249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f938c19d570 con 0x7f938c101420 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.415+0000 7f938b7fe640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c101420 0x7f938c198b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9380005940 tx=0x7f9380004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.415+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f938003f030 con 0x7f938c101420 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.415+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f938c19d800 con 0x7f938c101420 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.415+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9380003ac0 con 0x7f938c101420 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.415+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9380035070 con 0x7f938c101420 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.415+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f938c1a5140 con 0x7f938c101420 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.416+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f938c062980 con 0x7f938c101420 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.417+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9380042030 con 0x7f938c101420 2024-09-19T04:29:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f93897fa640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f93740a32d0 0x7f93740a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f938bfff640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f93740a32d0 0x7f93740a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f93800f06e0 con 0x7f938c101420 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f93897fa640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] conn(0x7f93740ace00 0x7f93740af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 --> [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f93800047a0 con 0x7f93740ace00 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f93800f0b30 con 0x7f938c101420 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f9390bd6640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] conn(0x7f93740ace00 0x7f93740af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f938bfff640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f93740a32d0 0x7f93740a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f937c009890 tx=0x7f937c008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.418+0000 7f9390bd6640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] conn(0x7f93740ace00 0x7f93740af2a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.419+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 <== osd.6 v2:172.21.15.70:6818/1741503048 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f93800047a0 con 0x7f93740ace00 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.432+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 --> [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f938c062d80 con 0x7f93740ace00 2024-09-19T04:29:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f93897fa640 1 -- 172.21.15.70:0/3024305249 <== osd.6 v2:172.21.15.70:6818/1741503048 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f938c062d80 con 0x7f93740ace00 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] conn(0x7f93740ace00 msgr2=0x7f93740af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] conn(0x7f93740ace00 0x7f93740af2a0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f93740a32d0 msgr2=0x7f93740a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f93740a32d0 0x7f93740a5790 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f937c009890 tx=0x7f937c008040 comp rx=0 tx=0).stop 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c101420 msgr2=0x7f938c198b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 --2- 172.21.15.70:0/3024305249 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f938c101420 0x7f938c198b00 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f9380005940 tx=0x7f9380004380 comp rx=0 tx=0).stop 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9390bd6640 1 -- 172.21.15.70:0/3024305249 reap_dead start 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 shutdown_connections 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 >> 172.21.15.70:0/3024305249 conn(0x7f938c0fc7a0 msgr2=0x7f938c06aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 shutdown_connections 2024-09-19T04:29:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.433+0000 7f9392639640 1 -- 172.21.15.70:0/3024305249 wait complete. 2024-09-19T04:29:41.717 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:42.251 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:42.251 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:42.252 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:42.252 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:42.274 INFO:teuthology.orchestra.run.smithi070.stdout:77309411393 2024-09-19T04:29:42.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-09-19T04:29:42.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 -- 172.21.15.70:0/1000165593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 msgr2=0x7fa1bc100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:42.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 --2- 172.21.15.70:0/1000165593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 0x7fa1bc100ae0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8009900 tx=0x7fa1b802a410 comp rx=0 tx=0).stop 2024-09-19T04:29:42.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 -- 172.21.15.70:0/1000165593 shutdown_connections 2024-09-19T04:29:42.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 --2- 172.21.15.70:0/1000165593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc101020 0x7fa1bc10d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:42.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 --2- 172.21.15.70:0/1000165593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 0x7fa1bc100ae0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:42.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 --2- 172.21.15.70:0/1000165593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1bc105220 0x7fa1bc105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:42.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 -- 172.21.15.70:0/1000165593 >> 172.21.15.70:0/1000165593 conn(0x7fa1bc077210 msgr2=0x7fa1bc077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:42.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 -- 172.21.15.70:0/1000165593 shutdown_connections 2024-09-19T04:29:42.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.297+0000 7fa1c3952640 1 -- 172.21.15.70:0/1000165593 wait complete. 2024-09-19T04:29:42.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c3952640 1 Processor -- start 2024-09-19T04:29:42.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c3952640 1 -- start start 2024-09-19T04:29:42.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c3952640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 0x7fa1bc198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:42.350 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c3952640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc101020 0x7fa1bc198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c3952640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1bc105220 0x7fa1bc19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c3952640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc10fe90 con 0x7fa1bc100680 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c3952640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc10fd10 con 0x7fa1bc101020 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c3952640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa1bc110010 con 0x7fa1bc105220 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c16ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 0x7fa1bc198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c16ee640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 0x7fa1bc198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45374/0 (socket says 172.21.15.70:45374) 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c16ee640 1 -- 172.21.15.70:0/3368708123 learned_addr learned my addr 172.21.15.70:0/3368708123 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c1eef640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1bc105220 0x7fa1bc19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:42.351 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c0eed640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc101020 0x7fa1bc198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:42.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c16ee640 1 -- 172.21.15.70:0/3368708123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1bc105220 msgr2=0x7fa1bc19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:42.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c16ee640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa1bc105220 0x7fa1bc19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:42.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c16ee640 1 -- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc101020 msgr2=0x7fa1bc198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:42.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c16ee640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc101020 0x7fa1bc198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:42.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c16ee640 1 -- 172.21.15.70:0/3368708123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1bc19d4e0 con 0x7fa1bc100680 2024-09-19T04:29:42.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.298+0000 7fa1c0eed640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa1bc101020 0x7fa1bc198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:42.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.299+0000 7fa1c16ee640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 0x7fa1bc198530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000b4a0 tx=0x7fa1b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.299+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0014070 con 0x7fa1bc100680 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.299+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1bc19d7d0 con 0x7fa1bc100680 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.299+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa1b0010ae0 con 0x7fa1bc100680 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.299+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1b0017c70 con 0x7fa1bc100680 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.299+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1bc1a50b0 con 0x7fa1bc100680 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.300+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa1bc062900 con 0x7fa1bc100680 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.301+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa1b0017070 con 0x7fa1bc100680 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.301+0000 7fa1ae7fc640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa1a80a3350 0x7fa1a80a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.302+0000 7fa1c0eed640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa1a80a3350 0x7fa1a80a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:42.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.302+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fa1b00cf480 con 0x7fa1bc100680 2024-09-19T04:29:42.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.302+0000 7fa1ae7fc640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] conn(0x7fa1a80ace80 0x7fa1a80af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:42.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.302+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 --> [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa1a80af9f0 con 0x7fa1a80ace80 2024-09-19T04:29:42.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.302+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa1b00cf8d0 con 0x7fa1bc100680 2024-09-19T04:29:42.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.302+0000 7fa1c0eed640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa1a80a3350 0x7fa1a80a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8006010 tx=0x7fa1b8000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:42.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.302+0000 7fa1c1eef640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] conn(0x7fa1a80ace80 0x7fa1a80af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:42.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.303+0000 7fa1c1eef640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] conn(0x7fa1a80ace80 0x7fa1a80af320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:42.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.303+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 <== osd.4 v2:172.21.15.134:6808/1442854624 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa1a80af9f0 con 0x7fa1a80ace80 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.317+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 --> [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa1bc062d80 con 0x7fa1a80ace80 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.317+0000 7fa1ae7fc640 1 -- 172.21.15.70:0/3368708123 <== osd.4 v2:172.21.15.134:6808/1442854624 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa1bc062d80 con 0x7fa1a80ace80 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] conn(0x7fa1a80ace80 msgr2=0x7fa1a80af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] conn(0x7fa1a80ace80 0x7fa1a80af320 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa1a80a3350 msgr2=0x7fa1a80a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa1a80a3350 0x7fa1a80a5810 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa1b8006010 tx=0x7fa1b8000bc0 comp rx=0 tx=0).stop 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 msgr2=0x7fa1bc198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 --2- 172.21.15.70:0/3368708123 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa1bc100680 0x7fa1bc198530 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fa1b000b4a0 tx=0x7fa1b000b960 comp rx=0 tx=0).stop 2024-09-19T04:29:42.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c1eef640 1 -- 172.21.15.70:0/3368708123 reap_dead start 2024-09-19T04:29:42.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 shutdown_connections 2024-09-19T04:29:42.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 >> 172.21.15.70:0/3368708123 conn(0x7fa1bc077210 msgr2=0x7fa1bc104220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:42.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 shutdown_connections 2024-09-19T04:29:42.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:41.318+0000 7fa1c3952640 1 -- 172.21.15.70:0/3368708123 wait complete. 2024-09-19T04:29:42.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:42 smithi070 ceph-mon[30942]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T04:29:42.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:42 smithi134 ceph-mon[34525]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T04:29:42.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:42 smithi167 ceph-mon[34339]: pgmap v295: 97 pgs: 97 active+clean; 638 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-09-19T04:29:43.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/288668382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 msgr2=0x7f4cb4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 --2- 172.21.15.70:0/288668382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 0x7f4cb4107b90 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8009930 tx=0x7f4ca802a420 comp rx=0 tx=0).stop 2024-09-19T04:29:43.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/288668382 shutdown_connections 2024-09-19T04:29:43.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 --2- 172.21.15.70:0/288668382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb41082a0 0x7f4cb410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 --2- 172.21.15.70:0/288668382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 0x7f4cb4107b90 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 --2- 172.21.15.70:0/288668382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cb4102d30 0x7f4cb4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/288668382 >> 172.21.15.70:0/288668382 conn(0x7f4cb40fc7d0 msgr2=0x7f4cb40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/288668382 shutdown_connections 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.051+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/288668382 wait complete. 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb8fb9640 1 Processor -- start 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb8fb9640 1 -- start start 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb8fb9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cb4102d30 0x7f4cb419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb8fb9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 0x7f4cb419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb8fb9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb41082a0 0x7f4cb419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb8fb9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb4112030 con 0x7f4cb41036e0 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb8fb9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb4111eb0 con 0x7f4cb4102d30 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb8fb9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4cb41121b0 con 0x7f4cb41082a0 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 0x7f4cb419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 0x7f4cb419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45430/0 (socket says 172.21.15.70:45430) 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb1d9b640 1 -- 172.21.15.70:0/2743234890 learned_addr learned my addr 172.21.15.70:0/2743234890 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb2d9d640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb41082a0 0x7f4cb419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb1d9b640 1 -- 172.21.15.70:0/2743234890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb41082a0 msgr2=0x7f4cb419f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb259c640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cb4102d30 0x7f4cb419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb1d9b640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cb41082a0 0x7f4cb419f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.052+0000 7f4cb1d9b640 1 -- 172.21.15.70:0/2743234890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cb4102d30 msgr2=0x7f4cb419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4cb1d9b640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cb4102d30 0x7f4cb419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4cb1d9b640 1 -- 172.21.15.70:0/2743234890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cb419f6f0 con 0x7f4cb41036e0 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4cb259c640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cb4102d30 0x7f4cb419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4cb1d9b640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 0x7f4cb419ac80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8005940 tx=0x7f4ca80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:43.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca803f030 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4ca8003ac0 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cb419f980 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ca8035070 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.053+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cb41a72c0 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.054+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f4cb4062980 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.055+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4ca8042030 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4ca37fe640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c9c0a32d0 0x7f4c9c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4cb259c640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c9c0a32d0 0x7f4c9c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f4ca80f0480 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4ca37fe640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] conn(0x7f4c9c0ace00 0x7f4c9c0af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 --> [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f4c9c0af970 con 0x7f4c9c0ace00 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f4ca80f08d0 con 0x7f4cb41036e0 2024-09-19T04:29:43.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4cb2d9d640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] conn(0x7f4c9c0ace00 0x7f4c9c0af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4cb259c640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c9c0a32d0 0x7f4c9c0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400baa0 tx=0x7f4ca4005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.056+0000 7f4cb2d9d640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] conn(0x7f4c9c0ace00 0x7f4c9c0af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.057+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 <== osd.0 v2:172.21.15.70:6802/1173006577 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f4c9c0af970 con 0x7f4c9c0ace00 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.070+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 --> [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4cb4062e00 con 0x7f4c9c0ace00 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4ca37fe640 1 -- 172.21.15.70:0/2743234890 <== osd.0 v2:172.21.15.70:6802/1173006577 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f4cb4062e00 con 0x7f4c9c0ace00 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] conn(0x7f4c9c0ace00 msgr2=0x7f4c9c0af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] conn(0x7f4c9c0ace00 0x7f4c9c0af2a0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c9c0a32d0 msgr2=0x7f4c9c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c9c0a32d0 0x7f4c9c0a5790 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f4ca400baa0 tx=0x7f4ca4005d90 comp rx=0 tx=0).stop 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 msgr2=0x7f4cb419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 --2- 172.21.15.70:0/2743234890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cb41036e0 0x7f4cb419ac80 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4ca8005940 tx=0x7f4ca80042f0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb2d9d640 1 -- 172.21.15.70:0/2743234890 reap_dead start 2024-09-19T04:29:43.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 shutdown_connections 2024-09-19T04:29:43.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 >> 172.21.15.70:0/2743234890 conn(0x7f4cb40fc7d0 msgr2=0x7f4cb4100ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:43.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 shutdown_connections 2024-09-19T04:29:43.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:43.071+0000 7f4cb8fb9640 1 -- 172.21.15.70:0/2743234890 wait complete. 2024-09-19T04:29:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 -- 172.21.15.70:0/178653821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348100e20 msgr2=0x7fe348101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 --2- 172.21.15.70:0/178653821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348100e20 0x7fe348101200 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fe338009900 tx=0x7fe33802a480 comp rx=0 tx=0).stop 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 -- 172.21.15.70:0/178653821 shutdown_connections 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 --2- 172.21.15.70:0/178653821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe348102ef0 0x7fe34810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 --2- 172.21.15.70:0/178653821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe348102570 0x7fe3481029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 --2- 172.21.15.70:0/178653821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348100e20 0x7fe348101200 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 -- 172.21.15.70:0/178653821 >> 172.21.15.70:0/178653821 conn(0x7fe3480fc7d0 msgr2=0x7fe3480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 -- 172.21.15.70:0/178653821 shutdown_connections 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 -- 172.21.15.70:0/178653821 wait complete. 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 Processor -- start 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.966+0000 7fe34dcb3640 1 -- start start 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe34dcb3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe348100e20 0x7fe3481a0440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe34dcb3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348102570 0x7fe3481a0980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe34dcb3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe348102ef0 0x7fe34819a600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe34dcb3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe348112090 con 0x7fe348102570 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe34dcb3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe348111f10 con 0x7fe348100e20 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe34dcb3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe348112210 con 0x7fe348102ef0 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348102570 0x7fe3481a0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348102570 0x7fe3481a0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:45414/0 (socket says 172.21.15.70:45414) 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 -- 172.21.15.70:0/954442369 learned_addr learned my addr 172.21.15.70:0/954442369 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe3477fe640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe348100e20 0x7fe3481a0440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe347fff640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe348102ef0 0x7fe34819a600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 -- 172.21.15.70:0/954442369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe348102ef0 msgr2=0x7fe34819a600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe348102ef0 0x7fe34819a600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 -- 172.21.15.70:0/954442369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe348100e20 msgr2=0x7fe3481a0440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe348100e20 0x7fe3481a0440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 -- 172.21.15.70:0/954442369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34819ad30 con 0x7fe348102570 2024-09-19T04:29:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe33ffff640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348102570 0x7fe3481a0980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe33000b4a0 tx=0x7fe33000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.967+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330014070 con 0x7fe348102570 2024-09-19T04:29:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.968+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34819b020 con 0x7fe348102570 2024-09-19T04:29:43.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.968+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe330010ae0 con 0x7fe348102570 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.968+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe330017c70 con 0x7fe348102570 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.968+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3481a7310 con 0x7fe348102570 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.969+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fe348062980 con 0x7fe348102570 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.971+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe330017070 con 0x7fe348102570 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.971+0000 7fe3457fa640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe3340a3350 0x7fe3340a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.972+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fe3300cf480 con 0x7fe348102570 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.972+0000 7fe3477fe640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe3340a3350 0x7fe3340a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.972+0000 7fe3457fa640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] conn(0x7fe3340ace80 0x7fe3340af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.972+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 --> [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fe33001ae50 con 0x7fe3340ace80 2024-09-19T04:29:43.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.972+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fe3300cf8d0 con 0x7fe348102570 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.972+0000 7fe3477fe640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe3340a3350 0x7fe3340a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe338000c00 tx=0x7fe338031400 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.972+0000 7fe347fff640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] conn(0x7fe3340ace80 0x7fe3340af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.972+0000 7fe347fff640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] conn(0x7fe3340ace80 0x7fe3340af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.973+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 <== osd.7 v2:172.21.15.134:6816/4280559958 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fe33001ae50 con 0x7fe3340ace80 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.987+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 --> [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fe348062d80 con 0x7fe3340ace80 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.987+0000 7fe3457fa640 1 -- 172.21.15.70:0/954442369 <== osd.7 v2:172.21.15.134:6816/4280559958 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fe348062d80 con 0x7fe3340ace80 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 >> [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] conn(0x7fe3340ace80 msgr2=0x7fe3340af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] conn(0x7fe3340ace80 0x7fe3340af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe3340a3350 msgr2=0x7fe3340a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe3340a3350 0x7fe3340a5810 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fe338000c00 tx=0x7fe338031400 comp rx=0 tx=0).stop 2024-09-19T04:29:43.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348102570 msgr2=0x7fe3481a0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 --2- 172.21.15.70:0/954442369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe348102570 0x7fe3481a0980 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fe33000b4a0 tx=0x7fe33000b960 comp rx=0 tx=0).stop 2024-09-19T04:29:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe347fff640 1 -- 172.21.15.70:0/954442369 reap_dead start 2024-09-19T04:29:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 shutdown_connections 2024-09-19T04:29:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 >> 172.21.15.70:0/954442369 conn(0x7fe3480fc7d0 msgr2=0x7fe348105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 shutdown_connections 2024-09-19T04:29:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:42.988+0000 7fe34dcb3640 1 -- 172.21.15.70:0/954442369 wait complete. 2024-09-19T04:29:44.243 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:44.270 INFO:teuthology.orchestra.run.smithi070.stdout:184683593773 2024-09-19T04:29:44.270 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-09-19T04:29:44.674 INFO:teuthology.orchestra.run.smithi070.stdout:34359738444 2024-09-19T04:29:44.674 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-09-19T04:29:44.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:44 smithi134 ceph-mon[34525]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T04:29:44.791 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:44 smithi070 ceph-mon[30942]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T04:29:44.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:44 smithi167 ceph-mon[34339]: pgmap v296: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T04:29:44.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 -- 172.21.15.70:0/3317895065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc074e30 msgr2=0x7fa7cc10df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:44.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 --2- 172.21.15.70:0/3317895065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc074e30 0x7fa7cc10df00 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fa7bc009900 tx=0x7fa7bc02a480 comp rx=0 tx=0).stop 2024-09-19T04:29:44.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 -- 172.21.15.70:0/3317895065 shutdown_connections 2024-09-19T04:29:44.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 --2- 172.21.15.70:0/3317895065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7cc10e440 0x7fa7cc110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:44.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 --2- 172.21.15.70:0/3317895065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc074e30 0x7fa7cc10df00 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:44.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 --2- 172.21.15.70:0/3317895065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7cc074510 0x7fa7cc0748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:44.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 -- 172.21.15.70:0/3317895065 >> 172.21.15.70:0/3317895065 conn(0x7fa7cc0fd8c0 msgr2=0x7fa7cc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:44.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 -- 172.21.15.70:0/3317895065 shutdown_connections 2024-09-19T04:29:44.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.988+0000 7fa7d424e640 1 -- 172.21.15.70:0/3317895065 wait complete. 2024-09-19T04:29:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d424e640 1 Processor -- start 2024-09-19T04:29:44.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d424e640 1 -- start start 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d424e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7cc074510 0x7fa7cc19a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d424e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7cc074e30 0x7fa7cc19ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d424e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc10e440 0x7fa7cc19efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d424e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc114140 con 0x7fa7cc10e440 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d424e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc113fc0 con 0x7fa7cc074510 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d424e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7cc1142c0 con 0x7fa7cc074e30 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d27eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc10e440 0x7fa7cc19efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d27eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc10e440 0x7fa7cc19efc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55358/0 (socket says 172.21.15.70:55358) 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d27eb640 1 -- 172.21.15.70:0/3732294703 learned_addr learned my addr 172.21.15.70:0/3732294703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d1fea640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7cc074510 0x7fa7cc19a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.989+0000 7fa7d17e9640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7cc074e30 0x7fa7cc19ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:44.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d27eb640 1 -- 172.21.15.70:0/3732294703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7cc074e30 msgr2=0x7fa7cc19ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d27eb640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7cc074e30 0x7fa7cc19ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d27eb640 1 -- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7cc074510 msgr2=0x7fa7cc19a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d27eb640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7cc074510 0x7fa7cc19a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d27eb640 1 -- 172.21.15.70:0/3732294703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7cc19f6a0 con 0x7fa7cc10e440 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d1fea640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7cc074510 0x7fa7cc19a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d27eb640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc10e440 0x7fa7cc19efc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400e9d0 tx=0x7fa7c400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c400cd80 con 0x7fa7cc10e440 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7cc19f990 con 0x7fa7cc10e440 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa7c4005020 con 0x7fa7cc10e440 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7c40116d0 con 0x7fa7cc10e440 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.990+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7cc1a7270 con 0x7fa7cc10e440 2024-09-19T04:29:44.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.991+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa7cc062900 con 0x7fa7cc10e440 2024-09-19T04:29:44.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.993+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa7c40051d0 con 0x7fa7cc10e440 2024-09-19T04:29:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.993+0000 7fa7c2ffd640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa7b80a32d0 0x7fa7b80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.993+0000 7fa7d1fea640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa7b80a32d0 0x7fa7b80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.994+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fa7c40cffa0 con 0x7fa7cc10e440 2024-09-19T04:29:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.994+0000 7fa7c2ffd640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] conn(0x7fa7b80ace00 0x7fa7b80af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.994+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 --> [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa7c4016ec0 con 0x7fa7b80ace00 2024-09-19T04:29:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.994+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fa7c40d0480 con 0x7fa7cc10e440 2024-09-19T04:29:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.994+0000 7fa7d1fea640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa7b80a32d0 0x7fa7b80a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80058c0 tx=0x7fa7c8005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:44.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.994+0000 7fa7d17e9640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] conn(0x7fa7b80ace00 0x7fa7b80af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:44.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.994+0000 7fa7d17e9640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] conn(0x7fa7b80ace00 0x7fa7b80af2a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:44.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:44.995+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 <== osd.10 v2:172.21.15.134:6824/3415319781 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa7c4016ec0 con 0x7fa7b80ace00 2024-09-19T04:29:45.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.009+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 --> [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fa7cc062d00 con 0x7fa7b80ace00 2024-09-19T04:29:45.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.009+0000 7fa7c2ffd640 1 -- 172.21.15.70:0/3732294703 <== osd.10 v2:172.21.15.134:6824/3415319781 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fa7cc062d00 con 0x7fa7b80ace00 2024-09-19T04:29:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.009+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] conn(0x7fa7b80ace00 msgr2=0x7fa7b80af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.009+0000 7fa7d424e640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] conn(0x7fa7b80ace00 0x7fa7b80af2a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.009+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa7b80a32d0 msgr2=0x7fa7b80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:45.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.009+0000 7fa7d424e640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa7b80a32d0 0x7fa7b80a5790 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fa7c80058c0 tx=0x7fa7c8005850 comp rx=0 tx=0).stop 2024-09-19T04:29:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.009+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc10e440 msgr2=0x7fa7cc19efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.009+0000 7fa7d424e640 1 --2- 172.21.15.70:0/3732294703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7cc10e440 0x7fa7cc19efc0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa7c400e9d0 tx=0x7fa7c400ee90 comp rx=0 tx=0).stop 2024-09-19T04:29:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.010+0000 7fa7d27eb640 1 -- 172.21.15.70:0/3732294703 reap_dead start 2024-09-19T04:29:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.010+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 shutdown_connections 2024-09-19T04:29:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.010+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 >> 172.21.15.70:0/3732294703 conn(0x7fa7cc0fd8c0 msgr2=0x7fa7cc0ff080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.010+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 shutdown_connections 2024-09-19T04:29:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:45.010+0000 7fa7d424e640 1 -- 172.21.15.70:0/3732294703 wait complete. 2024-09-19T04:29:45.547 INFO:teuthology.orchestra.run.smithi070.stdout:206158430249 2024-09-19T04:29:45.547 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 -- 172.21.15.70:0/3308101236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c100a80 msgr2=0x7f3f4c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 --2- 172.21.15.70:0/3308101236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c100a80 0x7f3f4c100ee0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3f3c009930 tx=0x7f3f3c02a420 comp rx=0 tx=0).stop 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 -- 172.21.15.70:0/3308101236 shutdown_connections 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 --2- 172.21.15.70:0/3308101236 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c101420 0x7f3f4c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 --2- 172.21.15.70:0/3308101236 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c100a80 0x7f3f4c100ee0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 --2- 172.21.15.70:0/3308101236 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f4c106a80 0x7f3f4c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 -- 172.21.15.70:0/3308101236 >> 172.21.15.70:0/3308101236 conn(0x7f3f4c0fc7a0 msgr2=0x7f3f4c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 -- 172.21.15.70:0/3308101236 shutdown_connections 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 -- 172.21.15.70:0/3308101236 wait complete. 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.281+0000 7f3f53f43640 1 Processor -- start 2024-09-19T04:29:46.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f53f43640 1 -- start start 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f53f43640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c100a80 0x7f3f4c199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f53f43640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f4c101420 0x7f3f4c199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f53f43640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c106a80 0x7f3f4c1a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f53f43640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c110e50 con 0x7f3f4c106a80 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f53f43640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c110cd0 con 0x7f3f4c101420 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f53f43640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f4c110fd0 con 0x7f3f4c100a80 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c106a80 0x7f3f4c1a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c106a80 0x7f3f4c1a4380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55378/0 (socket says 172.21.15.70:55378) 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 -- 172.21.15.70:0/4230347598 learned_addr learned my addr 172.21.15.70:0/4230347598 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f51cdf640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c100a80 0x7f3f4c199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:46.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f514de640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f4c101420 0x7f3f4c199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 -- 172.21.15.70:0/4230347598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c100a80 msgr2=0x7f3f4c199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f4c100a80 0x7f3f4c199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 -- 172.21.15.70:0/4230347598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f4c101420 msgr2=0x7f3f4c199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f4c101420 0x7f3f4c199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 -- 172.21.15.70:0/4230347598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f4c1a48c0 con 0x7f3f4c106a80 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f524e0640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c106a80 0x7f3f4c1a4380 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cad0 tx=0x7f3f4400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.282+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400ae20 con 0x7f3f4c106a80 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.283+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f4c1a4a90 con 0x7f3f4c106a80 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.283+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3f44005020 con 0x7f3f4c106a80 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.283+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4400f6b0 con 0x7f3f4c106a80 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.283+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f4c1a4fd0 con 0x7f3f4c106a80 2024-09-19T04:29:46.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.284+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3f4c062900 con 0x7f3f4c106a80 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.285+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f3f440051d0 con 0x7f3f4c106a80 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.285+0000 7f3f42ffd640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3f380a32d0 0x7f3f380a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.285+0000 7f3f51cdf640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3f380a32d0 0x7f3f380a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.285+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f3f440cfb20 con 0x7f3f4c106a80 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.286+0000 7f3f42ffd640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] conn(0x7f3f380ace00 0x7f3f380af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.286+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 --> [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f3f44004810 con 0x7f3f380ace00 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.286+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f3f440d42c0 con 0x7f3f4c106a80 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.286+0000 7f3f51cdf640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3f380a32d0 0x7f3f380a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3f48005d90 tx=0x7f3f48005d20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.286+0000 7f3f514de640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] conn(0x7f3f380ace00 0x7f3f380af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:46.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.286+0000 7f3f514de640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] conn(0x7f3f380ace00 0x7f3f380af2a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:46.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.287+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 <== osd.11 v2:172.21.15.167:6824/986370842 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f3f44004810 con 0x7f3f380ace00 2024-09-19T04:29:46.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.304+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 --> [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3f4c062d80 con 0x7f3f380ace00 2024-09-19T04:29:46.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f42ffd640 1 -- 172.21.15.70:0/4230347598 <== osd.11 v2:172.21.15.167:6824/986370842 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3f4c062d80 con 0x7f3f380ace00 2024-09-19T04:29:46.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 >> [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] conn(0x7f3f380ace00 msgr2=0x7f3f380af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] conn(0x7f3f380ace00 0x7f3f380af2a0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3f380a32d0 msgr2=0x7f3f380a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f3f380a32d0 0x7f3f380a5790 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f3f48005d90 tx=0x7f3f48005d20 comp rx=0 tx=0).stop 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c106a80 msgr2=0x7f3f4c1a4380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 --2- 172.21.15.70:0/4230347598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f4c106a80 0x7f3f4c1a4380 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f3f4400cad0 tx=0x7f3f4400cf90 comp rx=0 tx=0).stop 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f524e0640 1 -- 172.21.15.70:0/4230347598 reap_dead start 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 shutdown_connections 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 >> 172.21.15.70:0/4230347598 conn(0x7f3f4c0fc7a0 msgr2=0x7f3f4c0fcf60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 shutdown_connections 2024-09-19T04:29:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:46.305+0000 7f3f53f43640 1 -- 172.21.15.70:0/4230347598 wait complete. 2024-09-19T04:29:46.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:46 smithi134 ceph-mon[34525]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:46.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:46 smithi070 ceph-mon[30942]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:46.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:46 smithi167 ceph-mon[34339]: pgmap v297: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:47.210 INFO:teuthology.orchestra.run.smithi070.stdout:137438953527 2024-09-19T04:29:47.210 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 -- 172.21.15.70:0/1923120186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0106a60 msgr2=0x7f49b0106e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 --2- 172.21.15.70:0/1923120186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0106a60 0x7f49b0106e40 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f49a0009930 tx=0x7f49a002a420 comp rx=0 tx=0).stop 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 -- 172.21.15.70:0/1923120186 shutdown_connections 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 --2- 172.21.15.70:0/1923120186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49b0101400 0x7f49b010d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 --2- 172.21.15.70:0/1923120186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49b0100a60 0x7f49b0100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 --2- 172.21.15.70:0/1923120186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0106a60 0x7f49b0106e40 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 -- 172.21.15.70:0/1923120186 >> 172.21.15.70:0/1923120186 conn(0x7f49b00fc780 msgr2=0x7f49b00feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 -- 172.21.15.70:0/1923120186 shutdown_connections 2024-09-19T04:29:47.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 -- 172.21.15.70:0/1923120186 wait complete. 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 Processor -- start 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.409+0000 7f49b5f36640 1 -- start start 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49b5f36640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0100a60 0x7f49b0197510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49b5f36640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49b0101400 0x7f49b0197a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49b5f36640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49b0106a60 0x7f49b019bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49b5f36640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0110ef0 con 0x7f49b0100a60 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49b5f36640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0110d70 con 0x7f49b0106a60 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49b5f36640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f49b0111070 con 0x7f49b0101400 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0100a60 0x7f49b0197510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0100a60 0x7f49b0197510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55386/0 (socket says 172.21.15.70:55386) 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 -- 172.21.15.70:0/2638549373 learned_addr learned my addr 172.21.15.70:0/2638549373 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49affff640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49b0106a60 0x7f49b019bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:47.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49aeffd640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49b0101400 0x7f49b0197a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 -- 172.21.15.70:0/2638549373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49b0101400 msgr2=0x7f49b0197a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f49b0101400 0x7f49b0197a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 -- 172.21.15.70:0/2638549373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49b0106a60 msgr2=0x7f49b019bde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49b0106a60 0x7f49b019bde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 -- 172.21.15.70:0/2638549373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f49b019c4c0 con 0x7f49b0100a60 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49af7fe640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0100a60 0x7f49b0197510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f49a0005940 tx=0x7f49a0004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a003f030 con 0x7f49b0100a60 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f49a0003ac0 con 0x7f49b0100a60 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f49b019c750 con 0x7f49b0100a60 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49a0035070 con 0x7f49b0100a60 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.410+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f49b006a790 con 0x7f49b0100a60 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.411+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f49b006ad40 con 0x7f49b0100a60 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.412+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f49a0042030 con 0x7f49b0100a60 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.413+0000 7f49acff9640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49980a32d0 0x7f49980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:47.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.413+0000 7f49aeffd640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49980a32d0 0x7f49980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.413+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f49a00f06e0 con 0x7f49b0100a60 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.413+0000 7f49acff9640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] conn(0x7f49980ace00 0x7f49980af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.413+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 --> [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f49a00047a0 con 0x7f49980ace00 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.413+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f49a00f0b20 con 0x7f49b0100a60 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.413+0000 7f49aeffd640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49980a32d0 0x7f49980a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49b00fee90 tx=0x7f49a4008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.414+0000 7f49affff640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] conn(0x7f49980ace00 0x7f49980af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.414+0000 7f49affff640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] conn(0x7f49980ace00 0x7f49980af2a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.415+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 <== osd.8 v2:172.21.15.167:6816/94770656 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f49a00047a0 con 0x7f49980ace00 2024-09-19T04:29:47.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.428+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 --> [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f49b006b1c0 con 0x7f49980ace00 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49acff9640 1 -- 172.21.15.70:0/2638549373 <== osd.8 v2:172.21.15.167:6816/94770656 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f49b006b1c0 con 0x7f49980ace00 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 >> [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] conn(0x7f49980ace00 msgr2=0x7f49980af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] conn(0x7f49980ace00 0x7f49980af2a0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49980a32d0 msgr2=0x7f49980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49980a32d0 0x7f49980a5790 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f49b00fee90 tx=0x7f49a4008040 comp rx=0 tx=0).stop 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0100a60 msgr2=0x7f49b0197510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 --2- 172.21.15.70:0/2638549373 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f49b0100a60 0x7f49b0197510 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f49a0005940 tx=0x7f49a0004380 comp rx=0 tx=0).stop 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49affff640 1 -- 172.21.15.70:0/2638549373 reap_dead start 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 shutdown_connections 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 >> 172.21.15.70:0/2638549373 conn(0x7f49b00fc780 msgr2=0x7f49b00fd1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 shutdown_connections 2024-09-19T04:29:47.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:47.429+0000 7f49b5f36640 1 -- 172.21.15.70:0/2638549373 wait complete. 2024-09-19T04:29:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 -- 172.21.15.70:0/770988549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc106f10 msgr2=0x7f4fdc10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 --2- 172.21.15.70:0/770988549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc106f10 0x7f4fdc10ea90 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f4fd4009ca0 tx=0x7f4fd402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 -- 172.21.15.70:0/770988549 shutdown_connections 2024-09-19T04:29:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 --2- 172.21.15.70:0/770988549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc106f10 0x7f4fdc10ea90 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 --2- 172.21.15.70:0/770988549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc102790 0x7f4fdc1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 --2- 172.21.15.70:0/770988549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc101de0 0x7f4fdc1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 -- 172.21.15.70:0/770988549 >> 172.21.15.70:0/770988549 conn(0x7f4fdc0fd8c0 msgr2=0x7f4fdc0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 -- 172.21.15.70:0/770988549 shutdown_connections 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 -- 172.21.15.70:0/770988549 wait complete. 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.467+0000 7f4fe3987640 1 Processor -- start 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe3987640 1 -- start start 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe3987640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc101de0 0x7f4fdc198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe3987640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc102790 0x7f4fdc198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe3987640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc106f10 0x7f4fdc19cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe3987640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc111f40 con 0x7f4fdc102790 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe3987640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc111dc0 con 0x7f4fdc101de0 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe3987640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4fdc1120c0 con 0x7f4fdc106f10 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe0f22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc102790 0x7f4fdc198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe0f22640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc102790 0x7f4fdc198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55400/0 (socket says 172.21.15.70:55400) 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe0f22640 1 -- 172.21.15.70:0/3145237882 learned_addr learned my addr 172.21.15.70:0/3145237882 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe1f24640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc106f10 0x7f4fdc19cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe1723640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc101de0 0x7f4fdc198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe0f22640 1 -- 172.21.15.70:0/3145237882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc106f10 msgr2=0x7f4fdc19cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe0f22640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc106f10 0x7f4fdc19cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe0f22640 1 -- 172.21.15.70:0/3145237882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc101de0 msgr2=0x7f4fdc198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe0f22640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc101de0 0x7f4fdc198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe0f22640 1 -- 172.21.15.70:0/3145237882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fdc19d2f0 con 0x7f4fdc102790 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe1723640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc101de0 0x7f4fdc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.468+0000 7f4fe1f24640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc106f10 0x7f4fdc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.469+0000 7f4fe0f22640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc102790 0x7f4fdc198880 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800d770 tx=0x7f4fd800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:48.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.469+0000 7f4fd27fc640 1 -- 172.21.15.70:0/3145237882 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8017070 con 0x7f4fdc102790 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.469+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fdc19d5e0 con 0x7f4fdc102790 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.469+0000 7f4fd27fc640 1 -- 172.21.15.70:0/3145237882 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4fd80054f0 con 0x7f4fdc102790 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.469+0000 7f4fd27fc640 1 -- 172.21.15.70:0/3145237882 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8004d60 con 0x7f4fdc102790 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.469+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fdc074420 con 0x7f4fdc102790 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.470+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fdc1032c0 con 0x7f4fdc102790 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.471+0000 7f4fd27fc640 1 -- 172.21.15.70:0/3145237882 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4fd8004f00 con 0x7f4fdc102790 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.472+0000 7f4fd27fc640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4fc80a76e0 0x7f4fc80a9ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.472+0000 7f4fe1723640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4fc80a76e0 0x7f4fc80a9ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.472+0000 7f4fd27fc640 1 -- 172.21.15.70:0/3145237882 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f4fd80cf560 con 0x7f4fdc102790 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.472+0000 7f4fe1723640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4fc80a76e0 0x7f4fc80a9ba0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00baa0 tx=0x7f4fcc005d90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:48.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.476+0000 7f4fd27fc640 1 -- 172.21.15.70:0/3145237882 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f4fd809c150 con 0x7f4fdc102790 2024-09-19T04:29:48.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.652+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7f4fdc10a0f0 con 0x7f4fdc102790 2024-09-19T04:29:48.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.652+0000 7f4fd27fc640 1 -- 172.21.15.70:0/3145237882 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f4fd809ba50 con 0x7f4fdc102790 2024-09-19T04:29:48.654 INFO:teuthology.orchestra.run.smithi070.stdout:154618822707 2024-09-19T04:29:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4fc80a76e0 msgr2=0x7f4fc80a9ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4fc80a76e0 0x7f4fc80a9ba0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f4fcc00baa0 tx=0x7f4fcc005d90 comp rx=0 tx=0).stop 2024-09-19T04:29:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc102790 msgr2=0x7f4fdc198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc102790 0x7f4fdc198880 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800d770 tx=0x7f4fd800dc30 comp rx=0 tx=0).stop 2024-09-19T04:29:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 shutdown_connections 2024-09-19T04:29:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4fc80a76e0 0x7f4fc80a9ba0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4fdc106f10 0x7f4fdc19cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4fdc102790 0x7f4fdc198880 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 --2- 172.21.15.70:0/3145237882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4fdc101de0 0x7f4fdc198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 >> 172.21.15.70:0/3145237882 conn(0x7f4fdc0fd8c0 msgr2=0x7f4fdc0feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:48.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 shutdown_connections 2024-09-19T04:29:48.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.654+0000 7f4fe3987640 1 -- 172.21.15.70:0/3145237882 wait complete. 2024-09-19T04:29:48.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/2537528253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28103660 msgr2=0x7f5b2810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 --2- 172.21.15.70:0/2537528253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28103660 0x7f5b2810bb50 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f5b18009900 tx=0x7f5b1802a480 comp rx=0 tx=0).stop 2024-09-19T04:29:48.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/2537528253 shutdown_connections 2024-09-19T04:29:48.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 --2- 172.21.15.70:0/2537528253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b2810c170 0x7f5b2810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 --2- 172.21.15.70:0/2537528253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28103660 0x7f5b2810bb50 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 --2- 172.21.15.70:0/2537528253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b28102d40 0x7f5b28103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/2537528253 >> 172.21.15.70:0/2537528253 conn(0x7f5b280fc7a0 msgr2=0x7f5b280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:48.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/2537528253 shutdown_connections 2024-09-19T04:29:48.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.671+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/2537528253 wait complete. 2024-09-19T04:29:48.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b2dfe1640 1 Processor -- start 2024-09-19T04:29:48.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b2dfe1640 1 -- start start 2024-09-19T04:29:48.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b2dfe1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28102d40 0x7f5b281983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b2dfe1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b28103660 0x7f5b28198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b2dfe1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b2810c170 0x7f5b2819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b2dfe1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28111f90 con 0x7f5b28102d40 2024-09-19T04:29:48.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b2dfe1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28111e10 con 0x7f5b28103660 2024-09-19T04:29:48.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b2dfe1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5b28112110 con 0x7f5b2810c170 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b277fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28102d40 0x7f5b281983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b277fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28102d40 0x7f5b281983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55426/0 (socket says 172.21.15.70:55426) 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.672+0000 7f5b277fe640 1 -- 172.21.15.70:0/742381644 learned_addr learned my addr 172.21.15.70:0/742381644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b26ffd640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b28103660 0x7f5b28198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b27fff640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b2810c170 0x7f5b2819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b277fe640 1 -- 172.21.15.70:0/742381644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b2810c170 msgr2=0x7f5b2819cca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b277fe640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5b2810c170 0x7f5b2819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b277fe640 1 -- 172.21.15.70:0/742381644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b28103660 msgr2=0x7f5b28198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b277fe640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b28103660 0x7f5b28198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b277fe640 1 -- 172.21.15.70:0/742381644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5b2819d380 con 0x7f5b28102d40 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b26ffd640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b28103660 0x7f5b28198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:48.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b277fe640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28102d40 0x7f5b281983d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c970 tx=0x7f5b1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:48.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c007bb0 con 0x7f5b28102d40 2024-09-19T04:29:48.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5b1c007d50 con 0x7f5b28102d40 2024-09-19T04:29:48.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5b1c00f450 con 0x7f5b28102d40 2024-09-19T04:29:48.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5b2819d670 con 0x7f5b28102d40 2024-09-19T04:29:48.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.673+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5b281008d0 con 0x7f5b28102d40 2024-09-19T04:29:48.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.674+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f5b28062980 con 0x7f5b28102d40 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.675+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5b1c004f90 con 0x7f5b28102d40 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.676+0000 7f5b24ff9640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5b100a3350 0x7f5b100a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.676+0000 7f5b26ffd640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5b100a3350 0x7f5b100a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.676+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f5b1c0cfca0 con 0x7f5b28102d40 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.676+0000 7f5b24ff9640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] conn(0x7f5b100ace80 0x7f5b100af320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.676+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 --> [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f5b1c012ec0 con 0x7f5b100ace80 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.676+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7f5b1c0d0050 con 0x7f5b28102d40 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.677+0000 7f5b27fff640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] conn(0x7f5b100ace80 0x7f5b100af320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.677+0000 7f5b26ffd640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5b100a3350 0x7f5b100a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b18000c00 tx=0x7f5b18005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:48.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.677+0000 7f5b27fff640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] conn(0x7f5b100ace80 0x7f5b100af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:48.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.678+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 <== osd.3 v2:172.21.15.70:6810/1314792763 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f5b1c012ec0 con 0x7f5b100ace80 2024-09-19T04:29:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.692+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 --> [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f5b28062e00 con 0x7f5b100ace80 2024-09-19T04:29:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.692+0000 7f5b24ff9640 1 -- 172.21.15.70:0/742381644 <== osd.3 v2:172.21.15.70:6810/1314792763 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f5b28062e00 con 0x7f5b100ace80 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.692+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] conn(0x7f5b100ace80 msgr2=0x7f5b100af320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.692+0000 7f5b2dfe1640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] conn(0x7f5b100ace80 0x7f5b100af320 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.692+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5b100a3350 msgr2=0x7f5b100a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.693+0000 7f5b2dfe1640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5b100a3350 0x7f5b100a5810 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f5b18000c00 tx=0x7f5b18005a20 comp rx=0 tx=0).stop 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.693+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28102d40 msgr2=0x7f5b281983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.693+0000 7f5b2dfe1640 1 --2- 172.21.15.70:0/742381644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5b28102d40 0x7f5b281983d0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f5b1c00c970 tx=0x7f5b1c00ce30 comp rx=0 tx=0).stop 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.693+0000 7f5b27fff640 1 -- 172.21.15.70:0/742381644 reap_dead start 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.693+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 shutdown_connections 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.693+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 >> 172.21.15.70:0/742381644 conn(0x7f5b280fc7a0 msgr2=0x7f5b280fd400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.693+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 shutdown_connections 2024-09-19T04:29:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:48.693+0000 7f5b2dfe1640 1 -- 172.21.15.70:0/742381644 wait complete. 2024-09-19T04:29:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:48 smithi134 ceph-mon[34525]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:48.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:48 smithi070 ceph-mon[30942]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:48.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:48 smithi167 ceph-mon[34339]: pgmap v298: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:49.625 INFO:teuthology.orchestra.run.smithi070.stdout:236223201317 2024-09-19T04:29:49.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-09-19T04:29:49.633 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:49.838 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:49 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3145237882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:29:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 -- 172.21.15.70:0/2407057862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102ef0 msgr2=0x7fca1c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 --2- 172.21.15.70:0/2407057862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102ef0 0x7fca1c10da40 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7fca14009ca0 tx=0x7fca1402a950 comp rx=0 tx=0).stop 2024-09-19T04:29:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 -- 172.21.15.70:0/2407057862 shutdown_connections 2024-09-19T04:29:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 --2- 172.21.15.70:0/2407057862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102ef0 0x7fca1c10da40 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 --2- 172.21.15.70:0/2407057862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c102570 0x7fca1c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:49.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 --2- 172.21.15.70:0/2407057862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca1c100e20 0x7fca1c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 -- 172.21.15.70:0/2407057862 >> 172.21.15.70:0/2407057862 conn(0x7fca1c0fc7d0 msgr2=0x7fca1c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 -- 172.21.15.70:0/2407057862 shutdown_connections 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.952+0000 7fca23f11640 1 -- 172.21.15.70:0/2407057862 wait complete. 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca23f11640 1 Processor -- start 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca23f11640 1 -- start start 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca23f11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c100e20 0x7fca1c1994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca23f11640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102570 0x7fca1c199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca23f11640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca1c102ef0 0x7fca1c1a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca23f11640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c111010 con 0x7fca1c102570 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca23f11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c110e90 con 0x7fca1c100e20 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca23f11640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fca1c111190 con 0x7fca1c102ef0 2024-09-19T04:29:49.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca214ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102570 0x7fca1c199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca214ac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102570 0x7fca1c199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55454/0 (socket says 172.21.15.70:55454) 2024-09-19T04:29:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca214ac640 1 -- 172.21.15.70:0/1832674025 learned_addr learned my addr 172.21.15.70:0/1832674025 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca224ae640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca1c102ef0 0x7fca1c1a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca214ac640 1 -- 172.21.15.70:0/1832674025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca1c102ef0 msgr2=0x7fca1c1a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca214ac640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fca1c102ef0 0x7fca1c1a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca214ac640 1 -- 172.21.15.70:0/1832674025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c100e20 msgr2=0x7fca1c1994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca214ac640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca1c100e20 0x7fca1c1994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:49.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.953+0000 7fca214ac640 1 -- 172.21.15.70:0/1832674025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca1c1a4aa0 con 0x7fca1c102570 2024-09-19T04:29:49.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.954+0000 7fca214ac640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102570 0x7fca1c199a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b4a0 tx=0x7fca0c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:49.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.954+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c014070 con 0x7fca1c102570 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.954+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fca0c010ae0 con 0x7fca1c102570 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.954+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca0c017c70 con 0x7fca1c102570 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.954+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca1c1a4c70 con 0x7fca1c102570 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.954+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca1c1a5130 con 0x7fca1c102570 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.955+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fca1c0628c0 con 0x7fca1c102570 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.956+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fca0c017070 con 0x7fca1c102570 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca12ffd640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fca080a32d0 0x7fca080a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca21cad640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fca080a32d0 0x7fca080a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fca0c0cf4f0 con 0x7fca1c102570 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca12ffd640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] conn(0x7fca080ace00 0x7fca080af2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:49.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 --> [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fca080af970 con 0x7fca080ace00 2024-09-19T04:29:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_get_version_reply(handle=1 version=83) ==== 24+0+0 (secure 0 0 0) 0x7fca0c0cf940 con 0x7fca1c102570 2024-09-19T04:29:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca224ae640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] conn(0x7fca080ace00 0x7fca080af2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:49.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca21cad640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fca080a32d0 0x7fca080a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fca18009710 tx=0x7fca18006c90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:49.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:49 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3145237882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:29:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.957+0000 7fca224ae640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] conn(0x7fca080ace00 0x7fca080af2a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:49.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.958+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 <== osd.9 v2:172.21.15.70:6826/4029282246 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fca080af970 con 0x7fca080ace00 2024-09-19T04:29:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.971+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 --> [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fca1c062d40 con 0x7fca080ace00 2024-09-19T04:29:49.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca12ffd640 1 -- 172.21.15.70:0/1832674025 <== osd.9 v2:172.21.15.70:6826/4029282246 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fca1c062d40 con 0x7fca080ace00 2024-09-19T04:29:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] conn(0x7fca080ace00 msgr2=0x7fca080af2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] conn(0x7fca080ace00 0x7fca080af2a0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fca080a32d0 msgr2=0x7fca080a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fca080a32d0 0x7fca080a5790 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fca18009710 tx=0x7fca18006c90 comp rx=0 tx=0).stop 2024-09-19T04:29:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102570 msgr2=0x7fca1c199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 --2- 172.21.15.70:0/1832674025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fca1c102570 0x7fca1c199a20 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7fca0c00b4a0 tx=0x7fca0c00b960 comp rx=0 tx=0).stop 2024-09-19T04:29:49.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca224ae640 1 -- 172.21.15.70:0/1832674025 reap_dead start 2024-09-19T04:29:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 shutdown_connections 2024-09-19T04:29:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 >> 172.21.15.70:0/1832674025 conn(0x7fca1c0fc7d0 msgr2=0x7fca1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 shutdown_connections 2024-09-19T04:29:49.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:49.972+0000 7fca23f11640 1 -- 172.21.15.70:0/1832674025 wait complete. 2024-09-19T04:29:50.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:49 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3145237882' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-09-19T04:29:50.600 INFO:teuthology.orchestra.run.smithi070.stdout:287762808858 2024-09-19T04:29:50.601 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-09-19T04:29:50.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:50 smithi070 ceph-mon[30942]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:50.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:50 smithi167 ceph-mon[34339]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:51.016 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822705 got 154618822707 for osd.5 2024-09-19T04:29:51.016 DEBUG:teuthology.parallel:result is None 2024-09-19T04:29:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:50 smithi134 ceph-mon[34525]: pgmap v299: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 597 B/s wr, 6 op/s 2024-09-19T04:29:51.962 INFO:teuthology.orchestra.run.smithi070.stdout:266287972384 2024-09-19T04:29:51.963 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-09-19T04:29:52.567 INFO:teuthology.orchestra.run.smithi070.stdout:107374182462 2024-09-19T04:29:52.568 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-09-19T04:29:52.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.768+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/4233841288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e4102d40 msgr2=0x7fe8e4103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:52.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.768+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/4233841288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e4102d40 0x7fe8e4103120 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009900 tx=0x7fe8e002a480 comp rx=0 tx=0).stop 2024-09-19T04:29:52.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/4233841288 shutdown_connections 2024-09-19T04:29:52.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/4233841288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e410c170 0x7fe8e410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/4233841288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e4103660 0x7fe8e410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/4233841288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e4102d40 0x7fe8e4103120 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/4233841288 >> 172.21.15.70:0/4233841288 conn(0x7fe8e40fc7a0 msgr2=0x7fe8e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:52.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/4233841288 shutdown_connections 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/4233841288 wait complete. 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 Processor -- start 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 -- start start 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e4102d40 0x7fe8e41985c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e4103660 0x7fe8e4198b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e410c170 0x7fe8e419ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4112020 con 0x7fe8e410c170 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e4111ea0 con 0x7fe8e4103660 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.769+0000 7fe8ec5cc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e41121a0 con 0x7fe8e4102d40 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e410c170 0x7fe8e419ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e410c170 0x7fe8e419ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55474/0 (socket says 172.21.15.70:55474) 2024-09-19T04:29:52.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 -- 172.21.15.70:0/1694151379 learned_addr learned my addr 172.21.15.70:0/1694151379 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8e9b67640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e4103660 0x7fe8e4198b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 -- 172.21.15.70:0/1694151379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e4102d40 msgr2=0x7fe8e41985c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8ea368640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e4102d40 0x7fe8e41985c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e4102d40 0x7fe8e41985c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 -- 172.21.15.70:0/1694151379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e4103660 msgr2=0x7fe8e4198b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e4103660 0x7fe8e4198b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 -- 172.21.15.70:0/1694151379 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e419d570 con 0x7fe8e410c170 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8e9b67640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e4103660 0x7fe8e4198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8eab69640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e410c170 0x7fe8e419ce90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00b970 tx=0x7fe8dc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:52.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8db7fe640 1 -- 172.21.15.70:0/1694151379 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc019070 con 0x7fe8e410c170 2024-09-19T04:29:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e419d860 con 0x7fe8e410c170 2024-09-19T04:29:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8db7fe640 1 -- 172.21.15.70:0/1694151379 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe8dc00cb40 con 0x7fe8e410c170 2024-09-19T04:29:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8db7fe640 1 -- 172.21.15.70:0/1694151379 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8dc007650 con 0x7fe8e410c170 2024-09-19T04:29:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.770+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e41a5140 con 0x7fe8e410c170 2024-09-19T04:29:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.771+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e41031a0 con 0x7fe8e410c170 2024-09-19T04:29:52.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.772+0000 7fe8db7fe640 1 -- 172.21.15.70:0/1694151379 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe8dc01c070 con 0x7fe8e410c170 2024-09-19T04:29:52.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.773+0000 7fe8db7fe640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d00a32d0 0x7fe8d00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:52.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.773+0000 7fe8ea368640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d00a32d0 0x7fe8d00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:52.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.773+0000 7fe8db7fe640 1 -- 172.21.15.70:0/1694151379 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fe8dc0cf000 con 0x7fe8e410c170 2024-09-19T04:29:52.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.773+0000 7fe8ea368640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d00a32d0 0x7fe8d00a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00096c0 tx=0x7fe8e0000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:52.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.777+0000 7fe8db7fe640 1 -- 172.21.15.70:0/1694151379 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8dc09bd00 con 0x7fe8e410c170 2024-09-19T04:29:52.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:52 smithi070 ceph-mon[30942]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T04:29:52.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:52 smithi167 ceph-mon[34339]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T04:29:52.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.971+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe8e4106c50 con 0x7fe8e410c170 2024-09-19T04:29:52.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.971+0000 7fe8db7fe640 1 -- 172.21.15.70:0/1694151379 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe8dc09b600 con 0x7fe8e410c170 2024-09-19T04:29:52.973 INFO:teuthology.orchestra.run.smithi070.stdout:55834574921 2024-09-19T04:29:52.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d00a32d0 msgr2=0x7fe8d00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:52.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d00a32d0 0x7fe8d00a5790 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fe8e00096c0 tx=0x7fe8e0000bc0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e410c170 msgr2=0x7fe8e419ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:52.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e410c170 0x7fe8e419ce90 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7fe8dc00b970 tx=0x7fe8dc00be30 comp rx=0 tx=0).stop 2024-09-19T04:29:52.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 shutdown_connections 2024-09-19T04:29:52.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d00a32d0 0x7fe8d00a5790 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e410c170 0x7fe8e419ce90 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e4103660 0x7fe8e4198b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 --2- 172.21.15.70:0/1694151379 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e4102d40 0x7fe8e41985c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:52.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 >> 172.21.15.70:0/1694151379 conn(0x7fe8e40fc7a0 msgr2=0x7fe8e40fe0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:52.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 shutdown_connections 2024-09-19T04:29:52.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:52.973+0000 7fe8ec5cc640 1 -- 172.21.15.70:0/1694151379 wait complete. 2024-09-19T04:29:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:52 smithi134 ceph-mon[34525]: pgmap v300: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 255 B/s wr, 5 op/s 2024-09-19T04:29:53.211 INFO:teuthology.orchestra.run.smithi070.stdout:322122547222 2024-09-19T04:29:53.211 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-09-19T04:29:53.541 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:53.545 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:53.546 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:53.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:53 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1694151379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:29:53.556 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:53.941 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574918 got 55834574921 for osd.1 2024-09-19T04:29:53.942 DEBUG:teuthology.parallel:result is None 2024-09-19T04:29:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:53 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1694151379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:29:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:53 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1694151379' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-09-19T04:29:54.246 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:54.251 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:54.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 -- 172.21.15.70:0/464561389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0102de0 msgr2=0x7f51e01031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:54.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/464561389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0102de0 0x7f51e01031c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f51dc009900 tx=0x7f51dc02a480 comp rx=0 tx=0).stop 2024-09-19T04:29:54.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 -- 172.21.15.70:0/464561389 shutdown_connections 2024-09-19T04:29:54.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/464561389 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51e010c180 0x7f51e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/464561389 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51e0103700 0x7f51e010bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/464561389 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0102de0 0x7f51e01031c0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 -- 172.21.15.70:0/464561389 >> 172.21.15.70:0/464561389 conn(0x7f51e00fc7a0 msgr2=0x7f51e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 -- 172.21.15.70:0/464561389 shutdown_connections 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.725+0000 7f51e6ab2640 1 -- 172.21.15.70:0/464561389 wait complete. 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51e6ab2640 1 Processor -- start 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51e6ab2640 1 -- start start 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51e6ab2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51e0102de0 0x7f51e0198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51e6ab2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0103700 0x7f51e01989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51e6ab2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51e010c180 0x7f51e019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51e6ab2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0111f40 con 0x7f51e0103700 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51e6ab2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51e0111dc0 con 0x7f51e010c180 2024-09-19T04:29:54.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51e6ab2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f51e01120c0 con 0x7f51e0102de0 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0103700 0x7f51e01989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0103700 0x7f51e01989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52468/0 (socket says 172.21.15.70:52468) 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.726+0000 7f51d7fff640 1 -- 172.21.15.70:0/3084307627 learned_addr learned my addr 172.21.15.70:0/3084307627 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51e484e640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51e0102de0 0x7f51e0198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51e504f640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51e010c180 0x7f51e019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d7fff640 1 -- 172.21.15.70:0/3084307627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51e0102de0 msgr2=0x7f51e0198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d7fff640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51e0102de0 0x7f51e0198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d7fff640 1 -- 172.21.15.70:0/3084307627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51e010c180 msgr2=0x7f51e019cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d7fff640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51e010c180 0x7f51e019cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d7fff640 1 -- 172.21.15.70:0/3084307627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51e019d430 con 0x7f51e0103700 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51e484e640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51e0102de0 0x7f51e0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d7fff640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0103700 0x7f51e01989c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f51d000d950 tx=0x7f51d000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:54.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d5ffb640 1 -- 172.21.15.70:0/3084307627 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d0017070 con 0x7f51e0103700 2024-09-19T04:29:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51e019d720 con 0x7f51e0103700 2024-09-19T04:29:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d5ffb640 1 -- 172.21.15.70:0/3084307627 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f51d0009c30 con 0x7f51e0103700 2024-09-19T04:29:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51d5ffb640 1 -- 172.21.15.70:0/3084307627 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51d000f6b0 con 0x7f51e0103700 2024-09-19T04:29:54.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.727+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51e01a5000 con 0x7f51e0103700 2024-09-19T04:29:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.728+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f51e01031c0 con 0x7f51e0103700 2024-09-19T04:29:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.729+0000 7f51d5ffb640 1 -- 172.21.15.70:0/3084307627 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f51d0010a50 con 0x7f51e0103700 2024-09-19T04:29:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.730+0000 7f51d5ffb640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51c80a32d0 0x7f51c80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.730+0000 7f51e484e640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51c80a32d0 0x7f51c80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.730+0000 7f51d5ffb640 1 -- 172.21.15.70:0/3084307627 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f51d00cf780 con 0x7f51e0103700 2024-09-19T04:29:54.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.730+0000 7f51e484e640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51c80a32d0 0x7f51c80a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51dc005ab0 tx=0x7f51dc005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:54.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.734+0000 7f51d5ffb640 1 -- 172.21.15.70:0/3084307627 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51d0009de0 con 0x7f51e0103700 2024-09-19T04:29:54.823 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:54 smithi070 ceph-mon[30942]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T04:29:54.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.906+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7f51e002d7c0 con 0x7f51e0103700 2024-09-19T04:29:54.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.906+0000 7f51d5ffb640 1 -- 172.21.15.70:0/3084307627 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f51d009c370 con 0x7f51e0103700 2024-09-19T04:29:54.908 INFO:teuthology.orchestra.run.smithi070.stdout:236223201318 2024-09-19T04:29:54.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51c80a32d0 msgr2=0x7f51c80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:54.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51c80a32d0 0x7f51c80a5790 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f51dc005ab0 tx=0x7f51dc005a20 comp rx=0 tx=0).stop 2024-09-19T04:29:54.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0103700 msgr2=0x7f51e01989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:54.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0103700 0x7f51e01989c0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f51d000d950 tx=0x7f51d000de10 comp rx=0 tx=0).stop 2024-09-19T04:29:54.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 shutdown_connections 2024-09-19T04:29:54.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51c80a32d0 0x7f51c80a5790 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51e010c180 0x7f51e019cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f51e0103700 0x7f51e01989c0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 --2- 172.21.15.70:0/3084307627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f51e0102de0 0x7f51e0198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:54.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 >> 172.21.15.70:0/3084307627 conn(0x7f51e00fc7a0 msgr2=0x7f51e00fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:54.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 shutdown_connections 2024-09-19T04:29:54.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:54.908+0000 7f51e6ab2640 1 -- 172.21.15.70:0/3084307627 wait complete. 2024-09-19T04:29:54.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:54 smithi167 ceph-mon[34339]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T04:29:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:54 smithi134 ceph-mon[34525]: pgmap v301: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-09-19T04:29:55.585 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201317 got 236223201318 for osd.8 2024-09-19T04:29:55.585 DEBUG:teuthology.parallel:result is None 2024-09-19T04:29:55.817 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:55 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3084307627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:29:55.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:55 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3084307627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:29:56.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:55 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3084307627' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-09-19T04:29:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 -- 172.21.15.70:0/2369696303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 msgr2=0x7f73c8100750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 --2- 172.21.15.70:0/2369696303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 0x7f73c8100750 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f73c4009930 tx=0x7f73c402a420 comp rx=0 tx=0).stop 2024-09-19T04:29:56.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 -- 172.21.15.70:0/2369696303 shutdown_connections 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 --2- 172.21.15.70:0/2369696303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c8106fc0 0x7f73c810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 --2- 172.21.15.70:0/2369696303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c8100d20 0x7f73c8106860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 --2- 172.21.15.70:0/2369696303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 0x7f73c8100750 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 -- 172.21.15.70:0/2369696303 >> 172.21.15.70:0/2369696303 conn(0x7f73c8077210 msgr2=0x7f73c80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 -- 172.21.15.70:0/2369696303 shutdown_connections 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.079+0000 7f73cffb2640 1 -- 172.21.15.70:0/2369696303 wait complete. 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cffb2640 1 Processor -- start 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cffb2640 1 -- start start 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cffb2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 0x7f73c8198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:56.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cffb2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c8100d20 0x7f73c81989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cffb2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c8106fc0 0x7f73c819cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cffb2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8111fd0 con 0x7f73c8100370 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cffb2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8111e50 con 0x7f73c8106fc0 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cffb2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73c8112150 con 0x7f73c8100d20 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cdd4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 0x7f73c8198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cdd4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 0x7f73c8198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52484/0 (socket says 172.21.15.70:52484) 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cdd4e640 1 -- 172.21.15.70:0/4196654581 learned_addr learned my addr 172.21.15.70:0/4196654581 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cd54d640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c8100d20 0x7f73c81989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73ce54f640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c8106fc0 0x7f73c819cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cdd4e640 1 -- 172.21.15.70:0/4196654581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c8100d20 msgr2=0x7f73c81989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cdd4e640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c8100d20 0x7f73c81989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cdd4e640 1 -- 172.21.15.70:0/4196654581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c8106fc0 msgr2=0x7f73c819cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cdd4e640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c8106fc0 0x7f73c819cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73cdd4e640 1 -- 172.21.15.70:0/4196654581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73c819d440 con 0x7f73c8100370 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.080+0000 7f73ce54f640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c8106fc0 0x7f73c819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.081+0000 7f73cdd4e640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 0x7f73c8198490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73c4005940 tx=0x7f73c4004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.081+0000 7f73beffd640 1 -- 172.21.15.70:0/4196654581 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c403f030 con 0x7f73c8100370 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.081+0000 7f73beffd640 1 -- 172.21.15.70:0/4196654581 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73c4003ac0 con 0x7f73c8100370 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.081+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73c819d6d0 con 0x7f73c8100370 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.081+0000 7f73beffd640 1 -- 172.21.15.70:0/4196654581 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73c4035070 con 0x7f73c8100370 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.081+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73c81a5010 con 0x7f73c8100370 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.082+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73c8100750 con 0x7f73c8100370 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.084+0000 7f73beffd640 1 -- 172.21.15.70:0/4196654581 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f73c4042030 con 0x7f73c8100370 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.084+0000 7f73beffd640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f73b40a3350 0x7f73b40a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:56.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.084+0000 7f73cd54d640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f73b40a3350 0x7f73b40a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.085+0000 7f73beffd640 1 -- 172.21.15.70:0/4196654581 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f73c40f0540 con 0x7f73c8100370 2024-09-19T04:29:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.085+0000 7f73cd54d640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f73b40a3350 0x7f73b40a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73c80ff7f0 tx=0x7f73b800a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:56.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.088+0000 7f73beffd640 1 -- 172.21.15.70:0/4196654581 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f73c40bd130 con 0x7f73c8100370 2024-09-19T04:29:56.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.261+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f73c81997f0 con 0x7f73c8100370 2024-09-19T04:29:56.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.262+0000 7f73beffd640 1 -- 172.21.15.70:0/4196654581 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f73c40bca30 con 0x7f73c8100370 2024-09-19T04:29:56.264 INFO:teuthology.orchestra.run.smithi070.stdout:266287972385 2024-09-19T04:29:56.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f73b40a3350 msgr2=0x7f73b40a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f73b40a3350 0x7f73b40a5810 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f73c80ff7f0 tx=0x7f73b800a2d0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 msgr2=0x7f73c8198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 0x7f73c8198490 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f73c4005940 tx=0x7f73c4004380 comp rx=0 tx=0).stop 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 shutdown_connections 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f73b40a3350 0x7f73b40a5810 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73c8106fc0 0x7f73c819cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73c8100d20 0x7f73c81989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 --2- 172.21.15.70:0/4196654581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73c8100370 0x7f73c8198490 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 >> 172.21.15.70:0/4196654581 conn(0x7f73c8077210 msgr2=0x7f73c80fc800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 shutdown_connections 2024-09-19T04:29:56.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.264+0000 7f73cffb2640 1 -- 172.21.15.70:0/4196654581 wait complete. 2024-09-19T04:29:56.303 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:56.304 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 -- 172.21.15.70:0/893618701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 msgr2=0x7f9948103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 --2- 172.21.15.70:0/893618701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 0x7f9948103110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f9938009980 tx=0x7f993802a4b0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 -- 172.21.15.70:0/893618701 shutdown_connections 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 --2- 172.21.15.70:0/893618701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99481082a0 0x7f994810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 --2- 172.21.15.70:0/893618701 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99481036e0 0x7f9948107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 --2- 172.21.15.70:0/893618701 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 0x7f9948103110 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 -- 172.21.15.70:0/893618701 >> 172.21.15.70:0/893618701 conn(0x7f99480fc7d0 msgr2=0x7f99480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 -- 172.21.15.70:0/893618701 shutdown_connections 2024-09-19T04:29:56.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.305+0000 7f994de25640 1 -- 172.21.15.70:0/893618701 wait complete. 2024-09-19T04:29:56.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.306+0000 7f994de25640 1 Processor -- start 2024-09-19T04:29:56.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.306+0000 7f994de25640 1 -- start start 2024-09-19T04:29:56.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f994de25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 0x7f9948100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:56.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f994de25640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99481036e0 0x7f9948100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:56.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f99477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 0x7f9948100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:56.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f99477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 0x7f9948100990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52498/0 (socket says 172.21.15.70:52498) 2024-09-19T04:29:56.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f994de25640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99481082a0 0x7f9948101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:56.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f99477fe640 1 -- 172.21.15.70:0/3081677347 learned_addr learned my addr 172.21.15.70:0/3081677347 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:56.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9948112110 con 0x7f9948102d30 2024-09-19T04:29:56.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9948111f90 con 0x7f99481082a0 2024-09-19T04:29:56.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9948112290 con 0x7f99481036e0 2024-09-19T04:29:56.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.307+0000 7f9947fff640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99481082a0 0x7f9948101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:56.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.308+0000 7f9946ffd640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99481036e0 0x7f9948100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:56.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.308+0000 7f9946ffd640 1 -- 172.21.15.70:0/3081677347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99481082a0 msgr2=0x7f9948101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.308+0000 7f9946ffd640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99481082a0 0x7f9948101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.308+0000 7f9946ffd640 1 -- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 msgr2=0x7f9948100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.308+0000 7f9946ffd640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 0x7f9948100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.308+0000 7f9946ffd640 1 -- 172.21.15.70:0/3081677347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f99481a6b50 con 0x7f99481036e0 2024-09-19T04:29:56.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.309+0000 7f9946ffd640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99481036e0 0x7f9948100ed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99480697d0 tx=0x7f993c00cdd0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:56.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.309+0000 7f9944ff9640 1 -- 172.21.15.70:0/3081677347 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c007bb0 con 0x7f99481036e0 2024-09-19T04:29:56.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.309+0000 7f9944ff9640 1 -- 172.21.15.70:0/3081677347 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f993c007d50 con 0x7f99481036e0 2024-09-19T04:29:56.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.309+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f99481a6e40 con 0x7f99481036e0 2024-09-19T04:29:56.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.310+0000 7f9944ff9640 1 -- 172.21.15.70:0/3081677347 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993c00f450 con 0x7f99481036e0 2024-09-19T04:29:56.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.310+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99481a7240 con 0x7f99481036e0 2024-09-19T04:29:56.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.312+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f994806a850 con 0x7f99481036e0 2024-09-19T04:29:56.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.313+0000 7f9944ff9640 1 -- 172.21.15.70:0/3081677347 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f993c004e80 con 0x7f99481036e0 2024-09-19T04:29:56.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.313+0000 7f9944ff9640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a3350 0x7f99300a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:56.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.314+0000 7f9944ff9640 1 -- 172.21.15.70:0/3081677347 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f993c0cf5f0 con 0x7f99481036e0 2024-09-19T04:29:56.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.314+0000 7f99477fe640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a3350 0x7f99300a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:56.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.315+0000 7f99477fe640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a3350 0x7f99300a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f99380096c0 tx=0x7f9938005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:56.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.318+0000 7f9944ff9640 1 -- 172.21.15.70:0/3081677347 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f993c014030 con 0x7f99481036e0 2024-09-19T04:29:56.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.499+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f9948103110 con 0x7f99481036e0 2024-09-19T04:29:56.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.499+0000 7f9944ff9640 1 -- 172.21.15.70:0/3081677347 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f993c09c1e0 con 0x7f99481036e0 2024-09-19T04:29:56.501 INFO:teuthology.orchestra.run.smithi070.stdout:206158430252 2024-09-19T04:29:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a3350 msgr2=0x7f99300a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a3350 0x7f99300a5810 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f99380096c0 tx=0x7f9938005a20 comp rx=0 tx=0).stop 2024-09-19T04:29:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99481036e0 msgr2=0x7f9948100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:56.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99481036e0 0x7f9948100ed0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f99480697d0 tx=0x7f993c00cdd0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 shutdown_connections 2024-09-19T04:29:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f99300a3350 0x7f99300a5810 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99481082a0 0x7f9948101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f99481036e0 0x7f9948100ed0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 --2- 172.21.15.70:0/3081677347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9948102d30 0x7f9948100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 >> 172.21.15.70:0/3081677347 conn(0x7f99480fc7d0 msgr2=0x7f9948105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.501+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 shutdown_connections 2024-09-19T04:29:56.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:56.502+0000 7f994de25640 1 -- 172.21.15.70:0/3081677347 wait complete. 2024-09-19T04:29:56.784 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:56 smithi070 ceph-mon[30942]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T04:29:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:56 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4196654581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:29:56.785 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:56 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3081677347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:29:56.862 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:56 smithi167 ceph-mon[34339]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T04:29:56.862 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:56 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4196654581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:29:56.862 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:56 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3081677347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:29:56.937 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:56 smithi134 ceph-mon[34525]: pgmap v302: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T04:29:56.937 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:56 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4196654581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-09-19T04:29:56.937 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:56 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3081677347' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-09-19T04:29:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 -- 172.21.15.70:0/3184399924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 msgr2=0x7f7014107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 --2- 172.21.15.70:0/3184399924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 0x7f7014107b90 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7008009930 tx=0x7f700802a420 comp rx=0 tx=0).stop 2024-09-19T04:29:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 -- 172.21.15.70:0/3184399924 shutdown_connections 2024-09-19T04:29:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 --2- 172.21.15.70:0/3184399924 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70141082a0 0x7f701410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 --2- 172.21.15.70:0/3184399924 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 0x7f7014107b90 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 --2- 172.21.15.70:0/3184399924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7014102d30 0x7f7014103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 -- 172.21.15.70:0/3184399924 >> 172.21.15.70:0/3184399924 conn(0x7f70140fc7d0 msgr2=0x7f70140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 -- 172.21.15.70:0/3184399924 shutdown_connections 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.417+0000 7f7019405640 1 -- 172.21.15.70:0/3184399924 wait complete. 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7019405640 1 Processor -- start 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7019405640 1 -- start start 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7019405640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7014102d30 0x7f7014100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7019405640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 0x7f7014100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7019405640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70141082a0 0x7f7014101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7019405640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7014112070 con 0x7f70141036e0 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7019405640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7014111ef0 con 0x7f7014102d30 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7019405640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f70141121f0 con 0x7f70141082a0 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f70127fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 0x7f7014100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:57.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f70127fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 0x7f7014100ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52528/0 (socket says 172.21.15.70:52528) 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f70127fc640 1 -- 172.21.15.70:0/2802559271 learned_addr learned my addr 172.21.15.70:0/2802559271 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f70137fe640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70141082a0 0x7f7014101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.418+0000 7f7012ffd640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7014102d30 0x7f7014100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f70127fc640 1 -- 172.21.15.70:0/2802559271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70141082a0 msgr2=0x7f7014101410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f70127fc640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70141082a0 0x7f7014101410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f70127fc640 1 -- 172.21.15.70:0/2802559271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7014102d30 msgr2=0x7f7014100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f70127fc640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7014102d30 0x7f7014100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f70127fc640 1 -- 172.21.15.70:0/2802559271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70141a6a30 con 0x7f70141036e0 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f70127fc640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 0x7f7014100ed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7008005940 tx=0x7f70080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f6ffbfff640 1 -- 172.21.15.70:0/2802559271 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f700803f030 con 0x7f70141036e0 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70141a6cc0 con 0x7f70141036e0 2024-09-19T04:29:57.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f6ffbfff640 1 -- 172.21.15.70:0/2802559271 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7008003ac0 con 0x7f70141036e0 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.419+0000 7f6ffbfff640 1 -- 172.21.15.70:0/2802559271 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7008035070 con 0x7f70141036e0 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.420+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70141a71a0 con 0x7f70141036e0 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.421+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7014103110 con 0x7f70141036e0 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.422+0000 7f6ffbfff640 1 -- 172.21.15.70:0/2802559271 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f7008042030 con 0x7f70141036e0 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.423+0000 7f6ffbfff640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6ffc0a32d0 0x7f6ffc0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.423+0000 7f7012ffd640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6ffc0a32d0 0x7f6ffc0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.423+0000 7f6ffbfff640 1 -- 172.21.15.70:0/2802559271 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f70080efe70 con 0x7f70141036e0 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.424+0000 7f7012ffd640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6ffc0a32d0 0x7f6ffc0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7004005d00 tx=0x7f700400b410 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:57.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.427+0000 7f6ffbfff640 1 -- 172.21.15.70:0/2802559271 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f70080bc410 con 0x7f70141036e0 2024-09-19T04:29:57.589 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:57 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/325583025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:29:57.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.648+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f701410a2b0 con 0x7f70141036e0 2024-09-19T04:29:57.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.649+0000 7f6ffbfff640 1 -- 172.21.15.70:0/2802559271 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f70080c0710 con 0x7f70141036e0 2024-09-19T04:29:57.651 INFO:teuthology.orchestra.run.smithi070.stdout:137438953531 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6ffc0a32d0 msgr2=0x7f6ffc0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6ffc0a32d0 0x7f6ffc0a5790 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f7004005d00 tx=0x7f700400b410 comp rx=0 tx=0).stop 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 msgr2=0x7f7014100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 0x7f7014100ed0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7008005940 tx=0x7f70080042f0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 shutdown_connections 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6ffc0a32d0 0x7f6ffc0a5790 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f70141082a0 0x7f7014101410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f70141036e0 0x7f7014100ed0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 --2- 172.21.15.70:0/2802559271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7014102d30 0x7f7014100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:57.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 >> 172.21.15.70:0/2802559271 conn(0x7f70140fc7d0 msgr2=0x7f7014105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:57.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 shutdown_connections 2024-09-19T04:29:57.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.651+0000 7f7019405640 1 -- 172.21.15.70:0/2802559271 wait complete. 2024-09-19T04:29:57.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:57 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/325583025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:29:58.011 INFO:tasks.cephadm.ceph_manager.ceph:need seq 266287972384 got 266287972385 for osd.9 2024-09-19T04:29:58.011 DEBUG:teuthology.parallel:result is None 2024-09-19T04:29:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/325583025' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-09-19T04:29:58.631 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:58 smithi070 ceph-mon[30942]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-19T04:29:58.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:58 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2802559271' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:29:58.632 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:58 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:29:58.659 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953527 got 137438953531 for osd.4 2024-09-19T04:29:58.660 DEBUG:teuthology.parallel:result is None 2024-09-19T04:29:58.832 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:58 smithi167 ceph-mon[34339]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-19T04:29:58.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:58 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2802559271' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:29:58.833 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:58 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:29:58.846 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:58 smithi134 ceph-mon[34525]: pgmap v303: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 4 op/s 2024-09-19T04:29:58.846 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:58 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2802559271' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-09-19T04:29:58.846 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:58 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:29:59.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 -- 172.21.15.70:0/3282426676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c101e10 msgr2=0x7fde2c1021f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 --2- 172.21.15.70:0/3282426676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c101e10 0x7fde2c1021f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fde28009900 tx=0x7fde2802a410 comp rx=0 tx=0).stop 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 -- 172.21.15.70:0/3282426676 shutdown_connections 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 --2- 172.21.15.70:0/3282426676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde2c106f40 0x7fde2c10eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 --2- 172.21.15.70:0/3282426676 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2c1027c0 0x7fde2c106810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 --2- 172.21.15.70:0/3282426676 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c101e10 0x7fde2c1021f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 -- 172.21.15.70:0/3282426676 >> 172.21.15.70:0/3282426676 conn(0x7fde2c0fd8d0 msgr2=0x7fde2c0ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 -- 172.21.15.70:0/3282426676 shutdown_connections 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.146+0000 7fde3401c640 1 -- 172.21.15.70:0/3282426676 wait complete. 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.147+0000 7fde3401c640 1 Processor -- start 2024-09-19T04:29:59.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.147+0000 7fde3401c640 1 -- start start 2024-09-19T04:29:59.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.147+0000 7fde3401c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde2c101e10 0x7fde2c1984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:59.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.147+0000 7fde3401c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c1027c0 0x7fde2c198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:59.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.147+0000 7fde3401c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2c106f40 0x7fde2c19cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:59.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.147+0000 7fde3401c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c111fd0 con 0x7fde2c1027c0 2024-09-19T04:29:59.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.147+0000 7fde3401c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c111e50 con 0x7fde2c101e10 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.147+0000 7fde3401c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde2c112150 con 0x7fde2c106f40 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c1027c0 0x7fde2c198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c1027c0 0x7fde2c198a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52538/0 (socket says 172.21.15.70:52538) 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 -- 172.21.15.70:0/3793469977 learned_addr learned my addr 172.21.15.70:0/3793469977 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde325b9640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2c106f40 0x7fde2c19cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde31db8640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde2c101e10 0x7fde2c1984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 -- 172.21.15.70:0/3793469977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2c106f40 msgr2=0x7fde2c19cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2c106f40 0x7fde2c19cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 -- 172.21.15.70:0/3793469977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde2c101e10 msgr2=0x7fde2c1984d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde2c101e10 0x7fde2c1984d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 -- 172.21.15.70:0/3793469977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde2c19d480 con 0x7fde2c1027c0 2024-09-19T04:29:59.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde315b7640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c1027c0 0x7fde2c198a10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c970 tx=0x7fde1c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:59.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde22ffd640 1 -- 172.21.15.70:0/3793469977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c007bb0 con 0x7fde2c1027c0 2024-09-19T04:29:59.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde22ffd640 1 -- 172.21.15.70:0/3793469977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fde1c007d50 con 0x7fde2c1027c0 2024-09-19T04:29:59.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde2c19d770 con 0x7fde2c1027c0 2024-09-19T04:29:59.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde22ffd640 1 -- 172.21.15.70:0/3793469977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde1c00f450 con 0x7fde2c1027c0 2024-09-19T04:29:59.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.148+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde2c1a5050 con 0x7fde2c1027c0 2024-09-19T04:29:59.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.149+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde2c1021f0 con 0x7fde2c1027c0 2024-09-19T04:29:59.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.150+0000 7fde22ffd640 1 -- 172.21.15.70:0/3793469977 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fde1c004f90 con 0x7fde2c1027c0 2024-09-19T04:29:59.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.151+0000 7fde22ffd640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fde180a32d0 0x7fde180a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:59.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.151+0000 7fde31db8640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fde180a32d0 0x7fde180a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:59.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.151+0000 7fde22ffd640 1 -- 172.21.15.70:0/3793469977 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fde1c0cfaf0 con 0x7fde2c1027c0 2024-09-19T04:29:59.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.152+0000 7fde31db8640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fde180a32d0 0x7fde180a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fde28006010 tx=0x7fde280058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:59.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.154+0000 7fde22ffd640 1 -- 172.21.15.70:0/3793469977 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fde1c014030 con 0x7fde2c1027c0 2024-09-19T04:29:59.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.326+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fde2c199830 con 0x7fde2c1027c0 2024-09-19T04:29:59.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.326+0000 7fde22ffd640 1 -- 172.21.15.70:0/3793469977 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fde1c09c090 con 0x7fde2c1027c0 2024-09-19T04:29:59.328 INFO:teuthology.orchestra.run.smithi070.stdout:34359738447 2024-09-19T04:29:59.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fde180a32d0 msgr2=0x7fde180a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fde180a32d0 0x7fde180a5790 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fde28006010 tx=0x7fde280058d0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c1027c0 msgr2=0x7fde2c198a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c1027c0 0x7fde2c198a10 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fde1c00c970 tx=0x7fde1c00ce30 comp rx=0 tx=0).stop 2024-09-19T04:29:59.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 shutdown_connections 2024-09-19T04:29:59.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fde180a32d0 0x7fde180a5790 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde2c106f40 0x7fde2c19cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde2c1027c0 0x7fde2c198a10 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 --2- 172.21.15.70:0/3793469977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde2c101e10 0x7fde2c1984d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 >> 172.21.15.70:0/3793469977 conn(0x7fde2c0fd8d0 msgr2=0x7fde2c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:59.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 shutdown_connections 2024-09-19T04:29:59.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:59.329+0000 7fde3401c640 1 -- 172.21.15.70:0/3793469977 wait complete. 2024-09-19T04:29:59.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 -- 172.21.15.70:0/151415503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44102ef0 msgr2=0x7f2b4410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/151415503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44102ef0 0x7f2b4410da40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f2b3c009ca0 tx=0x7f2b3c02a950 comp rx=0 tx=0).stop 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 -- 172.21.15.70:0/151415503 shutdown_connections 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/151415503 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44102ef0 0x7f2b4410da40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/151415503 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b44102570 0x7f2b441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/151415503 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b44100e20 0x7f2b44101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 -- 172.21.15.70:0/151415503 >> 172.21.15.70:0/151415503 conn(0x7f2b440fc7d0 msgr2=0x7f2b440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 -- 172.21.15.70:0/151415503 shutdown_connections 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.327+0000 7f2b4bc46640 1 -- 172.21.15.70:0/151415503 wait complete. 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.328+0000 7f2b4bc46640 1 Processor -- start 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.328+0000 7f2b4bc46640 1 -- start start 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.328+0000 7f2b4bc46640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44100e20 0x7f2b44198680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:59.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.328+0000 7f2b4bc46640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b44102570 0x7f2b44198bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.328+0000 7f2b4bc46640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b44102ef0 0x7f2b4419cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.328+0000 7f2b4bc46640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44112120 con 0x7f2b44100e20 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.328+0000 7f2b4bc46640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b44111fa0 con 0x7f2b44102ef0 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b4bc46640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b441122a0 con 0x7f2b44102570 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44100e20 0x7f2b44198680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44100e20 0x7f2b44198680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52514/0 (socket says 172.21.15.70:52514) 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 -- 172.21.15.70:0/325583025 learned_addr learned my addr 172.21.15.70:0/325583025 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b491e1640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b44102570 0x7f2b44198bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b4a1e3640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b44102ef0 0x7f2b4419cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 -- 172.21.15.70:0/325583025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b44102570 msgr2=0x7f2b44198bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b44102570 0x7f2b44198bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 -- 172.21.15.70:0/325583025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b44102ef0 msgr2=0x7f2b4419cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b44102ef0 0x7f2b4419cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 -- 172.21.15.70:0/325583025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b4419d630 con 0x7f2b44100e20 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b4a1e3640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b44102ef0 0x7f2b4419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b499e2640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44100e20 0x7f2b44198680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000b4a0 tx=0x7f2b4000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b3affd640 1 -- 172.21.15.70:0/325583025 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40015020 con 0x7f2b44100e20 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b4419d920 con 0x7f2b44100e20 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b3affd640 1 -- 172.21.15.70:0/325583025 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b40011d00 con 0x7f2b44100e20 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b3affd640 1 -- 172.21.15.70:0/325583025 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b40010e50 con 0x7f2b44100e20 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.329+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b441a5200 con 0x7f2b44100e20 2024-09-19T04:29:59.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.331+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2b44101280 con 0x7f2b44100e20 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.332+0000 7f2b3affd640 1 -- 172.21.15.70:0/325583025 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f2b40018020 con 0x7f2b44100e20 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.332+0000 7f2b3affd640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b300a34f0 0x7f2b300a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.333+0000 7f2b491e1640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b300a34f0 0x7f2b300a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.333+0000 7f2b3affd640 1 -- 172.21.15.70:0/325583025 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f2b400cf6e0 con 0x7f2b44100e20 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.333+0000 7f2b491e1640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b300a34f0 0x7f2b300a59b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ffe50 tx=0x7f2b34009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.336+0000 7f2b3affd640 1 -- 172.21.15.70:0/325583025 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2b4001f020 con 0x7f2b44100e20 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.555+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f2b441999e0 con 0x7f2b44100e20 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.556+0000 7f2b3affd640 1 -- 172.21.15.70:0/325583025 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f2b441999e0 con 0x7f2b44100e20 2024-09-19T04:29:59.382 INFO:teuthology.orchestra.run.smithi070.stdout:77309411396 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b300a34f0 msgr2=0x7f2b300a59b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b300a34f0 0x7f2b300a59b0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2b440ffe50 tx=0x7f2b34009110 comp rx=0 tx=0).stop 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44100e20 msgr2=0x7f2b44198680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44100e20 0x7f2b44198680 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f2b4000b4a0 tx=0x7f2b4000b8a0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 shutdown_connections 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f2b300a34f0 0x7f2b300a59b0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b44102ef0 0x7f2b4419cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b44102570 0x7f2b44198bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 --2- 172.21.15.70:0/325583025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b44100e20 0x7f2b44198680 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:29:59.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 >> 172.21.15.70:0/325583025 conn(0x7f2b440fc7d0 msgr2=0x7f2b440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:29:59.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 shutdown_connections 2024-09-19T04:29:59.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:29:57.558+0000 7f2b4bc46640 1 -- 172.21.15.70:0/325583025 wait complete. 2024-09-19T04:29:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:59 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3793469977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:29:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:59 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:29:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:59 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:29:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:59 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:29:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:29:59 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:29:59.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:59 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3793469977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:29:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:59 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:29:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:59 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:29:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:59 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:29:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:29:59 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:59 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3793469977' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-09-19T04:30:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:59 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:59 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:59 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:29:59 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:00.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 -- 172.21.15.70:0/225831063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e8102de0 msgr2=0x7fe8e81031c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/225831063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e8102de0 0x7fe8e81031c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe8e4009900 tx=0x7fe8e402a480 comp rx=0 tx=0).stop 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 -- 172.21.15.70:0/225831063 shutdown_connections 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/225831063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e810c180 0x7fe8e810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/225831063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8103700 0x7fe8e810bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/225831063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e8102de0 0x7fe8e81031c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 -- 172.21.15.70:0/225831063 >> 172.21.15.70:0/225831063 conn(0x7fe8e80fc7a0 msgr2=0x7fe8e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 -- 172.21.15.70:0/225831063 shutdown_connections 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.123+0000 7fe8efd8e640 1 -- 172.21.15.70:0/225831063 wait complete. 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8efd8e640 1 Processor -- start 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8efd8e640 1 -- start start 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8efd8e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e8102de0 0x7fe8e8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8efd8e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8103700 0x7fe8e81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:00.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8efd8e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e810c180 0x7fe8e819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8efd8e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8111f40 con 0x7fe8e810c180 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8efd8e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e8111dc0 con 0x7fe8e8102de0 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8efd8e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe8e81120c0 con 0x7fe8e8103700 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e810c180 0x7fe8e819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e810c180 0x7fe8e819cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52552/0 (socket says 172.21.15.70:52552) 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 -- 172.21.15.70:0/1735388638 learned_addr learned my addr 172.21.15.70:0/1735388638 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ed329640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8103700 0x7fe8e81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 -- 172.21.15.70:0/1735388638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8103700 msgr2=0x7fe8e81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8edb2a640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e8102de0 0x7fe8e8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8103700 0x7fe8e81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 -- 172.21.15.70:0/1735388638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e8102de0 msgr2=0x7fe8e8198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e8102de0 0x7fe8e8198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 -- 172.21.15.70:0/1735388638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8e819d410 con 0x7fe8e810c180 2024-09-19T04:30:00.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.124+0000 7fe8ee32b640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e810c180 0x7fe8e819cd30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009fd0 tx=0x7fe8e000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.125+0000 7fe8deffd640 1 -- 172.21.15.70:0/1735388638 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e0017070 con 0x7fe8e810c180 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.125+0000 7fe8deffd640 1 -- 172.21.15.70:0/1735388638 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe8e0003e40 con 0x7fe8e810c180 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.125+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8e819d700 con 0x7fe8e810c180 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.125+0000 7fe8deffd640 1 -- 172.21.15.70:0/1735388638 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8e00106c0 con 0x7fe8e810c180 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.125+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8e81a4fe0 con 0x7fe8e810c180 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.126+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8e81031c0 con 0x7fe8e810c180 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.127+0000 7fe8deffd640 1 -- 172.21.15.70:0/1735388638 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe8e0003970 con 0x7fe8e810c180 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.127+0000 7fe8deffd640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d40a32d0 0x7fe8d40a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.128+0000 7fe8edb2a640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d40a32d0 0x7fe8d40a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.128+0000 7fe8deffd640 1 -- 172.21.15.70:0/1735388638 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fe8e00cf800 con 0x7fe8e810c180 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.128+0000 7fe8edb2a640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d40a32d0 0x7fe8d40a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40096c0 tx=0x7fe8e4000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:00.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.131+0000 7fe8deffd640 1 -- 172.21.15.70:0/1735388638 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8e0003c60 con 0x7fe8e810c180 2024-09-19T04:30:00.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.302+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fe8e81997c0 con 0x7fe8e810c180 2024-09-19T04:30:00.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.302+0000 7fe8deffd640 1 -- 172.21.15.70:0/1735388638 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe8e81997c0 con 0x7fe8e810c180 2024-09-19T04:30:00.304 INFO:teuthology.orchestra.run.smithi070.stdout:107374182464 2024-09-19T04:30:00.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d40a32d0 msgr2=0x7fe8d40a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d40a32d0 0x7fe8d40a5790 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fe8e40096c0 tx=0x7fe8e4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e810c180 msgr2=0x7fe8e819cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e810c180 0x7fe8e819cd30 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fe8e0009fd0 tx=0x7fe8e000b260 comp rx=0 tx=0).stop 2024-09-19T04:30:00.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 shutdown_connections 2024-09-19T04:30:00.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8d40a32d0 0x7fe8d40a5790 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8e810c180 0x7fe8e819cd30 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8e8103700 0x7fe8e81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 --2- 172.21.15.70:0/1735388638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8e8102de0 0x7fe8e8198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.305+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 >> 172.21.15.70:0/1735388638 conn(0x7fe8e80fc7a0 msgr2=0x7fe8e80fe040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:00.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.306+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 shutdown_connections 2024-09-19T04:30:00.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.306+0000 7fe8efd8e640 1 -- 172.21.15.70:0/1735388638 wait complete. 2024-09-19T04:30:00.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 -- 172.21.15.70:0/4121701818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178100e20 msgr2=0x7fd178101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 --2- 172.21.15.70:0/4121701818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178100e20 0x7fd178101200 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fd168009900 tx=0x7fd16802a480 comp rx=0 tx=0).stop 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 -- 172.21.15.70:0/4121701818 shutdown_connections 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 --2- 172.21.15.70:0/4121701818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178102ef0 0x7fd17810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 --2- 172.21.15.70:0/4121701818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd178102570 0x7fd1781029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 --2- 172.21.15.70:0/4121701818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178100e20 0x7fd178101200 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 -- 172.21.15.70:0/4121701818 >> 172.21.15.70:0/4121701818 conn(0x7fd1780fc7d0 msgr2=0x7fd1780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 -- 172.21.15.70:0/4121701818 shutdown_connections 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.341+0000 7fd17d223640 1 -- 172.21.15.70:0/4121701818 wait complete. 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.342+0000 7fd17d223640 1 Processor -- start 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.342+0000 7fd17d223640 1 -- start start 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.342+0000 7fd17d223640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd178100e20 0x7fd1781994a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.342+0000 7fd17d223640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178102570 0x7fd1781999e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:00.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.342+0000 7fd17d223640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178102ef0 0x7fd1781a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.342+0000 7fd17d223640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd178111010 con 0x7fd178102ef0 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.342+0000 7fd17d223640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd178110e90 con 0x7fd178102570 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.342+0000 7fd17d223640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd178111190 con 0x7fd178100e20 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178102ef0 0x7fd1781a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178102ef0 0x7fd1781a4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52572/0 (socket says 172.21.15.70:52572) 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 -- 172.21.15.70:0/245844665 learned_addr learned my addr 172.21.15.70:0/245844665 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17659c640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178102570 0x7fd1781999e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd176d9d640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd178100e20 0x7fd1781994a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 -- 172.21.15.70:0/245844665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd178100e20 msgr2=0x7fd1781994a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd178100e20 0x7fd1781994a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 -- 172.21.15.70:0/245844665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178102570 msgr2=0x7fd1781999e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178102570 0x7fd1781999e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 -- 172.21.15.70:0/245844665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1781a4a60 con 0x7fd178102ef0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd176d9d640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd178100e20 0x7fd1781994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17759e640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178102ef0 0x7fd1781a4520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd17000b970 tx=0x7fd17000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd15ffff640 1 -- 172.21.15.70:0/245844665 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170019070 con 0x7fd178102ef0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1781a4c30 con 0x7fd178102ef0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd15ffff640 1 -- 172.21.15.70:0/245844665 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd17000cb40 con 0x7fd178102ef0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd15ffff640 1 -- 172.21.15.70:0/245844665 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd170007650 con 0x7fd178102ef0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.343+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1781a5140 con 0x7fd178102ef0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.344+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd178101280 con 0x7fd178102ef0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.345+0000 7fd15ffff640 1 -- 172.21.15.70:0/245844665 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd17001c070 con 0x7fd178102ef0 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.346+0000 7fd15ffff640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1600a32d0 0x7fd1600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:00.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.346+0000 7fd176d9d640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1600a32d0 0x7fd1600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:00.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.346+0000 7fd15ffff640 1 -- 172.21.15.70:0/245844665 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fd1700cf510 con 0x7fd178102ef0 2024-09-19T04:30:00.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.346+0000 7fd176d9d640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1600a32d0 0x7fd1600a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd168006010 tx=0x7fd168000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:00.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.349+0000 7fd15ffff640 1 -- 172.21.15.70:0/245844665 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd17009c210 con 0x7fd178102ef0 2024-09-19T04:30:00.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.520+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fd178109090 con 0x7fd178102ef0 2024-09-19T04:30:00.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.520+0000 7fd15ffff640 1 -- 172.21.15.70:0/245844665 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fd17009bb10 con 0x7fd178102ef0 2024-09-19T04:30:00.522 INFO:teuthology.orchestra.run.smithi070.stdout:184683593776 2024-09-19T04:30:00.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1600a32d0 msgr2=0x7fd1600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1600a32d0 0x7fd1600a5790 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fd168006010 tx=0x7fd168000bc0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178102ef0 msgr2=0x7fd1781a4520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:00.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178102ef0 0x7fd1781a4520 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fd17000b970 tx=0x7fd17000be30 comp rx=0 tx=0).stop 2024-09-19T04:30:00.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 shutdown_connections 2024-09-19T04:30:00.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd1600a32d0 0x7fd1600a5790 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd178102ef0 0x7fd1781a4520 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd178102570 0x7fd1781999e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 --2- 172.21.15.70:0/245844665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd178100e20 0x7fd1781994a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:00.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.522+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 >> 172.21.15.70:0/245844665 conn(0x7fd1780fc7d0 msgr2=0x7fd1780febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:00.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.523+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 shutdown_connections 2024-09-19T04:30:00.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:00.523+0000 7fd17d223640 1 -- 172.21.15.70:0/245844665 wait complete. 2024-09-19T04:30:00.708 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411393 got 77309411396 for osd.2 2024-09-19T04:30:00.708 DEBUG:teuthology.parallel:result is None 2024-09-19T04:30:00.834 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:00 smithi070 ceph-mon[30942]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T04:30:00.835 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:00 smithi070 ceph-mon[30942]: overall HEALTH_OK 2024-09-19T04:30:00.835 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:00 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1735388638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:30:00.835 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:00 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/245844665' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:30:00.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:00 smithi167 ceph-mon[34339]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T04:30:00.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:00 smithi167 ceph-mon[34339]: overall HEALTH_OK 2024-09-19T04:30:00.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:00 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1735388638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:30:00.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:00 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/245844665' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:30:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:00 smithi134 ceph-mon[34525]: pgmap v304: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 5 op/s 2024-09-19T04:30:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:00 smithi134 ceph-mon[34525]: overall HEALTH_OK 2024-09-19T04:30:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:00 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1735388638' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-09-19T04:30:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:00 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/245844665' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-09-19T04:30:01.145 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738444 got 34359738447 for osd.0 2024-09-19T04:30:01.146 DEBUG:teuthology.parallel:result is None 2024-09-19T04:30:01.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.627+0000 7f0136b0e640 1 -- 172.21.15.70:0/397934197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f013010c170 msgr2=0x7f013010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.627+0000 7f0136b0e640 1 --2- 172.21.15.70:0/397934197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f013010c170 0x7f013010e610 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0128009ca0 tx=0x7f012802a950 comp rx=0 tx=0).stop 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.627+0000 7f0136b0e640 1 -- 172.21.15.70:0/397934197 shutdown_connections 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 --2- 172.21.15.70:0/397934197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f013010c170 0x7f013010e610 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 --2- 172.21.15.70:0/397934197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0130103660 0x7f013010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 --2- 172.21.15.70:0/397934197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0130102d40 0x7f0130103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 -- 172.21.15.70:0/397934197 >> 172.21.15.70:0/397934197 conn(0x7f01300fc7a0 msgr2=0x7f01300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 -- 172.21.15.70:0/397934197 shutdown_connections 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 -- 172.21.15.70:0/397934197 wait complete. 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 Processor -- start 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 -- start start 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0130102d40 0x7f01301983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:01.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0130103660 0x7f0130198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013010c170 0x7f013019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0130111f40 con 0x7f0130103660 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0130111dc0 con 0x7f0130102d40 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.628+0000 7f0136b0e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f01301120c0 con 0x7f013010c170 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0130103660 0x7f0130198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0130103660 0x7f0130198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52592/0 (socket says 172.21.15.70:52592) 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 -- 172.21.15.70:0/1723413606 learned_addr learned my addr 172.21.15.70:0/1723413606 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f01350ab640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013010c170 0x7f013019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f01348aa640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0130102d40 0x7f01301983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 -- 172.21.15.70:0/1723413606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013010c170 msgr2=0x7f013019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:01.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013010c170 0x7f013019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.870 INFO:teuthology.orchestra.run.smithi070.stdout:287762808861 2024-09-19T04:30:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 -- 172.21.15.70:0/1723413606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0130102d40 msgr2=0x7f01301983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0130102d40 0x7f01301983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 -- 172.21.15.70:0/1723413606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f013019d370 con 0x7f0130103660 2024-09-19T04:30:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f01350ab640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013010c170 0x7f013019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f01348aa640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0130102d40 0x7f01301983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012ffff640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0130103660 0x7f0130198900 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f012400c970 tx=0x7f012400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:01.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012dffb640 1 -- 172.21.15.70:0/1723413606 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124007bb0 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012dffb640 1 -- 172.21.15.70:0/1723413606 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0124007d50 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f013019d660 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f012dffb640 1 -- 172.21.15.70:0/1723413606 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0124018820 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.629+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01301a4f40 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.630+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0130103120 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.631+0000 7f012dffb640 1 -- 172.21.15.70:0/1723413606 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f01240189c0 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.632+0000 7f012dffb640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f01180a3350 0x7f01180a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.632+0000 7f01348aa640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f01180a3350 0x7f01180a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.633+0000 7f012dffb640 1 -- 172.21.15.70:0/1723413606 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f01240cfaf0 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.633+0000 7f01348aa640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f01180a3350 0x7f01180a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0120009b40 tx=0x7f0120005e50 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.637+0000 7f012dffb640 1 -- 172.21.15.70:0/1723413606 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0124014030 con 0x7f0130103660 2024-09-19T04:30:01.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.808+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f01301a51d0 con 0x7f0130103660 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.808+0000 7f012dffb640 1 -- 172.21.15.70:0/1723413606 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f012409c6e0 con 0x7f0130103660 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f01180a3350 msgr2=0x7f01180a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f01180a3350 0x7f01180a5810 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f0120009b40 tx=0x7f0120005e50 comp rx=0 tx=0).stop 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0130103660 msgr2=0x7f0130198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0130103660 0x7f0130198900 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f012400c970 tx=0x7f012400ce30 comp rx=0 tx=0).stop 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 shutdown_connections 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f01180a3350 0x7f01180a5810 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f013010c170 0x7f013019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0130103660 0x7f0130198900 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 --2- 172.21.15.70:0/1723413606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0130102d40 0x7f01301983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 >> 172.21.15.70:0/1723413606 conn(0x7f01300fc7a0 msgr2=0x7f01300fd3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:01.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 shutdown_connections 2024-09-19T04:30:01.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:01.810+0000 7f0136b0e640 1 -- 172.21.15.70:0/1723413606 wait complete. 2024-09-19T04:30:02.349 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:02.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:02 smithi070 ceph-mon[30942]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:30:02.714 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:02 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1723413606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:30:02.741 INFO:tasks.cephadm.ceph_manager.ceph:need seq 184683593773 got 184683593776 for osd.6 2024-09-19T04:30:02.741 DEBUG:teuthology.parallel:result is None 2024-09-19T04:30:02.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:02 smithi167 ceph-mon[34339]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:30:02.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:02 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1723413606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:30:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:02 smithi134 ceph-mon[34525]: pgmap v305: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:30:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:02 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1723413606' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-09-19T04:30:03.123 INFO:tasks.cephadm.ceph_manager.ceph:need seq 206158430249 got 206158430252 for osd.7 2024-09-19T04:30:03.123 DEBUG:teuthology.parallel:result is None 2024-09-19T04:30:03.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/2438645283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48101de0 msgr2=0x7fcf481021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:03.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/2438645283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48101de0 0x7fcf481021c0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcf38009900 tx=0x7fcf3802a410 comp rx=0 tx=0).stop 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/2438645283 shutdown_connections 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/2438645283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf48106f10 0x7fcf4810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/2438645283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf48102790 0x7fcf481067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/2438645283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48101de0 0x7fcf481021c0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/2438645283 >> 172.21.15.70:0/2438645283 conn(0x7fcf480fd8c0 msgr2=0x7fcf480ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/2438645283 shutdown_connections 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.557+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/2438645283 wait complete. 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf4cb4a640 1 Processor -- start 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf4cb4a640 1 -- start start 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf4cb4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf48101de0 0x7fcf48198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:03.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf4cb4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf48102790 0x7fcf48198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf4cb4a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48106f10 0x7fcf4819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf4cb4a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48111f40 con 0x7fcf48106f10 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf4cb4a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcf48111dc0 con 0x7fcf48102790 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf4cb4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcf481120c0 con 0x7fcf48101de0 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf46d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48106f10 0x7fcf4819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf46d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48106f10 0x7fcf4819ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34200/0 (socket says 172.21.15.70:34200) 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.558+0000 7fcf46d9d640 1 -- 172.21.15.70:0/482238422 learned_addr learned my addr 172.21.15.70:0/482238422 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf4659c640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf48101de0 0x7fcf48198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf45d9b640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf48102790 0x7fcf48198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf46d9d640 1 -- 172.21.15.70:0/482238422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf48101de0 msgr2=0x7fcf48198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf46d9d640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf48101de0 0x7fcf48198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf46d9d640 1 -- 172.21.15.70:0/482238422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf48102790 msgr2=0x7fcf48198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:03.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf46d9d640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf48102790 0x7fcf48198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf46d9d640 1 -- 172.21.15.70:0/482238422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf4819d3d0 con 0x7fcf48106f10 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf45d9b640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf48102790 0x7fcf48198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf46d9d640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48106f10 0x7fcf4819ccf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000eaa0 tx=0x7fcf4000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf377fe640 1 -- 172.21.15.70:0/482238422 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf4000cdb0 con 0x7fcf48106f10 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf377fe640 1 -- 172.21.15.70:0/482238422 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcf40005020 con 0x7fcf48106f10 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf4819d6c0 con 0x7fcf48106f10 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf377fe640 1 -- 172.21.15.70:0/482238422 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf400116b0 con 0x7fcf48106f10 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.559+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf481a4fa0 con 0x7fcf48106f10 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.560+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf481021c0 con 0x7fcf48106f10 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.561+0000 7fcf377fe640 1 -- 172.21.15.70:0/482238422 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fcf400051d0 con 0x7fcf48106f10 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.562+0000 7fcf377fe640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcf300a32d0 0x7fcf300a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.562+0000 7fcf4659c640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcf300a32d0 0x7fcf300a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:03.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.562+0000 7fcf377fe640 1 -- 172.21.15.70:0/482238422 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fcf400cfd20 con 0x7fcf48106f10 2024-09-19T04:30:03.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.562+0000 7fcf4659c640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcf300a32d0 0x7fcf300a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf38005ab0 tx=0x7fcf38005a20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:03.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.566+0000 7fcf377fe640 1 -- 172.21.15.70:0/482238422 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fcf40016030 con 0x7fcf48106f10 2024-09-19T04:30:03.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.737+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7fcf48109b60 con 0x7fcf48106f10 2024-09-19T04:30:03.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.737+0000 7fcf377fe640 1 -- 172.21.15.70:0/482238422 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7fcf4009c910 con 0x7fcf48106f10 2024-09-19T04:30:03.739 INFO:teuthology.orchestra.run.smithi070.stdout:322122547225 2024-09-19T04:30:03.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcf300a32d0 msgr2=0x7fcf300a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:03.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcf300a32d0 0x7fcf300a5790 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7fcf38005ab0 tx=0x7fcf38005a20 comp rx=0 tx=0).stop 2024-09-19T04:30:03.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48106f10 msgr2=0x7fcf4819ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48106f10 0x7fcf4819ccf0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcf4000eaa0 tx=0x7fcf4000ef60 comp rx=0 tx=0).stop 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 shutdown_connections 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fcf300a32d0 0x7fcf300a5790 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcf48106f10 0x7fcf4819ccf0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcf48102790 0x7fcf48198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 --2- 172.21.15.70:0/482238422 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcf48101de0 0x7fcf48198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 >> 172.21.15.70:0/482238422 conn(0x7fcf480fd8c0 msgr2=0x7fcf480fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 shutdown_connections 2024-09-19T04:30:03.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:03.740+0000 7fcf4cb4a640 1 -- 172.21.15.70:0/482238422 wait complete. 2024-09-19T04:30:04.003 INFO:tasks.cephadm.ceph_manager.ceph:need seq 107374182462 got 107374182464 for osd.3 2024-09-19T04:30:04.003 DEBUG:teuthology.parallel:result is None 2024-09-19T04:30:04.639 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547222 got 322122547225 for osd.11 2024-09-19T04:30:04.639 DEBUG:teuthology.parallel:result is None 2024-09-19T04:30:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:04 smithi070 ceph-mon[30942]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T04:30:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:04 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/482238422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:30:04.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:04 smithi167 ceph-mon[34339]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T04:30:04.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:04 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/482238422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:30:05.017 INFO:tasks.cephadm.ceph_manager.ceph:need seq 287762808858 got 287762808861 for osd.10 2024-09-19T04:30:05.017 DEBUG:teuthology.parallel:result is None 2024-09-19T04:30:05.017 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-09-19T04:30:05.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:30:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:04 smithi134 ceph-mon[34525]: pgmap v306: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 6 op/s 2024-09-19T04:30:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:04 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/482238422' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-09-19T04:30:05.735 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 -- 172.21.15.70:0/2325964857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c106f10 msgr2=0x7fa33c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 --2- 172.21.15.70:0/2325964857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c106f10 0x7fa33c10ea90 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa334009ca0 tx=0x7fa33402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 -- 172.21.15.70:0/2325964857 shutdown_connections 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 --2- 172.21.15.70:0/2325964857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c106f10 0x7fa33c10ea90 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 --2- 172.21.15.70:0/2325964857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa33c102790 0x7fa33c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 --2- 172.21.15.70:0/2325964857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa33c101de0 0x7fa33c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 -- 172.21.15.70:0/2325964857 >> 172.21.15.70:0/2325964857 conn(0x7fa33c0fd8c0 msgr2=0x7fa33c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 -- 172.21.15.70:0/2325964857 shutdown_connections 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.201+0000 7fa3423d0640 1 -- 172.21.15.70:0/2325964857 wait complete. 2024-09-19T04:30:06.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.202+0000 7fa3423d0640 1 Processor -- start 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.202+0000 7fa3423d0640 1 -- start start 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa3423d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c101de0 0x7fa33c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa3423d0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa33c102790 0x7fa33c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa3423d0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa33c106f10 0x7fa33c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa3423d0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c112000 con 0x7fa33c101de0 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa3423d0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c111e80 con 0x7fa33c102790 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa3423d0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa33c112180 con 0x7fa33c106f10 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c101de0 0x7fa33c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c101de0 0x7fa33c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34214/0 (socket says 172.21.15.70:34214) 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 -- 172.21.15.70:0/1452984748 learned_addr learned my addr 172.21.15.70:0/1452984748 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa333fff640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa33c102790 0x7fa33c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa34096d640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa33c106f10 0x7fa33c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:06.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 -- 172.21.15.70:0/1452984748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa33c106f10 msgr2=0x7fa33c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa33c106f10 0x7fa33c19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 -- 172.21.15.70:0/1452984748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa33c102790 msgr2=0x7fa33c198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa33c102790 0x7fa33c198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 -- 172.21.15.70:0/1452984748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa33c19d550 con 0x7fa33c101de0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa34096d640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa33c106f10 0x7fa33c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa33bfff640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c101de0 0x7fa33c1985a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00b4a0 tx=0x7fa32c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa339ffb640 1 -- 172.21.15.70:0/1452984748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c014070 con 0x7fa33c101de0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa33c19d840 con 0x7fa33c101de0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa339ffb640 1 -- 172.21.15.70:0/1452984748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa32c010ae0 con 0x7fa33c101de0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa339ffb640 1 -- 172.21.15.70:0/1452984748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa32c017c70 con 0x7fa33c101de0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.203+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa33c1a5120 con 0x7fa33c101de0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.204+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa33c102240 con 0x7fa33c101de0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.205+0000 7fa339ffb640 1 -- 172.21.15.70:0/1452984748 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fa32c017070 con 0x7fa33c101de0 2024-09-19T04:30:06.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.206+0000 7fa339ffb640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa3280a32d0 0x7fa3280a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.206+0000 7fa339ffb640 1 -- 172.21.15.70:0/1452984748 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fa32c0cee20 con 0x7fa33c101de0 2024-09-19T04:30:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.206+0000 7fa333fff640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa3280a32d0 0x7fa3280a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.206+0000 7fa333fff640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa3280a32d0 0x7fa3280a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0ffe20 tx=0x7fa324008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:06.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.210+0000 7fa339ffb640 1 -- 172.21.15.70:0/1452984748 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa32c09bb20 con 0x7fa33c101de0 2024-09-19T04:30:06.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.388+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa33c062630 con 0x7fa3280a32d0 2024-09-19T04:30:06.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.395+0000 7fa339ffb640 1 -- 172.21.15.70:0/1452984748 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258711 (secure 0 0 0) 0x7fa33c062630 con 0x7fa3280a32d0 2024-09-19T04:30:06.399 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:06.401 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-19T04:30:06.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa3280a32d0 msgr2=0x7fa3280a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa3280a32d0 0x7fa3280a5790 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fa33c0ffe20 tx=0x7fa324008040 comp rx=0 tx=0).stop 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c101de0 msgr2=0x7fa33c1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c101de0 0x7fa33c1985a0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa32c00b4a0 tx=0x7fa32c00b960 comp rx=0 tx=0).stop 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 shutdown_connections 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fa3280a32d0 0x7fa3280a5790 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa33c106f10 0x7fa33c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa33c102790 0x7fa33c198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 --2- 172.21.15.70:0/1452984748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa33c101de0 0x7fa33c1985a0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 >> 172.21.15.70:0/1452984748 conn(0x7fa33c0fd8c0 msgr2=0x7fa33c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 shutdown_connections 2024-09-19T04:30:06.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:06.399+0000 7fa3423d0640 1 -- 172.21.15.70:0/1452984748 wait complete. 2024-09-19T04:30:06.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:06 smithi070 ceph-mon[30942]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:30:06.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:06 smithi167 ceph-mon[34339]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:30:07.000 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":307,"stamp":"2024-09-19T04:30:05.401344+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":467,"num_read_kb":352,"num_write":344,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374476,"kb_used_data":12732,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567348,"statfs":{"total":1151940427776,"available":1151556964352,"internally_reserved":0,"allocated":13037568,"data_stored":7246287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":33,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003025"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478067+0000","last_change":"2024-09-19T04:29:02.416257+0000","last_active":"2024-09-19T04:29:18.478067+0000","last_peered":"2024-09-19T04:29:18.478067+0000","last_clean":"2024-09-19T04:29:18.478067+0000","last_became_active":"2024-09-19T04:29:02.415681+0000","last_became_peered":"2024-09-19T04:29:02.415681+0000","last_unstale":"2024-09-19T04:29:18.478067+0000","last_undegraded":"2024-09-19T04:29:18.478067+0000","last_fullsized":"2024-09-19T04:29:18.478067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:31.765859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479437+0000","last_change":"2024-09-19T04:29:02.417591+0000","last_active":"2024-09-19T04:29:18.479437+0000","last_peered":"2024-09-19T04:29:18.479437+0000","last_clean":"2024-09-19T04:29:18.479437+0000","last_became_active":"2024-09-19T04:29:02.417277+0000","last_became_peered":"2024-09-19T04:29:02.417277+0000","last_unstale":"2024-09-19T04:29:18.479437+0000","last_undegraded":"2024-09-19T04:29:18.479437+0000","last_fullsized":"2024-09-19T04:29:18.479437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:22.680000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479531+0000","last_change":"2024-09-19T04:29:02.416270+0000","last_active":"2024-09-19T04:29:18.479531+0000","last_peered":"2024-09-19T04:29:18.479531+0000","last_clean":"2024-09-19T04:29:18.479531+0000","last_became_active":"2024-09-19T04:29:02.415878+0000","last_became_peered":"2024-09-19T04:29:02.415878+0000","last_unstale":"2024-09-19T04:29:18.479531+0000","last_undegraded":"2024-09-19T04:29:18.479531+0000","last_fullsized":"2024-09-19T04:29:18.479531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:25.302575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353266+0000","last_change":"2024-09-19T04:29:02.414586+0000","last_active":"2024-09-19T04:29:19.353266+0000","last_peered":"2024-09-19T04:29:19.353266+0000","last_clean":"2024-09-19T04:29:19.353266+0000","last_became_active":"2024-09-19T04:29:02.414267+0000","last_became_peered":"2024-09-19T04:29:02.414267+0000","last_unstale":"2024-09-19T04:29:19.353266+0000","last_undegraded":"2024-09-19T04:29:19.353266+0000","last_fullsized":"2024-09-19T04:29:19.353266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:01.436793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479997+0000","last_change":"2024-09-19T04:29:02.412243+0000","last_active":"2024-09-19T04:29:18.479997+0000","last_peered":"2024-09-19T04:29:18.479997+0000","last_clean":"2024-09-19T04:29:18.479997+0000","last_became_active":"2024-09-19T04:29:02.411411+0000","last_became_peered":"2024-09-19T04:29:02.411411+0000","last_unstale":"2024-09-19T04:29:18.479997+0000","last_undegraded":"2024-09-19T04:29:18.479997+0000","last_fullsized":"2024-09-19T04:29:18.479997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:21.966542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.482295+0000","last_change":"2024-09-19T04:29:18.482295+0000","last_active":"2024-09-19T04:29:18.482295+0000","last_peered":"2024-09-19T04:29:18.482295+0000","last_clean":"2024-09-19T04:29:18.482295+0000","last_became_active":"2024-09-19T04:29:18.481929+0000","last_became_peered":"2024-09-19T04:29:18.481929+0000","last_unstale":"2024-09-19T04:29:18.482295+0000","last_undegraded":"2024-09-19T04:29:18.482295+0000","last_fullsized":"2024-09-19T04:29:18.482295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:17.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352359+0000","last_change":"2024-09-19T04:29:02.418029+0000","last_active":"2024-09-19T04:29:19.352359+0000","last_peered":"2024-09-19T04:29:19.352359+0000","last_clean":"2024-09-19T04:29:19.352359+0000","last_became_active":"2024-09-19T04:29:02.417676+0000","last_became_peered":"2024-09-19T04:29:02.417676+0000","last_unstale":"2024-09-19T04:29:19.352359+0000","last_undegraded":"2024-09-19T04:29:19.352359+0000","last_fullsized":"2024-09-19T04:29:19.352359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:12:03.148693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351553+0000","last_change":"2024-09-19T04:29:02.406657+0000","last_active":"2024-09-19T04:29:19.351553+0000","last_peered":"2024-09-19T04:29:19.351553+0000","last_clean":"2024-09-19T04:29:19.351553+0000","last_became_active":"2024-09-19T04:29:02.406203+0000","last_became_peered":"2024-09-19T04:29:02.406203+0000","last_unstale":"2024-09-19T04:29:19.351553+0000","last_undegraded":"2024-09-19T04:29:19.351553+0000","last_fullsized":"2024-09-19T04:29:19.351553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:06.842516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475951+0000","last_change":"2024-09-19T04:29:02.426478+0000","last_active":"2024-09-19T04:29:18.475951+0000","last_peered":"2024-09-19T04:29:18.475951+0000","last_clean":"2024-09-19T04:29:18.475951+0000","last_became_active":"2024-09-19T04:29:02.425938+0000","last_became_peered":"2024-09-19T04:29:02.425938+0000","last_unstale":"2024-09-19T04:29:18.475951+0000","last_undegraded":"2024-09-19T04:29:18.475951+0000","last_fullsized":"2024-09-19T04:29:18.475951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:01.439087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476878+0000","last_change":"2024-09-19T04:29:02.423380+0000","last_active":"2024-09-19T04:29:18.476878+0000","last_peered":"2024-09-19T04:29:18.476878+0000","last_clean":"2024-09-19T04:29:18.476878+0000","last_became_active":"2024-09-19T04:29:02.422894+0000","last_became_peered":"2024-09-19T04:29:02.422894+0000","last_unstale":"2024-09-19T04:29:18.476878+0000","last_undegraded":"2024-09-19T04:29:18.476878+0000","last_fullsized":"2024-09-19T04:29:18.476878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:55.082196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352800+0000","last_change":"2024-09-19T04:29:02.419929+0000","last_active":"2024-09-19T04:29:19.352800+0000","last_peered":"2024-09-19T04:29:19.352800+0000","last_clean":"2024-09-19T04:29:19.352800+0000","last_became_active":"2024-09-19T04:29:02.419432+0000","last_became_peered":"2024-09-19T04:29:02.419432+0000","last_unstale":"2024-09-19T04:29:19.352800+0000","last_undegraded":"2024-09-19T04:29:19.352800+0000","last_fullsized":"2024-09-19T04:29:19.352800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:50:03.896524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481806+0000","last_change":"2024-09-19T04:29:18.481426+0000","last_active":"2024-09-19T04:29:18.481806+0000","last_peered":"2024-09-19T04:29:18.481806+0000","last_clean":"2024-09-19T04:29:18.481806+0000","last_became_active":"2024-09-19T04:29:18.481042+0000","last_became_peered":"2024-09-19T04:29:18.481042+0000","last_unstale":"2024-09-19T04:29:18.481806+0000","last_undegraded":"2024-09-19T04:29:18.481806+0000","last_fullsized":"2024-09-19T04:29:18.481806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:16.251818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478854+0000","last_change":"2024-09-19T04:29:02.405545+0000","last_active":"2024-09-19T04:29:18.478854+0000","last_peered":"2024-09-19T04:29:18.478854+0000","last_clean":"2024-09-19T04:29:18.478854+0000","last_became_active":"2024-09-19T04:29:02.405247+0000","last_became_peered":"2024-09-19T04:29:02.405247+0000","last_unstale":"2024-09-19T04:29:18.478854+0000","last_undegraded":"2024-09-19T04:29:18.478854+0000","last_fullsized":"2024-09-19T04:29:18.478854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:26.673842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478732+0000","last_change":"2024-09-19T04:29:02.420647+0000","last_active":"2024-09-19T04:29:18.478732+0000","last_peered":"2024-09-19T04:29:18.478732+0000","last_clean":"2024-09-19T04:29:18.478732+0000","last_became_active":"2024-09-19T04:29:02.420310+0000","last_became_peered":"2024-09-19T04:29:02.420310+0000","last_unstale":"2024-09-19T04:29:18.478732+0000","last_undegraded":"2024-09-19T04:29:18.478732+0000","last_fullsized":"2024-09-19T04:29:18.478732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:47.893734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478550+0000","last_change":"2024-09-19T04:29:02.419199+0000","last_active":"2024-09-19T04:29:18.478550+0000","last_peered":"2024-09-19T04:29:18.478550+0000","last_clean":"2024-09-19T04:29:18.478550+0000","last_became_active":"2024-09-19T04:29:02.418902+0000","last_became_peered":"2024-09-19T04:29:02.418902+0000","last_unstale":"2024-09-19T04:29:18.478550+0000","last_undegraded":"2024-09-19T04:29:18.478550+0000","last_fullsized":"2024-09-19T04:29:18.478550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:04.958933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475374+0000","last_change":"2024-09-19T04:29:02.415284+0000","last_active":"2024-09-19T04:29:18.475374+0000","last_peered":"2024-09-19T04:29:18.475374+0000","last_clean":"2024-09-19T04:29:18.475374+0000","last_became_active":"2024-09-19T04:29:02.414947+0000","last_became_peered":"2024-09-19T04:29:02.414947+0000","last_unstale":"2024-09-19T04:29:18.475374+0000","last_undegraded":"2024-09-19T04:29:18.475374+0000","last_fullsized":"2024-09-19T04:29:18.475374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:08.525325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478189+0000","last_change":"2024-09-19T04:29:02.422294+0000","last_active":"2024-09-19T04:29:18.478189+0000","last_peered":"2024-09-19T04:29:18.478189+0000","last_clean":"2024-09-19T04:29:18.478189+0000","last_became_active":"2024-09-19T04:29:02.421014+0000","last_became_peered":"2024-09-19T04:29:02.421014+0000","last_unstale":"2024-09-19T04:29:18.478189+0000","last_undegraded":"2024-09-19T04:29:18.478189+0000","last_fullsized":"2024-09-19T04:29:18.478189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:34.197168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474734+0000","last_change":"2024-09-19T04:29:02.415319+0000","last_active":"2024-09-19T04:29:18.474734+0000","last_peered":"2024-09-19T04:29:18.474734+0000","last_clean":"2024-09-19T04:29:18.474734+0000","last_became_active":"2024-09-19T04:29:02.415030+0000","last_became_peered":"2024-09-19T04:29:02.415030+0000","last_unstale":"2024-09-19T04:29:18.474734+0000","last_undegraded":"2024-09-19T04:29:18.474734+0000","last_fullsized":"2024-09-19T04:29:18.474734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:11.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478695+0000","last_change":"2024-09-19T04:29:02.415938+0000","last_active":"2024-09-19T04:29:18.478695+0000","last_peered":"2024-09-19T04:29:18.478695+0000","last_clean":"2024-09-19T04:29:18.478695+0000","last_became_active":"2024-09-19T04:29:02.411665+0000","last_became_peered":"2024-09-19T04:29:02.411665+0000","last_unstale":"2024-09-19T04:29:18.478695+0000","last_undegraded":"2024-09-19T04:29:18.478695+0000","last_fullsized":"2024-09-19T04:29:18.478695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:12.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477535+0000","last_change":"2024-09-19T04:29:02.417489+0000","last_active":"2024-09-19T04:29:18.477535+0000","last_peered":"2024-09-19T04:29:18.477535+0000","last_clean":"2024-09-19T04:29:18.477535+0000","last_became_active":"2024-09-19T04:29:02.417164+0000","last_became_peered":"2024-09-19T04:29:02.417164+0000","last_unstale":"2024-09-19T04:29:18.477535+0000","last_undegraded":"2024-09-19T04:29:18.477535+0000","last_fullsized":"2024-09-19T04:29:18.477535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:28.055517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478961+0000","last_change":"2024-09-19T04:29:02.407559+0000","last_active":"2024-09-19T04:29:18.478961+0000","last_peered":"2024-09-19T04:29:18.478961+0000","last_clean":"2024-09-19T04:29:18.478961+0000","last_became_active":"2024-09-19T04:29:02.407241+0000","last_became_peered":"2024-09-19T04:29:02.407241+0000","last_unstale":"2024-09-19T04:29:18.478961+0000","last_undegraded":"2024-09-19T04:29:18.478961+0000","last_fullsized":"2024-09-19T04:29:18.478961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:13.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475575+0000","last_change":"2024-09-19T04:29:02.418341+0000","last_active":"2024-09-19T04:29:18.475575+0000","last_peered":"2024-09-19T04:29:18.475575+0000","last_clean":"2024-09-19T04:29:18.475575+0000","last_became_active":"2024-09-19T04:29:02.418028+0000","last_became_peered":"2024-09-19T04:29:02.418028+0000","last_unstale":"2024-09-19T04:29:18.475575+0000","last_undegraded":"2024-09-19T04:29:18.475575+0000","last_fullsized":"2024-09-19T04:29:18.475575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:03.264803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351574+0000","last_change":"2024-09-19T04:29:02.419191+0000","last_active":"2024-09-19T04:29:19.351574+0000","last_peered":"2024-09-19T04:29:19.351574+0000","last_clean":"2024-09-19T04:29:19.351574+0000","last_became_active":"2024-09-19T04:29:02.418587+0000","last_became_peered":"2024-09-19T04:29:02.418587+0000","last_unstale":"2024-09-19T04:29:19.351574+0000","last_undegraded":"2024-09-19T04:29:19.351574+0000","last_fullsized":"2024-09-19T04:29:19.351574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:58.185492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627644+0000","last_change":"2024-09-19T04:29:02.407961+0000","last_active":"2024-09-19T04:29:18.627644+0000","last_peered":"2024-09-19T04:29:18.627644+0000","last_clean":"2024-09-19T04:29:18.627644+0000","last_became_active":"2024-09-19T04:29:02.406888+0000","last_became_peered":"2024-09-19T04:29:02.406888+0000","last_unstale":"2024-09-19T04:29:18.627644+0000","last_undegraded":"2024-09-19T04:29:18.627644+0000","last_fullsized":"2024-09-19T04:29:18.627644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:47.360605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351914+0000","last_change":"2024-09-19T04:29:02.415234+0000","last_active":"2024-09-19T04:29:19.351914+0000","last_peered":"2024-09-19T04:29:19.351914+0000","last_clean":"2024-09-19T04:29:19.351914+0000","last_became_active":"2024-09-19T04:29:02.414929+0000","last_became_peered":"2024-09-19T04:29:02.414929+0000","last_unstale":"2024-09-19T04:29:19.351914+0000","last_undegraded":"2024-09-19T04:29:19.351914+0000","last_fullsized":"2024-09-19T04:29:19.351914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:48.077114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478990+0000","last_change":"2024-09-19T04:29:02.416072+0000","last_active":"2024-09-19T04:29:18.478990+0000","last_peered":"2024-09-19T04:29:18.478990+0000","last_clean":"2024-09-19T04:29:18.478990+0000","last_became_active":"2024-09-19T04:29:02.415714+0000","last_became_peered":"2024-09-19T04:29:02.415714+0000","last_unstale":"2024-09-19T04:29:18.478990+0000","last_undegraded":"2024-09-19T04:29:18.478990+0000","last_fullsized":"2024-09-19T04:29:18.478990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:45.000850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477913+0000","last_change":"2024-09-19T04:29:02.426071+0000","last_active":"2024-09-19T04:29:18.477913+0000","last_peered":"2024-09-19T04:29:18.477913+0000","last_clean":"2024-09-19T04:29:18.477913+0000","last_became_active":"2024-09-19T04:29:02.425717+0000","last_became_peered":"2024-09-19T04:29:02.425717+0000","last_unstale":"2024-09-19T04:29:18.477913+0000","last_undegraded":"2024-09-19T04:29:18.477913+0000","last_fullsized":"2024-09-19T04:29:18.477913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:11.989191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481675+0000","last_change":"2024-09-19T04:29:18.481675+0000","last_active":"2024-09-19T04:29:18.481675+0000","last_peered":"2024-09-19T04:29:18.481675+0000","last_clean":"2024-09-19T04:29:18.481675+0000","last_became_active":"2024-09-19T04:29:18.481224+0000","last_became_peered":"2024-09-19T04:29:18.481224+0000","last_unstale":"2024-09-19T04:29:18.481675+0000","last_undegraded":"2024-09-19T04:29:18.481675+0000","last_fullsized":"2024-09-19T04:29:18.481675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:10.928554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479403+0000","last_change":"2024-09-19T04:29:02.413973+0000","last_active":"2024-09-19T04:29:18.479403+0000","last_peered":"2024-09-19T04:29:18.479403+0000","last_clean":"2024-09-19T04:29:18.479403+0000","last_became_active":"2024-09-19T04:29:02.413695+0000","last_became_peered":"2024-09-19T04:29:02.413695+0000","last_unstale":"2024-09-19T04:29:18.479403+0000","last_undegraded":"2024-09-19T04:29:18.479403+0000","last_fullsized":"2024-09-19T04:29:18.479403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:11.961493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478960+0000","last_change":"2024-09-19T04:29:02.413943+0000","last_active":"2024-09-19T04:29:18.478960+0000","last_peered":"2024-09-19T04:29:18.478960+0000","last_clean":"2024-09-19T04:29:18.478960+0000","last_became_active":"2024-09-19T04:29:02.411977+0000","last_became_peered":"2024-09-19T04:29:02.411977+0000","last_unstale":"2024-09-19T04:29:18.478960+0000","last_undegraded":"2024-09-19T04:29:18.478960+0000","last_fullsized":"2024-09-19T04:29:18.478960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:38.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478817+0000","last_change":"2024-09-19T04:29:02.420995+0000","last_active":"2024-09-19T04:29:18.478817+0000","last_peered":"2024-09-19T04:29:18.478817+0000","last_clean":"2024-09-19T04:29:18.478817+0000","last_became_active":"2024-09-19T04:29:02.420552+0000","last_became_peered":"2024-09-19T04:29:02.420552+0000","last_unstale":"2024-09-19T04:29:18.478817+0000","last_undegraded":"2024-09-19T04:29:18.478817+0000","last_fullsized":"2024-09-19T04:29:18.478817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:12.560776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481041+0000","last_change":"2024-09-19T04:29:18.481041+0000","last_active":"2024-09-19T04:29:18.481041+0000","last_peered":"2024-09-19T04:29:18.481041+0000","last_clean":"2024-09-19T04:29:18.481041+0000","last_became_active":"2024-09-19T04:29:18.480478+0000","last_became_peered":"2024-09-19T04:29:18.480478+0000","last_unstale":"2024-09-19T04:29:18.481041+0000","last_undegraded":"2024-09-19T04:29:18.481041+0000","last_fullsized":"2024-09-19T04:29:18.481041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480094+0000","last_change":"2024-09-19T04:29:02.411380+0000","last_active":"2024-09-19T04:29:18.480094+0000","last_peered":"2024-09-19T04:29:18.480094+0000","last_clean":"2024-09-19T04:29:18.480094+0000","last_became_active":"2024-09-19T04:29:02.410977+0000","last_became_peered":"2024-09-19T04:29:02.410977+0000","last_unstale":"2024-09-19T04:29:18.480094+0000","last_undegraded":"2024-09-19T04:29:18.480094+0000","last_fullsized":"2024-09-19T04:29:18.480094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.147856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:02.530476+0000","last_change":"2024-09-19T04:29:00.394886+0000","last_active":"2024-09-19T04:30:02.530476+0000","last_peered":"2024-09-19T04:30:02.530476+0000","last_clean":"2024-09-19T04:30:02.530476+0000","last_became_active":"2024-09-19T04:29:00.394412+0000","last_became_peered":"2024-09-19T04:29:00.394412+0000","last_unstale":"2024-09-19T04:30:02.530476+0000","last_undegraded":"2024-09-19T04:30:02.530476+0000","last_fullsized":"2024-09-19T04:30:02.530476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:43.929791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627230+0000","last_change":"2024-09-19T04:29:02.413258+0000","last_active":"2024-09-19T04:29:18.627230+0000","last_peered":"2024-09-19T04:29:18.627230+0000","last_clean":"2024-09-19T04:29:18.627230+0000","last_became_active":"2024-09-19T04:29:02.412887+0000","last_became_peered":"2024-09-19T04:29:02.412887+0000","last_unstale":"2024-09-19T04:29:18.627230+0000","last_undegraded":"2024-09-19T04:29:18.627230+0000","last_fullsized":"2024-09-19T04:29:18.627230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:26.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476972+0000","last_change":"2024-09-19T04:29:00.395696+0000","last_active":"2024-09-19T04:29:18.476972+0000","last_peered":"2024-09-19T04:29:18.476972+0000","last_clean":"2024-09-19T04:29:18.476972+0000","last_became_active":"2024-09-19T04:29:00.395363+0000","last_became_peered":"2024-09-19T04:29:00.395363+0000","last_unstale":"2024-09-19T04:29:18.476972+0000","last_undegraded":"2024-09-19T04:29:18.476972+0000","last_fullsized":"2024-09-19T04:29:18.476972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:50.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478415+0000","last_change":"2024-09-19T04:29:00.391765+0000","last_active":"2024-09-19T04:29:18.478415+0000","last_peered":"2024-09-19T04:29:18.478415+0000","last_clean":"2024-09-19T04:29:18.478415+0000","last_became_active":"2024-09-19T04:29:00.391412+0000","last_became_peered":"2024-09-19T04:29:00.391412+0000","last_unstale":"2024-09-19T04:29:18.478415+0000","last_undegraded":"2024-09-19T04:29:18.478415+0000","last_fullsized":"2024-09-19T04:29:18.478415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:27.423046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351584+0000","last_change":"2024-09-19T04:29:02.417820+0000","last_active":"2024-09-19T04:29:19.351584+0000","last_peered":"2024-09-19T04:29:19.351584+0000","last_clean":"2024-09-19T04:29:19.351584+0000","last_became_active":"2024-09-19T04:29:02.417452+0000","last_became_peered":"2024-09-19T04:29:02.417452+0000","last_unstale":"2024-09-19T04:29:19.351584+0000","last_undegraded":"2024-09-19T04:29:19.351584+0000","last_fullsized":"2024-09-19T04:29:19.351584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:34.767829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627792+0000","last_change":"2024-09-19T04:29:00.393075+0000","last_active":"2024-09-19T04:29:18.627792+0000","last_peered":"2024-09-19T04:29:18.627792+0000","last_clean":"2024-09-19T04:29:18.627792+0000","last_became_active":"2024-09-19T04:29:00.392695+0000","last_became_peered":"2024-09-19T04:29:00.392695+0000","last_unstale":"2024-09-19T04:29:18.627792+0000","last_undegraded":"2024-09-19T04:29:18.627792+0000","last_fullsized":"2024-09-19T04:29:18.627792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:43.122636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474573+0000","last_change":"2024-09-19T04:29:02.403886+0000","last_active":"2024-09-19T04:29:18.474573+0000","last_peered":"2024-09-19T04:29:18.474573+0000","last_clean":"2024-09-19T04:29:18.474573+0000","last_became_active":"2024-09-19T04:29:02.403530+0000","last_became_peered":"2024-09-19T04:29:02.403530+0000","last_unstale":"2024-09-19T04:29:18.474573+0000","last_undegraded":"2024-09-19T04:29:18.474573+0000","last_fullsized":"2024-09-19T04:29:18.474573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:57.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":75,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:00.527063+0000","last_change":"2024-09-19T04:29:00.390081+0000","last_active":"2024-09-19T04:30:00.527063+0000","last_peered":"2024-09-19T04:30:00.527063+0000","last_clean":"2024-09-19T04:30:00.527063+0000","last_became_active":"2024-09-19T04:29:00.389701+0000","last_became_peered":"2024-09-19T04:29:00.389701+0000","last_unstale":"2024-09-19T04:30:00.527063+0000","last_undegraded":"2024-09-19T04:30:00.527063+0000","last_fullsized":"2024-09-19T04:30:00.527063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:42.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475842+0000","last_change":"2024-09-19T04:29:02.424712+0000","last_active":"2024-09-19T04:29:18.475842+0000","last_peered":"2024-09-19T04:29:18.475842+0000","last_clean":"2024-09-19T04:29:18.475842+0000","last_became_active":"2024-09-19T04:29:02.424316+0000","last_became_peered":"2024-09-19T04:29:02.424316+0000","last_unstale":"2024-09-19T04:29:18.475842+0000","last_undegraded":"2024-09-19T04:29:18.475842+0000","last_fullsized":"2024-09-19T04:29:18.475842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:06:21.246473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352814+0000","last_change":"2024-09-19T04:29:00.396085+0000","last_active":"2024-09-19T04:29:19.352814+0000","last_peered":"2024-09-19T04:29:19.352814+0000","last_clean":"2024-09-19T04:29:19.352814+0000","last_became_active":"2024-09-19T04:29:00.395737+0000","last_became_peered":"2024-09-19T04:29:00.395737+0000","last_unstale":"2024-09-19T04:29:19.352814+0000","last_undegraded":"2024-09-19T04:29:19.352814+0000","last_fullsized":"2024-09-19T04:29:19.352814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:59.429917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479755+0000","last_change":"2024-09-19T04:29:02.412318+0000","last_active":"2024-09-19T04:29:18.479755+0000","last_peered":"2024-09-19T04:29:18.479755+0000","last_clean":"2024-09-19T04:29:18.479755+0000","last_became_active":"2024-09-19T04:29:02.412020+0000","last_became_peered":"2024-09-19T04:29:02.412020+0000","last_unstale":"2024-09-19T04:29:18.479755+0000","last_undegraded":"2024-09-19T04:29:18.479755+0000","last_fullsized":"2024-09-19T04:29:18.479755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:45.341633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627499+0000","last_change":"2024-09-19T04:29:00.507027+0000","last_active":"2024-09-19T04:29:18.627499+0000","last_peered":"2024-09-19T04:29:18.627499+0000","last_clean":"2024-09-19T04:29:18.627499+0000","last_became_active":"2024-09-19T04:29:00.506660+0000","last_became_peered":"2024-09-19T04:29:00.506660+0000","last_unstale":"2024-09-19T04:29:18.627499+0000","last_undegraded":"2024-09-19T04:29:18.627499+0000","last_fullsized":"2024-09-19T04:29:18.627499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:54.629719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475693+0000","last_change":"2024-09-19T04:29:02.415423+0000","last_active":"2024-09-19T04:29:18.475693+0000","last_peered":"2024-09-19T04:29:18.475693+0000","last_clean":"2024-09-19T04:29:18.475693+0000","last_became_active":"2024-09-19T04:29:02.415105+0000","last_became_peered":"2024-09-19T04:29:02.415105+0000","last_unstale":"2024-09-19T04:29:18.475693+0000","last_undegraded":"2024-09-19T04:29:18.475693+0000","last_fullsized":"2024-09-19T04:29:18.475693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:00.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'28","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:01.528326+0000","last_change":"2024-09-19T04:29:00.396021+0000","last_active":"2024-09-19T04:30:01.528326+0000","last_peered":"2024-09-19T04:30:01.528326+0000","last_clean":"2024-09-19T04:30:01.528326+0000","last_became_active":"2024-09-19T04:29:00.395649+0000","last_became_peered":"2024-09-19T04:29:00.395649+0000","last_unstale":"2024-09-19T04:30:01.528326+0000","last_undegraded":"2024-09-19T04:30:01.528326+0000","last_fullsized":"2024-09-19T04:30:01.528326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:56.800573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480153+0000","last_change":"2024-09-19T04:29:02.416081+0000","last_active":"2024-09-19T04:29:18.480153+0000","last_peered":"2024-09-19T04:29:18.480153+0000","last_clean":"2024-09-19T04:29:18.480153+0000","last_became_active":"2024-09-19T04:29:02.415780+0000","last_became_peered":"2024-09-19T04:29:02.415780+0000","last_unstale":"2024-09-19T04:29:18.480153+0000","last_undegraded":"2024-09-19T04:29:18.480153+0000","last_fullsized":"2024-09-19T04:29:18.480153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:23.438141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479168+0000","last_change":"2024-09-19T04:29:00.396397+0000","last_active":"2024-09-19T04:29:18.479168+0000","last_peered":"2024-09-19T04:29:18.479168+0000","last_clean":"2024-09-19T04:29:18.479168+0000","last_became_active":"2024-09-19T04:29:00.395896+0000","last_became_peered":"2024-09-19T04:29:00.395896+0000","last_unstale":"2024-09-19T04:29:18.479168+0000","last_undegraded":"2024-09-19T04:29:18.479168+0000","last_fullsized":"2024-09-19T04:29:18.479168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:06.174262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478226+0000","last_change":"2024-09-19T04:29:02.408299+0000","last_active":"2024-09-19T04:29:18.478226+0000","last_peered":"2024-09-19T04:29:18.478226+0000","last_clean":"2024-09-19T04:29:18.478226+0000","last_became_active":"2024-09-19T04:29:02.407970+0000","last_became_peered":"2024-09-19T04:29:02.407970+0000","last_unstale":"2024-09-19T04:29:18.478226+0000","last_undegraded":"2024-09-19T04:29:18.478226+0000","last_fullsized":"2024-09-19T04:29:18.478226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:50.758517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627276+0000","last_change":"2024-09-19T04:29:00.393163+0000","last_active":"2024-09-19T04:29:18.627276+0000","last_peered":"2024-09-19T04:29:18.627276+0000","last_clean":"2024-09-19T04:29:18.627276+0000","last_became_active":"2024-09-19T04:29:00.392749+0000","last_became_peered":"2024-09-19T04:29:00.392749+0000","last_unstale":"2024-09-19T04:29:18.627276+0000","last_undegraded":"2024-09-19T04:29:18.627276+0000","last_fullsized":"2024-09-19T04:29:18.627276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:41.999124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352661+0000","last_change":"2024-09-19T04:29:02.412754+0000","last_active":"2024-09-19T04:29:19.352661+0000","last_peered":"2024-09-19T04:29:19.352661+0000","last_clean":"2024-09-19T04:29:19.352661+0000","last_became_active":"2024-09-19T04:29:02.412445+0000","last_became_peered":"2024-09-19T04:29:02.412445+0000","last_unstale":"2024-09-19T04:29:19.352661+0000","last_undegraded":"2024-09-19T04:29:19.352661+0000","last_fullsized":"2024-09-19T04:29:19.352661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:52:31.531672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":78,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:59.526371+0000","last_change":"2024-09-19T04:29:00.393863+0000","last_active":"2024-09-19T04:29:59.526371+0000","last_peered":"2024-09-19T04:29:59.526371+0000","last_clean":"2024-09-19T04:29:59.526371+0000","last_became_active":"2024-09-19T04:29:00.393502+0000","last_became_peered":"2024-09-19T04:29:00.393502+0000","last_unstale":"2024-09-19T04:29:59.526371+0000","last_undegraded":"2024-09-19T04:29:59.526371+0000","last_fullsized":"2024-09-19T04:29:59.526371+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:26.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352213+0000","last_change":"2024-09-19T04:29:02.412624+0000","last_active":"2024-09-19T04:29:19.352213+0000","last_peered":"2024-09-19T04:29:19.352213+0000","last_clean":"2024-09-19T04:29:19.352213+0000","last_became_active":"2024-09-19T04:29:02.412299+0000","last_became_peered":"2024-09-19T04:29:02.412299+0000","last_unstale":"2024-09-19T04:29:19.352213+0000","last_undegraded":"2024-09-19T04:29:19.352213+0000","last_fullsized":"2024-09-19T04:29:19.352213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.062422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479881+0000","last_change":"2024-09-19T04:29:00.504931+0000","last_active":"2024-09-19T04:29:18.479881+0000","last_peered":"2024-09-19T04:29:18.479881+0000","last_clean":"2024-09-19T04:29:18.479881+0000","last_became_active":"2024-09-19T04:29:00.504526+0000","last_became_peered":"2024-09-19T04:29:00.504526+0000","last_unstale":"2024-09-19T04:29:18.479881+0000","last_undegraded":"2024-09-19T04:29:18.479881+0000","last_fullsized":"2024-09-19T04:29:18.479881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:31.096516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627169+0000","last_change":"2024-09-19T04:29:02.424492+0000","last_active":"2024-09-19T04:29:18.627169+0000","last_peered":"2024-09-19T04:29:18.627169+0000","last_clean":"2024-09-19T04:29:18.627169+0000","last_became_active":"2024-09-19T04:29:02.424013+0000","last_became_peered":"2024-09-19T04:29:02.424013+0000","last_unstale":"2024-09-19T04:29:18.627169+0000","last_undegraded":"2024-09-19T04:29:18.627169+0000","last_fullsized":"2024-09-19T04:29:18.627169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:41.021945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480275+0000","last_change":"2024-09-19T04:29:00.396707+0000","last_active":"2024-09-19T04:29:18.480275+0000","last_peered":"2024-09-19T04:29:18.480275+0000","last_clean":"2024-09-19T04:29:18.480275+0000","last_became_active":"2024-09-19T04:29:00.394876+0000","last_became_peered":"2024-09-19T04:29:00.394876+0000","last_unstale":"2024-09-19T04:29:18.480275+0000","last_undegraded":"2024-09-19T04:29:18.480275+0000","last_fullsized":"2024-09-19T04:29:18.480275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:06.648377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477755+0000","last_change":"2024-09-19T04:29:02.425106+0000","last_active":"2024-09-19T04:29:18.477755+0000","last_peered":"2024-09-19T04:29:18.477755+0000","last_clean":"2024-09-19T04:29:18.477755+0000","last_became_active":"2024-09-19T04:29:02.424597+0000","last_became_peered":"2024-09-19T04:29:02.424597+0000","last_unstale":"2024-09-19T04:29:18.477755+0000","last_undegraded":"2024-09-19T04:29:18.477755+0000","last_fullsized":"2024-09-19T04:29:18.477755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:02.998519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478154+0000","last_change":"2024-09-19T04:29:00.396369+0000","last_active":"2024-09-19T04:29:18.478154+0000","last_peered":"2024-09-19T04:29:18.478154+0000","last_clean":"2024-09-19T04:29:18.478154+0000","last_became_active":"2024-09-19T04:29:00.395980+0000","last_became_peered":"2024-09-19T04:29:00.395980+0000","last_unstale":"2024-09-19T04:29:18.478154+0000","last_undegraded":"2024-09-19T04:29:18.478154+0000","last_fullsized":"2024-09-19T04:29:18.478154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.941729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352958+0000","last_change":"2024-09-19T04:29:02.415771+0000","last_active":"2024-09-19T04:29:19.352958+0000","last_peered":"2024-09-19T04:29:19.352958+0000","last_clean":"2024-09-19T04:29:19.352958+0000","last_became_active":"2024-09-19T04:29:02.415404+0000","last_became_peered":"2024-09-19T04:29:02.415404+0000","last_unstale":"2024-09-19T04:29:19.352958+0000","last_undegraded":"2024-09-19T04:29:19.352958+0000","last_fullsized":"2024-09-19T04:29:19.352958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:04.509294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627625+0000","last_change":"2024-09-19T04:29:00.389015+0000","last_active":"2024-09-19T04:29:18.627625+0000","last_peered":"2024-09-19T04:29:18.627625+0000","last_clean":"2024-09-19T04:29:18.627625+0000","last_became_active":"2024-09-19T04:29:00.388621+0000","last_became_peered":"2024-09-19T04:29:00.388621+0000","last_unstale":"2024-09-19T04:29:18.627625+0000","last_undegraded":"2024-09-19T04:29:18.627625+0000","last_fullsized":"2024-09-19T04:29:18.627625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:49.509697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352821+0000","last_change":"2024-09-19T04:29:02.411379+0000","last_active":"2024-09-19T04:29:19.352821+0000","last_peered":"2024-09-19T04:29:19.352821+0000","last_clean":"2024-09-19T04:29:19.352821+0000","last_became_active":"2024-09-19T04:29:02.411069+0000","last_became_peered":"2024-09-19T04:29:02.411069+0000","last_unstale":"2024-09-19T04:29:19.352821+0000","last_undegraded":"2024-09-19T04:29:19.352821+0000","last_fullsized":"2024-09-19T04:29:19.352821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:10.953422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479146+0000","last_change":"2024-09-19T04:29:00.505088+0000","last_active":"2024-09-19T04:29:18.479146+0000","last_peered":"2024-09-19T04:29:18.479146+0000","last_clean":"2024-09-19T04:29:18.479146+0000","last_became_active":"2024-09-19T04:29:00.504734+0000","last_became_peered":"2024-09-19T04:29:00.504734+0000","last_unstale":"2024-09-19T04:29:18.479146+0000","last_undegraded":"2024-09-19T04:29:18.479146+0000","last_fullsized":"2024-09-19T04:29:18.479146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:38.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352950+0000","last_change":"2024-09-19T04:29:02.420752+0000","last_active":"2024-09-19T04:29:19.352950+0000","last_peered":"2024-09-19T04:29:19.352950+0000","last_clean":"2024-09-19T04:29:19.352950+0000","last_became_active":"2024-09-19T04:29:02.419136+0000","last_became_peered":"2024-09-19T04:29:02.419136+0000","last_unstale":"2024-09-19T04:29:19.352950+0000","last_undegraded":"2024-09-19T04:29:19.352950+0000","last_fullsized":"2024-09-19T04:29:19.352950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:40.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352515+0000","last_change":"2024-09-19T04:27:51.622607+0000","last_active":"2024-09-19T04:29:19.352515+0000","last_peered":"2024-09-19T04:29:19.352515+0000","last_clean":"2024-09-19T04:29:19.352515+0000","last_became_active":"2024-09-19T04:27:51.622000+0000","last_became_peered":"2024-09-19T04:27:51.622000+0000","last_unstale":"2024-09-19T04:29:19.352515+0000","last_undegraded":"2024-09-19T04:29:19.352515+0000","last_fullsized":"2024-09-19T04:29:19.352515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_clean_scrub_stamp":"2024-09-19T04:24:31.610268+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:20:05.335499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353048+0000","last_change":"2024-09-19T04:29:00.393618+0000","last_active":"2024-09-19T04:29:19.353048+0000","last_peered":"2024-09-19T04:29:19.353048+0000","last_clean":"2024-09-19T04:29:19.353048+0000","last_became_active":"2024-09-19T04:29:00.393248+0000","last_became_peered":"2024-09-19T04:29:00.393248+0000","last_unstale":"2024-09-19T04:29:19.353048+0000","last_undegraded":"2024-09-19T04:29:19.353048+0000","last_fullsized":"2024-09-19T04:29:19.353048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:35.271531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351694+0000","last_change":"2024-09-19T04:29:02.415147+0000","last_active":"2024-09-19T04:29:19.351694+0000","last_peered":"2024-09-19T04:29:19.351694+0000","last_clean":"2024-09-19T04:29:19.351694+0000","last_became_active":"2024-09-19T04:29:02.414275+0000","last_became_peered":"2024-09-19T04:29:02.414275+0000","last_unstale":"2024-09-19T04:29:19.351694+0000","last_undegraded":"2024-09-19T04:29:19.351694+0000","last_fullsized":"2024-09-19T04:29:19.351694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:32.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352368+0000","last_change":"2024-09-19T04:29:00.398007+0000","last_active":"2024-09-19T04:29:19.352368+0000","last_peered":"2024-09-19T04:29:19.352368+0000","last_clean":"2024-09-19T04:29:19.352368+0000","last_became_active":"2024-09-19T04:29:00.397644+0000","last_became_peered":"2024-09-19T04:29:00.397644+0000","last_unstale":"2024-09-19T04:29:19.352368+0000","last_undegraded":"2024-09-19T04:29:19.352368+0000","last_fullsized":"2024-09-19T04:29:19.352368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:34.476893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478405+0000","last_change":"2024-09-19T04:29:02.414957+0000","last_active":"2024-09-19T04:29:18.478405+0000","last_peered":"2024-09-19T04:29:18.478405+0000","last_clean":"2024-09-19T04:29:18.478405+0000","last_became_active":"2024-09-19T04:29:02.414641+0000","last_became_peered":"2024-09-19T04:29:02.414641+0000","last_unstale":"2024-09-19T04:29:18.478405+0000","last_undegraded":"2024-09-19T04:29:18.478405+0000","last_fullsized":"2024-09-19T04:29:18.478405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:18.824972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:03.531207+0000","last_change":"2024-09-19T04:29:00.504872+0000","last_active":"2024-09-19T04:30:03.531207+0000","last_peered":"2024-09-19T04:30:03.531207+0000","last_clean":"2024-09-19T04:30:03.531207+0000","last_became_active":"2024-09-19T04:29:00.504520+0000","last_became_peered":"2024-09-19T04:29:00.504520+0000","last_unstale":"2024-09-19T04:30:03.531207+0000","last_undegraded":"2024-09-19T04:30:03.531207+0000","last_fullsized":"2024-09-19T04:30:03.531207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:39.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627739+0000","last_change":"2024-09-19T04:29:02.416451+0000","last_active":"2024-09-19T04:29:18.627739+0000","last_peered":"2024-09-19T04:29:18.627739+0000","last_clean":"2024-09-19T04:29:18.627739+0000","last_became_active":"2024-09-19T04:29:02.415271+0000","last_became_peered":"2024-09-19T04:29:02.415271+0000","last_unstale":"2024-09-19T04:29:18.627739+0000","last_undegraded":"2024-09-19T04:29:18.627739+0000","last_fullsized":"2024-09-19T04:29:18.627739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:06.371572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352591+0000","last_change":"2024-09-19T04:29:00.390999+0000","last_active":"2024-09-19T04:29:19.352591+0000","last_peered":"2024-09-19T04:29:19.352591+0000","last_clean":"2024-09-19T04:29:19.352591+0000","last_became_active":"2024-09-19T04:29:00.390639+0000","last_became_peered":"2024-09-19T04:29:00.390639+0000","last_unstale":"2024-09-19T04:29:19.352591+0000","last_undegraded":"2024-09-19T04:29:19.352591+0000","last_fullsized":"2024-09-19T04:29:19.352591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:26.504171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476998+0000","last_change":"2024-09-19T04:29:02.419534+0000","last_active":"2024-09-19T04:29:18.476998+0000","last_peered":"2024-09-19T04:29:18.476998+0000","last_clean":"2024-09-19T04:29:18.476998+0000","last_became_active":"2024-09-19T04:29:02.419192+0000","last_became_peered":"2024-09-19T04:29:02.419192+0000","last_unstale":"2024-09-19T04:29:18.476998+0000","last_undegraded":"2024-09-19T04:29:18.476998+0000","last_fullsized":"2024-09-19T04:29:18.476998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:33.866859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480950+0000","last_change":"2024-09-19T04:29:18.480950+0000","last_active":"2024-09-19T04:29:18.480950+0000","last_peered":"2024-09-19T04:29:18.480950+0000","last_clean":"2024-09-19T04:29:18.480950+0000","last_became_active":"2024-09-19T04:29:18.480542+0000","last_became_peered":"2024-09-19T04:29:18.480542+0000","last_unstale":"2024-09-19T04:29:18.480950+0000","last_undegraded":"2024-09-19T04:29:18.480950+0000","last_fullsized":"2024-09-19T04:29:18.480950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.647586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476904+0000","last_change":"2024-09-19T04:29:02.415075+0000","last_active":"2024-09-19T04:29:18.476904+0000","last_peered":"2024-09-19T04:29:18.476904+0000","last_clean":"2024-09-19T04:29:18.476904+0000","last_became_active":"2024-09-19T04:29:02.414635+0000","last_became_peered":"2024-09-19T04:29:02.414635+0000","last_unstale":"2024-09-19T04:29:18.476904+0000","last_undegraded":"2024-09-19T04:29:18.476904+0000","last_fullsized":"2024-09-19T04:29:18.476904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:12.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.485631+0000","last_change":"2024-09-19T04:29:18.485218+0000","last_active":"2024-09-19T04:29:18.485631+0000","last_peered":"2024-09-19T04:29:18.485631+0000","last_clean":"2024-09-19T04:29:18.485631+0000","last_became_active":"2024-09-19T04:29:18.481618+0000","last_became_peered":"2024-09-19T04:29:18.481618+0000","last_unstale":"2024-09-19T04:29:18.485631+0000","last_undegraded":"2024-09-19T04:29:18.485631+0000","last_fullsized":"2024-09-19T04:29:18.485631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:26.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479189+0000","last_change":"2024-09-19T04:29:02.412647+0000","last_active":"2024-09-19T04:29:18.479189+0000","last_peered":"2024-09-19T04:29:18.479189+0000","last_clean":"2024-09-19T04:29:18.479189+0000","last_became_active":"2024-09-19T04:29:02.412014+0000","last_became_peered":"2024-09-19T04:29:02.412014+0000","last_unstale":"2024-09-19T04:29:18.479189+0000","last_undegraded":"2024-09-19T04:29:18.479189+0000","last_fullsized":"2024-09-19T04:29:18.479189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:32.341462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:26.411831+0000","last_change":"2024-09-19T04:29:00.397860+0000","last_active":"2024-09-19T04:29:26.411831+0000","last_peered":"2024-09-19T04:29:26.411831+0000","last_clean":"2024-09-19T04:29:26.411831+0000","last_became_active":"2024-09-19T04:29:00.397501+0000","last_became_peered":"2024-09-19T04:29:00.397501+0000","last_unstale":"2024-09-19T04:29:26.411831+0000","last_undegraded":"2024-09-19T04:29:26.411831+0000","last_fullsized":"2024-09-19T04:29:26.411831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:51.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351919+0000","last_change":"2024-09-19T04:29:02.418639+0000","last_active":"2024-09-19T04:29:19.351919+0000","last_peered":"2024-09-19T04:29:19.351919+0000","last_clean":"2024-09-19T04:29:19.351919+0000","last_became_active":"2024-09-19T04:29:02.418334+0000","last_became_peered":"2024-09-19T04:29:02.418334+0000","last_unstale":"2024-09-19T04:29:19.351919+0000","last_undegraded":"2024-09-19T04:29:19.351919+0000","last_fullsized":"2024-09-19T04:29:19.351919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.161642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353459+0000","last_change":"2024-09-19T04:29:00.504849+0000","last_active":"2024-09-19T04:29:19.353459+0000","last_peered":"2024-09-19T04:29:19.353459+0000","last_clean":"2024-09-19T04:29:19.353459+0000","last_became_active":"2024-09-19T04:29:00.504618+0000","last_became_peered":"2024-09-19T04:29:00.504618+0000","last_unstale":"2024-09-19T04:29:19.353459+0000","last_undegraded":"2024-09-19T04:29:19.353459+0000","last_fullsized":"2024-09-19T04:29:19.353459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:31.038078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.354455+0000","last_change":"2024-09-19T04:29:19.354455+0000","last_active":"2024-09-19T04:29:19.354455+0000","last_peered":"2024-09-19T04:29:19.354455+0000","last_clean":"2024-09-19T04:29:19.354455+0000","last_became_active":"2024-09-19T04:29:19.354062+0000","last_became_peered":"2024-09-19T04:29:19.354062+0000","last_unstale":"2024-09-19T04:29:19.354455+0000","last_undegraded":"2024-09-19T04:29:19.354455+0000","last_fullsized":"2024-09-19T04:29:19.354455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:17.134082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475475+0000","last_change":"2024-09-19T04:29:00.506294+0000","last_active":"2024-09-19T04:29:18.475475+0000","last_peered":"2024-09-19T04:29:18.475475+0000","last_clean":"2024-09-19T04:29:18.475475+0000","last_became_active":"2024-09-19T04:29:00.506028+0000","last_became_peered":"2024-09-19T04:29:00.506028+0000","last_unstale":"2024-09-19T04:29:18.475475+0000","last_undegraded":"2024-09-19T04:29:18.475475+0000","last_fullsized":"2024-09-19T04:29:18.475475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.972980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479845+0000","last_change":"2024-09-19T04:29:02.414995+0000","last_active":"2024-09-19T04:29:18.479845+0000","last_peered":"2024-09-19T04:29:18.479845+0000","last_clean":"2024-09-19T04:29:18.479845+0000","last_became_active":"2024-09-19T04:29:02.414675+0000","last_became_peered":"2024-09-19T04:29:02.414675+0000","last_unstale":"2024-09-19T04:29:18.479845+0000","last_undegraded":"2024-09-19T04:29:18.479845+0000","last_fullsized":"2024-09-19T04:29:18.479845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:40.466483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351703+0000","last_change":"2024-09-19T04:29:00.389510+0000","last_active":"2024-09-19T04:29:19.351703+0000","last_peered":"2024-09-19T04:29:19.351703+0000","last_clean":"2024-09-19T04:29:19.351703+0000","last_became_active":"2024-09-19T04:29:00.389222+0000","last_became_peered":"2024-09-19T04:29:00.389222+0000","last_unstale":"2024-09-19T04:29:19.351703+0000","last_undegraded":"2024-09-19T04:29:19.351703+0000","last_fullsized":"2024-09-19T04:29:19.351703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:00.290076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477405+0000","last_change":"2024-09-19T04:29:02.422356+0000","last_active":"2024-09-19T04:29:18.477405+0000","last_peered":"2024-09-19T04:29:18.477405+0000","last_clean":"2024-09-19T04:29:18.477405+0000","last_became_active":"2024-09-19T04:29:02.422037+0000","last_became_peered":"2024-09-19T04:29:02.422037+0000","last_unstale":"2024-09-19T04:29:18.477405+0000","last_undegraded":"2024-09-19T04:29:18.477405+0000","last_fullsized":"2024-09-19T04:29:18.477405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:40.192439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478547+0000","last_change":"2024-09-19T04:29:00.399188+0000","last_active":"2024-09-19T04:29:18.478547+0000","last_peered":"2024-09-19T04:29:18.478547+0000","last_clean":"2024-09-19T04:29:18.478547+0000","last_became_active":"2024-09-19T04:29:00.398880+0000","last_became_peered":"2024-09-19T04:29:00.398880+0000","last_unstale":"2024-09-19T04:29:18.478547+0000","last_undegraded":"2024-09-19T04:29:18.478547+0000","last_fullsized":"2024-09-19T04:29:18.478547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:55.581504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351701+0000","last_change":"2024-09-19T04:29:02.408174+0000","last_active":"2024-09-19T04:29:19.351701+0000","last_peered":"2024-09-19T04:29:19.351701+0000","last_clean":"2024-09-19T04:29:19.351701+0000","last_became_active":"2024-09-19T04:29:02.407822+0000","last_became_peered":"2024-09-19T04:29:02.407822+0000","last_unstale":"2024-09-19T04:29:19.351701+0000","last_undegraded":"2024-09-19T04:29:19.351701+0000","last_fullsized":"2024-09-19T04:29:19.351701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480127+0000","last_change":"2024-09-19T04:29:00.398445+0000","last_active":"2024-09-19T04:29:18.480127+0000","last_peered":"2024-09-19T04:29:18.480127+0000","last_clean":"2024-09-19T04:29:18.480127+0000","last_became_active":"2024-09-19T04:29:00.397923+0000","last_became_peered":"2024-09-19T04:29:00.397923+0000","last_unstale":"2024-09-19T04:29:18.480127+0000","last_undegraded":"2024-09-19T04:29:18.480127+0000","last_fullsized":"2024-09-19T04:29:18.480127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:32.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352593+0000","last_change":"2024-09-19T04:29:02.416685+0000","last_active":"2024-09-19T04:29:19.352593+0000","last_peered":"2024-09-19T04:29:19.352593+0000","last_clean":"2024-09-19T04:29:19.352593+0000","last_became_active":"2024-09-19T04:29:02.416311+0000","last_became_peered":"2024-09-19T04:29:02.416311+0000","last_unstale":"2024-09-19T04:29:19.352593+0000","last_undegraded":"2024-09-19T04:29:19.352593+0000","last_fullsized":"2024-09-19T04:29:19.352593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:47.988318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627371+0000","last_change":"2024-09-19T04:29:02.424585+0000","last_active":"2024-09-19T04:29:18.627371+0000","last_peered":"2024-09-19T04:29:18.627371+0000","last_clean":"2024-09-19T04:29:18.627371+0000","last_became_active":"2024-09-19T04:29:02.424253+0000","last_became_peered":"2024-09-19T04:29:02.424253+0000","last_unstale":"2024-09-19T04:29:18.627371+0000","last_undegraded":"2024-09-19T04:29:18.627371+0000","last_fullsized":"2024-09-19T04:29:18.627371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:55.865599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480500+0000","last_change":"2024-09-19T04:29:00.396490+0000","last_active":"2024-09-19T04:29:18.480500+0000","last_peered":"2024-09-19T04:29:18.480500+0000","last_clean":"2024-09-19T04:29:18.480500+0000","last_became_active":"2024-09-19T04:29:00.394727+0000","last_became_peered":"2024-09-19T04:29:00.394727+0000","last_unstale":"2024-09-19T04:29:18.480500+0000","last_undegraded":"2024-09-19T04:29:18.480500+0000","last_fullsized":"2024-09-19T04:29:18.480500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:43.724257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475575+0000","last_change":"2024-09-19T04:29:02.425557+0000","last_active":"2024-09-19T04:29:18.475575+0000","last_peered":"2024-09-19T04:29:18.475575+0000","last_clean":"2024-09-19T04:29:18.475575+0000","last_became_active":"2024-09-19T04:29:02.425261+0000","last_became_peered":"2024-09-19T04:29:02.425261+0000","last_unstale":"2024-09-19T04:29:18.475575+0000","last_undegraded":"2024-09-19T04:29:18.475575+0000","last_fullsized":"2024-09-19T04:29:18.475575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:20.204026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480250+0000","last_change":"2024-09-19T04:29:00.397849+0000","last_active":"2024-09-19T04:29:18.480250+0000","last_peered":"2024-09-19T04:29:18.480250+0000","last_clean":"2024-09-19T04:29:18.480250+0000","last_became_active":"2024-09-19T04:29:00.397226+0000","last_became_peered":"2024-09-19T04:29:00.397226+0000","last_unstale":"2024-09-19T04:29:18.480250+0000","last_undegraded":"2024-09-19T04:29:18.480250+0000","last_fullsized":"2024-09-19T04:29:18.480250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:04.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479555+0000","last_change":"2024-09-19T04:29:02.416202+0000","last_active":"2024-09-19T04:29:18.479555+0000","last_peered":"2024-09-19T04:29:18.479555+0000","last_clean":"2024-09-19T04:29:18.479555+0000","last_became_active":"2024-09-19T04:29:02.415886+0000","last_became_peered":"2024-09-19T04:29:02.415886+0000","last_unstale":"2024-09-19T04:29:18.479555+0000","last_undegraded":"2024-09-19T04:29:18.479555+0000","last_fullsized":"2024-09-19T04:29:18.479555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:06.217254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352054+0000","last_change":"2024-09-19T04:29:00.505162+0000","last_active":"2024-09-19T04:29:19.352054+0000","last_peered":"2024-09-19T04:29:19.352054+0000","last_clean":"2024-09-19T04:29:19.352054+0000","last_became_active":"2024-09-19T04:29:00.504584+0000","last_became_peered":"2024-09-19T04:29:00.504584+0000","last_unstale":"2024-09-19T04:29:19.352054+0000","last_undegraded":"2024-09-19T04:29:19.352054+0000","last_fullsized":"2024-09-19T04:29:19.352054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:44.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351873+0000","last_change":"2024-09-19T04:29:02.415095+0000","last_active":"2024-09-19T04:29:19.351873+0000","last_peered":"2024-09-19T04:29:19.351873+0000","last_clean":"2024-09-19T04:29:19.351873+0000","last_became_active":"2024-09-19T04:29:02.414576+0000","last_became_peered":"2024-09-19T04:29:02.414576+0000","last_unstale":"2024-09-19T04:29:19.351873+0000","last_undegraded":"2024-09-19T04:29:19.351873+0000","last_fullsized":"2024-09-19T04:29:19.351873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:52.744011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474926+0000","last_change":"2024-09-19T04:29:00.397737+0000","last_active":"2024-09-19T04:29:18.474926+0000","last_peered":"2024-09-19T04:29:18.474926+0000","last_clean":"2024-09-19T04:29:18.474926+0000","last_became_active":"2024-09-19T04:29:00.397397+0000","last_became_peered":"2024-09-19T04:29:00.397397+0000","last_unstale":"2024-09-19T04:29:18.474926+0000","last_undegraded":"2024-09-19T04:29:18.474926+0000","last_fullsized":"2024-09-19T04:29:18.474926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:49:16.108744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":331,"num_read_kb":233,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547226,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":440869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32748,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712404,"statfs":{"total":95995035648,"available":95961501696,"internally_reserved":0,"allocated":1601536,"data_stored":1092485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":440981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430254,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1032935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":440472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1527808,"data_stored":1032226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953532,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":441302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182465,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":440783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411398,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":501379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":500029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":441743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:30:07.005 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph pg dump --format=json 2024-09-19T04:30:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:06 smithi134 ceph-mon[34525]: pgmap v307: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:30:07.264 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:07 smithi070 ceph-mon[30942]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:07.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:07 smithi070 ceph-mon[30942]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 -- 172.21.15.70:0/1548131220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102570 msgr2=0x7fd6741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 --2- 172.21.15.70:0/1548131220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102570 0x7fd6741029b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7fd65c009900 tx=0x7fd65c02a480 comp rx=0 tx=0).stop 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 -- 172.21.15.70:0/1548131220 shutdown_connections 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 --2- 172.21.15.70:0/1548131220 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd674102ef0 0x7fd67410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 --2- 172.21.15.70:0/1548131220 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102570 0x7fd6741029b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 --2- 172.21.15.70:0/1548131220 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674100e20 0x7fd674101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 -- 172.21.15.70:0/1548131220 >> 172.21.15.70:0/1548131220 conn(0x7fd6740fc7d0 msgr2=0x7fd6740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 -- 172.21.15.70:0/1548131220 shutdown_connections 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 -- 172.21.15.70:0/1548131220 wait complete. 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.767+0000 7fd679263640 1 Processor -- start 2024-09-19T04:30:07.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd679263640 1 -- start start 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd679263640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674100e20 0x7fd674199440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd679263640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd674102570 0x7fd674199980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd679263640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102ef0 0x7fd6741a44c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd679263640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd674110fb0 con 0x7fd674102ef0 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd679263640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd674110e30 con 0x7fd674100e20 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd679263640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd674111130 con 0x7fd674102570 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102ef0 0x7fd6741a44c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102ef0 0x7fd6741a44c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34234/0 (socket says 172.21.15.70:34234) 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 -- 172.21.15.70:0/3768099237 learned_addr learned my addr 172.21.15.70:0/3768099237 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd672ffd640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674100e20 0x7fd674199440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd66a7fc640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd674102570 0x7fd674199980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 -- 172.21.15.70:0/3768099237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd674102570 msgr2=0x7fd674199980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:07.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd674102570 0x7fd674199980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 -- 172.21.15.70:0/3768099237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674100e20 msgr2=0x7fd674199440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674100e20 0x7fd674199440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 -- 172.21.15.70:0/3768099237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6741a4a00 con 0x7fd674102ef0 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.768+0000 7fd6737fe640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102ef0 0x7fd6741a44c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00eaa0 tx=0x7fd66c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.769+0000 7fd670ff9640 1 -- 172.21.15.70:0/3768099237 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c004d20 con 0x7fd674102ef0 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.769+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6741a4bd0 con 0x7fd674102ef0 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.769+0000 7fd670ff9640 1 -- 172.21.15.70:0/3768099237 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd66c005020 con 0x7fd674102ef0 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.769+0000 7fd670ff9640 1 -- 172.21.15.70:0/3768099237 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd66c0116d0 con 0x7fd674102ef0 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.769+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6741a50e0 con 0x7fd674102ef0 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.770+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd674101200 con 0x7fd674102ef0 2024-09-19T04:30:07.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.771+0000 7fd670ff9640 1 -- 172.21.15.70:0/3768099237 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fd66c0051d0 con 0x7fd674102ef0 2024-09-19T04:30:07.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.772+0000 7fd670ff9640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd6600a32d0 0x7fd6600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:07.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.772+0000 7fd672ffd640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd6600a32d0 0x7fd6600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:07.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.772+0000 7fd670ff9640 1 -- 172.21.15.70:0/3768099237 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fd66c0cfc30 con 0x7fd674102ef0 2024-09-19T04:30:07.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.772+0000 7fd672ffd640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd6600a32d0 0x7fd6600a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd664009990 tx=0x7fd664009110 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:07.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.776+0000 7fd670ff9640 1 -- 172.21.15.70:0/3768099237 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fd66c016030 con 0x7fd674102ef0 2024-09-19T04:30:07.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.938+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd674062630 con 0x7fd6600a32d0 2024-09-19T04:30:07.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.944+0000 7fd670ff9640 1 -- 172.21.15.70:0/3768099237 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+258711 (secure 0 0 0) 0x7fd674062630 con 0x7fd6600a32d0 2024-09-19T04:30:07.948 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:07.949 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-19T04:30:07.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd6600a32d0 msgr2=0x7fd6600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:07.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd6600a32d0 0x7fd6600a5790 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fd664009990 tx=0x7fd664009110 comp rx=0 tx=0).stop 2024-09-19T04:30:07.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102ef0 msgr2=0x7fd6741a44c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:07.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102ef0 0x7fd6741a44c0 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fd66c00eaa0 tx=0x7fd66c00eea0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 shutdown_connections 2024-09-19T04:30:07.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fd6600a32d0 0x7fd6600a5790 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd674102ef0 0x7fd6741a44c0 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd674102570 0x7fd674199980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 --2- 172.21.15.70:0/3768099237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd674100e20 0x7fd674199440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:07.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 >> 172.21.15.70:0/3768099237 conn(0x7fd6740fc7d0 msgr2=0x7fd6740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:07.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 shutdown_connections 2024-09-19T04:30:07.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:07.947+0000 7fd679263640 1 -- 172.21.15.70:0/3768099237 wait complete. 2024-09-19T04:30:07.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:07 smithi167 ceph-mon[34339]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:07 smithi167 ceph-mon[34339]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:07 smithi134 ceph-mon[34525]: from='client.14916 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:07 smithi134 ceph-mon[34525]: from='mgr.14148 172.21.15.70:0/3557072521' entity='mgr.x' 2024-09-19T04:30:08.623 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":308,"stamp":"2024-09-19T04:30:07.401802+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":654369,"num_objects":64,"num_object_clones":0,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":472,"num_read_kb":352,"num_write":344,"num_write_kb":3049,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":374476,"kb_used_data":12732,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124567348,"statfs":{"total":1151940427776,"available":1151556964352,"internally_reserved":0,"allocated":13037568,"data_stored":7246287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":62,"num_read_kb":28,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002825"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478067+0000","last_change":"2024-09-19T04:29:02.416257+0000","last_active":"2024-09-19T04:29:18.478067+0000","last_peered":"2024-09-19T04:29:18.478067+0000","last_clean":"2024-09-19T04:29:18.478067+0000","last_became_active":"2024-09-19T04:29:02.415681+0000","last_became_peered":"2024-09-19T04:29:02.415681+0000","last_unstale":"2024-09-19T04:29:18.478067+0000","last_undegraded":"2024-09-19T04:29:18.478067+0000","last_fullsized":"2024-09-19T04:29:18.478067+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:31.765859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479437+0000","last_change":"2024-09-19T04:29:02.417591+0000","last_active":"2024-09-19T04:29:18.479437+0000","last_peered":"2024-09-19T04:29:18.479437+0000","last_clean":"2024-09-19T04:29:18.479437+0000","last_became_active":"2024-09-19T04:29:02.417277+0000","last_became_peered":"2024-09-19T04:29:02.417277+0000","last_unstale":"2024-09-19T04:29:18.479437+0000","last_undegraded":"2024-09-19T04:29:18.479437+0000","last_fullsized":"2024-09-19T04:29:18.479437+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:22.680000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479531+0000","last_change":"2024-09-19T04:29:02.416270+0000","last_active":"2024-09-19T04:29:18.479531+0000","last_peered":"2024-09-19T04:29:18.479531+0000","last_clean":"2024-09-19T04:29:18.479531+0000","last_became_active":"2024-09-19T04:29:02.415878+0000","last_became_peered":"2024-09-19T04:29:02.415878+0000","last_unstale":"2024-09-19T04:29:18.479531+0000","last_undegraded":"2024-09-19T04:29:18.479531+0000","last_fullsized":"2024-09-19T04:29:18.479531+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:25.302575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353266+0000","last_change":"2024-09-19T04:29:02.414586+0000","last_active":"2024-09-19T04:29:19.353266+0000","last_peered":"2024-09-19T04:29:19.353266+0000","last_clean":"2024-09-19T04:29:19.353266+0000","last_became_active":"2024-09-19T04:29:02.414267+0000","last_became_peered":"2024-09-19T04:29:02.414267+0000","last_unstale":"2024-09-19T04:29:19.353266+0000","last_undegraded":"2024-09-19T04:29:19.353266+0000","last_fullsized":"2024-09-19T04:29:19.353266+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:01.436793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479997+0000","last_change":"2024-09-19T04:29:02.412243+0000","last_active":"2024-09-19T04:29:18.479997+0000","last_peered":"2024-09-19T04:29:18.479997+0000","last_clean":"2024-09-19T04:29:18.479997+0000","last_became_active":"2024-09-19T04:29:02.411411+0000","last_became_peered":"2024-09-19T04:29:02.411411+0000","last_unstale":"2024-09-19T04:29:18.479997+0000","last_undegraded":"2024-09-19T04:29:18.479997+0000","last_fullsized":"2024-09-19T04:29:18.479997+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:21.966542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.482295+0000","last_change":"2024-09-19T04:29:18.482295+0000","last_active":"2024-09-19T04:29:18.482295+0000","last_peered":"2024-09-19T04:29:18.482295+0000","last_clean":"2024-09-19T04:29:18.482295+0000","last_became_active":"2024-09-19T04:29:18.481929+0000","last_became_peered":"2024-09-19T04:29:18.481929+0000","last_unstale":"2024-09-19T04:29:18.482295+0000","last_undegraded":"2024-09-19T04:29:18.482295+0000","last_fullsized":"2024-09-19T04:29:18.482295+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:17.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352359+0000","last_change":"2024-09-19T04:29:02.418029+0000","last_active":"2024-09-19T04:29:19.352359+0000","last_peered":"2024-09-19T04:29:19.352359+0000","last_clean":"2024-09-19T04:29:19.352359+0000","last_became_active":"2024-09-19T04:29:02.417676+0000","last_became_peered":"2024-09-19T04:29:02.417676+0000","last_unstale":"2024-09-19T04:29:19.352359+0000","last_undegraded":"2024-09-19T04:29:19.352359+0000","last_fullsized":"2024-09-19T04:29:19.352359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:12:03.148693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351553+0000","last_change":"2024-09-19T04:29:02.406657+0000","last_active":"2024-09-19T04:29:19.351553+0000","last_peered":"2024-09-19T04:29:19.351553+0000","last_clean":"2024-09-19T04:29:19.351553+0000","last_became_active":"2024-09-19T04:29:02.406203+0000","last_became_peered":"2024-09-19T04:29:02.406203+0000","last_unstale":"2024-09-19T04:29:19.351553+0000","last_undegraded":"2024-09-19T04:29:19.351553+0000","last_fullsized":"2024-09-19T04:29:19.351553+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:06.842516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475951+0000","last_change":"2024-09-19T04:29:02.426478+0000","last_active":"2024-09-19T04:29:18.475951+0000","last_peered":"2024-09-19T04:29:18.475951+0000","last_clean":"2024-09-19T04:29:18.475951+0000","last_became_active":"2024-09-19T04:29:02.425938+0000","last_became_peered":"2024-09-19T04:29:02.425938+0000","last_unstale":"2024-09-19T04:29:18.475951+0000","last_undegraded":"2024-09-19T04:29:18.475951+0000","last_fullsized":"2024-09-19T04:29:18.475951+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:01.439087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476878+0000","last_change":"2024-09-19T04:29:02.423380+0000","last_active":"2024-09-19T04:29:18.476878+0000","last_peered":"2024-09-19T04:29:18.476878+0000","last_clean":"2024-09-19T04:29:18.476878+0000","last_became_active":"2024-09-19T04:29:02.422894+0000","last_became_peered":"2024-09-19T04:29:02.422894+0000","last_unstale":"2024-09-19T04:29:18.476878+0000","last_undegraded":"2024-09-19T04:29:18.476878+0000","last_fullsized":"2024-09-19T04:29:18.476878+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:55.082196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352800+0000","last_change":"2024-09-19T04:29:02.419929+0000","last_active":"2024-09-19T04:29:19.352800+0000","last_peered":"2024-09-19T04:29:19.352800+0000","last_clean":"2024-09-19T04:29:19.352800+0000","last_became_active":"2024-09-19T04:29:02.419432+0000","last_became_peered":"2024-09-19T04:29:02.419432+0000","last_unstale":"2024-09-19T04:29:19.352800+0000","last_undegraded":"2024-09-19T04:29:19.352800+0000","last_fullsized":"2024-09-19T04:29:19.352800+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:50:03.896524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":11,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481806+0000","last_change":"2024-09-19T04:29:18.481426+0000","last_active":"2024-09-19T04:29:18.481806+0000","last_peered":"2024-09-19T04:29:18.481806+0000","last_clean":"2024-09-19T04:29:18.481806+0000","last_became_active":"2024-09-19T04:29:18.481042+0000","last_became_peered":"2024-09-19T04:29:18.481042+0000","last_unstale":"2024-09-19T04:29:18.481806+0000","last_undegraded":"2024-09-19T04:29:18.481806+0000","last_fullsized":"2024-09-19T04:29:18.481806+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:16.251818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478854+0000","last_change":"2024-09-19T04:29:02.405545+0000","last_active":"2024-09-19T04:29:18.478854+0000","last_peered":"2024-09-19T04:29:18.478854+0000","last_clean":"2024-09-19T04:29:18.478854+0000","last_became_active":"2024-09-19T04:29:02.405247+0000","last_became_peered":"2024-09-19T04:29:02.405247+0000","last_unstale":"2024-09-19T04:29:18.478854+0000","last_undegraded":"2024-09-19T04:29:18.478854+0000","last_fullsized":"2024-09-19T04:29:18.478854+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:26.673842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478732+0000","last_change":"2024-09-19T04:29:02.420647+0000","last_active":"2024-09-19T04:29:18.478732+0000","last_peered":"2024-09-19T04:29:18.478732+0000","last_clean":"2024-09-19T04:29:18.478732+0000","last_became_active":"2024-09-19T04:29:02.420310+0000","last_became_peered":"2024-09-19T04:29:02.420310+0000","last_unstale":"2024-09-19T04:29:18.478732+0000","last_undegraded":"2024-09-19T04:29:18.478732+0000","last_fullsized":"2024-09-19T04:29:18.478732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:47.893734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478550+0000","last_change":"2024-09-19T04:29:02.419199+0000","last_active":"2024-09-19T04:29:18.478550+0000","last_peered":"2024-09-19T04:29:18.478550+0000","last_clean":"2024-09-19T04:29:18.478550+0000","last_became_active":"2024-09-19T04:29:02.418902+0000","last_became_peered":"2024-09-19T04:29:02.418902+0000","last_unstale":"2024-09-19T04:29:18.478550+0000","last_undegraded":"2024-09-19T04:29:18.478550+0000","last_fullsized":"2024-09-19T04:29:18.478550+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:04.958933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475374+0000","last_change":"2024-09-19T04:29:02.415284+0000","last_active":"2024-09-19T04:29:18.475374+0000","last_peered":"2024-09-19T04:29:18.475374+0000","last_clean":"2024-09-19T04:29:18.475374+0000","last_became_active":"2024-09-19T04:29:02.414947+0000","last_became_peered":"2024-09-19T04:29:02.414947+0000","last_unstale":"2024-09-19T04:29:18.475374+0000","last_undegraded":"2024-09-19T04:29:18.475374+0000","last_fullsized":"2024-09-19T04:29:18.475374+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:08.525325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478189+0000","last_change":"2024-09-19T04:29:02.422294+0000","last_active":"2024-09-19T04:29:18.478189+0000","last_peered":"2024-09-19T04:29:18.478189+0000","last_clean":"2024-09-19T04:29:18.478189+0000","last_became_active":"2024-09-19T04:29:02.421014+0000","last_became_peered":"2024-09-19T04:29:02.421014+0000","last_unstale":"2024-09-19T04:29:18.478189+0000","last_undegraded":"2024-09-19T04:29:18.478189+0000","last_fullsized":"2024-09-19T04:29:18.478189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:34.197168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474734+0000","last_change":"2024-09-19T04:29:02.415319+0000","last_active":"2024-09-19T04:29:18.474734+0000","last_peered":"2024-09-19T04:29:18.474734+0000","last_clean":"2024-09-19T04:29:18.474734+0000","last_became_active":"2024-09-19T04:29:02.415030+0000","last_became_peered":"2024-09-19T04:29:02.415030+0000","last_unstale":"2024-09-19T04:29:18.474734+0000","last_undegraded":"2024-09-19T04:29:18.474734+0000","last_fullsized":"2024-09-19T04:29:18.474734+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:11.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478695+0000","last_change":"2024-09-19T04:29:02.415938+0000","last_active":"2024-09-19T04:29:18.478695+0000","last_peered":"2024-09-19T04:29:18.478695+0000","last_clean":"2024-09-19T04:29:18.478695+0000","last_became_active":"2024-09-19T04:29:02.411665+0000","last_became_peered":"2024-09-19T04:29:02.411665+0000","last_unstale":"2024-09-19T04:29:18.478695+0000","last_undegraded":"2024-09-19T04:29:18.478695+0000","last_fullsized":"2024-09-19T04:29:18.478695+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:12.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477535+0000","last_change":"2024-09-19T04:29:02.417489+0000","last_active":"2024-09-19T04:29:18.477535+0000","last_peered":"2024-09-19T04:29:18.477535+0000","last_clean":"2024-09-19T04:29:18.477535+0000","last_became_active":"2024-09-19T04:29:02.417164+0000","last_became_peered":"2024-09-19T04:29:02.417164+0000","last_unstale":"2024-09-19T04:29:18.477535+0000","last_undegraded":"2024-09-19T04:29:18.477535+0000","last_fullsized":"2024-09-19T04:29:18.477535+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:28.055517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478961+0000","last_change":"2024-09-19T04:29:02.407559+0000","last_active":"2024-09-19T04:29:18.478961+0000","last_peered":"2024-09-19T04:29:18.478961+0000","last_clean":"2024-09-19T04:29:18.478961+0000","last_became_active":"2024-09-19T04:29:02.407241+0000","last_became_peered":"2024-09-19T04:29:02.407241+0000","last_unstale":"2024-09-19T04:29:18.478961+0000","last_undegraded":"2024-09-19T04:29:18.478961+0000","last_fullsized":"2024-09-19T04:29:18.478961+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:13.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475575+0000","last_change":"2024-09-19T04:29:02.418341+0000","last_active":"2024-09-19T04:29:18.475575+0000","last_peered":"2024-09-19T04:29:18.475575+0000","last_clean":"2024-09-19T04:29:18.475575+0000","last_became_active":"2024-09-19T04:29:02.418028+0000","last_became_peered":"2024-09-19T04:29:02.418028+0000","last_unstale":"2024-09-19T04:29:18.475575+0000","last_undegraded":"2024-09-19T04:29:18.475575+0000","last_fullsized":"2024-09-19T04:29:18.475575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:03.264803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351574+0000","last_change":"2024-09-19T04:29:02.419191+0000","last_active":"2024-09-19T04:29:19.351574+0000","last_peered":"2024-09-19T04:29:19.351574+0000","last_clean":"2024-09-19T04:29:19.351574+0000","last_became_active":"2024-09-19T04:29:02.418587+0000","last_became_peered":"2024-09-19T04:29:02.418587+0000","last_unstale":"2024-09-19T04:29:19.351574+0000","last_undegraded":"2024-09-19T04:29:19.351574+0000","last_fullsized":"2024-09-19T04:29:19.351574+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:58.185492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627644+0000","last_change":"2024-09-19T04:29:02.407961+0000","last_active":"2024-09-19T04:29:18.627644+0000","last_peered":"2024-09-19T04:29:18.627644+0000","last_clean":"2024-09-19T04:29:18.627644+0000","last_became_active":"2024-09-19T04:29:02.406888+0000","last_became_peered":"2024-09-19T04:29:02.406888+0000","last_unstale":"2024-09-19T04:29:18.627644+0000","last_undegraded":"2024-09-19T04:29:18.627644+0000","last_fullsized":"2024-09-19T04:29:18.627644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:47.360605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351914+0000","last_change":"2024-09-19T04:29:02.415234+0000","last_active":"2024-09-19T04:29:19.351914+0000","last_peered":"2024-09-19T04:29:19.351914+0000","last_clean":"2024-09-19T04:29:19.351914+0000","last_became_active":"2024-09-19T04:29:02.414929+0000","last_became_peered":"2024-09-19T04:29:02.414929+0000","last_unstale":"2024-09-19T04:29:19.351914+0000","last_undegraded":"2024-09-19T04:29:19.351914+0000","last_fullsized":"2024-09-19T04:29:19.351914+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:48.077114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478990+0000","last_change":"2024-09-19T04:29:02.416072+0000","last_active":"2024-09-19T04:29:18.478990+0000","last_peered":"2024-09-19T04:29:18.478990+0000","last_clean":"2024-09-19T04:29:18.478990+0000","last_became_active":"2024-09-19T04:29:02.415714+0000","last_became_peered":"2024-09-19T04:29:02.415714+0000","last_unstale":"2024-09-19T04:29:18.478990+0000","last_undegraded":"2024-09-19T04:29:18.478990+0000","last_fullsized":"2024-09-19T04:29:18.478990+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:45.000850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477913+0000","last_change":"2024-09-19T04:29:02.426071+0000","last_active":"2024-09-19T04:29:18.477913+0000","last_peered":"2024-09-19T04:29:18.477913+0000","last_clean":"2024-09-19T04:29:18.477913+0000","last_became_active":"2024-09-19T04:29:02.425717+0000","last_became_peered":"2024-09-19T04:29:02.425717+0000","last_unstale":"2024-09-19T04:29:18.477913+0000","last_undegraded":"2024-09-19T04:29:18.477913+0000","last_fullsized":"2024-09-19T04:29:18.477913+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:11.989191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481675+0000","last_change":"2024-09-19T04:29:18.481675+0000","last_active":"2024-09-19T04:29:18.481675+0000","last_peered":"2024-09-19T04:29:18.481675+0000","last_clean":"2024-09-19T04:29:18.481675+0000","last_became_active":"2024-09-19T04:29:18.481224+0000","last_became_peered":"2024-09-19T04:29:18.481224+0000","last_unstale":"2024-09-19T04:29:18.481675+0000","last_undegraded":"2024-09-19T04:29:18.481675+0000","last_fullsized":"2024-09-19T04:29:18.481675+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:10.928554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479403+0000","last_change":"2024-09-19T04:29:02.413973+0000","last_active":"2024-09-19T04:29:18.479403+0000","last_peered":"2024-09-19T04:29:18.479403+0000","last_clean":"2024-09-19T04:29:18.479403+0000","last_became_active":"2024-09-19T04:29:02.413695+0000","last_became_peered":"2024-09-19T04:29:02.413695+0000","last_unstale":"2024-09-19T04:29:18.479403+0000","last_undegraded":"2024-09-19T04:29:18.479403+0000","last_fullsized":"2024-09-19T04:29:18.479403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:11.961493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478960+0000","last_change":"2024-09-19T04:29:02.413943+0000","last_active":"2024-09-19T04:29:18.478960+0000","last_peered":"2024-09-19T04:29:18.478960+0000","last_clean":"2024-09-19T04:29:18.478960+0000","last_became_active":"2024-09-19T04:29:02.411977+0000","last_became_peered":"2024-09-19T04:29:02.411977+0000","last_unstale":"2024-09-19T04:29:18.478960+0000","last_undegraded":"2024-09-19T04:29:18.478960+0000","last_fullsized":"2024-09-19T04:29:18.478960+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:38.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478817+0000","last_change":"2024-09-19T04:29:02.420995+0000","last_active":"2024-09-19T04:29:18.478817+0000","last_peered":"2024-09-19T04:29:18.478817+0000","last_clean":"2024-09-19T04:29:18.478817+0000","last_became_active":"2024-09-19T04:29:02.420552+0000","last_became_peered":"2024-09-19T04:29:02.420552+0000","last_unstale":"2024-09-19T04:29:18.478817+0000","last_undegraded":"2024-09-19T04:29:18.478817+0000","last_fullsized":"2024-09-19T04:29:18.478817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:12.560776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.481041+0000","last_change":"2024-09-19T04:29:18.481041+0000","last_active":"2024-09-19T04:29:18.481041+0000","last_peered":"2024-09-19T04:29:18.481041+0000","last_clean":"2024-09-19T04:29:18.481041+0000","last_became_active":"2024-09-19T04:29:18.480478+0000","last_became_peered":"2024-09-19T04:29:18.480478+0000","last_unstale":"2024-09-19T04:29:18.481041+0000","last_undegraded":"2024-09-19T04:29:18.481041+0000","last_fullsized":"2024-09-19T04:29:18.481041+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480094+0000","last_change":"2024-09-19T04:29:02.411380+0000","last_active":"2024-09-19T04:29:18.480094+0000","last_peered":"2024-09-19T04:29:18.480094+0000","last_clean":"2024-09-19T04:29:18.480094+0000","last_became_active":"2024-09-19T04:29:02.410977+0000","last_became_peered":"2024-09-19T04:29:02.410977+0000","last_unstale":"2024-09-19T04:29:18.480094+0000","last_undegraded":"2024-09-19T04:29:18.480094+0000","last_fullsized":"2024-09-19T04:29:18.480094+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.147856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"81'5","reported_seq":81,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:02.530476+0000","last_change":"2024-09-19T04:29:00.394886+0000","last_active":"2024-09-19T04:30:02.530476+0000","last_peered":"2024-09-19T04:30:02.530476+0000","last_clean":"2024-09-19T04:30:02.530476+0000","last_became_active":"2024-09-19T04:29:00.394412+0000","last_became_peered":"2024-09-19T04:29:00.394412+0000","last_unstale":"2024-09-19T04:30:02.530476+0000","last_undegraded":"2024-09-19T04:30:02.530476+0000","last_fullsized":"2024-09-19T04:30:02.530476+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:43.929791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":622,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":54,"num_read_kb":2,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627230+0000","last_change":"2024-09-19T04:29:02.413258+0000","last_active":"2024-09-19T04:29:18.627230+0000","last_peered":"2024-09-19T04:29:18.627230+0000","last_clean":"2024-09-19T04:29:18.627230+0000","last_became_active":"2024-09-19T04:29:02.412887+0000","last_became_peered":"2024-09-19T04:29:02.412887+0000","last_unstale":"2024-09-19T04:29:18.627230+0000","last_undegraded":"2024-09-19T04:29:18.627230+0000","last_fullsized":"2024-09-19T04:29:18.627230+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:26.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476972+0000","last_change":"2024-09-19T04:29:00.395696+0000","last_active":"2024-09-19T04:29:18.476972+0000","last_peered":"2024-09-19T04:29:18.476972+0000","last_clean":"2024-09-19T04:29:18.476972+0000","last_became_active":"2024-09-19T04:29:00.395363+0000","last_became_peered":"2024-09-19T04:29:00.395363+0000","last_unstale":"2024-09-19T04:29:18.476972+0000","last_undegraded":"2024-09-19T04:29:18.476972+0000","last_fullsized":"2024-09-19T04:29:18.476972+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:50.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478415+0000","last_change":"2024-09-19T04:29:00.391765+0000","last_active":"2024-09-19T04:29:18.478415+0000","last_peered":"2024-09-19T04:29:18.478415+0000","last_clean":"2024-09-19T04:29:18.478415+0000","last_became_active":"2024-09-19T04:29:00.391412+0000","last_became_peered":"2024-09-19T04:29:00.391412+0000","last_unstale":"2024-09-19T04:29:18.478415+0000","last_undegraded":"2024-09-19T04:29:18.478415+0000","last_fullsized":"2024-09-19T04:29:18.478415+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:27.423046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351584+0000","last_change":"2024-09-19T04:29:02.417820+0000","last_active":"2024-09-19T04:29:19.351584+0000","last_peered":"2024-09-19T04:29:19.351584+0000","last_clean":"2024-09-19T04:29:19.351584+0000","last_became_active":"2024-09-19T04:29:02.417452+0000","last_became_peered":"2024-09-19T04:29:02.417452+0000","last_unstale":"2024-09-19T04:29:19.351584+0000","last_undegraded":"2024-09-19T04:29:19.351584+0000","last_fullsized":"2024-09-19T04:29:19.351584+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:34.767829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627792+0000","last_change":"2024-09-19T04:29:00.393075+0000","last_active":"2024-09-19T04:29:18.627792+0000","last_peered":"2024-09-19T04:29:18.627792+0000","last_clean":"2024-09-19T04:29:18.627792+0000","last_became_active":"2024-09-19T04:29:00.392695+0000","last_became_peered":"2024-09-19T04:29:00.392695+0000","last_unstale":"2024-09-19T04:29:18.627792+0000","last_undegraded":"2024-09-19T04:29:18.627792+0000","last_fullsized":"2024-09-19T04:29:18.627792+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:43.122636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474573+0000","last_change":"2024-09-19T04:29:02.403886+0000","last_active":"2024-09-19T04:29:18.474573+0000","last_peered":"2024-09-19T04:29:18.474573+0000","last_clean":"2024-09-19T04:29:18.474573+0000","last_became_active":"2024-09-19T04:29:02.403530+0000","last_became_peered":"2024-09-19T04:29:02.403530+0000","last_unstale":"2024-09-19T04:29:18.474573+0000","last_undegraded":"2024-09-19T04:29:18.474573+0000","last_fullsized":"2024-09-19T04:29:18.474573+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:57.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"81'3","reported_seq":75,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:00.527063+0000","last_change":"2024-09-19T04:29:00.390081+0000","last_active":"2024-09-19T04:30:00.527063+0000","last_peered":"2024-09-19T04:30:00.527063+0000","last_clean":"2024-09-19T04:30:00.527063+0000","last_became_active":"2024-09-19T04:29:00.389701+0000","last_became_peered":"2024-09-19T04:29:00.389701+0000","last_unstale":"2024-09-19T04:30:00.527063+0000","last_undegraded":"2024-09-19T04:30:00.527063+0000","last_fullsized":"2024-09-19T04:30:00.527063+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:42.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475842+0000","last_change":"2024-09-19T04:29:02.424712+0000","last_active":"2024-09-19T04:29:18.475842+0000","last_peered":"2024-09-19T04:29:18.475842+0000","last_clean":"2024-09-19T04:29:18.475842+0000","last_became_active":"2024-09-19T04:29:02.424316+0000","last_became_peered":"2024-09-19T04:29:02.424316+0000","last_unstale":"2024-09-19T04:29:18.475842+0000","last_undegraded":"2024-09-19T04:29:18.475842+0000","last_fullsized":"2024-09-19T04:29:18.475842+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:06:21.246473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352814+0000","last_change":"2024-09-19T04:29:00.396085+0000","last_active":"2024-09-19T04:29:19.352814+0000","last_peered":"2024-09-19T04:29:19.352814+0000","last_clean":"2024-09-19T04:29:19.352814+0000","last_became_active":"2024-09-19T04:29:00.395737+0000","last_became_peered":"2024-09-19T04:29:00.395737+0000","last_unstale":"2024-09-19T04:29:19.352814+0000","last_undegraded":"2024-09-19T04:29:19.352814+0000","last_fullsized":"2024-09-19T04:29:19.352814+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:59.429917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479755+0000","last_change":"2024-09-19T04:29:02.412318+0000","last_active":"2024-09-19T04:29:18.479755+0000","last_peered":"2024-09-19T04:29:18.479755+0000","last_clean":"2024-09-19T04:29:18.479755+0000","last_became_active":"2024-09-19T04:29:02.412020+0000","last_became_peered":"2024-09-19T04:29:02.412020+0000","last_unstale":"2024-09-19T04:29:18.479755+0000","last_undegraded":"2024-09-19T04:29:18.479755+0000","last_fullsized":"2024-09-19T04:29:18.479755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:45.341633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627499+0000","last_change":"2024-09-19T04:29:00.507027+0000","last_active":"2024-09-19T04:29:18.627499+0000","last_peered":"2024-09-19T04:29:18.627499+0000","last_clean":"2024-09-19T04:29:18.627499+0000","last_became_active":"2024-09-19T04:29:00.506660+0000","last_became_peered":"2024-09-19T04:29:00.506660+0000","last_unstale":"2024-09-19T04:29:18.627499+0000","last_undegraded":"2024-09-19T04:29:18.627499+0000","last_fullsized":"2024-09-19T04:29:18.627499+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:54.629719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475693+0000","last_change":"2024-09-19T04:29:02.415423+0000","last_active":"2024-09-19T04:29:18.475693+0000","last_peered":"2024-09-19T04:29:18.475693+0000","last_clean":"2024-09-19T04:29:18.475693+0000","last_became_active":"2024-09-19T04:29:02.415105+0000","last_became_peered":"2024-09-19T04:29:02.415105+0000","last_unstale":"2024-09-19T04:29:18.475693+0000","last_undegraded":"2024-09-19T04:29:18.475693+0000","last_fullsized":"2024-09-19T04:29:18.475693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:00.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"83'28","reported_seq":159,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:01.528326+0000","last_change":"2024-09-19T04:29:00.396021+0000","last_active":"2024-09-19T04:30:01.528326+0000","last_peered":"2024-09-19T04:30:01.528326+0000","last_clean":"2024-09-19T04:30:01.528326+0000","last_became_active":"2024-09-19T04:29:00.395649+0000","last_became_peered":"2024-09-19T04:29:00.395649+0000","last_unstale":"2024-09-19T04:30:01.528326+0000","last_undegraded":"2024-09-19T04:30:01.528326+0000","last_fullsized":"2024-09-19T04:30:01.528326+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:56.800573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":59764,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":109,"num_read_kb":112,"num_write":29,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480153+0000","last_change":"2024-09-19T04:29:02.416081+0000","last_active":"2024-09-19T04:29:18.480153+0000","last_peered":"2024-09-19T04:29:18.480153+0000","last_clean":"2024-09-19T04:29:18.480153+0000","last_became_active":"2024-09-19T04:29:02.415780+0000","last_became_peered":"2024-09-19T04:29:02.415780+0000","last_unstale":"2024-09-19T04:29:18.480153+0000","last_undegraded":"2024-09-19T04:29:18.480153+0000","last_fullsized":"2024-09-19T04:29:18.480153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:23.438141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":29,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479168+0000","last_change":"2024-09-19T04:29:00.396397+0000","last_active":"2024-09-19T04:29:18.479168+0000","last_peered":"2024-09-19T04:29:18.479168+0000","last_clean":"2024-09-19T04:29:18.479168+0000","last_became_active":"2024-09-19T04:29:00.395896+0000","last_became_peered":"2024-09-19T04:29:00.395896+0000","last_unstale":"2024-09-19T04:29:18.479168+0000","last_undegraded":"2024-09-19T04:29:18.479168+0000","last_fullsized":"2024-09-19T04:29:18.479168+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:06.174262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478226+0000","last_change":"2024-09-19T04:29:02.408299+0000","last_active":"2024-09-19T04:29:18.478226+0000","last_peered":"2024-09-19T04:29:18.478226+0000","last_clean":"2024-09-19T04:29:18.478226+0000","last_became_active":"2024-09-19T04:29:02.407970+0000","last_became_peered":"2024-09-19T04:29:02.407970+0000","last_unstale":"2024-09-19T04:29:18.478226+0000","last_undegraded":"2024-09-19T04:29:18.478226+0000","last_fullsized":"2024-09-19T04:29:18.478226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:50.758517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627276+0000","last_change":"2024-09-19T04:29:00.393163+0000","last_active":"2024-09-19T04:29:18.627276+0000","last_peered":"2024-09-19T04:29:18.627276+0000","last_clean":"2024-09-19T04:29:18.627276+0000","last_became_active":"2024-09-19T04:29:00.392749+0000","last_became_peered":"2024-09-19T04:29:00.392749+0000","last_unstale":"2024-09-19T04:29:18.627276+0000","last_undegraded":"2024-09-19T04:29:18.627276+0000","last_fullsized":"2024-09-19T04:29:18.627276+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:41.999124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352661+0000","last_change":"2024-09-19T04:29:02.412754+0000","last_active":"2024-09-19T04:29:19.352661+0000","last_peered":"2024-09-19T04:29:19.352661+0000","last_clean":"2024-09-19T04:29:19.352661+0000","last_became_active":"2024-09-19T04:29:02.412445+0000","last_became_peered":"2024-09-19T04:29:02.412445+0000","last_unstale":"2024-09-19T04:29:19.352661+0000","last_undegraded":"2024-09-19T04:29:19.352661+0000","last_fullsized":"2024-09-19T04:29:19.352661+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:52:31.531672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"81'4","reported_seq":83,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:04.533064+0000","last_change":"2024-09-19T04:29:00.393863+0000","last_active":"2024-09-19T04:30:04.533064+0000","last_peered":"2024-09-19T04:30:04.533064+0000","last_clean":"2024-09-19T04:30:04.533064+0000","last_became_active":"2024-09-19T04:29:00.393502+0000","last_became_peered":"2024-09-19T04:29:00.393502+0000","last_unstale":"2024-09-19T04:30:04.533064+0000","last_undegraded":"2024-09-19T04:30:04.533064+0000","last_fullsized":"2024-09-19T04:30:04.533064+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:26.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":981,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":4,"num_write":3,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352213+0000","last_change":"2024-09-19T04:29:02.412624+0000","last_active":"2024-09-19T04:29:19.352213+0000","last_peered":"2024-09-19T04:29:19.352213+0000","last_clean":"2024-09-19T04:29:19.352213+0000","last_became_active":"2024-09-19T04:29:02.412299+0000","last_became_peered":"2024-09-19T04:29:02.412299+0000","last_unstale":"2024-09-19T04:29:19.352213+0000","last_undegraded":"2024-09-19T04:29:19.352213+0000","last_fullsized":"2024-09-19T04:29:19.352213+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.062422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":38,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479881+0000","last_change":"2024-09-19T04:29:00.504931+0000","last_active":"2024-09-19T04:29:18.479881+0000","last_peered":"2024-09-19T04:29:18.479881+0000","last_clean":"2024-09-19T04:29:18.479881+0000","last_became_active":"2024-09-19T04:29:00.504526+0000","last_became_peered":"2024-09-19T04:29:00.504526+0000","last_unstale":"2024-09-19T04:29:18.479881+0000","last_undegraded":"2024-09-19T04:29:18.479881+0000","last_fullsized":"2024-09-19T04:29:18.479881+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:31.096516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627169+0000","last_change":"2024-09-19T04:29:02.424492+0000","last_active":"2024-09-19T04:29:18.627169+0000","last_peered":"2024-09-19T04:29:18.627169+0000","last_clean":"2024-09-19T04:29:18.627169+0000","last_became_active":"2024-09-19T04:29:02.424013+0000","last_became_peered":"2024-09-19T04:29:02.424013+0000","last_unstale":"2024-09-19T04:29:18.627169+0000","last_undegraded":"2024-09-19T04:29:18.627169+0000","last_fullsized":"2024-09-19T04:29:18.627169+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:41.021945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"81'2","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480275+0000","last_change":"2024-09-19T04:29:00.396707+0000","last_active":"2024-09-19T04:29:18.480275+0000","last_peered":"2024-09-19T04:29:18.480275+0000","last_clean":"2024-09-19T04:29:18.480275+0000","last_became_active":"2024-09-19T04:29:00.394876+0000","last_became_peered":"2024-09-19T04:29:00.394876+0000","last_unstale":"2024-09-19T04:29:18.480275+0000","last_undegraded":"2024-09-19T04:29:18.480275+0000","last_fullsized":"2024-09-19T04:29:18.480275+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:06.648377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477755+0000","last_change":"2024-09-19T04:29:02.425106+0000","last_active":"2024-09-19T04:29:18.477755+0000","last_peered":"2024-09-19T04:29:18.477755+0000","last_clean":"2024-09-19T04:29:18.477755+0000","last_became_active":"2024-09-19T04:29:02.424597+0000","last_became_peered":"2024-09-19T04:29:02.424597+0000","last_unstale":"2024-09-19T04:29:18.477755+0000","last_undegraded":"2024-09-19T04:29:18.477755+0000","last_fullsized":"2024-09-19T04:29:18.477755+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:02.998519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478154+0000","last_change":"2024-09-19T04:29:00.396369+0000","last_active":"2024-09-19T04:29:18.478154+0000","last_peered":"2024-09-19T04:29:18.478154+0000","last_clean":"2024-09-19T04:29:18.478154+0000","last_became_active":"2024-09-19T04:29:00.395980+0000","last_became_peered":"2024-09-19T04:29:00.395980+0000","last_unstale":"2024-09-19T04:29:18.478154+0000","last_undegraded":"2024-09-19T04:29:18.478154+0000","last_fullsized":"2024-09-19T04:29:18.478154+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.941729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352958+0000","last_change":"2024-09-19T04:29:02.415771+0000","last_active":"2024-09-19T04:29:19.352958+0000","last_peered":"2024-09-19T04:29:19.352958+0000","last_clean":"2024-09-19T04:29:19.352958+0000","last_became_active":"2024-09-19T04:29:02.415404+0000","last_became_peered":"2024-09-19T04:29:02.415404+0000","last_unstale":"2024-09-19T04:29:19.352958+0000","last_undegraded":"2024-09-19T04:29:19.352958+0000","last_fullsized":"2024-09-19T04:29:19.352958+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:04.509294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627625+0000","last_change":"2024-09-19T04:29:00.389015+0000","last_active":"2024-09-19T04:29:18.627625+0000","last_peered":"2024-09-19T04:29:18.627625+0000","last_clean":"2024-09-19T04:29:18.627625+0000","last_became_active":"2024-09-19T04:29:00.388621+0000","last_became_peered":"2024-09-19T04:29:00.388621+0000","last_unstale":"2024-09-19T04:29:18.627625+0000","last_undegraded":"2024-09-19T04:29:18.627625+0000","last_fullsized":"2024-09-19T04:29:18.627625+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:49.509697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"83'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352821+0000","last_change":"2024-09-19T04:29:02.411379+0000","last_active":"2024-09-19T04:29:19.352821+0000","last_peered":"2024-09-19T04:29:19.352821+0000","last_clean":"2024-09-19T04:29:19.352821+0000","last_became_active":"2024-09-19T04:29:02.411069+0000","last_became_peered":"2024-09-19T04:29:02.411069+0000","last_unstale":"2024-09-19T04:29:19.352821+0000","last_undegraded":"2024-09-19T04:29:19.352821+0000","last_fullsized":"2024-09-19T04:29:19.352821+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:10.953422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479146+0000","last_change":"2024-09-19T04:29:00.505088+0000","last_active":"2024-09-19T04:29:18.479146+0000","last_peered":"2024-09-19T04:29:18.479146+0000","last_clean":"2024-09-19T04:29:18.479146+0000","last_became_active":"2024-09-19T04:29:00.504734+0000","last_became_peered":"2024-09-19T04:29:00.504734+0000","last_unstale":"2024-09-19T04:29:18.479146+0000","last_undegraded":"2024-09-19T04:29:18.479146+0000","last_fullsized":"2024-09-19T04:29:18.479146+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:38.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352950+0000","last_change":"2024-09-19T04:29:02.420752+0000","last_active":"2024-09-19T04:29:19.352950+0000","last_peered":"2024-09-19T04:29:19.352950+0000","last_clean":"2024-09-19T04:29:19.352950+0000","last_became_active":"2024-09-19T04:29:02.419136+0000","last_became_peered":"2024-09-19T04:29:02.419136+0000","last_unstale":"2024-09-19T04:29:19.352950+0000","last_undegraded":"2024-09-19T04:29:19.352950+0000","last_fullsized":"2024-09-19T04:29:19.352950+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:40.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":346,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352515+0000","last_change":"2024-09-19T04:27:51.622607+0000","last_active":"2024-09-19T04:29:19.352515+0000","last_peered":"2024-09-19T04:29:19.352515+0000","last_clean":"2024-09-19T04:29:19.352515+0000","last_became_active":"2024-09-19T04:27:51.622000+0000","last_became_peered":"2024-09-19T04:27:51.622000+0000","last_unstale":"2024-09-19T04:29:19.352515+0000","last_undegraded":"2024-09-19T04:29:19.352515+0000","last_fullsized":"2024-09-19T04:29:19.352515+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_clean_scrub_stamp":"2024-09-19T04:24:31.610268+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:20:05.335499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353048+0000","last_change":"2024-09-19T04:29:00.393618+0000","last_active":"2024-09-19T04:29:19.353048+0000","last_peered":"2024-09-19T04:29:19.353048+0000","last_clean":"2024-09-19T04:29:19.353048+0000","last_became_active":"2024-09-19T04:29:00.393248+0000","last_became_peered":"2024-09-19T04:29:00.393248+0000","last_unstale":"2024-09-19T04:29:19.353048+0000","last_undegraded":"2024-09-19T04:29:19.353048+0000","last_fullsized":"2024-09-19T04:29:19.353048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:35.271531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351694+0000","last_change":"2024-09-19T04:29:02.415147+0000","last_active":"2024-09-19T04:29:19.351694+0000","last_peered":"2024-09-19T04:29:19.351694+0000","last_clean":"2024-09-19T04:29:19.351694+0000","last_became_active":"2024-09-19T04:29:02.414275+0000","last_became_peered":"2024-09-19T04:29:02.414275+0000","last_unstale":"2024-09-19T04:29:19.351694+0000","last_undegraded":"2024-09-19T04:29:19.351694+0000","last_fullsized":"2024-09-19T04:29:19.351694+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:32.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352368+0000","last_change":"2024-09-19T04:29:00.398007+0000","last_active":"2024-09-19T04:29:19.352368+0000","last_peered":"2024-09-19T04:29:19.352368+0000","last_clean":"2024-09-19T04:29:19.352368+0000","last_became_active":"2024-09-19T04:29:00.397644+0000","last_became_peered":"2024-09-19T04:29:00.397644+0000","last_unstale":"2024-09-19T04:29:19.352368+0000","last_undegraded":"2024-09-19T04:29:19.352368+0000","last_fullsized":"2024-09-19T04:29:19.352368+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:34.476893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478405+0000","last_change":"2024-09-19T04:29:02.414957+0000","last_active":"2024-09-19T04:29:18.478405+0000","last_peered":"2024-09-19T04:29:18.478405+0000","last_clean":"2024-09-19T04:29:18.478405+0000","last_became_active":"2024-09-19T04:29:02.414641+0000","last_became_peered":"2024-09-19T04:29:02.414641+0000","last_unstale":"2024-09-19T04:29:18.478405+0000","last_undegraded":"2024-09-19T04:29:18.478405+0000","last_fullsized":"2024-09-19T04:29:18.478405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:18.824972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"81'4","reported_seq":79,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:30:03.531207+0000","last_change":"2024-09-19T04:29:00.504872+0000","last_active":"2024-09-19T04:30:03.531207+0000","last_peered":"2024-09-19T04:30:03.531207+0000","last_clean":"2024-09-19T04:30:03.531207+0000","last_became_active":"2024-09-19T04:29:00.504520+0000","last_became_peered":"2024-09-19T04:29:00.504520+0000","last_unstale":"2024-09-19T04:30:03.531207+0000","last_undegraded":"2024-09-19T04:30:03.531207+0000","last_fullsized":"2024-09-19T04:30:03.531207+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:39.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":53,"num_read_kb":53,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627739+0000","last_change":"2024-09-19T04:29:02.416451+0000","last_active":"2024-09-19T04:29:18.627739+0000","last_peered":"2024-09-19T04:29:18.627739+0000","last_clean":"2024-09-19T04:29:18.627739+0000","last_became_active":"2024-09-19T04:29:02.415271+0000","last_became_peered":"2024-09-19T04:29:02.415271+0000","last_unstale":"2024-09-19T04:29:18.627739+0000","last_undegraded":"2024-09-19T04:29:18.627739+0000","last_fullsized":"2024-09-19T04:29:18.627739+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:06.371572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352591+0000","last_change":"2024-09-19T04:29:00.390999+0000","last_active":"2024-09-19T04:29:19.352591+0000","last_peered":"2024-09-19T04:29:19.352591+0000","last_clean":"2024-09-19T04:29:19.352591+0000","last_became_active":"2024-09-19T04:29:00.390639+0000","last_became_peered":"2024-09-19T04:29:00.390639+0000","last_unstale":"2024-09-19T04:29:19.352591+0000","last_undegraded":"2024-09-19T04:29:19.352591+0000","last_fullsized":"2024-09-19T04:29:19.352591+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:26.504171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476998+0000","last_change":"2024-09-19T04:29:02.419534+0000","last_active":"2024-09-19T04:29:18.476998+0000","last_peered":"2024-09-19T04:29:18.476998+0000","last_clean":"2024-09-19T04:29:18.476998+0000","last_became_active":"2024-09-19T04:29:02.419192+0000","last_became_peered":"2024-09-19T04:29:02.419192+0000","last_unstale":"2024-09-19T04:29:18.476998+0000","last_undegraded":"2024-09-19T04:29:18.476998+0000","last_fullsized":"2024-09-19T04:29:18.476998+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:33.866859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":28,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480950+0000","last_change":"2024-09-19T04:29:18.480950+0000","last_active":"2024-09-19T04:29:18.480950+0000","last_peered":"2024-09-19T04:29:18.480950+0000","last_clean":"2024-09-19T04:29:18.480950+0000","last_became_active":"2024-09-19T04:29:18.480542+0000","last_became_peered":"2024-09-19T04:29:18.480542+0000","last_unstale":"2024-09-19T04:29:18.480950+0000","last_undegraded":"2024-09-19T04:29:18.480950+0000","last_fullsized":"2024-09-19T04:29:18.480950+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.647586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"82'1","reported_seq":18,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.476904+0000","last_change":"2024-09-19T04:29:02.415075+0000","last_active":"2024-09-19T04:29:18.476904+0000","last_peered":"2024-09-19T04:29:18.476904+0000","last_clean":"2024-09-19T04:29:18.476904+0000","last_became_active":"2024-09-19T04:29:02.414635+0000","last_became_peered":"2024-09-19T04:29:02.414635+0000","last_unstale":"2024-09-19T04:29:18.476904+0000","last_undegraded":"2024-09-19T04:29:18.476904+0000","last_fullsized":"2024-09-19T04:29:18.476904+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:12.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":15,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.485631+0000","last_change":"2024-09-19T04:29:18.485218+0000","last_active":"2024-09-19T04:29:18.485631+0000","last_peered":"2024-09-19T04:29:18.485631+0000","last_clean":"2024-09-19T04:29:18.485631+0000","last_became_active":"2024-09-19T04:29:18.481618+0000","last_became_peered":"2024-09-19T04:29:18.481618+0000","last_unstale":"2024-09-19T04:29:18.485631+0000","last_undegraded":"2024-09-19T04:29:18.485631+0000","last_fullsized":"2024-09-19T04:29:18.485631+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:26.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479189+0000","last_change":"2024-09-19T04:29:02.412647+0000","last_active":"2024-09-19T04:29:18.479189+0000","last_peered":"2024-09-19T04:29:18.479189+0000","last_clean":"2024-09-19T04:29:18.479189+0000","last_became_active":"2024-09-19T04:29:02.412014+0000","last_became_peered":"2024-09-19T04:29:02.412014+0000","last_unstale":"2024-09-19T04:29:18.479189+0000","last_undegraded":"2024-09-19T04:29:18.479189+0000","last_fullsized":"2024-09-19T04:29:18.479189+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:32.341462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"83'10","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:26.411831+0000","last_change":"2024-09-19T04:29:00.397860+0000","last_active":"2024-09-19T04:29:26.411831+0000","last_peered":"2024-09-19T04:29:26.411831+0000","last_clean":"2024-09-19T04:29:26.411831+0000","last_became_active":"2024-09-19T04:29:00.397501+0000","last_became_peered":"2024-09-19T04:29:00.397501+0000","last_unstale":"2024-09-19T04:29:26.411831+0000","last_undegraded":"2024-09-19T04:29:26.411831+0000","last_fullsized":"2024-09-19T04:29:26.411831+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:51.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351919+0000","last_change":"2024-09-19T04:29:02.418639+0000","last_active":"2024-09-19T04:29:19.351919+0000","last_peered":"2024-09-19T04:29:19.351919+0000","last_clean":"2024-09-19T04:29:19.351919+0000","last_became_active":"2024-09-19T04:29:02.418334+0000","last_became_peered":"2024-09-19T04:29:02.418334+0000","last_unstale":"2024-09-19T04:29:19.351919+0000","last_undegraded":"2024-09-19T04:29:19.351919+0000","last_fullsized":"2024-09-19T04:29:19.351919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.161642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.353459+0000","last_change":"2024-09-19T04:29:00.504849+0000","last_active":"2024-09-19T04:29:19.353459+0000","last_peered":"2024-09-19T04:29:19.353459+0000","last_clean":"2024-09-19T04:29:19.353459+0000","last_became_active":"2024-09-19T04:29:00.504618+0000","last_became_peered":"2024-09-19T04:29:00.504618+0000","last_unstale":"2024-09-19T04:29:19.353459+0000","last_undegraded":"2024-09-19T04:29:19.353459+0000","last_fullsized":"2024-09-19T04:29:19.353459+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:31.038078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.354455+0000","last_change":"2024-09-19T04:29:19.354455+0000","last_active":"2024-09-19T04:29:19.354455+0000","last_peered":"2024-09-19T04:29:19.354455+0000","last_clean":"2024-09-19T04:29:19.354455+0000","last_became_active":"2024-09-19T04:29:19.354062+0000","last_became_peered":"2024-09-19T04:29:19.354062+0000","last_unstale":"2024-09-19T04:29:19.354455+0000","last_undegraded":"2024-09-19T04:29:19.354455+0000","last_fullsized":"2024-09-19T04:29:19.354455+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:17.134082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475475+0000","last_change":"2024-09-19T04:29:00.506294+0000","last_active":"2024-09-19T04:29:18.475475+0000","last_peered":"2024-09-19T04:29:18.475475+0000","last_clean":"2024-09-19T04:29:18.475475+0000","last_became_active":"2024-09-19T04:29:00.506028+0000","last_became_peered":"2024-09-19T04:29:00.506028+0000","last_unstale":"2024-09-19T04:29:18.475475+0000","last_undegraded":"2024-09-19T04:29:18.475475+0000","last_fullsized":"2024-09-19T04:29:18.475475+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.972980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479845+0000","last_change":"2024-09-19T04:29:02.414995+0000","last_active":"2024-09-19T04:29:18.479845+0000","last_peered":"2024-09-19T04:29:18.479845+0000","last_clean":"2024-09-19T04:29:18.479845+0000","last_became_active":"2024-09-19T04:29:02.414675+0000","last_became_peered":"2024-09-19T04:29:02.414675+0000","last_unstale":"2024-09-19T04:29:18.479845+0000","last_undegraded":"2024-09-19T04:29:18.479845+0000","last_fullsized":"2024-09-19T04:29:18.479845+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:40.466483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":25,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351703+0000","last_change":"2024-09-19T04:29:00.389510+0000","last_active":"2024-09-19T04:29:19.351703+0000","last_peered":"2024-09-19T04:29:19.351703+0000","last_clean":"2024-09-19T04:29:19.351703+0000","last_became_active":"2024-09-19T04:29:00.389222+0000","last_became_peered":"2024-09-19T04:29:00.389222+0000","last_unstale":"2024-09-19T04:29:19.351703+0000","last_undegraded":"2024-09-19T04:29:19.351703+0000","last_fullsized":"2024-09-19T04:29:19.351703+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:00.290076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.477405+0000","last_change":"2024-09-19T04:29:02.422356+0000","last_active":"2024-09-19T04:29:18.477405+0000","last_peered":"2024-09-19T04:29:18.477405+0000","last_clean":"2024-09-19T04:29:18.477405+0000","last_became_active":"2024-09-19T04:29:02.422037+0000","last_became_peered":"2024-09-19T04:29:02.422037+0000","last_unstale":"2024-09-19T04:29:18.477405+0000","last_undegraded":"2024-09-19T04:29:18.477405+0000","last_fullsized":"2024-09-19T04:29:18.477405+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:40.192439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"81'1","reported_seq":23,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.478547+0000","last_change":"2024-09-19T04:29:00.399188+0000","last_active":"2024-09-19T04:29:18.478547+0000","last_peered":"2024-09-19T04:29:18.478547+0000","last_clean":"2024-09-19T04:29:18.478547+0000","last_became_active":"2024-09-19T04:29:00.398880+0000","last_became_peered":"2024-09-19T04:29:00.398880+0000","last_unstale":"2024-09-19T04:29:18.478547+0000","last_undegraded":"2024-09-19T04:29:18.478547+0000","last_fullsized":"2024-09-19T04:29:18.478547+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:55.581504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351701+0000","last_change":"2024-09-19T04:29:02.408174+0000","last_active":"2024-09-19T04:29:19.351701+0000","last_peered":"2024-09-19T04:29:19.351701+0000","last_clean":"2024-09-19T04:29:19.351701+0000","last_became_active":"2024-09-19T04:29:02.407822+0000","last_became_peered":"2024-09-19T04:29:02.407822+0000","last_unstale":"2024-09-19T04:29:19.351701+0000","last_undegraded":"2024-09-19T04:29:19.351701+0000","last_fullsized":"2024-09-19T04:29:19.351701+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":27,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480127+0000","last_change":"2024-09-19T04:29:00.398445+0000","last_active":"2024-09-19T04:29:18.480127+0000","last_peered":"2024-09-19T04:29:18.480127+0000","last_clean":"2024-09-19T04:29:18.480127+0000","last_became_active":"2024-09-19T04:29:00.397923+0000","last_became_peered":"2024-09-19T04:29:00.397923+0000","last_unstale":"2024-09-19T04:29:18.480127+0000","last_undegraded":"2024-09-19T04:29:18.480127+0000","last_fullsized":"2024-09-19T04:29:18.480127+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:32.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352593+0000","last_change":"2024-09-19T04:29:02.416685+0000","last_active":"2024-09-19T04:29:19.352593+0000","last_peered":"2024-09-19T04:29:19.352593+0000","last_clean":"2024-09-19T04:29:19.352593+0000","last_became_active":"2024-09-19T04:29:02.416311+0000","last_became_peered":"2024-09-19T04:29:02.416311+0000","last_unstale":"2024-09-19T04:29:19.352593+0000","last_undegraded":"2024-09-19T04:29:19.352593+0000","last_fullsized":"2024-09-19T04:29:19.352593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:47.988318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.627371+0000","last_change":"2024-09-19T04:29:02.424585+0000","last_active":"2024-09-19T04:29:18.627371+0000","last_peered":"2024-09-19T04:29:18.627371+0000","last_clean":"2024-09-19T04:29:18.627371+0000","last_became_active":"2024-09-19T04:29:02.424253+0000","last_became_peered":"2024-09-19T04:29:02.424253+0000","last_unstale":"2024-09-19T04:29:18.627371+0000","last_undegraded":"2024-09-19T04:29:18.627371+0000","last_fullsized":"2024-09-19T04:29:18.627371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:55.865599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480500+0000","last_change":"2024-09-19T04:29:00.396490+0000","last_active":"2024-09-19T04:29:18.480500+0000","last_peered":"2024-09-19T04:29:18.480500+0000","last_clean":"2024-09-19T04:29:18.480500+0000","last_became_active":"2024-09-19T04:29:00.394727+0000","last_became_peered":"2024-09-19T04:29:00.394727+0000","last_unstale":"2024-09-19T04:29:18.480500+0000","last_undegraded":"2024-09-19T04:29:18.480500+0000","last_fullsized":"2024-09-19T04:29:18.480500+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:43.724257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.475575+0000","last_change":"2024-09-19T04:29:02.425557+0000","last_active":"2024-09-19T04:29:18.475575+0000","last_peered":"2024-09-19T04:29:18.475575+0000","last_clean":"2024-09-19T04:29:18.475575+0000","last_became_active":"2024-09-19T04:29:02.425261+0000","last_became_peered":"2024-09-19T04:29:02.425261+0000","last_unstale":"2024-09-19T04:29:18.475575+0000","last_undegraded":"2024-09-19T04:29:18.475575+0000","last_fullsized":"2024-09-19T04:29:18.475575+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:20.204026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":26,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.480250+0000","last_change":"2024-09-19T04:29:00.397849+0000","last_active":"2024-09-19T04:29:18.480250+0000","last_peered":"2024-09-19T04:29:18.480250+0000","last_clean":"2024-09-19T04:29:18.480250+0000","last_became_active":"2024-09-19T04:29:00.397226+0000","last_became_peered":"2024-09-19T04:29:00.397226+0000","last_unstale":"2024-09-19T04:29:18.480250+0000","last_undegraded":"2024-09-19T04:29:18.480250+0000","last_fullsized":"2024-09-19T04:29:18.480250+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:04.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.479555+0000","last_change":"2024-09-19T04:29:02.416202+0000","last_active":"2024-09-19T04:29:18.479555+0000","last_peered":"2024-09-19T04:29:18.479555+0000","last_clean":"2024-09-19T04:29:18.479555+0000","last_became_active":"2024-09-19T04:29:02.415886+0000","last_became_peered":"2024-09-19T04:29:02.415886+0000","last_unstale":"2024-09-19T04:29:18.479555+0000","last_undegraded":"2024-09-19T04:29:18.479555+0000","last_fullsized":"2024-09-19T04:29:18.479555+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:06.217254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":24,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.352054+0000","last_change":"2024-09-19T04:29:00.505162+0000","last_active":"2024-09-19T04:29:19.352054+0000","last_peered":"2024-09-19T04:29:19.352054+0000","last_clean":"2024-09-19T04:29:19.352054+0000","last_became_active":"2024-09-19T04:29:00.504584+0000","last_became_peered":"2024-09-19T04:29:00.504584+0000","last_unstale":"2024-09-19T04:29:19.352054+0000","last_undegraded":"2024-09-19T04:29:19.352054+0000","last_fullsized":"2024-09-19T04:29:19.352054+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:44.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":17,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:19.351873+0000","last_change":"2024-09-19T04:29:02.415095+0000","last_active":"2024-09-19T04:29:19.351873+0000","last_peered":"2024-09-19T04:29:19.351873+0000","last_clean":"2024-09-19T04:29:19.351873+0000","last_became_active":"2024-09-19T04:29:02.414576+0000","last_became_peered":"2024-09-19T04:29:02.414576+0000","last_unstale":"2024-09-19T04:29:19.351873+0000","last_undegraded":"2024-09-19T04:29:19.351873+0000","last_fullsized":"2024-09-19T04:29:19.351873+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:52.744011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":32,"reported_epoch":83,"state":"active+clean","last_fresh":"2024-09-19T04:29:18.474926+0000","last_change":"2024-09-19T04:29:00.397737+0000","last_active":"2024-09-19T04:29:18.474926+0000","last_peered":"2024-09-19T04:29:18.474926+0000","last_clean":"2024-09-19T04:29:18.474926+0000","last_became_active":"2024-09-19T04:29:00.397397+0000","last_became_peered":"2024-09-19T04:29:00.397397+0000","last_unstale":"2024-09-19T04:29:18.474926+0000","last_undegraded":"2024-09-19T04:29:18.474926+0000","last_fullsized":"2024-09-19T04:29:18.474926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:49:16.108744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":63767,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":336,"num_read_kb":233,"num_write":161,"num_write_kb":109,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":191301,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547226,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":909312,"data_stored":440869,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808862,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32748,"kb_used_data":1564,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712404,"statfs":{"total":95995035648,"available":95961501696,"internally_reserved":0,"allocated":1601536,"data_stored":1092485,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972387,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27924,"kb_used_data":900,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717228,"statfs":{"total":95995035648,"available":95966441472,"internally_reserved":0,"allocated":921600,"data_stored":441083,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201321,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27920,"kb_used_data":896,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717232,"statfs":{"total":95995035648,"available":95966445568,"internally_reserved":0,"allocated":917504,"data_stored":440981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430254,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28504,"kb_used_data":1480,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716648,"statfs":{"total":95995035648,"available":95965847552,"internally_reserved":0,"allocated":1515520,"data_stored":1032935,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593778,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27912,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717240,"statfs":{"total":95995035648,"available":95966453760,"internally_reserved":0,"allocated":909312,"data_stored":440472,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822711,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1492,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1527808,"data_stored":1032226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953533,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32080,"kb_used_data":892,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713072,"statfs":{"total":95995035648,"available":95962185728,"internally_reserved":0,"allocated":913408,"data_stored":441302,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182466,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40408,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704744,"statfs":{"total":95995035648,"available":95953657856,"internally_reserved":0,"allocated":925696,"data_stored":440783,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411399,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":972,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":995328,"data_stored":501379,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27972,"kb_used_data":948,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717180,"statfs":{"total":95995035648,"available":95966392320,"internally_reserved":0,"allocated":970752,"data_stored":500029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738449,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40412,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704740,"statfs":{"total":95995035648,"available":95953653760,"internally_reserved":0,"allocated":929792,"data_stored":441743,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":59764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":61114,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1037,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1476,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2185,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":716,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":61735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:30:08.627 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-09-19T04:30:08.627 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T04:30:08.627 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-09-19T04:30:08.627 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph health --format=json 2024-09-19T04:30:08.649 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:08 smithi070 ceph-mon[30942]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-19T04:30:08.872 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:08.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:08 smithi167 ceph-mon[34339]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-19T04:30:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:08 smithi134 ceph-mon[34525]: pgmap v308: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s rd, 5 op/s 2024-09-19T04:30:09.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.350+0000 7fbe7979d640 1 -- 172.21.15.70:0/2481375850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe741008d0 msgr2=0x7fbe74100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.350+0000 7fbe7979d640 1 --2- 172.21.15.70:0/2481375850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe741008d0 0x7fbe74100d30 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c009930 tx=0x7fbe5c02a420 comp rx=0 tx=0).stop 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 -- 172.21.15.70:0/2481375850 shutdown_connections 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 --2- 172.21.15.70:0/2481375850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe74101270 0x7fbe7410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 --2- 172.21.15.70:0/2481375850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe741008d0 0x7fbe74100d30 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 --2- 172.21.15.70:0/2481375850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe741068d0 0x7fbe74106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 -- 172.21.15.70:0/2481375850 >> 172.21.15.70:0/2481375850 conn(0x7fbe740fc610 msgr2=0x7fbe740fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 -- 172.21.15.70:0/2481375850 shutdown_connections 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 -- 172.21.15.70:0/2481375850 wait complete. 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 Processor -- start 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.351+0000 7fbe7979d640 1 -- start start 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe7979d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe741008d0 0x7fbe741991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:09.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe7979d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe74101270 0x7fbe741996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe7979d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe741068d0 0x7fbe741a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe7979d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74110d30 con 0x7fbe74101270 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe7979d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74110bb0 con 0x7fbe741008d0 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe7979d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbe74110eb0 con 0x7fbe741068d0 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe74101270 0x7fbe741996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe74101270 0x7fbe741996e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34246/0 (socket says 172.21.15.70:34246) 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 -- 172.21.15.70:0/198840903 learned_addr learned my addr 172.21.15.70:0/198840903 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe73fff640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe741008d0 0x7fbe741991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 -- 172.21.15.70:0/198840903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe741068d0 msgr2=0x7fbe741a4220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe78f9c640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe741068d0 0x7fbe741a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:09.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe741068d0 0x7fbe741a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 -- 172.21.15.70:0/198840903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe741008d0 msgr2=0x7fbe741991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe741008d0 0x7fbe741991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 -- 172.21.15.70:0/198840903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe741a4760 con 0x7fbe74101270 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe737fe640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe74101270 0x7fbe741996e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005ab0 tx=0x7fbe5c0052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.352+0000 7fbe717fa640 1 -- 172.21.15.70:0/198840903 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c03f070 con 0x7fbe74101270 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.353+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe741a4930 con 0x7fbe74101270 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.353+0000 7fbe717fa640 1 -- 172.21.15.70:0/198840903 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbe5c003ac0 con 0x7fbe74101270 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.353+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe741a4de0 con 0x7fbe74101270 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.353+0000 7fbe717fa640 1 -- 172.21.15.70:0/198840903 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe5c035030 con 0x7fbe74101270 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.354+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe54005290 con 0x7fbe74101270 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.355+0000 7fbe717fa640 1 -- 172.21.15.70:0/198840903 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fbe5c042070 con 0x7fbe74101270 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.355+0000 7fbe717fa640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbe600a3350 0x7fbe600a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:09.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.356+0000 7fbe73fff640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbe600a3350 0x7fbe600a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.356+0000 7fbe717fa640 1 -- 172.21.15.70:0/198840903 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fbe5c0f0200 con 0x7fbe74101270 2024-09-19T04:30:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.356+0000 7fbe73fff640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbe600a3350 0x7fbe600a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400bbe0 tx=0x7fbe6400b390 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:09.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.360+0000 7fbe717fa640 1 -- 172.21.15.70:0/198840903 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fbe5c0bcdf0 con 0x7fbe74101270 2024-09-19T04:30:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.571+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fbe54005850 con 0x7fbe74101270 2024-09-19T04:30:09.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.572+0000 7fbe717fa640 1 -- 172.21.15.70:0/198840903 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fbe5c0bc6f0 con 0x7fbe74101270 2024-09-19T04:30:09.573 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:09.574 INFO:teuthology.orchestra.run.smithi070.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T04:30:09.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbe600a3350 msgr2=0x7fbe600a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:09.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbe600a3350 0x7fbe600a5810 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400bbe0 tx=0x7fbe6400b390 comp rx=0 tx=0).stop 2024-09-19T04:30:09.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe74101270 msgr2=0x7fbe741996e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:09.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe74101270 0x7fbe741996e0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c005ab0 tx=0x7fbe5c0052d0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 shutdown_connections 2024-09-19T04:30:09.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fbe600a3350 0x7fbe600a5810 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbe741068d0 0x7fbe741a4220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbe74101270 0x7fbe741996e0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 --2- 172.21.15.70:0/198840903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe741008d0 0x7fbe741991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:09.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.574+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 >> 172.21.15.70:0/198840903 conn(0x7fbe740fc610 msgr2=0x7fbe740fce50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:09.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.575+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 shutdown_connections 2024-09-19T04:30:09.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:09.575+0000 7fbe7979d640 1 -- 172.21.15.70:0/198840903 wait complete. 2024-09-19T04:30:09.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:09 smithi070 ceph-mon[30942]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:09.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:09 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/198840903' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:30:09.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:09 smithi167 ceph-mon[34339]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:09.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:09 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/198840903' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:30:10.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:09 smithi134 ceph-mon[34525]: from='client.14922 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:10.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:09 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/198840903' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-09-19T04:30:10.197 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-09-19T04:30:10.197 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:30:10.494 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:10.879 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:10 smithi070 ceph-mon[30942]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-19T04:30:10.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:10 smithi167 ceph-mon[34339]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 -- 172.21.15.70:0/1307290659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730100e20 msgr2=0x7f5730101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 --2- 172.21.15.70:0/1307290659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730100e20 0x7f5730101200 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f5728009900 tx=0x7f572802a480 comp rx=0 tx=0).stop 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 -- 172.21.15.70:0/1307290659 shutdown_connections 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 --2- 172.21.15.70:0/1307290659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5730102ef0 0x7f573010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 --2- 172.21.15.70:0/1307290659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5730102570 0x7f57301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 --2- 172.21.15.70:0/1307290659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730100e20 0x7f5730101200 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 -- 172.21.15.70:0/1307290659 >> 172.21.15.70:0/1307290659 conn(0x7f57300fc7d0 msgr2=0x7f57300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 -- 172.21.15.70:0/1307290659 shutdown_connections 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.957+0000 7f5736e14640 1 -- 172.21.15.70:0/1307290659 wait complete. 2024-09-19T04:30:10.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5736e14640 1 Processor -- start 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5736e14640 1 -- start start 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5736e14640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5730100e20 0x7f57301985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5736e14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730102570 0x7f5730198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5736e14640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5730102ef0 0x7f573019cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5736e14640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5730110fb0 con 0x7f5730102570 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5736e14640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5730110e30 con 0x7f5730100e20 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5736e14640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5730111130 con 0x7f5730102ef0 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f572ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730102570 0x7f5730198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f572ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730102570 0x7f5730198b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34262/0 (socket says 172.21.15.70:34262) 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f572ffff640 1 -- 172.21.15.70:0/2330109256 learned_addr learned my addr 172.21.15.70:0/2330109256 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f57353b1640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5730102ef0 0x7f573019cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:10.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5734bb0640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5730100e20 0x7f57301985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f572ffff640 1 -- 172.21.15.70:0/2330109256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5730102ef0 msgr2=0x7f573019cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f572ffff640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5730102ef0 0x7f573019cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f572ffff640 1 -- 172.21.15.70:0/2330109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5730100e20 msgr2=0x7f57301985d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f572ffff640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5730100e20 0x7f57301985d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f572ffff640 1 -- 172.21.15.70:0/2330109256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f573019d580 con 0x7f5730102570 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f57353b1640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5730102ef0 0x7f573019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.958+0000 7f5734bb0640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5730100e20 0x7f57301985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.959+0000 7f572ffff640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730102570 0x7f5730198b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f572000cce0 tx=0x7f572000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.959+0000 7f572dffb640 1 -- 172.21.15.70:0/2330109256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5720004b20 con 0x7f5730102570 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.959+0000 7f572dffb640 1 -- 172.21.15.70:0/2330109256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5720004cc0 con 0x7f5730102570 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.959+0000 7f572dffb640 1 -- 172.21.15.70:0/2330109256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f572000f810 con 0x7f5730102570 2024-09-19T04:30:10.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.959+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f573019d870 con 0x7f5730102570 2024-09-19T04:30:10.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.959+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57301a5150 con 0x7f5730102570 2024-09-19T04:30:10.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.960+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5730101200 con 0x7f5730102570 2024-09-19T04:30:10.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.961+0000 7f572dffb640 1 -- 172.21.15.70:0/2330109256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f572000f9b0 con 0x7f5730102570 2024-09-19T04:30:10.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.962+0000 7f572dffb640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f571c0a3350 0x7f571c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:10.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.962+0000 7f5734bb0640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f571c0a3350 0x7f571c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:10.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.962+0000 7f572dffb640 1 -- 172.21.15.70:0/2330109256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f57200cfc00 con 0x7f5730102570 2024-09-19T04:30:10.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.962+0000 7f5734bb0640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f571c0a3350 0x7f571c0a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5728006010 tx=0x7f5728000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:10.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:10.966+0000 7f572dffb640 1 -- 172.21.15.70:0/2330109256 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5720014030 con 0x7f5730102570 2024-09-19T04:30:11.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:10 smithi134 ceph-mon[34525]: pgmap v309: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 5 op/s 2024-09-19T04:30:11.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.166+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f57301a5320 con 0x7f5730102570 2024-09-19T04:30:11.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.167+0000 7f572dffb640 1 -- 172.21.15.70:0/2330109256 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11914 (secure 0 0 0) 0x7f572009c7f0 con 0x7f5730102570 2024-09-19T04:30:11.169 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:11.170 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"btime":"2024-09-19T04:29:14:453215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:29:14.027648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:30:11.170 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 23 2024-09-19T04:30:11.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f571c0a3350 msgr2=0x7f571c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:11.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f571c0a3350 0x7f571c0a5810 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f5728006010 tx=0x7f5728000bc0 comp rx=0 tx=0).stop 2024-09-19T04:30:11.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730102570 msgr2=0x7f5730198b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:11.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730102570 0x7f5730198b10 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f572000cce0 tx=0x7f572000a620 comp rx=0 tx=0).stop 2024-09-19T04:30:11.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 shutdown_connections 2024-09-19T04:30:11.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f571c0a3350 0x7f571c0a5810 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:11.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5730102ef0 0x7f573019cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:11.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5730102570 0x7f5730198b10 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:11.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 --2- 172.21.15.70:0/2330109256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5730100e20 0x7f57301985d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:11.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 >> 172.21.15.70:0/2330109256 conn(0x7f57300fc7d0 msgr2=0x7f573006a150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:11.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 shutdown_connections 2024-09-19T04:30:11.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:11.169+0000 7f5736e14640 1 -- 172.21.15.70:0/2330109256 wait complete. 2024-09-19T04:30:11.850 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:11 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2330109256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:11.879 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:30:11.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:11 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2330109256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:12.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:11 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2330109256' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:12.125 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:12.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 -- 172.21.15.70:0/3273467890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390101de0 msgr2=0x7f73901021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:12.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 --2- 172.21.15.70:0/3273467890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390101de0 0x7f73901021c0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f7388009900 tx=0x7f738802a410 comp rx=0 tx=0).stop 2024-09-19T04:30:12.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 -- 172.21.15.70:0/3273467890 shutdown_connections 2024-09-19T04:30:12.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 --2- 172.21.15.70:0/3273467890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390106f10 0x7f739010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 --2- 172.21.15.70:0/3273467890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390102790 0x7f73901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 --2- 172.21.15.70:0/3273467890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390101de0 0x7f73901021c0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 -- 172.21.15.70:0/3273467890 >> 172.21.15.70:0/3273467890 conn(0x7f73900fd8c0 msgr2=0x7f73900ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 -- 172.21.15.70:0/3273467890 shutdown_connections 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 -- 172.21.15.70:0/3273467890 wait complete. 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 Processor -- start 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.590+0000 7f7396f5c640 1 -- start start 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f7396f5c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101de0 0x7f73901984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f7396f5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390102790 0x7f7390198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f7396f5c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390106f10 0x7f739019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f7396f5c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7390111f80 con 0x7f7390102790 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f7396f5c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7390111e00 con 0x7f7390106f10 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f7396f5c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7390112100 con 0x7f7390101de0 2024-09-19T04:30:12.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390102790 0x7f7390198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390102790 0x7f7390198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34284/0 (socket says 172.21.15.70:34284) 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 -- 172.21.15.70:0/2272043950 learned_addr learned my addr 172.21.15.70:0/2272043950 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f7394cf8640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101de0 0x7f73901984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f73954f9640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390106f10 0x7f739019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 -- 172.21.15.70:0/2272043950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101de0 msgr2=0x7f73901984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101de0 0x7f73901984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 -- 172.21.15.70:0/2272043950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390106f10 msgr2=0x7f739019cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390106f10 0x7f739019cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 -- 172.21.15.70:0/2272043950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739019d470 con 0x7f7390102790 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738ffff640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390102790 0x7f7390198a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f738000ba50 tx=0x7f738000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:12.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738dffb640 1 -- 172.21.15.70:0/2272043950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380019070 con 0x7f7390102790 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f738dffb640 1 -- 172.21.15.70:0/2272043950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f738000cbe0 con 0x7f7390102790 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.591+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739019d760 con 0x7f7390102790 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.592+0000 7f738dffb640 1 -- 172.21.15.70:0/2272043950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7380007630 con 0x7f7390102790 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.592+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73901a5040 con 0x7f7390102790 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.593+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f73901021c0 con 0x7f7390102790 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.594+0000 7f738dffb640 1 -- 172.21.15.70:0/2272043950 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f738001c070 con 0x7f7390102790 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.594+0000 7f738dffb640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f737c0a32d0 0x7f737c0a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.595+0000 7f7394cf8640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f737c0a32d0 0x7f737c0a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.595+0000 7f738dffb640 1 -- 172.21.15.70:0/2272043950 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f73800cf460 con 0x7f7390102790 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.595+0000 7f7394cf8640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f737c0a32d0 0x7f737c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7388006010 tx=0x7f73880058d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:12.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.598+0000 7f738dffb640 1 -- 172.21.15.70:0/2272043950 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f738009bb10 con 0x7f7390102790 2024-09-19T04:30:12.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.800+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f739010a150 con 0x7f7390102790 2024-09-19T04:30:12.802 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:12 smithi070 ceph-mon[30942]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.801+0000 7f738dffb640 1 -- 172.21.15.70:0/2272043950 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11914 (secure 0 0 0) 0x7f738009fe10 con 0x7f7390102790 2024-09-19T04:30:12.803 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:12.803 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"btime":"2024-09-19T04:29:14:453215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:29:14.027648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:30:12.803 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 23 2024-09-19T04:30:12.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f737c0a32d0 msgr2=0x7f737c0a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f737c0a32d0 0x7f737c0a5790 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7388006010 tx=0x7f73880058d0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390102790 msgr2=0x7f7390198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390102790 0x7f7390198a00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f738000ba50 tx=0x7f738000bf10 comp rx=0 tx=0).stop 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 shutdown_connections 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f737c0a32d0 0x7f737c0a5790 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390106f10 0x7f739019cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390102790 0x7f7390198a00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 --2- 172.21.15.70:0/2272043950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101de0 0x7f73901984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:12.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 >> 172.21.15.70:0/2272043950 conn(0x7f73900fd8c0 msgr2=0x7f73900fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:12.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 shutdown_connections 2024-09-19T04:30:12.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:12.804+0000 7f7396f5c640 1 -- 172.21.15.70:0/2272043950 wait complete. 2024-09-19T04:30:12.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:12 smithi167 ceph-mon[34339]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:12 smithi134 ceph-mon[34525]: pgmap v310: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:13.436 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:30:13.683 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:13.804 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:13 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2272043950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:13.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:13 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2272043950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:14.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:13 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2272043950' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:14.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/1645393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 msgr2=0x7f4a041021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/1645393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 0x7f4a041021c0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009900 tx=0x7f49f802a410 comp rx=0 tx=0).stop 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/1645393 shutdown_connections 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/1645393 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a04106f10 0x7f4a0410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/1645393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a04102790 0x7f4a041067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/1645393 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 0x7f4a041021c0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/1645393 >> 172.21.15.70:0/1645393 conn(0x7f4a040fd8c0 msgr2=0x7f4a040ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/1645393 shutdown_connections 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.154+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/1645393 wait complete. 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0b6c3640 1 Processor -- start 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0b6c3640 1 -- start start 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0b6c3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 0x7f4a041983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0b6c3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a04102790 0x7f4a04198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:14.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0b6c3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a04106f10 0x7f4a0419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0b6c3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4a04111f80 con 0x7f4a04101de0 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0b6c3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4a04111e00 con 0x7f4a04106f10 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0b6c3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4a04112100 con 0x7f4a04102790 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0945f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 0x7f4a041983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0945f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 0x7f4a041983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34940/0 (socket says 172.21.15.70:34940) 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0945f640 1 -- 172.21.15.70:0/4096227474 learned_addr learned my addr 172.21.15.70:0/4096227474 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a08c5e640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a04102790 0x7f4a04198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a09c60640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a04106f10 0x7f4a0419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.155+0000 7f4a0945f640 1 -- 172.21.15.70:0/4096227474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a04102790 msgr2=0x7f4a04198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f4a0945f640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a04102790 0x7f4a04198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f4a0945f640 1 -- 172.21.15.70:0/4096227474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a04106f10 msgr2=0x7f4a0419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:14.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f4a0945f640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a04106f10 0x7f4a0419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f4a0945f640 1 -- 172.21.15.70:0/4096227474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4a0419d370 con 0x7f4a04101de0 2024-09-19T04:30:14.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f4a09c60640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a04106f10 0x7f4a0419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:14.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f4a0945f640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 0x7f4a041983c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009a20 tx=0x7f49f80043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:14.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f49f67fc640 1 -- 172.21.15.70:0/4096227474 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f803f030 con 0x7f4a04101de0 2024-09-19T04:30:14.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f49f67fc640 1 -- 172.21.15.70:0/4096227474 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f49f8031b80 con 0x7f4a04101de0 2024-09-19T04:30:14.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4a0419d600 con 0x7f4a04101de0 2024-09-19T04:30:14.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f49f67fc640 1 -- 172.21.15.70:0/4096227474 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f49f8035070 con 0x7f4a04101de0 2024-09-19T04:30:14.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.156+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4a041a4f40 con 0x7f4a04101de0 2024-09-19T04:30:14.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.157+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4a041032c0 con 0x7f4a04101de0 2024-09-19T04:30:14.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.159+0000 7f49f67fc640 1 -- 172.21.15.70:0/4096227474 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f49f80035f0 con 0x7f4a04101de0 2024-09-19T04:30:14.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.159+0000 7f49f67fc640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49f00a32d0 0x7f49f00a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:14.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.159+0000 7f4a08c5e640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49f00a32d0 0x7f49f00a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:14.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.160+0000 7f49f67fc640 1 -- 172.21.15.70:0/4096227474 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f49f80f0bd0 con 0x7f4a04101de0 2024-09-19T04:30:14.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.160+0000 7f4a08c5e640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49f00a32d0 0x7f49f00a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a041088e0 tx=0x7f4a0000a2d0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:14.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.163+0000 7f49f67fc640 1 -- 172.21.15.70:0/4096227474 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f49f80bd7c0 con 0x7f4a04101de0 2024-09-19T04:30:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.332+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4a0410a0f0 con 0x7f4a04101de0 2024-09-19T04:30:14.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.333+0000 7f49f67fc640 1 -- 172.21.15.70:0/4096227474 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22679 (secure 0 0 0) 0x7f49f80bd0c0 con 0x7f4a04101de0 2024-09-19T04:30:14.335 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:14.336 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:29:18.471871+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:30:14.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49f00a32d0 msgr2=0x7f49f00a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:14.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49f00a32d0 0x7f49f00a5790 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f4a041088e0 tx=0x7f4a0000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 msgr2=0x7f4a041983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:14.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 0x7f4a041983c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f49f8009a20 tx=0x7f49f80043b0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 shutdown_connections 2024-09-19T04:30:14.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f49f00a32d0 0x7f49f00a5790 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4a04106f10 0x7f4a0419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4a04102790 0x7f4a04198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 --2- 172.21.15.70:0/4096227474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4a04101de0 0x7f4a041983c0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:14.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 >> 172.21.15.70:0/4096227474 conn(0x7f4a040fd8c0 msgr2=0x7f4a040fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:14.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 shutdown_connections 2024-09-19T04:30:14.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:14.336+0000 7f4a0b6c3640 1 -- 172.21.15.70:0/4096227474 wait complete. 2024-09-19T04:30:14.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:14 smithi070 ceph-mon[30942]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:14.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:14 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4096227474' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:14.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:14 smithi167 ceph-mon[34339]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:14.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:14 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4096227474' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:15.018 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:30:15.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:14 smithi134 ceph-mon[34525]: pgmap v311: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:15.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:14 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4096227474' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:15.263 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 -- 172.21.15.70:0/4020741264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d600ffc60 msgr2=0x7f9d601000e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 --2- 172.21.15.70:0/4020741264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d600ffc60 0x7f9d601000e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009930 tx=0x7f9d5402a4d0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 -- 172.21.15.70:0/4020741264 shutdown_connections 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 --2- 172.21.15.70:0/4020741264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d60100620 0x7f9d6010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 --2- 172.21.15.70:0/4020741264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d600ffc60 0x7f9d601000e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 --2- 172.21.15.70:0/4020741264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d60106be0 0x7f9d60106fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 -- 172.21.15.70:0/4020741264 >> 172.21.15.70:0/4020741264 conn(0x7f9d600fba90 msgr2=0x7f9d600fdeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 -- 172.21.15.70:0/4020741264 shutdown_connections 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.744+0000 7f9d680c2640 1 -- 172.21.15.70:0/4020741264 wait complete. 2024-09-19T04:30:15.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d680c2640 1 Processor -- start 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d680c2640 1 -- start start 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d680c2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d600ffc60 0x7f9d60198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d680c2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d60100620 0x7f9d601989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d680c2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d60106be0 0x7f9d6019cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d680c2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60111f90 con 0x7f9d60100620 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d680c2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60111e10 con 0x7f9d600ffc60 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d680c2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9d60112110 con 0x7f9d60106be0 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d6565d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d60100620 0x7f9d601989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:15.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d6565d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d60100620 0x7f9d601989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34952/0 (socket says 172.21.15.70:34952) 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d6565d640 1 -- 172.21.15.70:0/1961737745 learned_addr learned my addr 172.21.15.70:0/1961737745 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d65e5e640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d600ffc60 0x7f9d60198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.745+0000 7f9d6665f640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d60106be0 0x7f9d6019cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d6565d640 1 -- 172.21.15.70:0/1961737745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d60106be0 msgr2=0x7f9d6019cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d6565d640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d60106be0 0x7f9d6019cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d6565d640 1 -- 172.21.15.70:0/1961737745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d600ffc60 msgr2=0x7f9d60198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d6565d640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d600ffc60 0x7f9d60198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d6565d640 1 -- 172.21.15.70:0/1961737745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6019d410 con 0x7f9d60100620 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d6665f640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d60106be0 0x7f9d6019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:15.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d6565d640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d60100620 0x7f9d601989a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9d54031440 tx=0x7f9d54005020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d5effd640 1 -- 172.21.15.70:0/1961737745 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5403f070 con 0x7f9d60100620 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6019d6a0 con 0x7f9d60100620 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d5effd640 1 -- 172.21.15.70:0/1961737745 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9d54005620 con 0x7f9d60100620 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d5effd640 1 -- 172.21.15.70:0/1961737745 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54035030 con 0x7f9d60100620 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.746+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d601a4fe0 con 0x7f9d60100620 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.747+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d601000e0 con 0x7f9d60100620 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.748+0000 7f9d5effd640 1 -- 172.21.15.70:0/1961737745 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f9d54042070 con 0x7f9d60100620 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.749+0000 7f9d5effd640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9d480a32d0 0x7f9d480a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:15.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.749+0000 7f9d65e5e640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9d480a32d0 0x7f9d480a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.749+0000 7f9d5effd640 1 -- 172.21.15.70:0/1961737745 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f9d540f0240 con 0x7f9d60100620 2024-09-19T04:30:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.749+0000 7f9d65e5e640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9d480a32d0 0x7f9d480a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005fd0 tx=0x7f9d50009680 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:15.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.753+0000 7f9d5effd640 1 -- 172.21.15.70:0/1961737745 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9d540bce30 con 0x7f9d60100620 2024-09-19T04:30:15.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.952+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9d6010a0c0 con 0x7f9d60100620 2024-09-19T04:30:15.954 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:15 smithi070 ceph-mon[30942]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:15.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.953+0000 7f9d5effd640 1 -- 172.21.15.70:0/1961737745 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11914 (secure 0 0 0) 0x7f9d540bc730 con 0x7f9d60100620 2024-09-19T04:30:15.955 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:15.955 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"btime":"2024-09-19T04:29:14:453215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:29:14.027648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:30:15.955 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 23 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9d480a32d0 msgr2=0x7f9d480a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9d480a32d0 0x7f9d480a5790 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f9d50005fd0 tx=0x7f9d50009680 comp rx=0 tx=0).stop 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d60100620 msgr2=0x7f9d601989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d60100620 0x7f9d601989a0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f9d54031440 tx=0x7f9d54005020 comp rx=0 tx=0).stop 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 shutdown_connections 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f9d480a32d0 0x7f9d480a5790 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d60106be0 0x7f9d6019cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d60100620 0x7f9d601989a0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 --2- 172.21.15.70:0/1961737745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d600ffc60 0x7f9d60198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 >> 172.21.15.70:0/1961737745 conn(0x7f9d600fba90 msgr2=0x7f9d600fd4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 shutdown_connections 2024-09-19T04:30:15.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:15.956+0000 7f9d680c2640 1 -- 172.21.15.70:0/1961737745 wait complete. 2024-09-19T04:30:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:15 smithi167 ceph-mon[34339]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:16.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:15 smithi134 ceph-mon[34525]: pgmap v312: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:16.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T04:29:02.989107+0000', 'modified': '2024-09-19T04:29:14.027648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24470, 'mds_1': 24452, 'mds_2': 24433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24412': {'gid': 24412, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/3330741295', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 3330741295}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 3330741295}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6837/3495956228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 3495956228}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 3495956228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/1711007693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1711007693}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1711007693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.167:6839/2148889748', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 2148889748}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 2148889748}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.134:6837/2308950233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2308950233}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2308950233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6839/1808608891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 1808608891}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 1808608891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24470, 'qdb_cluster': [24433, 24452, 24470]} 2024-09-19T04:30:16.573 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T04:30:16.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T04:30:16.818 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:16.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:16 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1961737745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:16.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:16 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1961737745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:16 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1961737745' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:17.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/3243842984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102570 msgr2=0x7f4c741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/3243842984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102570 0x7f4c741029b0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009900 tx=0x7f4c6402a480 comp rx=0 tx=0).stop 2024-09-19T04:30:17.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/3243842984 shutdown_connections 2024-09-19T04:30:17.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/3243842984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c74102ef0 0x7f4c7410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/3243842984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102570 0x7f4c741029b0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/3243842984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c74100e20 0x7f4c74101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/3243842984 >> 172.21.15.70:0/3243842984 conn(0x7f4c740fc7d0 msgr2=0x7f4c740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/3243842984 shutdown_connections 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.269+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/3243842984 wait complete. 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c7b4f5640 1 Processor -- start 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c7b4f5640 1 -- start start 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c7b4f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c74100e20 0x7f4c74199520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c7b4f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c74102570 0x7f4c74199a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c7b4f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102ef0 0x7f4c741a45a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c7b4f5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74111010 con 0x7f4c74102ef0 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c7b4f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74110e90 con 0x7f4c74102570 2024-09-19T04:30:17.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c7b4f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4c74111190 con 0x7f4c74100e20 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102ef0 0x7f4c741a45a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102ef0 0x7f4c741a45a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34974/0 (socket says 172.21.15.70:34974) 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 -- 172.21.15.70:0/1115327403 learned_addr learned my addr 172.21.15.70:0/1115327403 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 -- 172.21.15.70:0/1115327403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c74100e20 msgr2=0x7f4c74199520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79291640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c74100e20 0x7f4c74199520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c74100e20 0x7f4c74199520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 -- 172.21.15.70:0/1115327403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c74102570 msgr2=0x7f4c74199a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c74102570 0x7f4c74199a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 -- 172.21.15.70:0/1115327403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4c741a4ae0 con 0x7f4c74102ef0 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.270+0000 7f4c79a92640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102ef0 0x7f4c741a45a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00b970 tx=0x7f4c6c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.271+0000 7f4c6a7fc640 1 -- 172.21.15.70:0/1115327403 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c019070 con 0x7f4c74102ef0 2024-09-19T04:30:17.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.271+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/1115327403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4c741a4cb0 con 0x7f4c74102ef0 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.271+0000 7f4c6a7fc640 1 -- 172.21.15.70:0/1115327403 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4c6c00cb40 con 0x7f4c74102ef0 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.271+0000 7f4c6a7fc640 1 -- 172.21.15.70:0/1115327403 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c007650 con 0x7f4c74102ef0 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.271+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/1115327403 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4c741a51f0 con 0x7f4c74102ef0 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.273+0000 7f4c6a7fc640 1 -- 172.21.15.70:0/1115327403 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f4c6c01c070 con 0x7f4c74102ef0 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.273+0000 7f4c7d8ce740 1 Processor -- start 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c7d8ce740 1 -- start start 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c6a7fc640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c600a32d0 0x7f4c600a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c78a90640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c600a32d0 0x7f4c600a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 0x55b36eba3ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c6a7fc640 1 -- 172.21.15.70:0/1115327403 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f4c6c0cf090 con 0x7f4c74102ef0 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba4530 0x55b36eb9e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36eb9f050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b36eafb090 con 0x55b36eb9ebd0 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b36eaa2a70 con 0x55b36eba4530 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b36eaf7050 con 0x55b36eba3c10 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c79a92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36eb9f050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c79a92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36eb9f050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34984/0 (socket says 172.21.15.70:34984) 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c79a92640 1 -- 172.21.15.70:0/2542385075 learned_addr learned my addr 172.21.15.70:0/2542385075 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c79291640 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 0x55b36eba3ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.274+0000 7f4c78a90640 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba4530 0x55b36eb9e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c79a92640 1 -- 172.21.15.70:0/2542385075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 msgr2=0x55b36eba3ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c79a92640 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 0x55b36eba3ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c79a92640 1 -- 172.21.15.70:0/2542385075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba4530 msgr2=0x55b36eb9e560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c79a92640 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba4530 0x55b36eb9e560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c79a92640 1 -- 172.21.15.70:0/2542385075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b36eaaf130 con 0x55b36eb9ebd0 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c78a90640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c600a32d0 0x7f4c600a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4c6402a9a0 tx=0x7f4c64000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c79a92640 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36eb9f050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c016000 tx=0x7f4c6c09be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d2a08c630a5e583 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c5f7fe640 1 -- 172.21.15.70:0/2542385075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0a4300 con 0x55b36eb9ebd0 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c5f7fe640 1 -- 172.21.15.70:0/2542385075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4c6c00ccf0 con 0x55b36eb9ebd0 2024-09-19T04:30:17.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.275+0000 7f4c5f7fe640 1 -- 172.21.15.70:0/2542385075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c097ea0 con 0x55b36eb9ebd0 2024-09-19T04:30:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2542385075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 msgr2=0x55b36eb9f050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36eb9f050 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c016000 tx=0x7f4c6c09be50 comp rx=0 tx=0).stop 2024-09-19T04:30:17.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2542385075 shutdown_connections 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36eb9f050 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba4530 0x55b36eb9e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/2542385075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 0x55b36eba3ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2542385075 >> 172.21.15.70:0/2542385075 conn(0x55b36eb90a10 msgr2=0x55b36eb90df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2542385075 shutdown_connections 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2542385075 wait complete. 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 -- start start 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.276+0000 7f4c7d8ce740 1 Processor -- start 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 0x55b36ebaa530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 0x55b36eba7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba4530 0x55b36eba7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b36ebaaf50 con 0x55b36eba4530 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b36eab5f20 con 0x55b36eb9ebd0 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b36ebab0d0 con 0x55b36eba3c10 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 10 client.0 _ll_register_callbacks cb 0x55b36ea7f030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba4530 0x55b36eba7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba4530 0x55b36eba7fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34994/0 (socket says 172.21.15.70:34994) 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 -- 172.21.15.70:0/3017512776 learned_addr learned my addr 172.21.15.70:0/3017512776 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c78a90640 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 0x55b36eba7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79291640 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 0x55b36ebaa530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 -- 172.21.15.70:0/3017512776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 msgr2=0x55b36eba7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:17.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 0x55b36eba7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 -- 172.21.15.70:0/3017512776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 msgr2=0x55b36ebaa530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 0x55b36ebaa530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 -- 172.21.15.70:0/3017512776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b36e86c2b0 con 0x55b36eba4530 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c79a92640 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba4530 0x55b36eba7fc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00b940 tx=0x7f4c6c0149a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e06fecd4a68eeb47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3017512776 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c6c0b3070 con 0x55b36eba4530 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3017512776 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f4c6c0afbb0 con 0x55b36eba4530 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3017512776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c6c00ccf0 con 0x55b36eba4530 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3017512776 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4c6c0a4300 con 0x55b36eba4530 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.277+0000 7f4c7d8ce740 10 client.14964 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3017512776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b36ebb6a80 con 0x55b36eba4530 2024-09-19T04:30:17.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3017512776 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4c6c00ccf0 con 0x55b36eba4530 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3017512776 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f4c6c014440 con 0x55b36eba4530 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c7d8ce740 10 client.14964 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c7d8ce740 10 client.14964 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c7d8ce740 20 client.14964 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b36ebb8bc0 0x55b36ebba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c7d8ce740 4 client.14964 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3017512776 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b36eb08600 con 0x55b36ebb8bc0 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.278+0000 7f4c79291640 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b36ebb8bc0 0x55b36ebba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.279+0000 7f4c5cff9640 10 client.14964 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:30:17.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.279+0000 7f4c79291640 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b36ebb8bc0 0x55b36ebba030 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dee84d394eae3442 server_cookie=badfee5a9bb6442f in_seq=0 out_seq=0 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.279+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3017512776 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b36eb08600 con 0x55b36ebb8bc0 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.279+0000 7f4c5cff9640 10 client.14964 handle_command_reply: tid=0 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 client.14964 shutdown 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3017512776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba4530 msgr2=0x55b36eba7fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba4530 0x55b36eba7fc0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00b940 tx=0x7f4c6c0149a0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3017512776 shutdown_connections 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b36ebb8bc0 0x55b36ebba030 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba4530 0x55b36eba7fc0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba3c10 0x55b36eba7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3017512776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 0x55b36ebaa530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3017512776 >> 172.21.15.70:0/3017512776 conn(0x55b36eb90a10 msgr2=0x55b36eb90000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:17.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c5cff9640 0 client.14964 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:30:17.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3017512776 shutdown_connections 2024-09-19T04:30:17.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3017512776 wait complete. 2024-09-19T04:30:17.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.280+0000 7f4c7d8ce740 20 client.14964 trim_cache size 0 max 16384 2024-09-19T04:30:17.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.297+0000 7f4c7d8ce740 1 Processor -- start 2024-09-19T04:30:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.297+0000 7f4c7d8ce740 1 -- start start 2024-09-19T04:30:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.297+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 0x55b36ebba030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.297+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba3c10 0x55b36eb9e560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.297+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 0x55b36eba3230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.297+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b36ebb8370 con 0x55b36eba3c10 2024-09-19T04:30:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.297+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b36ebb8a40 con 0x55b36eb9ebd0 2024-09-19T04:30:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.297+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b36ebb9110 con 0x55b36eba4530 2024-09-19T04:30:17.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba3c10 0x55b36eb9e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba3c10 0x55b36eb9e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35004/0 (socket says 172.21.15.70:35004) 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 -- 172.21.15.70:0/2298437066 learned_addr learned my addr 172.21.15.70:0/2298437066 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 -- 172.21.15.70:0/2298437066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 msgr2=0x55b36eba3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 --2- 172.21.15.70:0/2298437066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 0x55b36eba3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 -- 172.21.15.70:0/2298437066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 msgr2=0x55b36ebba030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 --2- 172.21.15.70:0/2298437066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 0x55b36ebba030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 -- 172.21.15.70:0/2298437066 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b36eba85c0 con 0x55b36eba3c10 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c78a90640 1 --2- 172.21.15.70:0/2298437066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba3c10 0x55b36eb9e560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009900 tx=0x7f4c64042000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233ed3f3d69f8656 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:17.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c5effd640 1 -- 172.21.15.70:0/2298437066 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64043070 con 0x55b36eba3c10 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c5effd640 1 -- 172.21.15.70:0/2298437066 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4c64004400 con 0x55b36eba3c10 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.298+0000 7f4c5effd640 1 -- 172.21.15.70:0/2298437066 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c64035050 con 0x55b36eba3c10 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2298437066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba3c10 msgr2=0x55b36eb9e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/2298437066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba3c10 0x55b36eb9e560 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f4c64009900 tx=0x7f4c64042000 comp rx=0 tx=0).stop 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2298437066 shutdown_connections 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/2298437066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 0x55b36eba3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/2298437066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eba3c10 0x55b36eb9e560 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/2298437066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eb9ebd0 0x55b36ebba030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2298437066 >> 172.21.15.70:0/2298437066 conn(0x55b36eb90a10 msgr2=0x55b36eb8f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2298437066 shutdown_connections 2024-09-19T04:30:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/2298437066 wait complete. 2024-09-19T04:30:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 -- start start 2024-09-19T04:30:17.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.299+0000 7f4c7d8ce740 1 Processor -- start 2024-09-19T04:30:17.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36ebc29d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba3c10 0x55b36ebb3900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 0x55b36ebb3e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b36ebb9eb0 con 0x55b36eb9ebd0 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b36ebb97e0 con 0x55b36eba3c10 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b36ebba580 con 0x55b36eba4530 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 10 client.0 _ll_register_callbacks cb 0x7f4c6c0ce070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36ebc29d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36ebc29d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35006/0 (socket says 172.21.15.70:35006) 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 -- 172.21.15.70:0/3244202678 learned_addr learned my addr 172.21.15.70:0/3244202678 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79a92640 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 0x55b36ebb3e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c78a90640 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba3c10 0x55b36ebb3900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 -- 172.21.15.70:0/3244202678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 msgr2=0x55b36ebb3e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 0x55b36ebb3e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 -- 172.21.15.70:0/3244202678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba3c10 msgr2=0x55b36ebb3900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba3c10 0x55b36ebb3900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 -- 172.21.15.70:0/3244202678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b36ebb4620 con 0x55b36eb9ebd0 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c78a90640 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba3c10 0x55b36ebb3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c79291640 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36ebc29d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000e260 tx=0x7f4c7000ef30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d8952992ef887f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c5cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3244202678 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4c70015c30 con 0x55b36eb9ebd0 2024-09-19T04:30:17.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3244202678 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f4c70015dd0 con 0x55b36eb9ebd0 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3244202678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4c64004400 con 0x55b36eb9ebd0 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3244202678 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f4c7002a070 con 0x55b36eb9ebd0 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 10 client.14970 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.300+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3244202678 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55b36ec23330 con 0x55b36eb9ebd0 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3244202678 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4c64004400 con 0x55b36eb9ebd0 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3244202678 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f4c7002e6d0 con 0x55b36eb9ebd0 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c7d8ce740 10 client.14970 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c7d8ce740 10 client.14970 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c7d8ce740 20 client.14970 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b36ec257d0 0x55b36ec26c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:17.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c7d8ce740 4 client.14970 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3244202678 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "status"}) -- 0x55b36eb02b10 con 0x55b36ec257d0 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c78a90640 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b36ec257d0 0x55b36ec26c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c5cff9640 10 client.14970 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.301+0000 7f4c78a90640 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b36ec257d0 0x55b36ec26c40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a513229e02419230 server_cookie=38db8182c2ba367d in_seq=0 out_seq=0 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c5cff9640 1 -- 172.21.15.70:0/3244202678 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55b36eb02b10 con 0x55b36ec257d0 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c5cff9640 10 client.14970 handle_command_reply: tid=0 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 client.14970 shutdown 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3244202678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 msgr2=0x55b36ebc29d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36ebc29d0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f4c7000e260 tx=0x7f4c7000ef30 comp rx=0 tx=0).stop 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3244202678 shutdown_connections 2024-09-19T04:30:17.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b36ec257d0 0x55b36ec26c40 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b36eba4530 0x55b36ebb3e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c5cff9640 0 client.14970 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:30:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b36eba3c10 0x55b36ebb3900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 --2- 172.21.15.70:0/3244202678 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b36eb9ebd0 0x55b36ebc29d0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3244202678 >> 172.21.15.70:0/3244202678 conn(0x55b36eb90a10 msgr2=0x55b36eb90000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3244202678 shutdown_connections 2024-09-19T04:30:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 1 -- 172.21.15.70:0/3244202678 wait complete. 2024-09-19T04:30:17.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.302+0000 7f4c7d8ce740 20 client.14970 trim_cache size 0 max 16384 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "7f15b24a-763e-11ef-bceb-c7b262605968", 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24433, 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 65.8570809, 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 23, 2024-09-19T04:30:17.313 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-19T04:30:17.314 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T04:30:17.314 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 93.093930078 2024-09-19T04:30:17.314 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:17.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c600a32d0 msgr2=0x7f4c600a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c600a32d0 0x7f4c600a5790 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f4c6402a9a0 tx=0x7f4c64000bc0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102ef0 msgr2=0x7f4c741a45a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102ef0 0x7f4c741a45a0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f4c6c00b970 tx=0x7f4c6c00be30 comp rx=0 tx=0).stop 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/1115327403 shutdown_connections 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f4c600a32d0 0x7f4c600a5790 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4c74102ef0 0x7f4c741a45a0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4c74102570 0x7f4c74199a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 --2- 172.21.15.70:0/1115327403 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4c74100e20 0x7f4c74199520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/1115327403 >> 172.21.15.70:0/1115327403 conn(0x7f4c740fc7d0 msgr2=0x7f4c740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/1115327403 shutdown_connections 2024-09-19T04:30:17.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:17.303+0000 7f4c7b4f5640 1 -- 172.21.15.70:0/1115327403 wait complete. 2024-09-19T04:30:17.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:17 smithi070 ceph-mon[30942]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:17.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:17 smithi167 ceph-mon[34339]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:18.014 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T04:30:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:17 smithi134 ceph-mon[34525]: pgmap v313: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:18.259 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 -- 172.21.15.70:0/3364331661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08102570 msgr2=0x7eff081029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 --2- 172.21.15.70:0/3364331661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08102570 0x7eff081029b0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7efef4009900 tx=0x7efef402a480 comp rx=0 tx=0).stop 2024-09-19T04:30:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 -- 172.21.15.70:0/3364331661 shutdown_connections 2024-09-19T04:30:18.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 --2- 172.21.15.70:0/3364331661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff08102ef0 0x7eff0810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 --2- 172.21.15.70:0/3364331661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08102570 0x7eff081029b0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 --2- 172.21.15.70:0/3364331661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff08100e20 0x7eff08101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 -- 172.21.15.70:0/3364331661 >> 172.21.15.70:0/3364331661 conn(0x7eff080fc7d0 msgr2=0x7eff080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 -- 172.21.15.70:0/3364331661 shutdown_connections 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 -- 172.21.15.70:0/3364331661 wait complete. 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 Processor -- start 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 -- start start 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08100e20 0x7eff081992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff08102570 0x7eff08199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.702+0000 7eff0f17f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff08102ef0 0x7eff081a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0f17f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff08110f50 con 0x7eff08100e20 2024-09-19T04:30:18.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0f17f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff08110dd0 con 0x7eff08102570 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0f17f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff081110d0 con 0x7eff08102ef0 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08100e20 0x7eff081992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08100e20 0x7eff081992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35026/0 (socket says 172.21.15.70:35026) 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 -- 172.21.15.70:0/792846160 learned_addr learned my addr 172.21.15.70:0/792846160 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff07fff640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff08102570 0x7eff08199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 -- 172.21.15.70:0/792846160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff08102ef0 msgr2=0x7eff081a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff08102ef0 0x7eff081a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 -- 172.21.15.70:0/792846160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff08102570 msgr2=0x7eff08199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff08102570 0x7eff08199820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 -- 172.21.15.70:0/792846160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff081a48a0 con 0x7eff08100e20 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff07fff640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff08102570 0x7eff08199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:18.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08100e20 0x7eff081992e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efefc00d950 tx=0x7efefc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff05ffb640 1 -- 172.21.15.70:0/792846160 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc017070 con 0x7eff08100e20 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0f17f640 1 -- 172.21.15.70:0/792846160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff081a4a70 con 0x7eff08100e20 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff05ffb640 1 -- 172.21.15.70:0/792846160 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efefc009c30 con 0x7eff08100e20 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff05ffb640 1 -- 172.21.15.70:0/792846160 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efefc00f6b0 con 0x7eff08100e20 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.703+0000 7eff0f17f640 1 -- 172.21.15.70:0/792846160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff081a4fb0 con 0x7eff08100e20 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.706+0000 7eff05ffb640 1 -- 172.21.15.70:0/792846160 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7efefc010a50 con 0x7eff08100e20 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.706+0000 7eff11558740 1 Processor -- start 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.706+0000 7eff11558740 1 -- start start 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff11558740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834e7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff11558740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x5644834f6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff11558740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff11558740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56448344e090 con 0x5644834f6fc0 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff11558740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5644833f5a70 con 0x5644834e81d0 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff11558740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56448344a050 con 0x5644834e78b0 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f93b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35032/0 (socket says 172.21.15.70:35032) 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 -- 172.21.15.70:0/2347776899 learned_addr learned my addr 172.21.15.70:0/2347776899 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff05ffb640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efef80a32d0 0x7efef80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x5644834f6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff0d71c640 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834e7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff0d71c640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efef80a32d0 0x7efef80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 -- 172.21.15.70:0/2347776899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 msgr2=0x5644834e7c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834e7c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff05ffb640 1 -- 172.21.15.70:0/792846160 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7efefc0cf730 con 0x7eff08100e20 2024-09-19T04:30:18.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 -- 172.21.15.70:0/2347776899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 msgr2=0x5644834f6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x5644834f6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 -- 172.21.15.70:0/2347776899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564483402130 con 0x5644834f6fc0 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff0d71c640 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.707+0000 7eff07fff640 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f93b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efef402a9a0 tx=0x7efef4031e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bfe26f4456dbb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff0d71c640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efef80a32d0 0x7efef80a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff00005fd0 tx=0x7eff00005e90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7efef2ffd640 1 -- 172.21.15.70:0/2347776899 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4035030 con 0x5644834f6fc0 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7efef2ffd640 1 -- 172.21.15.70:0/2347776899 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efef40316a0 con 0x5644834f6fc0 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7efef2ffd640 1 -- 172.21.15.70:0/2347776899 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef40046c0 con 0x5644834f6fc0 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 -- 172.21.15.70:0/2347776899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 msgr2=0x5644834f93b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f93b0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7efef402a9a0 tx=0x7efef4031e60 comp rx=0 tx=0).stop 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 -- 172.21.15.70:0/2347776899 shutdown_connections 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f93b0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x5644834f6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 --2- 172.21.15.70:0/2347776899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834e7c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 -- 172.21.15.70:0/2347776899 >> 172.21.15.70:0/2347776899 conn(0x5644834e3f60 msgr2=0x5644834e4340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 -- 172.21.15.70:0/2347776899 shutdown_connections 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.708+0000 7eff11558740 1 -- 172.21.15.70:0/2347776899 wait complete. 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 1 -- start start 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 1 Processor -- start 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834f6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x5644834f3b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5644834f9b90 con 0x5644834f6fc0 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564483408f20 con 0x5644834e81d0 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5644834f9d10 con 0x5644834e78b0 2024-09-19T04:30:18.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff11558740 10 client.0 _ll_register_callbacks cb 0x5644833d2030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff0d71c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff0d71c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35036/0 (socket says 172.21.15.70:35036) 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff0d71c640 1 -- 172.21.15.70:0/1979365164 learned_addr learned my addr 172.21.15.70:0/1979365164 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff07fff640 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x5644834f3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.709+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834f6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff0d71c640 1 -- 172.21.15.70:0/1979365164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 msgr2=0x5644834f6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff0d71c640 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834f6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff0d71c640 1 -- 172.21.15.70:0/1979365164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 msgr2=0x5644834f3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff0d71c640 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x5644834f3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff0d71c640 1 -- 172.21.15.70:0/1979365164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644831bf2b0 con 0x5644834f6fc0 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff0d71c640 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f4090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7eff00011c70 tx=0x7eff00004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b2ef2e541e5a57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7efee7fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:18.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7efee7fff640 1 -- 172.21.15.70:0/1979365164 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00023070 con 0x5644834f6fc0 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7efee7fff640 1 -- 172.21.15.70:0/1979365164 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7eff00003970 con 0x5644834f6fc0 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff11558740 1 -- 172.21.15.70:0/1979365164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef40316a0 con 0x5644834f6fc0 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7efee7fff640 1 -- 172.21.15.70:0/1979365164 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7eff0001d420 con 0x5644834f6fc0 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff11558740 10 client.14982 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff11558740 1 -- 172.21.15.70:0/1979365164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5644835054f0 con 0x5644834f6fc0 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7efee7fff640 1 -- 172.21.15.70:0/1979365164 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efef40316a0 con 0x5644834f6fc0 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7efee7fff640 1 -- 172.21.15.70:0/1979365164 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7eff0000f040 con 0x5644834f6fc0 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.710+0000 7eff11558740 10 client.14982 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.711+0000 7eff11558740 10 client.14982 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.711+0000 7eff11558740 20 client.14982 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.711+0000 7eff11558740 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564483507ba0 0x564483509010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.711+0000 7eff11558740 4 client.14982 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:30:18.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.711+0000 7eff11558740 1 -- 172.21.15.70:0/1979365164 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56448345b600 con 0x564483507ba0 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.711+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564483507ba0 0x564483509010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.711+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564483507ba0 0x564483509010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b04518a1cf96c6d4 server_cookie=12f862a01644b75c in_seq=0 out_seq=0 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.711+0000 7efee7fff640 10 client.14982 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7efee7fff640 1 -- 172.21.15.70:0/1979365164 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56448345b600 con 0x564483507ba0 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7efee7fff640 10 client.14982 handle_command_reply: tid=0 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 client.14982 shutdown 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 -- 172.21.15.70:0/1979365164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 msgr2=0x5644834f4090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f4090 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7eff00011c70 tx=0x7eff00004a40 comp rx=0 tx=0).stop 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 -- 172.21.15.70:0/1979365164 shutdown_connections 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564483507ba0 0x564483509010 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644834f4090 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x5644834f3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7efee7fff640 0 client.14982 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:30:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 --2- 172.21.15.70:0/1979365164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x5644834f6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 -- 172.21.15.70:0/1979365164 >> 172.21.15.70:0/1979365164 conn(0x5644834e3f60 msgr2=0x5644834e9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 -- 172.21.15.70:0/1979365164 shutdown_connections 2024-09-19T04:30:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 1 -- 172.21.15.70:0/1979365164 wait complete. 2024-09-19T04:30:18.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.712+0000 7eff11558740 20 client.14982 trim_cache size 0 max 16384 2024-09-19T04:30:18.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff11558740 1 Processor -- start 2024-09-19T04:30:18.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff11558740 1 -- start start 2024-09-19T04:30:18.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff11558740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x564483509010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff11558740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834e81d0 0x5644834f2420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff11558740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834f6fc0 0x5644834f2960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff11558740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564483507350 con 0x5644834e81d0 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff11558740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564483507a20 con 0x5644834f6fc0 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff11558740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5644835080f0 con 0x5644834e78b0 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff07fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834e81d0 0x5644834f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff07fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834e81d0 0x5644834f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35040/0 (socket says 172.21.15.70:35040) 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff07fff640 1 -- 172.21.15.70:0/2044861539 learned_addr learned my addr 172.21.15.70:0/2044861539 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x564483509010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff07fff640 1 -- 172.21.15.70:0/2044861539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 msgr2=0x564483509010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff07fff640 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x564483509010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff07fff640 1 -- 172.21.15.70:0/2044861539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834f6fc0 msgr2=0x5644834f2960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:18.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff07fff640 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834f6fc0 0x5644834f2960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.730+0000 7eff07fff640 1 -- 172.21.15.70:0/2044861539 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644834e8000 con 0x5644834e81d0 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.731+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x564483509010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.731+0000 7eff07fff640 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834e81d0 0x5644834f2420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efef4033000 tx=0x7efef402a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e8ef81ede4ced24 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.731+0000 7efef27fc640 1 -- 172.21.15.70:0/2044861539 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4035070 con 0x5644834e81d0 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.731+0000 7efef27fc640 1 -- 172.21.15.70:0/2044861539 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efef4031720 con 0x5644834e81d0 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.731+0000 7efef27fc640 1 -- 172.21.15.70:0/2044861539 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efef4003ce0 con 0x5644834e81d0 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.731+0000 7eff11558740 1 -- 172.21.15.70:0/2044861539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834e81d0 msgr2=0x5644834f2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.731+0000 7eff11558740 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834e81d0 0x5644834f2420 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7efef4033000 tx=0x7efef402a480 comp rx=0 tx=0).stop 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 -- 172.21.15.70:0/2044861539 shutdown_connections 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834f6fc0 0x5644834f2960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834e81d0 0x5644834f2420 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 --2- 172.21.15.70:0/2044861539 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x564483509010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 -- 172.21.15.70:0/2044861539 >> 172.21.15.70:0/2044861539 conn(0x5644834e3f60 msgr2=0x5644834f3b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 -- 172.21.15.70:0/2044861539 shutdown_connections 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 -- 172.21.15.70:0/2044861539 wait complete. 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 -- start start 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 Processor -- start 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x56448350a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x56448350aa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644835702a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564483508e90 con 0x5644834f6fc0 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5644835087c0 con 0x5644834e81d0 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564483509560 con 0x5644834e78b0 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.732+0000 7eff11558740 10 client.0 _ll_register_callbacks cb 0x7eff00013400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644835702a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644835702a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35044/0 (socket says 172.21.15.70:35044) 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 -- 172.21.15.70:0/948869929 learned_addr learned my addr 172.21.15.70:0/948869929 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff07fff640 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x56448350aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 -- 172.21.15.70:0/948869929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 msgr2=0x56448350a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x56448350a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 -- 172.21.15.70:0/948869929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 msgr2=0x56448350aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x56448350aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 -- 172.21.15.70:0/948869929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644835707e0 con 0x5644834f6fc0 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff0d71c640 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644835702a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7eff00029870 tx=0x7eff000296b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37c34f671053ea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7efee7fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7efee7fff640 1 -- 172.21.15.70:0/948869929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff00037060 con 0x5644834f6fc0 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff11558740 1 -- 172.21.15.70:0/948869929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efef4031720 con 0x5644834f6fc0 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7efee7fff640 1 -- 172.21.15.70:0/948869929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7eff0001da50 con 0x5644834f6fc0 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7efee7fff640 1 -- 172.21.15.70:0/948869929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7eff00023070 con 0x5644834f6fc0 2024-09-19T04:30:18.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff11558740 10 client.14988 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7eff11558740 1 -- 172.21.15.70:0/948869929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x5644835719c0 con 0x5644834f6fc0 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.733+0000 7efee7fff640 1 -- 172.21.15.70:0/948869929 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efef4031720 con 0x5644834f6fc0 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7efee7fff640 1 -- 172.21.15.70:0/948869929 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7eff0000f8f0 con 0x5644834f6fc0 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7eff11558740 10 client.14988 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7eff11558740 10 client.14988 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7eff11558740 20 client.14988 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7eff11558740 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5644835764f0 0x564483575200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7eff11558740 4 client.14988 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7eff11558740 1 -- 172.21.15.70:0/948869929 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "status"}) -- 0x564483455b10 con 0x5644835764f0 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5644835764f0 0x564483575200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7efee7fff640 10 client.14988 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:30:18.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.734+0000 7eff0cf1b640 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5644835764f0 0x564483575200 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fafc2ffc997829b8 server_cookie=b5e072ba6d996129 in_seq=0 out_seq=0 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7efee7fff640 1 -- 172.21.15.70:0/948869929 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x564483455b10 con 0x5644835764f0 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7efee7fff640 10 client.14988 handle_command_reply: tid=0 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 client.14988 shutdown 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 -- 172.21.15.70:0/948869929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 msgr2=0x5644835702a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644835702a0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7eff00029870 tx=0x7eff000296b0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 -- 172.21.15.70:0/948869929 shutdown_connections 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5644835764f0 0x564483575200 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644834f6fc0 0x5644835702a0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644834e81d0 0x56448350aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7efee7fff640 0 client.14988 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 --2- 172.21.15.70:0/948869929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644834e78b0 0x56448350a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 -- 172.21.15.70:0/948869929 >> 172.21.15.70:0/948869929 conn(0x5644834e3f60 msgr2=0x5644834f23a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 -- 172.21.15.70:0/948869929 shutdown_connections 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 1 -- 172.21.15.70:0/948869929 wait complete. 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff11558740 20 client.14988 trim_cache size 0 max 16384 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "7f15b24a-763e-11ef-bceb-c7b262605968", 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24452, 2024-09-19T04:30:18.745 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-19T04:30:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-19T04:30:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-19T04:30:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 68.303383494000002, 2024-09-19T04:30:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 23, 2024-09-19T04:30:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-19T04:30:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T04:30:18.746 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 97.045026461999996 2024-09-19T04:30:18.746 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff0f17f640 1 -- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efef80a32d0 msgr2=0x7efef80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff0f17f640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efef80a32d0 0x7efef80a5790 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7eff00005fd0 tx=0x7eff00005e90 comp rx=0 tx=0).stop 2024-09-19T04:30:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff0f17f640 1 -- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08100e20 msgr2=0x7eff081992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.735+0000 7eff0f17f640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08100e20 0x7eff081992e0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7efefc00d950 tx=0x7efefc00de10 comp rx=0 tx=0).stop 2024-09-19T04:30:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.736+0000 7eff0f17f640 1 -- 172.21.15.70:0/792846160 shutdown_connections 2024-09-19T04:30:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.736+0000 7eff0f17f640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7efef80a32d0 0x7efef80a5790 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.736+0000 7eff0f17f640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff08102ef0 0x7eff081a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.736+0000 7eff0f17f640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff08102570 0x7eff08199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.736+0000 7eff0f17f640 1 --2- 172.21.15.70:0/792846160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff08100e20 0x7eff081992e0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.736+0000 7eff0f17f640 1 -- 172.21.15.70:0/792846160 >> 172.21.15.70:0/792846160 conn(0x7eff080fc7d0 msgr2=0x7eff080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.736+0000 7eff0f17f640 1 -- 172.21.15.70:0/792846160 shutdown_connections 2024-09-19T04:30:18.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:18.736+0000 7eff0f17f640 1 -- 172.21.15.70:0/792846160 wait complete. 2024-09-19T04:30:19.433 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T04:30:19.679 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:20.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 -- 172.21.15.70:0/1593745659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0101de0 msgr2=0x7fada01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 --2- 172.21.15.70:0/1593745659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0101de0 0x7fada01021c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fad90009ca0 tx=0x7fad9002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 -- 172.21.15.70:0/1593745659 shutdown_connections 2024-09-19T04:30:20.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 --2- 172.21.15.70:0/1593745659 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada0106f10 0x7fada010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 --2- 172.21.15.70:0/1593745659 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada0102790 0x7fada01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 --2- 172.21.15.70:0/1593745659 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0101de0 0x7fada01021c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 -- 172.21.15.70:0/1593745659 >> 172.21.15.70:0/1593745659 conn(0x7fada00fd8c0 msgr2=0x7fada00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:20.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 -- 172.21.15.70:0/1593745659 shutdown_connections 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.135+0000 7fada59b9640 1 -- 172.21.15.70:0/1593745659 wait complete. 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fada59b9640 1 Processor -- start 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fada59b9640 1 -- start start 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fada59b9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada0101de0 0x7fada01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fada59b9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada0102790 0x7fada01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fada59b9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0106f10 0x7fada019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fada59b9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fada0111f80 con 0x7fada0106f10 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fada59b9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fada0111e00 con 0x7fada0102790 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fada59b9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fada0112100 con 0x7fada0101de0 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.136+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0106f10 0x7fada019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0106f10 0x7fada019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35056/0 (socket says 172.21.15.70:35056) 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9f7fe640 1 -- 172.21.15.70:0/3504690360 learned_addr learned my addr 172.21.15.70:0/3504690360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:20.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9effd640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada0101de0 0x7fada01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada0102790 0x7fada01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9f7fe640 1 -- 172.21.15.70:0/3504690360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada0101de0 msgr2=0x7fada01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9f7fe640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada0101de0 0x7fada01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9f7fe640 1 -- 172.21.15.70:0/3504690360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada0102790 msgr2=0x7fada01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9f7fe640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada0102790 0x7fada01989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9f7fe640 1 -- 172.21.15.70:0/3504690360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fada019d450 con 0x7fada0106f10 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9effd640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada0101de0 0x7fada01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fad9f7fe640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0106f10 0x7fada019cd70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad9800c970 tx=0x7fad9800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fada49b7640 1 -- 172.21.15.70:0/3504690360 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad98007bb0 con 0x7fada0106f10 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fada49b7640 1 -- 172.21.15.70:0/3504690360 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fad98007d50 con 0x7fada0106f10 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fada59b9640 1 -- 172.21.15.70:0/3504690360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fada019d740 con 0x7fada0106f10 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fada49b7640 1 -- 172.21.15.70:0/3504690360 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9800f450 con 0x7fada0106f10 2024-09-19T04:30:20.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.137+0000 7fada59b9640 1 -- 172.21.15.70:0/3504690360 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fada01a5020 con 0x7fada0106f10 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.139+0000 7fada49b7640 1 -- 172.21.15.70:0/3504690360 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fad98004f30 con 0x7fada0106f10 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.139+0000 7fada7d92740 1 Processor -- start 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada7d92740 1 -- start start 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada7d92740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288c68d0 0x55a9288c6cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada7d92740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288d5a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada7d92740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288d5fc0 0x55a9288d83b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada7d92740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a92882d090 con 0x55a9288c68d0 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada7d92740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9287d4a70 con 0x55a9288d5fc0 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada7d92740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a928829050 con 0x55a9288c71f0 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288c68d0 0x55a9288c6cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288c68d0 0x55a9288c6cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35060/0 (socket says 172.21.15.70:35060) 2024-09-19T04:30:20.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 -- 172.21.15.70:0/77571981 learned_addr learned my addr 172.21.15.70:0/77571981 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288d5fc0 0x55a9288d83b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada49b7640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fad880a3350 0x7fad880a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9effd640 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288d5a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 -- 172.21.15.70:0/77571981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 msgr2=0x55a9288d5a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288d5a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 -- 172.21.15.70:0/77571981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288d5fc0 msgr2=0x55a9288d83b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288d5fc0 0x55a9288d83b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 -- 172.21.15.70:0/77571981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9287e1130 con 0x55a9288c68d0 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9f7fe640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fad880a3350 0x7fad880a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288c68d0 0x55a9288c6cb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fad9400aed0 tx=0x7fad9400a320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cd49307dcb05a02 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fada49b7640 1 -- 172.21.15.70:0/3504690360 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fad980cf7a0 con 0x7fada0106f10 2024-09-19T04:30:20.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.140+0000 7fad85ffb640 1 -- 172.21.15.70:0/77571981 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9401b070 con 0x55a9288c68d0 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fad85ffb640 1 -- 172.21.15.70:0/77571981 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fad9400edc0 con 0x55a9288c68d0 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fad85ffb640 1 -- 172.21.15.70:0/77571981 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9400f040 con 0x55a9288c68d0 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 -- 172.21.15.70:0/77571981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288c68d0 msgr2=0x55a9288c6cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fad9f7fe640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fad880a3350 0x7fad880a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad9806eae0 tx=0x7fad9806eb10 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288c68d0 0x55a9288c6cb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fad9400aed0 tx=0x7fad9400a320 comp rx=0 tx=0).stop 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 -- 172.21.15.70:0/77571981 shutdown_connections 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288d5fc0 0x55a9288d83b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288d5a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 --2- 172.21.15.70:0/77571981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288c68d0 0x55a9288c6cb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 -- 172.21.15.70:0/77571981 >> 172.21.15.70:0/77571981 conn(0x55a9288c2f60 msgr2=0x55a9288c3340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 -- 172.21.15.70:0/77571981 shutdown_connections 2024-09-19T04:30:20.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.141+0000 7fada7d92740 1 -- 172.21.15.70:0/77571981 wait complete. 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 1 -- start start 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 1 Processor -- start 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288d58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288d2c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288d3140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a9288d8c40 con 0x55a9288d5fc0 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9287e7f20 con 0x55a9288c68d0 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a9288d8dc0 con 0x55a9288c71f0 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fada7d92740 10 client.0 _ll_register_callbacks cb 0x55a9287b1030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288d3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35076/0 (socket says 172.21.15.70:35076) 2024-09-19T04:30:20.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9e7fc640 1 -- 172.21.15.70:0/1876777901 learned_addr learned my addr 172.21.15.70:0/1876777901 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9effd640 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288d2c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9e7fc640 1 -- 172.21.15.70:0/1876777901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 msgr2=0x55a9288d2c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288d2c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9e7fc640 1 -- 172.21.15.70:0/1876777901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 msgr2=0x55a9288d58b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288d58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.142+0000 7fad9e7fc640 1 -- 172.21.15.70:0/1876777901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a92859e2b0 con 0x55a9288d5fc0 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288d3140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fad94006cf0 tx=0x7fad94006ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d04b218ea824d3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fad7effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fad7effd640 1 -- 172.21.15.70:0/1876777901 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94025070 con 0x55a9288d5fc0 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 1 -- 172.21.15.70:0/1876777901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad9400edc0 con 0x55a9288d5fc0 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fad7effd640 1 -- 172.21.15.70:0/1876777901 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fad94021400 con 0x55a9288d5fc0 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fad7effd640 1 -- 172.21.15.70:0/1876777901 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fad94031050 con 0x55a9288d5fc0 2024-09-19T04:30:20.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 10 client.15000 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 1 -- 172.21.15.70:0/1876777901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a9288e45f0 con 0x55a9288d5fc0 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fad7effd640 1 -- 172.21.15.70:0/1876777901 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fad9400edc0 con 0x55a9288d5fc0 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fad7effd640 1 -- 172.21.15.70:0/1876777901 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fad94015070 con 0x55a9288d5fc0 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 10 client.15000 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 10 client.15000 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 20 client.15000 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a9288e59a0 0x55a9288e7b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 4 client.15000 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.143+0000 7fada7d92740 1 -- 172.21.15.70:0/1876777901 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a92883a600 con 0x55a9288e59a0 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.144+0000 7fad9effd640 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a9288e59a0 0x55a9288e7b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.144+0000 7fad7effd640 10 client.15000 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:20.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.144+0000 7fad9effd640 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a9288e59a0 0x55a9288e7b70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b0597bc0c4463e5 server_cookie=55543b3fc4ac3ea0 in_seq=0 out_seq=0 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fad7effd640 1 -- 172.21.15.70:0/1876777901 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a92883a600 con 0x55a9288e59a0 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fad7effd640 10 client.15000 handle_command_reply: tid=0 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 client.15000 shutdown 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 -- 172.21.15.70:0/1876777901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 msgr2=0x55a9288d3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288d3140 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fad94006cf0 tx=0x7fad94006ee0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 -- 172.21.15.70:0/1876777901 shutdown_connections 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a9288e59a0 0x55a9288e7b70 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288d3140 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288d2c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 --2- 172.21.15.70:0/1876777901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288d58b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fad7effd640 0 client.15000 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 -- 172.21.15.70:0/1876777901 >> 172.21.15.70:0/1876777901 conn(0x55a9288c2f60 msgr2=0x55a9288c8cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 -- 172.21.15.70:0/1876777901 shutdown_connections 2024-09-19T04:30:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.145+0000 7fada7d92740 1 -- 172.21.15.70:0/1876777901 wait complete. 2024-09-19T04:30:20.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.146+0000 7fada7d92740 20 client.15000 trim_cache size 0 max 16384 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fada7d92740 1 Processor -- start 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fada7d92740 1 -- start start 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fada7d92740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288e6dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fada7d92740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288e6700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fada7d92740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e6030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fada7d92740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a9288e5eb0 con 0x55a9288d5fc0 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fada7d92740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9288e6580 con 0x55a9288c68d0 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fada7d92740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a9288e6c50 con 0x55a9288c71f0 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fad9e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e6030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fad9e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e6030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35088/0 (socket says 172.21.15.70:35088) 2024-09-19T04:30:20.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.163+0000 7fad9e7fc640 1 -- 172.21.15.70:0/2137065488 learned_addr learned my addr 172.21.15.70:0/2137065488 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad9effd640 1 --2- 172.21.15.70:0/2137065488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288e6700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad9e7fc640 1 -- 172.21.15.70:0/2137065488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 msgr2=0x55a9288e6700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/2137065488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288e6700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad9e7fc640 1 -- 172.21.15.70:0/2137065488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 msgr2=0x55a9288e6dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/2137065488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288e6dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad9e7fc640 1 -- 172.21.15.70:0/2137065488 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9288c7020 con 0x55a9288d5fc0 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/2137065488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e6030 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fad94004700 tx=0x7fad94018fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eff9466ded24e48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad857fa640 1 -- 172.21.15.70:0/2137065488 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad94025040 con 0x55a9288d5fc0 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad857fa640 1 -- 172.21.15.70:0/2137065488 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fad9402e020 con 0x55a9288d5fc0 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.164+0000 7fad857fa640 1 -- 172.21.15.70:0/2137065488 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9401b040 con 0x55a9288d5fc0 2024-09-19T04:30:20.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 -- 172.21.15.70:0/2137065488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 msgr2=0x55a9288e6030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 --2- 172.21.15.70:0/2137065488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e6030 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fad94004700 tx=0x7fad94018fb0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 -- 172.21.15.70:0/2137065488 shutdown_connections 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 --2- 172.21.15.70:0/2137065488 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e6030 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 --2- 172.21.15.70:0/2137065488 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288e6700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 --2- 172.21.15.70:0/2137065488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288e6dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 -- 172.21.15.70:0/2137065488 >> 172.21.15.70:0/2137065488 conn(0x55a9288c2f60 msgr2=0x55a9288bdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 -- 172.21.15.70:0/2137065488 shutdown_connections 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 -- 172.21.15.70:0/2137065488 wait complete. 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 -- start start 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.165+0000 7fada7d92740 1 Processor -- start 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288f06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288e89b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a9288e79f0 con 0x55a9288d5fc0 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a9288e7320 con 0x55a9288c68d0 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a9288e80c0 con 0x55a9288c71f0 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 10 client.0 _ll_register_callbacks cb 0x7fad94019070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e8fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35102/0 (socket says 172.21.15.70:35102) 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 -- 172.21.15.70:0/120415200 learned_addr learned my addr 172.21.15.70:0/120415200 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288f06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 -- 172.21.15.70:0/120415200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 msgr2=0x55a9288e89b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288e89b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 -- 172.21.15.70:0/120415200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 msgr2=0x55a9288f06a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288f06a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 -- 172.21.15.70:0/120415200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a9288e97c0 con 0x55a9288d5fc0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad9e7fc640 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e8fc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fad9400aed0 tx=0x7fad9400a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebcb7cf949d03b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad7effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad7effd640 1 -- 172.21.15.70:0/120415200 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad9401b040 con 0x55a9288d5fc0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad7effd640 1 -- 172.21.15.70:0/120415200 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fad9400ebc0 con 0x55a9288d5fc0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 1 -- 172.21.15.70:0/120415200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fad9402e020 con 0x55a9288d5fc0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fad7effd640 1 -- 172.21.15.70:0/120415200 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7fad94025040 con 0x55a9288d5fc0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 10 client.15006 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.166+0000 7fada7d92740 1 -- 172.21.15.70:0/120415200 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55a92894fed0 con 0x55a9288d5fc0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fad7effd640 1 -- 172.21.15.70:0/120415200 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fad9402e020 con 0x55a9288d5fc0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fad7effd640 1 -- 172.21.15.70:0/120415200 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7fad94041020 con 0x55a9288d5fc0 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fada7d92740 10 client.15006 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fada7d92740 10 client.15006 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:30:20.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fada7d92740 20 client.15006 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fada7d92740 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a928954840 0x55a928953550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fada7d92740 4 client.15006 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fada7d92740 1 -- 172.21.15.70:0/120415200 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "status"}) -- 0x55a928834b10 con 0x55a928954840 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.167+0000 7fad9effd640 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a928954840 0x55a928953550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fad9effd640 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a928954840 0x55a928953550 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cb332123e6c06154 server_cookie=88de3106435295ab in_seq=0 out_seq=0 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fad7effd640 10 client.15006 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fad7effd640 1 -- 172.21.15.70:0/120415200 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55a928834b10 con 0x55a928954840 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fad7effd640 10 client.15006 handle_command_reply: tid=0 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 client.15006 shutdown 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 -- 172.21.15.70:0/120415200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 msgr2=0x55a9288e8fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e8fc0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7fad9400aed0 tx=0x7fad9400a470 comp rx=0 tx=0).stop 2024-09-19T04:30:20.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 -- 172.21.15.70:0/120415200 shutdown_connections 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a928954840 0x55a928953550 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a9288d5fc0 0x55a9288e8fc0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a9288c71f0 0x55a9288e89b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fad7effd640 0 client.15006 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 --2- 172.21.15.70:0/120415200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a9288c68d0 0x55a9288f06a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 -- 172.21.15.70:0/120415200 >> 172.21.15.70:0/120415200 conn(0x55a9288c2f60 msgr2=0x55a9288d1470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 -- 172.21.15.70:0/120415200 shutdown_connections 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 1 -- 172.21.15.70:0/120415200 wait complete. 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.168+0000 7fada7d92740 20 client.15006 trim_cache size 0 max 16384 2024-09-19T04:30:20.178 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "7f15b24a-763e-11ef-bceb-c7b262605968", 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24470, 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 76.764934514000004, 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 23, 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 87.583138136000002 2024-09-19T04:30:20.179 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:20.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 -- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fad880a3350 msgr2=0x7fad880a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fad880a3350 0x7fad880a5810 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fad9806eae0 tx=0x7fad9806eb10 comp rx=0 tx=0).stop 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 -- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0106f10 msgr2=0x7fada019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0106f10 0x7fada019cd70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fad9800c970 tx=0x7fad9800ce30 comp rx=0 tx=0).stop 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 -- 172.21.15.70:0/3504690360 shutdown_connections 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fad880a3350 0x7fad880a5810 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fada0106f10 0x7fada019cd70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fada0102790 0x7fada01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 --2- 172.21.15.70:0/3504690360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fada0101de0 0x7fada01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 -- 172.21.15.70:0/3504690360 >> 172.21.15.70:0/3504690360 conn(0x7fada00fd8c0 msgr2=0x7fada00fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 -- 172.21.15.70:0/3504690360 shutdown_connections 2024-09-19T04:30:20.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:20.169+0000 7fada59b9640 1 -- 172.21.15.70:0/3504690360 wait complete. 2024-09-19T04:30:20.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:20 smithi167 ceph-mon[34339]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:20 smithi134 ceph-mon[34525]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:20.844 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:20 smithi070 ceph-mon[30942]: pgmap v314: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:20.872 INFO:tasks.cephadm:Setup complete, yielding 2024-09-19T04:30:20.873 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T04:30:20.883 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:30:20.883 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch status' 2024-09-19T04:30:21.128 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 -- 172.21.15.70:0/2727214129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec1017b0 msgr2=0x7f66ec101c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 --2- 172.21.15.70:0/2727214129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec1017b0 0x7f66ec101c60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f66e4009ca0 tx=0x7f66e402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 -- 172.21.15.70:0/2727214129 shutdown_connections 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 --2- 172.21.15.70:0/2727214129 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec1017b0 0x7f66ec101c60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 --2- 172.21.15.70:0/2727214129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66ec100e10 0x7f66ec101270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 --2- 172.21.15.70:0/2727214129 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ec1004d0 0x7f66ec1008d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 -- 172.21.15.70:0/2727214129 >> 172.21.15.70:0/2727214129 conn(0x7f66ec0fc280 msgr2=0x7f66ec0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 -- 172.21.15.70:0/2727214129 shutdown_connections 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.610+0000 7f66f3480640 1 -- 172.21.15.70:0/2727214129 wait complete. 2024-09-19T04:30:21.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f3480640 1 Processor -- start 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f3480640 1 -- start start 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f3480640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ec1004d0 0x7f66ec19a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f3480640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec100e10 0x7f66ec19a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f3480640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66ec1017b0 0x7f66ec1a16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f3480640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec10fa90 con 0x7f66ec100e10 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f3480640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec10f910 con 0x7f66ec1017b0 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f3480640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f66ec10fc10 con 0x7f66ec1004d0 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f0a1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec100e10 0x7f66ec19a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f0a1b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec100e10 0x7f66ec19a620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35108/0 (socket says 172.21.15.70:35108) 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f0a1b640 1 -- 172.21.15.70:0/748730185 learned_addr learned my addr 172.21.15.70:0/748730185 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.611+0000 7f66f1a1d640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66ec1017b0 0x7f66ec1a16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f121c640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ec1004d0 0x7f66ec19a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f0a1b640 1 -- 172.21.15.70:0/748730185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ec1004d0 msgr2=0x7f66ec19a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f0a1b640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ec1004d0 0x7f66ec19a0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f0a1b640 1 -- 172.21.15.70:0/748730185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66ec1017b0 msgr2=0x7f66ec1a16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f0a1b640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66ec1017b0 0x7f66ec1a16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f0a1b640 1 -- 172.21.15.70:0/748730185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66ec1a1d10 con 0x7f66ec100e10 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f1a1d640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66ec1017b0 0x7f66ec1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f0a1b640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec100e10 0x7f66ec19a620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00d950 tx=0x7f66dc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66e27fc640 1 -- 172.21.15.70:0/748730185 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc017070 con 0x7f66ec100e10 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66ec1a1fa0 con 0x7f66ec100e10 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66e27fc640 1 -- 172.21.15.70:0/748730185 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f66dc009c30 con 0x7f66ec100e10 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66e27fc640 1 -- 172.21.15.70:0/748730185 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66dc00f6b0 con 0x7f66ec100e10 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.612+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66ec1a2580 con 0x7f66ec100e10 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.613+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f66ec10b3c0 con 0x7f66ec100e10 2024-09-19T04:30:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.614+0000 7f66e27fc640 1 -- 172.21.15.70:0/748730185 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f66dc010a50 con 0x7f66ec100e10 2024-09-19T04:30:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.615+0000 7f66e27fc640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f66d80a3300 0x7f66d80a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.615+0000 7f66f121c640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f66d80a3300 0x7f66d80a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.615+0000 7f66e27fc640 1 -- 172.21.15.70:0/748730185 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f66dc0cf6e0 con 0x7f66ec100e10 2024-09-19T04:30:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.615+0000 7f66f121c640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f66d80a3300 0x7f66d80a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66e800a810 tx=0x7f66e8008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.619+0000 7f66e27fc640 1 -- 172.21.15.70:0/748730185 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f66dc09c2d0 con 0x7f66ec100e10 2024-09-19T04:30:21.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.801+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f66ec062630 con 0x7f66d80a3300 2024-09-19T04:30:21.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.803+0000 7f66e27fc640 1 -- 172.21.15.70:0/748730185 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f66ec062630 con 0x7f66d80a3300 2024-09-19T04:30:21.804 INFO:teuthology.orchestra.run.smithi070.stdout:Backend: cephadm 2024-09-19T04:30:21.804 INFO:teuthology.orchestra.run.smithi070.stdout:Available: Yes 2024-09-19T04:30:21.804 INFO:teuthology.orchestra.run.smithi070.stdout:Paused: No 2024-09-19T04:30:21.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f66d80a3300 msgr2=0x7f66d80a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:21.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f66d80a3300 0x7f66d80a57c0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f66e800a810 tx=0x7f66e8008040 comp rx=0 tx=0).stop 2024-09-19T04:30:21.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec100e10 msgr2=0x7f66ec19a620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:21.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec100e10 0x7f66ec19a620 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f66dc00d950 tx=0x7f66dc00de10 comp rx=0 tx=0).stop 2024-09-19T04:30:21.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 shutdown_connections 2024-09-19T04:30:21.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f66d80a3300 0x7f66d80a57c0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66ec1017b0 0x7f66ec1a16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f66ec100e10 0x7f66ec19a620 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 --2- 172.21.15.70:0/748730185 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f66ec1004d0 0x7f66ec19a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:21.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 >> 172.21.15.70:0/748730185 conn(0x7f66ec0fc280 msgr2=0x7f66ec0fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:21.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 shutdown_connections 2024-09-19T04:30:21.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:21.805+0000 7f66f3480640 1 -- 172.21.15.70:0/748730185 wait complete. 2024-09-19T04:30:22.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ps' 2024-09-19T04:30:22.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:22 smithi070 ceph-mon[30942]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:22.674 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:22.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:22 smithi167 ceph-mon[34339]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:22.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:22 smithi134 ceph-mon[34525]: pgmap v315: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:23.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 -- 172.21.15.70:0/1707964136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 msgr2=0x7f0d2c109d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 --2- 172.21.15.70:0/1707964136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 0x7f0d2c109d50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f0d24009ca0 tx=0x7f0d2402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 -- 172.21.15.70:0/1707964136 shutdown_connections 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 --2- 172.21.15.70:0/1707964136 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 0x7f0d2c109d50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 --2- 172.21.15.70:0/1707964136 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2c104fd0 0x7f0d2c1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 --2- 172.21.15.70:0/1707964136 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c1026a0 0x7f0d2c104a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 -- 172.21.15.70:0/1707964136 >> 172.21.15.70:0/1707964136 conn(0x7f0d2c0fc2a0 msgr2=0x7f0d2c0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 -- 172.21.15.70:0/1707964136 shutdown_connections 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.108+0000 7f0d32995640 1 -- 172.21.15.70:0/1707964136 wait complete. 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d32995640 1 Processor -- start 2024-09-19T04:30:23.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d32995640 1 -- start start 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d32995640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2c1026a0 0x7f0d2c197e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d32995640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c104fd0 0x7f0d2c1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d32995640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 0x7f0d2c19f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d32995640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c10d880 con 0x7f0d2c107900 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d32995640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c10d700 con 0x7f0d2c104fd0 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d32995640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2c10da00 con 0x7f0d2c1026a0 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d30f32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 0x7f0d2c19f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d30f32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 0x7f0d2c19f440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35138/0 (socket says 172.21.15.70:35138) 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d30f32640 1 -- 172.21.15.70:0/2175455880 learned_addr learned my addr 172.21.15.70:0/2175455880 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.109+0000 7f0d2b7fe640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c104fd0 0x7f0d2c1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d2bfff640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2c1026a0 0x7f0d2c197e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d30f32640 1 -- 172.21.15.70:0/2175455880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2c1026a0 msgr2=0x7f0d2c197e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:23.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d30f32640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2c1026a0 0x7f0d2c197e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d30f32640 1 -- 172.21.15.70:0/2175455880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c104fd0 msgr2=0x7f0d2c1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d30f32640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c104fd0 0x7f0d2c1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d30f32640 1 -- 172.21.15.70:0/2175455880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2c19fab0 con 0x7f0d2c107900 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d2bfff640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2c1026a0 0x7f0d2c197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d30f32640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 0x7f0d2c19f440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0d24004ad0 tx=0x7f0d2402f450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d297fa640 1 -- 172.21.15.70:0/2175455880 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d24003cf0 con 0x7f0d2c107900 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d297fa640 1 -- 172.21.15.70:0/2175455880 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0d24004510 con 0x7f0d2c107900 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d297fa640 1 -- 172.21.15.70:0/2175455880 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2402fd10 con 0x7f0d2c107900 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2c19fd40 con 0x7f0d2c107900 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.110+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2c1a0220 con 0x7f0d2c107900 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.111+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d2c0fdd90 con 0x7f0d2c107900 2024-09-19T04:30:23.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.112+0000 7f0d297fa640 1 -- 172.21.15.70:0/2175455880 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f0d24004040 con 0x7f0d2c107900 2024-09-19T04:30:23.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.113+0000 7f0d297fa640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0d140a3300 0x7f0d140a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:23.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.113+0000 7f0d2bfff640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0d140a3300 0x7f0d140a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:23.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.113+0000 7f0d297fa640 1 -- 172.21.15.70:0/2175455880 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f0d240f0f60 con 0x7f0d2c107900 2024-09-19T04:30:23.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.113+0000 7f0d2bfff640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0d140a3300 0x7f0d140a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0058c0 tx=0x7f0d1c005850 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:23.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.117+0000 7f0d297fa640 1 -- 172.21.15.70:0/2175455880 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0d24004330 con 0x7f0d2c107900 2024-09-19T04:30:23.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.291+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7f0d2c062630 con 0x7f0d140a3300 2024-09-19T04:30:23.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.302+0000 7f0d297fa640 1 -- 172.21.15.70:0/2175455880 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4154 (secure 0 0 0) 0x7f0d2c062630 con 0x7f0d140a3300 2024-09-19T04:30:23.304 INFO:teuthology.orchestra.run.smithi070.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-09-19T04:30:23.304 INFO:teuthology.orchestra.run.smithi070.stdout:mds.a smithi070 running (93s) 16s ago 93s 15.7M - 19.1.1-361-g2f599a46 d2baa855c067 3392ae3361d7 2024-09-19T04:30:23.304 INFO:teuthology.orchestra.run.smithi070.stdout:mds.b smithi134 running (91s) 23s ago 90s 25.9M - 19.1.1-361-g2f599a46 d2baa855c067 28ec9eeea494 2024-09-19T04:30:23.304 INFO:teuthology.orchestra.run.smithi070.stdout:mds.c smithi167 running (104s) 23s ago 104s 16.1M - 19.1.1-361-g2f599a46 d2baa855c067 d11fa244cb39 2024-09-19T04:30:23.304 INFO:teuthology.orchestra.run.smithi070.stdout:mds.d smithi070 running (112s) 16s ago 111s 13.3M - 19.1.1-361-g2f599a46 d2baa855c067 8968a2ee3f41 2024-09-19T04:30:23.304 INFO:teuthology.orchestra.run.smithi070.stdout:mds.e smithi134 running (109s) 23s ago 109s 19.4M - 19.1.1-361-g2f599a46 d2baa855c067 94ad4b08ce31 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mds.f smithi167 running (107s) 23s ago 106s 15.9M - 19.1.1-361-g2f599a46 d2baa855c067 4a0ecc9ccf68 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mds.g smithi070 running (96s) 16s ago 96s 13.5M - 19.1.1-361-g2f599a46 d2baa855c067 5baf0eb5de1e 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mds.h smithi134 running (102s) 23s ago 101s 18.3M - 19.1.1-361-g2f599a46 d2baa855c067 47d6773c6ecb 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mds.i smithi167 running (99s) 23s ago 99s 17.9M - 19.1.1-361-g2f599a46 d2baa855c067 eef0be9bfff3 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mds.j smithi070 running (115s) 16s ago 115s 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 f3e72a5f4ed0 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mds.k smithi134 running (118s) 23s ago 118s 14.5M - 19.1.1-361-g2f599a46 d2baa855c067 ef11b2d346f0 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mds.l smithi167 running (2m) 23s ago 2m 16.7M - 19.1.1-361-g2f599a46 d2baa855c067 3c554b56acb6 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.x smithi070 *:9283,8765 running (8m) 16s ago 8m 508M - 19.1.1-361-g2f599a46 d2baa855c067 4ca48c3ce5fe 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.y smithi134 *:8443,8765 running (7m) 23s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 b89878a339b4 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mgr.z smithi167 *:8443,8765 running (7m) 23s ago 7m 442M - 19.1.1-361-g2f599a46 d2baa855c067 09e530864937 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mon.a smithi070 running (8m) 16s ago 8m 53.8M 2048M 19.1.1-361-g2f599a46 d2baa855c067 c4cdef64a225 2024-09-19T04:30:23.305 INFO:teuthology.orchestra.run.smithi070.stdout:mon.b smithi134 running (7m) 23s ago 7m 42.5M 2048M 19.1.1-361-g2f599a46 d2baa855c067 1db1e0a005e9 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:mon.c smithi167 running (7m) 23s ago 7m 44.3M 2048M 19.1.1-361-g2f599a46 d2baa855c067 a37b07fe580f 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 smithi070 running (6m) 16s ago 6m 57.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 fe2bbc7e6299 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 smithi134 running (6m) 23s ago 6m 48.9M 4272M 19.1.1-361-g2f599a46 d2baa855c067 6e78dfd1ade4 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 smithi167 running (6m) 23s ago 6m 52.2M 4272M 19.1.1-361-g2f599a46 d2baa855c067 34c5acfb9336 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 smithi070 running (5m) 16s ago 5m 57.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 678b585f6242 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 smithi134 running (5m) 23s ago 5m 51.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 c0ce70173feb 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 smithi167 running (4m) 23s ago 4m 48.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 1558ee63bfa5 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 smithi070 running (4m) 16s ago 4m 44.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 3c284c62d177 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 smithi134 running (3m) 23s ago 3m 46.5M 4272M 19.1.1-361-g2f599a46 d2baa855c067 b1baa1131503 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 smithi167 running (3m) 23s ago 3m 47.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 eb0586fcea16 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 smithi070 running (3m) 16s ago 3m 46.8M 4272M 19.1.1-361-g2f599a46 d2baa855c067 418432e808e6 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 smithi134 running (2m) 23s ago 2m 53.0M 4272M 19.1.1-361-g2f599a46 d2baa855c067 e7ef8d09ac62 2024-09-19T04:30:23.306 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 smithi167 running (2m) 23s ago 2m 53.4M 4272M 19.1.1-361-g2f599a46 d2baa855c067 27bc416fc689 2024-09-19T04:30:23.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0d140a3300 msgr2=0x7f0d140a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:23.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0d140a3300 0x7f0d140a57c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c0058c0 tx=0x7f0d1c005850 comp rx=0 tx=0).stop 2024-09-19T04:30:23.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 msgr2=0x7f0d2c19f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:23.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 0x7f0d2c19f440 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f0d24004ad0 tx=0x7f0d2402f450 comp rx=0 tx=0).stop 2024-09-19T04:30:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 shutdown_connections 2024-09-19T04:30:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f0d140a3300 0x7f0d140a57c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0d2c107900 0x7f0d2c19f440 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c104fd0 0x7f0d2c1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 --2- 172.21.15.70:0/2175455880 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0d2c1026a0 0x7f0d2c197e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 >> 172.21.15.70:0/2175455880 conn(0x7f0d2c0fc2a0 msgr2=0x7f0d2c102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 shutdown_connections 2024-09-19T04:30:23.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:23.305+0000 7f0d32995640 1 -- 172.21.15.70:0/2175455880 wait complete. 2024-09-19T04:30:23.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:23 smithi134 ceph-mon[34525]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:23 smithi070 ceph-mon[30942]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:23.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:23 smithi167 ceph-mon[34339]: from='client.15012 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:24.021 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch ls' 2024-09-19T04:30:24.266 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:24 smithi070 ceph-mon[30942]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:24.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:24 smithi070 ceph-mon[30942]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:24.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 -- 172.21.15.70:0/1335241227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0100b10 msgr2=0x7fb5a0100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:24.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 --2- 172.21.15.70:0/1335241227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0100b10 0x7fb5a0100f10 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fb598009900 tx=0x7fb59802a410 comp rx=0 tx=0).stop 2024-09-19T04:30:24.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 -- 172.21.15.70:0/1335241227 shutdown_connections 2024-09-19T04:30:24.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 --2- 172.21.15.70:0/1335241227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a01026d0 0x7fb5a0108f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 --2- 172.21.15.70:0/1335241227 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5a0101d10 0x7fb5a0102190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 --2- 172.21.15.70:0/1335241227 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0100b10 0x7fb5a0100f10 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 -- 172.21.15.70:0/1335241227 >> 172.21.15.70:0/1335241227 conn(0x7fb5a00fc2a0 msgr2=0x7fb5a00fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:24.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 -- 172.21.15.70:0/1335241227 shutdown_connections 2024-09-19T04:30:24.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.691+0000 7fb5a7739640 1 -- 172.21.15.70:0/1335241227 wait complete. 2024-09-19T04:30:24.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a7739640 1 Processor -- start 2024-09-19T04:30:24.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a7739640 1 -- start start 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a7739640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5a0100b10 0x7fb5a006b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a7739640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0101d10 0x7fb5a019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a7739640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a01026d0 0x7fb5a019f290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a7739640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a010c7e0 con 0x7fb5a0101d10 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a7739640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a010c660 con 0x7fb5a01026d0 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a7739640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb5a010c960 con 0x7fb5a0100b10 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0101d10 0x7fb5a019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0101d10 0x7fb5a019cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56094/0 (socket says 172.21.15.70:56094) 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 -- 172.21.15.70:0/3725838182 learned_addr learned my addr 172.21.15.70:0/3725838182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a5cd6640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a01026d0 0x7fb5a019f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a54d5640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5a0100b10 0x7fb5a006b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:24.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 -- 172.21.15.70:0/3725838182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5a0100b10 msgr2=0x7fb5a006b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5a0100b10 0x7fb5a006b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 -- 172.21.15.70:0/3725838182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a01026d0 msgr2=0x7fb5a019f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a01026d0 0x7fb5a019f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 -- 172.21.15.70:0/3725838182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb5a019fba0 con 0x7fb5a0101d10 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a54d5640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5a0100b10 0x7fb5a006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a5cd6640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a01026d0 0x7fb5a019f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.692+0000 7fb5a4cd4640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0101d10 0x7fb5a019cc70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb59400c920 tx=0x7fb59400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.693+0000 7fb59e7fc640 1 -- 172.21.15.70:0/3725838182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594007c70 con 0x7fb5a0101d10 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.693+0000 7fb59e7fc640 1 -- 172.21.15.70:0/3725838182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb594007e10 con 0x7fb5a0101d10 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.693+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb5a019fe30 con 0x7fb5a0101d10 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.693+0000 7fb59e7fc640 1 -- 172.21.15.70:0/3725838182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594018850 con 0x7fb5a0101d10 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.693+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb5a01a0360 con 0x7fb5a0101d10 2024-09-19T04:30:24.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.693+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb5a0107f10 con 0x7fb5a0101d10 2024-09-19T04:30:24.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.695+0000 7fb59e7fc640 1 -- 172.21.15.70:0/3725838182 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb594018a10 con 0x7fb5a0101d10 2024-09-19T04:30:24.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.696+0000 7fb59e7fc640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb5880a32d0 0x7fb5880a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:24.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.696+0000 7fb5a54d5640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb5880a32d0 0x7fb5880a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:24.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.696+0000 7fb59e7fc640 1 -- 172.21.15.70:0/3725838182 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fb5940cff20 con 0x7fb5a0101d10 2024-09-19T04:30:24.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.696+0000 7fb5a54d5640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb5880a32d0 0x7fb5880a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb598006010 tx=0x7fb598000bc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:24.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.698+0000 7fb59e7fc640 1 -- 172.21.15.70:0/3725838182 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb594014030 con 0x7fb5a0101d10 2024-09-19T04:30:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:24 smithi134 ceph-mon[34525]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:24.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:24 smithi134 ceph-mon[34525]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:24.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.873+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7fb5a0062630 con 0x7fb5880a32d0 2024-09-19T04:30:24.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.878+0000 7fb59e7fc640 1 -- 172.21.15.70:0/3725838182 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7fb5a0062630 con 0x7fb5880a32d0 2024-09-19T04:30:24.880 INFO:teuthology.orchestra.run.smithi070.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-09-19T04:30:24.880 INFO:teuthology.orchestra.run.smithi070.stdout:mds.all 12/12 25s ago 2m smithi070=a;smithi070=d;smithi070=g;smithi070=j;smithi134=b;smithi134=e;smithi134=h;smithi134=k;smithi167=c;smithi167=f;smithi167=i;smithi167=l;count:12 2024-09-19T04:30:24.880 INFO:teuthology.orchestra.run.smithi070.stdout:mgr 3/3 25s ago 7m smithi070=x;smithi134=y;smithi167=z;count:3 2024-09-19T04:30:24.880 INFO:teuthology.orchestra.run.smithi070.stdout:mon 3/3 25s ago 7m smithi070:172.21.15.70=a;smithi134:172.21.15.134=b;smithi167:172.21.15.167=c;count:3 2024-09-19T04:30:24.880 INFO:teuthology.orchestra.run.smithi070.stdout:osd 12 25s ago - 2024-09-19T04:30:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb5880a32d0 msgr2=0x7fb5880a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:24.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb5880a32d0 0x7fb5880a5790 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb598006010 tx=0x7fb598000bc0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0101d10 msgr2=0x7fb5a019cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0101d10 0x7fb5a019cc70 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fb59400c920 tx=0x7fb59400cde0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 shutdown_connections 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb5880a32d0 0x7fb5880a5790 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5a01026d0 0x7fb5a019f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb5a0101d10 0x7fb5a019cc70 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 --2- 172.21.15.70:0/3725838182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb5a0100b10 0x7fb5a006b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 >> 172.21.15.70:0/3725838182 conn(0x7fb5a00fc2a0 msgr2=0x7fb5a01050e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 shutdown_connections 2024-09-19T04:30:24.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:24.881+0000 7fb5a7739640 1 -- 172.21.15.70:0/3725838182 wait complete. 2024-09-19T04:30:24.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:24 smithi167 ceph-mon[34339]: from='client.15018 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:24.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:24 smithi167 ceph-mon[34339]: pgmap v316: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:25.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch host ls' 2024-09-19T04:30:25.810 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:26.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 -- 172.21.15.70:0/2935723128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c100ad0 msgr2=0x7f6b3c100ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 --2- 172.21.15.70:0/2935723128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c100ad0 0x7f6b3c100ed0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f6b30009900 tx=0x7f6b3002a410 comp rx=0 tx=0).stop 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 -- 172.21.15.70:0/2935723128 shutdown_connections 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 --2- 172.21.15.70:0/2935723128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b3c102690 0x7f6b3c108f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 --2- 172.21.15.70:0/2935723128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b3c101cd0 0x7f6b3c102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 --2- 172.21.15.70:0/2935723128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c100ad0 0x7f6b3c100ed0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 -- 172.21.15.70:0/2935723128 >> 172.21.15.70:0/2935723128 conn(0x7f6b3c0fc280 msgr2=0x7f6b3c0fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 -- 172.21.15.70:0/2935723128 shutdown_connections 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.300+0000 7f6b41438640 1 -- 172.21.15.70:0/2935723128 wait complete. 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b41438640 1 Processor -- start 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b41438640 1 -- start start 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b41438640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b3c100ad0 0x7f6b3c197fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:26.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b41438640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c101cd0 0x7f6b3c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b41438640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b3c102690 0x7f6b3c19f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b41438640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c10c7a0 con 0x7f6b3c101cd0 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b41438640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c10c620 con 0x7f6b3c102690 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b41438640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6b3c10c920 con 0x7f6b3c100ad0 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b3a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c101cd0 0x7f6b3c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b3a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c101cd0 0x7f6b3c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56106/0 (socket says 172.21.15.70:56106) 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.301+0000 7f6b3a7fc640 1 -- 172.21.15.70:0/3214010210 learned_addr learned my addr 172.21.15.70:0/3214010210 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3affd640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b3c100ad0 0x7f6b3c197fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3b7fe640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b3c102690 0x7f6b3c19f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3a7fc640 1 -- 172.21.15.70:0/3214010210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b3c100ad0 msgr2=0x7f6b3c197fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3a7fc640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b3c100ad0 0x7f6b3c197fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3a7fc640 1 -- 172.21.15.70:0/3214010210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b3c102690 msgr2=0x7f6b3c19f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:26.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3a7fc640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b3c102690 0x7f6b3c19f5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3a7fc640 1 -- 172.21.15.70:0/3214010210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b3c19fc10 con 0x7f6b3c101cd0 2024-09-19T04:30:26.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3affd640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b3c100ad0 0x7f6b3c197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:26.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b3a7fc640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c101cd0 0x7f6b3c198520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00b4a0 tx=0x7f6b2c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:26.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b23fff640 1 -- 172.21.15.70:0/3214010210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c014070 con 0x7f6b3c101cd0 2024-09-19T04:30:26.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b3c19ff00 con 0x7f6b3c101cd0 2024-09-19T04:30:26.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b23fff640 1 -- 172.21.15.70:0/3214010210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6b2c010ae0 con 0x7f6b3c101cd0 2024-09-19T04:30:26.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b23fff640 1 -- 172.21.15.70:0/3214010210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b2c017c70 con 0x7f6b3c101cd0 2024-09-19T04:30:26.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.302+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b3c1a0430 con 0x7f6b3c101cd0 2024-09-19T04:30:26.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.303+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b3c1a06c0 con 0x7f6b3c101cd0 2024-09-19T04:30:26.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.305+0000 7f6b23fff640 1 -- 172.21.15.70:0/3214010210 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f6b2c017070 con 0x7f6b3c101cd0 2024-09-19T04:30:26.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.306+0000 7f6b23fff640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6b240a3300 0x7f6b240a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:26.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.306+0000 7f6b3affd640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6b240a3300 0x7f6b240a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:26.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.306+0000 7f6b23fff640 1 -- 172.21.15.70:0/3214010210 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f6b2c0ced30 con 0x7f6b3c101cd0 2024-09-19T04:30:26.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.306+0000 7f6b3affd640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6b240a3300 0x7f6b240a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000c00 tx=0x7f6b30031510 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:26.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.310+0000 7f6b23fff640 1 -- 172.21.15.70:0/3214010210 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6b2c0d3070 con 0x7f6b3c101cd0 2024-09-19T04:30:26.506 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:26 smithi070 ceph-mon[30942]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:26.507 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:26 smithi070 ceph-mon[30942]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:26.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.504+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7f6b3c1a0890 con 0x7f6b240a3300 2024-09-19T04:30:26.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.506+0000 7f6b23fff640 1 -- 172.21.15.70:0/3214010210 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7f6b3c1a0890 con 0x7f6b240a3300 2024-09-19T04:30:26.508 INFO:teuthology.orchestra.run.smithi070.stdout:HOST ADDR LABELS STATUS 2024-09-19T04:30:26.508 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 172.21.15.70 2024-09-19T04:30:26.508 INFO:teuthology.orchestra.run.smithi070.stdout:smithi134 172.21.15.134 2024-09-19T04:30:26.509 INFO:teuthology.orchestra.run.smithi070.stdout:smithi167 172.21.15.167 2024-09-19T04:30:26.509 INFO:teuthology.orchestra.run.smithi070.stdout:3 hosts in cluster 2024-09-19T04:30:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6b240a3300 msgr2=0x7f6b240a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:26.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6b240a3300 0x7f6b240a57c0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6b30000c00 tx=0x7f6b30031510 comp rx=0 tx=0).stop 2024-09-19T04:30:26.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c101cd0 msgr2=0x7f6b3c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:26.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c101cd0 0x7f6b3c198520 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f6b2c00b4a0 tx=0x7f6b2c00b960 comp rx=0 tx=0).stop 2024-09-19T04:30:26.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 shutdown_connections 2024-09-19T04:30:26.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f6b240a3300 0x7f6b240a57c0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b3c102690 0x7f6b3c19f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b3c101cd0 0x7f6b3c198520 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 --2- 172.21.15.70:0/3214010210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b3c100ad0 0x7f6b3c197fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:26.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 >> 172.21.15.70:0/3214010210 conn(0x7f6b3c0fc280 msgr2=0x7f6b3c06a020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:26.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 shutdown_connections 2024-09-19T04:30:26.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:26.508+0000 7f6b41438640 1 -- 172.21.15.70:0/3214010210 wait complete. 2024-09-19T04:30:26.763 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:26 smithi167 ceph-mon[34339]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:26.763 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:26 smithi167 ceph-mon[34339]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:26.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:26 smithi134 ceph-mon[34525]: from='client.15024 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:26.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:26 smithi134 ceph-mon[34525]: pgmap v317: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:27.144 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- bash -c 'ceph orch device ls' 2024-09-19T04:30:27.394 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:27.770 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:27 smithi070 ceph-mon[30942]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:27.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:27 smithi134 ceph-mon[34525]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 -- 172.21.15.70:0/249803513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 msgr2=0x7ffb50108f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 --2- 172.21.15.70:0/249803513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 0x7ffb50108f20 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009ca0 tx=0x7ffb4802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:30:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 -- 172.21.15.70:0/249803513 shutdown_connections 2024-09-19T04:30:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 --2- 172.21.15.70:0/249803513 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 0x7ffb50108f20 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 --2- 172.21.15.70:0/249803513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb50101cd0 0x7ffb50102150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 --2- 172.21.15.70:0/249803513 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb50100ad0 0x7ffb50100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 -- 172.21.15.70:0/249803513 >> 172.21.15.70:0/249803513 conn(0x7ffb500fc280 msgr2=0x7ffb500fe6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:27.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 -- 172.21.15.70:0/249803513 shutdown_connections 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 -- 172.21.15.70:0/249803513 wait complete. 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 Processor -- start 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.850+0000 7ffb58789640 1 -- start start 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb58789640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb50100ad0 0x7ffb50197ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb58789640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb50101cd0 0x7ffb50198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb58789640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 0x7ffb5019f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb58789640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5010c7c0 con 0x7ffb50102690 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb58789640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5010c640 con 0x7ffb50100ad0 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb58789640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb5010c940 con 0x7ffb50101cd0 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 0x7ffb5019f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 0x7ffb5019f4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56124/0 (socket says 172.21.15.70:56124) 2024-09-19T04:30:27.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 -- 172.21.15.70:0/890358591 learned_addr learned my addr 172.21.15.70:0/890358591 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb55d24640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb50101cd0 0x7ffb50198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56525640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb50100ad0 0x7ffb50197ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 -- 172.21.15.70:0/890358591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb50101cd0 msgr2=0x7ffb50198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb50101cd0 0x7ffb50198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 -- 172.21.15.70:0/890358591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb50100ad0 msgr2=0x7ffb50197ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb50100ad0 0x7ffb50197ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 -- 172.21.15.70:0/890358591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb5019fb10 con 0x7ffb50102690 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb55d24640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb50101cd0 0x7ffb50198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb56d26640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 0x7ffb5019f4a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009430 tx=0x7ffb4802f380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb477fe640 1 -- 172.21.15.70:0/890358591 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb48003bf0 con 0x7ffb50102690 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb5019fda0 con 0x7ffb50102690 2024-09-19T04:30:27.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.851+0000 7ffb477fe640 1 -- 172.21.15.70:0/890358591 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ffb48003d90 con 0x7ffb50102690 2024-09-19T04:30:27.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.852+0000 7ffb477fe640 1 -- 172.21.15.70:0/890358591 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb4802fbf0 con 0x7ffb50102690 2024-09-19T04:30:27.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.852+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb501a0330 con 0x7ffb50102690 2024-09-19T04:30:27.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.852+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffb50100ed0 con 0x7ffb50102690 2024-09-19T04:30:27.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.854+0000 7ffb477fe640 1 -- 172.21.15.70:0/890358591 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7ffb48004b40 con 0x7ffb50102690 2024-09-19T04:30:27.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.855+0000 7ffb477fe640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffb3c0a3380 0x7ffb3c0a5840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:27.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.855+0000 7ffb56525640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffb3c0a3380 0x7ffb3c0a5840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:27.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.855+0000 7ffb477fe640 1 -- 172.21.15.70:0/890358591 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7ffb480f0e80 con 0x7ffb50102690 2024-09-19T04:30:27.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.855+0000 7ffb56525640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffb3c0a3380 0x7ffb3c0a5840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb50101b30 tx=0x7ffb4c005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:27.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:27.858+0000 7ffb477fe640 1 -- 172.21.15.70:0/890358591 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ffb480bdc10 con 0x7ffb50102690 2024-09-19T04:30:27.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:27 smithi167 ceph-mon[34339]: from='client.15030 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:28.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.032+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 --> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7ffb5006a680 con 0x7ffb3c0a3380 2024-09-19T04:30:28.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.034+0000 7ffb477fe640 1 -- 172.21.15.70:0/890358591 <== mgr.14148 v2:172.21.15.70:6800/4212188848 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7ffb5006a680 con 0x7ffb3c0a3380 2024-09-19T04:30:28.036 INFO:teuthology.orchestra.run.smithi070.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-09-19T04:30:28.036 INFO:teuthology.orchestra.run.smithi070.stdout:smithi070 /dev/nvme0n1 ssd INTEL_SSDPED1D480GA_PHMB7513002P480DGN 447G No 3m ago Has a FileSystem, LVM detected 2024-09-19T04:30:28.036 INFO:teuthology.orchestra.run.smithi070.stdout:smithi134 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62420002400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T04:30:28.036 INFO:teuthology.orchestra.run.smithi070.stdout:smithi167 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT62330080400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-09-19T04:30:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffb3c0a3380 msgr2=0x7ffb3c0a5840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:28.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffb3c0a3380 0x7ffb3c0a5840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7ffb50101b30 tx=0x7ffb4c005f90 comp rx=0 tx=0).stop 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 msgr2=0x7ffb5019f4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 0x7ffb5019f4a0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ffb48009430 tx=0x7ffb4802f380 comp rx=0 tx=0).stop 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 shutdown_connections 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7ffb3c0a3380 0x7ffb3c0a5840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb50102690 0x7ffb5019f4a0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb50101cd0 0x7ffb50198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 --2- 172.21.15.70:0/890358591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb50100ad0 0x7ffb50197ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 >> 172.21.15.70:0/890358591 conn(0x7ffb500fc280 msgr2=0x7ffb50069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 shutdown_connections 2024-09-19T04:30:28.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:28.037+0000 7ffb58789640 1 -- 172.21.15.70:0/890358591 wait complete. 2024-09-19T04:30:28.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:28 smithi070 ceph-mon[30942]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:28.734 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-09-19T04:30:28.743 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:30:28.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- bash -c 'ceph fs dump' 2024-09-19T04:30:28.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:28 smithi134 ceph-mon[34525]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:28.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:28 smithi167 ceph-mon[34339]: pgmap v318: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:28.989 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- 172.21.15.70:0/636201930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641037c0 msgr2=0x7f746410a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 --2- 172.21.15.70:0/636201930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641037c0 0x7f746410a050 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f745c009ca0 tx=0x7f745c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- 172.21.15.70:0/636201930 shutdown_connections 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 --2- 172.21.15.70:0/636201930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74641037c0 0x7f746410a050 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 --2- 172.21.15.70:0/636201930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7464102e00 0x7f7464103280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 --2- 172.21.15.70:0/636201930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7464101c00 0x7f7464102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- 172.21.15.70:0/636201930 >> 172.21.15.70:0/636201930 conn(0x7f74640fd3b0 msgr2=0x7f74640ff7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- 172.21.15.70:0/636201930 shutdown_connections 2024-09-19T04:30:29.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- 172.21.15.70:0/636201930 wait complete. 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 Processor -- start 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- start start 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7464101c00 0x7f7464197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7464102e00 0x7f7464198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74641037c0 0x7f746419f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f746410d860 con 0x7f7464102e00 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f746410d6e0 con 0x7f7464101c00 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f746a5d6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f746410d9e0 con 0x7f74641037c0 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.448+0000 7f745bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7464102e00 0x7f7464198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f745bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7464102e00 0x7f7464198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56138/0 (socket says 172.21.15.70:56138) 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f745bfff640 1 -- 172.21.15.70:0/1546784078 learned_addr learned my addr 172.21.15.70:0/1546784078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:29.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f7463fff640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7464101c00 0x7f7464197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f7468b73640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74641037c0 0x7f746419f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f745bfff640 1 -- 172.21.15.70:0/1546784078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74641037c0 msgr2=0x7f746419f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f745bfff640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74641037c0 0x7f746419f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f745bfff640 1 -- 172.21.15.70:0/1546784078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7464101c00 msgr2=0x7f7464197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f745bfff640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7464101c00 0x7f7464197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f745bfff640 1 -- 172.21.15.70:0/1546784078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f746419fa00 con 0x7f7464102e00 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f745bfff640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7464102e00 0x7f7464198310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f744c00d950 tx=0x7f744c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f7461ffb640 1 -- 172.21.15.70:0/1546784078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c017070 con 0x7f7464102e00 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f746419fcf0 con 0x7f7464102e00 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f7461ffb640 1 -- 172.21.15.70:0/1546784078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f744c009c30 con 0x7f7464102e00 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f7461ffb640 1 -- 172.21.15.70:0/1546784078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f744c00f6b0 con 0x7f7464102e00 2024-09-19T04:30:29.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.449+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74641a0220 con 0x7f7464102e00 2024-09-19T04:30:29.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.450+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7464108f30 con 0x7f7464102e00 2024-09-19T04:30:29.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.451+0000 7f7461ffb640 1 -- 172.21.15.70:0/1546784078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f744c010a50 con 0x7f7464102e00 2024-09-19T04:30:29.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.452+0000 7f7461ffb640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f74500a3300 0x7f74500a57c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:29.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.452+0000 7f7463fff640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f74500a3300 0x7f74500a57c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:29.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.452+0000 7f7461ffb640 1 -- 172.21.15.70:0/1546784078 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f744c0cf5c0 con 0x7f7464102e00 2024-09-19T04:30:29.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.452+0000 7f7463fff640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f74500a3300 0x7f74500a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7464102c60 tx=0x7f7454005f90 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:29.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.456+0000 7f7461ffb640 1 -- 172.21.15.70:0/1546784078 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f744c09bb60 con 0x7f7464102e00 2024-09-19T04:30:29.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:29 smithi070 ceph-mon[30942]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:29.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.663+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f746402d9b0 con 0x7f7464102e00 2024-09-19T04:30:29.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.663+0000 7f7461ffb640 1 -- 172.21.15.70:0/1546784078 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 23 v23) ==== 76+0+3088 (secure 0 0 0) 0x7f744c09fe60 con 0x7f7464102e00 2024-09-19T04:30:29.665 INFO:teuthology.orchestra.run.smithi070.stdout:e23 2024-09-19T04:30:29.665 INFO:teuthology.orchestra.run.smithi070.stdout:btime 2024-09-19T04:29:14:453215+0000 2024-09-19T04:30:29.665 INFO:teuthology.orchestra.run.smithi070.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-09-19T04:30:29.665 INFO:teuthology.orchestra.run.smithi070.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:30:29.665 INFO:teuthology.orchestra.run.smithi070.stdout:legacy client fscid: 1 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:Filesystem 'cephfs' (1) 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:fs_name cephfs 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 23 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-19T04:29:02.989107+0000 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-19T04:29:14.027648+0000 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:tableserver 0 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:root 0 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:session_timeout 300 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:session_autoclose 300 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:max_file_size 1099511627776 2024-09-19T04:30:29.666 INFO:teuthology.orchestra.run.smithi070.stdout:max_xattr_size 65536 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:required_client_features {} 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure 0 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:last_failure_osd_epoch 0 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:max_mds 3 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:in 0,1,2 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:up {0=24470,1=24452,2=24433} 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:failed 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:damaged 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:stopped 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:data_pools [3] 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:metadata_pool 2 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:inline_data disabled 2024-09-19T04:30:29.667 INFO:teuthology.orchestra.run.smithi070.stdout:balancer 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:bal_rank_mask -1 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:standby_count_wanted 0 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:qdb_cluster leader: 24470 members: 24433,24452,24470 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.b{0:24470} state up:active seq 4 addr [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.e{0:24428} state up:standby-replay seq 1 addr [v2:172.21.15.134:6834/1711007693,v1:172.21.15.134:6835/1711007693] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.h{1:24452} state up:active seq 9 addr [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.c{1:24418} state up:standby-replay seq 1 addr [v2:172.21.15.167:6836/3495956228,v1:172.21.15.167:6837/3495956228] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.i{2:24433} state up:active seq 8 addr [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.f{2:24412} state up:standby-replay seq 1 addr [v2:172.21.15.167:6834/3330741295,v1:172.21.15.167:6835/3330741295] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:Standby daemons: 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:29.668 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.j{-1:14544} state up:standby seq 1 addr [v2:172.21.15.70:6834/1596262416,v1:172.21.15.70:6835/1596262416] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.669 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.d{-1:14556} state up:standby seq 1 addr [v2:172.21.15.70:6836/53186803,v1:172.21.15.70:6837/53186803] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.669 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.g{-1:14598} state up:standby seq 1 addr [v2:172.21.15.70:6838/302466091,v1:172.21.15.70:6839/302466091] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.669 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.a{-1:14610} state up:standby seq 1 addr [v2:172.21.15.70:6840/3197291261,v1:172.21.15.70:6841/3197291261] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.669 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.l{-1:24391} state up:standby seq 1 addr [v2:172.21.15.167:6832/460081986,v1:172.21.15.167:6833/460081986] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.669 INFO:teuthology.orchestra.run.smithi070.stdout:[mds.k{-1:24407} state up:standby seq 1 addr [v2:172.21.15.134:6832/2796874112,v1:172.21.15.134:6833/2796874112] compat {c=[1],r=[1],i=[1fff]}] 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 23 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.665+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f74500a3300 msgr2=0x7f74500a57c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.665+0000 7f746a5d6640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f74500a3300 0x7f74500a57c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7464102c60 tx=0x7f7454005f90 comp rx=0 tx=0).stop 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.665+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7464102e00 msgr2=0x7f7464198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.665+0000 7f746a5d6640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7464102e00 0x7f7464198310 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f744c00d950 tx=0x7f744c00de10 comp rx=0 tx=0).stop 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.665+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 shutdown_connections 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.665+0000 7f746a5d6640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f74500a3300 0x7f74500a57c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.666+0000 7f746a5d6640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74641037c0 0x7f746419f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.666+0000 7f746a5d6640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7464102e00 0x7f7464198310 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.666+0000 7f746a5d6640 1 --2- 172.21.15.70:0/1546784078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7464101c00 0x7f7464197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.666+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 >> 172.21.15.70:0/1546784078 conn(0x7f74640fd3b0 msgr2=0x7f7464106100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:29.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.666+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 shutdown_connections 2024-09-19T04:30:29.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:29.666+0000 7f746a5d6640 1 -- 172.21.15.70:0/1546784078 wait complete. 2024-09-19T04:30:29.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:29 smithi134 ceph-mon[34525]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:29.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:29 smithi167 ceph-mon[34339]: from='client.15036 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:30.326 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- bash -c 'ceph osd dump' 2024-09-19T04:30:30.577 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:30 smithi134 ceph-mon[34525]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:30 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1546784078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:30:30.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:30 smithi070 ceph-mon[30942]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:30.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:30 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1546784078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:30:30.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:30 smithi167 ceph-mon[34339]: pgmap v319: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:30 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1546784078' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-09-19T04:30:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 -- 172.21.15.70:0/2637598400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac1026a0 msgr2=0x7f52ac104a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 --2- 172.21.15.70:0/2637598400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac1026a0 0x7f52ac104a90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f52a8009900 tx=0x7f52a802a410 comp rx=0 tx=0).stop 2024-09-19T04:30:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 -- 172.21.15.70:0/2637598400 shutdown_connections 2024-09-19T04:30:31.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 --2- 172.21.15.70:0/2637598400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac107900 0x7f52ac109d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 --2- 172.21.15.70:0/2637598400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac104fd0 0x7f52ac1073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 --2- 172.21.15.70:0/2637598400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac1026a0 0x7f52ac104a90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 -- 172.21.15.70:0/2637598400 >> 172.21.15.70:0/2637598400 conn(0x7f52ac0fc2a0 msgr2=0x7f52ac0fe6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 -- 172.21.15.70:0/2637598400 shutdown_connections 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.013+0000 7f52b3f90640 1 -- 172.21.15.70:0/2637598400 wait complete. 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b3f90640 1 Processor -- start 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b3f90640 1 -- start start 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b3f90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac1026a0 0x7f52ac102000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b3f90640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac104fd0 0x7f52ac100650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b3f90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac107900 0x7f52ac100b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b3f90640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac10d8a0 con 0x7f52ac107900 2024-09-19T04:30:31.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b3f90640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac10d720 con 0x7f52ac104fd0 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b3f90640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52ac10da20 con 0x7f52ac1026a0 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac107900 0x7f52ac100b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac107900 0x7f52ac100b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56154/0 (socket says 172.21.15.70:56154) 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 -- 172.21.15.70:0/1210894898 learned_addr learned my addr 172.21.15.70:0/1210894898 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b152b640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac104fd0 0x7f52ac100650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b1d2c640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac1026a0 0x7f52ac102000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 -- 172.21.15.70:0/1210894898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac1026a0 msgr2=0x7f52ac102000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac1026a0 0x7f52ac102000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 -- 172.21.15.70:0/1210894898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac104fd0 msgr2=0x7f52ac100650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac104fd0 0x7f52ac100650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 -- 172.21.15.70:0/1210894898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ac101450 con 0x7f52ac107900 2024-09-19T04:30:31.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.014+0000 7f52b252d640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac107900 0x7f52ac100b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52a400cad0 tx=0x7f52a400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.015+0000 7f52a2ffd640 1 -- 172.21.15.70:0/1210894898 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a400ae20 con 0x7f52ac107900 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.015+0000 7f52a2ffd640 1 -- 172.21.15.70:0/1210894898 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f52a4005020 con 0x7f52ac107900 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.015+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ac1a20e0 con 0x7f52ac107900 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.015+0000 7f52a2ffd640 1 -- 172.21.15.70:0/1210894898 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52a400f690 con 0x7f52ac107900 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.015+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ac1a25a0 con 0x7f52ac107900 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.016+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ac0fdd90 con 0x7f52ac107900 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.017+0000 7f52a2ffd640 1 -- 172.21.15.70:0/1210894898 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f52a40051d0 con 0x7f52ac107900 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.017+0000 7f52a2ffd640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f52980a32d0 0x7f52980a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.018+0000 7f52a2ffd640 1 -- 172.21.15.70:0/1210894898 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f52a40cfb40 con 0x7f52ac107900 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.018+0000 7f52b1d2c640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f52980a32d0 0x7f52980a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.018+0000 7f52b1d2c640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f52980a32d0 0x7f52980a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52a8031570 tx=0x7f52a8031cc0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:31.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.022+0000 7f52a2ffd640 1 -- 172.21.15.70:0/1210894898 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52a4014030 con 0x7f52ac107900 2024-09-19T04:30:31.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.189+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7f52ac062df0 con 0x7f52ac107900 2024-09-19T04:30:31.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.190+0000 7f52a2ffd640 1 -- 172.21.15.70:0/1210894898 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v83) ==== 56+0+5259 (secure 0 0 0) 0x7f52a409c6d0 con 0x7f52ac107900 2024-09-19T04:30:31.191 INFO:teuthology.orchestra.run.smithi070.stdout:epoch 83 2024-09-19T04:30:31.191 INFO:teuthology.orchestra.run.smithi070.stdout:fsid 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:30:31.191 INFO:teuthology.orchestra.run.smithi070.stdout:created 2024-09-19T04:21:29.503052+0000 2024-09-19T04:30:31.191 INFO:teuthology.orchestra.run.smithi070.stdout:modified 2024-09-19T04:29:18.471871+0000 2024-09-19T04:30:31.191 INFO:teuthology.orchestra.run.smithi070.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-09-19T04:30:31.191 INFO:teuthology.orchestra.run.smithi070.stdout:crush_version 26 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:full_ratio 0.95 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:backfillfull_ratio 0.9 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:nearfull_ratio 0.85 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:require_min_compat_client luminous 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:min_compat_client luminous 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:require_osd_release squid 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:stretch_mode_enabled false 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.9 application cephfs read_balance_score 1.50 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:max_osd 12 2024-09-19T04:30:31.192 INFO:teuthology.orchestra.run.smithi070.stdout:osd.0 up in weight 1 up_from 8 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6802/1173006577,v1:172.21.15.70:6803/1173006577] [v2:172.21.15.70:6804/1173006577,v1:172.21.15.70:6805/1173006577] exists,up 4f4e9a42-7846-4760-aaa3-fd08543625d3 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.1 up in weight 1 up_from 13 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6800/3268047050,v1:172.21.15.134:6801/3268047050] [v2:172.21.15.134:6802/3268047050,v1:172.21.15.134:6803/3268047050] exists,up cbfe06a1-eca7-4785-8b9e-89a170a13ea2 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.2 up in weight 1 up_from 18 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6800/2534409375,v1:172.21.15.167:6801/2534409375] [v2:172.21.15.167:6802/2534409375,v1:172.21.15.167:6803/2534409375] exists,up d4529395-6d0b-43a9-ab1c-00c5588e4bab 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.3 up in weight 1 up_from 25 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6810/1314792763,v1:172.21.15.70:6811/1314792763] [v2:172.21.15.70:6812/1314792763,v1:172.21.15.70:6813/1314792763] exists,up 8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.4 up in weight 1 up_from 32 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6808/1442854624,v1:172.21.15.134:6809/1442854624] [v2:172.21.15.134:6810/1442854624,v1:172.21.15.134:6811/1442854624] exists,up 81b280f6-42d4-4e66-91d5-8119a66b7e23 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.5 up in weight 1 up_from 36 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6808/1206537032,v1:172.21.15.167:6809/1206537032] [v2:172.21.15.167:6810/1206537032,v1:172.21.15.167:6811/1206537032] exists,up 4980fc29-7eaf-4f69-a034-1c10dafe1318 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.6 up in weight 1 up_from 43 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6818/1741503048,v1:172.21.15.70:6819/1741503048] [v2:172.21.15.70:6820/1741503048,v1:172.21.15.70:6821/1741503048] exists,up f1b5fe84-82d8-4beb-b050-fc03c492ab85 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.7 up in weight 1 up_from 48 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6816/4280559958,v1:172.21.15.134:6817/4280559958] [v2:172.21.15.134:6818/4280559958,v1:172.21.15.134:6819/4280559958] exists,up ed960d6e-6426-4124-addf-efddb5b1a800 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.8 up in weight 1 up_from 55 up_thru 79 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6816/94770656,v1:172.21.15.167:6817/94770656] [v2:172.21.15.167:6818/94770656,v1:172.21.15.167:6819/94770656] exists,up abb19a65-c197-4a87-a223-38297eb046e9 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.9 up in weight 1 up_from 62 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.70:6826/4029282246,v1:172.21.15.70:6827/4029282246] [v2:172.21.15.70:6828/4029282246,v1:172.21.15.70:6829/4029282246] exists,up 14c34016-a6ec-45d9-8a5a-181af66bd84b 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.10 up in weight 1 up_from 67 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.134:6824/3415319781,v1:172.21.15.134:6825/3415319781] [v2:172.21.15.134:6826/3415319781,v1:172.21.15.134:6827/3415319781] exists,up bfad740c-5443-45df-b7d6-523d91197fe2 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:osd.11 up in weight 1 up_from 75 up_thru 82 down_at 0 last_clean_interval [0,0) [v2:172.21.15.167:6824/986370842,v1:172.21.15.167:6825/986370842] [v2:172.21.15.167:6826/986370842,v1:172.21.15.167:6827/986370842] exists,up c23990f1-2aae-47b0-a906-4075d086633d 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.4 [2,11] 2024-09-19T04:30:31.193 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 2.5 [8,11] 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.6 [3,6] 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.20 [5,9] 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.24 [4,9] 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.34 [4,9] 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:pg_upmap_items 3.3a [4,8] 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/3440627608 expires 2024-09-20T04:22:17.308265+0000 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1218306304 expires 2024-09-20T04:22:17.308265+0000 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/1547748087 expires 2024-09-20T04:21:55.166153+0000 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6801/1492093884 expires 2024-09-20T04:21:55.166153+0000 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2258273209 expires 2024-09-20T04:22:17.308265+0000 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/3440627608 expires 2024-09-20T04:22:17.308265+0000 2024-09-19T04:30:31.194 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2407570280 expires 2024-09-20T04:21:55.166153+0000 2024-09-19T04:30:31.195 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/3192727507 expires 2024-09-20T04:22:17.308265+0000 2024-09-19T04:30:31.195 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:6800/1492093884 expires 2024-09-20T04:21:55.166153+0000 2024-09-19T04:30:31.195 INFO:teuthology.orchestra.run.smithi070.stdout:blocklist 172.21.15.70:0/2647945535 expires 2024-09-20T04:21:55.166153+0000 2024-09-19T04:30:31.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f52980a32d0 msgr2=0x7f52980a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:31.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f52980a32d0 0x7f52980a5790 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f52a8031570 tx=0x7f52a8031cc0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac107900 msgr2=0x7f52ac100b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:31.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac107900 0x7f52ac100b90 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f52a400cad0 tx=0x7f52a400cf90 comp rx=0 tx=0).stop 2024-09-19T04:30:31.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 shutdown_connections 2024-09-19T04:30:31.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f52980a32d0 0x7f52980a5790 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52ac107900 0x7f52ac100b90 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52ac104fd0 0x7f52ac100650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 --2- 172.21.15.70:0/1210894898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52ac1026a0 0x7f52ac102000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:31.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 >> 172.21.15.70:0/1210894898 conn(0x7f52ac0fc2a0 msgr2=0x7f52ac102f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:31.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 shutdown_connections 2024-09-19T04:30:31.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:31.192+0000 7f52b3f90640 1 -- 172.21.15.70:0/1210894898 wait complete. 2024-09-19T04:30:31.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:31 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1210894898' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:30:31.813 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:31 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1210894898' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:30:31.841 INFO:teuthology.run_tasks:Running task fs.ready... 2024-09-19T04:30:31.854 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:30:31.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:31 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1210894898' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-09-19T04:30:32.100 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 -- 172.21.15.70:0/102434267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc101420 msgr2=0x7fe8bc10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 --2- 172.21.15.70:0/102434267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc101420 0x7fe8bc10d950 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fe8b4009cd0 tx=0x7fe8b402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 -- 172.21.15.70:0/102434267 shutdown_connections 2024-09-19T04:30:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 --2- 172.21.15.70:0/102434267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc101420 0x7fe8bc10d950 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 --2- 172.21.15.70:0/102434267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100a80 0x7fe8bc100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 --2- 172.21.15.70:0/102434267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc106a80 0x7fe8bc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 -- 172.21.15.70:0/102434267 >> 172.21.15.70:0/102434267 conn(0x7fe8bc0fc7a0 msgr2=0x7fe8bc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 -- 172.21.15.70:0/102434267 shutdown_connections 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.595+0000 7fe8c3781640 1 -- 172.21.15.70:0/102434267 wait complete. 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c3781640 1 Processor -- start 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c3781640 1 -- start start 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c3781640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100a80 0x7fe8bc198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c3781640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc101420 0x7fe8bc1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c3781640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc106a80 0x7fe8bc19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c3781640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc110e50 con 0x7fe8bc106a80 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c3781640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc110cd0 con 0x7fe8bc100a80 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c3781640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe8bc110fd0 con 0x7fe8bc101420 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c1d1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc106a80 0x7fe8bc19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c1d1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc106a80 0x7fe8bc19cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56160/0 (socket says 172.21.15.70:56160) 2024-09-19T04:30:32.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c1d1e640 1 -- 172.21.15.70:0/1737607230 learned_addr learned my addr 172.21.15.70:0/1737607230 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c151d640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100a80 0x7fe8bc198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c0d1c640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc101420 0x7fe8bc1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c1d1e640 1 -- 172.21.15.70:0/1737607230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc101420 msgr2=0x7fe8bc1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c1d1e640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc101420 0x7fe8bc1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c1d1e640 1 -- 172.21.15.70:0/1737607230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100a80 msgr2=0x7fe8bc198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c1d1e640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100a80 0x7fe8bc198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.596+0000 7fe8c1d1e640 1 -- 172.21.15.70:0/1737607230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8bc19d320 con 0x7fe8bc106a80 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.597+0000 7fe8c0d1c640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc101420 0x7fe8bc1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.597+0000 7fe8c151d640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100a80 0x7fe8bc198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.597+0000 7fe8c1d1e640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc106a80 0x7fe8bc19cc40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40097b0 tx=0x7fe8b4003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.597+0000 7fe8b27fc640 1 -- 172.21.15.70:0/1737607230 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4004040 con 0x7fe8bc106a80 2024-09-19T04:30:32.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.597+0000 7fe8b27fc640 1 -- 172.21.15.70:0/1737607230 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe8b40046b0 con 0x7fe8bc106a80 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.597+0000 7fe8b27fc640 1 -- 172.21.15.70:0/1737607230 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8b4046480 con 0x7fe8bc106a80 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.597+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8bc19d5b0 con 0x7fe8bc106a80 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.597+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8bc1a4ef0 con 0x7fe8bc106a80 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.598+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8bc100ee0 con 0x7fe8bc106a80 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.599+0000 7fe8b27fc640 1 -- 172.21.15.70:0/1737607230 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fe8b4030730 con 0x7fe8bc106a80 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.600+0000 7fe8b27fc640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8a80a32d0 0x7fe8a80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.600+0000 7fe8c151d640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8a80a32d0 0x7fe8a80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.600+0000 7fe8b27fc640 1 -- 172.21.15.70:0/1737607230 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fe8b402e030 con 0x7fe8bc106a80 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.600+0000 7fe8c151d640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8a80a32d0 0x7fe8a80a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800baa0 tx=0x7fe8b8005d20 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:32.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.603+0000 7fe8b27fc640 1 -- 172.21.15.70:0/1737607230 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe8b404b060 con 0x7fe8bc106a80 2024-09-19T04:30:32.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:32 smithi134 ceph-mon[34525]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:32.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.803+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe8bc1996d0 con 0x7fe8bc106a80 2024-09-19T04:30:32.804 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:32 smithi070 ceph-mon[30942]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:32.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.803+0000 7fe8b27fc640 1 -- 172.21.15.70:0/1737607230 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11914 (secure 0 0 0) 0x7fe8bc1996d0 con 0x7fe8bc106a80 2024-09-19T04:30:32.805 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:32.806 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"btime":"2024-09-19T04:29:14:453215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:29:14.027648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:30:32.806 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 23 2024-09-19T04:30:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.805+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8a80a32d0 msgr2=0x7fe8a80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.805+0000 7fe8c3781640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8a80a32d0 0x7fe8a80a5790 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fe8b800baa0 tx=0x7fe8b8005d20 comp rx=0 tx=0).stop 2024-09-19T04:30:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.805+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc106a80 msgr2=0x7fe8bc19cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:32.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.805+0000 7fe8c3781640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc106a80 0x7fe8bc19cc40 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7fe8b40097b0 tx=0x7fe8b4003970 comp rx=0 tx=0).stop 2024-09-19T04:30:32.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.805+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 shutdown_connections 2024-09-19T04:30:32.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.805+0000 7fe8c3781640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fe8a80a32d0 0x7fe8a80a5790 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.805+0000 7fe8c3781640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe8bc106a80 0x7fe8bc19cc40 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.806+0000 7fe8c3781640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe8bc101420 0x7fe8bc1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.806+0000 7fe8c3781640 1 --2- 172.21.15.70:0/1737607230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe8bc100a80 0x7fe8bc198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:32.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.806+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 >> 172.21.15.70:0/1737607230 conn(0x7fe8bc0fc7a0 msgr2=0x7fe8bc06a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:32.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.806+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 shutdown_connections 2024-09-19T04:30:32.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:32.806+0000 7fe8c3781640 1 -- 172.21.15.70:0/1737607230 wait complete. 2024-09-19T04:30:32.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:32 smithi167 ceph-mon[34339]: pgmap v320: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:33.400 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:30:33.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:33 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1737607230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:33.647 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:33.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:33 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1737607230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:33.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:33 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1737607230' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:34.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.143+0000 7f5f2077b640 1 -- 172.21.15.70:0/3181412578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f18103640 msgr2=0x7f5f1810bb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:34.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.143+0000 7f5f2077b640 1 --2- 172.21.15.70:0/3181412578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f18103640 0x7f5f1810bb30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f5f08009900 tx=0x7f5f0802a480 comp rx=0 tx=0).stop 2024-09-19T04:30:34.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 -- 172.21.15.70:0/3181412578 shutdown_connections 2024-09-19T04:30:34.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 --2- 172.21.15.70:0/3181412578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f1810c150 0x7f5f1810e5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 --2- 172.21.15.70:0/3181412578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f18103640 0x7f5f1810bb30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 --2- 172.21.15.70:0/3181412578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f18102d20 0x7f5f18103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 -- 172.21.15.70:0/3181412578 >> 172.21.15.70:0/3181412578 conn(0x7f5f180fc780 msgr2=0x7f5f180feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:34.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 -- 172.21.15.70:0/3181412578 shutdown_connections 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 -- 172.21.15.70:0/3181412578 wait complete. 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 Processor -- start 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 -- start start 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f18102d20 0x7f5f18100980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f18103640 0x7f5f18100ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f1810c150 0x7f5f18101400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18111f80 con 0x7f5f1810c150 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18111e00 con 0x7f5f18102d20 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.144+0000 7f5f2077b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5f18112100 con 0x7f5f18103640 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f1810c150 0x7f5f18101400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:34.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f1810c150 0x7f5f18101400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35008/0 (socket says 172.21.15.70:35008) 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 -- 172.21.15.70:0/1553409656 learned_addr learned my addr 172.21.15.70:0/1553409656 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1e517640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f18102d20 0x7f5f18100980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1dd16640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f18103640 0x7f5f18100ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 -- 172.21.15.70:0/1553409656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f18103640 msgr2=0x7f5f18100ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f18103640 0x7f5f18100ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 -- 172.21.15.70:0/1553409656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f18102d20 msgr2=0x7f5f18100980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f18102d20 0x7f5f18100980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 -- 172.21.15.70:0/1553409656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f181a6920 con 0x7f5f1810c150 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1e517640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f18102d20 0x7f5f18100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f1ed18640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f1810c150 0x7f5f18101400 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000cce0 tx=0x7f5f1000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f0f7fe640 1 -- 172.21.15.70:0/1553409656 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f1000f450 con 0x7f5f1810c150 2024-09-19T04:30:34.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f0f7fe640 1 -- 172.21.15.70:0/1553409656 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5f1000fac0 con 0x7f5f1810c150 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f181a6c10 con 0x7f5f1810c150 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f0f7fe640 1 -- 172.21.15.70:0/1553409656 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f10018be0 con 0x7f5f1810c150 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.145+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f181a7100 con 0x7f5f1810c150 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.146+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f18103100 con 0x7f5f1810c150 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.147+0000 7f5f0f7fe640 1 -- 172.21.15.70:0/1553409656 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f5f1000fc70 con 0x7f5f1810c150 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.148+0000 7f5f0f7fe640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5f040a32d0 0x7f5f040a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.148+0000 7f5f1e517640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5f040a32d0 0x7f5f040a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.148+0000 7f5f0f7fe640 1 -- 172.21.15.70:0/1553409656 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f5f100d0200 con 0x7f5f1810c150 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.148+0000 7f5f1e517640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5f040a32d0 0x7f5f040a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f14009930 tx=0x7f5f14008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:34.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.152+0000 7f5f0f7fe640 1 -- 172.21.15.70:0/1553409656 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5f10014030 con 0x7f5f1810c150 2024-09-19T04:30:34.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.352+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5f181071c0 con 0x7f5f1810c150 2024-09-19T04:30:34.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.353+0000 7f5f0f7fe640 1 -- 172.21.15.70:0/1553409656 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 23 v23) ==== 94+0+11914 (secure 0 0 0) 0x7f5f1009cdf0 con 0x7f5f1810c150 2024-09-19T04:30:34.355 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:34.355 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":23,"btime":"2024-09-19T04:29:14:453215+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":23,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:29:14.027648+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:30:34.355 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 23 2024-09-19T04:30:34.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5f040a32d0 msgr2=0x7f5f040a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:34.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5f040a32d0 0x7f5f040a5790 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f5f14009930 tx=0x7f5f14008040 comp rx=0 tx=0).stop 2024-09-19T04:30:34.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f1810c150 msgr2=0x7f5f18101400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:34.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f1810c150 0x7f5f18101400 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f5f1000cce0 tx=0x7f5f1000a620 comp rx=0 tx=0).stop 2024-09-19T04:30:34.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 shutdown_connections 2024-09-19T04:30:34.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f5f040a32d0 0x7f5f040a5790 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5f1810c150 0x7f5f18101400 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5f18103640 0x7f5f18100ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 --2- 172.21.15.70:0/1553409656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f18102d20 0x7f5f18100980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:34.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 >> 172.21.15.70:0/1553409656 conn(0x7f5f180fc780 msgr2=0x7f5f180fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:34.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 shutdown_connections 2024-09-19T04:30:34.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:34.355+0000 7f5f2077b640 1 -- 172.21.15.70:0/1553409656 wait complete. 2024-09-19T04:30:34.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:34 smithi070 ceph-mon[30942]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:34.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:34 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1553409656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:34 smithi134 ceph-mon[34525]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:34.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:34 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1553409656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:34.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:34 smithi167 ceph-mon[34339]: pgmap v321: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:34 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1553409656' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:34.997 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:30:35.240 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:35.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.683+0000 7f893a833640 1 -- 172.21.15.70:0/134139246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 msgr2=0x7f89341067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:35.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.683+0000 7f893a833640 1 --2- 172.21.15.70:0/134139246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 0x7f89341067d0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f891c009900 tx=0x7f891c02a410 comp rx=0 tx=0).stop 2024-09-19T04:30:35.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.683+0000 7f893a833640 1 -- 172.21.15.70:0/134139246 shutdown_connections 2024-09-19T04:30:35.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.683+0000 7f893a833640 1 --2- 172.21.15.70:0/134139246 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8934106f00 0x7f893410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.683+0000 7f893a833640 1 --2- 172.21.15.70:0/134139246 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 0x7f89341067d0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.683+0000 7f893a833640 1 --2- 172.21.15.70:0/134139246 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8934101dd0 0x7f89341021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.683+0000 7f893a833640 1 -- 172.21.15.70:0/134139246 >> 172.21.15.70:0/134139246 conn(0x7f89340fd8b0 msgr2=0x7f89340ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:35.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.684+0000 7f893a833640 1 -- 172.21.15.70:0/134139246 shutdown_connections 2024-09-19T04:30:35.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.684+0000 7f893a833640 1 -- 172.21.15.70:0/134139246 wait complete. 2024-09-19T04:30:35.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.684+0000 7f893a833640 1 Processor -- start 2024-09-19T04:30:35.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.684+0000 7f893a833640 1 -- start start 2024-09-19T04:30:35.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f893a833640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8934101dd0 0x7f89341a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f893a833640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 0x7f89341a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f893a833640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8934106f00 0x7f893419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f893a833640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8934111ff0 con 0x7f8934102780 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f893a833640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8934111e70 con 0x7f8934106f00 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f893a833640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8934112170 con 0x7f8934101dd0 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 0x7f89341a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 0x7f89341a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35028/0 (socket says 172.21.15.70:35028) 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 -- 172.21.15.70:0/938930318 learned_addr learned my addr 172.21.15.70:0/938930318 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:35.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f8938dd0640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8934106f00 0x7f893419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:35.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 -- 172.21.15.70:0/938930318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8934101dd0 msgr2=0x7f89341a03f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:35.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f8933fff640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8934101dd0 0x7f89341a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:35.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8934101dd0 0x7f89341a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 -- 172.21.15.70:0/938930318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8934106f00 msgr2=0x7f893419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:35.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8934106f00 0x7f893419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 -- 172.21.15.70:0/938930318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f893419ace0 con 0x7f8934102780 2024-09-19T04:30:35.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89337fe640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 0x7f89341a0930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f891c009a20 tx=0x7f891c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:35.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89317fa640 1 -- 172.21.15.70:0/938930318 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c03f030 con 0x7f8934102780 2024-09-19T04:30:35.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89317fa640 1 -- 172.21.15.70:0/938930318 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f891c031b80 con 0x7f8934102780 2024-09-19T04:30:35.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f893419af70 con 0x7f8934102780 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f89317fa640 1 -- 172.21.15.70:0/938930318 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f891c035070 con 0x7f8934102780 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.685+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f89341a72c0 con 0x7f8934102780 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.686+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8934102230 con 0x7f8934102780 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.687+0000 7f89317fa640 1 -- 172.21.15.70:0/938930318 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f891c0035f0 con 0x7f8934102780 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.688+0000 7f89317fa640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89200a32d0 0x7f89200a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.688+0000 7f8933fff640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89200a32d0 0x7f89200a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.688+0000 7f89317fa640 1 -- 172.21.15.70:0/938930318 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f891c0f0630 con 0x7f8934102780 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.688+0000 7f8933fff640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89200a32d0 0x7f89200a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f892400a810 tx=0x7f8924008040 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:35.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.692+0000 7f89317fa640 1 -- 172.21.15.70:0/938930318 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f891c0bd220 con 0x7f8934102780 2024-09-19T04:30:35.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.860+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f89341a7490 con 0x7f8934102780 2024-09-19T04:30:35.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.861+0000 7f89317fa640 1 -- 172.21.15.70:0/938930318 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v83) ==== 74+0+22679 (secure 0 0 0) 0x7f891c0bcb20 con 0x7f8934102780 2024-09-19T04:30:35.863 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:35.863 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":83,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:29:18.471871+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:30:35.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89200a32d0 msgr2=0x7f89200a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:35.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89200a32d0 0x7f89200a5790 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f892400a810 tx=0x7f8924008040 comp rx=0 tx=0).stop 2024-09-19T04:30:35.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 msgr2=0x7f89341a0930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:35.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 0x7f89341a0930 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f891c009a20 tx=0x7f891c0043b0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 shutdown_connections 2024-09-19T04:30:35.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f89200a32d0 0x7f89200a5790 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8934106f00 0x7f893419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8934102780 0x7f89341a0930 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 --2- 172.21.15.70:0/938930318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8934101dd0 0x7f89341a03f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:35.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 >> 172.21.15.70:0/938930318 conn(0x7f89340fd8b0 msgr2=0x7f89340fecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:35.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 shutdown_connections 2024-09-19T04:30:35.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:35.864+0000 7f893a833640 1 -- 172.21.15.70:0/938930318 wait complete. 2024-09-19T04:30:36.510 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 23, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-09-19T04:29:02.989107+0000', 'modified': '2024-09-19T04:29:14.027648+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24470, 'mds_1': 24452, 'mds_2': 24433}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24412': {'gid': 24412, 'name': 'f', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6835/3330741295', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6834', 'nonce': 3330741295}, {'type': 'v1', 'addr': '172.21.15.167:6835', 'nonce': 3330741295}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24418': {'gid': 24418, 'name': 'c', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.167:6837/3495956228', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6836', 'nonce': 3495956228}, {'type': 'v1', 'addr': '172.21.15.167:6837', 'nonce': 3495956228}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24428': {'gid': 24428, 'name': 'e', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.134:6835/1711007693', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6834', 'nonce': 1711007693}, {'type': 'v1', 'addr': '172.21.15.134:6835', 'nonce': 1711007693}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24433': {'gid': 24433, 'name': 'i', 'rank': 2, 'incarnation': 20, 'state': 'up:active', 'state_seq': 8, 'addr': '172.21.15.167:6839/2148889748', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.167:6838', 'nonce': 2148889748}, {'type': 'v1', 'addr': '172.21.15.167:6839', 'nonce': 2148889748}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24452': {'gid': 24452, 'name': 'h', 'rank': 1, 'incarnation': 18, 'state': 'up:active', 'state_seq': 9, 'addr': '172.21.15.134:6837/2308950233', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6836', 'nonce': 2308950233}, {'type': 'v1', 'addr': '172.21.15.134:6837', 'nonce': 2308950233}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24470': {'gid': 24470, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.134:6839/1808608891', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.134:6838', 'nonce': 1808608891}, {'type': 'v1', 'addr': '172.21.15.134:6839', 'nonce': 1808608891}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24470, 'qdb_cluster': [24433, 24452, 24470]} 2024-09-19T04:30:36.510 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-09-19T04:30:36.510 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.i status 2024-09-19T04:30:36.756 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:36.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:36 smithi134 ceph-mon[34525]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:36.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:36 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/938930318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:36.834 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:36 smithi070 ceph-mon[30942]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:36.834 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:36 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/938930318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:36.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:36 smithi167 ceph-mon[34339]: pgmap v322: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-09-19T04:30:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:36 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/938930318' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:37.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 -- 172.21.15.70:0/3387463023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0102ef0 msgr2=0x7f64f010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 --2- 172.21.15.70:0/3387463023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0102ef0 0x7f64f010da40 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009ca0 tx=0x7f64e802a950 comp rx=0 tx=0).stop 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 -- 172.21.15.70:0/3387463023 shutdown_connections 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 --2- 172.21.15.70:0/3387463023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0102ef0 0x7f64f010da40 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 --2- 172.21.15.70:0/3387463023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0102570 0x7f64f01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 --2- 172.21.15.70:0/3387463023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f0100e20 0x7f64f0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 -- 172.21.15.70:0/3387463023 >> 172.21.15.70:0/3387463023 conn(0x7f64f00fc7d0 msgr2=0x7f64f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 -- 172.21.15.70:0/3387463023 shutdown_connections 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 -- 172.21.15.70:0/3387463023 wait complete. 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.254+0000 7f64f64e2640 1 Processor -- start 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64f64e2640 1 -- start start 2024-09-19T04:30:37.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64f64e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0100e20 0x7f64f0197570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64f64e2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f0102570 0x7f64f0197ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64f64e2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0102ef0 0x7f64f019be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64f64e2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64f0111010 con 0x7f64f0100e20 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64f64e2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64f0110e90 con 0x7f64f0102570 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64f64e2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64f0111190 con 0x7f64f0102ef0 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0100e20 0x7f64f0197570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0100e20 0x7f64f0197570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35048/0 (socket says 172.21.15.70:35048) 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 -- 172.21.15.70:0/4070029051 learned_addr learned my addr 172.21.15.70:0/4070029051 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64ef7fe640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f0102570 0x7f64f0197ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 -- 172.21.15.70:0/4070029051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0102ef0 msgr2=0x7f64f019be40 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0102ef0 0x7f64f019be40 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 -- 172.21.15.70:0/4070029051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f0102570 msgr2=0x7f64f0197ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f0102570 0x7f64f0197ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 -- 172.21.15.70:0/4070029051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64f019c520 con 0x7f64f0100e20 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.255+0000 7f64effff640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0100e20 0x7f64f0197570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f64e000b4a0 tx=0x7f64e000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.256+0000 7f64ed7fa640 1 -- 172.21.15.70:0/4070029051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0014070 con 0x7f64f0100e20 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.256+0000 7f64ed7fa640 1 -- 172.21.15.70:0/4070029051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64e0010ae0 con 0x7f64f0100e20 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.256+0000 7f64f64e2640 1 -- 172.21.15.70:0/4070029051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64f019c810 con 0x7f64f0100e20 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.256+0000 7f64ed7fa640 1 -- 172.21.15.70:0/4070029051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0017c70 con 0x7f64f0100e20 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.256+0000 7f64f64e2640 1 -- 172.21.15.70:0/4070029051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64f01a40f0 con 0x7f64f0100e20 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64ed7fa640 1 -- 172.21.15.70:0/4070029051 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f64e0017070 con 0x7f64f0100e20 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64f88bb740 1 Processor -- start 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64f88bb740 1 -- start start 2024-09-19T04:30:37.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f2850 0x55619c8f2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c8ff880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8ffdc0 0x55619c9021b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64f88bb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55619c859090 con 0x55619c8f3170 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64f88bb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55619c800a70 con 0x55619c8ffdc0 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.258+0000 7f64f88bb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55619c855050 con 0x55619c8f2850 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c8ff880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c8ff880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35058/0 (socket says 172.21.15.70:35058) 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 -- 172.21.15.70:0/4184743841 learned_addr learned my addr 172.21.15.70:0/4184743841 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64ed7fa640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f64d80a32d0 0x7f64d80a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64f4a7f640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f64d80a32d0 0x7f64d80a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 -- 172.21.15.70:0/4184743841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f2850 msgr2=0x55619c8f2c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 --2- 172.21.15.70:0/4184743841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f2850 0x55619c8f2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 -- 172.21.15.70:0/4184743841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8ffdc0 msgr2=0x55619c9021b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:37.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 --2- 172.21.15.70:0/4184743841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8ffdc0 0x55619c9021b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 -- 172.21.15.70:0/4184743841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619c80d130 con 0x55619c8f3170 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64ed7fa640 1 -- 172.21.15.70:0/4070029051 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f64e00cedb0 con 0x7f64f0100e20 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64effff640 1 --2- 172.21.15.70:0/4184743841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c8ff880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f64e00a3af0 tx=0x7f64e0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecfe922ac665c51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64d67fc640 1 -- 172.21.15.70:0/4184743841 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e001e070 con 0x55619c8f3170 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64d67fc640 1 -- 172.21.15.70:0/4184743841 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64e00d2430 con 0x55619c8f3170 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64f4a7f640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f64d80a32d0 0x7f64d80a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009a60 tx=0x7f64e8005ef0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.259+0000 7f64d67fc640 1 -- 172.21.15.70:0/4184743841 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e0010610 con 0x55619c8f3170 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 -- 172.21.15.70:0/4184743841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 msgr2=0x55619c8ff880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 --2- 172.21.15.70:0/4184743841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c8ff880 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f64e00a3af0 tx=0x7f64e0000bc0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 -- 172.21.15.70:0/4184743841 shutdown_connections 2024-09-19T04:30:37.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 --2- 172.21.15.70:0/4184743841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8ffdc0 0x55619c9021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 --2- 172.21.15.70:0/4184743841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c8ff880 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 --2- 172.21.15.70:0/4184743841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f2850 0x55619c8f2c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 -- 172.21.15.70:0/4184743841 >> 172.21.15.70:0/4184743841 conn(0x55619c8eef60 msgr2=0x55619c8ef340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 -- 172.21.15.70:0/4184743841 shutdown_connections 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 -- 172.21.15.70:0/4184743841 wait complete. 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.260+0000 7f64f88bb740 1 -- start start 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f88bb740 1 Processor -- start 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c8ff680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f3170 0x55619c8fc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8ffdc0 0x55619c8fcf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f88bb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55619c902930 con 0x55619c8ffdc0 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f88bb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55619c813f20 con 0x55619c8f2850 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f88bb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55619c902ab0 con 0x55619c8f3170 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f88bb740 10 client.0 _ll_register_callbacks cb 0x55619c7dd030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f4a7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8ffdc0 0x55619c8fcf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64effff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c8ff680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f4a7f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8ffdc0 0x55619c8fcf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35072/0 (socket says 172.21.15.70:35072) 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f4a7f640 1 -- 172.21.15.70:0/2657818803 learned_addr learned my addr 172.21.15.70:0/2657818803 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64ef7fe640 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f3170 0x55619c8fc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f4a7f640 1 -- 172.21.15.70:0/2657818803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f3170 msgr2=0x55619c8fc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f4a7f640 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f3170 0x55619c8fc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f4a7f640 1 -- 172.21.15.70:0/2657818803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 msgr2=0x55619c8ff680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f4a7f640 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c8ff680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64f4a7f640 1 -- 172.21.15.70:0/2657818803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619c5ca2b0 con 0x55619c8ffdc0 2024-09-19T04:30:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.261+0000 7f64effff640 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c8ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f4a7f640 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8ffdc0 0x55619c8fcf10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f64e802f650 tx=0x7f64e80095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4be8773be6750b7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2657818803 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e804a070 con 0x55619c8ffdc0 2024-09-19T04:30:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2657818803 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f64e803add0 con 0x55619c8ffdc0 2024-09-19T04:30:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 1 -- 172.21.15.70:0/2657818803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55619c866600 con 0x55619c8ffdc0 2024-09-19T04:30:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2657818803 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f64e8034070 con 0x55619c8ffdc0 2024-09-19T04:30:37.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 10 client.15078 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 1 -- 172.21.15.70:0/2657818803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55619c90e2c0 con 0x55619c8ffdc0 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2657818803 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55619c866600 con 0x55619c8ffdc0 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2657818803 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f64e803b440 con 0x55619c8ffdc0 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 10 client.15078 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 10 client.15078 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 20 client.15078 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55619c910940 0x55619c911db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 4 client.15078 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.262+0000 7f64f88bb740 1 -- 172.21.15.70:0/2657818803 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55619c860b10 con 0x55619c910940 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.263+0000 7f64effff640 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55619c910940 0x55619c911db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.264+0000 7f64cf7fe640 10 client.15078 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.264+0000 7f64effff640 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55619c910940 0x55619c911db0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6d063764b22628a0 server_cookie=6d67b09eaf5be1c8 in_seq=0 out_seq=0 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.264+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2657818803 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55619c860b10 con 0x55619c910940 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.264+0000 7f64cf7fe640 10 client.15078 handle_command_reply: tid=0 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.264+0000 7f64f88bb740 1 client.15078 shutdown 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.264+0000 7f64f88bb740 1 -- 172.21.15.70:0/2657818803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8ffdc0 msgr2=0x55619c8fcf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.264+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8ffdc0 0x55619c8fcf10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f64e802f650 tx=0x7f64e80095c0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 1 -- 172.21.15.70:0/2657818803 shutdown_connections 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55619c910940 0x55619c911db0 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64cf7fe640 0 client.15078 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8ffdc0 0x55619c8fcf10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8f3170 0x55619c8fc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2657818803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c8ff680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 1 -- 172.21.15.70:0/2657818803 >> 172.21.15.70:0/2657818803 conn(0x55619c8eef60 msgr2=0x55619c8f4c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:37.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 1 -- 172.21.15.70:0/2657818803 shutdown_connections 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 1 -- 172.21.15.70:0/2657818803 wait complete. 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.265+0000 7f64f88bb740 20 client.15078 trim_cache size 0 max 16384 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64f88bb740 1 Processor -- start 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64f88bb740 1 -- start start 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f2850 0x55619c911db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f3170 0x55619c8e9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 0x55619c8fb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64f88bb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55619c9100f0 con 0x55619c8f2850 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64f88bb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55619c9107c0 con 0x55619c8f3170 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64f88bb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55619c910e90 con 0x55619c8ffdc0 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f2850 0x55619c911db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64effff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f2850 0x55619c911db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35078/0 (socket says 172.21.15.70:35078) 2024-09-19T04:30:37.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64effff640 1 -- 172.21.15.70:0/3575933942 learned_addr learned my addr 172.21.15.70:0/3575933942 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64effff640 1 -- 172.21.15.70:0/3575933942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 msgr2=0x55619c8fb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64ef7fe640 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f3170 0x55619c8e9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64effff640 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 0x55619c8fb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64effff640 1 -- 172.21.15.70:0/3575933942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f3170 msgr2=0x55619c8e9ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.282+0000 7f64effff640 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f3170 0x55619c8e9ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64effff640 1 -- 172.21.15.70:0/3575933942 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55619c8faf20 con 0x55619c8f2850 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64ef7fe640 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f3170 0x55619c8e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64effff640 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f2850 0x55619c911db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f64e0004700 tx=0x7f64e0009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e89fc116fe005666 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64d5ffb640 1 -- 172.21.15.70:0/3575933942 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e001e040 con 0x55619c8f2850 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64d5ffb640 1 -- 172.21.15.70:0/3575933942 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64e0010610 con 0x55619c8f2850 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64d5ffb640 1 -- 172.21.15.70:0/3575933942 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e00a3df0 con 0x55619c8f2850 2024-09-19T04:30:37.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 -- 172.21.15.70:0/3575933942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f2850 msgr2=0x55619c911db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:37.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f2850 0x55619c911db0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f64e0004700 tx=0x7f64e0009390 comp rx=0 tx=0).stop 2024-09-19T04:30:37.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 -- 172.21.15.70:0/3575933942 shutdown_connections 2024-09-19T04:30:37.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 0x55619c8fb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f3170 0x55619c8e9ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 --2- 172.21.15.70:0/3575933942 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f2850 0x55619c911db0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 -- 172.21.15.70:0/3575933942 >> 172.21.15.70:0/3575933942 conn(0x55619c8eef60 msgr2=0x55619c8ef340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:37.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 -- 172.21.15.70:0/3575933942 shutdown_connections 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.283+0000 7f64f88bb740 1 -- 172.21.15.70:0/3575933942 wait complete. 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 1 -- start start 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 1 Processor -- start 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c91a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c912ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 0x55619c913420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55619c911c30 con 0x55619c8f3170 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55619c911560 con 0x55619c8f2850 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55619c912300 con 0x55619c8ffdc0 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f88bb740 10 client.0 _ll_register_callbacks cb 0x7f64e8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64ef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c912ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64ef7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c912ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35092/0 (socket says 172.21.15.70:35092) 2024-09-19T04:30:37.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64ef7fe640 1 -- 172.21.15.70:0/2370452601 learned_addr learned my addr 172.21.15.70:0/2370452601 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64effff640 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c91a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.284+0000 7f64f4a7f640 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 0x55619c913420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64ef7fe640 1 -- 172.21.15.70:0/2370452601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 msgr2=0x55619c913420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64ef7fe640 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 0x55619c913420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64ef7fe640 1 -- 172.21.15.70:0/2370452601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 msgr2=0x55619c91a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64ef7fe640 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c91a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64ef7fe640 1 -- 172.21.15.70:0/2370452601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55619c913c50 con 0x55619c8f3170 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64ef7fe640 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c912ec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55619c8f0050 tx=0x7f64e4011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9005523fdaa2e5c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64cf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2370452601 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64e401a070 con 0x55619c8f3170 2024-09-19T04:30:37.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2370452601 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f64e4015440 con 0x55619c8f3170 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64f88bb740 1 -- 172.21.15.70:0/2370452601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64e0010610 con 0x55619c8f3170 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2370452601 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f64e4026050 con 0x55619c8f3170 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64f88bb740 10 client.15084 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64f88bb740 1 -- 172.21.15.70:0/2370452601 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x55619c97a0a0 con 0x55619c8f3170 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.285+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2370452601 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64e0010610 con 0x55619c8f3170 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2370452601 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f64e4014740 con 0x55619c8f3170 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64f88bb740 10 client.15084 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64f88bb740 10 client.15084 resolve_mds: resolved name 'i' to daemon mds.i 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64f88bb740 20 client.15084 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55619c97eca0 0x55619c97d9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:37.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64f88bb740 4 client.15084 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:30:37.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64f88bb740 1 -- 172.21.15.70:0/2370452601 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "status"}) -- 0x55619c7dd0e0 con 0x55619c97eca0 2024-09-19T04:30:37.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64effff640 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55619c97eca0 0x55619c97d9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:37.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64effff640 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55619c97eca0 0x55619c97d9b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5edb8a984363817b server_cookie=1d52a6ecc54fe73d in_seq=0 out_seq=0 2024-09-19T04:30:37.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.286+0000 7f64cf7fe640 10 client.15084 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:30:37.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64cf7fe640 1 -- 172.21.15.70:0/2370452601 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55619c7dd0e0 con 0x55619c97eca0 2024-09-19T04:30:37.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64cf7fe640 10 client.15084 handle_command_reply: tid=0 2024-09-19T04:30:37.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 client.15084 shutdown 2024-09-19T04:30:37.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 -- 172.21.15.70:0/2370452601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 msgr2=0x55619c912ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:37.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c912ec0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x55619c8f0050 tx=0x7f64e4011630 comp rx=0 tx=0).stop 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 -- 172.21.15.70:0/2370452601 shutdown_connections 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55619c97eca0 0x55619c97d9b0 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55619c8ffdc0 0x55619c913420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55619c8f3170 0x55619c912ec0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 --2- 172.21.15.70:0/2370452601 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55619c8f2850 0x55619c91a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64cf7fe640 0 client.15084 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 -- 172.21.15.70:0/2370452601 >> 172.21.15.70:0/2370452601 conn(0x55619c8eef60 msgr2=0x55619c8e9ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 -- 172.21.15.70:0/2370452601 shutdown_connections 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 1 -- 172.21.15.70:0/2370452601 wait complete. 2024-09-19T04:30:37.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f88bb740 20 client.15084 trim_cache size 0 max 16384 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "7f15b24a-763e-11ef-bceb-c7b262605968", 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 2, 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24433, 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 85.841936872999995, 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 23, 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T04:30:37.307 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 113.078788308 2024-09-19T04:30:37.308 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:37.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f64e2640 1 -- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f64d80a32d0 msgr2=0x7f64d80a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:37.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f64e2640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f64d80a32d0 0x7f64d80a5790 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f64e8009a60 tx=0x7f64e8005ef0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f64e2640 1 -- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0100e20 msgr2=0x7f64f0197570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:37.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.287+0000 7f64f64e2640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0100e20 0x7f64f0197570 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f64e000b4a0 tx=0x7f64e000b960 comp rx=0 tx=0).stop 2024-09-19T04:30:37.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.288+0000 7f64f64e2640 1 -- 172.21.15.70:0/4070029051 shutdown_connections 2024-09-19T04:30:37.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.288+0000 7f64f64e2640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f64d80a32d0 0x7f64d80a5790 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.288+0000 7f64f64e2640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64f0102ef0 0x7f64f019be40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.288+0000 7f64f64e2640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64f0102570 0x7f64f0197ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.288+0000 7f64f64e2640 1 --2- 172.21.15.70:0/4070029051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64f0100e20 0x7f64f0197570 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:37.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.288+0000 7f64f64e2640 1 -- 172.21.15.70:0/4070029051 >> 172.21.15.70:0/4070029051 conn(0x7f64f00fc7d0 msgr2=0x7f64f00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:37.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.288+0000 7f64f64e2640 1 -- 172.21.15.70:0/4070029051 shutdown_connections 2024-09-19T04:30:37.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:37.288+0000 7f64f64e2640 1 -- 172.21.15.70:0/4070029051 wait complete. 2024-09-19T04:30:37.996 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.h status 2024-09-19T04:30:38.240 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:38.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:38 smithi070 ceph-mon[30942]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:38.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 -- 172.21.15.70:0/1716419538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460101420 msgr2=0x7f946010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 --2- 172.21.15.70:0/1716419538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460101420 0x7f946010d950 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f9458009cd0 tx=0x7f945802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 -- 172.21.15.70:0/1716419538 shutdown_connections 2024-09-19T04:30:38.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 --2- 172.21.15.70:0/1716419538 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460101420 0x7f946010d950 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 --2- 172.21.15.70:0/1716419538 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460100a80 0x7f9460100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 --2- 172.21.15.70:0/1716419538 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9460106a80 0x7f9460106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 -- 172.21.15.70:0/1716419538 >> 172.21.15.70:0/1716419538 conn(0x7f94600fc7a0 msgr2=0x7f94600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 -- 172.21.15.70:0/1716419538 shutdown_connections 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 -- 172.21.15.70:0/1716419538 wait complete. 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.667+0000 7f946750f640 1 Processor -- start 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f946750f640 1 -- start start 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f946750f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460100a80 0x7f94601970f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f946750f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460101420 0x7f9460197630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f946750f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9460106a80 0x7f9460197b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f946750f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9460110e90 con 0x7f9460100a80 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f946750f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9460110d10 con 0x7f9460101420 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f946750f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9460111010 con 0x7f9460106a80 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460100a80 0x7f94601970f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460100a80 0x7f94601970f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35096/0 (socket says 172.21.15.70:35096) 2024-09-19T04:30:38.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 -- 172.21.15.70:0/1070967586 learned_addr learned my addr 172.21.15.70:0/1070967586 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:38.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f9465aac640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9460106a80 0x7f9460197b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 -- 172.21.15.70:0/1070967586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9460106a80 msgr2=0x7f9460197b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9460106a80 0x7f9460197b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 -- 172.21.15.70:0/1070967586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460101420 msgr2=0x7f9460197630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460101420 0x7f9460197630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 -- 172.21.15.70:0/1070967586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94601a6960 con 0x7f9460100a80 2024-09-19T04:30:38.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94652ab640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460100a80 0x7f94601970f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f945c00c890 tx=0x7f945c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94527fc640 1 -- 172.21.15.70:0/1070967586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c004220 con 0x7f9460100a80 2024-09-19T04:30:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94527fc640 1 -- 172.21.15.70:0/1070967586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f945c0043c0 con 0x7f9460100a80 2024-09-19T04:30:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f946750f640 1 -- 172.21.15.70:0/1070967586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94601a6c50 con 0x7f9460100a80 2024-09-19T04:30:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.668+0000 7f94527fc640 1 -- 172.21.15.70:0/1070967586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c004a00 con 0x7f9460100a80 2024-09-19T04:30:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.669+0000 7f946750f640 1 -- 172.21.15.70:0/1070967586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94601a7190 con 0x7f9460100a80 2024-09-19T04:30:38.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94527fc640 1 -- 172.21.15.70:0/1070967586 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f945c004ba0 con 0x7f9460100a80 2024-09-19T04:30:38.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94698e8740 1 Processor -- start 2024-09-19T04:30:38.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94698e8740 1 -- start start 2024-09-19T04:30:38.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94698e8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e38db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94698e8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e43670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94698e8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e45fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94698e8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558369d9f090 con 0x558369e389d0 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94698e8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558369d46a70 con 0x558369e392f0 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94698e8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558369d9b050 con 0x558369e43bb0 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.671+0000 7f94527fc640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f944c0a3350 0x7f944c0a5810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e38db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e38db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35104/0 (socket says 172.21.15.70:35104) 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 -- 172.21.15.70:0/474338608 learned_addr learned my addr 172.21.15.70:0/474338608 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f944c0a3350 0x7f944c0a5810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f94652ab640 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e43670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f94527fc640 1 -- 172.21.15.70:0/1070967586 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f945c0cf860 con 0x7f9460100a80 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9464aaa640 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e45fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 -- 172.21.15.70:0/474338608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 msgr2=0x558369e45fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e45fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 -- 172.21.15.70:0/474338608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 msgr2=0x558369e43670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e43670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 -- 172.21.15.70:0/474338608 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558369d53130 con 0x558369e389d0 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9464aaa640 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e45fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e38db0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9458009430 tx=0x7f9458031ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3edc3684db8e9539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f9465aac640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f944c0a3350 0x7f944c0a5810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9458009a60 tx=0x7f9458048000 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f944b7fe640 1 -- 172.21.15.70:0/474338608 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945804e070 con 0x558369e389d0 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f944b7fe640 1 -- 172.21.15.70:0/474338608 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9458036040 con 0x558369e389d0 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.672+0000 7f944b7fe640 1 -- 172.21.15.70:0/474338608 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9458030800 con 0x558369e389d0 2024-09-19T04:30:38.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 -- 172.21.15.70:0/474338608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 msgr2=0x558369e38db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e38db0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f9458009430 tx=0x7f9458031ce0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 -- 172.21.15.70:0/474338608 shutdown_connections 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e45fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e43670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 --2- 172.21.15.70:0/474338608 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e38db0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 -- 172.21.15.70:0/474338608 >> 172.21.15.70:0/474338608 conn(0x558369e34f60 msgr2=0x558369e35340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 -- 172.21.15.70:0/474338608 shutdown_connections 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.673+0000 7f94698e8740 1 -- 172.21.15.70:0/474338608 wait complete. 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 1 -- start start 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 1 Processor -- start 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e392f0 0x558369e40800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 0x558369e40d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558369e46780 con 0x558369e389d0 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558369d59f20 con 0x558369e43bb0 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558369e46900 con 0x558369e392f0 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94698e8740 10 client.0 _ll_register_callbacks cb 0x558369d23030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94652ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94652ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35114/0 (socket says 172.21.15.70:35114) 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f94652ab640 1 -- 172.21.15.70:0/742325050 learned_addr learned my addr 172.21.15.70:0/742325050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f9464aaa640 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e392f0 0x558369e40800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.674+0000 7f9465aac640 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 0x558369e40d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94652ab640 1 -- 172.21.15.70:0/742325050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e392f0 msgr2=0x558369e40800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94652ab640 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e392f0 0x558369e40800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94652ab640 1 -- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 msgr2=0x558369e40d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94652ab640 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 0x558369e40d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94652ab640 1 -- 172.21.15.70:0/742325050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558369b102b0 con 0x558369e389d0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f9465aac640 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 0x558369e40d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94652ab640 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e434b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f945c0054c0 tx=0x7f945c09c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d66f557d74f15b39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f9448ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f9448ff9640 1 -- 172.21.15.70:0/742325050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c01d040 con 0x558369e389d0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f9448ff9640 1 -- 172.21.15.70:0/742325050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f945c0cd430 con 0x558369e389d0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94698e8740 1 -- 172.21.15.70:0/742325050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9458036040 con 0x558369e389d0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f9448ff9640 1 -- 172.21.15.70:0/742325050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f945c0a4960 con 0x558369e389d0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94698e8740 10 client.15096 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94698e8740 1 -- 172.21.15.70:0/742325050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x558369e52110 con 0x558369e389d0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f9448ff9640 1 -- 172.21.15.70:0/742325050 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9458036040 con 0x558369e389d0 2024-09-19T04:30:38.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f9448ff9640 1 -- 172.21.15.70:0/742325050 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f945c09abb0 con 0x558369e389d0 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94698e8740 10 client.15096 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.675+0000 7f94698e8740 10 client.15096 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.676+0000 7f94698e8740 20 client.15096 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.676+0000 7f94698e8740 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558369e54700 0x558369e55b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.676+0000 7f94698e8740 4 client.15096 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.676+0000 7f94698e8740 1 -- 172.21.15.70:0/742325050 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558369dac600 con 0x558369e54700 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.676+0000 7f9464aaa640 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558369e54700 0x558369e55b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.677+0000 7f9464aaa640 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558369e54700 0x558369e55b70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b96c2d847492c130 server_cookie=f24d66d22600f961 in_seq=0 out_seq=0 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.677+0000 7f9448ff9640 10 client.15096 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.677+0000 7f9448ff9640 1 -- 172.21.15.70:0/742325050 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558369dac600 con 0x558369e54700 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.677+0000 7f9448ff9640 10 client.15096 handle_command_reply: tid=0 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 client.15096 shutdown 2024-09-19T04:30:38.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 -- 172.21.15.70:0/742325050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 msgr2=0x558369e434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e434b0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f945c0054c0 tx=0x7f945c09c4e0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 -- 172.21.15.70:0/742325050 shutdown_connections 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558369e54700 0x558369e55b70 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 0x558369e40d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e392f0 0x558369e40800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 --2- 172.21.15.70:0/742325050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e434b0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f9448ff9640 0 client.15096 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 -- 172.21.15.70:0/742325050 >> 172.21.15.70:0/742325050 conn(0x558369e34f60 msgr2=0x558369e3ac90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 -- 172.21.15.70:0/742325050 shutdown_connections 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 1 -- 172.21.15.70:0/742325050 wait complete. 2024-09-19T04:30:38.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.678+0000 7f94698e8740 20 client.15096 trim_cache size 0 max 16384 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.695+0000 7f94698e8740 1 Processor -- start 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.695+0000 7f94698e8740 1 -- start start 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f94698e8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e389d0 0x558369e400c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f94698e8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e392f0 0x558369e3da80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f94698e8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 0x558369e3dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f94698e8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558369e53eb0 con 0x558369e392f0 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f94698e8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558369e54580 con 0x558369e43bb0 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f94698e8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558369e54c50 con 0x558369e389d0 2024-09-19T04:30:38.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e392f0 0x558369e3da80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e392f0 0x558369e3da80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35126/0 (socket says 172.21.15.70:35126) 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 -- 172.21.15.70:0/3770605396 learned_addr learned my addr 172.21.15.70:0/3770605396 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f94652ab640 1 --2- 172.21.15.70:0/3770605396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e389d0 0x558369e400c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 -- 172.21.15.70:0/3770605396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e389d0 msgr2=0x558369e400c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 --2- 172.21.15.70:0/3770605396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e389d0 0x558369e400c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 -- 172.21.15.70:0/3770605396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 msgr2=0x558369e3dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 --2- 172.21.15.70:0/3770605396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 0x558369e3dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 -- 172.21.15.70:0/3770605396 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558369e43820 con 0x558369e392f0 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f9464aaa640 1 --2- 172.21.15.70:0/3770605396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e392f0 0x558369e3da80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f945400a9c0 tx=0x7f945400acc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=631667971b7de488 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f944affd640 1 -- 172.21.15.70:0/3770605396 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9454024070 con 0x558369e392f0 2024-09-19T04:30:38.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f944affd640 1 -- 172.21.15.70:0/3770605396 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9454015ba0 con 0x558369e392f0 2024-09-19T04:30:38.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.696+0000 7f944affd640 1 -- 172.21.15.70:0/3770605396 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945401fe50 con 0x558369e392f0 2024-09-19T04:30:38.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 -- 172.21.15.70:0/3770605396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e392f0 msgr2=0x558369e3da80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 --2- 172.21.15.70:0/3770605396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e392f0 0x558369e3da80 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f945400a9c0 tx=0x7f945400acc0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 -- 172.21.15.70:0/3770605396 shutdown_connections 2024-09-19T04:30:38.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 --2- 172.21.15.70:0/3770605396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e43bb0 0x558369e3dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 --2- 172.21.15.70:0/3770605396 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e392f0 0x558369e3da80 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 --2- 172.21.15.70:0/3770605396 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e389d0 0x558369e400c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 -- 172.21.15.70:0/3770605396 >> 172.21.15.70:0/3770605396 conn(0x558369e34f60 msgr2=0x558369e407c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 -- 172.21.15.70:0/3770605396 shutdown_connections 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 -- 172.21.15.70:0/3770605396 wait complete. 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 -- start start 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.697+0000 7f94698e8740 1 Processor -- start 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94698e8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e5e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94698e8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e596a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94698e8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e59be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94698e8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558369e559f0 con 0x558369e389d0 2024-09-19T04:30:38.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94698e8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558369e55320 con 0x558369e392f0 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94698e8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558369e560c0 con 0x558369e43bb0 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94698e8740 10 client.0 _ll_register_callbacks cb 0x7f945c0058c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e5e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e5e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35134/0 (socket says 172.21.15.70:35134) 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 -- 172.21.15.70:0/2346103472 learned_addr learned my addr 172.21.15.70:0/2346103472 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f9465aac640 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e59be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f9464aaa640 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e596a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 -- 172.21.15.70:0/2346103472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 msgr2=0x558369e59be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e59be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 -- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 msgr2=0x558369e596a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e596a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 -- 172.21.15.70:0/2346103472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558369e5a120 con 0x558369e389d0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f9464aaa640 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f94652ab640 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e5e250 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f945c0986c0 tx=0x7f945c09bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b65b0995cc3b4f9a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f9448ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f9448ff9640 1 -- 172.21.15.70:0/2346103472 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f945c01d070 con 0x558369e389d0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.698+0000 7f9448ff9640 1 -- 172.21.15.70:0/2346103472 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f945c0cd430 con 0x558369e389d0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 1 -- 172.21.15.70:0/2346103472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9454015ba0 con 0x558369e389d0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f9448ff9640 1 -- 172.21.15.70:0/2346103472 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f945c097f90 con 0x558369e389d0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 10 client.15102 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 1 -- 172.21.15.70:0/2346103472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x558369ebeae0 con 0x558369e389d0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f9448ff9640 1 -- 172.21.15.70:0/2346103472 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9454015ba0 con 0x558369e389d0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f9448ff9640 1 -- 172.21.15.70:0/2346103472 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f945c097a40 con 0x558369e389d0 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 10 client.15102 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:38.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 10 client.15102 resolve_mds: resolved name 'h' to daemon mds.h 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 20 client.15102 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558369ec3720 0x558369ec2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 4 client.15102 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f94698e8740 1 -- 172.21.15.70:0/2346103472 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "status"}) -- 0x558369da6b10 con 0x558369ec3720 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.699+0000 7f9464aaa640 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558369ec3720 0x558369ec2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f9448ff9640 10 client.15102 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f9464aaa640 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558369ec3720 0x558369ec2200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b53270a1b03a3be2 server_cookie=8e29019013a980fd in_seq=0 out_seq=0 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f9448ff9640 1 -- 172.21.15.70:0/2346103472 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x558369da6b10 con 0x558369ec3720 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f9448ff9640 10 client.15102 handle_command_reply: tid=0 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 client.15102 shutdown 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 -- 172.21.15.70:0/2346103472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 msgr2=0x558369e5e250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e5e250 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f945c0986c0 tx=0x7f945c09bb50 comp rx=0 tx=0).stop 2024-09-19T04:30:38.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 -- 172.21.15.70:0/2346103472 shutdown_connections 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558369ec3720 0x558369ec2200 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558369e43bb0 0x558369e59be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558369e392f0 0x558369e596a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 --2- 172.21.15.70:0/2346103472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558369e389d0 0x558369e5e250 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 -- 172.21.15.70:0/2346103472 >> 172.21.15.70:0/2346103472 conn(0x558369e34f60 msgr2=0x558369e3f0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f9448ff9640 0 client.15102 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 -- 172.21.15.70:0/2346103472 shutdown_connections 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 1 -- 172.21.15.70:0/2346103472 wait complete. 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.700+0000 7f94698e8740 20 client.15102 trim_cache size 0 max 16384 2024-09-19T04:30:38.708 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "7f15b24a-763e-11ef-bceb-c7b262605968", 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 1, 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24452, 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 88.268750174999994, 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 23, 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 117.010393384 2024-09-19T04:30:38.709 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:38.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 -- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f944c0a3350 msgr2=0x7f944c0a5810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f944c0a3350 0x7f944c0a5810 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9458009a60 tx=0x7f9458048000 comp rx=0 tx=0).stop 2024-09-19T04:30:38.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 -- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460100a80 msgr2=0x7f94601970f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:38.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460100a80 0x7f94601970f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f945c00c890 tx=0x7f945c00cd50 comp rx=0 tx=0).stop 2024-09-19T04:30:38.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 -- 172.21.15.70:0/1070967586 shutdown_connections 2024-09-19T04:30:38.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f944c0a3350 0x7f944c0a5810 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9460106a80 0x7f9460197b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9460101420 0x7f9460197630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 --2- 172.21.15.70:0/1070967586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9460100a80 0x7f94601970f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:38.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 -- 172.21.15.70:0/1070967586 >> 172.21.15.70:0/1070967586 conn(0x7f94600fc7a0 msgr2=0x7f94600fd000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:38.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 -- 172.21.15.70:0/1070967586 shutdown_connections 2024-09-19T04:30:38.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:38.701+0000 7f946750f640 1 -- 172.21.15.70:0/1070967586 wait complete. 2024-09-19T04:30:38.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:38 smithi134 ceph-mon[34525]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:38.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:38 smithi167 ceph-mon[34339]: pgmap v323: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-09-19T04:30:39.421 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.b status 2024-09-19T04:30:39.667 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 -- 172.21.15.70:0/354819718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102570 msgr2=0x7f94281029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 --2- 172.21.15.70:0/354819718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102570 0x7f94281029b0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f9418009900 tx=0x7f941802a480 comp rx=0 tx=0).stop 2024-09-19T04:30:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 -- 172.21.15.70:0/354819718 shutdown_connections 2024-09-19T04:30:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 --2- 172.21.15.70:0/354819718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9428102ef0 0x7f942810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 --2- 172.21.15.70:0/354819718 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102570 0x7f94281029b0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 --2- 172.21.15.70:0/354819718 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100e20 0x7f9428101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 -- 172.21.15.70:0/354819718 >> 172.21.15.70:0/354819718 conn(0x7f94280fc7d0 msgr2=0x7f94280febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 -- 172.21.15.70:0/354819718 shutdown_connections 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.124+0000 7f942fcc0640 1 -- 172.21.15.70:0/354819718 wait complete. 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942fcc0640 1 Processor -- start 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942fcc0640 1 -- start start 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942fcc0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100e20 0x7f9428198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942fcc0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9428102570 0x7f9428198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942fcc0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102ef0 0x7f942819cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942fcc0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9428112070 con 0x7f9428102ef0 2024-09-19T04:30:40.158 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942fcc0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9428111ef0 con 0x7f9428102570 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942fcc0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94281121f0 con 0x7f9428100e20 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942e25d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102ef0 0x7f942819cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942e25d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102ef0 0x7f942819cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35156/0 (socket says 172.21.15.70:35156) 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942e25d640 1 -- 172.21.15.70:0/110173590 learned_addr learned my addr 172.21.15.70:0/110173590 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942d25b640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9428102570 0x7f9428198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.125+0000 7f942da5c640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100e20 0x7f9428198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942e25d640 1 -- 172.21.15.70:0/110173590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100e20 msgr2=0x7f9428198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942e25d640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100e20 0x7f9428198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942e25d640 1 -- 172.21.15.70:0/110173590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9428102570 msgr2=0x7f9428198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942e25d640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9428102570 0x7f9428198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942e25d640 1 -- 172.21.15.70:0/110173590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f942819d4d0 con 0x7f9428102ef0 2024-09-19T04:30:40.159 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942d25b640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9428102570 0x7f9428198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942e25d640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102ef0 0x7f942819cdf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f942000cad0 tx=0x7f942000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f941effd640 1 -- 172.21.15.70:0/110173590 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942000ae20 con 0x7f9428102ef0 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942fcc0640 1 -- 172.21.15.70:0/110173590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f942819d7c0 con 0x7f9428102ef0 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f941effd640 1 -- 172.21.15.70:0/110173590 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9420005020 con 0x7f9428102ef0 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f941effd640 1 -- 172.21.15.70:0/110173590 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f942000f690 con 0x7f9428102ef0 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.126+0000 7f942fcc0640 1 -- 172.21.15.70:0/110173590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94281a50a0 con 0x7f9428102ef0 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.128+0000 7f941effd640 1 -- 172.21.15.70:0/110173590 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7f94200051d0 con 0x7f9428102ef0 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.128+0000 7f9432099740 1 Processor -- start 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f9432099740 1 -- start start 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f9432099740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f109d0 0x560f36f10db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f9432099740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f112f0 0x560f36f1b670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f9432099740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f1dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f9432099740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560f36e77090 con 0x560f36f1bbb0 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f9432099740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560f36e1ea70 con 0x560f36f109d0 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f9432099740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560f36e73050 con 0x560f36f112f0 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942d25b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f1dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942d25b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f1dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35164/0 (socket says 172.21.15.70:35164) 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942d25b640 1 -- 172.21.15.70:0/3105729767 learned_addr learned my addr 172.21.15.70:0/3105729767 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f941effd640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f94140a32d0 0x7f94140a5790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942e25d640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f94140a32d0 0x7f94140a5790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942d25b640 1 -- 172.21.15.70:0/3105729767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f112f0 msgr2=0x560f36f1b670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942d25b640 1 --2- 172.21.15.70:0/3105729767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f112f0 0x560f36f1b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942d25b640 1 -- 172.21.15.70:0/3105729767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f109d0 msgr2=0x560f36f10db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:40.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942d25b640 1 --2- 172.21.15.70:0/3105729767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f109d0 0x560f36f10db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f942d25b640 1 -- 172.21.15.70:0/3105729767 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f36e2b130 con 0x560f36f1bbb0 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.129+0000 7f941effd640 1 -- 172.21.15.70:0/110173590 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f94200cfc30 con 0x7f9428102ef0 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.130+0000 7f942d25b640 1 --2- 172.21.15.70:0/3105729767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f1dfa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f941802a9a0 tx=0x7f9418031ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ecc1d99da27c45a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.130+0000 7f942e25d640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f94140a32d0 0x7f94140a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9420016000 tx=0x7f942006ef40 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.130+0000 7f9413fff640 1 -- 172.21.15.70:0/3105729767 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418035070 con 0x560f36f1bbb0 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.130+0000 7f9413fff640 1 -- 172.21.15.70:0/3105729767 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9418031760 con 0x560f36f1bbb0 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.130+0000 7f9413fff640 1 -- 172.21.15.70:0/3105729767 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94180048e0 con 0x560f36f1bbb0 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.130+0000 7f9432099740 1 -- 172.21.15.70:0/3105729767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 msgr2=0x560f36f1dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.130+0000 7f9432099740 1 --2- 172.21.15.70:0/3105729767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f1dfa0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f941802a9a0 tx=0x7f9418031ef0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 -- 172.21.15.70:0/3105729767 shutdown_connections 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 --2- 172.21.15.70:0/3105729767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f1dfa0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 --2- 172.21.15.70:0/3105729767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f112f0 0x560f36f1b670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 --2- 172.21.15.70:0/3105729767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f109d0 0x560f36f10db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 -- 172.21.15.70:0/3105729767 >> 172.21.15.70:0/3105729767 conn(0x560f36f0cf60 msgr2=0x560f36f0d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 -- 172.21.15.70:0/3105729767 shutdown_connections 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 -- 172.21.15.70:0/3105729767 wait complete. 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 -- start start 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.131+0000 7f9432099740 1 Processor -- start 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 0x560f36f1b460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f112f0 0x560f36f187b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f18cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560f36f1e780 con 0x560f36f1bbb0 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560f36e31f20 con 0x560f36f112f0 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560f36f1e900 con 0x560f36f109d0 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 10 client.0 _ll_register_callbacks cb 0x560f36dfb030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f18cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f18cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35166/0 (socket says 172.21.15.70:35166) 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 -- 172.21.15.70:0/3722726966 learned_addr learned my addr 172.21.15.70:0/3722726966 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 0x560f36f1b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 -- 172.21.15.70:0/3722726966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 msgr2=0x560f36f1b460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 0x560f36f1b460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 -- 172.21.15.70:0/3722726966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f112f0 msgr2=0x560f36f187b0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f112f0 0x560f36f187b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 -- 172.21.15.70:0/3722726966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f36be82b0 con 0x560f36f1bbb0 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f942d25b640 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f18cf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9418031a90 tx=0x7f9418005530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b717b3ee0def95cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f94117fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f94117fa640 1 -- 172.21.15.70:0/3722726966 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9418035070 con 0x560f36f1bbb0 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f94117fa640 1 -- 172.21.15.70:0/3722726966 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f9418046070 con 0x560f36f1bbb0 2024-09-19T04:30:40.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 1 -- 172.21.15.70:0/3722726966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9418031760 con 0x560f36f1bbb0 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f94117fa640 1 -- 172.21.15.70:0/3722726966 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9418046270 con 0x560f36f1bbb0 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 10 client.15114 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.132+0000 7f9432099740 1 -- 172.21.15.70:0/3722726966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x560f36f2a0a0 con 0x560f36f1bbb0 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.133+0000 7f94117fa640 1 -- 172.21.15.70:0/3722726966 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9418031760 con 0x560f36f1bbb0 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.133+0000 7f94117fa640 1 -- 172.21.15.70:0/3722726966 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f941803cb40 con 0x560f36f1bbb0 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.133+0000 7f9432099740 10 client.15114 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.133+0000 7f9432099740 10 client.15114 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.133+0000 7f9432099740 20 client.15114 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.133+0000 7f9432099740 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560f36f2c2d0 0x560f36f2d740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.133+0000 7f9432099740 4 client.15114 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.133+0000 7f9432099740 1 -- 172.21.15.70:0/3722726966 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560f36e84600 con 0x560f36f2c2d0 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.134+0000 7f942da5c640 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560f36f2c2d0 0x560f36f2d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.135+0000 7f942da5c640 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560f36f2c2d0 0x560f36f2d740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=120b29f7edb45dd9 server_cookie=527f7e4f967e8cb3 in_seq=0 out_seq=0 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.135+0000 7f94117fa640 10 client.15114 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.136+0000 7f94117fa640 1 -- 172.21.15.70:0/3722726966 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560f36e84600 con 0x560f36f2c2d0 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.136+0000 7f94117fa640 10 client.15114 handle_command_reply: tid=0 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.136+0000 7f9432099740 1 client.15114 shutdown 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.136+0000 7f9432099740 1 -- 172.21.15.70:0/3722726966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 msgr2=0x560f36f18cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.136+0000 7f9432099740 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f18cf0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f9418031a90 tx=0x7f9418005530 comp rx=0 tx=0).stop 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 1 -- 172.21.15.70:0/3722726966 shutdown_connections 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560f36f2c2d0 0x560f36f2d740 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f1bbb0 0x560f36f18cf0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f94117fa640 0 client.15114 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f112f0 0x560f36f187b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 1 --2- 172.21.15.70:0/3722726966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 0x560f36f1b460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 1 -- 172.21.15.70:0/3722726966 >> 172.21.15.70:0/3722726966 conn(0x560f36f0cf60 msgr2=0x560f36f12c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:40.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 1 -- 172.21.15.70:0/3722726966 shutdown_connections 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 1 -- 172.21.15.70:0/3722726966 wait complete. 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.137+0000 7f9432099740 20 client.15114 trim_cache size 0 max 16384 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f9432099740 1 Processor -- start 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f9432099740 1 -- start start 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f9432099740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f109d0 0x560f36f2bc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f9432099740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f2c9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f9432099740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f1bbb0 0x560f36f18070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f9432099740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560f36f2ba80 con 0x560f36f112f0 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f9432099740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560f36f2c150 con 0x560f36f109d0 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f9432099740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560f36f2c820 con 0x560f36f1bbb0 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f2c9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f2c9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35176/0 (socket says 172.21.15.70:35176) 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 -- 172.21.15.70:0/2790292623 learned_addr learned my addr 172.21.15.70:0/2790292623 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 -- 172.21.15.70:0/2790292623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f1bbb0 msgr2=0x560f36f18070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 --2- 172.21.15.70:0/2790292623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f1bbb0 0x560f36f18070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 -- 172.21.15.70:0/2790292623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f109d0 msgr2=0x560f36f2bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 --2- 172.21.15.70:0/2790292623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f109d0 0x560f36f2bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 -- 172.21.15.70:0/2790292623 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f36f0dbf0 con 0x560f36f112f0 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.154+0000 7f942da5c640 1 --2- 172.21.15.70:0/2790292623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f2c9a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x560f36f18040 tx=0x7f9424005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e17aaa0cf291ca7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f94137fe640 1 -- 172.21.15.70:0/2790292623 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424012d10 con 0x560f36f112f0 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f94137fe640 1 -- 172.21.15.70:0/2790292623 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f942401c030 con 0x560f36f112f0 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f94137fe640 1 -- 172.21.15.70:0/2790292623 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424018540 con 0x560f36f112f0 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 -- 172.21.15.70:0/2790292623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 msgr2=0x560f36f2c9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 --2- 172.21.15.70:0/2790292623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f2c9a0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x560f36f18040 tx=0x7f9424005c90 comp rx=0 tx=0).stop 2024-09-19T04:30:40.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 -- 172.21.15.70:0/2790292623 shutdown_connections 2024-09-19T04:30:40.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 --2- 172.21.15.70:0/2790292623 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f1bbb0 0x560f36f18070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 --2- 172.21.15.70:0/2790292623 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f2c9a0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 --2- 172.21.15.70:0/2790292623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f109d0 0x560f36f2bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 -- 172.21.15.70:0/2790292623 >> 172.21.15.70:0/2790292623 conn(0x560f36f0cf60 msgr2=0x560f36f07ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:40.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 -- 172.21.15.70:0/2790292623 shutdown_connections 2024-09-19T04:30:40.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.155+0000 7f9432099740 1 -- 172.21.15.70:0/2790292623 wait complete. 2024-09-19T04:30:40.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 1 -- start start 2024-09-19T04:30:40.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 1 Processor -- start 2024-09-19T04:30:40.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 0x560f36f15800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f15d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f1bbb0 0x560f36f91d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560f36f2d5c0 con 0x560f36f112f0 2024-09-19T04:30:40.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560f36f2cef0 con 0x560f36f1bbb0 2024-09-19T04:30:40.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560f36f2dc90 con 0x560f36f109d0 2024-09-19T04:30:40.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f9432099740 10 client.0 _ll_register_callbacks cb 0x7f9418031e20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:40.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f942da5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f15d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f942da5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f15d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35190/0 (socket says 172.21.15.70:35190) 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.156+0000 7f942da5c640 1 -- 172.21.15.70:0/4003524056 learned_addr learned my addr 172.21.15.70:0/4003524056 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f942da5c640 1 -- 172.21.15.70:0/4003524056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 msgr2=0x560f36f15800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f942da5c640 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 0x560f36f15800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f942d25b640 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f1bbb0 0x560f36f91d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f942da5c640 1 -- 172.21.15.70:0/4003524056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f1bbb0 msgr2=0x560f36f91d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f942da5c640 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f1bbb0 0x560f36f91d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f942da5c640 1 -- 172.21.15.70:0/4003524056 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f36f923c0 con 0x560f36f112f0 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f942da5c640 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f15d40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f942401f000 tx=0x7f9424009fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923854969793d888 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f94117fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f94117fa640 1 -- 172.21.15.70:0/4003524056 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9424020690 con 0x560f36f112f0 2024-09-19T04:30:40.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 1 -- 172.21.15.70:0/4003524056 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f942401c030 con 0x560f36f112f0 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f94117fa640 1 -- 172.21.15.70:0/4003524056 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f9424020830 con 0x560f36f112f0 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f94117fa640 1 -- 172.21.15.70:0/4003524056 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=23) ==== 24+0+0 (secure 0 0 0) 0x7f9424020a50 con 0x560f36f112f0 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 10 client.15120 fetch_fsmap learned FSMap version 23 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 1 -- 172.21.15.70:0/4003524056 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=23,monmap=4+}) -- 0x560f36f9a950 con 0x560f36f112f0 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f94117fa640 1 -- 172.21.15.70:0/4003524056 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f942401c030 con 0x560f36f112f0 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f94117fa640 1 -- 172.21.15.70:0/4003524056 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 23) ==== 8346+0+0 (secure 0 0 0) 0x7f942400f040 con 0x560f36f112f0 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 10 client.15120 fetch_fsmap finished waiting for FSMap version 23 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 10 client.15120 resolve_mds: resolved name 'b' to daemon mds.b 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 20 client.15120 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560f36f2c2d0 0x560f36f9dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 4 client.15120 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "status"}] 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.157+0000 7f9432099740 1 -- 172.21.15.70:0/4003524056 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "status"}) -- 0x560f36e7eb10 con 0x560f36f2c2d0 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.158+0000 7f942d25b640 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560f36f2c2d0 0x560f36f9dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:40.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.158+0000 7f942d25b640 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560f36f2c2d0 0x560f36f9dfe0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c54a2355f7a9f74 server_cookie=3189557f9873ab77 in_seq=0 out_seq=0 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.158+0000 7f94117fa640 10 client.15120 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f94117fa640 1 -- 172.21.15.70:0/4003524056 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+321 (crc 0 0 0) 0x560f36e7eb10 con 0x560f36f2c2d0 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f94117fa640 10 client.15120 handle_command_reply: tid=0 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 client.15120 shutdown 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 -- 172.21.15.70:0/4003524056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 msgr2=0x560f36f15d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f15d40 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f942401f000 tx=0x7f9424009fa0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 -- 172.21.15.70:0/4003524056 shutdown_connections 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560f36f2c2d0 0x560f36f9dfe0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560f36f1bbb0 0x560f36f91d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560f36f112f0 0x560f36f15d40 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f94117fa640 0 client.15120 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 --2- 172.21.15.70:0/4003524056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560f36f109d0 0x560f36f15800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 -- 172.21.15.70:0/4003524056 >> 172.21.15.70:0/4003524056 conn(0x560f36f0cf60 msgr2=0x560f36f17060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:40.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 -- 172.21.15.70:0/4003524056 shutdown_connections 2024-09-19T04:30:40.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 1 -- 172.21.15.70:0/4003524056 wait complete. 2024-09-19T04:30:40.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.159+0000 7f9432099740 20 client.15120 trim_cache size 0 max 16384 2024-09-19T04:30:40.176 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "cluster_fsid": "7f15b24a-763e-11ef-bceb-c7b262605968", 2024-09-19T04:30:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "whoami": 0, 2024-09-19T04:30:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 24470, 2024-09-19T04:30:40.176 INFO:teuthology.orchestra.run.smithi070.stdout: "want_state": "up:active", 2024-09-19T04:30:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "state": "up:active", 2024-09-19T04:30:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs", 2024-09-19T04:30:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "rank_uptime": 96.756059295, 2024-09-19T04:30:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "mdsmap_epoch": 23, 2024-09-19T04:30:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch": 83, 2024-09-19T04:30:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_epoch_barrier": 81, 2024-09-19T04:30:40.177 INFO:teuthology.orchestra.run.smithi070.stdout: "uptime": 107.574262686 2024-09-19T04:30:40.177 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 -- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f94140a32d0 msgr2=0x7f94140a5790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f94140a32d0 0x7f94140a5790 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f9420016000 tx=0x7f942006ef40 comp rx=0 tx=0).stop 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 -- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102ef0 msgr2=0x7f942819cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102ef0 0x7f942819cdf0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f942000cad0 tx=0x7f942000cf90 comp rx=0 tx=0).stop 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 -- 172.21.15.70:0/110173590 shutdown_connections 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f94140a32d0 0x7f94140a5790 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9428102ef0 0x7f942819cdf0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9428102570 0x7f9428198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 --2- 172.21.15.70:0/110173590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9428100e20 0x7f9428198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:40.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 -- 172.21.15.70:0/110173590 >> 172.21.15.70:0/110173590 conn(0x7f94280fc7d0 msgr2=0x7f94280febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:40.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 -- 172.21.15.70:0/110173590 shutdown_connections 2024-09-19T04:30:40.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:40.160+0000 7f942fcc0640 1 -- 172.21.15.70:0/110173590 wait complete. 2024-09-19T04:30:40.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:40 smithi134 ceph-mon[34525]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:40 smithi070 ceph-mon[30942]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:40.932 INFO:teuthology.run_tasks:Running task sequential... 2024-09-19T04:30:40.942 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-09-19T04:30:40.942 INFO:teuthology.task.sequential:In sequential, running task print... 2024-09-19T04:30:40.942 INFO:teuthology.task.print:Enabling mgr modules 2024-09-19T04:30:40.942 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-09-19T04:30:40.943 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T04:30:40.943 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:30:40.943 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-09-19T04:30:40.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:40 smithi167 ceph-mon[34339]: pgmap v324: 97 pgs: 97 active+clean; 639 KiB data, 366 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 -- 172.21.15.70:0/4058218674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2441025f0 msgr2=0x7fb244108e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 --2- 172.21.15.70:0/4058218674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2441025f0 0x7fb244108e80 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fb23c009ca0 tx=0x7fb23c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 -- 172.21.15.70:0/4058218674 shutdown_connections 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 --2- 172.21.15.70:0/4058218674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2441025f0 0x7fb244108e80 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 --2- 172.21.15.70:0/4058218674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb244101c30 0x7fb2441020b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 --2- 172.21.15.70:0/4058218674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb244100a40 0x7fb244100e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 -- 172.21.15.70:0/4058218674 >> 172.21.15.70:0/4058218674 conn(0x7fb2440fc1e0 msgr2=0x7fb2440fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 -- 172.21.15.70:0/4058218674 shutdown_connections 2024-09-19T04:30:41.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.044+0000 7fb248e5e640 1 -- 172.21.15.70:0/4058218674 wait complete. 2024-09-19T04:30:41.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb248e5e640 1 Processor -- start 2024-09-19T04:30:41.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb248e5e640 1 -- start start 2024-09-19T04:30:41.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb248e5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb244100a40 0x7fb244197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb248e5e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb244101c30 0x7fb244198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb248e5e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2441025f0 0x7fb24419f370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb248e5e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb24410c730 con 0x7fb244100a40 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb248e5e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb24410c5b0 con 0x7fb244101c30 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb248e5e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb24410c8b0 con 0x7fb2441025f0 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb24259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb244100a40 0x7fb244197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb24259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb244100a40 0x7fb244197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35198/0 (socket says 172.21.15.70:35198) 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb24259c640 1 -- 172.21.15.70:0/1934919182 learned_addr learned my addr 172.21.15.70:0/1934919182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb242d9d640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2441025f0 0x7fb24419f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb241d9b640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb244101c30 0x7fb244198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb24259c640 1 -- 172.21.15.70:0/1934919182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2441025f0 msgr2=0x7fb24419f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:41.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb24259c640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2441025f0 0x7fb24419f370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb24259c640 1 -- 172.21.15.70:0/1934919182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb244101c30 msgr2=0x7fb244198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb24259c640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb244101c30 0x7fb244198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb24259c640 1 -- 172.21.15.70:0/1934919182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb24419f9e0 con 0x7fb244100a40 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.045+0000 7fb242d9d640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2441025f0 0x7fb24419f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.046+0000 7fb24259c640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb244100a40 0x7fb244197dc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb23400b450 tx=0x7fb23400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.046+0000 7fb2337fe640 1 -- 172.21.15.70:0/1934919182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb234015020 con 0x7fb244100a40 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.046+0000 7fb2337fe640 1 -- 172.21.15.70:0/1934919182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb234011d60 con 0x7fb244100a40 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.046+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb24419fcd0 con 0x7fb244100a40 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.046+0000 7fb2337fe640 1 -- 172.21.15.70:0/1934919182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb23400f340 con 0x7fb244100a40 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.046+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2441a01d0 con 0x7fb244100a40 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.047+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb2441a0400 con 0x7fb244100a40 2024-09-19T04:30:41.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.048+0000 7fb2337fe640 1 -- 172.21.15.70:0/1934919182 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 17) ==== 138406+0+0 (secure 0 0 0) 0x7fb234018020 con 0x7fb244100a40 2024-09-19T04:30:41.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.049+0000 7fb2337fe640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb22c0a3390 0x7fb22c0a5850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:41.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.049+0000 7fb241d9b640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb22c0a3390 0x7fb22c0a5850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:41.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.049+0000 7fb2337fe640 1 -- 172.21.15.70:0/1934919182 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7fb2340cf570 con 0x7fb244100a40 2024-09-19T04:30:41.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.049+0000 7fb241d9b640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb22c0a3390 0x7fb22c0a5850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb238005e10 tx=0x7fb238005da0 comp rx=0 tx=0).ready entity=mgr.14148 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:41.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.053+0000 7fb2337fe640 1 -- 172.21.15.70:0/1934919182 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb23401f020 con 0x7fb244100a40 2024-09-19T04:30:41.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.266+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7fb2441a05d0 con 0x7fb244100a40 2024-09-19T04:30:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.519+0000 7fb2337fe640 1 -- 172.21.15.70:0/1934919182 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v18) ==== 92+0+0 (secure 0 0 0) 0x7fb23400d040 con 0x7fb244100a40 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb22c0a3390 msgr2=0x7fb22c0a5850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb22c0a3390 0x7fb22c0a5850 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fb238005e10 tx=0x7fb238005da0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb244100a40 msgr2=0x7fb244197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb244100a40 0x7fb244197dc0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fb23400b450 tx=0x7fb23400b910 comp rx=0 tx=0).stop 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 shutdown_connections 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7fb22c0a3390 0x7fb22c0a5850 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2441025f0 0x7fb24419f370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb244101c30 0x7fb244198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 --2- 172.21.15.70:0/1934919182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb244100a40 0x7fb244197dc0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 >> 172.21.15.70:0/1934919182 conn(0x7fb2440fc1e0 msgr2=0x7fb2440fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 shutdown_connections 2024-09-19T04:30:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:41.521+0000 7fb248e5e640 1 -- 172.21.15.70:0/1934919182 wait complete. 2024-09-19T04:30:41.539 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-09-19T04:30:41.565 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-09-19T04:30:41.566 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-09-19T04:30:41.566 INFO:tasks.ceph_fuse:client.0 config is {'mount_subvol_num': 0} 2024-09-19T04:30:41.566 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-09-19T04:30:41.566 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:41.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:41.566 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-19T04:30:41.583 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:41.584 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-19T04:30:41.651 INFO:teuthology.orchestra.run.smithi070.stderr:Cannot find device "ceph-brx" 2024-09-19T04:30:41.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:30:41.653 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-09-19T04:30:41.653 DEBUG:tasks.ceph_fuse:passing mntargs=[] 2024-09-19T04:30:41.653 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs ls 2024-09-19T04:30:41.674 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:41 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1934919182' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T04:30:41.674 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:41 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ignoring --setuser ceph since I am not root 2024-09-19T04:30:41.675 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:41 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ignoring --setgroup ceph since I am not root 2024-09-19T04:30:41.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:41 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1934919182' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T04:30:41.785 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:41 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: ignoring --setuser ceph since I am not root 2024-09-19T04:30:41.785 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:41 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: ignoring --setgroup ceph since I am not root 2024-09-19T04:30:41.785 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:41 smithi134 ceph-mgr[35896]: -- 172.21.15.134:0/2022447405 <== mon.2 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5635a3e970e0 con 0x5635a3e75400 2024-09-19T04:30:41.785 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:41 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:41.674+0000 7fcaf9e33040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:30:41.786 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:41 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:41.732+0000 7fcaf9e33040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:30:41.881 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:41 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1934919182' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-09-19T04:30:41.881 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: ignoring --setuser ceph since I am not root 2024-09-19T04:30:41.881 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: ignoring --setgroup ceph since I am not root 2024-09-19T04:30:41.881 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:41 smithi167 ceph-mgr[36144]: -- 172.21.15.167:0/2971869816 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55eda02ab0e0 con 0x55eda0288800 2024-09-19T04:30:41.881 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:41.675+0000 7f97bd122040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:30:41.881 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:41.732+0000 7f97bd122040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:30:41.881 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:41.878+0000 7f97bd122040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:30:41.936 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:41.970 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:41 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:41.672+0000 7fb7805e7040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-09-19T04:30:41.971 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:41 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:41.732+0000 7fb7805e7040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-09-19T04:30:41.971 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:41 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:41.891+0000 7fb7805e7040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:30:41.971 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:41 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:41.968+0000 7fb7805e7040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:30:42.210 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:41.946+0000 7f97bd122040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:30:42.211 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:42.093+0000 7f97bd122040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:30:42.225 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:42 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:42.119+0000 7fb7805e7040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:30:42.235 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:41 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:41.880+0000 7fcaf9e33040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-09-19T04:30:42.235 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:41 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:41.946+0000 7fcaf9e33040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-09-19T04:30:42.236 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:42 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:42.094+0000 7fcaf9e33040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:30:42.236 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:42 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:42.234+0000 7fcaf9e33040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:30:42.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 -- 172.21.15.70:0/1442703660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198100e20 msgr2=0x7f5198101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:42.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 --2- 172.21.15.70:0/1442703660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198100e20 0x7f5198101200 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f5188009900 tx=0x7f518802a480 comp rx=0 tx=0).stop 2024-09-19T04:30:42.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 -- 172.21.15.70:0/1442703660 shutdown_connections 2024-09-19T04:30:42.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 --2- 172.21.15.70:0/1442703660 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5198102ef0 0x7f519810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 --2- 172.21.15.70:0/1442703660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5198102570 0x7f51981029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 --2- 172.21.15.70:0/1442703660 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198100e20 0x7f5198101200 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 -- 172.21.15.70:0/1442703660 >> 172.21.15.70:0/1442703660 conn(0x7f51980fc7d0 msgr2=0x7f51980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:42.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 -- 172.21.15.70:0/1442703660 shutdown_connections 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 -- 172.21.15.70:0/1442703660 wait complete. 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 Processor -- start 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.448+0000 7f519e704640 1 -- start start 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519e704640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5198100e20 0x7f51980fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519e704640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5198102570 0x7f51980fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519e704640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198102ef0 0x7f51980fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519e704640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5198110f50 con 0x7f5198102ef0 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519e704640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5198110dd0 con 0x7f5198100e20 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519e704640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f51981110d0 con 0x7f5198102570 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519cca1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198102ef0 0x7f51980fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f5197fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5198100e20 0x7f51980fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:42.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519cca1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198102ef0 0x7f51980fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35240/0 (socket says 172.21.15.70:35240) 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f519cca1640 1 -- 172.21.15.70:0/1128477581 learned_addr learned my addr 172.21.15.70:0/1128477581 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f51977fe640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5198102570 0x7f51980fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f5197fff640 1 -- 172.21.15.70:0/1128477581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5198102570 msgr2=0x7f51980fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f5197fff640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5198102570 0x7f51980fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f5197fff640 1 -- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198102ef0 msgr2=0x7f51980fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.449+0000 7f5197fff640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198102ef0 0x7f51980fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f5197fff640 1 -- 172.21.15.70:0/1128477581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51981a6980 con 0x7f5198100e20 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f519cca1640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198102ef0 0x7f51980fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:42.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f51977fe640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5198102570 0x7f51980fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:42.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f5197fff640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5198100e20 0x7f51980fcc80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5188031440 tx=0x7f5188004270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:42.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f51957fa640 1 -- 172.21.15.70:0/1128477581 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f518803f030 con 0x7f5198100e20 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51981a6c10 con 0x7f5198100e20 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f51957fa640 1 -- 172.21.15.70:0/1128477581 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5188003ac0 con 0x7f5198100e20 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f51957fa640 1 -- 172.21.15.70:0/1128477581 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5188035070 con 0x7f5198100e20 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.450+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51981a70f0 con 0x7f5198100e20 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.451+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5198101200 con 0x7f5198100e20 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.452+0000 7f51957fa640 1 -- 172.21.15.70:0/1128477581 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) ==== 138423+0+0 (secure 0 0 0) 0x7f5188042030 con 0x7f5198100e20 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.453+0000 7f51957fa640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51800a3320 0x7f51800a57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.453+0000 7f51977fe640 1 -- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51800a3320 msgr2=0x7f51800a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/4212188848 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.453+0000 7f51957fa640 1 -- 172.21.15.70:0/1128477581 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(83..83 src has 1..83) ==== 8182+0+0 (secure 0 0 0) 0x7f51880f0320 con 0x7f5198100e20 2024-09-19T04:30:42.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.453+0000 7f51977fe640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51800a3320 0x7f51800a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-09-19T04:30:42.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.456+0000 7f51957fa640 1 -- 172.21.15.70:0/1128477581 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f51880bc860 con 0x7f5198100e20 2024-09-19T04:30:42.521 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:42 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:42.266+0000 7fb7805e7040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:30:42.522 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:42.233+0000 7f97bd122040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-09-19T04:30:42.522 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:42 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1934919182' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T04:30:42.522 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:42 smithi134 ceph-mon[34525]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T04:30:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.654+0000 7f51977fe640 1 -- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51800a3320 msgr2=0x7f51800a57e0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.70:6800/4212188848 2024-09-19T04:30:42.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.654+0000 7f51977fe640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51800a3320 0x7f51800a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-09-19T04:30:42.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.668+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f51980fe1b0 con 0x7f5198100e20 2024-09-19T04:30:42.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.668+0000 7f51957fa640 1 -- 172.21.15.70:0/1128477581 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v23) ==== 53+0+73 (secure 0 0 0) 0x7f51880c0b60 con 0x7f5198100e20 2024-09-19T04:30:42.670 INFO:teuthology.orchestra.run.smithi070.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2024-09-19T04:30:42.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51800a3320 msgr2=0x7f51800a57e0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-09-19T04:30:42.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51800a3320 0x7f51800a57e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5198100e20 msgr2=0x7f51980fcc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:42.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5198100e20 0x7f51980fcc80 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f5188031440 tx=0x7f5188004270 comp rx=0 tx=0).stop 2024-09-19T04:30:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 shutdown_connections 2024-09-19T04:30:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:6800/4212188848,v1:172.21.15.70:6801/4212188848] conn(0x7f51800a3320 0x7f51800a57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5198102ef0 0x7f51980fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5198102570 0x7f51980fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 --2- 172.21.15.70:0/1128477581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5198100e20 0x7f51980fcc80 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.670+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 >> 172.21.15.70:0/1128477581 conn(0x7f51980fc7d0 msgr2=0x7f519806a250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.671+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 shutdown_connections 2024-09-19T04:30:42.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:42.671+0000 7f519e704640 1 -- 172.21.15.70:0/1128477581 wait complete. 2024-09-19T04:30:42.785 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:42 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:42.548+0000 7fcaf9e33040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:30:42.785 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:42 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:42.609+0000 7fcaf9e33040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:30:42.792 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:42 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1934919182' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T04:30:42.792 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:42 smithi167 ceph-mon[34339]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T04:30:42.792 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:42.545+0000 7f97bd122040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:30:42.792 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:42.605+0000 7f97bd122040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:30:42.844 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:42 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1934919182' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-09-19T04:30:42.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:42 smithi070 ceph-mon[30942]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-09-19T04:30:42.845 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:42 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:42.591+0000 7fb7805e7040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-09-19T04:30:42.845 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:42 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:42.654+0000 7fb7805e7040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-09-19T04:30:42.845 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:42 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:42.843+0000 7fb7805e7040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:30:43.285 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:42 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:42.796+0000 7fcaf9e33040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:30:43.435 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-09-19T04:30:43.435 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-09-19T04:30:43.435 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi070.front.sepia.ceph.com 2024-09-19T04:30:43.436 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-09-19T04:30:43.436 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:43.436 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-09-19T04:30:43.436 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-09-19T04:30:43.436 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-09-19T04:30:43.436 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-09-19T04:30:43.436 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:43.436 DEBUG:teuthology.orchestra.run.smithi070:> ip addr 2024-09-19T04:30:43.452 INFO:teuthology.orchestra.run.smithi070.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-09-19T04:30:43.452 INFO:teuthology.orchestra.run.smithi070.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: inet 127.0.0.1/8 scope host lo 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 ::1/128 scope host 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b2 brd ff:ff:ff:ff:ff:ff 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f0 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:d8:a4:b3 brd ff:ff:ff:ff:ff:ff 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: altname enp7s0f1 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-09-19T04:30:43.453 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e6 brd ff:ff:ff:ff:ff:ff 2024-09-19T04:30:43.454 INFO:teuthology.orchestra.run.smithi070.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-09-19T04:30:43.454 INFO:teuthology.orchestra.run.smithi070.stdout: link/ether 0c:c4:7a:8f:d3:e7 brd ff:ff:ff:ff:ff:ff 2024-09-19T04:30:43.454 INFO:teuthology.orchestra.run.smithi070.stdout: inet 172.21.15.70/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-09-19T04:30:43.454 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft 42204sec preferred_lft 42204sec 2024-09-19T04:30:43.454 INFO:teuthology.orchestra.run.smithi070.stdout: inet6 fe80::ec4:7aff:fe8f:d3e7/64 scope link noprefixroute 2024-09-19T04:30:43.454 INFO:teuthology.orchestra.run.smithi070.stdout: valid_lft forever preferred_lft forever 2024-09-19T04:30:43.454 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-09-19T04:30:43.454 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:30:43.455 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-19T04:30:43.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add name ceph-brx type bridge 2024-09-19T04:30:43.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr flush dev ceph-brx 2024-09-19T04:30:43.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set ceph-brx up 2024-09-19T04:30:43.455 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-09-19T04:30:43.455 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-19T04:30:43.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:30:43.657 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:43 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1128477581' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:30:43.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:30:43.667 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:43.667 DEBUG:teuthology.orchestra.run.smithi070:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-09-19T04:30:43.693 INFO:teuthology.orchestra.run.smithi070.stdout:1 2024-09-19T04:30:43.695 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:43.695 DEBUG:teuthology.orchestra.run.smithi070:> route 2024-09-19T04:30:43.785 INFO:teuthology.orchestra.run.smithi070.stdout:Kernel IP routing table 2024-09-19T04:30:43.785 INFO:teuthology.orchestra.run.smithi070.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-09-19T04:30:43.785 INFO:teuthology.orchestra.run.smithi070.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-09-19T04:30:43.786 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-09-19T04:30:43.786 INFO:teuthology.orchestra.run.smithi070.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-09-19T04:30:43.786 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:30:43.786 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-19T04:30:43.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-09-19T04:30:43.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-09-19T04:30:43.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-09-19T04:30:43.786 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-19T04:30:43.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:43 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1128477581' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:30:43.787 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:43 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:43.683+0000 7fcaf9e33040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:30:43.787 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:43 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:43.751+0000 7fcaf9e33040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:30:43.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:30:43.948 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:43 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:43.754+0000 7fb7805e7040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:30:43.948 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:43 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:43.825+0000 7fb7805e7040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:30:43.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:43 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1128477581' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-09-19T04:30:43.960 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:42.790+0000 7f97bd122040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-09-19T04:30:43.961 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:43.671+0000 7f97bd122040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-09-19T04:30:43.961 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:43.738+0000 7f97bd122040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-09-19T04:30:44.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:30:44.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:44.055 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-19T04:30:44.070 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:44.071 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list-id 2024-09-19T04:30:44.126 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:30:44.126 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-19T04:30:44.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:44.127 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-09-19T04:30:44.127 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-19T04:30:44.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:30:44.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:30:44.246 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-09-19T04:30:44.246 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:30:44.246 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-19T04:30:44.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-09-19T04:30:44.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-09-19T04:30:44.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-09-19T04:30:44.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-09-19T04:30:44.247 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-09-19T04:30:44.247 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-19T04:30:44.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:30:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:30:44.373 DEBUG:teuthology.orchestra.run.smithi070:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-09-19T04:30:44.373 DEBUG:teuthology.orchestra.run.smithi070:> set -e 2024-09-19T04:30:44.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set brx.0 up 2024-09-19T04:30:44.374 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link set dev brx.0 master ceph-brx 2024-09-19T04:30:44.374 DEBUG:teuthology.orchestra.run.smithi070:> ') 2024-09-19T04:30:44.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-09-19T04:30:44.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:30:44.454 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {'mount_subvol_num': 0} 2024-09-19T04:30:44.454 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T04:30:44.454 DEBUG:teuthology.orchestra.run.smithi070:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:44.469 INFO:teuthology.orchestra.run.smithi070.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-09-19T04:30:44.469 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-09-19T04:30:44.469 DEBUG:teuthology.orchestra.run.smithi070:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:44.524 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-19T04:30:44.592 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-19T04:30:44.649 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:30:44.650 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8fe90312a7d03fb10310a5b91526288047d90f58d47415d5844a22f6822b9128/merged 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5c68fc281ed2226fc46fc25af0014c5fe48b5cfe1fb8ff9c93e487b541d0a3f5/merged 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b02367d57e73433ed0e9b0fee0ea7ca882ae14a36fe8f1fcc47e97ad2220c29a/merged 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/d9274cea80b517ad9e6f753a95556d59528628fbe31db1c4719ac618eda21258/merged 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5721c8077d4b4592d8a8d25fe39a832f4f29947aa71cbd00adb6cbb5c99d3d2b/merged 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3095b8493438a875afff224a6f37ba9d7e8a462fc66c94425fd5a5459eac7b48/merged 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/65821401ab41106f6b883b99ba831b5df6fe084f7ff7e0c4013b5a6206000e1f/merged 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f1c83755a6aba96c0b25cfe0ead475d49e2485dd25d3e024bdcd9dfb5b7cc8f4/merged 2024-09-19T04:30:44.651 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4a39fdadd8bb6afe07a58eeb3dad642f7e35d38b40f574c8768a9b68e4ce284d/merged 2024-09-19T04:30:44.652 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3411fa8a058cf99545ffb8cd93c584fb1b62c181d52fdb410c8821025628d021/merged 2024-09-19T04:30:44.652 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-19T04:30:44.652 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:44.652 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:44.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:44.652 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-19T04:30:44.705 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-09-19T04:30:44.705 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0 --client_mountpoint=/volumes/qa/sv_0/3a651188-3a6f-40c4-92bf-62db8c710383 --client_fs=cephfs) 2024-09-19T04:30:44.710 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:44.450+0000 7f97bd122040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:30:44.710 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:44.566+0000 7f97bd122040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:30:44.729 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:44 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:44.467+0000 7fcaf9e33040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:30:44.730 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:44 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:44.584+0000 7fcaf9e33040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:30:44.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-19T04:30:44.773 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:30:44.829 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-19T04:30:44.829 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-19T04:30:44.829 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-19T04:30:44.829 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-19T04:30:44.829 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-19T04:30:44.829 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-19T04:30:44.829 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:30:44.830 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8fe90312a7d03fb10310a5b91526288047d90f58d47415d5844a22f6822b9128/merged 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5c68fc281ed2226fc46fc25af0014c5fe48b5cfe1fb8ff9c93e487b541d0a3f5/merged 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b02367d57e73433ed0e9b0fee0ea7ca882ae14a36fe8f1fcc47e97ad2220c29a/merged 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/d9274cea80b517ad9e6f753a95556d59528628fbe31db1c4719ac618eda21258/merged 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5721c8077d4b4592d8a8d25fe39a832f4f29947aa71cbd00adb6cbb5c99d3d2b/merged 2024-09-19T04:30:44.831 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3095b8493438a875afff224a6f37ba9d7e8a462fc66c94425fd5a5459eac7b48/merged 2024-09-19T04:30:44.832 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/65821401ab41106f6b883b99ba831b5df6fe084f7ff7e0c4013b5a6206000e1f/merged 2024-09-19T04:30:44.832 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f1c83755a6aba96c0b25cfe0ead475d49e2485dd25d3e024bdcd9dfb5b7cc8f4/merged 2024-09-19T04:30:44.832 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4a39fdadd8bb6afe07a58eeb3dad642f7e35d38b40f574c8768a9b68e4ce284d/merged 2024-09-19T04:30:44.832 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3411fa8a058cf99545ffb8cd93c584fb1b62c181d52fdb410c8821025628d021/merged 2024-09-19T04:30:44.832 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-19T04:30:44.832 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:44.832 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:44.832 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:44.832 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-19T04:30:44.851 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:44 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:44.578+0000 7fb7805e7040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-09-19T04:30:44.851 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:44 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:44.699+0000 7fb7805e7040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-09-19T04:30:44.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:2024-09-19T04:30:44.862+0000 7f69daf47480 -1 init, newargv = 0x5606a7ae9c60 newargc=15 2024-09-19T04:30:44.863 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[79472]: starting ceph client 2024-09-19T04:30:44.991 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:44.709+0000 7f97bd122040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:30:44.992 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:44.770+0000 7f97bd122040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:30:44.992 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:44.921+0000 7f97bd122040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:30:44.992 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:44.989+0000 7f97bd122040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:30:45.012 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:44 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:44.728+0000 7fcaf9e33040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:30:45.012 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:44 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:44.790+0000 7fcaf9e33040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:30:45.013 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:44 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:44.943+0000 7fcaf9e33040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:30:45.013 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:45.011+0000 7fcaf9e33040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:30:45.132 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:44 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:44.850+0000 7fb7805e7040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-09-19T04:30:45.132 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:44 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:44.915+0000 7fb7805e7040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-09-19T04:30:45.132 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.062+0000 7fb7805e7040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-09-19T04:30:45.132 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.130+0000 7fb7805e7040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-09-19T04:30:45.273 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:45.049+0000 7f97bd122040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:30:45.273 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:45.206+0000 7f97bd122040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:30:45.273 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:45.270+0000 7f97bd122040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:30:45.285 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:45.071+0000 7fcaf9e33040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:30:45.285 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:45.229+0000 7fcaf9e33040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:30:45.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.190+0000 7fb7805e7040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-09-19T04:30:45.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.347+0000 7fb7805e7040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-09-19T04:30:45.539 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:45.337+0000 7f97bd122040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:30:45.539 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:45.418+0000 7f97bd122040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:30:45.539 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:45.477+0000 7f97bd122040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:30:45.539 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:45.537+0000 7f97bd122040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:30:45.565 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:45.295+0000 7fcaf9e33040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:30:45.565 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:45.362+0000 7fcaf9e33040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:30:45.565 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:45.443+0000 7fcaf9e33040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:30:45.565 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:45.504+0000 7fcaf9e33040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:30:45.565 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:45.563+0000 7fcaf9e33040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:30:45.681 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.412+0000 7fb7805e7040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-09-19T04:30:45.681 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.478+0000 7fb7805e7040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-09-19T04:30:45.681 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.560+0000 7fb7805e7040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-09-19T04:30:45.681 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.621+0000 7fb7805e7040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-09-19T04:30:45.681 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:45.679+0000 7fb7805e7040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-09-19T04:30:45.969 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-19T04:30:45.996 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:30:46.052 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-19T04:30:46.052 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:30:46.053 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8fe90312a7d03fb10310a5b91526288047d90f58d47415d5844a22f6822b9128/merged 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5c68fc281ed2226fc46fc25af0014c5fe48b5cfe1fb8ff9c93e487b541d0a3f5/merged 2024-09-19T04:30:46.054 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b02367d57e73433ed0e9b0fee0ea7ca882ae14a36fe8f1fcc47e97ad2220c29a/merged 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/d9274cea80b517ad9e6f753a95556d59528628fbe31db1c4719ac618eda21258/merged 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5721c8077d4b4592d8a8d25fe39a832f4f29947aa71cbd00adb6cbb5c99d3d2b/merged 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3095b8493438a875afff224a6f37ba9d7e8a462fc66c94425fd5a5459eac7b48/merged 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/65821401ab41106f6b883b99ba831b5df6fe084f7ff7e0c4013b5a6206000e1f/merged 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f1c83755a6aba96c0b25cfe0ead475d49e2485dd25d3e024bdcd9dfb5b7cc8f4/merged 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4a39fdadd8bb6afe07a58eeb3dad642f7e35d38b40f574c8768a9b68e4ce284d/merged 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3411fa8a058cf99545ffb8cd93c584fb1b62c181d52fdb410c8821025628d021/merged 2024-09-19T04:30:46.055 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-19T04:30:46.056 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:46.056 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:46.056 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:46.056 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-19T04:30:46.546 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[79472]: starting fuse 2024-09-19T04:30:46.645 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.482+0000 7fb7805e7040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:30:46.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: Standby manager daemon z restarted 2024-09-19T04:30:46.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: Standby manager daemon z started 2024-09-19T04:30:46.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:30:46.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:30:46.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:30:46.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:30:46.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: Standby manager daemon y restarted 2024-09-19T04:30:46.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: Standby manager daemon y started 2024-09-19T04:30:46.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:30:46.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:30:46.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:30:46.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-mon[30942]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:30:46.710 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z[36140]: 2024-09-19T04:30:46.326+0000 7f97bd122040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:30:46.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: Standby manager daemon z restarted 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: Standby manager daemon z started 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: Standby manager daemon y restarted 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: Standby manager daemon y started 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:30:46.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:46 smithi167 ceph-mon[34339]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:30:46.773 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y[35892]: 2024-09-19T04:30:46.357+0000 7fcaf9e33040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-09-19T04:30:46.773 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: Standby manager daemon z restarted 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: Standby manager daemon z started 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.167:0/3759575919' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: Standby manager daemon y restarted 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: Standby manager daemon y started 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-09-19T04:30:46.776 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:46 smithi134 ceph-mon[34525]: from='mgr.? 172.21.15.134:0/1119871143' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-09-19T04:30:47.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.731+0000 7fb6e6df7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.731+0000 7fb6e6df7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.731+0000 7fb6e6df7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.731+0000 7fb6e6df7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.731+0000 7fb6e6df7640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.734+0000 7fb6e963c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.734+0000 7fb6e963c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.734+0000 7fb6e963c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.734+0000 7fb6e963c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:46.734+0000 7fb6e963c640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:47.209 DEBUG:teuthology.orchestra.run.smithi070:> sudo modprobe fuse 2024-09-19T04:30:47.239 DEBUG:teuthology.orchestra.run.smithi070:> cat /proc/self/mounts | awk '{print $2}' 2024-09-19T04:30:47.296 INFO:teuthology.orchestra.run.smithi070.stdout:/proc 2024-09-19T04:30:47.296 INFO:teuthology.orchestra.run.smithi070.stdout:/sys 2024-09-19T04:30:47.296 INFO:teuthology.orchestra.run.smithi070.stdout:/dev 2024-09-19T04:30:47.296 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/security 2024-09-19T04:30:47.296 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/shm 2024-09-19T04:30:47.296 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/pts 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/run 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/cgroup 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/pstore 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/bpf 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/ 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/selinux 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/mqueue 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/dev/hugepages 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/debug 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/tracing 2024-09-19T04:30:47.297 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/fs/fuse/connections 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/sys/kernel/config 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-sysctl.service 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/nfs/rpc_pipefs 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/1000 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/ceph 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/8fe90312a7d03fb10310a5b91526288047d90f58d47415d5844a22f6822b9128/merged 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5c68fc281ed2226fc46fc25af0014c5fe48b5cfe1fb8ff9c93e487b541d0a3f5/merged 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/run/user/0 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/proc/sys/fs/binfmt_misc 2024-09-19T04:30:47.298 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/b02367d57e73433ed0e9b0fee0ea7ca882ae14a36fe8f1fcc47e97ad2220c29a/merged 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/d9274cea80b517ad9e6f753a95556d59528628fbe31db1c4719ac618eda21258/merged 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/5721c8077d4b4592d8a8d25fe39a832f4f29947aa71cbd00adb6cbb5c99d3d2b/merged 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3095b8493438a875afff224a6f37ba9d7e8a462fc66c94425fd5a5459eac7b48/merged 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/65821401ab41106f6b883b99ba831b5df6fe084f7ff7e0c4013b5a6206000e1f/merged 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/f1c83755a6aba96c0b25cfe0ead475d49e2485dd25d3e024bdcd9dfb5b7cc8f4/merged 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/4a39fdadd8bb6afe07a58eeb3dad642f7e35d38b40f574c8768a9b68e4ce284d/merged 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/var/lib/containers/storage/overlay/3411fa8a058cf99545ffb8cd93c584fb1b62c181d52fdb410c8821025628d021/merged 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:30:47.299 INFO:teuthology.orchestra.run.smithi070.stdout:/home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:47.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:47.301 DEBUG:teuthology.orchestra.run.smithi070:> ls /sys/fs/fuse/connections 2024-09-19T04:30:47.356 INFO:teuthology.orchestra.run.smithi070.stdout:120 2024-09-19T04:30:47.357 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [120] 2024-09-19T04:30:47.357 DEBUG:teuthology.orchestra.run.smithi070:> sudo stdin-killer -- python3 -c ' 2024-09-19T04:30:47.357 DEBUG:teuthology.orchestra.run.smithi070:> import glob 2024-09-19T04:30:47.357 DEBUG:teuthology.orchestra.run.smithi070:> import re 2024-09-19T04:30:47.357 DEBUG:teuthology.orchestra.run.smithi070:> import os 2024-09-19T04:30:47.357 DEBUG:teuthology.orchestra.run.smithi070:> import subprocess 2024-09-19T04:30:47.357 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-19T04:30:47.357 DEBUG:teuthology.orchestra.run.smithi070:> def _find_admin_socket(client_name): 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> files = glob.glob(asok_path) 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> # Given a non-glob path, it better be there 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> if "*" not in asok_path: 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> assert(len(files) == 1) 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> return files[0] 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> for f in files: 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> if os.path.exists("/proc/{0}".format(pid)): 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> contents = proc_f.read() 2024-09-19T04:30:47.358 DEBUG:teuthology.orchestra.run.smithi070:> if mountpoint in contents: 2024-09-19T04:30:47.359 DEBUG:teuthology.orchestra.run.smithi070:> return f 2024-09-19T04:30:47.359 DEBUG:teuthology.orchestra.run.smithi070:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-09-19T04:30:47.359 DEBUG:teuthology.orchestra.run.smithi070:> 2024-09-19T04:30:47.359 DEBUG:teuthology.orchestra.run.smithi070:> print(_find_admin_socket("client.0")) 2024-09-19T04:30:47.359 DEBUG:teuthology.orchestra.run.smithi070:> ' 2024-09-19T04:30:47.476 INFO:teuthology.orchestra.run.smithi070.stdout:/var/run/ceph/ceph-client.0.79472.asok 2024-09-19T04:30:47.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-09-19T04:30:47.485 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: Active manager daemon x restarted 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: Activating manager daemon x 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: mgrmap e20: x(active, starting, since 0.0130777s), standbys: y, z 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:30:47.486 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:30:47.487 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:30:47.488 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:30:47.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:30:47.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: Manager daemon x is now available 2024-09-19T04:30:47.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:47.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:30:47.489 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:30:47.490 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.79472.asok 2024-09-19T04:30:47.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:47.490 DEBUG:teuthology.orchestra.run.smithi070:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.79472.asok status 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "metadata": { 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_sha1": "2f599a46ad10e37c929e5c43da2f6907ddcd1961", 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_version": "ceph version 19.1.1-361-g2f599a46 (2f599a46ad10e37c929e5c43da2f6907ddcd1961) squid (stable)", 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "entity_id": "0", 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": "smithi070", 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "pid": "79472", 2024-09-19T04:30:47.626 INFO:teuthology.orchestra.run.smithi070.stdout: "root": "/volumes/qa/sv_0/3a651188-3a6f-40c4-92bf-62db8c710383" 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_count": 0, 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "dentry_pinned_count": 0, 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "id": 15153, 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "inst": { 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "name": { 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "client", 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "num": 15153 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-09-19T04:30:47.627 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2689693009 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": { 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "192.168.0.1:0", 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2689693009 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "inst_str": "client.15153 192.168.0.1:0/2689693009", 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "addr_str": "192.168.0.1:0/2689693009", 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "inode_count": 5, 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_epoch": 23, 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch": 83, 2024-09-19T04:30:47.628 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_epoch_barrier": 0, 2024-09-19T04:30:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "blocklisted": false, 2024-09-19T04:30:47.629 INFO:teuthology.orchestra.run.smithi070.stdout: "fs_name": "cephfs" 2024-09-19T04:30:47.629 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:47.636 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:47.636 DEBUG:teuthology.orchestra.run.smithi070:> stat --file-system '--printf=%T 2024-09-19T04:30:47.636 DEBUG:teuthology.orchestra.run.smithi070:> ' -- /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:47.651 INFO:teuthology.orchestra.run.smithi070.stdout:fuseblk 2024-09-19T04:30:47.652 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:47.652 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:30:47.652 DEBUG:teuthology.orchestra.run.smithi070:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: Active manager daemon x restarted 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: Activating manager daemon x 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: mgrmap e20: x(active, starting, since 0.0130777s), standbys: y, z 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:30:47.679 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:30:47.680 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:30:47.681 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:30:47.682 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:30:47.682 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:30:47.682 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:30:47.682 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:30:47.682 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: Manager daemon x is now available 2024-09-19T04:30:47.682 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:47.682 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:30:47.682 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:47 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:30:47.714 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: mgrmap e19: x(active, since 8m), standbys: y, z 2024-09-19T04:30:47.714 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: Active manager daemon x restarted 2024-09-19T04:30:47.714 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: Activating manager daemon x 2024-09-19T04:30:47.714 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: osdmap e84: 12 total, 12 up, 12 in 2024-09-19T04:30:47.714 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: mgrmap e20: x(active, starting, since 0.0130777s), standbys: y, z 2024-09-19T04:30:47.714 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:30:47.715 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-09-19T04:30:47.716 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: Manager daemon x is now available 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-09-19T04:30:47.717 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:47 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-09-19T04:30:47.720 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T04:30:47.732 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T04:30:47.732 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:30:47.732 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate false' 2024-09-19T04:30:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 -- 172.21.15.70:0/2646641322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24001025e0 msgr2=0x7f24001049d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:47.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 --2- 172.21.15.70:0/2646641322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24001025e0 0x7f24001049d0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f23fc009900 tx=0x7f23fc02a410 comp rx=0 tx=0).stop 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 -- 172.21.15.70:0/2646641322 shutdown_connections 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 --2- 172.21.15.70:0/2646641322 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2400107840 0x7f2400109cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 --2- 172.21.15.70:0/2646641322 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2400104f10 0x7f2400107300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 --2- 172.21.15.70:0/2646641322 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24001025e0 0x7f24001049d0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 -- 172.21.15.70:0/2646641322 >> 172.21.15.70:0/2646641322 conn(0x7f24000fc1e0 msgr2=0x7f24000fe600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 -- 172.21.15.70:0/2646641322 shutdown_connections 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 -- 172.21.15.70:0/2646641322 wait complete. 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 Processor -- start 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.862+0000 7f2407eed640 1 -- start start 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2407eed640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24001025e0 0x7f2400197e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2407eed640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400104f10 0x7f24001983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:47.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2407eed640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2400107840 0x7f240019f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2407eed640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f240010d800 con 0x7f2400104f10 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2407eed640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f240010d680 con 0x7f2400107840 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2407eed640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f240010d980 con 0x7f24001025e0 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400104f10 0x7f24001983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400104f10 0x7f24001983d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56616/0 (socket says 172.21.15.70:56616) 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 -- 172.21.15.70:0/1717248423 learned_addr learned my addr 172.21.15.70:0/1717248423 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405c89640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24001025e0 0x7f2400197e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f240648a640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2400107840 0x7f240019f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 -- 172.21.15.70:0/1717248423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24001025e0 msgr2=0x7f2400197e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24001025e0 0x7f2400197e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 -- 172.21.15.70:0/1717248423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2400107840 msgr2=0x7f240019f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2400107840 0x7f240019f440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:47.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 -- 172.21.15.70:0/1717248423 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f240019fab0 con 0x7f2400104f10 2024-09-19T04:30:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f240648a640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2400107840 0x7f240019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2405488640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400104f10 0x7f24001983d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005fd0 tx=0x7f23f000dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f23f6ffd640 1 -- 172.21.15.70:0/1717248423 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0017070 con 0x7f2400104f10 2024-09-19T04:30:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f240019fda0 con 0x7f2400104f10 2024-09-19T04:30:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f23f6ffd640 1 -- 172.21.15.70:0/1717248423 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f23f0009c30 con 0x7f2400104f10 2024-09-19T04:30:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f23f6ffd640 1 -- 172.21.15.70:0/1717248423 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f23f0003e20 con 0x7f2400104f10 2024-09-19T04:30:47.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.863+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24001a0270 con 0x7f2400104f10 2024-09-19T04:30:47.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.864+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f24000fdcd0 con 0x7f2400104f10 2024-09-19T04:30:47.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.865+0000 7f23f6ffd640 1 -- 172.21.15.70:0/1717248423 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f23f0004020 con 0x7f2400104f10 2024-09-19T04:30:47.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.866+0000 7f23f6ffd640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f23ec0a3100 0x7f23ec0a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:47.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.866+0000 7f2405c89640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f23ec0a3100 0x7f23ec0a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:47.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.866+0000 7f23f6ffd640 1 -- 172.21.15.70:0/1717248423 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f23f00cf320 con 0x7f2400104f10 2024-09-19T04:30:47.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.867+0000 7f2405c89640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f23ec0a3100 0x7f23ec0a55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23fc000c00 tx=0x7f23fc031510 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:47.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:47.870+0000 7f23f6ffd640 1 -- 172.21.15.70:0/1717248423 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f23f0020030 con 0x7f2400104f10 2024-09-19T04:30:48.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.081+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"} v 0) -- 0x7f2400062e90 con 0x7f2400104f10 2024-09-19T04:30:48.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:47.952+0000 7fb6d3e52640 -1 log_channel(cephadm) log [ERR] : [19/Sep/2024:04:30:47] ENGINE Error in HTTPServer.serve 2024-09-19T04:30:48.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: Traceback (most recent call last): 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._connections.run(self.expiration_interval) 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._run(expiration_interval) 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:30:48.146 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: s = self.context.wrap_socket( 2024-09-19T04:30:48.147 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:30:48.147 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: return self.sslsocket_class._create( 2024-09-19T04:30:48.147 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:30:48.147 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self.do_handshake() 2024-09-19T04:30:48.147 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:30:48.147 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: self._sslobj.do_handshake() 2024-09-19T04:30:48.147 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:30:48.147 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:48.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.495+0000 7f23f6ffd640 1 -- 172.21.15.70:0/1717248423 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]=0 v24) ==== 118+0+0 (secure 0 0 0) 0x7f23f009c230 con 0x7f2400104f10 2024-09-19T04:30:48.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f23ec0a3100 msgr2=0x7f23ec0a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:48.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f23ec0a3100 0x7f23ec0a55c0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f23fc000c00 tx=0x7f23fc031510 comp rx=0 tx=0).stop 2024-09-19T04:30:48.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400104f10 msgr2=0x7f24001983d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400104f10 0x7f24001983d0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f23f0005fd0 tx=0x7f23f000dde0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 shutdown_connections 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f23ec0a3100 0x7f23ec0a55c0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2400107840 0x7f240019f440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2400104f10 0x7f24001983d0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 --2- 172.21.15.70:0/1717248423 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24001025e0 0x7f2400197e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.497+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 >> 172.21.15.70:0/1717248423 conn(0x7f24000fc1e0 msgr2=0x7f2400102f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.498+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 shutdown_connections 2024-09-19T04:30:48.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.498+0000 7f2407eed640 1 -- 172.21.15.70:0/1717248423 wait complete. 2024-09-19T04:30:48.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs subvolumegroup pin cephfs qa random 0.10' 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.622+0000 7f52cabc4640 1 -- 172.21.15.70:0/726512648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c4102670 msgr2=0x7f52c4104a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.622+0000 7f52cabc4640 1 --2- 172.21.15.70:0/726512648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c4102670 0x7f52c4104a60 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f52b8009900 tx=0x7f52b802a410 comp rx=0 tx=0).stop 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 -- 172.21.15.70:0/726512648 shutdown_connections 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 --2- 172.21.15.70:0/726512648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c41078d0 0x7f52c4109cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 --2- 172.21.15.70:0/726512648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52c4104fa0 0x7f52c4107390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 --2- 172.21.15.70:0/726512648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c4102670 0x7f52c4104a60 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 -- 172.21.15.70:0/726512648 >> 172.21.15.70:0/726512648 conn(0x7f52c40fc1b0 msgr2=0x7f52c40fe5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 -- 172.21.15.70:0/726512648 shutdown_connections 2024-09-19T04:30:48.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 -- 172.21.15.70:0/726512648 wait complete. 2024-09-19T04:30:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 Processor -- start 2024-09-19T04:30:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 -- start start 2024-09-19T04:30:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52c4102670 0x7f52c4197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c4104fa0 0x7f52c4198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c41078d0 0x7f52c419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52c410d840 con 0x7f52c41078d0 2024-09-19T04:30:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52c410d6c0 con 0x7f52c4104fa0 2024-09-19T04:30:48.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52cabc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52c410d9c0 con 0x7f52c4102670 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.623+0000 7f52c9161640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c41078d0 0x7f52c419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c9161640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c41078d0 0x7f52c419f400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56658/0 (socket says 172.21.15.70:56658) 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c9161640 1 -- 172.21.15.70:0/1439584700 learned_addr learned my addr 172.21.15.70:0/1439584700 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c3fff640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c4104fa0 0x7f52c4198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c8960640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52c4102670 0x7f52c4197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c9161640 1 -- 172.21.15.70:0/1439584700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52c4102670 msgr2=0x7f52c4197e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c9161640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52c4102670 0x7f52c4197e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c9161640 1 -- 172.21.15.70:0/1439584700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c4104fa0 msgr2=0x7f52c4198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c9161640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c4104fa0 0x7f52c4198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c9161640 1 -- 172.21.15.70:0/1439584700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52c419fa70 con 0x7f52c41078d0 2024-09-19T04:30:48.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c8960640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52c4102670 0x7f52c4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c9161640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c41078d0 0x7f52c419f400 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00eb40 tx=0x7f52bc00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c1ffb640 1 -- 172.21.15.70:0/1439584700 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc004b20 con 0x7f52c41078d0 2024-09-19T04:30:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c1ffb640 1 -- 172.21.15.70:0/1439584700 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f52bc004cc0 con 0x7f52c41078d0 2024-09-19T04:30:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52c419fd60 con 0x7f52c41078d0 2024-09-19T04:30:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52c1ffb640 1 -- 172.21.15.70:0/1439584700 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52bc010850 con 0x7f52c41078d0 2024-09-19T04:30:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.624+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52c41a0200 con 0x7f52c41078d0 2024-09-19T04:30:48.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.625+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52c40fdca0 con 0x7f52c41078d0 2024-09-19T04:30:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.627+0000 7f52c1ffb640 1 -- 172.21.15.70:0/1439584700 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f52bc005000 con 0x7f52c41078d0 2024-09-19T04:30:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.628+0000 7f52c1ffb640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f52b40a3100 0x7f52b40a55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.628+0000 7f52c1ffb640 1 -- 172.21.15.70:0/1439584700 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f52bc0cfe70 con 0x7f52c41078d0 2024-09-19T04:30:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.628+0000 7f52c8960640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f52b40a3100 0x7f52b40a55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:48.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.629+0000 7f52c8960640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f52b40a3100 0x7f52b40a55c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f52b8000c00 tx=0x7f52b8031510 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:48.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.631+0000 7f52c1ffb640 1 -- 172.21.15.70:0/1439584700 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f52bc09ce10 con 0x7f52c41078d0 2024-09-19T04:30:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:48 smithi134 ceph-mon[34525]: mgrmap e21: x(active, since 1.01883s), standbys: y, z 2024-09-19T04:30:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:48 smithi134 ceph-mon[34525]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:48 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1717248423' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T04:30:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:48 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:48.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:48 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:48.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.843+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}) -- 0x7f52c40626d0 con 0x7f52b40a3100 2024-09-19T04:30:48.849 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-mon[30942]: mgrmap e21: x(active, since 1.01883s), standbys: y, z 2024-09-19T04:30:48.849 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-mon[30942]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:48.849 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1717248423' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T04:30:48.849 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:48.849 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:48.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.858+0000 7f52c1ffb640 1 -- 172.21.15.70:0/1439584700 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+3 (secure 0 0 0) 0x7f52c40626d0 con 0x7f52b40a3100 2024-09-19T04:30:48.860 INFO:teuthology.orchestra.run.smithi070.stdout:{} 2024-09-19T04:30:48.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f52b40a3100 msgr2=0x7f52b40a55c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:48.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f52b40a3100 0x7f52b40a55c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f52b8000c00 tx=0x7f52b8031510 comp rx=0 tx=0).stop 2024-09-19T04:30:48.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c41078d0 msgr2=0x7f52c419f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:48.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c41078d0 0x7f52c419f400 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f52bc00eb40 tx=0x7f52bc00c2d0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 shutdown_connections 2024-09-19T04:30:48.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f52b40a3100 0x7f52b40a55c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f52c41078d0 0x7f52c419f400 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f52c4104fa0 0x7f52c4198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 --2- 172.21.15.70:0/1439584700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f52c4102670 0x7f52c4197e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:48.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.860+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 >> 172.21.15.70:0/1439584700 conn(0x7f52c40fc1b0 msgr2=0x7f52c4103010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:48.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.861+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 shutdown_connections 2024-09-19T04:30:48.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:48.861+0000 7f52cabc4640 1 -- 172.21.15.70:0/1439584700 wait complete. 2024-09-19T04:30:48.874 INFO:teuthology.run_tasks:Running task check-counter... 2024-09-19T04:30:48.885 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-09-19T04:30:48.910 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T04:30:48.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:48 smithi167 ceph-mon[34339]: mgrmap e21: x(active, since 1.01883s), standbys: y, z 2024-09-19T04:30:48.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:48 smithi167 ceph-mon[34339]: pgmap v3: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:48.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:48 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1717248423' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]: dispatch 2024-09-19T04:30:48.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:48 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:48.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:48 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 -- 172.21.15.70:0/1920501730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99341077f0 msgr2=0x7f9934109c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 --2- 172.21.15.70:0/1920501730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99341077f0 0x7f9934109c60 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f992c009ca0 tx=0x7f992c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 -- 172.21.15.70:0/1920501730 shutdown_connections 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 --2- 172.21.15.70:0/1920501730 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f99341077f0 0x7f9934109c60 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 --2- 172.21.15.70:0/1920501730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9934104ec0 0x7f99341072b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 --2- 172.21.15.70:0/1920501730 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9934102590 0x7f9934104980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 -- 172.21.15.70:0/1920501730 >> 172.21.15.70:0/1920501730 conn(0x7f99340fc170 msgr2=0x7f99340fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 -- 172.21.15.70:0/1920501730 shutdown_connections 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.011+0000 7f993bfbd640 1 -- 172.21.15.70:0/1920501730 wait complete. 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993bfbd640 1 Processor -- start 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993bfbd640 1 -- start start 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993bfbd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9934102590 0x7f9934197e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993bfbd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9934104ec0 0x7f9934198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993bfbd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99341077f0 0x7f993419f400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993bfbd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f993410d7e0 con 0x7f9934102590 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993bfbd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f993410d660 con 0x7f99341077f0 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993bfbd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f993410d960 con 0x7f9934104ec0 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939d59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9934102590 0x7f9934197e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939d59640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9934102590 0x7f9934197e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56686/0 (socket says 172.21.15.70:56686) 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939d59640 1 -- 172.21.15.70:0/4067965831 learned_addr learned my addr 172.21.15.70:0/4067965831 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939558640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9934104ec0 0x7f9934198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993a55a640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99341077f0 0x7f993419f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939d59640 1 -- 172.21.15.70:0/4067965831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9934104ec0 msgr2=0x7f9934198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939d59640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9934104ec0 0x7f9934198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939d59640 1 -- 172.21.15.70:0/4067965831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99341077f0 msgr2=0x7f993419f400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939d59640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99341077f0 0x7f993419f400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f9939d59640 1 -- 172.21.15.70:0/4067965831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f993419fa70 con 0x7f9934102590 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.012+0000 7f993a55a640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99341077f0 0x7f993419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.013+0000 7f9939d59640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9934102590 0x7f9934197e50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f993000e9f0 tx=0x7f993000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.013+0000 7f992affd640 1 -- 172.21.15.70:0/4067965831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f993000cd80 con 0x7f9934102590 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.013+0000 7f992affd640 1 -- 172.21.15.70:0/4067965831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9930010900 con 0x7f9934102590 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.013+0000 7f992affd640 1 -- 172.21.15.70:0/4067965831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f99300189e0 con 0x7f9934102590 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.013+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f993419fd60 con 0x7f9934102590 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.013+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f99341a01f0 con 0x7f9934102590 2024-09-19T04:30:49.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.014+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f99340fdc60 con 0x7f9934102590 2024-09-19T04:30:49.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.015+0000 7f992affd640 1 -- 172.21.15.70:0/4067965831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f9930010ab0 con 0x7f9934102590 2024-09-19T04:30:49.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.016+0000 7f992affd640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f99200a3050 0x7f99200a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.016+0000 7f992affd640 1 -- 172.21.15.70:0/4067965831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f99300cfe30 con 0x7f9934102590 2024-09-19T04:30:49.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.016+0000 7f9939558640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f99200a3050 0x7f99200a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.016+0000 7f9939558640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f99200a3050 0x7f99200a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9934199360 tx=0x7f9924005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:49.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.020+0000 7f992affd640 1 -- 172.21.15.70:0/4067965831 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f993009cd40 con 0x7f9934102590 2024-09-19T04:30:49.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:48.847+0000 7fb6e4df3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:49.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:48.847+0000 7fb6e4df3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:49.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:48.847+0000 7fb6e4df3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:49.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:48.847+0000 7fb6e4df3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:49.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:30:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:30:48.847+0000 7fb6e4df3640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:30:49.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.200+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9934062f30 con 0x7f9934102590 2024-09-19T04:30:49.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.201+0000 7f992affd640 1 -- 172.21.15.70:0/4067965831 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+23117 (secure 0 0 0) 0x7f993009c640 con 0x7f9934102590 2024-09-19T04:30:49.203 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:49.203 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":84,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:30:46.485035+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/4212188848":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/3933277587":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/544441745":"2024-09-20T04:30:46.484972+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/999804527":"2024-09-20T04:30:46.484972+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/4212188848":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/2420707462":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/3999565316":"2024-09-20T04:30:46.484972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f99200a3050 msgr2=0x7f99200a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f99200a3050 0x7f99200a5510 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f9934199360 tx=0x7f9924005f90 comp rx=0 tx=0).stop 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9934102590 msgr2=0x7f9934197e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9934102590 0x7f9934197e50 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f993000e9f0 tx=0x7f993000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 shutdown_connections 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f99200a3050 0x7f99200a5510 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f99341077f0 0x7f993419f400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9934104ec0 0x7f9934198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 --2- 172.21.15.70:0/4067965831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9934102590 0x7f9934197e50 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 >> 172.21.15.70:0/4067965831 conn(0x7f99340fc170 msgr2=0x7f9934102e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:49.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 shutdown_connections 2024-09-19T04:30:49.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.203+0000 7f993bfbd640 1 -- 172.21.15.70:0/4067965831 wait complete. 2024-09-19T04:30:49.217 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T04:24:31.609825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T04:28:59.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T04:29:01.143246+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T04:30:49.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 -- 172.21.15.70:0/289396943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c14100a00 msgr2=0x7f2c14100e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 --2- 172.21.15.70:0/289396943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c14100a00 0x7f2c14100e00 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f2c04009900 tx=0x7f2c0402a410 comp rx=0 tx=0).stop 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 -- 172.21.15.70:0/289396943 shutdown_connections 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 --2- 172.21.15.70:0/289396943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c141025b0 0x7f2c14108e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 --2- 172.21.15.70:0/289396943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c14101bf0 0x7f2c14102070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 --2- 172.21.15.70:0/289396943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c14100a00 0x7f2c14100e00 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 -- 172.21.15.70:0/289396943 >> 172.21.15.70:0/289396943 conn(0x7f2c140fc140 msgr2=0x7f2c140fe5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 -- 172.21.15.70:0/289396943 shutdown_connections 2024-09-19T04:30:49.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.327+0000 7f2c1a986640 1 -- 172.21.15.70:0/289396943 wait complete. 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c1a986640 1 Processor -- start 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c1a986640 1 -- start start 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c1a986640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c14100a00 0x7f2c14196d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c1a986640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c14101bf0 0x7f2c14197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c1a986640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c141025b0 0x7f2c1419e300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c1a986640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1410c690 con 0x7f2c141025b0 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c1a986640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1410c510 con 0x7f2c14100a00 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c1a986640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c1410c810 con 0x7f2c14101bf0 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c18f23640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c141025b0 0x7f2c1419e300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c18f23640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c141025b0 0x7f2c1419e300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56698/0 (socket says 172.21.15.70:56698) 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c18f23640 1 -- 172.21.15.70:0/3869163048 learned_addr learned my addr 172.21.15.70:0/3869163048 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c0bfff640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c14101bf0 0x7f2c14197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c13fff640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c14100a00 0x7f2c14196d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c18f23640 1 -- 172.21.15.70:0/3869163048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c14101bf0 msgr2=0x7f2c14197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c18f23640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c14101bf0 0x7f2c14197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c18f23640 1 -- 172.21.15.70:0/3869163048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c14100a00 msgr2=0x7f2c14196d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c18f23640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c14100a00 0x7f2c14196d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c18f23640 1 -- 172.21.15.70:0/3869163048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c1419e970 con 0x7f2c141025b0 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.328+0000 7f2c0bfff640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c14101bf0 0x7f2c14197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.329+0000 7f2c18f23640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c141025b0 0x7f2c1419e300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00eb10 tx=0x7f2c0c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.329+0000 7f2c11ffb640 1 -- 172.21.15.70:0/3869163048 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c004b20 con 0x7f2c141025b0 2024-09-19T04:30:49.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.329+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c1419ec60 con 0x7f2c141025b0 2024-09-19T04:30:49.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.329+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c1419f1b0 con 0x7f2c141025b0 2024-09-19T04:30:49.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.329+0000 7f2c11ffb640 1 -- 172.21.15.70:0/3869163048 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2c0c004cc0 con 0x7f2c141025b0 2024-09-19T04:30:49.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.329+0000 7f2c11ffb640 1 -- 172.21.15.70:0/3869163048 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c0c010700 con 0x7f2c141025b0 2024-09-19T04:30:49.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.330+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c14107eb0 con 0x7f2c141025b0 2024-09-19T04:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.331+0000 7f2c11ffb640 1 -- 172.21.15.70:0/3869163048 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 21) ==== 138167+0+0 (secure 0 0 0) 0x7f2c0c004e70 con 0x7f2c141025b0 2024-09-19T04:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.332+0000 7f2c11ffb640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c000a3050 0x7f2c000a5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.332+0000 7f2c13fff640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c000a3050 0x7f2c000a5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.332+0000 7f2c11ffb640 1 -- 172.21.15.70:0/3869163048 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2c0c0cfb90 con 0x7f2c141025b0 2024-09-19T04:30:49.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.332+0000 7f2c13fff640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c000a3050 0x7f2c000a5510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c04006010 tx=0x7f2c04031510 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:49.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.337+0000 7f2c11ffb640 1 -- 172.21.15.70:0/3869163048 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c0c09caa0 con 0x7f2c141025b0 2024-09-19T04:30:49.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.424+0000 7f2c11ffb640 1 -- 172.21.15.70:0/3869163048 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7f2c0c098a10 con 0x7f2c141025b0 2024-09-19T04:30:49.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.522+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2c14062df0 con 0x7f2c141025b0 2024-09-19T04:30:49.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.523+0000 7f2c11ffb640 1 -- 172.21.15.70:0/3869163048 <== mon.0 v2:172.21.15.70:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v84) ==== 93+0+10 (secure 0 0 0) 0x7f2c0c061550 con 0x7f2c141025b0 2024-09-19T04:30:49.525 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-19T04:30:49.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c000a3050 msgr2=0x7f2c000a5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c000a3050 0x7f2c000a5510 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f2c04006010 tx=0x7f2c04031510 comp rx=0 tx=0).stop 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c141025b0 msgr2=0x7f2c1419e300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c141025b0 0x7f2c1419e300 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c00eb10 tx=0x7f2c0c00c2d0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 shutdown_connections 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c000a3050 0x7f2c000a5510 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c141025b0 0x7f2c1419e300 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c14101bf0 0x7f2c14197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 --2- 172.21.15.70:0/3869163048 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c14100a00 0x7f2c14196d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 >> 172.21.15.70:0/3869163048 conn(0x7f2c140fc140 msgr2=0x7f2c14105080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 shutdown_connections 2024-09-19T04:30:49.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.525+0000 7f2c1a986640 1 -- 172.21.15.70:0/3869163048 wait complete. 2024-09-19T04:30:49.538 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T04:30:49.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.646+0000 7f74aae9b640 1 -- 172.21.15.70:0/4085738126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4100c70 msgr2=0x7f74a41010f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.646+0000 7f74aae9b640 1 --2- 172.21.15.70:0/4085738126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4100c70 0x7f74a41010f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7490009900 tx=0x7f749002a410 comp rx=0 tx=0).stop 2024-09-19T04:30:49.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.646+0000 7f74aae9b640 1 -- 172.21.15.70:0/4085738126 shutdown_connections 2024-09-19T04:30:49.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.646+0000 7f74aae9b640 1 --2- 172.21.15.70:0/4085738126 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a4101630 0x7f74a4108ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.646+0000 7f74aae9b640 1 --2- 172.21.15.70:0/4085738126 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4100c70 0x7f74a41010f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.646+0000 7f74aae9b640 1 --2- 172.21.15.70:0/4085738126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a4102020 0x7f74a4102420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.646+0000 7f74aae9b640 1 -- 172.21.15.70:0/4085738126 >> 172.21.15.70:0/4085738126 conn(0x7f74a40fb910 msgr2=0x7f74a40fdd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:49.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 -- 172.21.15.70:0/4085738126 shutdown_connections 2024-09-19T04:30:49.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 -- 172.21.15.70:0/4085738126 wait complete. 2024-09-19T04:30:49.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 Processor -- start 2024-09-19T04:30:49.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 -- start start 2024-09-19T04:30:49.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a4101630 0x7f74a419e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4102020 0x7f74a419ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a41a3cd0 0x7f74a41a60c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74a410b590 con 0x7f74a4102020 2024-09-19T04:30:49.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74a410b410 con 0x7f74a41a3cd0 2024-09-19T04:30:49.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.647+0000 7f74aae9b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74a410b710 con 0x7f74a4101630 2024-09-19T04:30:49.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4102020 0x7f74a419ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4102020 0x7f74a419ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56730/0 (socket says 172.21.15.70:56730) 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 -- 172.21.15.70:0/2267568119 learned_addr learned my addr 172.21.15.70:0/2267568119 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a8c37640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a4101630 0x7f74a419e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a9438640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a41a3cd0 0x7f74a41a60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 -- 172.21.15.70:0/2267568119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a4101630 msgr2=0x7f74a419e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a4101630 0x7f74a419e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 -- 172.21.15.70:0/2267568119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a41a3cd0 msgr2=0x7f74a41a60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a41a3cd0 0x7f74a41a60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 -- 172.21.15.70:0/2267568119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74a41a6730 con 0x7f74a4102020 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a3fff640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4102020 0x7f74a419ed30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7490004770 tx=0x7f74900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a1ffb640 1 -- 172.21.15.70:0/2267568119 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f749003f030 con 0x7f74a4102020 2024-09-19T04:30:49.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a1ffb640 1 -- 172.21.15.70:0/2267568119 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7490003ac0 con 0x7f74a4102020 2024-09-19T04:30:49.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74a41a6960 con 0x7f74a4102020 2024-09-19T04:30:49.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.648+0000 7f74a1ffb640 1 -- 172.21.15.70:0/2267568119 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7490035070 con 0x7f74a4102020 2024-09-19T04:30:49.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.649+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74a41a6e00 con 0x7f74a4102020 2024-09-19T04:30:49.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.650+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f74a41a7030 con 0x7f74a4102020 2024-09-19T04:30:49.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.651+0000 7f74a1ffb640 1 -- 172.21.15.70:0/2267568119 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7f7490042030 con 0x7f74a4102020 2024-09-19T04:30:49.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.651+0000 7f74a1ffb640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f74940a33c0 0x7f74940a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.652+0000 7f74a1ffb640 1 -- 172.21.15.70:0/2267568119 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f74900f00e0 con 0x7f74a4102020 2024-09-19T04:30:49.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.652+0000 7f74a8c37640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f74940a33c0 0x7f74940a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.652+0000 7f74a8c37640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f74940a33c0 0x7f74940a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74a419fc40 tx=0x7f7498005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:49.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.656+0000 7f74a1ffb640 1 -- 172.21.15.70:0/2267568119 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7490049030 con 0x7f74a4102020 2024-09-19T04:30:49.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: [19/Sep/2024:04:30:47] ENGINE Bus STARTING 2024-09-19T04:30:49.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: [19/Sep/2024:04:30:47] ENGINE Serving on https://172.21.15.70:7150 2024-09-19T04:30:49.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: [19/Sep/2024:04:30:47] ENGINE Error in HTTPServer.serve 2024-09-19T04:30:49.785 INFO:journalctl@ceph.mon.b.smithi134.stdout: Traceback (most recent call last): 2024-09-19T04:30:49.785 INFO:journalctl@ceph.mon.b.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: self._run(expiration_interval) 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: s = self.context.wrap_socket( 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: return self.sslsocket_class._create( 2024-09-19T04:30:49.786 INFO:journalctl@ceph.mon.b.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout: self.do_handshake() 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout: self._sslobj.do_handshake() 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: [19/Sep/2024:04:30:48] ENGINE Serving on http://172.21.15.70:8765 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: [19/Sep/2024:04:30:48] ENGINE Bus STARTED 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1717248423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4067965831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.788 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:49.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:49.789 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:49 smithi134 ceph-mon[34525]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T04:30:49.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.858+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f74a41a7200 con 0x7f74a4102020 2024-09-19T04:30:49.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.858+0000 7f74a1ffb640 1 -- 172.21.15.70:0/2267568119 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v84) ==== 104+0+11 (secure 0 0 0) 0x7f74900bc490 con 0x7f74a4102020 2024-09-19T04:30:49.860 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-19T04:30:49.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.860+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f74940a33c0 msgr2=0x7f74940a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.860+0000 7f74aae9b640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f74940a33c0 0x7f74940a5880 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f74a419fc40 tx=0x7f7498005f90 comp rx=0 tx=0).stop 2024-09-19T04:30:49.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.860+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4102020 msgr2=0x7f74a419ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.860+0000 7f74aae9b640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4102020 0x7f74a419ed30 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7490004770 tx=0x7f74900042f0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.860+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 shutdown_connections 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.860+0000 7f74aae9b640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f74940a33c0 0x7f74940a5880 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.861+0000 7f74aae9b640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74a41a3cd0 0x7f74a41a60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.861+0000 7f74aae9b640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f74a4102020 0x7f74a419ed30 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.861+0000 7f74aae9b640 1 --2- 172.21.15.70:0/2267568119 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f74a4101630 0x7f74a419e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.861+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 >> 172.21.15.70:0/2267568119 conn(0x7f74a40fb910 msgr2=0x7f74a410e2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.861+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 shutdown_connections 2024-09-19T04:30:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.861+0000 7f74aae9b640 1 -- 172.21.15.70:0/2267568119 wait complete. 2024-09-19T04:30:49.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: [19/Sep/2024:04:30:47] ENGINE Bus STARTING 2024-09-19T04:30:49.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: [19/Sep/2024:04:30:47] ENGINE Serving on https://172.21.15.70:7150 2024-09-19T04:30:49.873 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: [19/Sep/2024:04:30:47] ENGINE Error in HTTPServer.serve 2024-09-19T04:30:49.873 INFO:journalctl@ceph.mon.a.smithi070.stdout: Traceback (most recent call last): 2024-09-19T04:30:49.873 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:30:49.873 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:30:49.873 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._run(expiration_interval) 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: s = self.context.wrap_socket( 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: return self.sslsocket_class._create( 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: self.do_handshake() 2024-09-19T04:30:49.874 INFO:journalctl@ceph.mon.a.smithi070.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout: self._sslobj.do_handshake() 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: [19/Sep/2024:04:30:48] ENGINE Serving on http://172.21.15.70:8765 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: [19/Sep/2024:04:30:48] ENGINE Bus STARTED 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1717248423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.875 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4067965831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.876 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:49.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:49.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:49 smithi070 ceph-mon[30942]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T04:30:49.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: [19/Sep/2024:04:30:47] ENGINE Bus STARTING 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: [19/Sep/2024:04:30:47] ENGINE Serving on https://172.21.15.70:7150 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: [19/Sep/2024:04:30:47] ENGINE Error in HTTPServer.serve 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout: Traceback (most recent call last): 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout: self._connections.run(self.expiration_interval) 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout: self._run(expiration_interval) 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-09-19T04:30:49.961 INFO:journalctl@ceph.mon.c.smithi167.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: s = self.context.wrap_socket( 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: return self.sslsocket_class._create( 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: self.do_handshake() 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: self._sslobj.do_handshake() 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: [19/Sep/2024:04:30:48] ENGINE Serving on http://172.21.15.70:8765 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: [19/Sep/2024:04:30:48] ENGINE Bus STARTED 2024-09-19T04:30:49.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1717248423' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "false"}]': finished 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: pgmap v4: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4067965831' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:49.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:49.964 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:49.965 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:49 smithi167 ceph-mon[34339]: mgrmap e22: x(active, since 2s), standbys: y, z 2024-09-19T04:30:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 -- 172.21.15.70:0/1682534387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0106990 msgr2=0x7fc3d0106d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 --2- 172.21.15.70:0/1682534387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0106990 0x7fc3d0106d70 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc009930 tx=0x7fc3cc02a420 comp rx=0 tx=0).stop 2024-09-19T04:30:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 -- 172.21.15.70:0/1682534387 shutdown_connections 2024-09-19T04:30:49.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 --2- 172.21.15.70:0/1682534387 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d0101320 0x7fc3d010d850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 --2- 172.21.15.70:0/1682534387 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3d0100980 0x7fc3d0100de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 --2- 172.21.15.70:0/1682534387 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0106990 0x7fc3d0106d70 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 -- 172.21.15.70:0/1682534387 >> 172.21.15.70:0/1682534387 conn(0x7fc3d00779d0 msgr2=0x7fc3d00fed90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 -- 172.21.15.70:0/1682534387 shutdown_connections 2024-09-19T04:30:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.981+0000 7fc3d838d640 1 -- 172.21.15.70:0/1682534387 wait complete. 2024-09-19T04:30:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d838d640 1 Processor -- start 2024-09-19T04:30:49.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d838d640 1 -- start start 2024-09-19T04:30:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d838d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3d0100980 0x7fc3d0197080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d838d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0101320 0x7fc3d01975c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d838d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d0106990 0x7fc3d0197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d838d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0110da0 con 0x7fc3d0101320 2024-09-19T04:30:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d838d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0110c20 con 0x7fc3d0100980 2024-09-19T04:30:49.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d838d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3d0110f20 con 0x7fc3d0106990 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d5928640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0101320 0x7fc3d01975c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d5928640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0101320 0x7fc3d01975c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56750/0 (socket says 172.21.15.70:56750) 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d5928640 1 -- 172.21.15.70:0/80110825 learned_addr learned my addr 172.21.15.70:0/80110825 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d692a640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d0106990 0x7fc3d0197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.982+0000 7fc3d6129640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3d0100980 0x7fc3d0197080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3d5928640 1 -- 172.21.15.70:0/80110825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d0106990 msgr2=0x7fc3d0197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3d5928640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d0106990 0x7fc3d0197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3d5928640 1 -- 172.21.15.70:0/80110825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3d0100980 msgr2=0x7fc3d0197080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3d5928640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3d0100980 0x7fc3d0197080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3d5928640 1 -- 172.21.15.70:0/80110825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3d01a68f0 con 0x7fc3d0101320 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3d5928640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0101320 0x7fc3d01975c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000e9f0 tx=0x7fc3c000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3c77fe640 1 -- 172.21.15.70:0/80110825 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c000cd80 con 0x7fc3d0101320 2024-09-19T04:30:49.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3d01a6be0 con 0x7fc3d0101320 2024-09-19T04:30:49.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3c77fe640 1 -- 172.21.15.70:0/80110825 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc3c0010900 con 0x7fc3d0101320 2024-09-19T04:30:49.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3c77fe640 1 -- 172.21.15.70:0/80110825 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3c00189e0 con 0x7fc3d0101320 2024-09-19T04:30:49.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.983+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3d01a7180 con 0x7fc3d0101320 2024-09-19T04:30:49.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.984+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3d0100de0 con 0x7fc3d0101320 2024-09-19T04:30:49.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.985+0000 7fc3c77fe640 1 -- 172.21.15.70:0/80110825 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7fc3c0010ab0 con 0x7fc3d0101320 2024-09-19T04:30:49.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.986+0000 7fc3c77fe640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3bc0a33c0 0x7fc3bc0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:49.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.986+0000 7fc3c77fe640 1 -- 172.21.15.70:0/80110825 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc3c00cffc0 con 0x7fc3d0101320 2024-09-19T04:30:49.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.986+0000 7fc3d6129640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3bc0a33c0 0x7fc3bc0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:49.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.987+0000 7fc3d6129640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3bc0a33c0 0x7fc3bc0a5880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0314b0 tx=0x7fc3cc0058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:49.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:49.990+0000 7fc3c77fe640 1 -- 172.21.15.70:0/80110825 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3c009c370 con 0x7fc3d0101320 2024-09-19T04:30:50.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.169+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fc3d002d7c0 con 0x7fc3d0101320 2024-09-19T04:30:50.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.170+0000 7fc3c77fe640 1 -- 172.21.15.70:0/80110825 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v84) ==== 100+0+11 (secure 0 0 0) 0x7fc3c00a0670 con 0x7fc3d0101320 2024-09-19T04:30:50.171 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3bc0a33c0 msgr2=0x7fc3bc0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3bc0a33c0 0x7fc3bc0a5880 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc3cc0314b0 tx=0x7fc3cc0058d0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0101320 msgr2=0x7fc3d01975c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0101320 0x7fc3d01975c0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fc3c000e9f0 tx=0x7fc3c000eeb0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 shutdown_connections 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3bc0a33c0 0x7fc3bc0a5880 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3d0106990 0x7fc3d0197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3d0101320 0x7fc3d01975c0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 --2- 172.21.15.70:0/80110825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3d0100980 0x7fc3d0197080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 >> 172.21.15.70:0/80110825 conn(0x7fc3d00779d0 msgr2=0x7fc3d0103910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 shutdown_connections 2024-09-19T04:30:50.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.172+0000 7fc3d838d640 1 -- 172.21.15.70:0/80110825 wait complete. 2024-09-19T04:30:50.187 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-09-19T04:30:50.188 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:30:50.448 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-19T04:30:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Unable to set osd_memory_target on smithi134 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T04:30:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Unable to set osd_memory_target on smithi167 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Unable to set osd_memory_target on smithi070 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3869163048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2267568119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/80110825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:50.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:50 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Unable to set osd_memory_target on smithi134 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Unable to set osd_memory_target on smithi167 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Unable to set osd_memory_target on smithi070 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-19T04:30:50.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3869163048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2267568119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/80110825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:50.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:50.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:50.857 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:50 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='client.15204 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup pin", "vol_name": "cephfs", "group_name": "qa", "pin_type": "random", "pin_setting": "0.10", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-19T04:30:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Unable to set osd_memory_target on smithi134 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T04:30:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T04:30:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Unable to set osd_memory_target on smithi167 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T04:30:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-19T04:30:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Unable to set osd_memory_target on smithi070 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-19T04:30:50.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Updating smithi070:/etc/ceph/ceph.conf 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Updating smithi134:/etc/ceph/ceph.conf 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Updating smithi167:/etc/ceph/ceph.conf 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.conf 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3869163048' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2267568119' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/80110825' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:50.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:50.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:50.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:50 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:50.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 -- 172.21.15.70:0/517373312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102ef0 msgr2=0x7ff58010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 --2- 172.21.15.70:0/517373312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102ef0 0x7ff58010da40 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7ff578009ca0 tx=0x7ff57802a950 comp rx=0 tx=0).stop 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 -- 172.21.15.70:0/517373312 shutdown_connections 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 --2- 172.21.15.70:0/517373312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102ef0 0x7ff58010da40 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 --2- 172.21.15.70:0/517373312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff580102570 0x7ff5801029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 --2- 172.21.15.70:0/517373312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff580100e20 0x7ff580101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 -- 172.21.15.70:0/517373312 >> 172.21.15.70:0/517373312 conn(0x7ff5800fc7d0 msgr2=0x7ff5800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 -- 172.21.15.70:0/517373312 shutdown_connections 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.936+0000 7ff586296640 1 -- 172.21.15.70:0/517373312 wait complete. 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff586296640 1 Processor -- start 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff586296640 1 -- start start 2024-09-19T04:30:50.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff586296640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff580100e20 0x7ff5801983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff586296640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102570 0x7ff580198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff586296640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff580102ef0 0x7ff58019cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff586296640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff580110f50 con 0x7ff580102570 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff586296640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff580110dd0 con 0x7ff580100e20 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff586296640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff5801110d0 con 0x7ff580102ef0 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff577fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102570 0x7ff580198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff577fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102570 0x7ff580198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56780/0 (socket says 172.21.15.70:56780) 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff577fff640 1 -- 172.21.15.70:0/2857967536 learned_addr learned my addr 172.21.15.70:0/2857967536 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff57ffff640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff580100e20 0x7ff5801983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff584833640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff580102ef0 0x7ff58019cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff577fff640 1 -- 172.21.15.70:0/2857967536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff580102ef0 msgr2=0x7ff58019cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff577fff640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff580102ef0 0x7ff58019cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff577fff640 1 -- 172.21.15.70:0/2857967536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff580100e20 msgr2=0x7ff5801983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff577fff640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff580100e20 0x7ff5801983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.937+0000 7ff577fff640 1 -- 172.21.15.70:0/2857967536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff58019d370 con 0x7ff580102570 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.938+0000 7ff577fff640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102570 0x7ff580198900 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff56800c920 tx=0x7ff56800cd20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.938+0000 7ff57dffb640 1 -- 172.21.15.70:0/2857967536 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff568007bb0 con 0x7ff580102570 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.938+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff58019d660 con 0x7ff580102570 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.938+0000 7ff57dffb640 1 -- 172.21.15.70:0/2857967536 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff568007d50 con 0x7ff580102570 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.938+0000 7ff57dffb640 1 -- 172.21.15.70:0/2857967536 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5680187c0 con 0x7ff580102570 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.938+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5801a4f40 con 0x7ff580102570 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.939+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff580101200 con 0x7ff580102570 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.940+0000 7ff57dffb640 1 -- 172.21.15.70:0/2857967536 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 22) ==== 138475+0+0 (secure 0 0 0) 0x7ff56800f450 con 0x7ff580102570 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.941+0000 7ff57dffb640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff56c0a33b0 0x7ff56c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.941+0000 7ff57ffff640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff56c0a33b0 0x7ff56c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:50.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.941+0000 7ff57dffb640 1 -- 172.21.15.70:0/2857967536 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7ff5680d00f0 con 0x7ff580102570 2024-09-19T04:30:50.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.941+0000 7ff57ffff640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff56c0a33b0 0x7ff56c0a5870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff57000abe0 tx=0x7ff57000a2d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:50.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:50.945+0000 7ff57dffb640 1 -- 172.21.15.70:0/2857967536 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff568014030 con 0x7ff580102570 2024-09-19T04:30:51.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.146+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff5801a5170 con 0x7ff580102570 2024-09-19T04:30:51.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.146+0000 7ff57dffb640 1 -- 172.21.15.70:0/2857967536 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11914 (secure 0 0 0) 0x7ff56809cb80 con 0x7ff580102570 2024-09-19T04:30:51.148 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:51.148 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"btime":"2024-09-19T04:30:48:492398+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:30:48.082662+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:30:51.149 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-09-19T04:30:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff56c0a33b0 msgr2=0x7ff56c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff56c0a33b0 0x7ff56c0a5870 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7ff57000abe0 tx=0x7ff57000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102570 msgr2=0x7ff580198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:51.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102570 0x7ff580198900 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7ff56800c920 tx=0x7ff56800cd20 comp rx=0 tx=0).stop 2024-09-19T04:30:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 shutdown_connections 2024-09-19T04:30:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff56c0a33b0 0x7ff56c0a5870 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff580102ef0 0x7ff58019cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff580102570 0x7ff580198900 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 --2- 172.21.15.70:0/2857967536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff580100e20 0x7ff5801983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 >> 172.21.15.70:0/2857967536 conn(0x7ff5800fc7d0 msgr2=0x7ff58006a0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 shutdown_connections 2024-09-19T04:30:51.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.149+0000 7ff586296640 1 -- 172.21.15.70:0/2857967536 wait complete. 2024-09-19T04:30:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:51.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2857967536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:51.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:51 smithi134 ceph-mon[34525]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T04:30:51.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.860 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:51.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2857967536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:51.861 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:51 smithi070 ceph-mon[30942]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T04:30:51.888 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-09-19T04:30:51.889 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-09-19T04:30:51.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T04:30:51.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: Updating smithi070:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: Updating smithi167:/etc/ceph/ceph.client.admin.keyring 2024-09-19T04:30:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: Updating smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: Updating smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: Updating smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/config/ceph.client.admin.keyring 2024-09-19T04:30:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: pgmap v5: 97 pgs: 97 active+clean; 1.1 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:30:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2857967536' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:51.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:51 smithi167 ceph-mon[34339]: mgrmap e23: x(active, since 4s), standbys: y, z 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 -- 172.21.15.70:0/3354827710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a0101360 msgr2=0x7fa7a010d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3354827710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a0101360 0x7fa7a010d890 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fa798009cd0 tx=0x7fa79802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 -- 172.21.15.70:0/3354827710 shutdown_connections 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3354827710 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a0101360 0x7fa7a010d890 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3354827710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7a01009c0 0x7fa7a0100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3354827710 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7a01069d0 0x7fa7a0106db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 -- 172.21.15.70:0/3354827710 >> 172.21.15.70:0/3354827710 conn(0x7fa7a00fc6a0 msgr2=0x7fa7a00feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 -- 172.21.15.70:0/3354827710 shutdown_connections 2024-09-19T04:30:51.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.990+0000 7fa7a860e640 1 -- 172.21.15.70:0/3354827710 wait complete. 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a860e640 1 Processor -- start 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a860e640 1 -- start start 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a860e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a01009c0 0x7fa7a01983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a860e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7a0101360 0x7fa7a01988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a860e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7a01069d0 0x7fa7a019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a860e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0110de0 con 0x7fa7a01009c0 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a860e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0110c60 con 0x7fa7a01069d0 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a860e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7a0110f60 con 0x7fa7a0101360 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a63aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a01009c0 0x7fa7a01983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a63aa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a01009c0 0x7fa7a01983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56808/0 (socket says 172.21.15.70:56808) 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a63aa640 1 -- 172.21.15.70:0/3031639081 learned_addr learned my addr 172.21.15.70:0/3031639081 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a6bab640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7a01069d0 0x7fa7a019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:51.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a5ba9640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7a0101360 0x7fa7a01988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a63aa640 1 -- 172.21.15.70:0/3031639081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7a0101360 msgr2=0x7fa7a01988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a63aa640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7a0101360 0x7fa7a01988f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.991+0000 7fa7a63aa640 1 -- 172.21.15.70:0/3031639081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7a01069d0 msgr2=0x7fa7a019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7a63aa640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7a01069d0 0x7fa7a019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7a63aa640 1 -- 172.21.15.70:0/3031639081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7a019d3a0 con 0x7fa7a01009c0 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7a6bab640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7a01069d0 0x7fa7a019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7a63aa640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a01009c0 0x7fa7a01983b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00c890 tx=0x7fa79c00cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7977fe640 1 -- 172.21.15.70:0/3031639081 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c004220 con 0x7fa7a01009c0 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa7a019d690 con 0x7fa7a01009c0 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7977fe640 1 -- 172.21.15.70:0/3031639081 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa79c0043c0 con 0x7fa7a01009c0 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7977fe640 1 -- 172.21.15.70:0/3031639081 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa79c004a00 con 0x7fa7a01009c0 2024-09-19T04:30:51.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.992+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7a01a4f20 con 0x7fa7a01009c0 2024-09-19T04:30:51.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.993+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa7a0100e20 con 0x7fa7a01009c0 2024-09-19T04:30:51.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.994+0000 7fa7977fe640 1 -- 172.21.15.70:0/3031639081 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fa79c004ba0 con 0x7fa7a01009c0 2024-09-19T04:30:51.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.994+0000 7fa7977fe640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa78c0a34e0 0x7fa78c0a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:51.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.995+0000 7fa7a5ba9640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa78c0a34e0 0x7fa78c0a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:51.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.995+0000 7fa7977fe640 1 -- 172.21.15.70:0/3031639081 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fa79c0cfd60 con 0x7fa7a01009c0 2024-09-19T04:30:51.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.995+0000 7fa7a5ba9640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa78c0a34e0 0x7fa78c0a59a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa790005fd0 tx=0x7fa790005850 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:51.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:51.999+0000 7fa7977fe640 1 -- 172.21.15.70:0/3031639081 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa79c014030 con 0x7fa7a01009c0 2024-09-19T04:30:52.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.162+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa7a0109fa0 con 0x7fa78c0a34e0 2024-09-19T04:30:52.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.169+0000 7fa7977fe640 1 -- 172.21.15.70:0/3031639081 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257846 (secure 0 0 0) 0x7fa7a0109fa0 con 0x7fa78c0a34e0 2024-09-19T04:30:52.173 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:52.174 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-19T04:30:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa78c0a34e0 msgr2=0x7fa78c0a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa78c0a34e0 0x7fa78c0a59a0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa790005fd0 tx=0x7fa790005850 comp rx=0 tx=0).stop 2024-09-19T04:30:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a01009c0 msgr2=0x7fa7a01983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a01009c0 0x7fa7a01983b0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7fa79c00c890 tx=0x7fa79c00cd50 comp rx=0 tx=0).stop 2024-09-19T04:30:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 shutdown_connections 2024-09-19T04:30:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa78c0a34e0 0x7fa78c0a59a0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7a01069d0 0x7fa7a019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa7a0101360 0x7fa7a01988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 --2- 172.21.15.70:0/3031639081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa7a01009c0 0x7fa7a01983b0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 >> 172.21.15.70:0/3031639081 conn(0x7fa7a00fc6a0 msgr2=0x7fa7a006a640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:52.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 shutdown_connections 2024-09-19T04:30:52.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.172+0000 7fa7a860e640 1 -- 172.21.15.70:0/3031639081 wait complete. 2024-09-19T04:30:52.184 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T04:30:50.510534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1183418,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":829,"num_read_kb":567,"num_write":474,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375972,"kb_used_data":14088,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565852,"statfs":{"total":1151940427776,"available":1151555432448,"internally_reserved":0,"allocated":14426112,"data_stored":8548026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.001299"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533458+0000","last_change":"2024-09-19T04:29:02.416257+0000","last_active":"2024-09-19T04:30:46.533458+0000","last_peered":"2024-09-19T04:30:46.533458+0000","last_clean":"2024-09-19T04:30:46.533458+0000","last_became_active":"2024-09-19T04:29:02.415681+0000","last_became_peered":"2024-09-19T04:29:02.415681+0000","last_unstale":"2024-09-19T04:30:46.533458+0000","last_undegraded":"2024-09-19T04:30:46.533458+0000","last_fullsized":"2024-09-19T04:30:46.533458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:31.765859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533964+0000","last_change":"2024-09-19T04:29:02.417591+0000","last_active":"2024-09-19T04:30:46.533964+0000","last_peered":"2024-09-19T04:30:46.533964+0000","last_clean":"2024-09-19T04:30:46.533964+0000","last_became_active":"2024-09-19T04:29:02.417277+0000","last_became_peered":"2024-09-19T04:29:02.417277+0000","last_unstale":"2024-09-19T04:30:46.533964+0000","last_undegraded":"2024-09-19T04:30:46.533964+0000","last_fullsized":"2024-09-19T04:30:46.533964+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:22.680000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537963+0000","last_change":"2024-09-19T04:29:02.416270+0000","last_active":"2024-09-19T04:30:46.537963+0000","last_peered":"2024-09-19T04:30:46.537963+0000","last_clean":"2024-09-19T04:30:46.537963+0000","last_became_active":"2024-09-19T04:29:02.415878+0000","last_became_peered":"2024-09-19T04:29:02.415878+0000","last_unstale":"2024-09-19T04:30:46.537963+0000","last_undegraded":"2024-09-19T04:30:46.537963+0000","last_fullsized":"2024-09-19T04:30:46.537963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:25.302575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536145+0000","last_change":"2024-09-19T04:29:02.414586+0000","last_active":"2024-09-19T04:30:46.536145+0000","last_peered":"2024-09-19T04:30:46.536145+0000","last_clean":"2024-09-19T04:30:46.536145+0000","last_became_active":"2024-09-19T04:29:02.414267+0000","last_became_peered":"2024-09-19T04:29:02.414267+0000","last_unstale":"2024-09-19T04:30:46.536145+0000","last_undegraded":"2024-09-19T04:30:46.536145+0000","last_fullsized":"2024-09-19T04:30:46.536145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:01.436793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536599+0000","last_change":"2024-09-19T04:29:02.412243+0000","last_active":"2024-09-19T04:30:46.536599+0000","last_peered":"2024-09-19T04:30:46.536599+0000","last_clean":"2024-09-19T04:30:46.536599+0000","last_became_active":"2024-09-19T04:29:02.411411+0000","last_became_peered":"2024-09-19T04:29:02.411411+0000","last_unstale":"2024-09-19T04:30:46.536599+0000","last_undegraded":"2024-09-19T04:30:46.536599+0000","last_fullsized":"2024-09-19T04:30:46.536599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:21.966542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.534637+0000","last_change":"2024-09-19T04:29:18.482295+0000","last_active":"2024-09-19T04:30:46.534637+0000","last_peered":"2024-09-19T04:30:46.534637+0000","last_clean":"2024-09-19T04:30:46.534637+0000","last_became_active":"2024-09-19T04:29:18.481929+0000","last_became_peered":"2024-09-19T04:29:18.481929+0000","last_unstale":"2024-09-19T04:30:46.534637+0000","last_undegraded":"2024-09-19T04:30:46.534637+0000","last_fullsized":"2024-09-19T04:30:46.534637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:17.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538019+0000","last_change":"2024-09-19T04:29:02.418029+0000","last_active":"2024-09-19T04:30:46.538019+0000","last_peered":"2024-09-19T04:30:46.538019+0000","last_clean":"2024-09-19T04:30:46.538019+0000","last_became_active":"2024-09-19T04:29:02.417676+0000","last_became_peered":"2024-09-19T04:29:02.417676+0000","last_unstale":"2024-09-19T04:30:46.538019+0000","last_undegraded":"2024-09-19T04:30:46.538019+0000","last_fullsized":"2024-09-19T04:30:46.538019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:12:03.148693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538928+0000","last_change":"2024-09-19T04:29:02.406657+0000","last_active":"2024-09-19T04:30:46.538928+0000","last_peered":"2024-09-19T04:30:46.538928+0000","last_clean":"2024-09-19T04:30:46.538928+0000","last_became_active":"2024-09-19T04:29:02.406203+0000","last_became_peered":"2024-09-19T04:29:02.406203+0000","last_unstale":"2024-09-19T04:30:46.538928+0000","last_undegraded":"2024-09-19T04:30:46.538928+0000","last_fullsized":"2024-09-19T04:30:46.538928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:06.842516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531218+0000","last_change":"2024-09-19T04:29:02.426478+0000","last_active":"2024-09-19T04:30:46.531218+0000","last_peered":"2024-09-19T04:30:46.531218+0000","last_clean":"2024-09-19T04:30:46.531218+0000","last_became_active":"2024-09-19T04:29:02.425938+0000","last_became_peered":"2024-09-19T04:29:02.425938+0000","last_unstale":"2024-09-19T04:30:46.531218+0000","last_undegraded":"2024-09-19T04:30:46.531218+0000","last_fullsized":"2024-09-19T04:30:46.531218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:01.439087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537678+0000","last_change":"2024-09-19T04:29:02.423380+0000","last_active":"2024-09-19T04:30:46.537678+0000","last_peered":"2024-09-19T04:30:46.537678+0000","last_clean":"2024-09-19T04:30:46.537678+0000","last_became_active":"2024-09-19T04:29:02.422894+0000","last_became_peered":"2024-09-19T04:29:02.422894+0000","last_unstale":"2024-09-19T04:30:46.537678+0000","last_undegraded":"2024-09-19T04:30:46.537678+0000","last_fullsized":"2024-09-19T04:30:46.537678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:55.082196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.543106+0000","last_change":"2024-09-19T04:29:02.419929+0000","last_active":"2024-09-19T04:30:46.543106+0000","last_peered":"2024-09-19T04:30:46.543106+0000","last_clean":"2024-09-19T04:30:46.543106+0000","last_became_active":"2024-09-19T04:29:02.419432+0000","last_became_peered":"2024-09-19T04:29:02.419432+0000","last_unstale":"2024-09-19T04:30:46.543106+0000","last_undegraded":"2024-09-19T04:30:46.543106+0000","last_fullsized":"2024-09-19T04:30:46.543106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:50:03.896524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.529367+0000","last_change":"2024-09-19T04:29:18.481426+0000","last_active":"2024-09-19T04:30:46.529367+0000","last_peered":"2024-09-19T04:30:46.529367+0000","last_clean":"2024-09-19T04:30:46.529367+0000","last_became_active":"2024-09-19T04:29:18.481042+0000","last_became_peered":"2024-09-19T04:29:18.481042+0000","last_unstale":"2024-09-19T04:30:46.529367+0000","last_undegraded":"2024-09-19T04:30:46.529367+0000","last_fullsized":"2024-09-19T04:30:46.529367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:16.251818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.527488+0000","last_change":"2024-09-19T04:29:02.405545+0000","last_active":"2024-09-19T04:30:46.527488+0000","last_peered":"2024-09-19T04:30:46.527488+0000","last_clean":"2024-09-19T04:30:46.527488+0000","last_became_active":"2024-09-19T04:29:02.405247+0000","last_became_peered":"2024-09-19T04:29:02.405247+0000","last_unstale":"2024-09-19T04:30:46.527488+0000","last_undegraded":"2024-09-19T04:30:46.527488+0000","last_fullsized":"2024-09-19T04:30:46.527488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:26.673842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538618+0000","last_change":"2024-09-19T04:29:02.420647+0000","last_active":"2024-09-19T04:30:46.538618+0000","last_peered":"2024-09-19T04:30:46.538618+0000","last_clean":"2024-09-19T04:30:46.538618+0000","last_became_active":"2024-09-19T04:29:02.420310+0000","last_became_peered":"2024-09-19T04:29:02.420310+0000","last_unstale":"2024-09-19T04:30:46.538618+0000","last_undegraded":"2024-09-19T04:30:46.538618+0000","last_fullsized":"2024-09-19T04:30:46.538618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:47.893734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538556+0000","last_change":"2024-09-19T04:29:02.419199+0000","last_active":"2024-09-19T04:30:46.538556+0000","last_peered":"2024-09-19T04:30:46.538556+0000","last_clean":"2024-09-19T04:30:46.538556+0000","last_became_active":"2024-09-19T04:29:02.418902+0000","last_became_peered":"2024-09-19T04:29:02.418902+0000","last_unstale":"2024-09-19T04:30:46.538556+0000","last_undegraded":"2024-09-19T04:30:46.538556+0000","last_fullsized":"2024-09-19T04:30:46.538556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:04.958933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542787+0000","last_change":"2024-09-19T04:29:02.415284+0000","last_active":"2024-09-19T04:30:46.542787+0000","last_peered":"2024-09-19T04:30:46.542787+0000","last_clean":"2024-09-19T04:30:46.542787+0000","last_became_active":"2024-09-19T04:29:02.414947+0000","last_became_peered":"2024-09-19T04:29:02.414947+0000","last_unstale":"2024-09-19T04:30:46.542787+0000","last_undegraded":"2024-09-19T04:30:46.542787+0000","last_fullsized":"2024-09-19T04:30:46.542787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:08.525325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533676+0000","last_change":"2024-09-19T04:29:02.422294+0000","last_active":"2024-09-19T04:30:46.533676+0000","last_peered":"2024-09-19T04:30:46.533676+0000","last_clean":"2024-09-19T04:30:46.533676+0000","last_became_active":"2024-09-19T04:29:02.421014+0000","last_became_peered":"2024-09-19T04:29:02.421014+0000","last_unstale":"2024-09-19T04:30:46.533676+0000","last_undegraded":"2024-09-19T04:30:46.533676+0000","last_fullsized":"2024-09-19T04:30:46.533676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:34.197168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536966+0000","last_change":"2024-09-19T04:29:02.415319+0000","last_active":"2024-09-19T04:30:46.536966+0000","last_peered":"2024-09-19T04:30:46.536966+0000","last_clean":"2024-09-19T04:30:46.536966+0000","last_became_active":"2024-09-19T04:29:02.415030+0000","last_became_peered":"2024-09-19T04:29:02.415030+0000","last_unstale":"2024-09-19T04:30:46.536966+0000","last_undegraded":"2024-09-19T04:30:46.536966+0000","last_fullsized":"2024-09-19T04:30:46.536966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:11.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542299+0000","last_change":"2024-09-19T04:29:02.415938+0000","last_active":"2024-09-19T04:30:46.542299+0000","last_peered":"2024-09-19T04:30:46.542299+0000","last_clean":"2024-09-19T04:30:46.542299+0000","last_became_active":"2024-09-19T04:29:02.411665+0000","last_became_peered":"2024-09-19T04:29:02.411665+0000","last_unstale":"2024-09-19T04:30:46.542299+0000","last_undegraded":"2024-09-19T04:30:46.542299+0000","last_fullsized":"2024-09-19T04:30:46.542299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:12.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532036+0000","last_change":"2024-09-19T04:29:02.417489+0000","last_active":"2024-09-19T04:30:46.532036+0000","last_peered":"2024-09-19T04:30:46.532036+0000","last_clean":"2024-09-19T04:30:46.532036+0000","last_became_active":"2024-09-19T04:29:02.417164+0000","last_became_peered":"2024-09-19T04:29:02.417164+0000","last_unstale":"2024-09-19T04:30:46.532036+0000","last_undegraded":"2024-09-19T04:30:46.532036+0000","last_fullsized":"2024-09-19T04:30:46.532036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:28.055517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538975+0000","last_change":"2024-09-19T04:29:02.407559+0000","last_active":"2024-09-19T04:30:46.538975+0000","last_peered":"2024-09-19T04:30:46.538975+0000","last_clean":"2024-09-19T04:30:46.538975+0000","last_became_active":"2024-09-19T04:29:02.407241+0000","last_became_peered":"2024-09-19T04:29:02.407241+0000","last_unstale":"2024-09-19T04:30:46.538975+0000","last_undegraded":"2024-09-19T04:30:46.538975+0000","last_fullsized":"2024-09-19T04:30:46.538975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:13.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541684+0000","last_change":"2024-09-19T04:29:02.418341+0000","last_active":"2024-09-19T04:30:46.541684+0000","last_peered":"2024-09-19T04:30:46.541684+0000","last_clean":"2024-09-19T04:30:46.541684+0000","last_became_active":"2024-09-19T04:29:02.418028+0000","last_became_peered":"2024-09-19T04:29:02.418028+0000","last_unstale":"2024-09-19T04:30:46.541684+0000","last_undegraded":"2024-09-19T04:30:46.541684+0000","last_fullsized":"2024-09-19T04:30:46.541684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:03.264803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532781+0000","last_change":"2024-09-19T04:29:02.419191+0000","last_active":"2024-09-19T04:30:46.532781+0000","last_peered":"2024-09-19T04:30:46.532781+0000","last_clean":"2024-09-19T04:30:46.532781+0000","last_became_active":"2024-09-19T04:29:02.418587+0000","last_became_peered":"2024-09-19T04:29:02.418587+0000","last_unstale":"2024-09-19T04:30:46.532781+0000","last_undegraded":"2024-09-19T04:30:46.532781+0000","last_fullsized":"2024-09-19T04:30:46.532781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:58.185492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537222+0000","last_change":"2024-09-19T04:29:02.407961+0000","last_active":"2024-09-19T04:30:46.537222+0000","last_peered":"2024-09-19T04:30:46.537222+0000","last_clean":"2024-09-19T04:30:46.537222+0000","last_became_active":"2024-09-19T04:29:02.406888+0000","last_became_peered":"2024-09-19T04:29:02.406888+0000","last_unstale":"2024-09-19T04:30:46.537222+0000","last_undegraded":"2024-09-19T04:30:46.537222+0000","last_fullsized":"2024-09-19T04:30:46.537222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:47.360605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532530+0000","last_change":"2024-09-19T04:29:02.415234+0000","last_active":"2024-09-19T04:30:46.532530+0000","last_peered":"2024-09-19T04:30:46.532530+0000","last_clean":"2024-09-19T04:30:46.532530+0000","last_became_active":"2024-09-19T04:29:02.414929+0000","last_became_peered":"2024-09-19T04:29:02.414929+0000","last_unstale":"2024-09-19T04:30:46.532530+0000","last_undegraded":"2024-09-19T04:30:46.532530+0000","last_fullsized":"2024-09-19T04:30:46.532530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:48.077114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538596+0000","last_change":"2024-09-19T04:29:02.416072+0000","last_active":"2024-09-19T04:30:46.538596+0000","last_peered":"2024-09-19T04:30:46.538596+0000","last_clean":"2024-09-19T04:30:46.538596+0000","last_became_active":"2024-09-19T04:29:02.415714+0000","last_became_peered":"2024-09-19T04:29:02.415714+0000","last_unstale":"2024-09-19T04:30:46.538596+0000","last_undegraded":"2024-09-19T04:30:46.538596+0000","last_fullsized":"2024-09-19T04:30:46.538596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:45.000850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.528255+0000","last_change":"2024-09-19T04:29:02.426071+0000","last_active":"2024-09-19T04:30:46.528255+0000","last_peered":"2024-09-19T04:30:46.528255+0000","last_clean":"2024-09-19T04:30:46.528255+0000","last_became_active":"2024-09-19T04:29:02.425717+0000","last_became_peered":"2024-09-19T04:29:02.425717+0000","last_unstale":"2024-09-19T04:30:46.528255+0000","last_undegraded":"2024-09-19T04:30:46.528255+0000","last_fullsized":"2024-09-19T04:30:46.528255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:11.989191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541570+0000","last_change":"2024-09-19T04:29:18.481675+0000","last_active":"2024-09-19T04:30:46.541570+0000","last_peered":"2024-09-19T04:30:46.541570+0000","last_clean":"2024-09-19T04:30:46.541570+0000","last_became_active":"2024-09-19T04:29:18.481224+0000","last_became_peered":"2024-09-19T04:29:18.481224+0000","last_unstale":"2024-09-19T04:30:46.541570+0000","last_undegraded":"2024-09-19T04:30:46.541570+0000","last_fullsized":"2024-09-19T04:30:46.541570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:10.928554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540263+0000","last_change":"2024-09-19T04:29:02.413973+0000","last_active":"2024-09-19T04:30:46.540263+0000","last_peered":"2024-09-19T04:30:46.540263+0000","last_clean":"2024-09-19T04:30:46.540263+0000","last_became_active":"2024-09-19T04:29:02.413695+0000","last_became_peered":"2024-09-19T04:29:02.413695+0000","last_unstale":"2024-09-19T04:30:46.540263+0000","last_undegraded":"2024-09-19T04:30:46.540263+0000","last_fullsized":"2024-09-19T04:30:46.540263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:11.961493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535839+0000","last_change":"2024-09-19T04:29:02.413943+0000","last_active":"2024-09-19T04:30:46.535839+0000","last_peered":"2024-09-19T04:30:46.535839+0000","last_clean":"2024-09-19T04:30:46.535839+0000","last_became_active":"2024-09-19T04:29:02.411977+0000","last_became_peered":"2024-09-19T04:29:02.411977+0000","last_unstale":"2024-09-19T04:30:46.535839+0000","last_undegraded":"2024-09-19T04:30:46.535839+0000","last_fullsized":"2024-09-19T04:30:46.535839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:38.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535817+0000","last_change":"2024-09-19T04:29:02.420995+0000","last_active":"2024-09-19T04:30:46.535817+0000","last_peered":"2024-09-19T04:30:46.535817+0000","last_clean":"2024-09-19T04:30:46.535817+0000","last_became_active":"2024-09-19T04:29:02.420552+0000","last_became_peered":"2024-09-19T04:29:02.420552+0000","last_unstale":"2024-09-19T04:30:46.535817+0000","last_undegraded":"2024-09-19T04:30:46.535817+0000","last_fullsized":"2024-09-19T04:30:46.535817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:12.560776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533888+0000","last_change":"2024-09-19T04:29:18.481041+0000","last_active":"2024-09-19T04:30:46.533888+0000","last_peered":"2024-09-19T04:30:46.533888+0000","last_clean":"2024-09-19T04:30:46.533888+0000","last_became_active":"2024-09-19T04:29:18.480478+0000","last_became_peered":"2024-09-19T04:29:18.480478+0000","last_unstale":"2024-09-19T04:30:46.533888+0000","last_undegraded":"2024-09-19T04:30:46.533888+0000","last_fullsized":"2024-09-19T04:30:46.533888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.526134+0000","last_change":"2024-09-19T04:29:02.411380+0000","last_active":"2024-09-19T04:30:46.526134+0000","last_peered":"2024-09-19T04:30:46.526134+0000","last_clean":"2024-09-19T04:30:46.526134+0000","last_became_active":"2024-09-19T04:29:02.410977+0000","last_became_peered":"2024-09-19T04:29:02.410977+0000","last_unstale":"2024-09-19T04:30:46.526134+0000","last_undegraded":"2024-09-19T04:30:46.526134+0000","last_fullsized":"2024-09-19T04:30:46.526134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.147856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'8","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.762048+0000","last_change":"2024-09-19T04:29:00.394886+0000","last_active":"2024-09-19T04:30:46.762048+0000","last_peered":"2024-09-19T04:30:46.762048+0000","last_clean":"2024-09-19T04:30:46.762048+0000","last_became_active":"2024-09-19T04:29:00.394412+0000","last_became_peered":"2024-09-19T04:29:00.394412+0000","last_unstale":"2024-09-19T04:30:46.762048+0000","last_undegraded":"2024-09-19T04:30:46.762048+0000","last_fullsized":"2024-09-19T04:30:46.762048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:43.929791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536908+0000","last_change":"2024-09-19T04:29:02.413258+0000","last_active":"2024-09-19T04:30:46.536908+0000","last_peered":"2024-09-19T04:30:46.536908+0000","last_clean":"2024-09-19T04:30:46.536908+0000","last_became_active":"2024-09-19T04:29:02.412887+0000","last_became_peered":"2024-09-19T04:29:02.412887+0000","last_unstale":"2024-09-19T04:30:46.536908+0000","last_undegraded":"2024-09-19T04:30:46.536908+0000","last_fullsized":"2024-09-19T04:30:46.536908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:26.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494757+0000","last_change":"2024-09-19T04:29:00.395696+0000","last_active":"2024-09-19T04:30:46.494757+0000","last_peered":"2024-09-19T04:30:46.494757+0000","last_clean":"2024-09-19T04:30:46.494757+0000","last_became_active":"2024-09-19T04:29:00.395363+0000","last_became_peered":"2024-09-19T04:29:00.395363+0000","last_unstale":"2024-09-19T04:30:46.494757+0000","last_undegraded":"2024-09-19T04:30:46.494757+0000","last_fullsized":"2024-09-19T04:30:46.494757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:50.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.489872+0000","last_change":"2024-09-19T04:29:00.391765+0000","last_active":"2024-09-19T04:30:46.489872+0000","last_peered":"2024-09-19T04:30:46.489872+0000","last_clean":"2024-09-19T04:30:46.489872+0000","last_became_active":"2024-09-19T04:29:00.391412+0000","last_became_peered":"2024-09-19T04:29:00.391412+0000","last_unstale":"2024-09-19T04:30:46.489872+0000","last_undegraded":"2024-09-19T04:30:46.489872+0000","last_fullsized":"2024-09-19T04:30:46.489872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:27.423046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.529949+0000","last_change":"2024-09-19T04:29:02.417820+0000","last_active":"2024-09-19T04:30:46.529949+0000","last_peered":"2024-09-19T04:30:46.529949+0000","last_clean":"2024-09-19T04:30:46.529949+0000","last_became_active":"2024-09-19T04:29:02.417452+0000","last_became_peered":"2024-09-19T04:29:02.417452+0000","last_unstale":"2024-09-19T04:30:46.529949+0000","last_undegraded":"2024-09-19T04:30:46.529949+0000","last_fullsized":"2024-09-19T04:30:46.529949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:34.767829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494641+0000","last_change":"2024-09-19T04:29:00.393075+0000","last_active":"2024-09-19T04:30:46.494641+0000","last_peered":"2024-09-19T04:30:46.494641+0000","last_clean":"2024-09-19T04:30:46.494641+0000","last_became_active":"2024-09-19T04:29:00.392695+0000","last_became_peered":"2024-09-19T04:29:00.392695+0000","last_unstale":"2024-09-19T04:30:46.494641+0000","last_undegraded":"2024-09-19T04:30:46.494641+0000","last_fullsized":"2024-09-19T04:30:46.494641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:43.122636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537328+0000","last_change":"2024-09-19T04:29:02.403886+0000","last_active":"2024-09-19T04:30:46.537328+0000","last_peered":"2024-09-19T04:30:46.537328+0000","last_clean":"2024-09-19T04:30:46.537328+0000","last_became_active":"2024-09-19T04:29:02.403530+0000","last_became_peered":"2024-09-19T04:29:02.403530+0000","last_unstale":"2024-09-19T04:30:46.537328+0000","last_undegraded":"2024-09-19T04:30:46.537328+0000","last_fullsized":"2024-09-19T04:30:46.537328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:57.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":123,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.495151+0000","last_change":"2024-09-19T04:29:00.390081+0000","last_active":"2024-09-19T04:30:46.495151+0000","last_peered":"2024-09-19T04:30:46.495151+0000","last_clean":"2024-09-19T04:30:46.495151+0000","last_became_active":"2024-09-19T04:29:00.389701+0000","last_became_peered":"2024-09-19T04:29:00.389701+0000","last_unstale":"2024-09-19T04:30:46.495151+0000","last_undegraded":"2024-09-19T04:30:46.495151+0000","last_fullsized":"2024-09-19T04:30:46.495151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:42.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538592+0000","last_change":"2024-09-19T04:29:02.424712+0000","last_active":"2024-09-19T04:30:46.538592+0000","last_peered":"2024-09-19T04:30:46.538592+0000","last_clean":"2024-09-19T04:30:46.538592+0000","last_became_active":"2024-09-19T04:29:02.424316+0000","last_became_peered":"2024-09-19T04:29:02.424316+0000","last_unstale":"2024-09-19T04:30:46.538592+0000","last_undegraded":"2024-09-19T04:30:46.538592+0000","last_fullsized":"2024-09-19T04:30:46.538592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:06:21.246473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.518453+0000","last_change":"2024-09-19T04:29:00.396085+0000","last_active":"2024-09-19T04:30:46.518453+0000","last_peered":"2024-09-19T04:30:46.518453+0000","last_clean":"2024-09-19T04:30:46.518453+0000","last_became_active":"2024-09-19T04:29:00.395737+0000","last_became_peered":"2024-09-19T04:29:00.395737+0000","last_unstale":"2024-09-19T04:30:46.518453+0000","last_undegraded":"2024-09-19T04:30:46.518453+0000","last_fullsized":"2024-09-19T04:30:46.518453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:59.429917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536976+0000","last_change":"2024-09-19T04:29:02.412318+0000","last_active":"2024-09-19T04:30:46.536976+0000","last_peered":"2024-09-19T04:30:46.536976+0000","last_clean":"2024-09-19T04:30:46.536976+0000","last_became_active":"2024-09-19T04:29:02.412020+0000","last_became_peered":"2024-09-19T04:29:02.412020+0000","last_unstale":"2024-09-19T04:30:46.536976+0000","last_undegraded":"2024-09-19T04:30:46.536976+0000","last_fullsized":"2024-09-19T04:30:46.536976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:45.341633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.495019+0000","last_change":"2024-09-19T04:29:00.507027+0000","last_active":"2024-09-19T04:30:46.495019+0000","last_peered":"2024-09-19T04:30:46.495019+0000","last_clean":"2024-09-19T04:30:46.495019+0000","last_became_active":"2024-09-19T04:29:00.506660+0000","last_became_peered":"2024-09-19T04:29:00.506660+0000","last_unstale":"2024-09-19T04:30:46.495019+0000","last_undegraded":"2024-09-19T04:30:46.495019+0000","last_fullsized":"2024-09-19T04:30:46.495019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:54.629719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536650+0000","last_change":"2024-09-19T04:29:02.415423+0000","last_active":"2024-09-19T04:30:46.536650+0000","last_peered":"2024-09-19T04:30:46.536650+0000","last_clean":"2024-09-19T04:30:46.536650+0000","last_became_active":"2024-09-19T04:29:02.415105+0000","last_became_peered":"2024-09-19T04:29:02.415105+0000","last_unstale":"2024-09-19T04:30:46.536650+0000","last_undegraded":"2024-09-19T04:30:46.536650+0000","last_fullsized":"2024-09-19T04:30:46.536650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:00.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'34","reported_seq":259,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.761844+0000","last_change":"2024-09-19T04:29:00.396021+0000","last_active":"2024-09-19T04:30:46.761844+0000","last_peered":"2024-09-19T04:30:46.761844+0000","last_clean":"2024-09-19T04:30:46.761844+0000","last_became_active":"2024-09-19T04:29:00.395649+0000","last_became_peered":"2024-09-19T04:29:00.395649+0000","last_unstale":"2024-09-19T04:30:46.761844+0000","last_undegraded":"2024-09-19T04:30:46.761844+0000","last_fullsized":"2024-09-19T04:30:46.761844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:56.800573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61294,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":201,"num_read_kb":159,"num_write":35,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.526198+0000","last_change":"2024-09-19T04:29:02.416081+0000","last_active":"2024-09-19T04:30:46.526198+0000","last_peered":"2024-09-19T04:30:46.526198+0000","last_clean":"2024-09-19T04:30:46.526198+0000","last_became_active":"2024-09-19T04:29:02.415780+0000","last_became_peered":"2024-09-19T04:29:02.415780+0000","last_unstale":"2024-09-19T04:30:46.526198+0000","last_undegraded":"2024-09-19T04:30:46.526198+0000","last_fullsized":"2024-09-19T04:30:46.526198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:23.438141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497681+0000","last_change":"2024-09-19T04:29:00.396397+0000","last_active":"2024-09-19T04:30:46.497681+0000","last_peered":"2024-09-19T04:30:46.497681+0000","last_clean":"2024-09-19T04:30:46.497681+0000","last_became_active":"2024-09-19T04:29:00.395896+0000","last_became_peered":"2024-09-19T04:29:00.395896+0000","last_unstale":"2024-09-19T04:30:46.497681+0000","last_undegraded":"2024-09-19T04:30:46.497681+0000","last_fullsized":"2024-09-19T04:30:46.497681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:06.174262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538251+0000","last_change":"2024-09-19T04:29:02.408299+0000","last_active":"2024-09-19T04:30:46.538251+0000","last_peered":"2024-09-19T04:30:46.538251+0000","last_clean":"2024-09-19T04:30:46.538251+0000","last_became_active":"2024-09-19T04:29:02.407970+0000","last_became_peered":"2024-09-19T04:29:02.407970+0000","last_unstale":"2024-09-19T04:30:46.538251+0000","last_undegraded":"2024-09-19T04:30:46.538251+0000","last_fullsized":"2024-09-19T04:30:46.538251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:50.758517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494741+0000","last_change":"2024-09-19T04:29:00.393163+0000","last_active":"2024-09-19T04:30:46.494741+0000","last_peered":"2024-09-19T04:30:46.494741+0000","last_clean":"2024-09-19T04:30:46.494741+0000","last_became_active":"2024-09-19T04:29:00.392749+0000","last_became_peered":"2024-09-19T04:29:00.392749+0000","last_unstale":"2024-09-19T04:30:46.494741+0000","last_undegraded":"2024-09-19T04:30:46.494741+0000","last_fullsized":"2024-09-19T04:30:46.494741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:41.999124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.543441+0000","last_change":"2024-09-19T04:29:02.412754+0000","last_active":"2024-09-19T04:30:46.543441+0000","last_peered":"2024-09-19T04:30:46.543441+0000","last_clean":"2024-09-19T04:30:46.543441+0000","last_became_active":"2024-09-19T04:29:02.412445+0000","last_became_peered":"2024-09-19T04:29:02.412445+0000","last_unstale":"2024-09-19T04:30:46.543441+0000","last_undegraded":"2024-09-19T04:30:46.543441+0000","last_fullsized":"2024-09-19T04:30:46.543441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:52:31.531672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.764348+0000","last_change":"2024-09-19T04:29:00.393863+0000","last_active":"2024-09-19T04:30:46.764348+0000","last_peered":"2024-09-19T04:30:46.764348+0000","last_clean":"2024-09-19T04:30:46.764348+0000","last_became_active":"2024-09-19T04:29:00.393502+0000","last_became_peered":"2024-09-19T04:29:00.393502+0000","last_unstale":"2024-09-19T04:30:46.764348+0000","last_undegraded":"2024-09-19T04:30:46.764348+0000","last_fullsized":"2024-09-19T04:30:46.764348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:26.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2403,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":5,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538632+0000","last_change":"2024-09-19T04:29:02.412624+0000","last_active":"2024-09-19T04:30:46.538632+0000","last_peered":"2024-09-19T04:30:46.538632+0000","last_clean":"2024-09-19T04:30:46.538632+0000","last_became_active":"2024-09-19T04:29:02.412299+0000","last_became_peered":"2024-09-19T04:29:02.412299+0000","last_unstale":"2024-09-19T04:30:46.538632+0000","last_undegraded":"2024-09-19T04:30:46.538632+0000","last_fullsized":"2024-09-19T04:30:46.538632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.062422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.504375+0000","last_change":"2024-09-19T04:29:00.504931+0000","last_active":"2024-09-19T04:30:46.504375+0000","last_peered":"2024-09-19T04:30:46.504375+0000","last_clean":"2024-09-19T04:30:46.504375+0000","last_became_active":"2024-09-19T04:29:00.504526+0000","last_became_peered":"2024-09-19T04:29:00.504526+0000","last_unstale":"2024-09-19T04:30:46.504375+0000","last_undegraded":"2024-09-19T04:30:46.504375+0000","last_fullsized":"2024-09-19T04:30:46.504375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:31.096516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530159+0000","last_change":"2024-09-19T04:29:02.424492+0000","last_active":"2024-09-19T04:30:46.530159+0000","last_peered":"2024-09-19T04:30:46.530159+0000","last_clean":"2024-09-19T04:30:46.530159+0000","last_became_active":"2024-09-19T04:29:02.424013+0000","last_became_peered":"2024-09-19T04:29:02.424013+0000","last_unstale":"2024-09-19T04:30:46.530159+0000","last_undegraded":"2024-09-19T04:30:46.530159+0000","last_fullsized":"2024-09-19T04:30:46.530159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:41.021945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508470+0000","last_change":"2024-09-19T04:29:00.396707+0000","last_active":"2024-09-19T04:30:46.508470+0000","last_peered":"2024-09-19T04:30:46.508470+0000","last_clean":"2024-09-19T04:30:46.508470+0000","last_became_active":"2024-09-19T04:29:00.394876+0000","last_became_peered":"2024-09-19T04:29:00.394876+0000","last_unstale":"2024-09-19T04:30:46.508470+0000","last_undegraded":"2024-09-19T04:30:46.508470+0000","last_fullsized":"2024-09-19T04:30:46.508470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:06.648377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531572+0000","last_change":"2024-09-19T04:29:02.425106+0000","last_active":"2024-09-19T04:30:46.531572+0000","last_peered":"2024-09-19T04:30:46.531572+0000","last_clean":"2024-09-19T04:30:46.531572+0000","last_became_active":"2024-09-19T04:29:02.424597+0000","last_became_peered":"2024-09-19T04:29:02.424597+0000","last_unstale":"2024-09-19T04:30:46.531572+0000","last_undegraded":"2024-09-19T04:30:46.531572+0000","last_fullsized":"2024-09-19T04:30:46.531572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:02.998519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.490229+0000","last_change":"2024-09-19T04:29:00.396369+0000","last_active":"2024-09-19T04:30:46.490229+0000","last_peered":"2024-09-19T04:30:46.490229+0000","last_clean":"2024-09-19T04:30:46.490229+0000","last_became_active":"2024-09-19T04:29:00.395980+0000","last_became_peered":"2024-09-19T04:29:00.395980+0000","last_unstale":"2024-09-19T04:30:46.490229+0000","last_undegraded":"2024-09-19T04:30:46.490229+0000","last_fullsized":"2024-09-19T04:30:46.490229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.941729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540832+0000","last_change":"2024-09-19T04:29:02.415771+0000","last_active":"2024-09-19T04:30:46.540832+0000","last_peered":"2024-09-19T04:30:46.540832+0000","last_clean":"2024-09-19T04:30:46.540832+0000","last_became_active":"2024-09-19T04:29:02.415404+0000","last_became_peered":"2024-09-19T04:29:02.415404+0000","last_unstale":"2024-09-19T04:30:46.540832+0000","last_undegraded":"2024-09-19T04:30:46.540832+0000","last_fullsized":"2024-09-19T04:30:46.540832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:04.509294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":71,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.705215+0000","last_change":"2024-09-19T04:29:00.389015+0000","last_active":"2024-09-19T04:30:46.705215+0000","last_peered":"2024-09-19T04:30:46.705215+0000","last_clean":"2024-09-19T04:30:46.705215+0000","last_became_active":"2024-09-19T04:29:00.388621+0000","last_became_peered":"2024-09-19T04:29:00.388621+0000","last_unstale":"2024-09-19T04:30:46.705215+0000","last_undegraded":"2024-09-19T04:30:46.705215+0000","last_fullsized":"2024-09-19T04:30:46.705215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:49.509697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541218+0000","last_change":"2024-09-19T04:29:02.411379+0000","last_active":"2024-09-19T04:30:46.541218+0000","last_peered":"2024-09-19T04:30:46.541218+0000","last_clean":"2024-09-19T04:30:46.541218+0000","last_became_active":"2024-09-19T04:29:02.411069+0000","last_became_peered":"2024-09-19T04:29:02.411069+0000","last_unstale":"2024-09-19T04:30:46.541218+0000","last_undegraded":"2024-09-19T04:30:46.541218+0000","last_fullsized":"2024-09-19T04:30:46.541218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:10.953422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.498451+0000","last_change":"2024-09-19T04:29:00.505088+0000","last_active":"2024-09-19T04:30:46.498451+0000","last_peered":"2024-09-19T04:30:46.498451+0000","last_clean":"2024-09-19T04:30:46.498451+0000","last_became_active":"2024-09-19T04:29:00.504734+0000","last_became_peered":"2024-09-19T04:29:00.504734+0000","last_unstale":"2024-09-19T04:30:46.498451+0000","last_undegraded":"2024-09-19T04:30:46.498451+0000","last_fullsized":"2024-09-19T04:30:46.498451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:38.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542579+0000","last_change":"2024-09-19T04:29:02.420752+0000","last_active":"2024-09-19T04:30:46.542579+0000","last_peered":"2024-09-19T04:30:46.542579+0000","last_clean":"2024-09-19T04:30:46.542579+0000","last_became_active":"2024-09-19T04:29:02.419136+0000","last_became_peered":"2024-09-19T04:29:02.419136+0000","last_unstale":"2024-09-19T04:30:46.542579+0000","last_undegraded":"2024-09-19T04:30:46.542579+0000","last_fullsized":"2024-09-19T04:30:46.542579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:40.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508217+0000","last_change":"2024-09-19T04:27:51.622607+0000","last_active":"2024-09-19T04:30:46.508217+0000","last_peered":"2024-09-19T04:30:46.508217+0000","last_clean":"2024-09-19T04:30:46.508217+0000","last_became_active":"2024-09-19T04:27:51.622000+0000","last_became_peered":"2024-09-19T04:27:51.622000+0000","last_unstale":"2024-09-19T04:30:46.508217+0000","last_undegraded":"2024-09-19T04:30:46.508217+0000","last_fullsized":"2024-09-19T04:30:46.508217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_clean_scrub_stamp":"2024-09-19T04:24:31.610268+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:20:05.335499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.514503+0000","last_change":"2024-09-19T04:29:00.393618+0000","last_active":"2024-09-19T04:30:46.514503+0000","last_peered":"2024-09-19T04:30:46.514503+0000","last_clean":"2024-09-19T04:30:46.514503+0000","last_became_active":"2024-09-19T04:29:00.393248+0000","last_became_peered":"2024-09-19T04:29:00.393248+0000","last_unstale":"2024-09-19T04:30:46.514503+0000","last_undegraded":"2024-09-19T04:30:46.514503+0000","last_fullsized":"2024-09-19T04:30:46.514503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:35.271531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.528183+0000","last_change":"2024-09-19T04:29:02.415147+0000","last_active":"2024-09-19T04:30:46.528183+0000","last_peered":"2024-09-19T04:30:46.528183+0000","last_clean":"2024-09-19T04:30:46.528183+0000","last_became_active":"2024-09-19T04:29:02.414275+0000","last_became_peered":"2024-09-19T04:29:02.414275+0000","last_unstale":"2024-09-19T04:30:46.528183+0000","last_undegraded":"2024-09-19T04:30:46.528183+0000","last_fullsized":"2024-09-19T04:30:46.528183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:32.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508104+0000","last_change":"2024-09-19T04:29:00.398007+0000","last_active":"2024-09-19T04:30:46.508104+0000","last_peered":"2024-09-19T04:30:46.508104+0000","last_clean":"2024-09-19T04:30:46.508104+0000","last_became_active":"2024-09-19T04:29:00.397644+0000","last_became_peered":"2024-09-19T04:29:00.397644+0000","last_unstale":"2024-09-19T04:30:46.508104+0000","last_undegraded":"2024-09-19T04:30:46.508104+0000","last_fullsized":"2024-09-19T04:30:46.508104+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:34.476893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541292+0000","last_change":"2024-09-19T04:29:02.414957+0000","last_active":"2024-09-19T04:30:46.541292+0000","last_peered":"2024-09-19T04:30:46.541292+0000","last_clean":"2024-09-19T04:30:46.541292+0000","last_became_active":"2024-09-19T04:29:02.414641+0000","last_became_peered":"2024-09-19T04:29:02.414641+0000","last_unstale":"2024-09-19T04:30:46.541292+0000","last_undegraded":"2024-09-19T04:30:46.541292+0000","last_fullsized":"2024-09-19T04:30:46.541292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:18.824972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.496502+0000","last_change":"2024-09-19T04:29:00.504872+0000","last_active":"2024-09-19T04:30:46.496502+0000","last_peered":"2024-09-19T04:30:46.496502+0000","last_clean":"2024-09-19T04:30:46.496502+0000","last_became_active":"2024-09-19T04:29:00.504520+0000","last_became_peered":"2024-09-19T04:29:00.504520+0000","last_unstale":"2024-09-19T04:30:46.496502+0000","last_undegraded":"2024-09-19T04:30:46.496502+0000","last_fullsized":"2024-09-19T04:30:46.496502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:39.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535674+0000","last_change":"2024-09-19T04:29:02.416451+0000","last_active":"2024-09-19T04:30:46.535674+0000","last_peered":"2024-09-19T04:30:46.535674+0000","last_clean":"2024-09-19T04:30:46.535674+0000","last_became_active":"2024-09-19T04:29:02.415271+0000","last_became_peered":"2024-09-19T04:29:02.415271+0000","last_unstale":"2024-09-19T04:30:46.535674+0000","last_undegraded":"2024-09-19T04:30:46.535674+0000","last_fullsized":"2024-09-19T04:30:46.535674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:06.371572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.518710+0000","last_change":"2024-09-19T04:29:00.390999+0000","last_active":"2024-09-19T04:30:46.518710+0000","last_peered":"2024-09-19T04:30:46.518710+0000","last_clean":"2024-09-19T04:30:46.518710+0000","last_became_active":"2024-09-19T04:29:00.390639+0000","last_became_peered":"2024-09-19T04:29:00.390639+0000","last_unstale":"2024-09-19T04:30:46.518710+0000","last_undegraded":"2024-09-19T04:30:46.518710+0000","last_fullsized":"2024-09-19T04:30:46.518710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:26.504171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532095+0000","last_change":"2024-09-19T04:29:02.419534+0000","last_active":"2024-09-19T04:30:46.532095+0000","last_peered":"2024-09-19T04:30:46.532095+0000","last_clean":"2024-09-19T04:30:46.532095+0000","last_became_active":"2024-09-19T04:29:02.419192+0000","last_became_peered":"2024-09-19T04:29:02.419192+0000","last_unstale":"2024-09-19T04:30:46.532095+0000","last_undegraded":"2024-09-19T04:30:46.532095+0000","last_fullsized":"2024-09-19T04:30:46.532095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:33.866859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.501709+0000","last_change":"2024-09-19T04:29:18.480950+0000","last_active":"2024-09-19T04:30:46.501709+0000","last_peered":"2024-09-19T04:30:46.501709+0000","last_clean":"2024-09-19T04:30:46.501709+0000","last_became_active":"2024-09-19T04:29:18.480542+0000","last_became_peered":"2024-09-19T04:29:18.480542+0000","last_unstale":"2024-09-19T04:30:46.501709+0000","last_undegraded":"2024-09-19T04:30:46.501709+0000","last_fullsized":"2024-09-19T04:30:46.501709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.647586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530211+0000","last_change":"2024-09-19T04:29:02.415075+0000","last_active":"2024-09-19T04:30:46.530211+0000","last_peered":"2024-09-19T04:30:46.530211+0000","last_clean":"2024-09-19T04:30:46.530211+0000","last_became_active":"2024-09-19T04:29:02.414635+0000","last_became_peered":"2024-09-19T04:29:02.414635+0000","last_unstale":"2024-09-19T04:30:46.530211+0000","last_undegraded":"2024-09-19T04:30:46.530211+0000","last_fullsized":"2024-09-19T04:30:46.530211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:12.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.502268+0000","last_change":"2024-09-19T04:29:18.485218+0000","last_active":"2024-09-19T04:30:46.502268+0000","last_peered":"2024-09-19T04:30:46.502268+0000","last_clean":"2024-09-19T04:30:46.502268+0000","last_became_active":"2024-09-19T04:29:18.481618+0000","last_became_peered":"2024-09-19T04:29:18.481618+0000","last_unstale":"2024-09-19T04:30:46.502268+0000","last_undegraded":"2024-09-19T04:30:46.502268+0000","last_fullsized":"2024-09-19T04:30:46.502268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:26.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540687+0000","last_change":"2024-09-19T04:29:02.412647+0000","last_active":"2024-09-19T04:30:46.540687+0000","last_peered":"2024-09-19T04:30:46.540687+0000","last_clean":"2024-09-19T04:30:46.540687+0000","last_became_active":"2024-09-19T04:29:02.412014+0000","last_became_peered":"2024-09-19T04:29:02.412014+0000","last_unstale":"2024-09-19T04:30:46.540687+0000","last_undegraded":"2024-09-19T04:30:46.540687+0000","last_fullsized":"2024-09-19T04:30:46.540687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:32.341462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'45","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.710645+0000","last_change":"2024-09-19T04:29:00.397860+0000","last_active":"2024-09-19T04:30:46.710645+0000","last_peered":"2024-09-19T04:30:46.710645+0000","last_clean":"2024-09-19T04:30:46.710645+0000","last_became_active":"2024-09-19T04:29:00.397501+0000","last_became_peered":"2024-09-19T04:29:00.397501+0000","last_unstale":"2024-09-19T04:30:46.710645+0000","last_undegraded":"2024-09-19T04:30:46.710645+0000","last_fullsized":"2024-09-19T04:30:46.710645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:51.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542946+0000","last_change":"2024-09-19T04:29:02.418639+0000","last_active":"2024-09-19T04:30:46.542946+0000","last_peered":"2024-09-19T04:30:46.542946+0000","last_clean":"2024-09-19T04:30:46.542946+0000","last_became_active":"2024-09-19T04:29:02.418334+0000","last_became_peered":"2024-09-19T04:29:02.418334+0000","last_unstale":"2024-09-19T04:30:46.542946+0000","last_undegraded":"2024-09-19T04:30:46.542946+0000","last_fullsized":"2024-09-19T04:30:46.542946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.161642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505107+0000","last_change":"2024-09-19T04:29:00.504849+0000","last_active":"2024-09-19T04:30:46.505107+0000","last_peered":"2024-09-19T04:30:46.505107+0000","last_clean":"2024-09-19T04:30:46.505107+0000","last_became_active":"2024-09-19T04:29:00.504618+0000","last_became_peered":"2024-09-19T04:29:00.504618+0000","last_unstale":"2024-09-19T04:30:46.505107+0000","last_undegraded":"2024-09-19T04:30:46.505107+0000","last_fullsized":"2024-09-19T04:30:46.505107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:31.038078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540526+0000","last_change":"2024-09-19T04:29:19.354455+0000","last_active":"2024-09-19T04:30:46.540526+0000","last_peered":"2024-09-19T04:30:46.540526+0000","last_clean":"2024-09-19T04:30:46.540526+0000","last_became_active":"2024-09-19T04:29:19.354062+0000","last_became_peered":"2024-09-19T04:29:19.354062+0000","last_unstale":"2024-09-19T04:30:46.540526+0000","last_undegraded":"2024-09-19T04:30:46.540526+0000","last_fullsized":"2024-09-19T04:30:46.540526+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:17.134082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.496926+0000","last_change":"2024-09-19T04:29:00.506294+0000","last_active":"2024-09-19T04:30:46.496926+0000","last_peered":"2024-09-19T04:30:46.496926+0000","last_clean":"2024-09-19T04:30:46.496926+0000","last_became_active":"2024-09-19T04:29:00.506028+0000","last_became_peered":"2024-09-19T04:29:00.506028+0000","last_unstale":"2024-09-19T04:30:46.496926+0000","last_undegraded":"2024-09-19T04:30:46.496926+0000","last_fullsized":"2024-09-19T04:30:46.496926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.972980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.515227+0000","last_change":"2024-09-19T04:29:02.414995+0000","last_active":"2024-09-19T04:30:46.515227+0000","last_peered":"2024-09-19T04:30:46.515227+0000","last_clean":"2024-09-19T04:30:46.515227+0000","last_became_active":"2024-09-19T04:29:02.414675+0000","last_became_peered":"2024-09-19T04:29:02.414675+0000","last_unstale":"2024-09-19T04:30:46.515227+0000","last_undegraded":"2024-09-19T04:30:46.515227+0000","last_fullsized":"2024-09-19T04:30:46.515227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:40.466483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.496463+0000","last_change":"2024-09-19T04:29:00.389510+0000","last_active":"2024-09-19T04:30:46.496463+0000","last_peered":"2024-09-19T04:30:46.496463+0000","last_clean":"2024-09-19T04:30:46.496463+0000","last_became_active":"2024-09-19T04:29:00.389222+0000","last_became_peered":"2024-09-19T04:29:00.389222+0000","last_unstale":"2024-09-19T04:30:46.496463+0000","last_undegraded":"2024-09-19T04:30:46.496463+0000","last_fullsized":"2024-09-19T04:30:46.496463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:00.290076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532102+0000","last_change":"2024-09-19T04:29:02.422356+0000","last_active":"2024-09-19T04:30:46.532102+0000","last_peered":"2024-09-19T04:30:46.532102+0000","last_clean":"2024-09-19T04:30:46.532102+0000","last_became_active":"2024-09-19T04:29:02.422037+0000","last_became_peered":"2024-09-19T04:29:02.422037+0000","last_unstale":"2024-09-19T04:30:46.532102+0000","last_undegraded":"2024-09-19T04:30:46.532102+0000","last_fullsized":"2024-09-19T04:30:46.532102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:40.192439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497530+0000","last_change":"2024-09-19T04:29:00.399188+0000","last_active":"2024-09-19T04:30:46.497530+0000","last_peered":"2024-09-19T04:30:46.497530+0000","last_clean":"2024-09-19T04:30:46.497530+0000","last_became_active":"2024-09-19T04:29:00.398880+0000","last_became_peered":"2024-09-19T04:29:00.398880+0000","last_unstale":"2024-09-19T04:30:46.497530+0000","last_undegraded":"2024-09-19T04:30:46.497530+0000","last_fullsized":"2024-09-19T04:30:46.497530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:55.581504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532359+0000","last_change":"2024-09-19T04:29:02.408174+0000","last_active":"2024-09-19T04:30:46.532359+0000","last_peered":"2024-09-19T04:30:46.532359+0000","last_clean":"2024-09-19T04:30:46.532359+0000","last_became_active":"2024-09-19T04:29:02.407822+0000","last_became_peered":"2024-09-19T04:29:02.407822+0000","last_unstale":"2024-09-19T04:30:46.532359+0000","last_undegraded":"2024-09-19T04:30:46.532359+0000","last_fullsized":"2024-09-19T04:30:46.532359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505712+0000","last_change":"2024-09-19T04:29:00.398445+0000","last_active":"2024-09-19T04:30:46.505712+0000","last_peered":"2024-09-19T04:30:46.505712+0000","last_clean":"2024-09-19T04:30:46.505712+0000","last_became_active":"2024-09-19T04:29:00.397923+0000","last_became_peered":"2024-09-19T04:29:00.397923+0000","last_unstale":"2024-09-19T04:30:46.505712+0000","last_undegraded":"2024-09-19T04:30:46.505712+0000","last_fullsized":"2024-09-19T04:30:46.505712+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:32.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542712+0000","last_change":"2024-09-19T04:29:02.416685+0000","last_active":"2024-09-19T04:30:46.542712+0000","last_peered":"2024-09-19T04:30:46.542712+0000","last_clean":"2024-09-19T04:30:46.542712+0000","last_became_active":"2024-09-19T04:29:02.416311+0000","last_became_peered":"2024-09-19T04:29:02.416311+0000","last_unstale":"2024-09-19T04:30:46.542712+0000","last_undegraded":"2024-09-19T04:30:46.542712+0000","last_fullsized":"2024-09-19T04:30:46.542712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:47.988318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530456+0000","last_change":"2024-09-19T04:29:02.424585+0000","last_active":"2024-09-19T04:30:46.530456+0000","last_peered":"2024-09-19T04:30:46.530456+0000","last_clean":"2024-09-19T04:30:46.530456+0000","last_became_active":"2024-09-19T04:29:02.424253+0000","last_became_peered":"2024-09-19T04:29:02.424253+0000","last_unstale":"2024-09-19T04:30:46.530456+0000","last_undegraded":"2024-09-19T04:30:46.530456+0000","last_fullsized":"2024-09-19T04:30:46.530456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:55.865599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505381+0000","last_change":"2024-09-19T04:29:00.396490+0000","last_active":"2024-09-19T04:30:46.505381+0000","last_peered":"2024-09-19T04:30:46.505381+0000","last_clean":"2024-09-19T04:30:46.505381+0000","last_became_active":"2024-09-19T04:29:00.394727+0000","last_became_peered":"2024-09-19T04:29:00.394727+0000","last_unstale":"2024-09-19T04:30:46.505381+0000","last_undegraded":"2024-09-19T04:30:46.505381+0000","last_fullsized":"2024-09-19T04:30:46.505381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:43.724257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532968+0000","last_change":"2024-09-19T04:29:02.425557+0000","last_active":"2024-09-19T04:30:46.532968+0000","last_peered":"2024-09-19T04:30:46.532968+0000","last_clean":"2024-09-19T04:30:46.532968+0000","last_became_active":"2024-09-19T04:29:02.425261+0000","last_became_peered":"2024-09-19T04:29:02.425261+0000","last_unstale":"2024-09-19T04:30:46.532968+0000","last_undegraded":"2024-09-19T04:30:46.532968+0000","last_fullsized":"2024-09-19T04:30:46.532968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:20.204026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508704+0000","last_change":"2024-09-19T04:29:00.397849+0000","last_active":"2024-09-19T04:30:46.508704+0000","last_peered":"2024-09-19T04:30:46.508704+0000","last_clean":"2024-09-19T04:30:46.508704+0000","last_became_active":"2024-09-19T04:29:00.397226+0000","last_became_peered":"2024-09-19T04:29:00.397226+0000","last_unstale":"2024-09-19T04:30:46.508704+0000","last_undegraded":"2024-09-19T04:30:46.508704+0000","last_fullsized":"2024-09-19T04:30:46.508704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:04.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538188+0000","last_change":"2024-09-19T04:29:02.416202+0000","last_active":"2024-09-19T04:30:46.538188+0000","last_peered":"2024-09-19T04:30:46.538188+0000","last_clean":"2024-09-19T04:30:46.538188+0000","last_became_active":"2024-09-19T04:29:02.415886+0000","last_became_peered":"2024-09-19T04:29:02.415886+0000","last_unstale":"2024-09-19T04:30:46.538188+0000","last_undegraded":"2024-09-19T04:30:46.538188+0000","last_fullsized":"2024-09-19T04:30:46.538188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:06.217254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497341+0000","last_change":"2024-09-19T04:29:00.505162+0000","last_active":"2024-09-19T04:30:46.497341+0000","last_peered":"2024-09-19T04:30:46.497341+0000","last_clean":"2024-09-19T04:30:46.497341+0000","last_became_active":"2024-09-19T04:29:00.504584+0000","last_became_peered":"2024-09-19T04:29:00.504584+0000","last_unstale":"2024-09-19T04:30:46.497341+0000","last_undegraded":"2024-09-19T04:30:46.497341+0000","last_fullsized":"2024-09-19T04:30:46.497341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:44.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531611+0000","last_change":"2024-09-19T04:29:02.415095+0000","last_active":"2024-09-19T04:30:46.531611+0000","last_peered":"2024-09-19T04:30:46.531611+0000","last_clean":"2024-09-19T04:30:46.531611+0000","last_became_active":"2024-09-19T04:29:02.414576+0000","last_became_peered":"2024-09-19T04:29:02.414576+0000","last_unstale":"2024-09-19T04:30:46.531611+0000","last_undegraded":"2024-09-19T04:30:46.531611+0000","last_fullsized":"2024-09-19T04:30:46.531611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:52.744011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.503839+0000","last_change":"2024-09-19T04:29:00.397737+0000","last_active":"2024-09-19T04:30:46.503839+0000","last_peered":"2024-09-19T04:30:46.503839+0000","last_clean":"2024-09-19T04:30:46.503839+0000","last_became_active":"2024-09-19T04:29:00.397397+0000","last_became_peered":"2024-09-19T04:29:00.397397+0000","last_unstale":"2024-09-19T04:30:46.503839+0000","last_undegraded":"2024-09-19T04:30:46.503839+0000","last_fullsized":"2024-09-19T04:30:46.503839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:49:16.108744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":592816,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":693,"num_read_kb":448,"num_write":291,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2002944,"data_stored":1778448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547234,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":449853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33016,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712136,"statfs":{"total":95995035648,"available":95961227264,"internally_reserved":0,"allocated":1753088,"data_stored":1236021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1331200,"data_stored":843283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201329,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":449965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1531904,"data_stored":1044622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":449456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28664,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716488,"statfs":{"total":95995035648,"available":95965683712,"internally_reserved":0,"allocated":1679360,"data_stored":1174091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":929792,"data_stored":451708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40940,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704212,"statfs":{"total":95995035648,"available":95953113088,"internally_reserved":0,"allocated":1470464,"data_stored":974583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":513174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":510543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":946176,"data_stored":450727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":196287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:30:52.188 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T04:30:52.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 -- 172.21.15.70:0/1581086910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281069d0 msgr2=0x7f7b28106db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1581086910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281069d0 0x7f7b28106db0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f7b18009930 tx=0x7f7b1802a420 comp rx=0 tx=0).stop 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 -- 172.21.15.70:0/1581086910 shutdown_connections 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1581086910 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b28101360 0x7f7b2810d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1581086910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b281009c0 0x7f7b28100e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1581086910 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281069d0 0x7f7b28106db0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 -- 172.21.15.70:0/1581086910 >> 172.21.15.70:0/1581086910 conn(0x7f7b280fc6a0 msgr2=0x7f7b280feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 -- 172.21.15.70:0/1581086910 shutdown_connections 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.322+0000 7f7b2e378640 1 -- 172.21.15.70:0/1581086910 wait complete. 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b2e378640 1 Processor -- start 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b2e378640 1 -- start start 2024-09-19T04:30:52.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b2e378640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281009c0 0x7f7b281991f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b2e378640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b28101360 0x7f7b28199730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b2e378640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b281069d0 0x7f7b281a4270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b2e378640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28110da0 con 0x7f7b281009c0 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b2e378640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28110c20 con 0x7f7b28101360 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b2e378640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7b28110f20 con 0x7f7b281069d0 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.323+0000 7f7b27fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281009c0 0x7f7b281991f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b27fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281009c0 0x7f7b281991f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56824/0 (socket says 172.21.15.70:56824) 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b27fff640 1 -- 172.21.15.70:0/1154678031 learned_addr learned my addr 172.21.15.70:0/1154678031 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b277fe640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b28101360 0x7f7b28199730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:52.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b2c915640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b281069d0 0x7f7b281a4270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b27fff640 1 -- 172.21.15.70:0/1154678031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b281069d0 msgr2=0x7f7b281a4270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b27fff640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b281069d0 0x7f7b281a4270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b27fff640 1 -- 172.21.15.70:0/1154678031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b28101360 msgr2=0x7f7b28199730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b27fff640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b28101360 0x7f7b28199730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b27fff640 1 -- 172.21.15.70:0/1154678031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b281a47b0 con 0x7f7b281009c0 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b27fff640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281009c0 0x7f7b281991f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b18005940 tx=0x7f7b180042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b257fa640 1 -- 172.21.15.70:0/1154678031 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1803f030 con 0x7f7b281009c0 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b281a4980 con 0x7f7b281009c0 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b257fa640 1 -- 172.21.15.70:0/1154678031 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7b18003ac0 con 0x7f7b281009c0 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b257fa640 1 -- 172.21.15.70:0/1154678031 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b18035070 con 0x7f7b281009c0 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.324+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b281a4de0 con 0x7f7b281009c0 2024-09-19T04:30:52.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.325+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b28100e20 con 0x7f7b281009c0 2024-09-19T04:30:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.326+0000 7f7b257fa640 1 -- 172.21.15.70:0/1154678031 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f7b18042030 con 0x7f7b281009c0 2024-09-19T04:30:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.327+0000 7f7b257fa640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7b100a34e0 0x7f7b100a59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.327+0000 7f7b277fe640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7b100a34e0 0x7f7b100a59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.327+0000 7f7b257fa640 1 -- 172.21.15.70:0/1154678031 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f7b180f06f0 con 0x7f7b281009c0 2024-09-19T04:30:52.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.327+0000 7f7b277fe640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7b100a34e0 0x7f7b100a59a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b2806af10 tx=0x7f7b1c00a2d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:52.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.330+0000 7f7b257fa640 1 -- 172.21.15.70:0/1154678031 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7b180bcf70 con 0x7f7b281009c0 2024-09-19T04:30:52.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.496+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f7b28062630 con 0x7f7b100a34e0 2024-09-19T04:30:52.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.503+0000 7f7b257fa640 1 -- 172.21.15.70:0/1154678031 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257846 (secure 0 0 0) 0x7f7b28062630 con 0x7f7b100a34e0 2024-09-19T04:30:52.507 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:52.508 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-19T04:30:52.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7b100a34e0 msgr2=0x7f7b100a59a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7b100a34e0 0x7f7b100a59a0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f7b2806af10 tx=0x7f7b1c00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281009c0 msgr2=0x7f7b281991f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281009c0 0x7f7b281991f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f7b18005940 tx=0x7f7b180042f0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 shutdown_connections 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7b100a34e0 0x7f7b100a59a0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7b281069d0 0x7f7b281a4270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7b28101360 0x7f7b28199730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 --2- 172.21.15.70:0/1154678031 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7b281009c0 0x7f7b281991f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 >> 172.21.15.70:0/1154678031 conn(0x7f7b280fc6a0 msgr2=0x7f7b280fce90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:52.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 shutdown_connections 2024-09-19T04:30:52.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.506+0000 7f7b2e378640 1 -- 172.21.15.70:0/1154678031 wait complete. 2024-09-19T04:30:52.519 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":5,"stamp":"2024-09-19T04:30:50.510534+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1183418,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":829,"num_read_kb":567,"num_write":474,"num_write_kb":4373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":866,"ondisk_log_size":866,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375972,"kb_used_data":14088,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565852,"statfs":{"total":1151940427776,"available":1151555432448,"internally_reserved":0,"allocated":14426112,"data_stored":8548026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"3.001299"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533458+0000","last_change":"2024-09-19T04:29:02.416257+0000","last_active":"2024-09-19T04:30:46.533458+0000","last_peered":"2024-09-19T04:30:46.533458+0000","last_clean":"2024-09-19T04:30:46.533458+0000","last_became_active":"2024-09-19T04:29:02.415681+0000","last_became_peered":"2024-09-19T04:29:02.415681+0000","last_unstale":"2024-09-19T04:30:46.533458+0000","last_undegraded":"2024-09-19T04:30:46.533458+0000","last_fullsized":"2024-09-19T04:30:46.533458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:31.765859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533964+0000","last_change":"2024-09-19T04:29:02.417591+0000","last_active":"2024-09-19T04:30:46.533964+0000","last_peered":"2024-09-19T04:30:46.533964+0000","last_clean":"2024-09-19T04:30:46.533964+0000","last_became_active":"2024-09-19T04:29:02.417277+0000","last_became_peered":"2024-09-19T04:29:02.417277+0000","last_unstale":"2024-09-19T04:30:46.533964+0000","last_undegraded":"2024-09-19T04:30:46.533964+0000","last_fullsized":"2024-09-19T04:30:46.533964+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:22.680000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537963+0000","last_change":"2024-09-19T04:29:02.416270+0000","last_active":"2024-09-19T04:30:46.537963+0000","last_peered":"2024-09-19T04:30:46.537963+0000","last_clean":"2024-09-19T04:30:46.537963+0000","last_became_active":"2024-09-19T04:29:02.415878+0000","last_became_peered":"2024-09-19T04:29:02.415878+0000","last_unstale":"2024-09-19T04:30:46.537963+0000","last_undegraded":"2024-09-19T04:30:46.537963+0000","last_fullsized":"2024-09-19T04:30:46.537963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:25.302575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536145+0000","last_change":"2024-09-19T04:29:02.414586+0000","last_active":"2024-09-19T04:30:46.536145+0000","last_peered":"2024-09-19T04:30:46.536145+0000","last_clean":"2024-09-19T04:30:46.536145+0000","last_became_active":"2024-09-19T04:29:02.414267+0000","last_became_peered":"2024-09-19T04:29:02.414267+0000","last_unstale":"2024-09-19T04:30:46.536145+0000","last_undegraded":"2024-09-19T04:30:46.536145+0000","last_fullsized":"2024-09-19T04:30:46.536145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:01.436793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536599+0000","last_change":"2024-09-19T04:29:02.412243+0000","last_active":"2024-09-19T04:30:46.536599+0000","last_peered":"2024-09-19T04:30:46.536599+0000","last_clean":"2024-09-19T04:30:46.536599+0000","last_became_active":"2024-09-19T04:29:02.411411+0000","last_became_peered":"2024-09-19T04:29:02.411411+0000","last_unstale":"2024-09-19T04:30:46.536599+0000","last_undegraded":"2024-09-19T04:30:46.536599+0000","last_fullsized":"2024-09-19T04:30:46.536599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:21.966542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.534637+0000","last_change":"2024-09-19T04:29:18.482295+0000","last_active":"2024-09-19T04:30:46.534637+0000","last_peered":"2024-09-19T04:30:46.534637+0000","last_clean":"2024-09-19T04:30:46.534637+0000","last_became_active":"2024-09-19T04:29:18.481929+0000","last_became_peered":"2024-09-19T04:29:18.481929+0000","last_unstale":"2024-09-19T04:30:46.534637+0000","last_undegraded":"2024-09-19T04:30:46.534637+0000","last_fullsized":"2024-09-19T04:30:46.534637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:17.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538019+0000","last_change":"2024-09-19T04:29:02.418029+0000","last_active":"2024-09-19T04:30:46.538019+0000","last_peered":"2024-09-19T04:30:46.538019+0000","last_clean":"2024-09-19T04:30:46.538019+0000","last_became_active":"2024-09-19T04:29:02.417676+0000","last_became_peered":"2024-09-19T04:29:02.417676+0000","last_unstale":"2024-09-19T04:30:46.538019+0000","last_undegraded":"2024-09-19T04:30:46.538019+0000","last_fullsized":"2024-09-19T04:30:46.538019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:12:03.148693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538928+0000","last_change":"2024-09-19T04:29:02.406657+0000","last_active":"2024-09-19T04:30:46.538928+0000","last_peered":"2024-09-19T04:30:46.538928+0000","last_clean":"2024-09-19T04:30:46.538928+0000","last_became_active":"2024-09-19T04:29:02.406203+0000","last_became_peered":"2024-09-19T04:29:02.406203+0000","last_unstale":"2024-09-19T04:30:46.538928+0000","last_undegraded":"2024-09-19T04:30:46.538928+0000","last_fullsized":"2024-09-19T04:30:46.538928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:06.842516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531218+0000","last_change":"2024-09-19T04:29:02.426478+0000","last_active":"2024-09-19T04:30:46.531218+0000","last_peered":"2024-09-19T04:30:46.531218+0000","last_clean":"2024-09-19T04:30:46.531218+0000","last_became_active":"2024-09-19T04:29:02.425938+0000","last_became_peered":"2024-09-19T04:29:02.425938+0000","last_unstale":"2024-09-19T04:30:46.531218+0000","last_undegraded":"2024-09-19T04:30:46.531218+0000","last_fullsized":"2024-09-19T04:30:46.531218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:01.439087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537678+0000","last_change":"2024-09-19T04:29:02.423380+0000","last_active":"2024-09-19T04:30:46.537678+0000","last_peered":"2024-09-19T04:30:46.537678+0000","last_clean":"2024-09-19T04:30:46.537678+0000","last_became_active":"2024-09-19T04:29:02.422894+0000","last_became_peered":"2024-09-19T04:29:02.422894+0000","last_unstale":"2024-09-19T04:30:46.537678+0000","last_undegraded":"2024-09-19T04:30:46.537678+0000","last_fullsized":"2024-09-19T04:30:46.537678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:55.082196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.543106+0000","last_change":"2024-09-19T04:29:02.419929+0000","last_active":"2024-09-19T04:30:46.543106+0000","last_peered":"2024-09-19T04:30:46.543106+0000","last_clean":"2024-09-19T04:30:46.543106+0000","last_became_active":"2024-09-19T04:29:02.419432+0000","last_became_peered":"2024-09-19T04:29:02.419432+0000","last_unstale":"2024-09-19T04:30:46.543106+0000","last_undegraded":"2024-09-19T04:30:46.543106+0000","last_fullsized":"2024-09-19T04:30:46.543106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:50:03.896524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.529367+0000","last_change":"2024-09-19T04:29:18.481426+0000","last_active":"2024-09-19T04:30:46.529367+0000","last_peered":"2024-09-19T04:30:46.529367+0000","last_clean":"2024-09-19T04:30:46.529367+0000","last_became_active":"2024-09-19T04:29:18.481042+0000","last_became_peered":"2024-09-19T04:29:18.481042+0000","last_unstale":"2024-09-19T04:30:46.529367+0000","last_undegraded":"2024-09-19T04:30:46.529367+0000","last_fullsized":"2024-09-19T04:30:46.529367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:16.251818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.527488+0000","last_change":"2024-09-19T04:29:02.405545+0000","last_active":"2024-09-19T04:30:46.527488+0000","last_peered":"2024-09-19T04:30:46.527488+0000","last_clean":"2024-09-19T04:30:46.527488+0000","last_became_active":"2024-09-19T04:29:02.405247+0000","last_became_peered":"2024-09-19T04:29:02.405247+0000","last_unstale":"2024-09-19T04:30:46.527488+0000","last_undegraded":"2024-09-19T04:30:46.527488+0000","last_fullsized":"2024-09-19T04:30:46.527488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:26.673842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538618+0000","last_change":"2024-09-19T04:29:02.420647+0000","last_active":"2024-09-19T04:30:46.538618+0000","last_peered":"2024-09-19T04:30:46.538618+0000","last_clean":"2024-09-19T04:30:46.538618+0000","last_became_active":"2024-09-19T04:29:02.420310+0000","last_became_peered":"2024-09-19T04:29:02.420310+0000","last_unstale":"2024-09-19T04:30:46.538618+0000","last_undegraded":"2024-09-19T04:30:46.538618+0000","last_fullsized":"2024-09-19T04:30:46.538618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:47.893734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538556+0000","last_change":"2024-09-19T04:29:02.419199+0000","last_active":"2024-09-19T04:30:46.538556+0000","last_peered":"2024-09-19T04:30:46.538556+0000","last_clean":"2024-09-19T04:30:46.538556+0000","last_became_active":"2024-09-19T04:29:02.418902+0000","last_became_peered":"2024-09-19T04:29:02.418902+0000","last_unstale":"2024-09-19T04:30:46.538556+0000","last_undegraded":"2024-09-19T04:30:46.538556+0000","last_fullsized":"2024-09-19T04:30:46.538556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:04.958933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542787+0000","last_change":"2024-09-19T04:29:02.415284+0000","last_active":"2024-09-19T04:30:46.542787+0000","last_peered":"2024-09-19T04:30:46.542787+0000","last_clean":"2024-09-19T04:30:46.542787+0000","last_became_active":"2024-09-19T04:29:02.414947+0000","last_became_peered":"2024-09-19T04:29:02.414947+0000","last_unstale":"2024-09-19T04:30:46.542787+0000","last_undegraded":"2024-09-19T04:30:46.542787+0000","last_fullsized":"2024-09-19T04:30:46.542787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:08.525325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533676+0000","last_change":"2024-09-19T04:29:02.422294+0000","last_active":"2024-09-19T04:30:46.533676+0000","last_peered":"2024-09-19T04:30:46.533676+0000","last_clean":"2024-09-19T04:30:46.533676+0000","last_became_active":"2024-09-19T04:29:02.421014+0000","last_became_peered":"2024-09-19T04:29:02.421014+0000","last_unstale":"2024-09-19T04:30:46.533676+0000","last_undegraded":"2024-09-19T04:30:46.533676+0000","last_fullsized":"2024-09-19T04:30:46.533676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:34.197168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536966+0000","last_change":"2024-09-19T04:29:02.415319+0000","last_active":"2024-09-19T04:30:46.536966+0000","last_peered":"2024-09-19T04:30:46.536966+0000","last_clean":"2024-09-19T04:30:46.536966+0000","last_became_active":"2024-09-19T04:29:02.415030+0000","last_became_peered":"2024-09-19T04:29:02.415030+0000","last_unstale":"2024-09-19T04:30:46.536966+0000","last_undegraded":"2024-09-19T04:30:46.536966+0000","last_fullsized":"2024-09-19T04:30:46.536966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:11.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542299+0000","last_change":"2024-09-19T04:29:02.415938+0000","last_active":"2024-09-19T04:30:46.542299+0000","last_peered":"2024-09-19T04:30:46.542299+0000","last_clean":"2024-09-19T04:30:46.542299+0000","last_became_active":"2024-09-19T04:29:02.411665+0000","last_became_peered":"2024-09-19T04:29:02.411665+0000","last_unstale":"2024-09-19T04:30:46.542299+0000","last_undegraded":"2024-09-19T04:30:46.542299+0000","last_fullsized":"2024-09-19T04:30:46.542299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:12.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532036+0000","last_change":"2024-09-19T04:29:02.417489+0000","last_active":"2024-09-19T04:30:46.532036+0000","last_peered":"2024-09-19T04:30:46.532036+0000","last_clean":"2024-09-19T04:30:46.532036+0000","last_became_active":"2024-09-19T04:29:02.417164+0000","last_became_peered":"2024-09-19T04:29:02.417164+0000","last_unstale":"2024-09-19T04:30:46.532036+0000","last_undegraded":"2024-09-19T04:30:46.532036+0000","last_fullsized":"2024-09-19T04:30:46.532036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:28.055517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538975+0000","last_change":"2024-09-19T04:29:02.407559+0000","last_active":"2024-09-19T04:30:46.538975+0000","last_peered":"2024-09-19T04:30:46.538975+0000","last_clean":"2024-09-19T04:30:46.538975+0000","last_became_active":"2024-09-19T04:29:02.407241+0000","last_became_peered":"2024-09-19T04:29:02.407241+0000","last_unstale":"2024-09-19T04:30:46.538975+0000","last_undegraded":"2024-09-19T04:30:46.538975+0000","last_fullsized":"2024-09-19T04:30:46.538975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:13.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541684+0000","last_change":"2024-09-19T04:29:02.418341+0000","last_active":"2024-09-19T04:30:46.541684+0000","last_peered":"2024-09-19T04:30:46.541684+0000","last_clean":"2024-09-19T04:30:46.541684+0000","last_became_active":"2024-09-19T04:29:02.418028+0000","last_became_peered":"2024-09-19T04:29:02.418028+0000","last_unstale":"2024-09-19T04:30:46.541684+0000","last_undegraded":"2024-09-19T04:30:46.541684+0000","last_fullsized":"2024-09-19T04:30:46.541684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:03.264803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532781+0000","last_change":"2024-09-19T04:29:02.419191+0000","last_active":"2024-09-19T04:30:46.532781+0000","last_peered":"2024-09-19T04:30:46.532781+0000","last_clean":"2024-09-19T04:30:46.532781+0000","last_became_active":"2024-09-19T04:29:02.418587+0000","last_became_peered":"2024-09-19T04:29:02.418587+0000","last_unstale":"2024-09-19T04:30:46.532781+0000","last_undegraded":"2024-09-19T04:30:46.532781+0000","last_fullsized":"2024-09-19T04:30:46.532781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:58.185492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537222+0000","last_change":"2024-09-19T04:29:02.407961+0000","last_active":"2024-09-19T04:30:46.537222+0000","last_peered":"2024-09-19T04:30:46.537222+0000","last_clean":"2024-09-19T04:30:46.537222+0000","last_became_active":"2024-09-19T04:29:02.406888+0000","last_became_peered":"2024-09-19T04:29:02.406888+0000","last_unstale":"2024-09-19T04:30:46.537222+0000","last_undegraded":"2024-09-19T04:30:46.537222+0000","last_fullsized":"2024-09-19T04:30:46.537222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:47.360605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532530+0000","last_change":"2024-09-19T04:29:02.415234+0000","last_active":"2024-09-19T04:30:46.532530+0000","last_peered":"2024-09-19T04:30:46.532530+0000","last_clean":"2024-09-19T04:30:46.532530+0000","last_became_active":"2024-09-19T04:29:02.414929+0000","last_became_peered":"2024-09-19T04:29:02.414929+0000","last_unstale":"2024-09-19T04:30:46.532530+0000","last_undegraded":"2024-09-19T04:30:46.532530+0000","last_fullsized":"2024-09-19T04:30:46.532530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:48.077114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538596+0000","last_change":"2024-09-19T04:29:02.416072+0000","last_active":"2024-09-19T04:30:46.538596+0000","last_peered":"2024-09-19T04:30:46.538596+0000","last_clean":"2024-09-19T04:30:46.538596+0000","last_became_active":"2024-09-19T04:29:02.415714+0000","last_became_peered":"2024-09-19T04:29:02.415714+0000","last_unstale":"2024-09-19T04:30:46.538596+0000","last_undegraded":"2024-09-19T04:30:46.538596+0000","last_fullsized":"2024-09-19T04:30:46.538596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:45.000850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.528255+0000","last_change":"2024-09-19T04:29:02.426071+0000","last_active":"2024-09-19T04:30:46.528255+0000","last_peered":"2024-09-19T04:30:46.528255+0000","last_clean":"2024-09-19T04:30:46.528255+0000","last_became_active":"2024-09-19T04:29:02.425717+0000","last_became_peered":"2024-09-19T04:29:02.425717+0000","last_unstale":"2024-09-19T04:30:46.528255+0000","last_undegraded":"2024-09-19T04:30:46.528255+0000","last_fullsized":"2024-09-19T04:30:46.528255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:11.989191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541570+0000","last_change":"2024-09-19T04:29:18.481675+0000","last_active":"2024-09-19T04:30:46.541570+0000","last_peered":"2024-09-19T04:30:46.541570+0000","last_clean":"2024-09-19T04:30:46.541570+0000","last_became_active":"2024-09-19T04:29:18.481224+0000","last_became_peered":"2024-09-19T04:29:18.481224+0000","last_unstale":"2024-09-19T04:30:46.541570+0000","last_undegraded":"2024-09-19T04:30:46.541570+0000","last_fullsized":"2024-09-19T04:30:46.541570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:10.928554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540263+0000","last_change":"2024-09-19T04:29:02.413973+0000","last_active":"2024-09-19T04:30:46.540263+0000","last_peered":"2024-09-19T04:30:46.540263+0000","last_clean":"2024-09-19T04:30:46.540263+0000","last_became_active":"2024-09-19T04:29:02.413695+0000","last_became_peered":"2024-09-19T04:29:02.413695+0000","last_unstale":"2024-09-19T04:30:46.540263+0000","last_undegraded":"2024-09-19T04:30:46.540263+0000","last_fullsized":"2024-09-19T04:30:46.540263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:11.961493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535839+0000","last_change":"2024-09-19T04:29:02.413943+0000","last_active":"2024-09-19T04:30:46.535839+0000","last_peered":"2024-09-19T04:30:46.535839+0000","last_clean":"2024-09-19T04:30:46.535839+0000","last_became_active":"2024-09-19T04:29:02.411977+0000","last_became_peered":"2024-09-19T04:29:02.411977+0000","last_unstale":"2024-09-19T04:30:46.535839+0000","last_undegraded":"2024-09-19T04:30:46.535839+0000","last_fullsized":"2024-09-19T04:30:46.535839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:38.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535817+0000","last_change":"2024-09-19T04:29:02.420995+0000","last_active":"2024-09-19T04:30:46.535817+0000","last_peered":"2024-09-19T04:30:46.535817+0000","last_clean":"2024-09-19T04:30:46.535817+0000","last_became_active":"2024-09-19T04:29:02.420552+0000","last_became_peered":"2024-09-19T04:29:02.420552+0000","last_unstale":"2024-09-19T04:30:46.535817+0000","last_undegraded":"2024-09-19T04:30:46.535817+0000","last_fullsized":"2024-09-19T04:30:46.535817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:12.560776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533888+0000","last_change":"2024-09-19T04:29:18.481041+0000","last_active":"2024-09-19T04:30:46.533888+0000","last_peered":"2024-09-19T04:30:46.533888+0000","last_clean":"2024-09-19T04:30:46.533888+0000","last_became_active":"2024-09-19T04:29:18.480478+0000","last_became_peered":"2024-09-19T04:29:18.480478+0000","last_unstale":"2024-09-19T04:30:46.533888+0000","last_undegraded":"2024-09-19T04:30:46.533888+0000","last_fullsized":"2024-09-19T04:30:46.533888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.526134+0000","last_change":"2024-09-19T04:29:02.411380+0000","last_active":"2024-09-19T04:30:46.526134+0000","last_peered":"2024-09-19T04:30:46.526134+0000","last_clean":"2024-09-19T04:30:46.526134+0000","last_became_active":"2024-09-19T04:29:02.410977+0000","last_became_peered":"2024-09-19T04:29:02.410977+0000","last_unstale":"2024-09-19T04:30:46.526134+0000","last_undegraded":"2024-09-19T04:30:46.526134+0000","last_fullsized":"2024-09-19T04:30:46.526134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.147856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'8","reported_seq":130,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.762048+0000","last_change":"2024-09-19T04:29:00.394886+0000","last_active":"2024-09-19T04:30:46.762048+0000","last_peered":"2024-09-19T04:30:46.762048+0000","last_clean":"2024-09-19T04:30:46.762048+0000","last_became_active":"2024-09-19T04:29:00.394412+0000","last_became_peered":"2024-09-19T04:29:00.394412+0000","last_unstale":"2024-09-19T04:30:46.762048+0000","last_undegraded":"2024-09-19T04:30:46.762048+0000","last_fullsized":"2024-09-19T04:30:46.762048+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:43.929791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1903,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":98,"num_read_kb":3,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536908+0000","last_change":"2024-09-19T04:29:02.413258+0000","last_active":"2024-09-19T04:30:46.536908+0000","last_peered":"2024-09-19T04:30:46.536908+0000","last_clean":"2024-09-19T04:30:46.536908+0000","last_became_active":"2024-09-19T04:29:02.412887+0000","last_became_peered":"2024-09-19T04:29:02.412887+0000","last_unstale":"2024-09-19T04:30:46.536908+0000","last_undegraded":"2024-09-19T04:30:46.536908+0000","last_fullsized":"2024-09-19T04:30:46.536908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:26.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494757+0000","last_change":"2024-09-19T04:29:00.395696+0000","last_active":"2024-09-19T04:30:46.494757+0000","last_peered":"2024-09-19T04:30:46.494757+0000","last_clean":"2024-09-19T04:30:46.494757+0000","last_became_active":"2024-09-19T04:29:00.395363+0000","last_became_peered":"2024-09-19T04:29:00.395363+0000","last_unstale":"2024-09-19T04:30:46.494757+0000","last_undegraded":"2024-09-19T04:30:46.494757+0000","last_fullsized":"2024-09-19T04:30:46.494757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:50.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.489872+0000","last_change":"2024-09-19T04:29:00.391765+0000","last_active":"2024-09-19T04:30:46.489872+0000","last_peered":"2024-09-19T04:30:46.489872+0000","last_clean":"2024-09-19T04:30:46.489872+0000","last_became_active":"2024-09-19T04:29:00.391412+0000","last_became_peered":"2024-09-19T04:29:00.391412+0000","last_unstale":"2024-09-19T04:30:46.489872+0000","last_undegraded":"2024-09-19T04:30:46.489872+0000","last_fullsized":"2024-09-19T04:30:46.489872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:27.423046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.529949+0000","last_change":"2024-09-19T04:29:02.417820+0000","last_active":"2024-09-19T04:30:46.529949+0000","last_peered":"2024-09-19T04:30:46.529949+0000","last_clean":"2024-09-19T04:30:46.529949+0000","last_became_active":"2024-09-19T04:29:02.417452+0000","last_became_peered":"2024-09-19T04:29:02.417452+0000","last_unstale":"2024-09-19T04:30:46.529949+0000","last_undegraded":"2024-09-19T04:30:46.529949+0000","last_fullsized":"2024-09-19T04:30:46.529949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:34.767829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494641+0000","last_change":"2024-09-19T04:29:00.393075+0000","last_active":"2024-09-19T04:30:46.494641+0000","last_peered":"2024-09-19T04:30:46.494641+0000","last_clean":"2024-09-19T04:30:46.494641+0000","last_became_active":"2024-09-19T04:29:00.392695+0000","last_became_peered":"2024-09-19T04:29:00.392695+0000","last_unstale":"2024-09-19T04:30:46.494641+0000","last_undegraded":"2024-09-19T04:30:46.494641+0000","last_fullsized":"2024-09-19T04:30:46.494641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:43.122636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537328+0000","last_change":"2024-09-19T04:29:02.403886+0000","last_active":"2024-09-19T04:30:46.537328+0000","last_peered":"2024-09-19T04:30:46.537328+0000","last_clean":"2024-09-19T04:30:46.537328+0000","last_became_active":"2024-09-19T04:29:02.403530+0000","last_became_peered":"2024-09-19T04:29:02.403530+0000","last_unstale":"2024-09-19T04:30:46.537328+0000","last_undegraded":"2024-09-19T04:30:46.537328+0000","last_fullsized":"2024-09-19T04:30:46.537328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:57.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":123,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.495151+0000","last_change":"2024-09-19T04:29:00.390081+0000","last_active":"2024-09-19T04:30:46.495151+0000","last_peered":"2024-09-19T04:30:46.495151+0000","last_clean":"2024-09-19T04:30:46.495151+0000","last_became_active":"2024-09-19T04:29:00.389701+0000","last_became_peered":"2024-09-19T04:29:00.389701+0000","last_unstale":"2024-09-19T04:30:46.495151+0000","last_undegraded":"2024-09-19T04:30:46.495151+0000","last_fullsized":"2024-09-19T04:30:46.495151+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:42.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538592+0000","last_change":"2024-09-19T04:29:02.424712+0000","last_active":"2024-09-19T04:30:46.538592+0000","last_peered":"2024-09-19T04:30:46.538592+0000","last_clean":"2024-09-19T04:30:46.538592+0000","last_became_active":"2024-09-19T04:29:02.424316+0000","last_became_peered":"2024-09-19T04:29:02.424316+0000","last_unstale":"2024-09-19T04:30:46.538592+0000","last_undegraded":"2024-09-19T04:30:46.538592+0000","last_fullsized":"2024-09-19T04:30:46.538592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:06:21.246473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.518453+0000","last_change":"2024-09-19T04:29:00.396085+0000","last_active":"2024-09-19T04:30:46.518453+0000","last_peered":"2024-09-19T04:30:46.518453+0000","last_clean":"2024-09-19T04:30:46.518453+0000","last_became_active":"2024-09-19T04:29:00.395737+0000","last_became_peered":"2024-09-19T04:29:00.395737+0000","last_unstale":"2024-09-19T04:30:46.518453+0000","last_undegraded":"2024-09-19T04:30:46.518453+0000","last_fullsized":"2024-09-19T04:30:46.518453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:59.429917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536976+0000","last_change":"2024-09-19T04:29:02.412318+0000","last_active":"2024-09-19T04:30:46.536976+0000","last_peered":"2024-09-19T04:30:46.536976+0000","last_clean":"2024-09-19T04:30:46.536976+0000","last_became_active":"2024-09-19T04:29:02.412020+0000","last_became_peered":"2024-09-19T04:29:02.412020+0000","last_unstale":"2024-09-19T04:30:46.536976+0000","last_undegraded":"2024-09-19T04:30:46.536976+0000","last_fullsized":"2024-09-19T04:30:46.536976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:45.341633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.495019+0000","last_change":"2024-09-19T04:29:00.507027+0000","last_active":"2024-09-19T04:30:46.495019+0000","last_peered":"2024-09-19T04:30:46.495019+0000","last_clean":"2024-09-19T04:30:46.495019+0000","last_became_active":"2024-09-19T04:29:00.506660+0000","last_became_peered":"2024-09-19T04:29:00.506660+0000","last_unstale":"2024-09-19T04:30:46.495019+0000","last_undegraded":"2024-09-19T04:30:46.495019+0000","last_fullsized":"2024-09-19T04:30:46.495019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:54.629719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536650+0000","last_change":"2024-09-19T04:29:02.415423+0000","last_active":"2024-09-19T04:30:46.536650+0000","last_peered":"2024-09-19T04:30:46.536650+0000","last_clean":"2024-09-19T04:30:46.536650+0000","last_became_active":"2024-09-19T04:29:02.415105+0000","last_became_peered":"2024-09-19T04:29:02.415105+0000","last_unstale":"2024-09-19T04:30:46.536650+0000","last_undegraded":"2024-09-19T04:30:46.536650+0000","last_fullsized":"2024-09-19T04:30:46.536650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:00.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'34","reported_seq":259,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.761844+0000","last_change":"2024-09-19T04:29:00.396021+0000","last_active":"2024-09-19T04:30:46.761844+0000","last_peered":"2024-09-19T04:30:46.761844+0000","last_clean":"2024-09-19T04:30:46.761844+0000","last_became_active":"2024-09-19T04:29:00.395649+0000","last_became_peered":"2024-09-19T04:29:00.395649+0000","last_unstale":"2024-09-19T04:30:46.761844+0000","last_undegraded":"2024-09-19T04:30:46.761844+0000","last_fullsized":"2024-09-19T04:30:46.761844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:56.800573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":61294,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":201,"num_read_kb":159,"num_write":35,"num_write_kb":75,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.526198+0000","last_change":"2024-09-19T04:29:02.416081+0000","last_active":"2024-09-19T04:30:46.526198+0000","last_peered":"2024-09-19T04:30:46.526198+0000","last_clean":"2024-09-19T04:30:46.526198+0000","last_became_active":"2024-09-19T04:29:02.415780+0000","last_became_peered":"2024-09-19T04:29:02.415780+0000","last_unstale":"2024-09-19T04:30:46.526198+0000","last_undegraded":"2024-09-19T04:30:46.526198+0000","last_fullsized":"2024-09-19T04:30:46.526198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:23.438141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497681+0000","last_change":"2024-09-19T04:29:00.396397+0000","last_active":"2024-09-19T04:30:46.497681+0000","last_peered":"2024-09-19T04:30:46.497681+0000","last_clean":"2024-09-19T04:30:46.497681+0000","last_became_active":"2024-09-19T04:29:00.395896+0000","last_became_peered":"2024-09-19T04:29:00.395896+0000","last_unstale":"2024-09-19T04:30:46.497681+0000","last_undegraded":"2024-09-19T04:30:46.497681+0000","last_fullsized":"2024-09-19T04:30:46.497681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:06.174262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538251+0000","last_change":"2024-09-19T04:29:02.408299+0000","last_active":"2024-09-19T04:30:46.538251+0000","last_peered":"2024-09-19T04:30:46.538251+0000","last_clean":"2024-09-19T04:30:46.538251+0000","last_became_active":"2024-09-19T04:29:02.407970+0000","last_became_peered":"2024-09-19T04:29:02.407970+0000","last_unstale":"2024-09-19T04:30:46.538251+0000","last_undegraded":"2024-09-19T04:30:46.538251+0000","last_fullsized":"2024-09-19T04:30:46.538251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:50.758517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494741+0000","last_change":"2024-09-19T04:29:00.393163+0000","last_active":"2024-09-19T04:30:46.494741+0000","last_peered":"2024-09-19T04:30:46.494741+0000","last_clean":"2024-09-19T04:30:46.494741+0000","last_became_active":"2024-09-19T04:29:00.392749+0000","last_became_peered":"2024-09-19T04:29:00.392749+0000","last_unstale":"2024-09-19T04:30:46.494741+0000","last_undegraded":"2024-09-19T04:30:46.494741+0000","last_fullsized":"2024-09-19T04:30:46.494741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:41.999124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.543441+0000","last_change":"2024-09-19T04:29:02.412754+0000","last_active":"2024-09-19T04:30:46.543441+0000","last_peered":"2024-09-19T04:30:46.543441+0000","last_clean":"2024-09-19T04:30:46.543441+0000","last_became_active":"2024-09-19T04:29:02.412445+0000","last_became_peered":"2024-09-19T04:29:02.412445+0000","last_unstale":"2024-09-19T04:30:46.543441+0000","last_undegraded":"2024-09-19T04:30:46.543441+0000","last_fullsized":"2024-09-19T04:30:46.543441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:52:31.531672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":131,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.764348+0000","last_change":"2024-09-19T04:29:00.393863+0000","last_active":"2024-09-19T04:30:46.764348+0000","last_peered":"2024-09-19T04:30:46.764348+0000","last_clean":"2024-09-19T04:30:46.764348+0000","last_became_active":"2024-09-19T04:29:00.393502+0000","last_became_peered":"2024-09-19T04:29:00.393502+0000","last_unstale":"2024-09-19T04:30:46.764348+0000","last_undegraded":"2024-09-19T04:30:46.764348+0000","last_fullsized":"2024-09-19T04:30:46.764348+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:26.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2403,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":5,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538632+0000","last_change":"2024-09-19T04:29:02.412624+0000","last_active":"2024-09-19T04:30:46.538632+0000","last_peered":"2024-09-19T04:30:46.538632+0000","last_clean":"2024-09-19T04:30:46.538632+0000","last_became_active":"2024-09-19T04:29:02.412299+0000","last_became_peered":"2024-09-19T04:29:02.412299+0000","last_unstale":"2024-09-19T04:30:46.538632+0000","last_undegraded":"2024-09-19T04:30:46.538632+0000","last_fullsized":"2024-09-19T04:30:46.538632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.062422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.504375+0000","last_change":"2024-09-19T04:29:00.504931+0000","last_active":"2024-09-19T04:30:46.504375+0000","last_peered":"2024-09-19T04:30:46.504375+0000","last_clean":"2024-09-19T04:30:46.504375+0000","last_became_active":"2024-09-19T04:29:00.504526+0000","last_became_peered":"2024-09-19T04:29:00.504526+0000","last_unstale":"2024-09-19T04:30:46.504375+0000","last_undegraded":"2024-09-19T04:30:46.504375+0000","last_fullsized":"2024-09-19T04:30:46.504375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:31.096516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530159+0000","last_change":"2024-09-19T04:29:02.424492+0000","last_active":"2024-09-19T04:30:46.530159+0000","last_peered":"2024-09-19T04:30:46.530159+0000","last_clean":"2024-09-19T04:30:46.530159+0000","last_became_active":"2024-09-19T04:29:02.424013+0000","last_became_peered":"2024-09-19T04:29:02.424013+0000","last_unstale":"2024-09-19T04:30:46.530159+0000","last_undegraded":"2024-09-19T04:30:46.530159+0000","last_fullsized":"2024-09-19T04:30:46.530159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:41.021945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508470+0000","last_change":"2024-09-19T04:29:00.396707+0000","last_active":"2024-09-19T04:30:46.508470+0000","last_peered":"2024-09-19T04:30:46.508470+0000","last_clean":"2024-09-19T04:30:46.508470+0000","last_became_active":"2024-09-19T04:29:00.394876+0000","last_became_peered":"2024-09-19T04:29:00.394876+0000","last_unstale":"2024-09-19T04:30:46.508470+0000","last_undegraded":"2024-09-19T04:30:46.508470+0000","last_fullsized":"2024-09-19T04:30:46.508470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:06.648377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531572+0000","last_change":"2024-09-19T04:29:02.425106+0000","last_active":"2024-09-19T04:30:46.531572+0000","last_peered":"2024-09-19T04:30:46.531572+0000","last_clean":"2024-09-19T04:30:46.531572+0000","last_became_active":"2024-09-19T04:29:02.424597+0000","last_became_peered":"2024-09-19T04:29:02.424597+0000","last_unstale":"2024-09-19T04:30:46.531572+0000","last_undegraded":"2024-09-19T04:30:46.531572+0000","last_fullsized":"2024-09-19T04:30:46.531572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:02.998519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.490229+0000","last_change":"2024-09-19T04:29:00.396369+0000","last_active":"2024-09-19T04:30:46.490229+0000","last_peered":"2024-09-19T04:30:46.490229+0000","last_clean":"2024-09-19T04:30:46.490229+0000","last_became_active":"2024-09-19T04:29:00.395980+0000","last_became_peered":"2024-09-19T04:29:00.395980+0000","last_unstale":"2024-09-19T04:30:46.490229+0000","last_undegraded":"2024-09-19T04:30:46.490229+0000","last_fullsized":"2024-09-19T04:30:46.490229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.941729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540832+0000","last_change":"2024-09-19T04:29:02.415771+0000","last_active":"2024-09-19T04:30:46.540832+0000","last_peered":"2024-09-19T04:30:46.540832+0000","last_clean":"2024-09-19T04:30:46.540832+0000","last_became_active":"2024-09-19T04:29:02.415404+0000","last_became_peered":"2024-09-19T04:29:02.415404+0000","last_unstale":"2024-09-19T04:30:46.540832+0000","last_undegraded":"2024-09-19T04:30:46.540832+0000","last_fullsized":"2024-09-19T04:30:46.540832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:04.509294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":71,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.705215+0000","last_change":"2024-09-19T04:29:00.389015+0000","last_active":"2024-09-19T04:30:46.705215+0000","last_peered":"2024-09-19T04:30:46.705215+0000","last_clean":"2024-09-19T04:30:46.705215+0000","last_became_active":"2024-09-19T04:29:00.388621+0000","last_became_peered":"2024-09-19T04:29:00.388621+0000","last_unstale":"2024-09-19T04:30:46.705215+0000","last_undegraded":"2024-09-19T04:30:46.705215+0000","last_fullsized":"2024-09-19T04:30:46.705215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:49.509697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541218+0000","last_change":"2024-09-19T04:29:02.411379+0000","last_active":"2024-09-19T04:30:46.541218+0000","last_peered":"2024-09-19T04:30:46.541218+0000","last_clean":"2024-09-19T04:30:46.541218+0000","last_became_active":"2024-09-19T04:29:02.411069+0000","last_became_peered":"2024-09-19T04:29:02.411069+0000","last_unstale":"2024-09-19T04:30:46.541218+0000","last_undegraded":"2024-09-19T04:30:46.541218+0000","last_fullsized":"2024-09-19T04:30:46.541218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:10.953422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.498451+0000","last_change":"2024-09-19T04:29:00.505088+0000","last_active":"2024-09-19T04:30:46.498451+0000","last_peered":"2024-09-19T04:30:46.498451+0000","last_clean":"2024-09-19T04:30:46.498451+0000","last_became_active":"2024-09-19T04:29:00.504734+0000","last_became_peered":"2024-09-19T04:29:00.504734+0000","last_unstale":"2024-09-19T04:30:46.498451+0000","last_undegraded":"2024-09-19T04:30:46.498451+0000","last_fullsized":"2024-09-19T04:30:46.498451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:38.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542579+0000","last_change":"2024-09-19T04:29:02.420752+0000","last_active":"2024-09-19T04:30:46.542579+0000","last_peered":"2024-09-19T04:30:46.542579+0000","last_clean":"2024-09-19T04:30:46.542579+0000","last_became_active":"2024-09-19T04:29:02.419136+0000","last_became_peered":"2024-09-19T04:29:02.419136+0000","last_unstale":"2024-09-19T04:30:46.542579+0000","last_undegraded":"2024-09-19T04:30:46.542579+0000","last_fullsized":"2024-09-19T04:30:46.542579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:40.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":349,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508217+0000","last_change":"2024-09-19T04:27:51.622607+0000","last_active":"2024-09-19T04:30:46.508217+0000","last_peered":"2024-09-19T04:30:46.508217+0000","last_clean":"2024-09-19T04:30:46.508217+0000","last_became_active":"2024-09-19T04:27:51.622000+0000","last_became_peered":"2024-09-19T04:27:51.622000+0000","last_unstale":"2024-09-19T04:30:46.508217+0000","last_undegraded":"2024-09-19T04:30:46.508217+0000","last_fullsized":"2024-09-19T04:30:46.508217+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_clean_scrub_stamp":"2024-09-19T04:24:31.610268+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:20:05.335499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.514503+0000","last_change":"2024-09-19T04:29:00.393618+0000","last_active":"2024-09-19T04:30:46.514503+0000","last_peered":"2024-09-19T04:30:46.514503+0000","last_clean":"2024-09-19T04:30:46.514503+0000","last_became_active":"2024-09-19T04:29:00.393248+0000","last_became_peered":"2024-09-19T04:29:00.393248+0000","last_unstale":"2024-09-19T04:30:46.514503+0000","last_undegraded":"2024-09-19T04:30:46.514503+0000","last_fullsized":"2024-09-19T04:30:46.514503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:35.271531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.528183+0000","last_change":"2024-09-19T04:29:02.415147+0000","last_active":"2024-09-19T04:30:46.528183+0000","last_peered":"2024-09-19T04:30:46.528183+0000","last_clean":"2024-09-19T04:30:46.528183+0000","last_became_active":"2024-09-19T04:29:02.414275+0000","last_became_peered":"2024-09-19T04:29:02.414275+0000","last_unstale":"2024-09-19T04:30:46.528183+0000","last_undegraded":"2024-09-19T04:30:46.528183+0000","last_fullsized":"2024-09-19T04:30:46.528183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:32.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508104+0000","last_change":"2024-09-19T04:29:00.398007+0000","last_active":"2024-09-19T04:30:46.508104+0000","last_peered":"2024-09-19T04:30:46.508104+0000","last_clean":"2024-09-19T04:30:46.508104+0000","last_became_active":"2024-09-19T04:29:00.397644+0000","last_became_peered":"2024-09-19T04:29:00.397644+0000","last_unstale":"2024-09-19T04:30:46.508104+0000","last_undegraded":"2024-09-19T04:30:46.508104+0000","last_fullsized":"2024-09-19T04:30:46.508104+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:34.476893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541292+0000","last_change":"2024-09-19T04:29:02.414957+0000","last_active":"2024-09-19T04:30:46.541292+0000","last_peered":"2024-09-19T04:30:46.541292+0000","last_clean":"2024-09-19T04:30:46.541292+0000","last_became_active":"2024-09-19T04:29:02.414641+0000","last_became_peered":"2024-09-19T04:29:02.414641+0000","last_unstale":"2024-09-19T04:30:46.541292+0000","last_undegraded":"2024-09-19T04:30:46.541292+0000","last_fullsized":"2024-09-19T04:30:46.541292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:18.824972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":124,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.496502+0000","last_change":"2024-09-19T04:29:00.504872+0000","last_active":"2024-09-19T04:30:46.496502+0000","last_peered":"2024-09-19T04:30:46.496502+0000","last_clean":"2024-09-19T04:30:46.496502+0000","last_became_active":"2024-09-19T04:29:00.504520+0000","last_became_peered":"2024-09-19T04:29:00.504520+0000","last_unstale":"2024-09-19T04:30:46.496502+0000","last_undegraded":"2024-09-19T04:30:46.496502+0000","last_fullsized":"2024-09-19T04:30:46.496502+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:39.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":95,"num_read_kb":95,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535674+0000","last_change":"2024-09-19T04:29:02.416451+0000","last_active":"2024-09-19T04:30:46.535674+0000","last_peered":"2024-09-19T04:30:46.535674+0000","last_clean":"2024-09-19T04:30:46.535674+0000","last_became_active":"2024-09-19T04:29:02.415271+0000","last_became_peered":"2024-09-19T04:29:02.415271+0000","last_unstale":"2024-09-19T04:30:46.535674+0000","last_undegraded":"2024-09-19T04:30:46.535674+0000","last_fullsized":"2024-09-19T04:30:46.535674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:06.371572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.518710+0000","last_change":"2024-09-19T04:29:00.390999+0000","last_active":"2024-09-19T04:30:46.518710+0000","last_peered":"2024-09-19T04:30:46.518710+0000","last_clean":"2024-09-19T04:30:46.518710+0000","last_became_active":"2024-09-19T04:29:00.390639+0000","last_became_peered":"2024-09-19T04:29:00.390639+0000","last_unstale":"2024-09-19T04:30:46.518710+0000","last_undegraded":"2024-09-19T04:30:46.518710+0000","last_fullsized":"2024-09-19T04:30:46.518710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:26.504171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532095+0000","last_change":"2024-09-19T04:29:02.419534+0000","last_active":"2024-09-19T04:30:46.532095+0000","last_peered":"2024-09-19T04:30:46.532095+0000","last_clean":"2024-09-19T04:30:46.532095+0000","last_became_active":"2024-09-19T04:29:02.419192+0000","last_became_peered":"2024-09-19T04:29:02.419192+0000","last_unstale":"2024-09-19T04:30:46.532095+0000","last_undegraded":"2024-09-19T04:30:46.532095+0000","last_fullsized":"2024-09-19T04:30:46.532095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:33.866859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.501709+0000","last_change":"2024-09-19T04:29:18.480950+0000","last_active":"2024-09-19T04:30:46.501709+0000","last_peered":"2024-09-19T04:30:46.501709+0000","last_clean":"2024-09-19T04:30:46.501709+0000","last_became_active":"2024-09-19T04:29:18.480542+0000","last_became_peered":"2024-09-19T04:29:18.480542+0000","last_unstale":"2024-09-19T04:30:46.501709+0000","last_undegraded":"2024-09-19T04:30:46.501709+0000","last_fullsized":"2024-09-19T04:30:46.501709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.647586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530211+0000","last_change":"2024-09-19T04:29:02.415075+0000","last_active":"2024-09-19T04:30:46.530211+0000","last_peered":"2024-09-19T04:30:46.530211+0000","last_clean":"2024-09-19T04:30:46.530211+0000","last_became_active":"2024-09-19T04:29:02.414635+0000","last_became_peered":"2024-09-19T04:29:02.414635+0000","last_unstale":"2024-09-19T04:30:46.530211+0000","last_undegraded":"2024-09-19T04:30:46.530211+0000","last_fullsized":"2024-09-19T04:30:46.530211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:12.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.502268+0000","last_change":"2024-09-19T04:29:18.485218+0000","last_active":"2024-09-19T04:30:46.502268+0000","last_peered":"2024-09-19T04:30:46.502268+0000","last_clean":"2024-09-19T04:30:46.502268+0000","last_became_active":"2024-09-19T04:29:18.481618+0000","last_became_peered":"2024-09-19T04:29:18.481618+0000","last_unstale":"2024-09-19T04:30:46.502268+0000","last_undegraded":"2024-09-19T04:30:46.502268+0000","last_fullsized":"2024-09-19T04:30:46.502268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:26.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540687+0000","last_change":"2024-09-19T04:29:02.412647+0000","last_active":"2024-09-19T04:30:46.540687+0000","last_peered":"2024-09-19T04:30:46.540687+0000","last_clean":"2024-09-19T04:30:46.540687+0000","last_became_active":"2024-09-19T04:29:02.412014+0000","last_became_peered":"2024-09-19T04:29:02.412014+0000","last_unstale":"2024-09-19T04:30:46.540687+0000","last_undegraded":"2024-09-19T04:30:46.540687+0000","last_fullsized":"2024-09-19T04:30:46.540687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:32.341462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'45","reported_seq":92,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.710645+0000","last_change":"2024-09-19T04:29:00.397860+0000","last_active":"2024-09-19T04:30:46.710645+0000","last_peered":"2024-09-19T04:30:46.710645+0000","last_clean":"2024-09-19T04:30:46.710645+0000","last_became_active":"2024-09-19T04:29:00.397501+0000","last_became_peered":"2024-09-19T04:29:00.397501+0000","last_unstale":"2024-09-19T04:30:46.710645+0000","last_undegraded":"2024-09-19T04:30:46.710645+0000","last_fullsized":"2024-09-19T04:30:46.710645+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":45,"log_dups_size":0,"ondisk_log_size":45,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:51.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":82,"num_write_kb":837,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542946+0000","last_change":"2024-09-19T04:29:02.418639+0000","last_active":"2024-09-19T04:30:46.542946+0000","last_peered":"2024-09-19T04:30:46.542946+0000","last_clean":"2024-09-19T04:30:46.542946+0000","last_became_active":"2024-09-19T04:29:02.418334+0000","last_became_peered":"2024-09-19T04:29:02.418334+0000","last_unstale":"2024-09-19T04:30:46.542946+0000","last_undegraded":"2024-09-19T04:30:46.542946+0000","last_fullsized":"2024-09-19T04:30:46.542946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.161642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505107+0000","last_change":"2024-09-19T04:29:00.504849+0000","last_active":"2024-09-19T04:30:46.505107+0000","last_peered":"2024-09-19T04:30:46.505107+0000","last_clean":"2024-09-19T04:30:46.505107+0000","last_became_active":"2024-09-19T04:29:00.504618+0000","last_became_peered":"2024-09-19T04:29:00.504618+0000","last_unstale":"2024-09-19T04:30:46.505107+0000","last_undegraded":"2024-09-19T04:30:46.505107+0000","last_fullsized":"2024-09-19T04:30:46.505107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:31.038078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540526+0000","last_change":"2024-09-19T04:29:19.354455+0000","last_active":"2024-09-19T04:30:46.540526+0000","last_peered":"2024-09-19T04:30:46.540526+0000","last_clean":"2024-09-19T04:30:46.540526+0000","last_became_active":"2024-09-19T04:29:19.354062+0000","last_became_peered":"2024-09-19T04:29:19.354062+0000","last_unstale":"2024-09-19T04:30:46.540526+0000","last_undegraded":"2024-09-19T04:30:46.540526+0000","last_fullsized":"2024-09-19T04:30:46.540526+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:17.134082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.496926+0000","last_change":"2024-09-19T04:29:00.506294+0000","last_active":"2024-09-19T04:30:46.496926+0000","last_peered":"2024-09-19T04:30:46.496926+0000","last_clean":"2024-09-19T04:30:46.496926+0000","last_became_active":"2024-09-19T04:29:00.506028+0000","last_became_peered":"2024-09-19T04:29:00.506028+0000","last_unstale":"2024-09-19T04:30:46.496926+0000","last_undegraded":"2024-09-19T04:30:46.496926+0000","last_fullsized":"2024-09-19T04:30:46.496926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.972980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.515227+0000","last_change":"2024-09-19T04:29:02.414995+0000","last_active":"2024-09-19T04:30:46.515227+0000","last_peered":"2024-09-19T04:30:46.515227+0000","last_clean":"2024-09-19T04:30:46.515227+0000","last_became_active":"2024-09-19T04:29:02.414675+0000","last_became_peered":"2024-09-19T04:29:02.414675+0000","last_unstale":"2024-09-19T04:30:46.515227+0000","last_undegraded":"2024-09-19T04:30:46.515227+0000","last_fullsized":"2024-09-19T04:30:46.515227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:40.466483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.496463+0000","last_change":"2024-09-19T04:29:00.389510+0000","last_active":"2024-09-19T04:30:46.496463+0000","last_peered":"2024-09-19T04:30:46.496463+0000","last_clean":"2024-09-19T04:30:46.496463+0000","last_became_active":"2024-09-19T04:29:00.389222+0000","last_became_peered":"2024-09-19T04:29:00.389222+0000","last_unstale":"2024-09-19T04:30:46.496463+0000","last_undegraded":"2024-09-19T04:30:46.496463+0000","last_fullsized":"2024-09-19T04:30:46.496463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:00.290076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532102+0000","last_change":"2024-09-19T04:29:02.422356+0000","last_active":"2024-09-19T04:30:46.532102+0000","last_peered":"2024-09-19T04:30:46.532102+0000","last_clean":"2024-09-19T04:30:46.532102+0000","last_became_active":"2024-09-19T04:29:02.422037+0000","last_became_peered":"2024-09-19T04:29:02.422037+0000","last_unstale":"2024-09-19T04:30:46.532102+0000","last_undegraded":"2024-09-19T04:30:46.532102+0000","last_fullsized":"2024-09-19T04:30:46.532102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:40.192439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497530+0000","last_change":"2024-09-19T04:29:00.399188+0000","last_active":"2024-09-19T04:30:46.497530+0000","last_peered":"2024-09-19T04:30:46.497530+0000","last_clean":"2024-09-19T04:30:46.497530+0000","last_became_active":"2024-09-19T04:29:00.398880+0000","last_became_peered":"2024-09-19T04:29:00.398880+0000","last_unstale":"2024-09-19T04:30:46.497530+0000","last_undegraded":"2024-09-19T04:30:46.497530+0000","last_fullsized":"2024-09-19T04:30:46.497530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:55.581504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532359+0000","last_change":"2024-09-19T04:29:02.408174+0000","last_active":"2024-09-19T04:30:46.532359+0000","last_peered":"2024-09-19T04:30:46.532359+0000","last_clean":"2024-09-19T04:30:46.532359+0000","last_became_active":"2024-09-19T04:29:02.407822+0000","last_became_peered":"2024-09-19T04:29:02.407822+0000","last_unstale":"2024-09-19T04:30:46.532359+0000","last_undegraded":"2024-09-19T04:30:46.532359+0000","last_fullsized":"2024-09-19T04:30:46.532359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505712+0000","last_change":"2024-09-19T04:29:00.398445+0000","last_active":"2024-09-19T04:30:46.505712+0000","last_peered":"2024-09-19T04:30:46.505712+0000","last_clean":"2024-09-19T04:30:46.505712+0000","last_became_active":"2024-09-19T04:29:00.397923+0000","last_became_peered":"2024-09-19T04:29:00.397923+0000","last_unstale":"2024-09-19T04:30:46.505712+0000","last_undegraded":"2024-09-19T04:30:46.505712+0000","last_fullsized":"2024-09-19T04:30:46.505712+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:32.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542712+0000","last_change":"2024-09-19T04:29:02.416685+0000","last_active":"2024-09-19T04:30:46.542712+0000","last_peered":"2024-09-19T04:30:46.542712+0000","last_clean":"2024-09-19T04:30:46.542712+0000","last_became_active":"2024-09-19T04:29:02.416311+0000","last_became_peered":"2024-09-19T04:29:02.416311+0000","last_unstale":"2024-09-19T04:30:46.542712+0000","last_undegraded":"2024-09-19T04:30:46.542712+0000","last_fullsized":"2024-09-19T04:30:46.542712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:47.988318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530456+0000","last_change":"2024-09-19T04:29:02.424585+0000","last_active":"2024-09-19T04:30:46.530456+0000","last_peered":"2024-09-19T04:30:46.530456+0000","last_clean":"2024-09-19T04:30:46.530456+0000","last_became_active":"2024-09-19T04:29:02.424253+0000","last_became_peered":"2024-09-19T04:29:02.424253+0000","last_unstale":"2024-09-19T04:30:46.530456+0000","last_undegraded":"2024-09-19T04:30:46.530456+0000","last_fullsized":"2024-09-19T04:30:46.530456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:55.865599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505381+0000","last_change":"2024-09-19T04:29:00.396490+0000","last_active":"2024-09-19T04:30:46.505381+0000","last_peered":"2024-09-19T04:30:46.505381+0000","last_clean":"2024-09-19T04:30:46.505381+0000","last_became_active":"2024-09-19T04:29:00.394727+0000","last_became_peered":"2024-09-19T04:29:00.394727+0000","last_unstale":"2024-09-19T04:30:46.505381+0000","last_undegraded":"2024-09-19T04:30:46.505381+0000","last_fullsized":"2024-09-19T04:30:46.505381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:43.724257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532968+0000","last_change":"2024-09-19T04:29:02.425557+0000","last_active":"2024-09-19T04:30:46.532968+0000","last_peered":"2024-09-19T04:30:46.532968+0000","last_clean":"2024-09-19T04:30:46.532968+0000","last_became_active":"2024-09-19T04:29:02.425261+0000","last_became_peered":"2024-09-19T04:29:02.425261+0000","last_unstale":"2024-09-19T04:30:46.532968+0000","last_undegraded":"2024-09-19T04:30:46.532968+0000","last_fullsized":"2024-09-19T04:30:46.532968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:20.204026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508704+0000","last_change":"2024-09-19T04:29:00.397849+0000","last_active":"2024-09-19T04:30:46.508704+0000","last_peered":"2024-09-19T04:30:46.508704+0000","last_clean":"2024-09-19T04:30:46.508704+0000","last_became_active":"2024-09-19T04:29:00.397226+0000","last_became_peered":"2024-09-19T04:29:00.397226+0000","last_unstale":"2024-09-19T04:30:46.508704+0000","last_undegraded":"2024-09-19T04:30:46.508704+0000","last_fullsized":"2024-09-19T04:30:46.508704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:04.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538188+0000","last_change":"2024-09-19T04:29:02.416202+0000","last_active":"2024-09-19T04:30:46.538188+0000","last_peered":"2024-09-19T04:30:46.538188+0000","last_clean":"2024-09-19T04:30:46.538188+0000","last_became_active":"2024-09-19T04:29:02.415886+0000","last_became_peered":"2024-09-19T04:29:02.415886+0000","last_unstale":"2024-09-19T04:30:46.538188+0000","last_undegraded":"2024-09-19T04:30:46.538188+0000","last_fullsized":"2024-09-19T04:30:46.538188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:06.217254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497341+0000","last_change":"2024-09-19T04:29:00.505162+0000","last_active":"2024-09-19T04:30:46.497341+0000","last_peered":"2024-09-19T04:30:46.497341+0000","last_clean":"2024-09-19T04:30:46.497341+0000","last_became_active":"2024-09-19T04:29:00.504584+0000","last_became_peered":"2024-09-19T04:29:00.504584+0000","last_unstale":"2024-09-19T04:30:46.497341+0000","last_undegraded":"2024-09-19T04:30:46.497341+0000","last_fullsized":"2024-09-19T04:30:46.497341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:44.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531611+0000","last_change":"2024-09-19T04:29:02.415095+0000","last_active":"2024-09-19T04:30:46.531611+0000","last_peered":"2024-09-19T04:30:46.531611+0000","last_clean":"2024-09-19T04:30:46.531611+0000","last_became_active":"2024-09-19T04:29:02.414576+0000","last_became_peered":"2024-09-19T04:29:02.414576+0000","last_unstale":"2024-09-19T04:30:46.531611+0000","last_undegraded":"2024-09-19T04:30:46.531611+0000","last_fullsized":"2024-09-19T04:30:46.531611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:52.744011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.503839+0000","last_change":"2024-09-19T04:29:00.397737+0000","last_active":"2024-09-19T04:30:46.503839+0000","last_peered":"2024-09-19T04:30:46.503839+0000","last_clean":"2024-09-19T04:30:46.503839+0000","last_became_active":"2024-09-19T04:29:00.397397+0000","last_became_peered":"2024-09-19T04:29:00.397397+0000","last_unstale":"2024-09-19T04:30:46.503839+0000","last_undegraded":"2024-09-19T04:30:46.503839+0000","last_fullsized":"2024-09-19T04:30:46.503839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:49:16.108744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":592816,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":693,"num_read_kb":448,"num_write":291,"num_write_kb":1433,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2002944,"data_stored":1778448,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":227,"ondisk_log_size":227,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547234,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":449853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808870,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33016,"kb_used_data":1712,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712136,"statfs":{"total":95995035648,"available":95961227264,"internally_reserved":0,"allocated":1753088,"data_stored":1236021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972395,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1331200,"data_stored":843283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201329,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27940,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717212,"statfs":{"total":95995035648,"available":95966425088,"internally_reserved":0,"allocated":933888,"data_stored":449965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430262,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28524,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716628,"statfs":{"total":95995035648,"available":95965827072,"internally_reserved":0,"allocated":1531904,"data_stored":1044622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593786,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":449456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822719,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28664,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716488,"statfs":{"total":95995035648,"available":95965683712,"internally_reserved":0,"allocated":1679360,"data_stored":1174091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953541,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":929792,"data_stored":451708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182474,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40940,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704212,"statfs":{"total":95995035648,"available":95953113088,"internally_reserved":0,"allocated":1470464,"data_stored":974583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[1],"upper_bound":2},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411407,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":988,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1011712,"data_stored":513174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574932,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27992,"kb_used_data":964,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717160,"statfs":{"total":95995035648,"available":95966371840,"internally_reserved":0,"allocated":987136,"data_stored":510543,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738457,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":946176,"data_stored":450727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":61294,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":63925,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":4888,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":237568,"data_stored":196287,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:30:52.523 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-09-19T04:30:52.523 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T04:30:52.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3643022330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78101330 msgr2=0x7fdc7810d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3643022330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78101330 0x7fdc7810d860 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7fdc70009cd0 tx=0x7fdc7002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3643022330 shutdown_connections 2024-09-19T04:30:52.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3643022330 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78101330 0x7fdc7810d860 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3643022330 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc78100990 0x7fdc78100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3643022330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc781069a0 0x7fdc78106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3643022330 >> 172.21.15.70:0/3643022330 conn(0x7fdc780fc6d0 msgr2=0x7fdc780feaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3643022330 shutdown_connections 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.658+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3643022330 wait complete. 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7ef8d640 1 Processor -- start 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7ef8d640 1 -- start start 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7ef8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78100990 0x7fdc7819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7ef8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc78101330 0x7fdc7819ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7ef8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc781069a0 0x7fdc7819eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7ef8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78110db0 con 0x7fdc78100990 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7ef8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78110c30 con 0x7fdc78101330 2024-09-19T04:30:52.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7ef8d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdc78110f30 con 0x7fdc781069a0 2024-09-19T04:30:52.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7cd29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78100990 0x7fdc7819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:52.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7cd29640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78100990 0x7fdc7819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56840/0 (socket says 172.21.15.70:56840) 2024-09-19T04:30:52.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7cd29640 1 -- 172.21.15.70:0/3961841377 learned_addr learned my addr 172.21.15.70:0/3961841377 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:52.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7d52a640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc781069a0 0x7fdc7819eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:52.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc77fff640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc78101330 0x7fdc7819ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:52.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7cd29640 1 -- 172.21.15.70:0/3961841377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc781069a0 msgr2=0x7fdc7819eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7cd29640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc781069a0 0x7fdc7819eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7cd29640 1 -- 172.21.15.70:0/3961841377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc78101330 msgr2=0x7fdc7819ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7cd29640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc78101330 0x7fdc7819ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.659+0000 7fdc7cd29640 1 -- 172.21.15.70:0/3961841377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdc7819f620 con 0x7fdc78100990 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.660+0000 7fdc7cd29640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78100990 0x7fdc7819a630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00d950 tx=0x7fdc6c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.660+0000 7fdc75ffb640 1 -- 172.21.15.70:0/3961841377 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c017070 con 0x7fdc78100990 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.660+0000 7fdc75ffb640 1 -- 172.21.15.70:0/3961841377 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdc6c009c30 con 0x7fdc78100990 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.660+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdc7819f910 con 0x7fdc78100990 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.660+0000 7fdc75ffb640 1 -- 172.21.15.70:0/3961841377 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdc6c00f6b0 con 0x7fdc78100990 2024-09-19T04:30:52.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.660+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdc781a71a0 con 0x7fdc78100990 2024-09-19T04:30:52.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.661+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdc78100df0 con 0x7fdc78100990 2024-09-19T04:30:52.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.662+0000 7fdc75ffb640 1 -- 172.21.15.70:0/3961841377 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fdc6c010a50 con 0x7fdc78100990 2024-09-19T04:30:52.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.663+0000 7fdc75ffb640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdc680a3560 0x7fdc680a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:52.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.663+0000 7fdc77fff640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdc680a3560 0x7fdc680a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:52.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.663+0000 7fdc75ffb640 1 -- 172.21.15.70:0/3961841377 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fdc6c0cfa40 con 0x7fdc78100990 2024-09-19T04:30:52.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.663+0000 7fdc77fff640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdc680a3560 0x7fdc680a5a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc780fec70 tx=0x7fdc6400b390 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:52.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.667+0000 7fdc75ffb640 1 -- 172.21.15.70:0/3961841377 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdc6c009de0 con 0x7fdc78100990 2024-09-19T04:30:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.829+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fdc7806ab50 con 0x7fdc680a3560 2024-09-19T04:30:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.835+0000 7fdc75ffb640 1 -- 172.21.15.70:0/3961841377 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+257735 (secure 0 0 0) 0x7fdc7806ab50 con 0x7fdc680a3560 2024-09-19T04:30:52.839 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:52.840 INFO:teuthology.orchestra.run.smithi070.stderr:dumped all 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdc680a3560 msgr2=0x7fdc680a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdc680a3560 0x7fdc680a5a20 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fdc780fec70 tx=0x7fdc6400b390 comp rx=0 tx=0).stop 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78100990 msgr2=0x7fdc7819a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78100990 0x7fdc7819a630 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fdc6c00d950 tx=0x7fdc6c00de10 comp rx=0 tx=0).stop 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 shutdown_connections 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdc680a3560 0x7fdc680a5a20 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdc781069a0 0x7fdc7819eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc78101330 0x7fdc7819ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 --2- 172.21.15.70:0/3961841377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdc78100990 0x7fdc7819a630 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 >> 172.21.15.70:0/3961841377 conn(0x7fdc780fc6d0 msgr2=0x7fdc7806a440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 shutdown_connections 2024-09-19T04:30:52.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:52.838+0000 7fdc7ef8d640 1 -- 172.21.15.70:0/3961841377 wait complete. 2024-09-19T04:30:52.850 INFO:teuthology.orchestra.run.smithi070.stdout:{"pg_ready":true,"pg_map":{"version":6,"stamp":"2024-09-19T04:30:52.510818+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1188518,"num_objects":66,"num_object_clones":0,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":965,"num_read_kb":802,"num_write":498,"num_write_kb":4380,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":1180758,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":880,"ondisk_log_size":880,"up":291,"acting":291,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":291,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":376360,"kb_used_data":14484,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124565464,"statfs":{"total":1151940427776,"available":1151555035136,"internally_reserved":0,"allocated":14831616,"data_stored":8956542,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19142,"internal_metadata":370193722},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":5100,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":136,"num_read_kb":235,"num_write":24,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.001584"},"pg_stats":[{"pgid":"3.3f","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533458+0000","last_change":"2024-09-19T04:29:02.416257+0000","last_active":"2024-09-19T04:30:46.533458+0000","last_peered":"2024-09-19T04:30:46.533458+0000","last_clean":"2024-09-19T04:30:46.533458+0000","last_became_active":"2024-09-19T04:29:02.415681+0000","last_became_peered":"2024-09-19T04:29:02.415681+0000","last_unstale":"2024-09-19T04:30:46.533458+0000","last_undegraded":"2024-09-19T04:30:46.533458+0000","last_fullsized":"2024-09-19T04:30:46.533458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:01:31.765859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.3e","version":"84'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533964+0000","last_change":"2024-09-19T04:29:02.417591+0000","last_active":"2024-09-19T04:30:46.533964+0000","last_peered":"2024-09-19T04:30:46.533964+0000","last_clean":"2024-09-19T04:30:46.533964+0000","last_became_active":"2024-09-19T04:29:02.417277+0000","last_became_peered":"2024-09-19T04:29:02.417277+0000","last_unstale":"2024-09-19T04:30:46.533964+0000","last_undegraded":"2024-09-19T04:30:46.533964+0000","last_fullsized":"2024-09-19T04:30:46.533964+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:22.680000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537963+0000","last_change":"2024-09-19T04:29:02.416270+0000","last_active":"2024-09-19T04:30:46.537963+0000","last_peered":"2024-09-19T04:30:46.537963+0000","last_clean":"2024-09-19T04:30:46.537963+0000","last_became_active":"2024-09-19T04:29:02.415878+0000","last_became_peered":"2024-09-19T04:29:02.415878+0000","last_unstale":"2024-09-19T04:30:46.537963+0000","last_undegraded":"2024-09-19T04:30:46.537963+0000","last_fullsized":"2024-09-19T04:30:46.537963+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:02:25.302575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536145+0000","last_change":"2024-09-19T04:29:02.414586+0000","last_active":"2024-09-19T04:30:46.536145+0000","last_peered":"2024-09-19T04:30:46.536145+0000","last_clean":"2024-09-19T04:30:46.536145+0000","last_became_active":"2024-09-19T04:29:02.414267+0000","last_became_peered":"2024-09-19T04:29:02.414267+0000","last_unstale":"2024-09-19T04:30:46.536145+0000","last_undegraded":"2024-09-19T04:30:46.536145+0000","last_fullsized":"2024-09-19T04:30:46.536145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:41:01.436793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,8,2],"acting":[4,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3b","version":"84'4","reported_seq":23,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536599+0000","last_change":"2024-09-19T04:29:02.412243+0000","last_active":"2024-09-19T04:30:46.536599+0000","last_peered":"2024-09-19T04:30:46.536599+0000","last_clean":"2024-09-19T04:30:46.536599+0000","last_became_active":"2024-09-19T04:29:02.411411+0000","last_became_peered":"2024-09-19T04:29:02.411411+0000","last_unstale":"2024-09-19T04:30:46.536599+0000","last_undegraded":"2024-09-19T04:30:46.536599+0000","last_fullsized":"2024-09-19T04:30:46.536599+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:48:21.966542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3a","version":"84'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.534637+0000","last_change":"2024-09-19T04:29:18.482295+0000","last_active":"2024-09-19T04:30:46.534637+0000","last_peered":"2024-09-19T04:30:46.534637+0000","last_clean":"2024-09-19T04:30:46.534637+0000","last_became_active":"2024-09-19T04:29:18.481929+0000","last_became_peered":"2024-09-19T04:29:18.481929+0000","last_unstale":"2024-09-19T04:30:46.534637+0000","last_undegraded":"2024-09-19T04:30:46.534637+0000","last_fullsized":"2024-09-19T04:30:46.534637+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:27:17.018947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,8],"acting":[10,9,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.39","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538019+0000","last_change":"2024-09-19T04:29:02.418029+0000","last_active":"2024-09-19T04:30:46.538019+0000","last_peered":"2024-09-19T04:30:46.538019+0000","last_clean":"2024-09-19T04:30:46.538019+0000","last_became_active":"2024-09-19T04:29:02.417676+0000","last_became_peered":"2024-09-19T04:29:02.417676+0000","last_unstale":"2024-09-19T04:30:46.538019+0000","last_undegraded":"2024-09-19T04:30:46.538019+0000","last_fullsized":"2024-09-19T04:30:46.538019+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:12:03.148693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538928+0000","last_change":"2024-09-19T04:29:02.406657+0000","last_active":"2024-09-19T04:30:46.538928+0000","last_peered":"2024-09-19T04:30:46.538928+0000","last_clean":"2024-09-19T04:30:46.538928+0000","last_became_active":"2024-09-19T04:29:02.406203+0000","last_became_peered":"2024-09-19T04:29:02.406203+0000","last_unstale":"2024-09-19T04:30:46.538928+0000","last_undegraded":"2024-09-19T04:30:46.538928+0000","last_fullsized":"2024-09-19T04:30:46.538928+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:03:06.842516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531218+0000","last_change":"2024-09-19T04:29:02.426478+0000","last_active":"2024-09-19T04:30:46.531218+0000","last_peered":"2024-09-19T04:30:46.531218+0000","last_clean":"2024-09-19T04:30:46.531218+0000","last_became_active":"2024-09-19T04:29:02.425938+0000","last_became_peered":"2024-09-19T04:29:02.425938+0000","last_unstale":"2024-09-19T04:30:46.531218+0000","last_undegraded":"2024-09-19T04:30:46.531218+0000","last_fullsized":"2024-09-19T04:30:46.531218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:20:01.439087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"84'16","reported_seq":35,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537678+0000","last_change":"2024-09-19T04:29:02.423380+0000","last_active":"2024-09-19T04:30:46.537678+0000","last_peered":"2024-09-19T04:30:46.537678+0000","last_clean":"2024-09-19T04:30:46.537678+0000","last_became_active":"2024-09-19T04:29:02.422894+0000","last_became_peered":"2024-09-19T04:29:02.422894+0000","last_unstale":"2024-09-19T04:30:46.537678+0000","last_undegraded":"2024-09-19T04:30:46.537678+0000","last_fullsized":"2024-09-19T04:30:46.537678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:55.082196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.35","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.543106+0000","last_change":"2024-09-19T04:29:02.419929+0000","last_active":"2024-09-19T04:30:46.543106+0000","last_peered":"2024-09-19T04:30:46.543106+0000","last_clean":"2024-09-19T04:30:46.543106+0000","last_became_active":"2024-09-19T04:29:02.419432+0000","last_became_peered":"2024-09-19T04:29:02.419432+0000","last_unstale":"2024-09-19T04:30:46.543106+0000","last_undegraded":"2024-09-19T04:30:46.543106+0000","last_fullsized":"2024-09-19T04:30:46.543106+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:50:03.896524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.34","version":"84'7","reported_seq":20,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.529367+0000","last_change":"2024-09-19T04:29:18.481426+0000","last_active":"2024-09-19T04:30:46.529367+0000","last_peered":"2024-09-19T04:30:46.529367+0000","last_clean":"2024-09-19T04:30:46.529367+0000","last_became_active":"2024-09-19T04:29:18.481042+0000","last_became_peered":"2024-09-19T04:29:18.481042+0000","last_unstale":"2024-09-19T04:30:46.529367+0000","last_undegraded":"2024-09-19T04:30:46.529367+0000","last_fullsized":"2024-09-19T04:30:46.529367+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:16.251818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,10,8],"acting":[9,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.33","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.527488+0000","last_change":"2024-09-19T04:29:02.405545+0000","last_active":"2024-09-19T04:30:46.527488+0000","last_peered":"2024-09-19T04:30:46.527488+0000","last_clean":"2024-09-19T04:30:46.527488+0000","last_became_active":"2024-09-19T04:29:02.405247+0000","last_became_peered":"2024-09-19T04:29:02.405247+0000","last_unstale":"2024-09-19T04:30:46.527488+0000","last_undegraded":"2024-09-19T04:30:46.527488+0000","last_fullsized":"2024-09-19T04:30:46.527488+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:49:26.673842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.32","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538618+0000","last_change":"2024-09-19T04:29:02.420647+0000","last_active":"2024-09-19T04:30:46.538618+0000","last_peered":"2024-09-19T04:30:46.538618+0000","last_clean":"2024-09-19T04:30:46.538618+0000","last_became_active":"2024-09-19T04:29:02.420310+0000","last_became_peered":"2024-09-19T04:29:02.420310+0000","last_unstale":"2024-09-19T04:30:46.538618+0000","last_undegraded":"2024-09-19T04:30:46.538618+0000","last_fullsized":"2024-09-19T04:30:46.538618+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:58:47.893734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538556+0000","last_change":"2024-09-19T04:29:02.419199+0000","last_active":"2024-09-19T04:30:46.538556+0000","last_peered":"2024-09-19T04:30:46.538556+0000","last_clean":"2024-09-19T04:30:46.538556+0000","last_became_active":"2024-09-19T04:29:02.418902+0000","last_became_peered":"2024-09-19T04:29:02.418902+0000","last_unstale":"2024-09-19T04:30:46.538556+0000","last_undegraded":"2024-09-19T04:30:46.538556+0000","last_fullsized":"2024-09-19T04:30:46.538556+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:14:04.958933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.30","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542787+0000","last_change":"2024-09-19T04:29:02.415284+0000","last_active":"2024-09-19T04:30:46.542787+0000","last_peered":"2024-09-19T04:30:46.542787+0000","last_clean":"2024-09-19T04:30:46.542787+0000","last_became_active":"2024-09-19T04:29:02.414947+0000","last_became_peered":"2024-09-19T04:29:02.414947+0000","last_unstale":"2024-09-19T04:30:46.542787+0000","last_undegraded":"2024-09-19T04:30:46.542787+0000","last_fullsized":"2024-09-19T04:30:46.542787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:08.525325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533676+0000","last_change":"2024-09-19T04:29:02.422294+0000","last_active":"2024-09-19T04:30:46.533676+0000","last_peered":"2024-09-19T04:30:46.533676+0000","last_clean":"2024-09-19T04:30:46.533676+0000","last_became_active":"2024-09-19T04:29:02.421014+0000","last_became_peered":"2024-09-19T04:29:02.421014+0000","last_unstale":"2024-09-19T04:30:46.533676+0000","last_undegraded":"2024-09-19T04:30:46.533676+0000","last_fullsized":"2024-09-19T04:30:46.533676+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:42:34.197168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2e","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536966+0000","last_change":"2024-09-19T04:29:02.415319+0000","last_active":"2024-09-19T04:30:46.536966+0000","last_peered":"2024-09-19T04:30:46.536966+0000","last_clean":"2024-09-19T04:30:46.536966+0000","last_became_active":"2024-09-19T04:29:02.415030+0000","last_became_peered":"2024-09-19T04:29:02.415030+0000","last_unstale":"2024-09-19T04:30:46.536966+0000","last_undegraded":"2024-09-19T04:30:46.536966+0000","last_fullsized":"2024-09-19T04:30:46.536966+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:07:11.381264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542299+0000","last_change":"2024-09-19T04:29:02.415938+0000","last_active":"2024-09-19T04:30:46.542299+0000","last_peered":"2024-09-19T04:30:46.542299+0000","last_clean":"2024-09-19T04:30:46.542299+0000","last_became_active":"2024-09-19T04:29:02.411665+0000","last_became_peered":"2024-09-19T04:29:02.411665+0000","last_unstale":"2024-09-19T04:30:46.542299+0000","last_undegraded":"2024-09-19T04:30:46.542299+0000","last_fullsized":"2024-09-19T04:30:46.542299+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:25:12.563258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2c","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532036+0000","last_change":"2024-09-19T04:29:02.417489+0000","last_active":"2024-09-19T04:30:46.532036+0000","last_peered":"2024-09-19T04:30:46.532036+0000","last_clean":"2024-09-19T04:30:46.532036+0000","last_became_active":"2024-09-19T04:29:02.417164+0000","last_became_peered":"2024-09-19T04:29:02.417164+0000","last_unstale":"2024-09-19T04:30:46.532036+0000","last_undegraded":"2024-09-19T04:30:46.532036+0000","last_fullsized":"2024-09-19T04:30:46.532036+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:45:28.055517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2b","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538975+0000","last_change":"2024-09-19T04:29:02.407559+0000","last_active":"2024-09-19T04:30:46.538975+0000","last_peered":"2024-09-19T04:30:46.538975+0000","last_clean":"2024-09-19T04:30:46.538975+0000","last_became_active":"2024-09-19T04:29:02.407241+0000","last_became_peered":"2024-09-19T04:29:02.407241+0000","last_unstale":"2024-09-19T04:30:46.538975+0000","last_undegraded":"2024-09-19T04:30:46.538975+0000","last_fullsized":"2024-09-19T04:30:46.538975+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:13.246995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2a","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541684+0000","last_change":"2024-09-19T04:29:02.418341+0000","last_active":"2024-09-19T04:30:46.541684+0000","last_peered":"2024-09-19T04:30:46.541684+0000","last_clean":"2024-09-19T04:30:46.541684+0000","last_became_active":"2024-09-19T04:29:02.418028+0000","last_became_peered":"2024-09-19T04:29:02.418028+0000","last_unstale":"2024-09-19T04:30:46.541684+0000","last_undegraded":"2024-09-19T04:30:46.541684+0000","last_fullsized":"2024-09-19T04:30:46.541684+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:10:03.264803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.29","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532781+0000","last_change":"2024-09-19T04:29:02.419191+0000","last_active":"2024-09-19T04:30:46.532781+0000","last_peered":"2024-09-19T04:30:46.532781+0000","last_clean":"2024-09-19T04:30:46.532781+0000","last_became_active":"2024-09-19T04:29:02.418587+0000","last_became_peered":"2024-09-19T04:29:02.418587+0000","last_unstale":"2024-09-19T04:30:46.532781+0000","last_undegraded":"2024-09-19T04:30:46.532781+0000","last_fullsized":"2024-09-19T04:30:46.532781+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:21:58.185492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537222+0000","last_change":"2024-09-19T04:29:02.407961+0000","last_active":"2024-09-19T04:30:46.537222+0000","last_peered":"2024-09-19T04:30:46.537222+0000","last_clean":"2024-09-19T04:30:46.537222+0000","last_became_active":"2024-09-19T04:29:02.406888+0000","last_became_peered":"2024-09-19T04:29:02.406888+0000","last_unstale":"2024-09-19T04:30:46.537222+0000","last_undegraded":"2024-09-19T04:30:46.537222+0000","last_fullsized":"2024-09-19T04:30:46.537222+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:47.360605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"84'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532530+0000","last_change":"2024-09-19T04:29:02.415234+0000","last_active":"2024-09-19T04:30:46.532530+0000","last_peered":"2024-09-19T04:30:46.532530+0000","last_clean":"2024-09-19T04:30:46.532530+0000","last_became_active":"2024-09-19T04:29:02.414929+0000","last_became_peered":"2024-09-19T04:29:02.414929+0000","last_unstale":"2024-09-19T04:30:46.532530+0000","last_undegraded":"2024-09-19T04:30:46.532530+0000","last_fullsized":"2024-09-19T04:30:46.532530+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:40:48.077114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538596+0000","last_change":"2024-09-19T04:29:02.416072+0000","last_active":"2024-09-19T04:30:46.538596+0000","last_peered":"2024-09-19T04:30:46.538596+0000","last_clean":"2024-09-19T04:30:46.538596+0000","last_became_active":"2024-09-19T04:29:02.415714+0000","last_became_peered":"2024-09-19T04:29:02.415714+0000","last_unstale":"2024-09-19T04:30:46.538596+0000","last_undegraded":"2024-09-19T04:30:46.538596+0000","last_fullsized":"2024-09-19T04:30:46.538596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:45.000850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.25","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.528255+0000","last_change":"2024-09-19T04:29:02.426071+0000","last_active":"2024-09-19T04:30:46.528255+0000","last_peered":"2024-09-19T04:30:46.528255+0000","last_clean":"2024-09-19T04:30:46.528255+0000","last_became_active":"2024-09-19T04:29:02.425717+0000","last_became_peered":"2024-09-19T04:29:02.425717+0000","last_unstale":"2024-09-19T04:30:46.528255+0000","last_undegraded":"2024-09-19T04:30:46.528255+0000","last_fullsized":"2024-09-19T04:30:46.528255+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:36:11.989191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.24","version":"84'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541570+0000","last_change":"2024-09-19T04:29:18.481675+0000","last_active":"2024-09-19T04:30:46.541570+0000","last_peered":"2024-09-19T04:30:46.541570+0000","last_clean":"2024-09-19T04:30:46.541570+0000","last_became_active":"2024-09-19T04:29:18.481224+0000","last_became_peered":"2024-09-19T04:29:18.481224+0000","last_unstale":"2024-09-19T04:30:46.541570+0000","last_undegraded":"2024-09-19T04:30:46.541570+0000","last_fullsized":"2024-09-19T04:30:46.541570+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:10.928554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,9,0],"acting":[6,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.23","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540263+0000","last_change":"2024-09-19T04:29:02.413973+0000","last_active":"2024-09-19T04:30:46.540263+0000","last_peered":"2024-09-19T04:30:46.540263+0000","last_clean":"2024-09-19T04:30:46.540263+0000","last_became_active":"2024-09-19T04:29:02.413695+0000","last_became_peered":"2024-09-19T04:29:02.413695+0000","last_unstale":"2024-09-19T04:30:46.540263+0000","last_undegraded":"2024-09-19T04:30:46.540263+0000","last_fullsized":"2024-09-19T04:30:46.540263+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:11.961493+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535839+0000","last_change":"2024-09-19T04:29:02.413943+0000","last_active":"2024-09-19T04:30:46.535839+0000","last_peered":"2024-09-19T04:30:46.535839+0000","last_clean":"2024-09-19T04:30:46.535839+0000","last_became_active":"2024-09-19T04:29:02.411977+0000","last_became_peered":"2024-09-19T04:29:02.411977+0000","last_unstale":"2024-09-19T04:30:46.535839+0000","last_undegraded":"2024-09-19T04:30:46.535839+0000","last_fullsized":"2024-09-19T04:30:46.535839+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:48:38.734831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.21","version":"84'12","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535817+0000","last_change":"2024-09-19T04:29:02.420995+0000","last_active":"2024-09-19T04:30:46.535817+0000","last_peered":"2024-09-19T04:30:46.535817+0000","last_clean":"2024-09-19T04:30:46.535817+0000","last_became_active":"2024-09-19T04:29:02.420552+0000","last_became_peered":"2024-09-19T04:29:02.420552+0000","last_unstale":"2024-09-19T04:30:46.535817+0000","last_undegraded":"2024-09-19T04:30:46.535817+0000","last_fullsized":"2024-09-19T04:30:46.535817+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:54:12.560776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"84'9","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.533888+0000","last_change":"2024-09-19T04:29:18.481041+0000","last_active":"2024-09-19T04:30:46.533888+0000","last_peered":"2024-09-19T04:30:46.533888+0000","last_clean":"2024-09-19T04:30:46.533888+0000","last_became_active":"2024-09-19T04:29:18.480478+0000","last_became_peered":"2024-09-19T04:29:18.480478+0000","last_unstale":"2024-09-19T04:30:46.533888+0000","last_undegraded":"2024-09-19T04:30:46.533888+0000","last_fullsized":"2024-09-19T04:30:46.533888+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:11:38.185061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,9],"acting":[11,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1a","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.526134+0000","last_change":"2024-09-19T04:29:02.411380+0000","last_active":"2024-09-19T04:30:46.526134+0000","last_peered":"2024-09-19T04:30:46.526134+0000","last_clean":"2024-09-19T04:30:46.526134+0000","last_became_active":"2024-09-19T04:29:02.410977+0000","last_became_peered":"2024-09-19T04:29:02.410977+0000","last_unstale":"2024-09-19T04:30:46.526134+0000","last_undegraded":"2024-09-19T04:30:46.526134+0000","last_fullsized":"2024-09-19T04:30:46.526134+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:05.147856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.1b","version":"84'9","reported_seq":138,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:50.593813+0000","last_change":"2024-09-19T04:29:00.394886+0000","last_active":"2024-09-19T04:30:50.593813+0000","last_peered":"2024-09-19T04:30:50.593813+0000","last_clean":"2024-09-19T04:30:50.593813+0000","last_became_active":"2024-09-19T04:29:00.394412+0000","last_became_peered":"2024-09-19T04:29:00.394412+0000","last_unstale":"2024-09-19T04:30:50.593813+0000","last_undegraded":"2024-09-19T04:30:50.593813+0000","last_fullsized":"2024-09-19T04:30:50.593813+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:43.929791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2296,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":5,"num_write":6,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1b","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536908+0000","last_change":"2024-09-19T04:29:02.413258+0000","last_active":"2024-09-19T04:30:46.536908+0000","last_peered":"2024-09-19T04:30:46.536908+0000","last_clean":"2024-09-19T04:30:46.536908+0000","last_became_active":"2024-09-19T04:29:02.412887+0000","last_became_peered":"2024-09-19T04:29:02.412887+0000","last_unstale":"2024-09-19T04:30:46.536908+0000","last_undegraded":"2024-09-19T04:30:46.536908+0000","last_fullsized":"2024-09-19T04:30:46.536908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:04:26.737877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,3],"acting":[5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1a","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494757+0000","last_change":"2024-09-19T04:29:00.395696+0000","last_active":"2024-09-19T04:30:46.494757+0000","last_peered":"2024-09-19T04:30:46.494757+0000","last_clean":"2024-09-19T04:30:46.494757+0000","last_became_active":"2024-09-19T04:29:00.395363+0000","last_became_peered":"2024-09-19T04:29:00.395363+0000","last_unstale":"2024-09-19T04:30:46.494757+0000","last_undegraded":"2024-09-19T04:30:46.494757+0000","last_fullsized":"2024-09-19T04:30:46.494757+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:05:50.660391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.19","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.489872+0000","last_change":"2024-09-19T04:29:00.391765+0000","last_active":"2024-09-19T04:30:46.489872+0000","last_peered":"2024-09-19T04:30:46.489872+0000","last_clean":"2024-09-19T04:30:46.489872+0000","last_became_active":"2024-09-19T04:29:00.391412+0000","last_became_peered":"2024-09-19T04:29:00.391412+0000","last_unstale":"2024-09-19T04:30:46.489872+0000","last_undegraded":"2024-09-19T04:30:46.489872+0000","last_fullsized":"2024-09-19T04:30:46.489872+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:14:27.423046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.529949+0000","last_change":"2024-09-19T04:29:02.417820+0000","last_active":"2024-09-19T04:30:46.529949+0000","last_peered":"2024-09-19T04:30:46.529949+0000","last_clean":"2024-09-19T04:30:46.529949+0000","last_became_active":"2024-09-19T04:29:02.417452+0000","last_became_peered":"2024-09-19T04:29:02.417452+0000","last_unstale":"2024-09-19T04:30:46.529949+0000","last_undegraded":"2024-09-19T04:30:46.529949+0000","last_fullsized":"2024-09-19T04:30:46.529949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:34.767829+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494641+0000","last_change":"2024-09-19T04:29:00.393075+0000","last_active":"2024-09-19T04:30:46.494641+0000","last_peered":"2024-09-19T04:30:46.494641+0000","last_clean":"2024-09-19T04:30:46.494641+0000","last_became_active":"2024-09-19T04:29:00.392695+0000","last_became_peered":"2024-09-19T04:29:00.392695+0000","last_unstale":"2024-09-19T04:30:46.494641+0000","last_undegraded":"2024-09-19T04:30:46.494641+0000","last_fullsized":"2024-09-19T04:30:46.494641+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:49:43.122636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.537328+0000","last_change":"2024-09-19T04:29:02.403886+0000","last_active":"2024-09-19T04:30:46.537328+0000","last_peered":"2024-09-19T04:30:46.537328+0000","last_clean":"2024-09-19T04:30:46.537328+0000","last_became_active":"2024-09-19T04:29:02.403530+0000","last_became_peered":"2024-09-19T04:29:02.403530+0000","last_unstale":"2024-09-19T04:30:46.537328+0000","last_undegraded":"2024-09-19T04:30:46.537328+0000","last_fullsized":"2024-09-19T04:30:46.537328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:20:57.597364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.17","version":"83'4","reported_seq":128,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:50.593313+0000","last_change":"2024-09-19T04:29:00.390081+0000","last_active":"2024-09-19T04:30:50.593313+0000","last_peered":"2024-09-19T04:30:50.593313+0000","last_clean":"2024-09-19T04:30:50.593313+0000","last_became_active":"2024-09-19T04:29:00.389701+0000","last_became_peered":"2024-09-19T04:29:00.389701+0000","last_unstale":"2024-09-19T04:30:50.593313+0000","last_undegraded":"2024-09-19T04:30:50.593313+0000","last_fullsized":"2024-09-19T04:30:50.593313+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:15:42.702518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.16","version":"84'10","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538592+0000","last_change":"2024-09-19T04:29:02.424712+0000","last_active":"2024-09-19T04:30:46.538592+0000","last_peered":"2024-09-19T04:30:46.538592+0000","last_clean":"2024-09-19T04:30:46.538592+0000","last_became_active":"2024-09-19T04:29:02.424316+0000","last_became_peered":"2024-09-19T04:29:02.424316+0000","last_unstale":"2024-09-19T04:30:46.538592+0000","last_undegraded":"2024-09-19T04:30:46.538592+0000","last_fullsized":"2024-09-19T04:30:46.538592+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:06:21.246473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.16","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.518453+0000","last_change":"2024-09-19T04:29:00.396085+0000","last_active":"2024-09-19T04:30:46.518453+0000","last_peered":"2024-09-19T04:30:46.518453+0000","last_clean":"2024-09-19T04:30:46.518453+0000","last_became_active":"2024-09-19T04:29:00.395737+0000","last_became_peered":"2024-09-19T04:29:00.395737+0000","last_unstale":"2024-09-19T04:30:46.518453+0000","last_undegraded":"2024-09-19T04:30:46.518453+0000","last_fullsized":"2024-09-19T04:30:46.518453+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:30:59.429917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.17","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536976+0000","last_change":"2024-09-19T04:29:02.412318+0000","last_active":"2024-09-19T04:30:46.536976+0000","last_peered":"2024-09-19T04:30:46.536976+0000","last_clean":"2024-09-19T04:30:46.536976+0000","last_became_active":"2024-09-19T04:29:02.412020+0000","last_became_peered":"2024-09-19T04:29:02.412020+0000","last_unstale":"2024-09-19T04:30:46.536976+0000","last_undegraded":"2024-09-19T04:30:46.536976+0000","last_fullsized":"2024-09-19T04:30:46.536976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:16:45.341633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.495019+0000","last_change":"2024-09-19T04:29:00.507027+0000","last_active":"2024-09-19T04:30:46.495019+0000","last_peered":"2024-09-19T04:30:46.495019+0000","last_clean":"2024-09-19T04:30:46.495019+0000","last_became_active":"2024-09-19T04:29:00.506660+0000","last_became_peered":"2024-09-19T04:29:00.506660+0000","last_unstale":"2024-09-19T04:30:46.495019+0000","last_undegraded":"2024-09-19T04:30:46.495019+0000","last_fullsized":"2024-09-19T04:30:46.495019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:54.629719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.14","version":"84'11","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.536650+0000","last_change":"2024-09-19T04:29:02.415423+0000","last_active":"2024-09-19T04:30:46.536650+0000","last_peered":"2024-09-19T04:30:46.536650+0000","last_clean":"2024-09-19T04:30:46.536650+0000","last_became_active":"2024-09-19T04:29:02.415105+0000","last_became_peered":"2024-09-19T04:29:02.415105+0000","last_unstale":"2024-09-19T04:30:46.536650+0000","last_undegraded":"2024-09-19T04:30:46.536650+0000","last_fullsized":"2024-09-19T04:30:46.536650+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:24:00.449745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.14","version":"84'35","reported_seq":272,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:51.594406+0000","last_change":"2024-09-19T04:29:00.396021+0000","last_active":"2024-09-19T04:30:51.594406+0000","last_peered":"2024-09-19T04:30:51.594406+0000","last_clean":"2024-09-19T04:30:51.594406+0000","last_became_active":"2024-09-19T04:29:00.395649+0000","last_became_peered":"2024-09-19T04:29:00.395649+0000","last_unstale":"2024-09-19T04:30:51.594406+0000","last_undegraded":"2024-09-19T04:30:51.594406+0000","last_fullsized":"2024-09-19T04:30:51.594406+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:30:56.800573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":66001,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":213,"num_read_kb":170,"num_write":36,"num_write_kb":80,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.526198+0000","last_change":"2024-09-19T04:29:02.416081+0000","last_active":"2024-09-19T04:30:46.526198+0000","last_peered":"2024-09-19T04:30:46.526198+0000","last_clean":"2024-09-19T04:30:46.526198+0000","last_became_active":"2024-09-19T04:29:02.415780+0000","last_became_peered":"2024-09-19T04:29:02.415780+0000","last_unstale":"2024-09-19T04:30:46.526198+0000","last_undegraded":"2024-09-19T04:30:46.526198+0000","last_fullsized":"2024-09-19T04:30:46.526198+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:15:23.438141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.13","version":"81'6","reported_seq":31,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497681+0000","last_change":"2024-09-19T04:29:00.396397+0000","last_active":"2024-09-19T04:30:46.497681+0000","last_peered":"2024-09-19T04:30:46.497681+0000","last_clean":"2024-09-19T04:30:46.497681+0000","last_became_active":"2024-09-19T04:29:00.395896+0000","last_became_peered":"2024-09-19T04:29:00.395896+0000","last_unstale":"2024-09-19T04:30:46.497681+0000","last_undegraded":"2024-09-19T04:30:46.497681+0000","last_fullsized":"2024-09-19T04:30:46.497681+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:06.174262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,10,3],"acting":[2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.12","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538251+0000","last_change":"2024-09-19T04:29:02.408299+0000","last_active":"2024-09-19T04:30:46.538251+0000","last_peered":"2024-09-19T04:30:46.538251+0000","last_clean":"2024-09-19T04:30:46.538251+0000","last_became_active":"2024-09-19T04:29:02.407970+0000","last_became_peered":"2024-09-19T04:29:02.407970+0000","last_unstale":"2024-09-19T04:30:46.538251+0000","last_undegraded":"2024-09-19T04:30:46.538251+0000","last_fullsized":"2024-09-19T04:30:46.538251+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:38:50.758517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.12","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.494741+0000","last_change":"2024-09-19T04:29:00.393163+0000","last_active":"2024-09-19T04:30:46.494741+0000","last_peered":"2024-09-19T04:30:46.494741+0000","last_clean":"2024-09-19T04:30:46.494741+0000","last_became_active":"2024-09-19T04:29:00.392749+0000","last_became_peered":"2024-09-19T04:29:00.392749+0000","last_unstale":"2024-09-19T04:30:46.494741+0000","last_undegraded":"2024-09-19T04:30:46.494741+0000","last_fullsized":"2024-09-19T04:30:46.494741+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:41.999124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.543441+0000","last_change":"2024-09-19T04:29:02.412754+0000","last_active":"2024-09-19T04:30:46.543441+0000","last_peered":"2024-09-19T04:30:46.543441+0000","last_clean":"2024-09-19T04:30:46.543441+0000","last_became_active":"2024-09-19T04:29:02.412445+0000","last_became_peered":"2024-09-19T04:29:02.412445+0000","last_unstale":"2024-09-19T04:30:46.543441+0000","last_undegraded":"2024-09-19T04:30:46.543441+0000","last_fullsized":"2024-09-19T04:30:46.543441+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:52:31.531672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"84'8","reported_seq":137,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:50.593969+0000","last_change":"2024-09-19T04:29:00.393863+0000","last_active":"2024-09-19T04:30:50.593969+0000","last_peered":"2024-09-19T04:30:50.593969+0000","last_clean":"2024-09-19T04:30:50.593969+0000","last_became_active":"2024-09-19T04:29:00.393502+0000","last_became_peered":"2024-09-19T04:29:00.393502+0000","last_unstale":"2024-09-19T04:30:50.593969+0000","last_undegraded":"2024-09-19T04:30:50.593969+0000","last_fullsized":"2024-09-19T04:30:50.593969+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:58:26.674948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2403,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":6,"num_write":7,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.10","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538632+0000","last_change":"2024-09-19T04:29:02.412624+0000","last_active":"2024-09-19T04:30:46.538632+0000","last_peered":"2024-09-19T04:30:46.538632+0000","last_clean":"2024-09-19T04:30:46.538632+0000","last_became_active":"2024-09-19T04:29:02.412299+0000","last_became_peered":"2024-09-19T04:29:02.412299+0000","last_unstale":"2024-09-19T04:30:46.538632+0000","last_undegraded":"2024-09-19T04:30:46.538632+0000","last_fullsized":"2024-09-19T04:30:46.538632+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:34.062422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"81'15","reported_seq":40,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.504375+0000","last_change":"2024-09-19T04:29:00.504931+0000","last_active":"2024-09-19T04:30:46.504375+0000","last_peered":"2024-09-19T04:30:46.504375+0000","last_clean":"2024-09-19T04:30:46.504375+0000","last_became_active":"2024-09-19T04:29:00.504526+0000","last_became_peered":"2024-09-19T04:29:00.504526+0000","last_unstale":"2024-09-19T04:30:46.504375+0000","last_undegraded":"2024-09-19T04:30:46.504375+0000","last_fullsized":"2024-09-19T04:30:46.504375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:47:31.096516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.11","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530159+0000","last_change":"2024-09-19T04:29:02.424492+0000","last_active":"2024-09-19T04:30:46.530159+0000","last_peered":"2024-09-19T04:30:46.530159+0000","last_clean":"2024-09-19T04:30:46.530159+0000","last_became_active":"2024-09-19T04:29:02.424013+0000","last_became_peered":"2024-09-19T04:29:02.424013+0000","last_unstale":"2024-09-19T04:30:46.530159+0000","last_undegraded":"2024-09-19T04:30:46.530159+0000","last_fullsized":"2024-09-19T04:30:46.530159+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:01:41.021945+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.f","version":"84'3","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508470+0000","last_change":"2024-09-19T04:29:00.396707+0000","last_active":"2024-09-19T04:30:46.508470+0000","last_peered":"2024-09-19T04:30:46.508470+0000","last_clean":"2024-09-19T04:30:46.508470+0000","last_became_active":"2024-09-19T04:29:00.394876+0000","last_became_peered":"2024-09-19T04:29:00.394876+0000","last_unstale":"2024-09-19T04:30:46.508470+0000","last_undegraded":"2024-09-19T04:30:46.508470+0000","last_fullsized":"2024-09-19T04:30:46.508470+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:48:06.648377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.e","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531572+0000","last_change":"2024-09-19T04:29:02.425106+0000","last_active":"2024-09-19T04:30:46.531572+0000","last_peered":"2024-09-19T04:30:46.531572+0000","last_clean":"2024-09-19T04:30:46.531572+0000","last_became_active":"2024-09-19T04:29:02.424597+0000","last_became_peered":"2024-09-19T04:29:02.424597+0000","last_unstale":"2024-09-19T04:30:46.531572+0000","last_undegraded":"2024-09-19T04:30:46.531572+0000","last_fullsized":"2024-09-19T04:30:46.531572+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:35:02.998519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.490229+0000","last_change":"2024-09-19T04:29:00.396369+0000","last_active":"2024-09-19T04:30:46.490229+0000","last_peered":"2024-09-19T04:30:46.490229+0000","last_clean":"2024-09-19T04:30:46.490229+0000","last_became_active":"2024-09-19T04:29:00.395980+0000","last_became_peered":"2024-09-19T04:29:00.395980+0000","last_unstale":"2024-09-19T04:30:46.490229+0000","last_undegraded":"2024-09-19T04:30:46.490229+0000","last_fullsized":"2024-09-19T04:30:46.490229+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:18:45.941729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540832+0000","last_change":"2024-09-19T04:29:02.415771+0000","last_active":"2024-09-19T04:30:46.540832+0000","last_peered":"2024-09-19T04:30:46.540832+0000","last_clean":"2024-09-19T04:30:46.540832+0000","last_became_active":"2024-09-19T04:29:02.415404+0000","last_became_peered":"2024-09-19T04:29:02.415404+0000","last_unstale":"2024-09-19T04:30:46.540832+0000","last_undegraded":"2024-09-19T04:30:46.540832+0000","last_fullsized":"2024-09-19T04:30:46.540832+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:04:04.509294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"84'39","reported_seq":71,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.705215+0000","last_change":"2024-09-19T04:29:00.389015+0000","last_active":"2024-09-19T04:30:46.705215+0000","last_peered":"2024-09-19T04:30:46.705215+0000","last_clean":"2024-09-19T04:30:46.705215+0000","last_became_active":"2024-09-19T04:29:00.388621+0000","last_became_peered":"2024-09-19T04:29:00.388621+0000","last_unstale":"2024-09-19T04:30:46.705215+0000","last_undegraded":"2024-09-19T04:30:46.705215+0000","last_fullsized":"2024-09-19T04:30:46.705215+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:19:49.509697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.c","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541218+0000","last_change":"2024-09-19T04:29:02.411379+0000","last_active":"2024-09-19T04:30:46.541218+0000","last_peered":"2024-09-19T04:30:46.541218+0000","last_clean":"2024-09-19T04:30:46.541218+0000","last_became_active":"2024-09-19T04:29:02.411069+0000","last_became_peered":"2024-09-19T04:29:02.411069+0000","last_unstale":"2024-09-19T04:30:46.541218+0000","last_undegraded":"2024-09-19T04:30:46.541218+0000","last_fullsized":"2024-09-19T04:30:46.541218+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:10.953422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"81'3","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.498451+0000","last_change":"2024-09-19T04:29:00.505088+0000","last_active":"2024-09-19T04:30:46.498451+0000","last_peered":"2024-09-19T04:30:46.498451+0000","last_clean":"2024-09-19T04:30:46.498451+0000","last_became_active":"2024-09-19T04:29:00.504734+0000","last_became_peered":"2024-09-19T04:29:00.504734+0000","last_unstale":"2024-09-19T04:30:46.498451+0000","last_undegraded":"2024-09-19T04:30:46.498451+0000","last_fullsized":"2024-09-19T04:30:46.498451+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:31:38.286789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542579+0000","last_change":"2024-09-19T04:29:02.420752+0000","last_active":"2024-09-19T04:30:46.542579+0000","last_peered":"2024-09-19T04:30:46.542579+0000","last_clean":"2024-09-19T04:30:46.542579+0000","last_became_active":"2024-09-19T04:29:02.419136+0000","last_became_peered":"2024-09-19T04:29:02.419136+0000","last_unstale":"2024-09-19T04:30:46.542579+0000","last_undegraded":"2024-09-19T04:30:46.542579+0000","last_fullsized":"2024-09-19T04:30:46.542579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:40.163876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"84'148","reported_seq":393,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:48.614087+0000","last_change":"2024-09-19T04:27:51.622607+0000","last_active":"2024-09-19T04:30:48.614087+0000","last_peered":"2024-09-19T04:30:48.614087+0000","last_clean":"2024-09-19T04:30:48.614087+0000","last_became_active":"2024-09-19T04:27:51.622000+0000","last_became_peered":"2024-09-19T04:27:51.622000+0000","last_unstale":"2024-09-19T04:30:48.614087+0000","last_undegraded":"2024-09-19T04:30:48.614087+0000","last_fullsized":"2024-09-19T04:30:48.614087+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:24:31.610268+0000","last_clean_scrub_stamp":"2024-09-19T04:24:31.610268+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:20:05.335499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"81'3","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.514503+0000","last_change":"2024-09-19T04:29:00.393618+0000","last_active":"2024-09-19T04:30:46.514503+0000","last_peered":"2024-09-19T04:30:46.514503+0000","last_clean":"2024-09-19T04:30:46.514503+0000","last_became_active":"2024-09-19T04:29:00.393248+0000","last_became_peered":"2024-09-19T04:29:00.393248+0000","last_unstale":"2024-09-19T04:30:46.514503+0000","last_undegraded":"2024-09-19T04:30:46.514503+0000","last_fullsized":"2024-09-19T04:30:46.514503+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:35.271531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.528183+0000","last_change":"2024-09-19T04:29:02.415147+0000","last_active":"2024-09-19T04:30:46.528183+0000","last_peered":"2024-09-19T04:30:46.528183+0000","last_clean":"2024-09-19T04:30:46.528183+0000","last_became_active":"2024-09-19T04:29:02.414275+0000","last_became_peered":"2024-09-19T04:29:02.414275+0000","last_unstale":"2024-09-19T04:30:46.528183+0000","last_undegraded":"2024-09-19T04:30:46.528183+0000","last_fullsized":"2024-09-19T04:30:46.528183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:01:32.843572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508104+0000","last_change":"2024-09-19T04:29:00.398007+0000","last_active":"2024-09-19T04:30:46.508104+0000","last_peered":"2024-09-19T04:30:46.508104+0000","last_clean":"2024-09-19T04:30:46.508104+0000","last_became_active":"2024-09-19T04:29:00.397644+0000","last_became_peered":"2024-09-19T04:29:00.397644+0000","last_unstale":"2024-09-19T04:30:46.508104+0000","last_undegraded":"2024-09-19T04:30:46.508104+0000","last_fullsized":"2024-09-19T04:30:46.508104+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:34.476893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.541292+0000","last_change":"2024-09-19T04:29:02.414957+0000","last_active":"2024-09-19T04:30:46.541292+0000","last_peered":"2024-09-19T04:30:46.541292+0000","last_clean":"2024-09-19T04:30:46.541292+0000","last_became_active":"2024-09-19T04:29:02.414641+0000","last_became_peered":"2024-09-19T04:29:02.414641+0000","last_unstale":"2024-09-19T04:30:46.541292+0000","last_undegraded":"2024-09-19T04:30:46.541292+0000","last_fullsized":"2024-09-19T04:30:46.541292+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:19:18.824972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"84'5","reported_seq":129,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:50.593549+0000","last_change":"2024-09-19T04:29:00.504872+0000","last_active":"2024-09-19T04:30:50.593549+0000","last_peered":"2024-09-19T04:30:50.593549+0000","last_clean":"2024-09-19T04:30:50.593549+0000","last_became_active":"2024-09-19T04:29:00.504520+0000","last_became_peered":"2024-09-19T04:29:00.504520+0000","last_unstale":"2024-09-19T04:30:50.593549+0000","last_undegraded":"2024-09-19T04:30:50.593549+0000","last_fullsized":"2024-09-19T04:30:50.593549+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:19:39.284328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":100,"num_read_kb":100,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.535674+0000","last_change":"2024-09-19T04:29:02.416451+0000","last_active":"2024-09-19T04:30:46.535674+0000","last_peered":"2024-09-19T04:30:46.535674+0000","last_clean":"2024-09-19T04:30:46.535674+0000","last_became_active":"2024-09-19T04:29:02.415271+0000","last_became_peered":"2024-09-19T04:29:02.415271+0000","last_unstale":"2024-09-19T04:30:46.535674+0000","last_undegraded":"2024-09-19T04:30:46.535674+0000","last_fullsized":"2024-09-19T04:30:46.535674+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:39:06.371572+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"81'1","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.518710+0000","last_change":"2024-09-19T04:29:00.390999+0000","last_active":"2024-09-19T04:30:46.518710+0000","last_peered":"2024-09-19T04:30:46.518710+0000","last_clean":"2024-09-19T04:30:46.518710+0000","last_became_active":"2024-09-19T04:29:00.390639+0000","last_became_peered":"2024-09-19T04:29:00.390639+0000","last_unstale":"2024-09-19T04:30:46.518710+0000","last_undegraded":"2024-09-19T04:30:46.518710+0000","last_fullsized":"2024-09-19T04:30:46.518710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:42:26.504171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3","version":"84'7","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532095+0000","last_change":"2024-09-19T04:29:02.419534+0000","last_active":"2024-09-19T04:30:46.532095+0000","last_peered":"2024-09-19T04:30:46.532095+0000","last_clean":"2024-09-19T04:30:46.532095+0000","last_became_active":"2024-09-19T04:29:02.419192+0000","last_became_peered":"2024-09-19T04:29:02.419192+0000","last_unstale":"2024-09-19T04:30:46.532095+0000","last_undegraded":"2024-09-19T04:30:46.532095+0000","last_fullsized":"2024-09-19T04:30:46.532095+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T05:33:33.866859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":30,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.501709+0000","last_change":"2024-09-19T04:29:18.480950+0000","last_active":"2024-09-19T04:30:46.501709+0000","last_peered":"2024-09-19T04:30:46.501709+0000","last_clean":"2024-09-19T04:30:46.501709+0000","last_became_active":"2024-09-19T04:29:18.480542+0000","last_became_peered":"2024-09-19T04:29:18.480542+0000","last_unstale":"2024-09-19T04:30:46.501709+0000","last_undegraded":"2024-09-19T04:30:46.501709+0000","last_fullsized":"2024-09-19T04:30:46.501709+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:18.647586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,11,0],"acting":[9,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.5","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530211+0000","last_change":"2024-09-19T04:29:02.415075+0000","last_active":"2024-09-19T04:30:46.530211+0000","last_peered":"2024-09-19T04:30:46.530211+0000","last_clean":"2024-09-19T04:30:46.530211+0000","last_became_active":"2024-09-19T04:29:02.414635+0000","last_became_peered":"2024-09-19T04:29:02.414635+0000","last_unstale":"2024-09-19T04:30:46.530211+0000","last_undegraded":"2024-09-19T04:30:46.530211+0000","last_fullsized":"2024-09-19T04:30:46.530211+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:12.587903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.5","version":"81'1","reported_seq":17,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.502268+0000","last_change":"2024-09-19T04:29:18.485218+0000","last_active":"2024-09-19T04:30:46.502268+0000","last_peered":"2024-09-19T04:30:46.502268+0000","last_clean":"2024-09-19T04:30:46.502268+0000","last_became_active":"2024-09-19T04:29:18.481618+0000","last_became_peered":"2024-09-19T04:29:18.481618+0000","last_unstale":"2024-09-19T04:30:46.502268+0000","last_undegraded":"2024-09-19T04:30:46.502268+0000","last_fullsized":"2024-09-19T04:30:46.502268+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:28:26.178884+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,9],"acting":[11,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.4","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540687+0000","last_change":"2024-09-19T04:29:02.412647+0000","last_active":"2024-09-19T04:30:46.540687+0000","last_peered":"2024-09-19T04:30:46.540687+0000","last_clean":"2024-09-19T04:30:46.540687+0000","last_became_active":"2024-09-19T04:29:02.412014+0000","last_became_peered":"2024-09-19T04:29:02.412014+0000","last_unstale":"2024-09-19T04:30:46.540687+0000","last_undegraded":"2024-09-19T04:30:46.540687+0000","last_fullsized":"2024-09-19T04:30:46.540687+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:59:32.341462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"84'46","reported_seq":93,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:47.423213+0000","last_change":"2024-09-19T04:29:00.397860+0000","last_active":"2024-09-19T04:30:47.423213+0000","last_peered":"2024-09-19T04:30:47.423213+0000","last_clean":"2024-09-19T04:30:47.423213+0000","last_became_active":"2024-09-19T04:29:00.397501+0000","last_became_peered":"2024-09-19T04:29:00.397501+0000","last_unstale":"2024-09-19T04:30:47.423213+0000","last_undegraded":"2024-09-19T04:30:47.423213+0000","last_fullsized":"2024-09-19T04:30:47.423213+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T06:28:51.683617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":84,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.7","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542946+0000","last_change":"2024-09-19T04:29:02.418639+0000","last_active":"2024-09-19T04:30:46.542946+0000","last_peered":"2024-09-19T04:30:46.542946+0000","last_clean":"2024-09-19T04:30:46.542946+0000","last_became_active":"2024-09-19T04:29:02.418334+0000","last_became_peered":"2024-09-19T04:29:02.418334+0000","last_unstale":"2024-09-19T04:30:46.542946+0000","last_undegraded":"2024-09-19T04:30:46.542946+0000","last_fullsized":"2024-09-19T04:30:46.542946+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:57.161642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"81'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505107+0000","last_change":"2024-09-19T04:29:00.504849+0000","last_active":"2024-09-19T04:30:46.505107+0000","last_peered":"2024-09-19T04:30:46.505107+0000","last_clean":"2024-09-19T04:30:46.505107+0000","last_became_active":"2024-09-19T04:29:00.504618+0000","last_became_peered":"2024-09-19T04:29:00.504618+0000","last_unstale":"2024-09-19T04:30:46.505107+0000","last_undegraded":"2024-09-19T04:30:46.505107+0000","last_fullsized":"2024-09-19T04:30:46.505107+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:08:31.038078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"84'7","reported_seq":32,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.540526+0000","last_change":"2024-09-19T04:29:19.354455+0000","last_active":"2024-09-19T04:30:46.540526+0000","last_peered":"2024-09-19T04:30:46.540526+0000","last_clean":"2024-09-19T04:30:46.540526+0000","last_became_active":"2024-09-19T04:29:19.354062+0000","last_became_peered":"2024-09-19T04:29:19.354062+0000","last_unstale":"2024-09-19T04:30:46.540526+0000","last_undegraded":"2024-09-19T04:30:46.540526+0000","last_fullsized":"2024-09-19T04:30:46.540526+0000","mapping_epoch":82,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":83,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:43:17.134082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.496926+0000","last_change":"2024-09-19T04:29:00.506294+0000","last_active":"2024-09-19T04:30:46.496926+0000","last_peered":"2024-09-19T04:30:46.496926+0000","last_clean":"2024-09-19T04:30:46.496926+0000","last_became_active":"2024-09-19T04:29:00.506028+0000","last_became_peered":"2024-09-19T04:29:00.506028+0000","last_unstale":"2024-09-19T04:30:46.496926+0000","last_undegraded":"2024-09-19T04:30:46.496926+0000","last_fullsized":"2024-09-19T04:30:46.496926+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:44:15.972980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"84'2","reported_seq":21,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.515227+0000","last_change":"2024-09-19T04:29:02.414995+0000","last_active":"2024-09-19T04:30:46.515227+0000","last_peered":"2024-09-19T04:30:46.515227+0000","last_clean":"2024-09-19T04:30:46.515227+0000","last_became_active":"2024-09-19T04:29:02.414675+0000","last_became_peered":"2024-09-19T04:29:02.414675+0000","last_unstale":"2024-09-19T04:30:46.515227+0000","last_undegraded":"2024-09-19T04:30:46.515227+0000","last_fullsized":"2024-09-19T04:30:46.515227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:17:40.466483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.9","version":"81'3","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.496463+0000","last_change":"2024-09-19T04:29:00.389510+0000","last_active":"2024-09-19T04:30:46.496463+0000","last_peered":"2024-09-19T04:30:46.496463+0000","last_clean":"2024-09-19T04:30:46.496463+0000","last_became_active":"2024-09-19T04:29:00.389222+0000","last_became_peered":"2024-09-19T04:29:00.389222+0000","last_unstale":"2024-09-19T04:30:46.496463+0000","last_undegraded":"2024-09-19T04:30:46.496463+0000","last_fullsized":"2024-09-19T04:30:46.496463+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:15:00.290076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.8","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532102+0000","last_change":"2024-09-19T04:29:02.422356+0000","last_active":"2024-09-19T04:30:46.532102+0000","last_peered":"2024-09-19T04:30:46.532102+0000","last_clean":"2024-09-19T04:30:46.532102+0000","last_became_active":"2024-09-19T04:29:02.422037+0000","last_became_peered":"2024-09-19T04:29:02.422037+0000","last_unstale":"2024-09-19T04:30:46.532102+0000","last_undegraded":"2024-09-19T04:30:46.532102+0000","last_fullsized":"2024-09-19T04:30:46.532102+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:15:40.192439+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.a","version":"84'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497530+0000","last_change":"2024-09-19T04:29:00.399188+0000","last_active":"2024-09-19T04:30:46.497530+0000","last_peered":"2024-09-19T04:30:46.497530+0000","last_clean":"2024-09-19T04:30:46.497530+0000","last_became_active":"2024-09-19T04:29:00.398880+0000","last_became_peered":"2024-09-19T04:29:00.398880+0000","last_unstale":"2024-09-19T04:30:46.497530+0000","last_undegraded":"2024-09-19T04:30:46.497530+0000","last_fullsized":"2024-09-19T04:30:46.497530+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T07:02:55.581504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.b","version":"84'8","reported_seq":27,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532359+0000","last_change":"2024-09-19T04:29:02.408174+0000","last_active":"2024-09-19T04:30:46.532359+0000","last_peered":"2024-09-19T04:30:46.532359+0000","last_clean":"2024-09-19T04:30:46.532359+0000","last_became_active":"2024-09-19T04:29:02.407822+0000","last_became_peered":"2024-09-19T04:29:02.407822+0000","last_unstale":"2024-09-19T04:30:46.532359+0000","last_undegraded":"2024-09-19T04:30:46.532359+0000","last_fullsized":"2024-09-19T04:30:46.532359+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:51:59.755135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"81'4","reported_seq":29,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505712+0000","last_change":"2024-09-19T04:29:00.398445+0000","last_active":"2024-09-19T04:30:46.505712+0000","last_peered":"2024-09-19T04:30:46.505712+0000","last_clean":"2024-09-19T04:30:46.505712+0000","last_became_active":"2024-09-19T04:29:00.397923+0000","last_became_peered":"2024-09-19T04:29:00.397923+0000","last_unstale":"2024-09-19T04:30:46.505712+0000","last_undegraded":"2024-09-19T04:30:46.505712+0000","last_fullsized":"2024-09-19T04:30:46.505712+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T08:55:32.875211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.a","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.542712+0000","last_change":"2024-09-19T04:29:02.416685+0000","last_active":"2024-09-19T04:30:46.542712+0000","last_peered":"2024-09-19T04:30:46.542712+0000","last_clean":"2024-09-19T04:30:46.542712+0000","last_became_active":"2024-09-19T04:29:02.416311+0000","last_became_peered":"2024-09-19T04:29:02.416311+0000","last_unstale":"2024-09-19T04:30:46.542712+0000","last_undegraded":"2024-09-19T04:30:46.542712+0000","last_fullsized":"2024-09-19T04:30:46.542712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:47.988318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"84'15","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.530456+0000","last_change":"2024-09-19T04:29:02.424585+0000","last_active":"2024-09-19T04:30:46.530456+0000","last_peered":"2024-09-19T04:30:46.530456+0000","last_clean":"2024-09-19T04:30:46.530456+0000","last_became_active":"2024-09-19T04:29:02.424253+0000","last_became_peered":"2024-09-19T04:29:02.424253+0000","last_unstale":"2024-09-19T04:30:46.530456+0000","last_undegraded":"2024-09-19T04:30:46.530456+0000","last_fullsized":"2024-09-19T04:30:46.530456+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:55.865599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.505381+0000","last_change":"2024-09-19T04:29:00.396490+0000","last_active":"2024-09-19T04:30:46.505381+0000","last_peered":"2024-09-19T04:30:46.505381+0000","last_clean":"2024-09-19T04:30:46.505381+0000","last_became_active":"2024-09-19T04:29:00.394727+0000","last_became_peered":"2024-09-19T04:29:00.394727+0000","last_unstale":"2024-09-19T04:30:46.505381+0000","last_undegraded":"2024-09-19T04:30:46.505381+0000","last_fullsized":"2024-09-19T04:30:46.505381+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:43.724257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1c","version":"84'9","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.532968+0000","last_change":"2024-09-19T04:29:02.425557+0000","last_active":"2024-09-19T04:30:46.532968+0000","last_peered":"2024-09-19T04:30:46.532968+0000","last_clean":"2024-09-19T04:30:46.532968+0000","last_became_active":"2024-09-19T04:29:02.425261+0000","last_became_peered":"2024-09-19T04:29:02.425261+0000","last_unstale":"2024-09-19T04:30:46.532968+0000","last_undegraded":"2024-09-19T04:30:46.532968+0000","last_fullsized":"2024-09-19T04:30:46.532968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:30:20.204026+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1d","version":"81'4","reported_seq":28,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.508704+0000","last_change":"2024-09-19T04:29:00.397849+0000","last_active":"2024-09-19T04:30:46.508704+0000","last_peered":"2024-09-19T04:30:46.508704+0000","last_clean":"2024-09-19T04:30:46.508704+0000","last_became_active":"2024-09-19T04:29:00.397226+0000","last_became_peered":"2024-09-19T04:29:00.397226+0000","last_unstale":"2024-09-19T04:30:46.508704+0000","last_undegraded":"2024-09-19T04:30:46.508704+0000","last_fullsized":"2024-09-19T04:30:46.508704+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T10:49:04.402360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1f","version":"84'6","reported_seq":25,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.538188+0000","last_change":"2024-09-19T04:29:02.416202+0000","last_active":"2024-09-19T04:30:46.538188+0000","last_peered":"2024-09-19T04:30:46.538188+0000","last_clean":"2024-09-19T04:30:46.538188+0000","last_became_active":"2024-09-19T04:29:02.415886+0000","last_became_peered":"2024-09-19T04:29:02.415886+0000","last_unstale":"2024-09-19T04:30:46.538188+0000","last_undegraded":"2024-09-19T04:30:46.538188+0000","last_fullsized":"2024-09-19T04:30:46.538188+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:06:06.217254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"81'2","reported_seq":26,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.497341+0000","last_change":"2024-09-19T04:29:00.505162+0000","last_active":"2024-09-19T04:30:46.497341+0000","last_peered":"2024-09-19T04:30:46.497341+0000","last_clean":"2024-09-19T04:30:46.497341+0000","last_became_active":"2024-09-19T04:29:00.504584+0000","last_became_peered":"2024-09-19T04:29:00.504584+0000","last_unstale":"2024-09-19T04:30:46.497341+0000","last_undegraded":"2024-09-19T04:30:46.497341+0000","last_fullsized":"2024-09-19T04:30:46.497341+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T09:23:44.030010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"84'5","reported_seq":24,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.531611+0000","last_change":"2024-09-19T04:29:02.415095+0000","last_active":"2024-09-19T04:30:46.531611+0000","last_peered":"2024-09-19T04:30:46.531611+0000","last_clean":"2024-09-19T04:30:46.531611+0000","last_became_active":"2024-09-19T04:29:02.414576+0000","last_became_peered":"2024-09-19T04:29:02.414576+0000","last_unstale":"2024-09-19T04:30:46.531611+0000","last_undegraded":"2024-09-19T04:30:46.531611+0000","last_fullsized":"2024-09-19T04:30:46.531611+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:29:01.381083+0000","last_clean_scrub_stamp":"2024-09-19T04:29:01.381083+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:55:52.744011+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5],"acting":[3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"81'9","reported_seq":34,"reported_epoch":84,"state":"active+clean","last_fresh":"2024-09-19T04:30:46.503839+0000","last_change":"2024-09-19T04:29:00.397737+0000","last_active":"2024-09-19T04:30:46.503839+0000","last_peered":"2024-09-19T04:30:46.503839+0000","last_clean":"2024-09-19T04:30:46.503839+0000","last_became_active":"2024-09-19T04:29:00.397397+0000","last_became_peered":"2024-09-19T04:29:00.397397+0000","last_unstale":"2024-09-19T04:30:46.503839+0000","last_undegraded":"2024-09-19T04:30:46.503839+0000","last_fullsized":"2024-09-19T04:30:46.503839+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T04:28:59.369960+0000","last_clean_scrub_stamp":"2024-09-19T04:28:59.369960+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T04:49:16.108744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":502,"ondisk_log_size":502,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":597916,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":728,"num_read_kb":472,"num_write":295,"num_write_kb":1440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":22,"num_keys_recovered":0,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2015232,"data_stored":1793748,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":230,"ondisk_log_size":230,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547235,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32092,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713060,"statfs":{"total":95995035648,"available":95962173440,"internally_reserved":0,"allocated":925696,"data_stored":449853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":67,"seq":287762808871,"num_pgs":26,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":33020,"kb_used_data":1716,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712132,"statfs":{"total":95995035648,"available":95961223168,"internally_reserved":0,"allocated":1757184,"data_stored":1240728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":31914432},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":62,"seq":266287972396,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28328,"kb_used_data":1300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716824,"statfs":{"total":95995035648,"available":95966027776,"internally_reserved":0,"allocated":1331200,"data_stored":843283,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,6,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":55,"seq":236223201330,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28324,"kb_used_data":1296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716828,"statfs":{"total":95995035648,"available":95966031872,"internally_reserved":0,"allocated":1327104,"data_stored":843181,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":48,"seq":206158430263,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28520,"kb_used_data":1496,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716632,"statfs":{"total":95995035648,"available":95965831168,"internally_reserved":0,"allocated":1531904,"data_stored":1045015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1589,"internal_metadata":27654603},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":43,"seq":184683593787,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27932,"kb_used_data":904,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717220,"statfs":{"total":95995035648,"available":95966433280,"internally_reserved":0,"allocated":925696,"data_stored":449456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822720,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28664,"kb_used_data":1640,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716488,"statfs":{"total":95995035648,"available":95965683712,"internally_reserved":0,"allocated":1679360,"data_stored":1174484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":32,"seq":137438953542,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32096,"kb_used_data":908,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93713056,"statfs":{"total":95995035648,"available":95962169344,"internally_reserved":0,"allocated":929792,"data_stored":451708,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":25,"seq":107374182475,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40940,"kb_used_data":1436,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704212,"statfs":{"total":95995035648,"available":95953113088,"internally_reserved":0,"allocated":1470464,"data_stored":974583,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411408,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28016,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717136,"statfs":{"total":95995035648,"available":95966347264,"internally_reserved":0,"allocated":1015808,"data_stored":518274,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574933,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":27996,"kb_used_data":968,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717156,"statfs":{"total":95995035648,"available":95966367744,"internally_reserved":0,"allocated":991232,"data_stored":515250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738458,"num_pgs":25,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":40432,"kb_used_data":924,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":93704720,"statfs":{"total":95995035648,"available":95953633280,"internally_reserved":0,"allocated":946176,"data_stored":450727,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":66001,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":69025,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":2459,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":134750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":5281,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":409600,"data_stored":393932,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":241664,"data_stored":200994,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":234,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":117,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T04:30:52.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:30:53.135 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:53.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 -- 172.21.15.70:0/3976192651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102ef0 msgr2=0x7f08b410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:53.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3976192651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102ef0 0x7f08b410da40 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f08a4009900 tx=0x7f08a402a480 comp rx=0 tx=0).stop 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 -- 172.21.15.70:0/3976192651 shutdown_connections 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3976192651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102ef0 0x7f08b410da40 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3976192651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b4102570 0x7f08b41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3976192651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4100e20 0x7f08b4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 -- 172.21.15.70:0/3976192651 >> 172.21.15.70:0/3976192651 conn(0x7f08b40fc7d0 msgr2=0x7f08b40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 -- 172.21.15.70:0/3976192651 shutdown_connections 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 -- 172.21.15.70:0/3976192651 wait complete. 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.565+0000 7f08b9f99640 1 Processor -- start 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b9f99640 1 -- start start 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b9f99640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b4100e20 0x7f08b4198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b9f99640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102570 0x7f08b4198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:53.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b9f99640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102ef0 0x7f08b419ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b9f99640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4110f90 con 0x7f08b4102570 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b9f99640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4110e10 con 0x7f08b4100e20 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b9f99640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f08b4111110 con 0x7f08b4102ef0 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102570 0x7f08b4198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102570 0x7f08b4198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36962/0 (socket says 172.21.15.70:36962) 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b2ffd640 1 -- 172.21.15.70:0/3939125983 learned_addr learned my addr 172.21.15.70:0/3939125983 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b3fff640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102ef0 0x7f08b419ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b37fe640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b4100e20 0x7f08b4198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b2ffd640 1 -- 172.21.15.70:0/3939125983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102ef0 msgr2=0x7f08b419ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b2ffd640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102ef0 0x7f08b419ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b2ffd640 1 -- 172.21.15.70:0/3939125983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b4100e20 msgr2=0x7f08b4198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:53.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b2ffd640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b4100e20 0x7f08b4198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b2ffd640 1 -- 172.21.15.70:0/3939125983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08b419d5b0 con 0x7f08b4102570 2024-09-19T04:30:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.566+0000 7f08b3fff640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102ef0 0x7f08b419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.567+0000 7f08b2ffd640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102570 0x7f08b4198b40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f089c00b4a0 tx=0x7f089c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.567+0000 7f08b0ff9640 1 -- 172.21.15.70:0/3939125983 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c014070 con 0x7f08b4102570 2024-09-19T04:30:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.567+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08b419d8a0 con 0x7f08b4102570 2024-09-19T04:30:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.567+0000 7f08b0ff9640 1 -- 172.21.15.70:0/3939125983 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f089c010ae0 con 0x7f08b4102570 2024-09-19T04:30:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.567+0000 7f08b0ff9640 1 -- 172.21.15.70:0/3939125983 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f089c017c70 con 0x7f08b4102570 2024-09-19T04:30:53.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.567+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08b41a5180 con 0x7f08b4102570 2024-09-19T04:30:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.568+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f08b4101200 con 0x7f08b4102570 2024-09-19T04:30:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.569+0000 7f08b0ff9640 1 -- 172.21.15.70:0/3939125983 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f089c017070 con 0x7f08b4102570 2024-09-19T04:30:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.570+0000 7f08b0ff9640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08a00a34d0 0x7f08a00a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.570+0000 7f08b37fe640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08a00a34d0 0x7f08a00a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.570+0000 7f08b0ff9640 1 -- 172.21.15.70:0/3939125983 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f089c0cfa30 con 0x7f08b4102570 2024-09-19T04:30:53.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.570+0000 7f08b37fe640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08a00a34d0 0x7f08a00a5990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f08ac005c40 tx=0x7f08ac008230 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:53.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.573+0000 7f08b0ff9640 1 -- 172.21.15.70:0/3939125983 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f089c09c2f0 con 0x7f08b4102570 2024-09-19T04:30:53.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.775+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08b4199960 con 0x7f08b4102570 2024-09-19T04:30:53.778 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:53 smithi070 ceph-mon[30942]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:53.778 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:53 smithi070 ceph-mon[30942]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:53.778 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:53 smithi070 ceph-mon[30942]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.4 KiB/s wr, 31 op/s 2024-09-19T04:30:53.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.776+0000 7f08b0ff9640 1 -- 172.21.15.70:0/3939125983 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11914 (secure 0 0 0) 0x7f08b4199960 con 0x7f08b4102570 2024-09-19T04:30:53.779 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:53.779 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"btime":"2024-09-19T04:30:48:492398+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:30:48.082662+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:30:53.779 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-09-19T04:30:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.778+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08a00a34d0 msgr2=0x7f08a00a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.778+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08a00a34d0 0x7f08a00a5990 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f08ac005c40 tx=0x7f08ac008230 comp rx=0 tx=0).stop 2024-09-19T04:30:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.778+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102570 msgr2=0x7f08b4198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.778+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102570 0x7f08b4198b40 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f089c00b4a0 tx=0x7f089c00b960 comp rx=0 tx=0).stop 2024-09-19T04:30:53.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.779+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 shutdown_connections 2024-09-19T04:30:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.779+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08a00a34d0 0x7f08a00a5990 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.779+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08b4102ef0 0x7f08b419ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.779+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08b4102570 0x7f08b4198b40 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.779+0000 7f08b9f99640 1 --2- 172.21.15.70:0/3939125983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08b4100e20 0x7f08b4198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.779+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 >> 172.21.15.70:0/3939125983 conn(0x7f08b40fc7d0 msgr2=0x7f08b406a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.779+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 shutdown_connections 2024-09-19T04:30:53.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:53.779+0000 7f08b9f99640 1 -- 172.21.15.70:0/3939125983 wait complete. 2024-09-19T04:30:53.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:53 smithi134 ceph-mon[34525]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:53.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:53 smithi134 ceph-mon[34525]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:53.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:53 smithi134 ceph-mon[34525]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.4 KiB/s wr, 31 op/s 2024-09-19T04:30:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:53 smithi167 ceph-mon[34339]: from='client.15246 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:53 smithi167 ceph-mon[34339]: from='client.15252 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:53.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:53 smithi167 ceph-mon[34339]: pgmap v6: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 47 KiB/s rd, 1.4 KiB/s wr, 31 op/s 2024-09-19T04:30:54.478 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:30:54.725 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:54.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:54 smithi134 ceph-mon[34525]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:54.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:54 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3939125983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:54.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:54 smithi070 ceph-mon[30942]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:54.845 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:54 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3939125983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:54.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:54 smithi167 ceph-mon[34339]: from='client.15258 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-09-19T04:30:54.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:54 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3939125983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:30:55.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 -- 172.21.15.70:0/211453765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 msgr2=0x7f0494101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 --2- 172.21.15.70:0/211453765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 0x7f0494101200 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f0484009900 tx=0x7f048402a480 comp rx=0 tx=0).stop 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 -- 172.21.15.70:0/211453765 shutdown_connections 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 --2- 172.21.15.70:0/211453765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494102ef0 0x7f049410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 --2- 172.21.15.70:0/211453765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0494102570 0x7f04941029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 --2- 172.21.15.70:0/211453765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 0x7f0494101200 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 -- 172.21.15.70:0/211453765 >> 172.21.15.70:0/211453765 conn(0x7f04940fc7d0 msgr2=0x7f04940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 -- 172.21.15.70:0/211453765 shutdown_connections 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 -- 172.21.15.70:0/211453765 wait complete. 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 Processor -- start 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.177+0000 7f049a620640 1 -- start start 2024-09-19T04:30:55.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f049a620640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 0x7f0494103bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f049a620640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494102570 0x7f0494104100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f049a620640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0494102ef0 0x7f0494104640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f049a620640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0494110f50 con 0x7f0494100e20 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f049a620640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0494110dd0 con 0x7f0494102ef0 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f049a620640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f04941110d0 con 0x7f0494102570 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0493fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 0x7f0494103bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0493fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 0x7f0494103bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36990/0 (socket says 172.21.15.70:36990) 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0493fff640 1 -- 172.21.15.70:0/3170915340 learned_addr learned my addr 172.21.15.70:0/3170915340 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f04937fe640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494102570 0x7f0494104100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0498bbd640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0494102ef0 0x7f0494104640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0493fff640 1 -- 172.21.15.70:0/3170915340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494102570 msgr2=0x7f0494104100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0493fff640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494102570 0x7f0494104100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0493fff640 1 -- 172.21.15.70:0/3170915340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0494102ef0 msgr2=0x7f0494104640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:55.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0493fff640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0494102ef0 0x7f0494104640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0493fff640 1 -- 172.21.15.70:0/3170915340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04941a6940 con 0x7f0494100e20 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.178+0000 7f0498bbd640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0494102ef0 0x7f0494104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.179+0000 7f0493fff640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 0x7f0494103bc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0484004770 tx=0x7f04840042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.179+0000 7f04917fa640 1 -- 172.21.15.70:0/3170915340 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f048403f030 con 0x7f0494100e20 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.179+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04941a6bd0 con 0x7f0494100e20 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.179+0000 7f04917fa640 1 -- 172.21.15.70:0/3170915340 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0484003ac0 con 0x7f0494100e20 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.179+0000 7f04917fa640 1 -- 172.21.15.70:0/3170915340 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0484035070 con 0x7f0494100e20 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.179+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f04941a70b0 con 0x7f0494100e20 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.180+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0494101200 con 0x7f0494100e20 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.181+0000 7f04917fa640 1 -- 172.21.15.70:0/3170915340 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f0484042030 con 0x7f0494100e20 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.182+0000 7f04917fa640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f047c0a34d0 0x7f047c0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:55.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.182+0000 7f04937fe640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f047c0a34d0 0x7f047c0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:55.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.182+0000 7f04917fa640 1 -- 172.21.15.70:0/3170915340 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f04840f0b20 con 0x7f0494100e20 2024-09-19T04:30:55.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.182+0000 7f04937fe640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f047c0a34d0 0x7f047c0a5990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0488005fd0 tx=0x7f0488005850 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:55.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.189+0000 7f04917fa640 1 -- 172.21.15.70:0/3170915340 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f04840bd3a0 con 0x7f0494100e20 2024-09-19T04:30:55.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.366+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f04941a7280 con 0x7f0494100e20 2024-09-19T04:30:55.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.368+0000 7f04917fa640 1 -- 172.21.15.70:0/3170915340 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v84) ==== 74+0+23117 (secure 0 0 0) 0x7f04840bcca0 con 0x7f0494100e20 2024-09-19T04:30:55.370 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:30:55.370 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":84,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:30:46.485035+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/4212188848":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/3933277587":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/544441745":"2024-09-20T04:30:46.484972+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/999804527":"2024-09-20T04:30:46.484972+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/4212188848":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/2420707462":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/3999565316":"2024-09-20T04:30:46.484972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f047c0a34d0 msgr2=0x7f047c0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f047c0a34d0 0x7f047c0a5990 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f0488005fd0 tx=0x7f0488005850 comp rx=0 tx=0).stop 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 msgr2=0x7f0494103bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 0x7f0494103bc0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f0484004770 tx=0x7f04840042f0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 shutdown_connections 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f047c0a34d0 0x7f047c0a5990 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0494102ef0 0x7f0494104640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0494102570 0x7f0494104100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 --2- 172.21.15.70:0/3170915340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0494100e20 0x7f0494103bc0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 >> 172.21.15.70:0/3170915340 conn(0x7f04940fc7d0 msgr2=0x7f0494105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 shutdown_connections 2024-09-19T04:30:55.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:55.370+0000 7f049a620640 1 -- 172.21.15.70:0/3170915340 wait complete. 2024-09-19T04:30:55.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:55 smithi070 ceph-mon[30942]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1023 B/s wr, 22 op/s 2024-09-19T04:30:55.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:55 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3170915340' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:55.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:55 smithi134 ceph-mon[34525]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1023 B/s wr, 22 op/s 2024-09-19T04:30:55.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:55 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3170915340' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:55.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:55 smithi167 ceph-mon[34339]: pgmap v7: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 1023 B/s wr, 22 op/s 2024-09-19T04:30:55.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:55 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3170915340' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:30:56.137 DEBUG:tasks.fwd_scrub:Yielding 2024-09-19T04:30:56.137 INFO:teuthology.run_tasks:Running task exec... 2024-09-19T04:30:56.149 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T04:30:56.149 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:30:56.149 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-09-19T04:30:56.149 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-09-19T04:30:56.150 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:30:56.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:30:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 -- 172.21.15.70:0/746493317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d81035a0 msgr2=0x7f94d810ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 --2- 172.21.15.70:0/746493317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d81035a0 0x7f94d810ba80 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f94c8009900 tx=0x7f94c802a480 comp rx=0 tx=0).stop 2024-09-19T04:30:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 -- 172.21.15.70:0/746493317 shutdown_connections 2024-09-19T04:30:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 --2- 172.21.15.70:0/746493317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d810c0d0 0x7f94d810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 --2- 172.21.15.70:0/746493317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d81035a0 0x7f94d810ba80 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 --2- 172.21.15.70:0/746493317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d8102c80 0x7f94d8103060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 -- 172.21.15.70:0/746493317 >> 172.21.15.70:0/746493317 conn(0x7f94d8077990 msgr2=0x7f94d80fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 -- 172.21.15.70:0/746493317 shutdown_connections 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.253+0000 7f94df5df640 1 -- 172.21.15.70:0/746493317 wait complete. 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94df5df640 1 Processor -- start 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94df5df640 1 -- start start 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94df5df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8102c80 0x7f94d81008d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94df5df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d81035a0 0x7f94d8100e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94df5df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d810c0d0 0x7f94d8101350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94df5df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8111e80 con 0x7f94d8102c80 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94df5df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8111d00 con 0x7f94d81035a0 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94df5df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f94d8112000 con 0x7f94d810c0d0 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dd37b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8102c80 0x7f94d81008d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dd37b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8102c80 0x7f94d81008d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37014/0 (socket says 172.21.15.70:37014) 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dd37b640 1 -- 172.21.15.70:0/1090441043 learned_addr learned my addr 172.21.15.70:0/1090441043 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94ddb7c640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d810c0d0 0x7f94d8101350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dcb7a640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d81035a0 0x7f94d8100e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dd37b640 1 -- 172.21.15.70:0/1090441043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d810c0d0 msgr2=0x7f94d8101350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dd37b640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d810c0d0 0x7f94d8101350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dd37b640 1 -- 172.21.15.70:0/1090441043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d81035a0 msgr2=0x7f94d8100e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dd37b640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d81035a0 0x7f94d8100e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.254+0000 7f94dd37b640 1 -- 172.21.15.70:0/1090441043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f94d81a6850 con 0x7f94d8102c80 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.255+0000 7f94dd37b640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8102c80 0x7f94d81008d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f94d400d770 tx=0x7f94d400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.255+0000 7f94ce7fc640 1 -- 172.21.15.70:0/1090441043 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4017070 con 0x7f94d8102c80 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.255+0000 7f94ce7fc640 1 -- 172.21.15.70:0/1090441043 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f94d40054f0 con 0x7f94d8102c80 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.255+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f94d81a6b40 con 0x7f94d8102c80 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.255+0000 7f94ce7fc640 1 -- 172.21.15.70:0/1090441043 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f94d4004d60 con 0x7f94d8102c80 2024-09-19T04:30:56.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.255+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f94d81a7010 con 0x7f94d8102c80 2024-09-19T04:30:56.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.256+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f94d8103060 con 0x7f94d8102c80 2024-09-19T04:30:56.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.257+0000 7f94ce7fc640 1 -- 172.21.15.70:0/1090441043 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f94d4004f00 con 0x7f94d8102c80 2024-09-19T04:30:56.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.258+0000 7f94ce7fc640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f94c40a3580 0x7f94c40a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.258+0000 7f94dcb7a640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f94c40a3580 0x7f94c40a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.258+0000 7f94ce7fc640 1 -- 172.21.15.70:0/1090441043 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f94d40cf9b0 con 0x7f94d8102c80 2024-09-19T04:30:56.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.258+0000 7f94dcb7a640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f94c40a3580 0x7f94c40a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f94c8006010 tx=0x7f94c80058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.262+0000 7f94ce7fc640 1 -- 172.21.15.70:0/1090441043 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f94d409bb10 con 0x7f94d8102c80 2024-09-19T04:30:56.417 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:56.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.474+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f94d81a7250 con 0x7f94d8102c80 2024-09-19T04:30:56.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.477+0000 7f94ce7fc640 1 -- 172.21.15.70:0/1090441043 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7f94d409fe10 con 0x7f94d8102c80 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f94c40a3580 msgr2=0x7f94c40a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f94c40a3580 0x7f94c40a5a40 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f94c8006010 tx=0x7f94c80058d0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8102c80 msgr2=0x7f94d81008d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8102c80 0x7f94d81008d0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f94d400d770 tx=0x7f94d400dc30 comp rx=0 tx=0).stop 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 shutdown_connections 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f94c40a3580 0x7f94c40a5a40 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f94d810c0d0 0x7f94d8101350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94d81035a0 0x7f94d8100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 --2- 172.21.15.70:0/1090441043 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f94d8102c80 0x7f94d81008d0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 >> 172.21.15.70:0/1090441043 conn(0x7f94d8077990 msgr2=0x7f94d80fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 shutdown_connections 2024-09-19T04:30:56.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.480+0000 7f94df5df640 1 -- 172.21.15.70:0/1090441043 wait complete. 2024-09-19T04:30:56.494 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-09-19T04:30:56.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.596+0000 7f6080b11640 1 -- 172.21.15.70:0/1311852529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c101370 msgr2=0x7f607c10d8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.596+0000 7f6080b11640 1 --2- 172.21.15.70:0/1311852529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c101370 0x7f607c10d8a0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f6074009930 tx=0x7f607402a420 comp rx=0 tx=0).stop 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 -- 172.21.15.70:0/1311852529 shutdown_connections 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 --2- 172.21.15.70:0/1311852529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c101370 0x7f607c10d8a0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 --2- 172.21.15.70:0/1311852529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c1009d0 0x7f607c100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 --2- 172.21.15.70:0/1311852529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c1069e0 0x7f607c106dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 -- 172.21.15.70:0/1311852529 >> 172.21.15.70:0/1311852529 conn(0x7f607c0fc6b0 msgr2=0x7f607c0fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 -- 172.21.15.70:0/1311852529 shutdown_connections 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 -- 172.21.15.70:0/1311852529 wait complete. 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 Processor -- start 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 -- start start 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c1009d0 0x7f607c199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.597+0000 7f6080b11640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c101370 0x7f607c1996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f6080b11640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c1069e0 0x7f607c1a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f6080b11640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f607c110df0 con 0x7f607c1069e0 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f6080b11640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f607c110c70 con 0x7f607c1009d0 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f6080b11640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f607c110f70 con 0x7f607c101370 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c1069e0 0x7f607c1a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c1069e0 0x7f607c1a41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37040/0 (socket says 172.21.15.70:37040) 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 -- 172.21.15.70:0/2810532724 learned_addr learned my addr 172.21.15.70:0/2810532724 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607a59c640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c1009d0 0x7f607c199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f6079d9b640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c101370 0x7f607c1996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 -- 172.21.15.70:0/2810532724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c101370 msgr2=0x7f607c1996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c101370 0x7f607c1996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 -- 172.21.15.70:0/2810532724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c1009d0 msgr2=0x7f607c199160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c1009d0 0x7f607c199160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 -- 172.21.15.70:0/2810532724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f607c1a4720 con 0x7f607c1069e0 2024-09-19T04:30:56.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f607ad9d640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c1069e0 0x7f607c1a41e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6074005940 tx=0x7f60740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f606b7fe640 1 -- 172.21.15.70:0/2810532724 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f607403f030 con 0x7f607c1069e0 2024-09-19T04:30:56.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f606b7fe640 1 -- 172.21.15.70:0/2810532724 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6074003ac0 con 0x7f607c1069e0 2024-09-19T04:30:56.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f606b7fe640 1 -- 172.21.15.70:0/2810532724 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6074035070 con 0x7f607c1069e0 2024-09-19T04:30:56.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f607c1a48f0 con 0x7f607c1069e0 2024-09-19T04:30:56.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.598+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f607c1a4db0 con 0x7f607c1069e0 2024-09-19T04:30:56.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.599+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f607c100e30 con 0x7f607c1069e0 2024-09-19T04:30:56.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.600+0000 7f606b7fe640 1 -- 172.21.15.70:0/2810532724 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f6074042030 con 0x7f607c1069e0 2024-09-19T04:30:56.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.601+0000 7f606b7fe640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60640a3600 0x7f60640a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.601+0000 7f607a59c640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60640a3600 0x7f60640a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.601+0000 7f606b7fe640 1 -- 172.21.15.70:0/2810532724 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f60740f0250 con 0x7f607c1069e0 2024-09-19T04:30:56.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.602+0000 7f607a59c640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60640a3600 0x7f60640a5ac0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f606c005fd0 tx=0x7f606c009760 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.605+0000 7f606b7fe640 1 -- 172.21.15.70:0/2810532724 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f60740bc480 con 0x7f607c1069e0 2024-09-19T04:30:56.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.796+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7f607c1a4f80 con 0x7f607c1069e0 2024-09-19T04:30:56.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.800+0000 7f606b7fe640 1 -- 172.21.15.70:0/2810532724 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7f60740c0780 con 0x7f607c1069e0 2024-09-19T04:30:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.802+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60640a3600 msgr2=0x7f60640a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.802+0000 7f6080b11640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60640a3600 0x7f60640a5ac0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f606c005fd0 tx=0x7f606c009760 comp rx=0 tx=0).stop 2024-09-19T04:30:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.802+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c1069e0 msgr2=0x7f607c1a41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.802+0000 7f6080b11640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c1069e0 0x7f607c1a41e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f6074005940 tx=0x7f60740042f0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.802+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 shutdown_connections 2024-09-19T04:30:56.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.802+0000 7f6080b11640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60640a3600 0x7f60640a5ac0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.802+0000 7f6080b11640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f607c1069e0 0x7f607c1a41e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.802+0000 7f6080b11640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f607c101370 0x7f607c1996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.803+0000 7f6080b11640 1 --2- 172.21.15.70:0/2810532724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f607c1009d0 0x7f607c199160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.803+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 >> 172.21.15.70:0/2810532724 conn(0x7f607c0fc6b0 msgr2=0x7f607c0fcdc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.803+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 shutdown_connections 2024-09-19T04:30:56.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.803+0000 7f6080b11640 1 -- 172.21.15.70:0/2810532724 wait complete. 2024-09-19T04:30:56.816 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-09-19T04:30:56.924 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 -- 172.21.15.70:0/540182066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e0100830 msgr2=0x7f72e0100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 --2- 172.21.15.70:0/540182066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e0100830 0x7f72e0100c10 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f72dc009930 tx=0x7f72dc02a4d0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 -- 172.21.15.70:0/540182066 shutdown_connections 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 --2- 172.21.15.70:0/540182066 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72e01080f0 0x7f72e010ea40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 --2- 172.21.15.70:0/540182066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e0101150 0x7f72e0107990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 --2- 172.21.15.70:0/540182066 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e0100830 0x7f72e0100c10 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 -- 172.21.15.70:0/540182066 >> 172.21.15.70:0/540182066 conn(0x7f72e0075f20 msgr2=0x7f72e0076330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 -- 172.21.15.70:0/540182066 shutdown_connections 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.921+0000 7f72e8752640 1 -- 172.21.15.70:0/540182066 wait complete. 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e8752640 1 Processor -- start 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e8752640 1 -- start start 2024-09-19T04:30:56.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e8752640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72e0100830 0x7f72e01983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e8752640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e0101150 0x7f72e01988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e8752640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e01080f0 0x7f72e019cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e8752640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f72e0111ef0 con 0x7f72e01080f0 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e8752640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f72e0111d70 con 0x7f72e0101150 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e8752640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f72e0112070 con 0x7f72e0100830 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e01080f0 0x7f72e019cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e01080f0 0x7f72e019cc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37058/0 (socket says 172.21.15.70:37058) 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 -- 172.21.15.70:0/2723660778 learned_addr learned my addr 172.21.15.70:0/2723660778 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e64ee640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72e0100830 0x7f72e01983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e5ced640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e0101150 0x7f72e01988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 -- 172.21.15.70:0/2723660778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72e0100830 msgr2=0x7f72e01983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72e0100830 0x7f72e01983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 -- 172.21.15.70:0/2723660778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e0101150 msgr2=0x7f72e01988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e0101150 0x7f72e01988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 -- 172.21.15.70:0/2723660778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f72e019d390 con 0x7f72e01080f0 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.922+0000 7f72e6cef640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e01080f0 0x7f72e019cc60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f72d800eaa0 tx=0x7f72d800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.923+0000 7f72d77fe640 1 -- 172.21.15.70:0/2723660778 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d800cdb0 con 0x7f72e01080f0 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.923+0000 7f72d77fe640 1 -- 172.21.15.70:0/2723660778 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f72d8005020 con 0x7f72e01080f0 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.923+0000 7f72d77fe640 1 -- 172.21.15.70:0/2723660778 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f72d80116b0 con 0x7f72e01080f0 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.923+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f72e019d680 con 0x7f72e01080f0 2024-09-19T04:30:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.923+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f72e01a4f10 con 0x7f72e01080f0 2024-09-19T04:30:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.924+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f72e0100c10 con 0x7f72e01080f0 2024-09-19T04:30:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.925+0000 7f72d77fe640 1 -- 172.21.15.70:0/2723660778 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f72d80051d0 con 0x7f72e01080f0 2024-09-19T04:30:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.926+0000 7f72d77fe640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f72cc0a3600 0x7f72cc0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.926+0000 7f72e64ee640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f72cc0a3600 0x7f72cc0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.926+0000 7f72d77fe640 1 -- 172.21.15.70:0/2723660778 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f72d80d04e0 con 0x7f72e01080f0 2024-09-19T04:30:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.927+0000 7f72e64ee640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f72cc0a3600 0x7f72cc0a5ac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0314b0 tx=0x7f72dc0058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.929+0000 7f72d77fe640 1 -- 172.21.15.70:0/2723660778 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f72d8016030 con 0x7f72e01080f0 2024-09-19T04:30:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 -- 172.21.15.70:0/10072978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced0102db0 msgr2=0x7fced0103190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 --2- 172.21.15.70:0/10072978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced0102db0 0x7fced0103190 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fcec0009930 tx=0x7fcec002a420 comp rx=0 tx=0).stop 2024-09-19T04:30:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 -- 172.21.15.70:0/10072978 shutdown_connections 2024-09-19T04:30:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 --2- 172.21.15.70:0/10072978 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced01082e0 0x7fced010ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 --2- 172.21.15.70:0/10072978 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fced0103760 0x7fced0107ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 --2- 172.21.15.70:0/10072978 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced0102db0 0x7fced0103190 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 -- 172.21.15.70:0/10072978 >> 172.21.15.70:0/10072978 conn(0x7fced00fc7d0 msgr2=0x7fced00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 -- 172.21.15.70:0/10072978 shutdown_connections 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.950+0000 7fced699b640 1 -- 172.21.15.70:0/10072978 wait complete. 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.951+0000 7fced699b640 1 Processor -- start 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.951+0000 7fced699b640 1 -- start start 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.951+0000 7fced699b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fced0102db0 0x7fced0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.951+0000 7fced699b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced0103760 0x7fced0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.951+0000 7fced699b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced01082e0 0x7fced019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.951+0000 7fced699b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fced0112080 con 0x7fced01082e0 2024-09-19T04:30:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.951+0000 7fced699b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fced0111f00 con 0x7fced0103760 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.951+0000 7fced699b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fced0112200 con 0x7fced0102db0 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced01082e0 0x7fced019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced01082e0 0x7fced019ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37074/0 (socket says 172.21.15.70:37074) 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 -- 172.21.15.70:0/544433388 learned_addr learned my addr 172.21.15.70:0/544433388 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced0103760 0x7fced0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fcecffff640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fced0102db0 0x7fced0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 -- 172.21.15.70:0/544433388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fced0102db0 msgr2=0x7fced0198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fced0102db0 0x7fced0198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 -- 172.21.15.70:0/544433388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced0103760 msgr2=0x7fced0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced0103760 0x7fced0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 -- 172.21.15.70:0/544433388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced019d530 con 0x7fced01082e0 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced4f38640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced01082e0 0x7fced019ce50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcec800eaa0 tx=0x7fcec800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fcecd7fa640 1 -- 172.21.15.70:0/544433388 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800cdb0 con 0x7fced01082e0 2024-09-19T04:30:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced699b640 1 -- 172.21.15.70:0/544433388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced019d820 con 0x7fced01082e0 2024-09-19T04:30:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fcecd7fa640 1 -- 172.21.15.70:0/544433388 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcec8005020 con 0x7fced01082e0 2024-09-19T04:30:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fcecd7fa640 1 -- 172.21.15.70:0/544433388 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec80116b0 con 0x7fced01082e0 2024-09-19T04:30:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.952+0000 7fced699b640 1 -- 172.21.15.70:0/544433388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced01a5100 con 0x7fced01082e0 2024-09-19T04:30:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fcecd7fa640 1 -- 172.21.15.70:0/544433388 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fcec80051d0 con 0x7fced01082e0 2024-09-19T04:30:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fced8d74740 1 Processor -- start 2024-09-19T04:30:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fced8d74740 1 -- start start 2024-09-19T04:30:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fced8d74740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a46fa20 0x55b65a46fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fced8d74740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a470340 0x55b65a47ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fced8d74740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a47f150 0x55b65a481540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fced8d74740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b65a3d5280 con 0x55b65a470340 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fced8d74740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b65a37cb10 con 0x55b65a46fa20 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fced8d74740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b65a3d1240 con 0x55b65a47f150 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fcecf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a46fa20 0x55b65a46fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fcecffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a470340 0x55b65a47ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fcecf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a46fa20 0x55b65a46fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:53240/0 (socket says 172.21.15.70:53240) 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fcecf7fe640 1 -- 172.21.15.70:0/2608420689 learned_addr learned my addr 172.21.15.70:0/2608420689 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.955+0000 7fcecd7fa640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceb80a3550 0x7fceb80a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/2608420689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a47f150 0x55b65a481540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fced4f38640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceb80a3550 0x7fceb80a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fcecf7fe640 1 -- 172.21.15.70:0/2608420689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a47f150 msgr2=0x55b65a481540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/2608420689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a47f150 0x55b65a481540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fcecf7fe640 1 -- 172.21.15.70:0/2608420689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a470340 msgr2=0x55b65a47ec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/2608420689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a470340 0x55b65a47ec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fcecf7fe640 1 -- 172.21.15.70:0/2608420689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b65a3891f0 con 0x55b65a46fa20 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fcecd7fa640 1 -- 172.21.15.70:0/544433388 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fcec80d0130 con 0x7fced01082e0 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/2608420689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a46fa20 0x55b65a46fe00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcec40116b0 tx=0x7fcec400a640 comp rx=0 tx=0).ready entity=mon.2 client_cookie=47d85183763f2ace server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fced4f38640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceb80a3550 0x7fceb80a5a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcec80cd780 tx=0x7fcec80a0040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fceb67fc640 1 -- 172.21.15.70:0/2608420689 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4004020 con 0x55b65a46fa20 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fceb67fc640 1 -- 172.21.15.70:0/2608420689 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcec40054f0 con 0x55b65a46fa20 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.956+0000 7fceb67fc640 1 -- 172.21.15.70:0/2608420689 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4004d60 con 0x55b65a46fa20 2024-09-19T04:30:56.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 -- 172.21.15.70:0/2608420689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a46fa20 msgr2=0x55b65a46fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 --2- 172.21.15.70:0/2608420689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a46fa20 0x55b65a46fe00 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fcec40116b0 tx=0x7fcec400a640 comp rx=0 tx=0).stop 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 -- 172.21.15.70:0/2608420689 shutdown_connections 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 --2- 172.21.15.70:0/2608420689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a47f150 0x55b65a481540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 --2- 172.21.15.70:0/2608420689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a470340 0x55b65a47ec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 --2- 172.21.15.70:0/2608420689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a46fa20 0x55b65a46fe00 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 -- 172.21.15.70:0/2608420689 >> 172.21.15.70:0/2608420689 conn(0x55b65a46c0f0 msgr2=0x55b65a46c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 -- 172.21.15.70:0/2608420689 shutdown_connections 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 -- 172.21.15.70:0/2608420689 wait complete. 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.957+0000 7fced8d74740 1 -- start start 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fced8d74740 1 Processor -- start 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fced8d74740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 0x55b65a47c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fced8d74740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a47c610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fced8d74740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a47cb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fced8d74740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b65a481d20 con 0x55b65a47f150 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fced8d74740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b65a38ff10 con 0x55b65a470340 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fced8d74740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b65a481ea0 con 0x55b65a46fa20 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fced8d74740 10 client.0 _ll_register_callbacks cb 0x55b65a358a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a47cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a47cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37102/0 (socket says 172.21.15.70:37102) 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 -- 172.21.15.70:0/3861080536 learned_addr learned my addr 172.21.15.70:0/3861080536 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 0x55b65a47c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecffff640 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a47c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 -- 172.21.15.70:0/3861080536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 msgr2=0x55b65a47c0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 0x55b65a47c0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 -- 172.21.15.70:0/3861080536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 msgr2=0x55b65a47c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:56.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a47c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.958+0000 7fcecf7fe640 1 -- 172.21.15.70:0/3861080536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b65a1466a0 con 0x55b65a47f150 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.959+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a47cb50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcec4004a40 tx=0x7fcec4013040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b01b2e62d09ad373 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.959+0000 7fceaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.959+0000 7fceaf7fe640 1 -- 172.21.15.70:0/3861080536 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec4005150 con 0x55b65a47f150 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.959+0000 7fceaf7fe640 1 -- 172.21.15.70:0/3861080536 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fcec40052f0 con 0x55b65a47f150 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.959+0000 7fced8d74740 1 -- 172.21.15.70:0/3861080536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec40054f0 con 0x55b65a47f150 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.959+0000 7fceaf7fe640 1 -- 172.21.15.70:0/3861080536 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcec400f600 con 0x55b65a47f150 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.959+0000 7fced8d74740 10 client.15300 fetch_fsmap learned FSMap version 24 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.959+0000 7fced8d74740 1 -- 172.21.15.70:0/3861080536 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b65a48da10 con 0x55b65a47f150 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fceaf7fe640 1 -- 172.21.15.70:0/3861080536 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcec40054f0 con 0x55b65a47f150 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fceaf7fe640 1 -- 172.21.15.70:0/3861080536 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcec401e800 con 0x55b65a47f150 2024-09-19T04:30:56.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fced8d74740 10 client.15300 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:30:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fced8d74740 10 client.15300 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:30:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fced8d74740 20 client.15300 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fced8d74740 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b65a48ed60 0x55b65a491150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fced8d74740 4 client.15300 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:30:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fced8d74740 1 -- 172.21.15.70:0/3861080536 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b65a3e27f0 con 0x55b65a48ed60 2024-09-19T04:30:56.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fcecffff640 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b65a48ed60 0x55b65a491150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fceaf7fe640 10 client.15300 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.960+0000 7fcecffff640 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b65a48ed60 0x55b65a491150 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9017d10356d994dc server_cookie=1bff20e9a597a003 in_seq=0 out_seq=0 2024-09-19T04:30:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fceaf7fe640 1 -- 172.21.15.70:0/3861080536 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b65a3e27f0 con 0x55b65a48ed60 2024-09-19T04:30:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fceaf7fe640 10 client.15300 handle_command_reply: tid=0 2024-09-19T04:30:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 client.15300 shutdown 2024-09-19T04:30:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 -- 172.21.15.70:0/3861080536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 msgr2=0x55b65a47cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a47cb50 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fcec4004a40 tx=0x7fcec4013040 comp rx=0 tx=0).stop 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 -- 172.21.15.70:0/3861080536 shutdown_connections 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b65a48ed60 0x55b65a491150 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fceaf7fe640 0 client.15300 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a47cb50 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a47c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 --2- 172.21.15.70:0/3861080536 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 0x55b65a47c0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.961+0000 7fced8d74740 1 -- 172.21.15.70:0/3861080536 >> 172.21.15.70:0/3861080536 conn(0x55b65a46c0f0 msgr2=0x55b65a471e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.962+0000 7fced8d74740 1 -- 172.21.15.70:0/3861080536 shutdown_connections 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.962+0000 7fced8d74740 1 -- 172.21.15.70:0/3861080536 wait complete. 2024-09-19T04:30:56.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.962+0000 7fced8d74740 20 client.15300 trim_cache size 0 max 16384 2024-09-19T04:30:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fced8d74740 1 Processor -- start 2024-09-19T04:30:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fced8d74740 1 -- start start 2024-09-19T04:30:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fced8d74740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a46fa20 0x55b65a46b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fced8d74740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a470340 0x55b65a47b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fced8d74740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a47f150 0x55b65a496870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fced8d74740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fced01adf80 con 0x55b65a46fa20 2024-09-19T04:30:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fced8d74740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fced01ab850 con 0x55b65a47f150 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fced8d74740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fced01a96c0 con 0x55b65a470340 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a46fa20 0x55b65a46b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a46fa20 0x55b65a46b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37112/0 (socket says 172.21.15.70:37112) 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 -- 172.21.15.70:0/816922147 learned_addr learned my addr 172.21.15.70:0/816922147 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecffff640 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a470340 0x55b65a47b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a47f150 0x55b65a496870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 -- 172.21.15.70:0/816922147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a470340 msgr2=0x55b65a47b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a470340 0x55b65a47b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 -- 172.21.15.70:0/816922147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a47f150 msgr2=0x55b65a496870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a47f150 0x55b65a496870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 -- 172.21.15.70:0/816922147 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b65a466680 con 0x55b65a46fa20 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.979+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a46fa20 0x55b65a46b520 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcec40058c0 tx=0x7fcec4004a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a0ac056e7a086 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fceb5ffb640 1 -- 172.21.15.70:0/816922147 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec400a970 con 0x55b65a46fa20 2024-09-19T04:30:56.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fceb5ffb640 1 -- 172.21.15.70:0/816922147 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcec4005620 con 0x55b65a46fa20 2024-09-19T04:30:56.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fceb5ffb640 1 -- 172.21.15.70:0/816922147 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec401ea30 con 0x55b65a46fa20 2024-09-19T04:30:56.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fced8d74740 1 -- 172.21.15.70:0/816922147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a46fa20 msgr2=0x55b65a46b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fced8d74740 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a46fa20 0x55b65a46b520 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fcec40058c0 tx=0x7fcec4004a70 comp rx=0 tx=0).stop 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fced8d74740 1 -- 172.21.15.70:0/816922147 shutdown_connections 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fced8d74740 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a47f150 0x55b65a496870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fced8d74740 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a470340 0x55b65a47b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fced8d74740 1 --2- 172.21.15.70:0/816922147 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a46fa20 0x55b65a46b520 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fced8d74740 1 -- 172.21.15.70:0/816922147 >> 172.21.15.70:0/816922147 conn(0x55b65a46c0f0 msgr2=0x55b65a47e040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.980+0000 7fced8d74740 1 -- 172.21.15.70:0/816922147 shutdown_connections 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 -- 172.21.15.70:0/816922147 wait complete. 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 -- start start 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 Processor -- start 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 0x55b65a4876c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a4829f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a482f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fced01a9d10 con 0x55b65a47f150 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fced01ab180 con 0x55b65a470340 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fced01aa3e0 con 0x55b65a46fa20 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fced8d74740 10 client.0 _ll_register_callbacks cb 0x7fcec0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.981+0000 7fcecf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a482f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a482f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37118/0 (socket says 172.21.15.70:37118) 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a4829f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecf7fe640 1 -- 172.21.15.70:0/958850264 learned_addr learned my addr 172.21.15.70:0/958850264 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 0x55b65a4876c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecffff640 1 -- 172.21.15.70:0/958850264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 msgr2=0x55b65a4876c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecffff640 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 0x55b65a4876c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecffff640 1 -- 172.21.15.70:0/958850264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 msgr2=0x55b65a482f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecffff640 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a482f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecffff640 1 -- 172.21.15.70:0/958850264 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b65a483570 con 0x55b65a470340 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fcecffff640 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a4829f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcec002a940 tx=0x7fcec0005c00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3b22c0afe0a682d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fceaf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fceaf7fe640 1 -- 172.21.15.70:0/958850264 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0035040 con 0x55b65a470340 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fced8d74740 1 -- 172.21.15.70:0/958850264 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec4005620 con 0x55b65a470340 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fceaf7fe640 1 -- 172.21.15.70:0/958850264 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fcec0005040 con 0x55b65a470340 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fceaf7fe640 1 -- 172.21.15.70:0/958850264 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fcec0052050 con 0x55b65a470340 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fced8d74740 10 client.24851 fetch_fsmap learned FSMap version 24 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.982+0000 7fced8d74740 1 -- 172.21.15.70:0/958850264 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55b65a4f96a0 con 0x55b65a470340 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fceaf7fe640 1 -- 172.21.15.70:0/958850264 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcec4005620 con 0x55b65a470340 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fceaf7fe640 1 -- 172.21.15.70:0/958850264 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fcec00035f0 con 0x55b65a470340 2024-09-19T04:30:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fced8d74740 10 client.24851 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fced8d74740 10 client.24851 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fced8d74740 20 client.24851 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fced8d74740 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b65a4f9e50 0x55b65a4fc270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fced8d74740 4 client.24851 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fced8d74740 1 -- 172.21.15.70:0/958850264 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55b65a3dcd00 con 0x55b65a4f9e50 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b65a4f9e50 0x55b65a4fc270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fcecf7fe640 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b65a4f9e50 0x55b65a4fc270 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d64fa6db356bfa45 server_cookie=72297a02396e4992 in_seq=0 out_seq=0 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.983+0000 7fceaf7fe640 10 client.24851 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.984+0000 7fceaf7fe640 1 -- 172.21.15.70:0/958850264 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55b65a3dcd00 con 0x55b65a4f9e50 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.984+0000 7fceaf7fe640 10 client.24851 handle_command_reply: tid=0 2024-09-19T04:30:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.984+0000 7fced8d74740 1 client.24851 shutdown 2024-09-19T04:30:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 -- 172.21.15.70:0/958850264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 msgr2=0x55b65a4829f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a4829f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fcec002a940 tx=0x7fcec0005c00 comp rx=0 tx=0).stop 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 -- 172.21.15.70:0/958850264 shutdown_connections 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b65a4f9e50 0x55b65a4fc270 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b65a47f150 0x55b65a482f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b65a470340 0x55b65a4829f0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 --2- 172.21.15.70:0/958850264 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b65a46fa20 0x55b65a4876c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fceaf7fe640 0 client.24851 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 -- 172.21.15.70:0/958850264 >> 172.21.15.70:0/958850264 conn(0x55b65a46c0f0 msgr2=0x55b65a489fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 -- 172.21.15.70:0/958850264 shutdown_connections 2024-09-19T04:30:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 1 -- 172.21.15.70:0/958850264 wait complete. 2024-09-19T04:30:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced8d74740 20 client.24851 trim_cache size 0 max 16384 2024-09-19T04:30:56.992 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:30:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "b4dacad8-144a-4338-8f2a-66e9954d786f", 2024-09-19T04:30:56.992 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:30:56.992 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced699b640 1 -- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceb80a3550 msgr2=0x7fceb80a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced699b640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceb80a3550 0x7fceb80a5a10 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fcec80cd780 tx=0x7fcec80a0040 comp rx=0 tx=0).stop 2024-09-19T04:30:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced699b640 1 -- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced01082e0 msgr2=0x7fced019ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.985+0000 7fced699b640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced01082e0 0x7fced019ce50 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fcec800eaa0 tx=0x7fcec800ef60 comp rx=0 tx=0).stop 2024-09-19T04:30:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.986+0000 7fced699b640 1 -- 172.21.15.70:0/544433388 shutdown_connections 2024-09-19T04:30:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.986+0000 7fced699b640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceb80a3550 0x7fceb80a5a10 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.986+0000 7fced699b640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fced01082e0 0x7fced019ce50 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.986+0000 7fced699b640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fced0103760 0x7fced0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.986+0000 7fced699b640 1 --2- 172.21.15.70:0/544433388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fced0102db0 0x7fced0198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.986+0000 7fced699b640 1 -- 172.21.15.70:0/544433388 >> 172.21.15.70:0/544433388 conn(0x7fced00fc7d0 msgr2=0x7fced0105d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.986+0000 7fced699b640 1 -- 172.21.15.70:0/544433388 shutdown_connections 2024-09-19T04:30:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:56.986+0000 7fced699b640 1 -- 172.21.15.70:0/544433388 wait complete. 2024-09-19T04:30:57.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.113+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7f72e01996f0 con 0x7f72e01080f0 2024-09-19T04:30:57.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.116+0000 7f72d77fe640 1 -- 172.21.15.70:0/2723660778 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7f72e01996f0 con 0x7f72e01080f0 2024-09-19T04:30:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f72cc0a3600 msgr2=0x7f72cc0a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f72cc0a3600 0x7f72cc0a5ac0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f72dc0314b0 tx=0x7f72dc0058d0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e01080f0 msgr2=0x7f72e019cc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e01080f0 0x7f72e019cc60 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f72d800eaa0 tx=0x7f72d800ef60 comp rx=0 tx=0).stop 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 shutdown_connections 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f72cc0a3600 0x7f72cc0a5ac0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f72e01080f0 0x7f72e019cc60 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72e0101150 0x7f72e01988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 --2- 172.21.15.70:0/2723660778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f72e0100830 0x7f72e01983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 >> 172.21.15.70:0/2723660778 conn(0x7f72e0075f20 msgr2=0x7f72e00ff6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 shutdown_connections 2024-09-19T04:30:57.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.119+0000 7f72e8752640 1 -- 172.21.15.70:0/2723660778 wait complete. 2024-09-19T04:30:57.132 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-09-19T04:30:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- 172.21.15.70:0/2741695764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4884103600 msgr2=0x7f488410bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 --2- 172.21.15.70:0/2741695764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4884103600 0x7f488410bae0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f4878009900 tx=0x7f487802a480 comp rx=0 tx=0).stop 2024-09-19T04:30:57.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- 172.21.15.70:0/2741695764 shutdown_connections 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 --2- 172.21.15.70:0/2741695764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f488410c0b0 0x7f488410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 --2- 172.21.15.70:0/2741695764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4884103600 0x7f488410bae0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 --2- 172.21.15.70:0/2741695764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4884102ce0 0x7f48841030c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- 172.21.15.70:0/2741695764 >> 172.21.15.70:0/2741695764 conn(0x7f4884077990 msgr2=0x7f48840fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- 172.21.15.70:0/2741695764 shutdown_connections 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- 172.21.15.70:0/2741695764 wait complete. 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 Processor -- start 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- start start 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4884102ce0 0x7f48841983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4884103600 0x7f4884198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:57.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f488410c0b0 0x7f488419cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4884111e80 con 0x7f488410c0b0 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4884111d00 con 0x7f4884103600 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.243+0000 7f488af9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4884112000 con 0x7f4884102ce0 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f488410c0b0 0x7f488419cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f488410c0b0 0x7f488419cc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37122/0 (socket says 172.21.15.70:37122) 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 -- 172.21.15.70:0/1779706737 learned_addr learned my addr 172.21.15.70:0/1779706737 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f4888d3b640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4884102ce0 0x7f48841983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f4883fff640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4884103600 0x7f4884198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 -- 172.21.15.70:0/1779706737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4884102ce0 msgr2=0x7f48841983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4884102ce0 0x7f48841983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 -- 172.21.15.70:0/1779706737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4884103600 msgr2=0x7f4884198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4884103600 0x7f4884198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 -- 172.21.15.70:0/1779706737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f488419d3b0 con 0x7f488410c0b0 2024-09-19T04:30:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488953c640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f488410c0b0 0x7f488419cc80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f487c00cad0 tx=0x7f487c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f4881ffb640 1 -- 172.21.15.70:0/1779706737 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c00ae20 con 0x7f488410c0b0 2024-09-19T04:30:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f488419d6a0 con 0x7f488410c0b0 2024-09-19T04:30:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f4881ffb640 1 -- 172.21.15.70:0/1779706737 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f487c005020 con 0x7f488410c0b0 2024-09-19T04:30:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f4881ffb640 1 -- 172.21.15.70:0/1779706737 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f487c00f690 con 0x7f488410c0b0 2024-09-19T04:30:57.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.244+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48841a4f30 con 0x7f488410c0b0 2024-09-19T04:30:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.245+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48841030c0 con 0x7f488410c0b0 2024-09-19T04:30:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.246+0000 7f4881ffb640 1 -- 172.21.15.70:0/1779706737 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f487c0051d0 con 0x7f488410c0b0 2024-09-19T04:30:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.247+0000 7f4881ffb640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f486c0a3580 0x7f486c0a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.247+0000 7f4888d3b640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f486c0a3580 0x7f486c0a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.247+0000 7f4881ffb640 1 -- 172.21.15.70:0/1779706737 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f487c0cff90 con 0x7f488410c0b0 2024-09-19T04:30:57.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.248+0000 7f4888d3b640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f486c0a3580 0x7f486c0a5a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4874005fd0 tx=0x7f487400b390 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:57.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.251+0000 7f4881ffb640 1 -- 172.21.15.70:0/1779706737 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f487c014030 con 0x7f488410c0b0 2024-09-19T04:30:57.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.440+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7f4884062630 con 0x7f486c0a3580 2024-09-19T04:30:57.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.506+0000 7f4881ffb640 1 -- 172.21.15.70:0/1779706737 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f4884062630 con 0x7f486c0a3580 2024-09-19T04:30:57.508 INFO:teuthology.orchestra.run.smithi070.stdout:Schedule set for path / 2024-09-19T04:30:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f486c0a3580 msgr2=0x7f486c0a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f486c0a3580 0x7f486c0a5a40 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f4874005fd0 tx=0x7f487400b390 comp rx=0 tx=0).stop 2024-09-19T04:30:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f488410c0b0 msgr2=0x7f488419cc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f488410c0b0 0x7f488419cc80 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f487c00cad0 tx=0x7f487c00cf90 comp rx=0 tx=0).stop 2024-09-19T04:30:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 shutdown_connections 2024-09-19T04:30:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f486c0a3580 0x7f486c0a5a40 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f488410c0b0 0x7f488419cc80 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4884103600 0x7f4884198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 --2- 172.21.15.70:0/1779706737 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4884102ce0 0x7f48841983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 >> 172.21.15.70:0/1779706737 conn(0x7f4884077990 msgr2=0x7f48840fd1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 shutdown_connections 2024-09-19T04:30:57.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.508+0000 7f488af9f640 1 -- 172.21.15.70:0/1779706737 wait complete. 2024-09-19T04:30:57.521 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-09-19T04:30:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 -- 172.21.15.70:0/1693299499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 msgr2=0x7fb284106dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 --2- 172.21.15.70:0/1693299499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 0x7fb284106dc0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7fb274009930 tx=0x7fb27402a420 comp rx=0 tx=0).stop 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 -- 172.21.15.70:0/1693299499 shutdown_connections 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 --2- 172.21.15.70:0/1693299499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb284101370 0x7fb28410d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 --2- 172.21.15.70:0/1693299499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2841009d0 0x7fb284100e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 --2- 172.21.15.70:0/1693299499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 0x7fb284106dc0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 -- 172.21.15.70:0/1693299499 >> 172.21.15.70:0/1693299499 conn(0x7fb2840fc6f0 msgr2=0x7fb2840feb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 -- 172.21.15.70:0/1693299499 shutdown_connections 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.622+0000 7fb28af9f640 1 -- 172.21.15.70:0/1693299499 wait complete. 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28af9f640 1 Processor -- start 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28af9f640 1 -- start start 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28af9f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2841009d0 0x7fb284198380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28af9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb284101370 0x7fb2841988c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28af9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 0x7fb28419cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:57.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28af9f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb284110df0 con 0x7fb2841069e0 2024-09-19T04:30:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28af9f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb284110c70 con 0x7fb284101370 2024-09-19T04:30:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28af9f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb284110f70 con 0x7fb2841009d0 2024-09-19T04:30:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28953c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 0x7fb28419cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28953c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 0x7fb28419cc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37130/0 (socket says 172.21.15.70:37130) 2024-09-19T04:30:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb28953c640 1 -- 172.21.15.70:0/4205911413 learned_addr learned my addr 172.21.15.70:0/4205911413 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:57.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.623+0000 7fb288d3b640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2841009d0 0x7fb284198380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb283fff640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb284101370 0x7fb2841988c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb28953c640 1 -- 172.21.15.70:0/4205911413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2841009d0 msgr2=0x7fb284198380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb28953c640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2841009d0 0x7fb284198380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb28953c640 1 -- 172.21.15.70:0/4205911413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb284101370 msgr2=0x7fb2841988c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb28953c640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb284101370 0x7fb2841988c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb28953c640 1 -- 172.21.15.70:0/4205911413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28419d370 con 0x7fb2841069e0 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb28953c640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 0x7fb28419cc40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d750 tx=0x7fb27c00dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb281ffb640 1 -- 172.21.15.70:0/4205911413 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c017070 con 0x7fb2841069e0 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb281ffb640 1 -- 172.21.15.70:0/4205911413 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb27c0054f0 con 0x7fb2841069e0 2024-09-19T04:30:57.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28419d660 con 0x7fb2841069e0 2024-09-19T04:30:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb281ffb640 1 -- 172.21.15.70:0/4205911413 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb27c004cf0 con 0x7fb2841069e0 2024-09-19T04:30:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.624+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2841a4ef0 con 0x7fb2841069e0 2024-09-19T04:30:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.625+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb284100e30 con 0x7fb2841069e0 2024-09-19T04:30:57.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.626+0000 7fb281ffb640 1 -- 172.21.15.70:0/4205911413 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fb27c004e90 con 0x7fb2841069e0 2024-09-19T04:30:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.627+0000 7fb281ffb640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb26c0a3600 0x7fb26c0a5ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.627+0000 7fb288d3b640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb26c0a3600 0x7fb26c0a5ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.627+0000 7fb281ffb640 1 -- 172.21.15.70:0/4205911413 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fb27c0cf7c0 con 0x7fb2841069e0 2024-09-19T04:30:57.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.627+0000 7fb288d3b640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb26c0a3600 0x7fb26c0a5ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb2740314b0 tx=0x7fb2740058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:57.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.631+0000 7fb281ffb640 1 -- 172.21.15.70:0/4205911413 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb27c09b920 con 0x7fb2841069e0 2024-09-19T04:30:57.763 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1090441043' entity='client.admin' 2024-09-19T04:30:57.763 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 796 B/s wr, 17 op/s 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2810532724' entity='client.admin' 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2723660778' entity='client.admin' 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.764 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.765 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.765 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1090441043' entity='client.admin' 2024-09-19T04:30:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 796 B/s wr, 17 op/s 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2810532724' entity='client.admin' 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2723660778' entity='client.admin' 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.810 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1090441043' entity='client.admin' 2024-09-19T04:30:57.810 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.810 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.810 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.810 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: pgmap v8: 97 pgs: 97 active+clean; 1.1 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 26 KiB/s rd, 796 B/s wr, 17 op/s 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2810532724' entity='client.admin' 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2723660778' entity='client.admin' 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:30:57.811 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:30:57.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.824+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fb2840fcd50 con 0x7fb26c0a3600 2024-09-19T04:30:57.839 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:30:57.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.883+0000 7fb281ffb640 1 -- 172.21.15.70:0/4205911413 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fb2840fcd50 con 0x7fb26c0a3600 2024-09-19T04:30:57.885 INFO:teuthology.orchestra.run.smithi070.stdout:Retention added to path / 2024-09-19T04:30:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb26c0a3600 msgr2=0x7fb26c0a5ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb26c0a3600 0x7fb26c0a5ac0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb2740314b0 tx=0x7fb2740058d0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 msgr2=0x7fb28419cc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 0x7fb28419cc40 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fb27c00d750 tx=0x7fb27c00dc10 comp rx=0 tx=0).stop 2024-09-19T04:30:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 shutdown_connections 2024-09-19T04:30:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb26c0a3600 0x7fb26c0a5ac0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb2841069e0 0x7fb28419cc40 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb284101370 0x7fb2841988c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 --2- 172.21.15.70:0/4205911413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb2841009d0 0x7fb284198380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.885+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 >> 172.21.15.70:0/4205911413 conn(0x7fb2840fc6f0 msgr2=0x7fb284104780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.886+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 shutdown_connections 2024-09-19T04:30:57.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.886+0000 7fb28af9f640 1 -- 172.21.15.70:0/4205911413 wait complete. 2024-09-19T04:30:57.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 -- 172.21.15.70:0/543987401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 msgr2=0x7f38dc10d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 --2- 172.21.15.70:0/543987401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 0x7f38dc10d880 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f38d4009cd0 tx=0x7f38d402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 -- 172.21.15.70:0/543987401 shutdown_connections 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 --2- 172.21.15.70:0/543987401 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 0x7f38dc10d880 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 --2- 172.21.15.70:0/543987401 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38dc1009b0 0x7f38dc100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 --2- 172.21.15.70:0/543987401 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38dc1069c0 0x7f38dc106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 -- 172.21.15.70:0/543987401 >> 172.21.15.70:0/543987401 conn(0x7f38dc077990 msgr2=0x7f38dc0fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 -- 172.21.15.70:0/543987401 shutdown_connections 2024-09-19T04:30:58.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:57.999+0000 7f38e1e06640 1 -- 172.21.15.70:0/543987401 wait complete. 2024-09-19T04:30:58.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38e1e06640 1 Processor -- start 2024-09-19T04:30:58.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38e1e06640 1 -- start start 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38e1e06640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38dc1009b0 0x7f38dc197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38e1e06640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 0x7f38dc1976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38e1e06640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38dc1069c0 0x7f38dc19ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38e1e06640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc110dd0 con 0x7f38dc101350 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38e1e06640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc110c50 con 0x7f38dc1069c0 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38e1e06640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f38dc110f50 con 0x7f38dc1009b0 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 0x7f38dc1976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 0x7f38dc1976d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37160/0 (socket says 172.21.15.70:37160) 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38daffd640 1 -- 172.21.15.70:0/4013672304 learned_addr learned my addr 172.21.15.70:0/4013672304 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:58.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38db7fe640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38dc1009b0 0x7f38dc197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38dbfff640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38dc1069c0 0x7f38dc19ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38daffd640 1 -- 172.21.15.70:0/4013672304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38dc1009b0 msgr2=0x7f38dc197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38daffd640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38dc1009b0 0x7f38dc197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38daffd640 1 -- 172.21.15.70:0/4013672304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38dc1069c0 msgr2=0x7f38dc19ba50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38daffd640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38dc1069c0 0x7f38dc19ba50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.000+0000 7f38daffd640 1 -- 172.21.15.70:0/4013672304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f38dc19c180 con 0x7f38dc101350 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.001+0000 7f38daffd640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 0x7f38dc1976d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f38d000e9f0 tx=0x7f38d000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.001+0000 7f38d8ff9640 1 -- 172.21.15.70:0/4013672304 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d000ccc0 con 0x7f38dc101350 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.001+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f38dc19c470 con 0x7f38dc101350 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.001+0000 7f38d8ff9640 1 -- 172.21.15.70:0/4013672304 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f38d0010900 con 0x7f38dc101350 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.001+0000 7f38d8ff9640 1 -- 172.21.15.70:0/4013672304 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38d00188a0 con 0x7f38dc101350 2024-09-19T04:30:58.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.001+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38dc1a3d00 con 0x7f38dc101350 2024-09-19T04:30:58.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.002+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f38dc100e10 con 0x7f38dc101350 2024-09-19T04:30:58.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.003+0000 7f38d8ff9640 1 -- 172.21.15.70:0/4013672304 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7f38d0010ab0 con 0x7f38dc101350 2024-09-19T04:30:58.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.005+0000 7f38d8ff9640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f38c40a3580 0x7f38c40a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.005+0000 7f38db7fe640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f38c40a3580 0x7f38c40a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.005+0000 7f38d8ff9640 1 -- 172.21.15.70:0/4013672304 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f38d00d0850 con 0x7f38dc101350 2024-09-19T04:30:58.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.005+0000 7f38db7fe640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f38c40a3580 0x7f38c40a5a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00ab60 tx=0x7f38cc00a2d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.008+0000 7f38d8ff9640 1 -- 172.21.15.70:0/4013672304 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f38d009cfa0 con 0x7f38dc101350 2024-09-19T04:30:58.105 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:30:58.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.210+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f38dc103cf0 con 0x7f38c40a3580 2024-09-19T04:30:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.217+0000 7f38d8ff9640 1 -- 172.21.15.70:0/4013672304 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7f38dc103cf0 con 0x7f38c40a3580 2024-09-19T04:30:58.218 INFO:teuthology.orchestra.run.smithi070.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T04:30:57", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f38c40a3580 msgr2=0x7f38c40a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f38c40a3580 0x7f38c40a5a40 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f38cc00ab60 tx=0x7f38cc00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 msgr2=0x7f38dc1976d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 0x7f38dc1976d0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f38d000e9f0 tx=0x7f38d000edf0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 shutdown_connections 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f38c40a3580 0x7f38c40a5a40 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f38dc1069c0 0x7f38dc19ba50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38dc101350 0x7f38dc1976d0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 --2- 172.21.15.70:0/4013672304 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f38dc1009b0 0x7f38dc197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 >> 172.21.15.70:0/4013672304 conn(0x7f38dc077990 msgr2=0x7f38dc1035e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 shutdown_connections 2024-09-19T04:30:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.219+0000 7f38e1e06640 1 -- 172.21.15.70:0/4013672304 wait complete. 2024-09-19T04:30:58.231 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T04:30:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 -- 172.21.15.70:0/3032002030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 msgr2=0x7fc3e0107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 --2- 172.21.15.70:0/3032002030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 0x7fc3e0107f60 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fc3d8009930 tx=0x7fc3d802a420 comp rx=0 tx=0).stop 2024-09-19T04:30:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 -- 172.21.15.70:0/3032002030 shutdown_connections 2024-09-19T04:30:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 --2- 172.21.15.70:0/3032002030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3e0102480 0x7fc3e010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 --2- 172.21.15.70:0/3032002030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3e0101ae0 0x7fc3e0101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 --2- 172.21.15.70:0/3032002030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 0x7fc3e0107f60 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 -- 172.21.15.70:0/3032002030 >> 172.21.15.70:0/3032002030 conn(0x7fc3e00fd7e0 msgr2=0x7fc3e00ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 -- 172.21.15.70:0/3032002030 shutdown_connections 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 -- 172.21.15.70:0/3032002030 wait complete. 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 Processor -- start 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 -- start start 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.333+0000 7fc3e8149640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3e0101ae0 0x7fc3e0198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e8149640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3e0102480 0x7fc3e01988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e8149640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 0x7fc3e019cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e8149640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0111f00 con 0x7fc3e0107b80 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e8149640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0111d80 con 0x7fc3e0102480 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e8149640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3e0112080 con 0x7fc3e0101ae0 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 0x7fc3e019cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 0x7fc3e019cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37176/0 (socket says 172.21.15.70:37176) 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e5ee5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3e0101ae0 0x7fc3e0198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e56e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3e0102480 0x7fc3e01988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 -- 172.21.15.70:0/1614313951 learned_addr learned my addr 172.21.15.70:0/1614313951 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 -- 172.21.15.70:0/1614313951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3e0101ae0 msgr2=0x7fc3e0198370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3e0101ae0 0x7fc3e0198370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 -- 172.21.15.70:0/1614313951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3e0102480 msgr2=0x7fc3e01988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3e0102480 0x7fc3e01988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 -- 172.21.15.70:0/1614313951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc3e019d360 con 0x7fc3e0107b80 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e56e4640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3e0102480 0x7fc3e01988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e66e6640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 0x7fc3e019cc30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000eb10 tx=0x7fc3d000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3deffd640 1 -- 172.21.15.70:0/1614313951 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0004b20 con 0x7fc3e0107b80 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc3e019d650 con 0x7fc3e0107b80 2024-09-19T04:30:58.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3deffd640 1 -- 172.21.15.70:0/1614313951 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc3d0004cc0 con 0x7fc3e0107b80 2024-09-19T04:30:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3deffd640 1 -- 172.21.15.70:0/1614313951 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc3d0010700 con 0x7fc3e0107b80 2024-09-19T04:30:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.334+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3e01a4ee0 con 0x7fc3e0107b80 2024-09-19T04:30:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.335+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc3e0101f40 con 0x7fc3e0107b80 2024-09-19T04:30:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.336+0000 7fc3deffd640 1 -- 172.21.15.70:0/1614313951 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fc3d0004e70 con 0x7fc3e0107b80 2024-09-19T04:30:58.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.337+0000 7fc3deffd640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3c80a3580 0x7fc3c80a5a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.337+0000 7fc3e5ee5640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3c80a3580 0x7fc3c80a5a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.337+0000 7fc3deffd640 1 -- 172.21.15.70:0/1614313951 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc3d00d0480 con 0x7fc3e0107b80 2024-09-19T04:30:58.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.337+0000 7fc3e5ee5640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3c80a3580 0x7fc3c80a5a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80314b0 tx=0x7fc3d80058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.341+0000 7fc3deffd640 1 -- 172.21.15.70:0/1614313951 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc3d009cc30 con 0x7fc3e0107b80 2024-09-19T04:30:58.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.539+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fc3e00fe620 con 0x7fc3c80a3580 2024-09-19T04:30:58.547 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.545+0000 7fc3deffd640 1 -- 172.21.15.70:0/1614313951 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fc3e00fe620 con 0x7fc3c80a3580 2024-09-19T04:30:58.547 INFO:teuthology.orchestra.run.smithi070.stdout:/ 1m 6m3h 2024-09-19T04:30:58.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.547+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3c80a3580 msgr2=0x7fc3c80a5a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.547+0000 7fc3e8149640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3c80a3580 0x7fc3c80a5a40 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fc3d80314b0 tx=0x7fc3d80058d0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.547+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 msgr2=0x7fc3e019cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.547+0000 7fc3e8149640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 0x7fc3e019cc30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fc3d000eb10 tx=0x7fc3d000c2d0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.548+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 shutdown_connections 2024-09-19T04:30:58.549 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.548+0000 7fc3e8149640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3c80a3580 0x7fc3c80a5a40 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.548+0000 7fc3e8149640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3e0107b80 0x7fc3e019cc30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.548+0000 7fc3e8149640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc3e0102480 0x7fc3e01988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.548+0000 7fc3e8149640 1 --2- 172.21.15.70:0/1614313951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc3e0101ae0 0x7fc3e0198370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.548+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 >> 172.21.15.70:0/1614313951 conn(0x7fc3e00fd7e0 msgr2=0x7fc3e00fdf10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.548+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 shutdown_connections 2024-09-19T04:30:58.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.548+0000 7fc3e8149640 1 -- 172.21.15.70:0/1614313951 wait complete. 2024-09-19T04:30:58.560 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-09-19T04:30:58.587 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-09-19T04:30:58.597 INFO:teuthology.run_tasks:Running task workunit... 2024-09-19T04:30:58.646 INFO:tasks.workunit:Pulling workunits from ref 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T04:30:58.647 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-09-19T04:30:58.647 INFO:tasks.workunit:timeout=3h 2024-09-19T04:30:58.647 INFO:tasks.workunit:cleanup=True 2024-09-19T04:30:58.647 DEBUG:teuthology.orchestra.run.smithi070:> stat -- /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.613+0000 7fcec8284640 1 -- 172.21.15.70:0/441118597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0102d40 msgr2=0x7fcec0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.613+0000 7fcec8284640 1 --2- 172.21.15.70:0/441118597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0102d40 0x7fcec0103120 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fceb0009900 tx=0x7fceb002a480 comp rx=0 tx=0).stop 2024-09-19T04:30:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.613+0000 7fcec8284640 1 -- 172.21.15.70:0/441118597 shutdown_connections 2024-09-19T04:30:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.613+0000 7fcec8284640 1 --2- 172.21.15.70:0/441118597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcec010c170 0x7fcec010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.613+0000 7fcec8284640 1 --2- 172.21.15.70:0/441118597 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcec0103660 0x7fcec010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.613+0000 7fcec8284640 1 --2- 172.21.15.70:0/441118597 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0102d40 0x7fcec0103120 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.613+0000 7fcec8284640 1 -- 172.21.15.70:0/441118597 >> 172.21.15.70:0/441118597 conn(0x7fcec00fc7a0 msgr2=0x7fcec00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 -- 172.21.15.70:0/441118597 shutdown_connections 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 -- 172.21.15.70:0/441118597 wait complete. 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 Processor -- start 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 -- start start 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcec0102d40 0x7fcec019a770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0103660 0x7fcec019acb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcec010c170 0x7fcec019efa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0111f40 con 0x7fcec0103660 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcec0111dc0 con 0x7fcec010c170 2024-09-19T04:30:58.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec8284640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01120c0 con 0x7fcec0102d40 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.614+0000 7fcec581f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0103660 0x7fcec019acb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec581f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0103660 0x7fcec019acb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37194/0 (socket says 172.21.15.70:37194) 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec581f640 1 -- 172.21.15.70:0/2793333938 learned_addr learned my addr 172.21.15.70:0/2793333938 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec6821640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcec010c170 0x7fcec019efa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec6020640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcec0102d40 0x7fcec019a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec581f640 1 -- 172.21.15.70:0/2793333938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcec0102d40 msgr2=0x7fcec019a770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec581f640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcec0102d40 0x7fcec019a770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec581f640 1 -- 172.21.15.70:0/2793333938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcec010c170 msgr2=0x7fcec019efa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec581f640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcec010c170 0x7fcec019efa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec581f640 1 -- 172.21.15.70:0/2793333938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcec019f680 con 0x7fcec0103660 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec6821640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcec010c170 0x7fcec019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec581f640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0103660 0x7fcec019acb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00d740 tx=0x7fcebc00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fceb77fe640 1 -- 172.21.15.70:0/2793333938 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc017070 con 0x7fcec0103660 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fceb77fe640 1 -- 172.21.15.70:0/2793333938 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fcebc00de50 con 0x7fcec0103660 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec8284640 1 -- 172.21.15.70:0/2793333938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcec019f970 con 0x7fcec0103660 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fceb77fe640 1 -- 172.21.15.70:0/2793333938 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcebc00f620 con 0x7fcec0103660 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.615+0000 7fcec8284640 1 -- 172.21.15.70:0/2793333938 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcec01a7250 con 0x7fcec0103660 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.617+0000 7fceb77fe640 1 -- 172.21.15.70:0/2793333938 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 23) ==== 138582+0+0 (secure 0 0 0) 0x7fcebc009c30 con 0x7fcec0103660 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceca65d740 1 Processor -- start 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceca65d740 1 -- start start 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceca65d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdf4a0 0x559937fdf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceca65d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdfdc0 0x559937fea140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceca65d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937feca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceca65d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559937f452e0 con 0x559937fea680 2024-09-19T04:30:58.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceca65d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559937eecce0 con 0x559937fdfdc0 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceca65d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559937f412a0 con 0x559937fdf4a0 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fcec581f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937feca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fcec581f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937feca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37202/0 (socket says 172.21.15.70:37202) 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fcec581f640 1 -- 172.21.15.70:0/3360109916 learned_addr learned my addr 172.21.15.70:0/3360109916 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fcec6020640 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdfdc0 0x559937fea140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fcec6821640 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdf4a0 0x559937fdf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.618+0000 7fceb77fe640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceac0a34d0 0x7fceac0a5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec6020640 1 -- 172.21.15.70:0/3360109916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdf4a0 msgr2=0x559937fdf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec6020640 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdf4a0 0x559937fdf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec6020640 1 -- 172.21.15.70:0/3360109916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 msgr2=0x559937feca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec6020640 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937feca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec6020640 1 -- 172.21.15.70:0/3360109916 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559937ed1440 con 0x559937fdfdc0 2024-09-19T04:30:58.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec581f640 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937feca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec6821640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceac0a34d0 0x7fceac0a5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fceb77fe640 1 -- 172.21.15.70:0/2793333938 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fcebc0cfb80 con 0x7fcec0103660 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec6020640 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdfdc0 0x559937fea140 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fceb0006010 tx=0x7fceb0005e80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c216063bdf919745 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fceb4dea640 1 -- 172.21.15.70:0/3360109916 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb003f070 con 0x559937fdfdc0 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fcec6821640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceac0a34d0 0x7fceac0a5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fceb8005c40 tx=0x7fceb8004a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.619+0000 7fceb4dea640 1 -- 172.21.15.70:0/3360109916 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fceb0004030 con 0x559937fdfdc0 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceb4dea640 1 -- 172.21.15.70:0/3360109916 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb0035070 con 0x559937fdfdc0 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 -- 172.21.15.70:0/3360109916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdfdc0 msgr2=0x559937fea140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdfdc0 0x559937fea140 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fceb0006010 tx=0x7fceb0005e80 comp rx=0 tx=0).stop 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 -- 172.21.15.70:0/3360109916 shutdown_connections 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937feca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdfdc0 0x559937fea140 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 --2- 172.21.15.70:0/3360109916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdf4a0 0x559937fdf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 -- 172.21.15.70:0/3360109916 >> 172.21.15.70:0/3360109916 conn(0x559937fdba30 msgr2=0x559937fdbe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 -- 172.21.15.70:0/3360109916 shutdown_connections 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 -- 172.21.15.70:0/3360109916 wait complete. 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 -- start start 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.620+0000 7fceca65d740 1 Processor -- start 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fceca65d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x559937fe9f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fceca65d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937fe7200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fceca65d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937fe7740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fceca65d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559937fed2f0 con 0x559937fea680 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fceca65d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559937f00050 con 0x559937fdf4a0 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fceca65d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559937fed470 con 0x559937fdfdc0 2024-09-19T04:30:58.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fceca65d740 10 client.0 _ll_register_callbacks cb 0x559937f40160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6821640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937fe7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x559937fe9f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x559937fe9f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:53394/0 (socket says 172.21.15.70:53394) 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 -- 172.21.15.70:0/908579009 learned_addr learned my addr 172.21.15.70:0/908579009 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec581f640 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937fe7200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 -- 172.21.15.70:0/908579009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 msgr2=0x559937fe7200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937fe7200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 -- 172.21.15.70:0/908579009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 msgr2=0x559937fe7740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937fe7740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 -- 172.21.15.70:0/908579009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559937cb63c0 con 0x559937fdf4a0 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcec6020640 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x559937fe9f50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fceb002a9a0 tx=0x7fceb0009580 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a058748b9f03a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcea9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcea9ffb640 1 -- 172.21.15.70:0/908579009 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb0035070 con 0x559937fdf4a0 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fceca65d740 1 -- 172.21.15.70:0/908579009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fceb0004030 con 0x559937fdf4a0 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.621+0000 7fcea9ffb640 1 -- 172.21.15.70:0/908579009 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fceb0031510 con 0x559937fdf4a0 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fcea9ffb640 1 -- 172.21.15.70:0/908579009 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fceb0055050 con 0x559937fdf4a0 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fceca65d740 10 client.24884 fetch_fsmap learned FSMap version 24 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fceca65d740 1 -- 172.21.15.70:0/908579009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5599380014a0 con 0x559937fdf4a0 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fcea9ffb640 1 -- 172.21.15.70:0/908579009 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fceb0004030 con 0x559937fdf4a0 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fcea9ffb640 1 -- 172.21.15.70:0/908579009 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fceb00046c0 con 0x559937fdf4a0 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fceca65d740 10 client.24884 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fceca65d740 10 client.24884 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fceca65d740 20 client.24884 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fceca65d740 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5599380027f0 0x559938004be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fceca65d740 4 client.24884 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fceca65d740 1 -- 172.21.15.70:0/908579009 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559937f52850 con 0x5599380027f0 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.622+0000 7fcec581f640 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5599380027f0 0x559938004be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.623+0000 7fcea9ffb640 10 client.24884 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.623+0000 7fcec581f640 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5599380027f0 0x559938004be0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bcf64d2b28b26018 server_cookie=b10e9e85a95e3b6 in_seq=0 out_seq=0 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.623+0000 7fcea9ffb640 1 -- 172.21.15.70:0/908579009 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559937f52850 con 0x5599380027f0 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.623+0000 7fcea9ffb640 10 client.24884 handle_command_reply: tid=0 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.623+0000 7fceca65d740 1 client.24884 shutdown 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.623+0000 7fceca65d740 1 -- 172.21.15.70:0/908579009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 msgr2=0x559937fe9f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x559937fe9f50 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fceb002a9a0 tx=0x7fceb0009580 comp rx=0 tx=0).stop 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 -- 172.21.15.70:0/908579009 shutdown_connections 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5599380027f0 0x559938004be0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937fe7740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937fe7200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fcea9ffb640 0 client.24884 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 --2- 172.21.15.70:0/908579009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x559937fe9f50 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 -- 172.21.15.70:0/908579009 >> 172.21.15.70:0/908579009 conn(0x559937fdba30 msgr2=0x559937fe1710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 -- 172.21.15.70:0/908579009 shutdown_connections 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 1 -- 172.21.15.70:0/908579009 wait complete. 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.624+0000 7fceca65d740 20 client.24884 trim_cache size 0 max 16384 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.640+0000 7fceca65d740 1 Processor -- start 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.640+0000 7fceca65d740 1 -- start start 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceca65d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x55993800a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceca65d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x55993800a6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceca65d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937ffaf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceca65d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01ade90 con 0x559937fea680 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceca65d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01ab760 con 0x559937fdf4a0 2024-09-19T04:30:58.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceca65d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01a95f0 con 0x559937fdfdc0 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937ffaf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937ffaf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37234/0 (socket says 172.21.15.70:37234) 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 -- 172.21.15.70:0/3271541991 learned_addr learned my addr 172.21.15.70:0/3271541991 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6020640 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x55993800a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec581f640 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x55993800a6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 -- 172.21.15.70:0/3271541991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 msgr2=0x55993800a6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x55993800a6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 -- 172.21.15.70:0/3271541991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 msgr2=0x55993800a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x55993800a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 -- 172.21.15.70:0/3271541991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559937fea2c0 con 0x559937fea680 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6020640 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x55993800a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fcec6821640 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937ffaf90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fceb800fd90 tx=0x7fceb8013030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9e2a53a16132c37 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceabfff640 1 -- 172.21.15.70:0/3271541991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb802f070 con 0x559937fea680 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceabfff640 1 -- 172.21.15.70:0/3271541991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fceb801f0d0 con 0x559937fea680 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.641+0000 7fceabfff640 1 -- 172.21.15.70:0/3271541991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb801d6b0 con 0x559937fea680 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 -- 172.21.15.70:0/3271541991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 msgr2=0x559937ffaf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937ffaf90 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fceb800fd90 tx=0x7fceb8013030 comp rx=0 tx=0).stop 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 -- 172.21.15.70:0/3271541991 shutdown_connections 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fea680 0x559937ffaf90 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x55993800a6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 --2- 172.21.15.70:0/3271541991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fdf4a0 0x55993800a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 -- 172.21.15.70:0/3271541991 >> 172.21.15.70:0/3271541991 conn(0x559937fdba30 msgr2=0x559937fe62f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 -- 172.21.15.70:0/3271541991 shutdown_connections 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 -- 172.21.15.70:0/3271541991 wait complete. 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 -- start start 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.642+0000 7fceca65d740 1 Processor -- start 2024-09-19T04:30:58.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fceca65d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fdf4a0 0x559937ff8460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fceca65d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937ff89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fceca65d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fea680 0x55993806b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fceca65d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01a9c40 con 0x559937fdf4a0 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fceca65d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01ab090 con 0x559937fea680 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fceca65d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fcec01aa2f0 con 0x559937fdfdc0 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fceca65d740 10 client.0 _ll_register_callbacks cb 0x7fcebc0d3560 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fdf4a0 0x559937ff8460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fdf4a0 0x559937ff8460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37244/0 (socket says 172.21.15.70:37244) 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 -- 172.21.15.70:0/2398463568 learned_addr learned my addr 172.21.15.70:0/2398463568 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6821640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fea680 0x55993806b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec581f640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937ff89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 -- 172.21.15.70:0/2398463568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 msgr2=0x559937ff89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937ff89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 -- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fea680 msgr2=0x55993806b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fea680 0x55993806b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 -- 172.21.15.70:0/2398463568 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55993806b6c0 con 0x559937fdf4a0 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6821640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fea680 0x55993806b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec581f640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937ff89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcec6020640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fdf4a0 0x559937ff8460 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fceb00045e0 tx=0x7fceb0005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e95aaec0dbbe5e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcea9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcea9ffb640 1 -- 172.21.15.70:0/2398463568 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fceb005e060 con 0x559937fdf4a0 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fcea9ffb640 1 -- 172.21.15.70:0/2398463568 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fceb0004f00 con 0x559937fdf4a0 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.643+0000 7fceca65d740 1 -- 172.21.15.70:0/2398463568 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fceb801f0d0 con 0x559937fdf4a0 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fcea9ffb640 1 -- 172.21.15.70:0/2398463568 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fceb0035040 con 0x559937fdf4a0 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fceca65d740 10 client.15348 fetch_fsmap learned FSMap version 24 2024-09-19T04:30:58.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fceca65d740 1 -- 172.21.15.70:0/2398463568 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55993806c9b0 con 0x559937fdf4a0 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fcea9ffb640 1 -- 172.21.15.70:0/2398463568 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fceb801f0d0 con 0x559937fdf4a0 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fcea9ffb640 1 -- 172.21.15.70:0/2398463568 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fceb0059550 con 0x559937fdf4a0 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fceca65d740 10 client.15348 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fceca65d740 10 client.15348 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fceca65d740 20 client.15348 populate_metadata read hostname 'smithi070' 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fceca65d740 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55993806d070 0x55993806f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fceca65d740 4 client.15348 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fceca65d740 1 -- 172.21.15.70:0/2398463568 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559937f4cd60 con 0x55993806d070 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.644+0000 7fcec581f640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55993806d070 0x55993806f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fcea9ffb640 10 client.15348 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fcec581f640 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55993806d070 0x55993806f490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=345fb8749f0fa832 server_cookie=9c6a630aa771ae2b in_seq=0 out_seq=0 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fcea9ffb640 1 -- 172.21.15.70:0/2398463568 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x559937f4cd60 con 0x55993806d070 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fcea9ffb640 10 client.15348 handle_command_reply: tid=0 2024-09-19T04:30:58.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 client.15348 shutdown 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 -- 172.21.15.70:0/2398463568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fdf4a0 msgr2=0x559937ff8460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fdf4a0 0x559937ff8460 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fceb00045e0 tx=0x7fceb0005fd0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 -- 172.21.15.70:0/2398463568 shutdown_connections 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55993806d070 0x55993806f490 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559937fea680 0x55993806b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559937fdfdc0 0x559937ff89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fcea9ffb640 0 client.15348 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 --2- 172.21.15.70:0/2398463568 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559937fdf4a0 0x559937ff8460 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 -- 172.21.15.70:0/2398463568 >> 172.21.15.70:0/2398463568 conn(0x559937fdba30 msgr2=0x559937fda350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 -- 172.21.15.70:0/2398463568 shutdown_connections 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 1 -- 172.21.15.70:0/2398463568 wait complete. 2024-09-19T04:30:58.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.645+0000 7fceca65d740 20 client.15348 trim_cache size 0 max 16384 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout: "b4dacad8-144a-4338-8f2a-66e9954d786f": { 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "b4dacad8-144a-4338-8f2a-66e9954d786f", 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:30:58.670 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:30:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 -- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceac0a34d0 msgr2=0x7fceac0a5990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceac0a34d0 0x7fceac0a5990 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fceb8005c40 tx=0x7fceb8004a40 comp rx=0 tx=0).stop 2024-09-19T04:30:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 -- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0103660 msgr2=0x7fcec019acb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:30:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0103660 0x7fcec019acb0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fcebc00d740 tx=0x7fcebc00dc00 comp rx=0 tx=0).stop 2024-09-19T04:30:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 -- 172.21.15.70:0/2793333938 shutdown_connections 2024-09-19T04:30:58.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fceac0a34d0 0x7fceac0a5990 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcec010c170 0x7fcec019efa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fcec0103660 0x7fcec019acb0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 --2- 172.21.15.70:0/2793333938 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fcec0102d40 0x7fcec019a770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:30:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 -- 172.21.15.70:0/2793333938 >> 172.21.15.70:0/2793333938 conn(0x7fcec00fc7a0 msgr2=0x7fcec01019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:30:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 -- 172.21.15.70:0/2793333938 shutdown_connections 2024-09-19T04:30:58.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:30:58.646+0000 7fcec8284640 1 -- 172.21.15.70:0/2793333938 wait complete. 2024-09-19T04:30:58.687 INFO:teuthology.orchestra.run.smithi070.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:58.688 INFO:teuthology.orchestra.run.smithi070.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-09-19T04:30:58.688 INFO:teuthology.orchestra.run.smithi070.stdout:Device: 78h/120d Inode: 1 Links: 2 2024-09-19T04:30:58.688 INFO:teuthology.orchestra.run.smithi070.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T04:30:58.688 INFO:teuthology.orchestra.run.smithi070.stdout:Context: system_u:object_r:fusefs_t:s0 2024-09-19T04:30:58.688 INFO:teuthology.orchestra.run.smithi070.stdout:Access: 2024-09-19 04:29:17.669969752 +0000 2024-09-19T04:30:58.688 INFO:teuthology.orchestra.run.smithi070.stdout:Modify: 2024-09-19 04:29:17.669969752 +0000 2024-09-19T04:30:58.688 INFO:teuthology.orchestra.run.smithi070.stdout:Change: 2024-09-19 04:30:47.717916204 +0000 2024-09-19T04:30:58.688 INFO:teuthology.orchestra.run.smithi070.stdout: Birth: - 2024-09-19T04:30:58.688 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-09-19T04:30:58.688 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-09-19T04:30:58.750 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:58 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:30:58.750 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:58 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:30:58.750 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:58 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:30:58.750 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:58 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:30:58.750 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:58 smithi070 ceph-mon[30942]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:58.759 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 6fad5dd73c93545e52f57f681e140a9c3529c11e 2024-09-19T04:30:58.783 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:58 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:30:58.783 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:58 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:30:58.783 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:58 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:30:58.783 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:58 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:30:58.783 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:58 smithi167 ceph-mon[34339]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:58 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:30:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:58 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:30:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:58 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:30:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:58 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:30:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:58 smithi134 ceph-mon[34525]: from='client.15312 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:58.815 INFO:tasks.workunit.client.0.smithi070.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-09-19T04:30:59.518 INFO:tasks.cephfs.filesystem:scrub status for tag:b4dacad8-144a-4338-8f2a-66e9954d786f - {'path': '/', 'tag': 'b4dacad8-144a-4338-8f2a-66e9954d786f', 'options': 'recursive,force'} 2024-09-19T04:30:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:59 smithi134 ceph-mon[34525]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:59 smithi134 ceph-mon[34525]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:59 smithi134 ceph-mon[34525]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 60 KiB/s wr, 31 op/s 2024-09-19T04:30:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:30:59 smithi134 ceph-mon[34525]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:59 smithi070 ceph-mon[30942]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:59 smithi070 ceph-mon[30942]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:59 smithi070 ceph-mon[30942]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 60 KiB/s wr, 31 op/s 2024-09-19T04:30:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:30:59 smithi070 ceph-mon[30942]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:59.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:59 smithi167 ceph-mon[34339]: from='client.15318 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:59.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:59 smithi167 ceph-mon[34339]: from='client.15324 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:30:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:59 smithi167 ceph-mon[34339]: pgmap v9: 97 pgs: 97 active+clean; 1.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 31 KiB/s rd, 60 KiB/s wr, 31 op/s 2024-09-19T04:30:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:30:59 smithi167 ceph-mon[34339]: from='client.15330 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:31:01.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:31:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:31:00.894+0000 7fb6bfcaa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:31:01.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:31:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:31:00.894+0000 7fb6bfcaa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:31:01.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:31:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:31:00.894+0000 7fb6bfcaa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:31:01.395 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:31:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:31:00.894+0000 7fb6bfcaa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:31:01.396 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:31:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x[31168]: 2024-09-19T04:31:00.894+0000 7fb6bfcaa640 -1 client.0 error registering admin socket command: (17) File exists 2024-09-19T04:31:01.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:01 smithi070 ceph-mon[30942]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-09-19T04:31:01.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:01 smithi167 ceph-mon[34339]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-09-19T04:31:02.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:01 smithi134 ceph-mon[34525]: pgmap v10: 97 pgs: 97 active+clean; 1.3 MiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 29 KiB/s rd, 55 KiB/s wr, 29 op/s 2024-09-19T04:31:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:03 smithi070 ceph-mon[30942]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-09-19T04:31:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:03 smithi070 ceph-mon[30942]: mgrmap e24: x(active, since 16s), standbys: y, z 2024-09-19T04:31:03.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:03 smithi167 ceph-mon[34339]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-09-19T04:31:03.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:03 smithi167 ceph-mon[34339]: mgrmap e24: x(active, since 16s), standbys: y, z 2024-09-19T04:31:04.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:03 smithi134 ceph-mon[34525]: pgmap v11: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 52 KiB/s rd, 100 KiB/s wr, 65 op/s 2024-09-19T04:31:04.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:03 smithi134 ceph-mon[34525]: mgrmap e24: x(active, since 16s), standbys: y, z 2024-09-19T04:31:05.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:05 smithi070 ceph-mon[30942]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 99 KiB/s wr, 52 op/s 2024-09-19T04:31:05.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:05 smithi167 ceph-mon[34339]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 99 KiB/s wr, 52 op/s 2024-09-19T04:31:06.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:05 smithi134 ceph-mon[34525]: pgmap v12: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 99 KiB/s wr, 52 op/s 2024-09-19T04:31:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:07 smithi070 ceph-mon[30942]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 99 KiB/s wr, 52 op/s 2024-09-19T04:31:07.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:07 smithi167 ceph-mon[34339]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 99 KiB/s wr, 52 op/s 2024-09-19T04:31:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:07 smithi134 ceph-mon[34525]: pgmap v13: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 32 KiB/s rd, 99 KiB/s wr, 52 op/s 2024-09-19T04:31:08.893 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:08 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:31:08.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:08 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:31:08.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:08 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:31:09.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:09 smithi070 ceph-mon[30942]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-19T04:31:09.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:09 smithi167 ceph-mon[34339]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-19T04:31:10.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:09 smithi134 ceph-mon[34525]: pgmap v14: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 100 KiB/s wr, 55 op/s 2024-09-19T04:31:10.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:10 smithi070 ceph-mon[30942]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 45 KiB/s wr, 39 op/s 2024-09-19T04:31:10.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:10 smithi167 ceph-mon[34339]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 45 KiB/s wr, 39 op/s 2024-09-19T04:31:11.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:10 smithi134 ceph-mon[34525]: pgmap v15: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 45 KiB/s wr, 39 op/s 2024-09-19T04:31:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:13 smithi070 ceph-mon[30942]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 46 KiB/s wr, 42 op/s 2024-09-19T04:31:13.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:13 smithi167 ceph-mon[34339]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 46 KiB/s wr, 42 op/s 2024-09-19T04:31:14.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:13 smithi134 ceph-mon[34525]: pgmap v16: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 27 KiB/s rd, 46 KiB/s wr, 42 op/s 2024-09-19T04:31:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:15 smithi070 ceph-mon[30942]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T04:31:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:15 smithi167 ceph-mon[34339]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T04:31:16.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:15 smithi134 ceph-mon[34525]: pgmap v17: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T04:31:17.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:17 smithi070 ceph-mon[30942]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T04:31:17.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:17 smithi167 ceph-mon[34339]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T04:31:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:17 smithi134 ceph-mon[34525]: pgmap v18: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.4 KiB/s wr, 5 op/s 2024-09-19T04:31:19.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:19 smithi070 ceph-mon[30942]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T04:31:19.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:19 smithi167 ceph-mon[34339]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T04:31:20.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:19 smithi134 ceph-mon[34525]: pgmap v19: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 1.4 KiB/s wr, 7 op/s 2024-09-19T04:31:21.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:21 smithi070 ceph-mon[30942]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T04:31:21.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:21 smithi167 ceph-mon[34339]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T04:31:22.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:21 smithi134 ceph-mon[34525]: pgmap v20: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 682 B/s wr, 5 op/s 2024-09-19T04:31:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:23 smithi070 ceph-mon[30942]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T04:31:23.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:23 smithi167 ceph-mon[34339]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T04:31:24.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:23 smithi134 ceph-mon[34525]: pgmap v21: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 682 B/s wr, 7 op/s 2024-09-19T04:31:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:25 smithi070 ceph-mon[30942]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:25.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:25 smithi167 ceph-mon[34339]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:26.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:25 smithi134 ceph-mon[34525]: pgmap v22: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:27.837 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:27 smithi134 ceph-mon[34525]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:27.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:27 smithi070 ceph-mon[30942]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:27.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:27 smithi167 ceph-mon[34339]: pgmap v23: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:28.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:28 smithi070 ceph-mon[30942]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:28.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:28 smithi167 ceph-mon[34339]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:28 smithi134 ceph-mon[34525]: pgmap v24: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:29.519 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:31:29.806 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:31:30.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.329+0000 7fb408596640 1 -- 172.21.15.70:0/934910350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 msgr2=0x7fb4001108e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.329+0000 7fb408596640 1 --2- 172.21.15.70:0/934910350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 0x7fb4001108e0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8009ca0 tx=0x7fb3f802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 -- 172.21.15.70:0/934910350 shutdown_connections 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 --2- 172.21.15.70:0/934910350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 0x7fb4001108e0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 --2- 172.21.15.70:0/934910350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb400101360 0x7fb40010df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 --2- 172.21.15.70:0/934910350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb4001009b0 0x7fb400100d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 -- 172.21.15.70:0/934910350 >> 172.21.15.70:0/934910350 conn(0x7fb4000fc7d0 msgr2=0x7fb4000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 -- 172.21.15.70:0/934910350 shutdown_connections 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 -- 172.21.15.70:0/934910350 wait complete. 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 Processor -- start 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.330+0000 7fb408596640 1 -- start start 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb408596640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4001009b0 0x7fb40019a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb408596640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb400101360 0x7fb40019abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb408596640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 0x7fb40019ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb408596640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb400114210 con 0x7fb40010e4d0 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb408596640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb400114090 con 0x7fb4001009b0 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb408596640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb400114390 con 0x7fb400101360 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406b33640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 0x7fb40019ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406b33640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 0x7fb40019ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38056/0 (socket says 172.21.15.70:38056) 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406b33640 1 -- 172.21.15.70:0/885519390 learned_addr learned my addr 172.21.15.70:0/885519390 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb405b31640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb400101360 0x7fb40019abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406332640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4001009b0 0x7fb40019a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406b33640 1 -- 172.21.15.70:0/885519390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb400101360 msgr2=0x7fb40019abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406b33640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb400101360 0x7fb40019abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406b33640 1 -- 172.21.15.70:0/885519390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4001009b0 msgr2=0x7fb40019a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406b33640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4001009b0 0x7fb40019a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.331+0000 7fb406b33640 1 -- 172.21.15.70:0/885519390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb40019f640 con 0x7fb40010e4d0 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.332+0000 7fb406b33640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 0x7fb40019ef60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8033040 tx=0x7fb3f8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.332+0000 7fb3f77fe640 1 -- 172.21.15.70:0/885519390 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f80316d0 con 0x7fb40010e4d0 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.332+0000 7fb408596640 1 -- 172.21.15.70:0/885519390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb40019f8d0 con 0x7fb40010e4d0 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.332+0000 7fb408596640 1 -- 172.21.15.70:0/885519390 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4001a7210 con 0x7fb40010e4d0 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.332+0000 7fb3f77fe640 1 -- 172.21.15.70:0/885519390 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb3f8031870 con 0x7fb40010e4d0 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.332+0000 7fb3f77fe640 1 -- 172.21.15.70:0/885519390 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f802fca0 con 0x7fb40010e4d0 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.334+0000 7fb40a96f740 1 Processor -- start 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.335+0000 7fb3f77fe640 1 -- 172.21.15.70:0/885519390 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7fb3f80305c0 con 0x7fb40010e4d0 2024-09-19T04:31:30.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.335+0000 7fb40a96f740 1 -- start start 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf79880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf79dc0 0x564e9cf84140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf84680 0x564e9cf86a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb40a96f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564e9cedf2e0 con 0x564e9cf84680 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb40a96f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e9ce86ce0 con 0x564e9cf79dc0 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb40a96f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564e9cedb2a0 con 0x564e9cf794a0 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf84680 0x564e9cf86a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf84680 0x564e9cf86a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38062/0 (socket says 172.21.15.70:38062) 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 -- 172.21.15.70:0/2695969518 learned_addr learned my addr 172.21.15.70:0/2695969518 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf79880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb406332640 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf79dc0 0x564e9cf84140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb3f77fe640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb3ec0a35e0 0x7fb3ec0a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 -- 172.21.15.70:0/2695969518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 msgr2=0x564e9cf79880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf79880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 -- 172.21.15.70:0/2695969518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf79dc0 msgr2=0x564e9cf84140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf79dc0 0x564e9cf84140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb405b31640 1 -- 172.21.15.70:0/2695969518 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e9ce6b440 con 0x564e9cf84680 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.336+0000 7fb3f77fe640 1 -- 172.21.15.70:0/885519390 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fb3f80f1360 con 0x7fb40010e4d0 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.337+0000 7fb406b33640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb3ec0a35e0 0x7fb3ec0a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.337+0000 7fb405b31640 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf84680 0x564e9cf86a70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00126a0 tx=0x7fb3f000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e29da0c12ad6f560 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.337+0000 7fb406b33640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb3ec0a35e0 0x7fb3ec0a5aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3f80eea00 tx=0x7fb3f803e040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.337+0000 7fb3f4ff9640 1 -- 172.21.15.70:0/2695969518 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0004020 con 0x564e9cf84680 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.338+0000 7fb3f4ff9640 1 -- 172.21.15.70:0/2695969518 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb3f00041c0 con 0x564e9cf84680 2024-09-19T04:31:30.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.338+0000 7fb3f4ff9640 1 -- 172.21.15.70:0/2695969518 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f001f790 con 0x564e9cf84680 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.338+0000 7fb40a96f740 1 -- 172.21.15.70:0/2695969518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf84680 msgr2=0x564e9cf86a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.338+0000 7fb40a96f740 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf84680 0x564e9cf86a70 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fb3f00126a0 tx=0x7fb3f000b650 comp rx=0 tx=0).stop 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 -- 172.21.15.70:0/2695969518 shutdown_connections 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf84680 0x564e9cf86a70 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf79dc0 0x564e9cf84140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 --2- 172.21.15.70:0/2695969518 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf79880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 -- 172.21.15.70:0/2695969518 >> 172.21.15.70:0/2695969518 conn(0x564e9cf75a30 msgr2=0x564e9cf75e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 -- 172.21.15.70:0/2695969518 shutdown_connections 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 -- 172.21.15.70:0/2695969518 wait complete. 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 -- start start 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 Processor -- start 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf83f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf79dc0 0x564e9cf81220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf81760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564e9cf87250 con 0x564e9cf79dc0 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.339+0000 7fb40a96f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e9ce9a050 con 0x564e9cf84680 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb40a96f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564e9cf873d0 con 0x564e9cf794a0 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb40a96f740 10 client.0 _ll_register_callbacks cb 0x564e9ceda160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb405b31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf83f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf79dc0 0x564e9cf81220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf79dc0 0x564e9cf81220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38078/0 (socket says 172.21.15.70:38078) 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb405b31640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf83f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:34834/0 (socket says 172.21.15.70:34834) 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 -- 172.21.15.70:0/20535243 learned_addr learned my addr 172.21.15.70:0/20535243 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:30.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb405b31640 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf81760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 -- 172.21.15.70:0/20535243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 msgr2=0x564e9cf83f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf83f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 -- 172.21.15.70:0/20535243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 msgr2=0x564e9cf81760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf81760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 -- 172.21.15.70:0/20535243 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e9cc503c0 con 0x564e9cf79dc0 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb406332640 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf79dc0 0x564e9cf81220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00be40 tx=0x7fb3fc0039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf57266767dae1e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb3e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.340+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/20535243 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3fc005020 con 0x564e9cf79dc0 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.341+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/20535243 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fb3fc0051c0 con 0x564e9cf79dc0 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.341+0000 7fb40a96f740 1 -- 172.21.15.70:0/20535243 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f00041c0 con 0x564e9cf79dc0 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.341+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/20535243 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb3fc005400 con 0x564e9cf79dc0 2024-09-19T04:31:30.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.341+0000 7fb40a96f740 10 client.15366 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.341+0000 7fb40a96f740 1 -- 172.21.15.70:0/20535243 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564e9cf92cb0 con 0x564e9cf79dc0 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.341+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/20535243 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb3fc0055a0 con 0x564e9cf79dc0 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.342+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/20535243 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb3fc022020 con 0x564e9cf79dc0 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.342+0000 7fb40a96f740 10 client.15366 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.342+0000 7fb40a96f740 10 client.15366 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.342+0000 7fb40a96f740 20 client.15366 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.342+0000 7fb40a96f740 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e9cf94110 0x564e9cf96500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.342+0000 7fb40a96f740 4 client.15366 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.342+0000 7fb40a96f740 1 -- 172.21.15.70:0/20535243 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb3f00041c0 con 0x564e9cf94110 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.342+0000 7fb405b31640 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e9cf94110 0x564e9cf96500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.343+0000 7fb405b31640 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e9cf94110 0x564e9cf96500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8edb209d6d403e5 server_cookie=743761ceef10f24a in_seq=0 out_seq=0 2024-09-19T04:31:30.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.343+0000 7fb3e9ffb640 10 client.15366 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.343+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/20535243 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x7fb3f00041c0 con 0x564e9cf94110 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.343+0000 7fb3e9ffb640 10 client.15366 handle_command_reply: tid=0 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.343+0000 7fb40a96f740 1 client.15366 shutdown 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 -- 172.21.15.70:0/20535243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf79dc0 msgr2=0x564e9cf81220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf79dc0 0x564e9cf81220 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fb3fc00be40 tx=0x7fb3fc0039c0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 -- 172.21.15.70:0/20535243 shutdown_connections 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e9cf94110 0x564e9cf96500 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf81760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb3e9ffb640 0 client.15366 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf79dc0 0x564e9cf81220 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 --2- 172.21.15.70:0/20535243 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf794a0 0x564e9cf83f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 -- 172.21.15.70:0/20535243 >> 172.21.15.70:0/20535243 conn(0x564e9cf75a30 msgr2=0x564e9cf7b710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:30.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 -- 172.21.15.70:0/20535243 shutdown_connections 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 1 -- 172.21.15.70:0/20535243 wait complete. 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.344+0000 7fb40a96f740 20 client.15366 trim_cache size 0 max 16384 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb40a96f740 1 Processor -- start 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb40a96f740 1 -- start start 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf90540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 0x564e9cf9bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf9c310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb40a96f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e4010dd0 con 0x564e9cf794a0 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb40a96f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e400e6a0 con 0x564e9cf84680 2024-09-19T04:31:30.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb40a96f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e400c5a0 con 0x564e9cf79dc0 2024-09-19T04:31:30.398 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:31:30.398 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:31:30.398 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:31:30.398 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:31:30.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb405b31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf90540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb405b31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf90540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38090/0 (socket says 172.21.15.70:38090) 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb405b31640 1 -- 172.21.15.70:0/2941486457 learned_addr learned my addr 172.21.15.70:0/2941486457 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb406332640 1 --2- 172.21.15.70:0/2941486457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 0x564e9cf9bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb405b31640 1 -- 172.21.15.70:0/2941486457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 msgr2=0x564e9cf9bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb405b31640 1 --2- 172.21.15.70:0/2941486457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 0x564e9cf9bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb405b31640 1 -- 172.21.15.70:0/2941486457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 msgr2=0x564e9cf9c310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb405b31640 1 --2- 172.21.15.70:0/2941486457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf9c310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.376+0000 7fb405b31640 1 -- 172.21.15.70:0/2941486457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e9cf792d0 con 0x564e9cf794a0 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.377+0000 7fb405b31640 1 --2- 172.21.15.70:0/2941486457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf90540 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0014010 tx=0x7fb3f000b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba5bde42e14dd81 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.377+0000 7fb3ebfff640 1 -- 172.21.15.70:0/2941486457 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f00041c0 con 0x564e9cf794a0 2024-09-19T04:31:30.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.377+0000 7fb3ebfff640 1 -- 172.21.15.70:0/2941486457 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb3f0016070 con 0x564e9cf794a0 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.377+0000 7fb3ebfff640 1 -- 172.21.15.70:0/2941486457 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f0010420 con 0x564e9cf794a0 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 -- 172.21.15.70:0/2941486457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 msgr2=0x564e9cf90540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 --2- 172.21.15.70:0/2941486457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf90540 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb3f0014010 tx=0x7fb3f000b650 comp rx=0 tx=0).stop 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 -- 172.21.15.70:0/2941486457 shutdown_connections 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 --2- 172.21.15.70:0/2941486457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf9c310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 --2- 172.21.15.70:0/2941486457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 0x564e9cf9bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 --2- 172.21.15.70:0/2941486457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf90540 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 -- 172.21.15.70:0/2941486457 >> 172.21.15.70:0/2941486457 conn(0x564e9cf75a30 msgr2=0x564e9cf7faf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 -- 172.21.15.70:0/2941486457 shutdown_connections 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.378+0000 7fb40a96f740 1 -- 172.21.15.70:0/2941486457 wait complete. 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 1 -- start start 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 1 Processor -- start 2024-09-19T04:31:30.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf88580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 0x564e9cf88ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf89000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e400cb60 con 0x564e9cf794a0 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e400dfd0 con 0x564e9cf84680 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3e400d230 con 0x564e9cf79dc0 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb40a96f740 10 client.0 _ll_register_callbacks cb 0x7fb3fc0040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb405b31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf88580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb405b31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf88580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38094/0 (socket says 172.21.15.70:38094) 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb405b31640 1 -- 172.21.15.70:0/3832344561 learned_addr learned my addr 172.21.15.70:0/3832344561 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb406332640 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 0x564e9cf88ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb405b31640 1 -- 172.21.15.70:0/3832344561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 msgr2=0x564e9cf88ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb405b31640 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 0x564e9cf88ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb405b31640 1 -- 172.21.15.70:0/3832344561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 msgr2=0x564e9cf89000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb405b31640 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf89000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.379+0000 7fb405b31640 1 -- 172.21.15.70:0/3832344561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e9cffdf40 con 0x564e9cf794a0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.380+0000 7fb405b31640 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf88580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb3f001fb40 tx=0x7fb3f0012480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a6e24386060b4c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.380+0000 7fb3e9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.380+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/3832344561 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3f00041c0 con 0x564e9cf794a0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.380+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/3832344561 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fb3f0004360 con 0x564e9cf794a0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.380+0000 7fb40a96f740 1 -- 172.21.15.70:0/3832344561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3f0016070 con 0x564e9cf794a0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.380+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/3832344561 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fb3f001f520 con 0x564e9cf794a0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.380+0000 7fb40a96f740 10 client.15372 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.380+0000 7fb40a96f740 1 -- 172.21.15.70:0/3832344561 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x564e9cfff1f0 con 0x564e9cf794a0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/3832344561 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb3f0005510 con 0x564e9cf794a0 2024-09-19T04:31:30.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/3832344561 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fb3f0035030 con 0x564e9cf794a0 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb40a96f740 10 client.15372 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb40a96f740 10 client.15372 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb40a96f740 20 client.15372 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb40a96f740 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e9cf94110 0x564e9d001620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb40a96f740 4 client.15372 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb40a96f740 1 -- 172.21.15.70:0/3832344561 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7fb3f0016070 con 0x564e9cf94110 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.381+0000 7fb406332640 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e9cf94110 0x564e9d001620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb3e9ffb640 10 client.15372 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb406332640 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e9cf94110 0x564e9d001620 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aae15e87b8876623 server_cookie=8d3d7a0c493bc7e3 in_seq=0 out_seq=0 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb3e9ffb640 1 -- 172.21.15.70:0/3832344561 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7fb3f0016070 con 0x564e9cf94110 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb3e9ffb640 10 client.15372 handle_command_reply: tid=0 2024-09-19T04:31:30.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 client.15372 shutdown 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 -- 172.21.15.70:0/3832344561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 msgr2=0x564e9cf88580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf88580 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fb3f001fb40 tx=0x7fb3f0012480 comp rx=0 tx=0).stop 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 -- 172.21.15.70:0/3832344561 shutdown_connections 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e9cf94110 0x564e9d001620 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e9cf84680 0x564e9cf89000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb3e9ffb640 0 client.15372 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e9cf79dc0 0x564e9cf88ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 --2- 172.21.15.70:0/3832344561 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e9cf794a0 0x564e9cf88580 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 -- 172.21.15.70:0/3832344561 >> 172.21.15.70:0/3832344561 conn(0x564e9cf75a30 msgr2=0x564e9cf832a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 -- 172.21.15.70:0/3832344561 shutdown_connections 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 1 -- 172.21.15.70:0/3832344561 wait complete. 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.382+0000 7fb40a96f740 20 client.15372 trim_cache size 0 max 16384 2024-09-19T04:31:30.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 -- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb3ec0a35e0 msgr2=0x7fb3ec0a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb3ec0a35e0 0x7fb3ec0a5aa0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb3f80eea00 tx=0x7fb3f803e040 comp rx=0 tx=0).stop 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 -- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 msgr2=0x7fb40019ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 0x7fb40019ef60 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fb3f8033040 tx=0x7fb3f8003f10 comp rx=0 tx=0).stop 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 -- 172.21.15.70:0/885519390 shutdown_connections 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb3ec0a35e0 0x7fb3ec0a5aa0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb40010e4d0 0x7fb40019ef60 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb400101360 0x7fb40019abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 --2- 172.21.15.70:0/885519390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4001009b0 0x7fb40019a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 -- 172.21.15.70:0/885519390 >> 172.21.15.70:0/885519390 conn(0x7fb4000fc7d0 msgr2=0x7fb4000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 -- 172.21.15.70:0/885519390 shutdown_connections 2024-09-19T04:31:30.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:30.383+0000 7fb408596640 1 -- 172.21.15.70:0/885519390 wait complete. 2024-09-19T04:31:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:31 smithi070 ceph-mon[30942]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:31.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:31 smithi167 ceph-mon[34339]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:32.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:31 smithi134 ceph-mon[34525]: pgmap v25: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:33.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:33 smithi070 ceph-mon[30942]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:33.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:33 smithi167 ceph-mon[34339]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:33 smithi134 ceph-mon[34525]: pgmap v26: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:35.450 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:31:35.450 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:31:35.725 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:31:35.847 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:35 smithi070 ceph-mon[30942]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:35.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:35 smithi167 ceph-mon[34339]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:35 smithi134 ceph-mon[34525]: pgmap v27: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 -- 172.21.15.70:0/1529633173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 msgr2=0x7f8d6c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 --2- 172.21.15.70:0/1529633173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 0x7f8d6c101200 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c009900 tx=0x7f8d5c02a480 comp rx=0 tx=0).stop 2024-09-19T04:31:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 -- 172.21.15.70:0/1529633173 shutdown_connections 2024-09-19T04:31:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 --2- 172.21.15.70:0/1529633173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d6c102ef0 0x7f8d6c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 --2- 172.21.15.70:0/1529633173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6c102570 0x7f8d6c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 --2- 172.21.15.70:0/1529633173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 0x7f8d6c101200 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 -- 172.21.15.70:0/1529633173 >> 172.21.15.70:0/1529633173 conn(0x7f8d6c0fc7d0 msgr2=0x7f8d6c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:36.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 -- 172.21.15.70:0/1529633173 shutdown_connections 2024-09-19T04:31:36.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.230+0000 7f8d72022640 1 -- 172.21.15.70:0/1529633173 wait complete. 2024-09-19T04:31:36.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.231+0000 7f8d72022640 1 Processor -- start 2024-09-19T04:31:36.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.231+0000 7f8d72022640 1 -- start start 2024-09-19T04:31:36.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.231+0000 7f8d72022640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 0x7f8d6c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:36.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.231+0000 7f8d72022640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6c102570 0x7f8d6c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:36.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.231+0000 7f8d72022640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d6c102ef0 0x7f8d6c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:36.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 0x7f8d6c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:36.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 0x7f8d6c197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59406/0 (socket says 172.21.15.70:59406) 2024-09-19T04:31:36.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6c102570 0x7f8d6c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6affd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6c102570 0x7f8d6c197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:45898/0 (socket says 172.21.15.70:45898) 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6affd640 1 -- 172.21.15.70:0/504484728 learned_addr learned my addr 172.21.15.70:0/504484728 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6bfff640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d6c102ef0 0x7f8d6c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c110f50 con 0x7f8d6c100e20 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c110dd0 con 0x7f8d6c102ef0 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d6c1110d0 con 0x7f8d6c102570 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6bfff640 1 -- 172.21.15.70:0/504484728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6c102570 msgr2=0x7f8d6c197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6bfff640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6c102570 0x7f8d6c197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.232+0000 7f8d6bfff640 1 -- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 msgr2=0x7f8d6c197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.233+0000 7f8d6bfff640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 0x7f8d6c197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.233+0000 7f8d6bfff640 1 -- 172.21.15.70:0/504484728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6c19c3f0 con 0x7f8d6c102ef0 2024-09-19T04:31:36.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.233+0000 7f8d6bfff640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d6c102ef0 0x7f8d6c19bd10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009fd0 tx=0x7f8d6400ef10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:36.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.233+0000 7f8d68ff9640 1 -- 172.21.15.70:0/504484728 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d6400ce20 con 0x7f8d6c102ef0 2024-09-19T04:31:36.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.233+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d6c19c6e0 con 0x7f8d6c102ef0 2024-09-19T04:31:36.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.233+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d6c069f70 con 0x7f8d6c102ef0 2024-09-19T04:31:36.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.233+0000 7f8d68ff9640 1 -- 172.21.15.70:0/504484728 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8d640137d0 con 0x7f8d6c102ef0 2024-09-19T04:31:36.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.233+0000 7f8d68ff9640 1 -- 172.21.15.70:0/504484728 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d640055e0 con 0x7f8d6c102ef0 2024-09-19T04:31:36.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.235+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d58005290 con 0x7f8d6c102ef0 2024-09-19T04:31:36.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.237+0000 7f8d68ff9640 1 -- 172.21.15.70:0/504484728 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f8d64005880 con 0x7f8d6c102ef0 2024-09-19T04:31:36.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.237+0000 7f8d68ff9640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d540a35e0 0x7f8d540a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:36.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.237+0000 7f8d68ff9640 1 -- 172.21.15.70:0/504484728 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8d640d4510 con 0x7f8d6c102ef0 2024-09-19T04:31:36.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.238+0000 7f8d6b7fe640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d540a35e0 0x7f8d540a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:36.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.238+0000 7f8d6b7fe640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d540a35e0 0x7f8d540a5aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c006010 tx=0x7f8d5c000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:36.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.240+0000 7f8d68ff9640 1 -- 172.21.15.70:0/504484728 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f8d640a0de0 con 0x7f8d6c102ef0 2024-09-19T04:31:36.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.467+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d58005580 con 0x7f8d6c102ef0 2024-09-19T04:31:36.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.468+0000 7f8d68ff9640 1 -- 172.21.15.70:0/504484728 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 24 v24) ==== 94+0+11914 (secure 0 0 0) 0x7f8d640a06e0 con 0x7f8d6c102ef0 2024-09-19T04:31:36.470 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:31:36.471 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":24,"btime":"2024-09-19T04:30:48:492398+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":24,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:30:48.082662+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:31:36.471 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 24 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.470+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d540a35e0 msgr2=0x7f8d540a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.470+0000 7f8d72022640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d540a35e0 0x7f8d540a5aa0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f8d5c006010 tx=0x7f8d5c000bc0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d6c102ef0 msgr2=0x7f8d6c19bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d6c102ef0 0x7f8d6c19bd10 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f8d64009fd0 tx=0x7f8d6400ef10 comp rx=0 tx=0).stop 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 shutdown_connections 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d540a35e0 0x7f8d540a5aa0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d6c102ef0 0x7f8d6c19bd10 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d6c102570 0x7f8d6c197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 --2- 172.21.15.70:0/504484728 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d6c100e20 0x7f8d6c197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 >> 172.21.15.70:0/504484728 conn(0x7f8d6c0fc7d0 msgr2=0x7f8d6c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 shutdown_connections 2024-09-19T04:31:36.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:36.471+0000 7f8d72022640 1 -- 172.21.15.70:0/504484728 wait complete. 2024-09-19T04:31:36.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:36 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/504484728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:31:36.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:36 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/504484728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:31:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:36 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/504484728' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:31:37.195 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:31:37.477 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:31:37.585 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:37 smithi070 ceph-mon[30942]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:37.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:37 smithi167 ceph-mon[34339]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:37 smithi134 ceph-mon[34525]: pgmap v28: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:38.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.048+0000 7f4e585a1640 1 -- 172.21.15.70:0/3414443934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 msgr2=0x7f4e501029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.048+0000 7f4e585a1640 1 --2- 172.21.15.70:0/3414443934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 0x7f4e501029b0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f4e40009900 tx=0x7f4e4002a480 comp rx=0 tx=0).stop 2024-09-19T04:31:38.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.049+0000 7f4e585a1640 1 -- 172.21.15.70:0/3414443934 shutdown_connections 2024-09-19T04:31:38.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.049+0000 7f4e585a1640 1 --2- 172.21.15.70:0/3414443934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102ef0 0x7f4e5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.049+0000 7f4e585a1640 1 --2- 172.21.15.70:0/3414443934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 0x7f4e501029b0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.049+0000 7f4e585a1640 1 --2- 172.21.15.70:0/3414443934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50100e20 0x7f4e50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.049+0000 7f4e585a1640 1 -- 172.21.15.70:0/3414443934 >> 172.21.15.70:0/3414443934 conn(0x7f4e500fc7d0 msgr2=0x7f4e500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:38.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.049+0000 7f4e585a1640 1 -- 172.21.15.70:0/3414443934 shutdown_connections 2024-09-19T04:31:38.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.049+0000 7f4e585a1640 1 -- 172.21.15.70:0/3414443934 wait complete. 2024-09-19T04:31:38.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e585a1640 1 Processor -- start 2024-09-19T04:31:38.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e585a1640 1 -- start start 2024-09-19T04:31:38.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e585a1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50100e20 0x7f4e50197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e585a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 0x7f4e50197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e585a1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102ef0 0x7f4e5019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e585a1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110f50 con 0x7f4e50102570 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e585a1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e50110dd0 con 0x7f4e50100e20 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e585a1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501110d0 con 0x7f4e50102ef0 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.050+0000 7f4e55b3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 0x7f4e50197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e55b3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 0x7f4e50197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59422/0 (socket says 172.21.15.70:59422) 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e55b3c640 1 -- 172.21.15.70:0/556055288 learned_addr learned my addr 172.21.15.70:0/556055288 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e5633d640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50100e20 0x7f4e50197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102ef0 0x7f4e5019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e55b3c640 1 -- 172.21.15.70:0/556055288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102ef0 msgr2=0x7f4e5019bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102ef0 0x7f4e5019bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e55b3c640 1 -- 172.21.15.70:0/556055288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50100e20 msgr2=0x7f4e50197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50100e20 0x7f4e50197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e55b3c640 1 -- 172.21.15.70:0/556055288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4e5019c3f0 con 0x7f4e50102570 2024-09-19T04:31:38.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 0x7f4e50197980 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e40004770 tx=0x7f4e400042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:38.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e477fe640 1 -- 172.21.15.70:0/556055288 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e4003f030 con 0x7f4e50102570 2024-09-19T04:31:38.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.051+0000 7f4e477fe640 1 -- 172.21.15.70:0/556055288 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e40003ac0 con 0x7f4e50102570 2024-09-19T04:31:38.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.052+0000 7f4e585a1640 1 -- 172.21.15.70:0/556055288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4e5019c680 con 0x7f4e50102570 2024-09-19T04:31:38.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.052+0000 7f4e477fe640 1 -- 172.21.15.70:0/556055288 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40035070 con 0x7f4e50102570 2024-09-19T04:31:38.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.052+0000 7f4e585a1640 1 -- 172.21.15.70:0/556055288 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4e50069f70 con 0x7f4e50102570 2024-09-19T04:31:38.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.055+0000 7f4e477fe640 1 -- 172.21.15.70:0/556055288 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f4e40042030 con 0x7f4e50102570 2024-09-19T04:31:38.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.055+0000 7f4e5a97a740 1 Processor -- start 2024-09-19T04:31:38.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.055+0000 7f4e5a97a740 1 -- start start 2024-09-19T04:31:38.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394800090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f3948005d0 0x55f394800a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f39480b370 0x55f39480d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f3947662f0 con 0x55f39480b370 2024-09-19T04:31:38.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f39470dcf0 con 0x55f3948005d0 2024-09-19T04:31:38.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f3947622b0 con 0x55f394801b40 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e55b3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f39480b370 0x55f39480d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e55b3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f39480b370 0x55f39480d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59428/0 (socket says 172.21.15.70:59428) 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e55b3c640 1 -- 172.21.15.70:0/3397236667 learned_addr learned my addr 172.21.15.70:0/3397236667 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394800090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e5633d640 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f3948005d0 0x55f394800a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e477fe640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4e3c0a3730 0x7f4e3c0a5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.056+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4e3c0a3730 0x7f4e3c0a5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e56b3e640 1 -- 172.21.15.70:0/3397236667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f3948005d0 msgr2=0x55f394800a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f3948005d0 0x55f394800a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e56b3e640 1 -- 172.21.15.70:0/3397236667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f39480b370 msgr2=0x55f39480d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:38.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f39480b370 0x55f39480d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e56b3e640 1 -- 172.21.15.70:0/3397236667 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3946f23a0 con 0x55f394801b40 2024-09-19T04:31:38.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394800090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e48005fd0 tx=0x7f4e4800ea70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=58d1abd7f78c9624 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:38.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e477fe640 1 -- 172.21.15.70:0/556055288 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4e400f0390 con 0x7f4e50102570 2024-09-19T04:31:38.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4e3c0a3730 0x7f4e3c0a5bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e48024000 tx=0x7f4e48025000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:38.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e44ff9640 1 -- 172.21.15.70:0/3397236667 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48003b70 con 0x55f394801b40 2024-09-19T04:31:38.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e44ff9640 1 -- 172.21.15.70:0/3397236667 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e48003d10 con 0x55f394801b40 2024-09-19T04:31:38.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.057+0000 7f4e44ff9640 1 -- 172.21.15.70:0/3397236667 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48028760 con 0x55f394801b40 2024-09-19T04:31:38.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.058+0000 7f4e5a97a740 1 -- 172.21.15.70:0/3397236667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 msgr2=0x55f394800090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.058+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394800090 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f4e48005fd0 tx=0x7f4e4800ea70 comp rx=0 tx=0).stop 2024-09-19T04:31:38.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.058+0000 7f4e5a97a740 1 -- 172.21.15.70:0/3397236667 shutdown_connections 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.058+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f39480b370 0x55f39480d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.058+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f3948005d0 0x55f394800a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.058+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/3397236667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394800090 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.058+0000 7f4e5a97a740 1 -- 172.21.15.70:0/3397236667 >> 172.21.15.70:0/3397236667 conn(0x55f3947c9310 msgr2=0x55f3947fcc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.059+0000 7f4e5a97a740 1 -- 172.21.15.70:0/3397236667 shutdown_connections 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.059+0000 7f4e5a97a740 1 -- 172.21.15.70:0/3397236667 wait complete. 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.059+0000 7f4e5a97a740 1 -- start start 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.059+0000 7f4e5a97a740 1 Processor -- start 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.059+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f39480adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.059+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f394808060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948087f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f39480dfb0 con 0x55f394801b40 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f394721060 con 0x55f39480b370 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f39480e130 con 0x55f3948005d0 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f394808060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f394808060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59436/0 (socket says 172.21.15.70:59436) 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 -- 172.21.15.70:0/15539132 learned_addr learned my addr 172.21.15.70:0/15539132 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e5a97a740 10 client.0 _ll_register_callbacks cb 0x55f3944748c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e5633d640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f39480adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948087f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 -- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 msgr2=0x55f39480adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:38.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f39480adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 -- 172.21.15.70:0/15539132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 msgr2=0x55f3948087f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:38.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948087f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 -- 172.21.15.70:0/15539132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f3944d73c0 con 0x55f394801b40 2024-09-19T04:31:38.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e5633d640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f39480adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:31:38.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f394808060 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005940 tx=0x7f4e400f3ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad2fd2a788a159c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e39ffb640 1 -- 172.21.15.70:0/15539132 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40049040 con 0x55f394801b40 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e5a97a740 1 -- 172.21.15.70:0/15539132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e48003d10 con 0x55f394801b40 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.060+0000 7f4e39ffb640 1 -- 172.21.15.70:0/15539132 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4e400035f0 con 0x55f394801b40 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e39ffb640 1 -- 172.21.15.70:0/15539132 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e400b87a0 con 0x55f394801b40 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5a97a740 10 client.15390 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5a97a740 1 -- 172.21.15.70:0/15539132 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f394819aa0 con 0x55f394801b40 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e39ffb640 1 -- 172.21.15.70:0/15539132 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e48003d10 con 0x55f394801b40 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e39ffb640 1 -- 172.21.15.70:0/15539132 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4e400f0070 con 0x55f394801b40 2024-09-19T04:31:38.068 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5a97a740 10 client.15390 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5a97a740 10 client.15390 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5a97a740 20 client.15390 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55f39481b180 0x55f39481d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5a97a740 4 client.15390 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5a97a740 1 -- 172.21.15.70:0/15539132 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f394773860 con 0x55f39481b180 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.061+0000 7f4e5633d640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55f39481b180 0x55f39481d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.062+0000 7f4e5633d640 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55f39481b180 0x55f39481d5c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=da8bfa734da2f08d server_cookie=5557f211ac4c8d58 in_seq=0 out_seq=0 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.062+0000 7f4e39ffb640 10 client.15390 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e39ffb640 1 -- 172.21.15.70:0/15539132 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f394773860 con 0x55f39481b180 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e39ffb640 10 client.15390 handle_command_reply: tid=0 2024-09-19T04:31:38.069 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 client.15390 shutdown 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 -- 172.21.15.70:0/15539132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 msgr2=0x55f394808060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f394808060 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f4e40005940 tx=0x7f4e400f3ab0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 -- 172.21.15.70:0/15539132 shutdown_connections 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55f39481b180 0x55f39481d5c0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948087f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f394808060 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/15539132 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f39480adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e39ffb640 0 client.15390 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:31:38.070 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 -- 172.21.15.70:0/15539132 >> 172.21.15.70:0/15539132 conn(0x55f3947c9310 msgr2=0x55f394802960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:38.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 -- 172.21.15.70:0/15539132 shutdown_connections 2024-09-19T04:31:38.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 1 -- 172.21.15.70:0/15539132 wait complete. 2024-09-19T04:31:38.071 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.063+0000 7f4e5a97a740 20 client.15390 trim_cache size 0 max 16384 2024-09-19T04:31:38.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.076+0000 7f4e5a97a740 1 Processor -- start 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.076+0000 7f4e5a97a740 1 -- start start 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.076+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3948005d0 0x55f394807920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.076+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394822e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.076+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501adde0 con 0x55f3948005d0 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501ab6b0 con 0x55f39480b370 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501a9520 con 0x55f394801b40 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e5633d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3948005d0 0x55f394807920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e55b3c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394822e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e55b3c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394822e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:45942/0 (socket says 172.21.15.70:45942) 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e55b3c640 1 -- 172.21.15.70:0/4068742355 learned_addr learned my addr 172.21.15.70:0/4068742355 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:38.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e55b3c640 1 -- 172.21.15.70:0/4068742355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 msgr2=0x55f3948233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:38.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e55b3c640 1 -- 172.21.15.70:0/4068742355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3948005d0 msgr2=0x55f394807920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3948005d0 0x55f394807920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e55b3c640 1 -- 172.21.15.70:0/4068742355 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f3947fb310 con 0x55f394801b40 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.077+0000 7f4e5633d640 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3948005d0 0x55f394807920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.078+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394822e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e4003b510 tx=0x7f4e40032ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9eb35d4ea89ad42b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.078+0000 7f4e3bfff640 1 -- 172.21.15.70:0/4068742355 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e40049070 con 0x55f394801b40 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.078+0000 7f4e3bfff640 1 -- 172.21.15.70:0/4068742355 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e400047a0 con 0x55f394801b40 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.078+0000 7f4e3bfff640 1 -- 172.21.15.70:0/4068742355 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e400bbe60 con 0x55f394801b40 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.079+0000 7f4e5a97a740 1 -- 172.21.15.70:0/4068742355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 msgr2=0x55f394822e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.079+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394822e90 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e4003b510 tx=0x7f4e40032ab0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.079+0000 7f4e5a97a740 1 -- 172.21.15.70:0/4068742355 shutdown_connections 2024-09-19T04:31:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.079+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f3948233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.079+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f394801b40 0x55f394822e90 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.079+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/4068742355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f3948005d0 0x55f394807920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.079+0000 7f4e5a97a740 1 -- 172.21.15.70:0/4068742355 >> 172.21.15.70:0/4068742355 conn(0x55f3947c9310 msgr2=0x55f394806930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.079+0000 7f4e5a97a740 1 -- 172.21.15.70:0/4068742355 shutdown_connections 2024-09-19T04:31:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.080+0000 7f4e5a97a740 1 -- 172.21.15.70:0/4068742355 wait complete. 2024-09-19T04:31:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.080+0000 7f4e5a97a740 1 -- start start 2024-09-19T04:31:38.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.080+0000 7f4e5a97a740 1 Processor -- start 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f394813c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f39480ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5a97a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f39480f540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501a9b70 con 0x55f394801b40 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5a97a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501aafe0 con 0x55f39480b370 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5633d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f394813c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5633d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f394813c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:45946/0 (socket says 172.21.15.70:45946) 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5633d640 1 -- 172.21.15.70:0/2909397732 learned_addr learned my addr 172.21.15.70:0/2909397732 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4e501aa240 con 0x55f3948005d0 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.081+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f39480f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e5a97a740 10 client.0 _ll_register_callbacks cb 0x7f4e4003b460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:38.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f39480ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e56b3e640 1 -- 172.21.15.70:0/2909397732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 msgr2=0x55f394813c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f394813c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e56b3e640 1 -- 172.21.15.70:0/2909397732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 msgr2=0x55f39480ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f39480ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e56b3e640 1 -- 172.21.15.70:0/2909397732 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f39480fd70 con 0x55f39480b370 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e5633d640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f394813c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e55b3c640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f39480ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e56b3e640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f39480f540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800ef70 tx=0x7f4e48009f00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cbf86be31507ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e39ffb640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e39ffb640 1 -- 172.21.15.70:0/2909397732 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4e48003c80 con 0x55f39480b370 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4e400047a0 con 0x55f39480b370 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.082+0000 7f4e39ffb640 1 -- 172.21.15.70:0/2909397732 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4e4801d2f0 con 0x55f39480b370 2024-09-19T04:31:38.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.083+0000 7f4e39ffb640 1 -- 172.21.15.70:0/2909397732 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f4e48003e20 con 0x55f39480b370 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.083+0000 7f4e5a97a740 10 client.24923 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.083+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f394885f60 con 0x55f39480b370 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.083+0000 7f4e39ffb640 1 -- 172.21.15.70:0/2909397732 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4e4801d9c0 con 0x55f39480b370 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.084+0000 7f4e39ffb640 1 -- 172.21.15.70:0/2909397732 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f4e48037030 con 0x55f39480b370 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.084+0000 7f4e5a97a740 10 client.24923 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.084+0000 7f4e5a97a740 10 client.24923 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.084+0000 7f4e5a97a740 20 client.24923 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.084+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55f3948864f0 0x55f3948888e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.084+0000 7f4e5a97a740 4 client.24923 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.084+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f4e400047a0 con 0x55f3948864f0 2024-09-19T04:31:38.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.084+0000 7f4e5633d640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55f3948864f0 0x55f3948888e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:38.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e39ffb640 10 client.24923 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5633d640 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55f3948864f0 0x55f3948888e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ca7f6e013e23af7d server_cookie=fafa0f77023630f9 in_seq=0 out_seq=0 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e39ffb640 1 -- 172.21.15.70:0/2909397732 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f4e400047a0 con 0x55f3948864f0 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e39ffb640 10 client.24923 handle_command_reply: tid=0 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 client.24923 shutdown 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 msgr2=0x55f39480f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f39480f540 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f4e4800ef70 tx=0x7f4e48009f00 comp rx=0 tx=0).stop 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 shutdown_connections 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55f3948864f0 0x55f3948888e0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f39480b370 0x55f39480f540 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f394801b40 0x55f39480ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 --2- 172.21.15.70:0/2909397732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f3948005d0 0x55f394813c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 >> 172.21.15.70:0/2909397732 conn(0x55f3947c9310 msgr2=0x55f39480a0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:38.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e39ffb640 0 client.24923 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:31:38.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 shutdown_connections 2024-09-19T04:31:38.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 1 -- 172.21.15.70:0/2909397732 wait complete. 2024-09-19T04:31:38.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.085+0000 7f4e5a97a740 20 client.24923 trim_cache size 0 max 16384 2024-09-19T04:31:38.091 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:31:38.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 -- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4e3c0a3730 msgr2=0x7f4e3c0a5bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4e3c0a3730 0x7f4e3c0a5bf0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f4e48024000 tx=0x7f4e48025000 comp rx=0 tx=0).stop 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 -- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 msgr2=0x7f4e50197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 0x7f4e50197980 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f4e40004770 tx=0x7f4e400042f0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 -- 172.21.15.70:0/556055288 shutdown_connections 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4e3c0a3730 0x7f4e3c0a5bf0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4e50102ef0 0x7f4e5019bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4e50102570 0x7f4e50197980 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 --2- 172.21.15.70:0/556055288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e50100e20 0x7f4e50197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 -- 172.21.15.70:0/556055288 >> 172.21.15.70:0/556055288 conn(0x7f4e500fc7d0 msgr2=0x7f4e500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 -- 172.21.15.70:0/556055288 shutdown_connections 2024-09-19T04:31:38.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:38.086+0000 7f4e585a1640 1 -- 172.21.15.70:0/556055288 wait complete. 2024-09-19T04:31:38.847 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:31:39.218 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:31:39.643 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:39 smithi070 ceph-mon[30942]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:39.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 -- 172.21.15.70:0/4072809835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc10e4d0 msgr2=0x7fadcc1108c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 --2- 172.21.15.70:0/4072809835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc10e4d0 0x7fadcc1108c0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fadc4009ca0 tx=0x7fadc402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 -- 172.21.15.70:0/4072809835 shutdown_connections 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 --2- 172.21.15.70:0/4072809835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc10e4d0 0x7fadcc1108c0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 --2- 172.21.15.70:0/4072809835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc1012d0 0x7fadcc10df90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 --2- 172.21.15.70:0/4072809835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc100920 0x7fadcc100d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 -- 172.21.15.70:0/4072809835 >> 172.21.15.70:0/4072809835 conn(0x7fadcc0fc790 msgr2=0x7fadcc0febb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 -- 172.21.15.70:0/4072809835 shutdown_connections 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.726+0000 7fadd1834640 1 -- 172.21.15.70:0/4072809835 wait complete. 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadd1834640 1 Processor -- start 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadd1834640 1 -- start start 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadd1834640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc100920 0x7fadcc19a640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadd1834640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc1012d0 0x7fadcc19ab80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadd1834640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc10e4d0 0x7fadcc19ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadd1834640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc114150 con 0x7fadcc1012d0 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadd1834640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc113fd0 con 0x7fadcc10e4d0 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadd1834640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1142d0 con 0x7fadcc100920 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc1012d0 0x7fadcc19ab80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc1012d0 0x7fadcc19ab80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59490/0 (socket says 172.21.15.70:59490) 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.727+0000 7fadca7fc640 1 -- 172.21.15.70:0/698013492 learned_addr learned my addr 172.21.15.70:0/698013492 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc10e4d0 0x7fadcc19ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadcaffd640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc100920 0x7fadcc19a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadca7fc640 1 -- 172.21.15.70:0/698013492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc100920 msgr2=0x7fadcc19a640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadca7fc640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc100920 0x7fadcc19a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadca7fc640 1 -- 172.21.15.70:0/698013492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc10e4d0 msgr2=0x7fadcc19ef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadca7fc640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc10e4d0 0x7fadcc19ef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadca7fc640 1 -- 172.21.15.70:0/698013492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadcc19f5f0 con 0x7fadcc1012d0 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadca7fc640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc1012d0 0x7fadcc19ab80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fadc000d950 tx=0x7fadc000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadd0832640 1 -- 172.21.15.70:0/698013492 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc0017030 con 0x7fadcc1012d0 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadd1834640 1 -- 172.21.15.70:0/698013492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadcc19f8e0 con 0x7fadcc1012d0 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadd1834640 1 -- 172.21.15.70:0/698013492 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadcc1a71c0 con 0x7fadcc1012d0 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadd0832640 1 -- 172.21.15.70:0/698013492 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadc0004020 con 0x7fadcc1012d0 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.728+0000 7fadd0832640 1 -- 172.21.15.70:0/698013492 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc00047a0 con 0x7fadcc1012d0 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd3c0d740 1 Processor -- start 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd0832640 1 -- 172.21.15.70:0/698013492 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7fadc00041d0 con 0x7fadcc1012d0 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd3c0d740 1 -- start start 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7b2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7b2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7bd370 0x5614bb7bf760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5614bb7182f0 con 0x5614bb7b3b40 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5614bb6bfcf0 con 0x5614bb7bd370 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5614bb7142b0 con 0x5614bb7b25d0 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7b2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7b2a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:45960/0 (socket says 172.21.15.70:45960) 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadcaffd640 1 -- 172.21.15.70:0/2056541258 learned_addr learned my addr 172.21.15.70:0/2056541258 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.732+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7b2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadca7fc640 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7bd370 0x5614bb7bf760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadcb7fe640 1 -- 172.21.15.70:0/2056541258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 msgr2=0x5614bb7b2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7b2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadcb7fe640 1 -- 172.21.15.70:0/2056541258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7bd370 msgr2=0x5614bb7bf760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:39.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7bd370 0x5614bb7bf760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadcb7fe640 1 -- 172.21.15.70:0/2056541258 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614bb6a43a0 con 0x5614bb7b3b40 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadd0832640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadb40a35e0 0x7fadb40a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7b2090 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005e30 tx=0x7fadc40098b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f11649e4984512fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadd0832640 1 -- 172.21.15.70:0/698013492 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fadc00cf930 con 0x7fadcc1012d0 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.733+0000 7fadcaffd640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadb40a35e0 0x7fadb40a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.734+0000 7fadb1ffb640 1 -- 172.21.15.70:0/2056541258 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4031e00 con 0x5614bb7b3b40 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.734+0000 7fadb1ffb640 1 -- 172.21.15.70:0/2056541258 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadc4036030 con 0x5614bb7b3b40 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.734+0000 7fadb1ffb640 1 -- 172.21.15.70:0/2056541258 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4004370 con 0x5614bb7b3b40 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.734+0000 7fadcaffd640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadb40a35e0 0x7fadb40a5aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5614bb7afac0 tx=0x7fadbc009480 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.735+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2056541258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 msgr2=0x5614bb7b2090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.735+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7b2090 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005e30 tx=0x7fadc40098b0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.735+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2056541258 shutdown_connections 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.735+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7bd370 0x5614bb7bf760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.735+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7b2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.735+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/2056541258 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7b2090 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.735+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2056541258 >> 172.21.15.70:0/2056541258 conn(0x5614bb77b310 msgr2=0x5614bb7aec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.735+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2056541258 shutdown_connections 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.736+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2056541258 wait complete. 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.736+0000 7fadd3c0d740 1 -- start start 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.736+0000 7fadd3c0d740 1 Processor -- start 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 0x5614bb7bcd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b3b40 0x5614bb7ba040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7ba6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5614bb7bfe90 con 0x5614bb7bd370 2024-09-19T04:31:39.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5614bb6d3060 con 0x5614bb7b25d0 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5614bb7c0010 con 0x5614bb7b3b40 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadd3c0d740 10 client.0 _ll_register_callbacks cb 0x5614bb4268c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b3b40 0x5614bb7ba040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadca7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b3b40 0x5614bb7ba040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:45964/0 (socket says 172.21.15.70:45964) 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadca7fc640 1 -- 172.21.15.70:0/3321750076 learned_addr learned my addr 172.21.15.70:0/3321750076 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7ba6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadca7fc640 1 -- 172.21.15.70:0/3321750076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 msgr2=0x5614bb7bcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadca7fc640 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 0x5614bb7bcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadca7fc640 1 -- 172.21.15.70:0/3321750076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 msgr2=0x5614bb7ba6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadca7fc640 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7ba6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadca7fc640 1 -- 172.21.15.70:0/3321750076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614bb4893c0 con 0x5614bb7b3b40 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.737+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7ba6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:31:39.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadca7fc640 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b3b40 0x5614bb7ba040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadc00ccf50 tx=0x7fadc009b350 comp rx=0 tx=0).ready entity=mon.1 client_cookie=999516d42fc9c002 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadaaffd640 1 -- 172.21.15.70:0/3321750076 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc009fda0 con 0x5614bb7b3b40 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadd3c0d740 1 -- 172.21.15.70:0/3321750076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc4036030 con 0x5614bb7b3b40 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadaaffd640 1 -- 172.21.15.70:0/3321750076 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fadc009ae40 con 0x5614bb7b3b40 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadaaffd640 1 -- 172.21.15.70:0/3321750076 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fadc00a4660 con 0x5614bb7b3b40 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadd3c0d740 10 client.24949 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadd3c0d740 1 -- 172.21.15.70:0/3321750076 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5614bb7cb990 con 0x5614bb7b3b40 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.738+0000 7fadaaffd640 1 -- 172.21.15.70:0/3321750076 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadc4036030 con 0x5614bb7b3b40 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.739+0000 7fadaaffd640 1 -- 172.21.15.70:0/3321750076 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fadc00cd170 con 0x5614bb7b3b40 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.739+0000 7fadd3c0d740 10 client.24949 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.739+0000 7fadd3c0d740 10 client.24949 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.739+0000 7fadd3c0d740 20 client.24949 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:39.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.739+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5614bb7ccda0 0x5614bb7cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.739+0000 7fadd3c0d740 4 client.24949 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.739+0000 7fadd3c0d740 1 -- 172.21.15.70:0/3321750076 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5614bb725860 con 0x5614bb7ccda0 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.739+0000 7fadcaffd640 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5614bb7ccda0 0x5614bb7cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.740+0000 7fadaaffd640 10 client.24949 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.740+0000 7fadcaffd640 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5614bb7ccda0 0x5614bb7cf1b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=39168ac30986a339 server_cookie=66f632443ee50583 in_seq=0 out_seq=0 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadaaffd640 1 -- 172.21.15.70:0/3321750076 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5614bb725860 con 0x5614bb7ccda0 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadaaffd640 10 client.24949 handle_command_reply: tid=0 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 client.24949 shutdown 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 -- 172.21.15.70:0/3321750076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b3b40 msgr2=0x5614bb7ba040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b3b40 0x5614bb7ba040 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fadc00ccf50 tx=0x7fadc009b350 comp rx=0 tx=0).stop 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 -- 172.21.15.70:0/3321750076 shutdown_connections 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5614bb7ccda0 0x5614bb7cf1b0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadaaffd640 0 client.24949 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:31:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7ba6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b3b40 0x5614bb7ba040 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/3321750076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 0x5614bb7bcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 -- 172.21.15.70:0/3321750076 >> 172.21.15.70:0/3321750076 conn(0x5614bb77b310 msgr2=0x5614bb7b4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 -- 172.21.15.70:0/3321750076 shutdown_connections 2024-09-19T04:31:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.741+0000 7fadd3c0d740 1 -- 172.21.15.70:0/3321750076 wait complete. 2024-09-19T04:31:39.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.742+0000 7fadd3c0d740 20 client.24949 trim_cache size 0 max 16384 2024-09-19T04:31:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.754+0000 7fadd3c0d740 1 Processor -- start 2024-09-19T04:31:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.754+0000 7fadd3c0d740 1 -- start start 2024-09-19T04:31:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7adc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b3b40 0x5614bb7b5120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7b5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1b20e0 con 0x5614bb7bd370 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1af9b0 con 0x5614bb7b3b40 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1ad800 con 0x5614bb7b25d0 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7b5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7b5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59526/0 (socket says 172.21.15.70:59526) 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcb7fe640 1 -- 172.21.15.70:0/2347792932 learned_addr learned my addr 172.21.15.70:0/2347792932 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcb7fe640 1 -- 172.21.15.70:0/2347792932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 msgr2=0x5614bb7adc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcaffd640 1 --2- 172.21.15.70:0/2347792932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7adc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/2347792932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7adc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcb7fe640 1 -- 172.21.15.70:0/2347792932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b3b40 msgr2=0x5614bb7b5120 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/2347792932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b3b40 0x5614bb7b5120 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.755+0000 7fadcb7fe640 1 -- 172.21.15.70:0/2347792932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5614bb7bc8b0 con 0x5614bb7bd370 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.756+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/2347792932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7b5660 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005e30 tx=0x7fadc402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=994a5138570dcc9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.756+0000 7fadb17fa640 1 -- 172.21.15.70:0/2347792932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4053070 con 0x5614bb7bd370 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.756+0000 7fadb17fa640 1 -- 172.21.15.70:0/2347792932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadc4036050 con 0x5614bb7bd370 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.756+0000 7fadb17fa640 1 -- 172.21.15.70:0/2347792932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc404a040 con 0x5614bb7bd370 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2347792932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 msgr2=0x5614bb7b5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/2347792932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7b5660 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7fadc4005e30 tx=0x7fadc402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2347792932 shutdown_connections 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/2347792932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7bd370 0x5614bb7b5660 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/2347792932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b3b40 0x5614bb7b5120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/2347792932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7b25d0 0x5614bb7adc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2347792932 >> 172.21.15.70:0/2347792932 conn(0x5614bb77b310 msgr2=0x5614bb7ad500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2347792932 shutdown_connections 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 -- 172.21.15.70:0/2347792932 wait complete. 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.757+0000 7fadd3c0d740 1 -- start start 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadd3c0d740 1 Processor -- start 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 0x5614bb7c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadd3c0d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7bd370 0x5614bb7c2270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1ade70 con 0x5614bb7b3b40 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1af2e0 con 0x5614bb7b25d0 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadd3c0d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fadcc1ae540 con 0x5614bb7bd370 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadd3c0d740 10 client.0 _ll_register_callbacks cb 0x7fadc00046c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:39.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7bd370 0x5614bb7c2270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 0x5614bb7c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadcb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7bd370 0x5614bb7c2270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:45982/0 (socket says 172.21.15.70:45982) 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.758+0000 7fadcb7fe640 1 -- 172.21.15.70:0/1163602169 learned_addr learned my addr 172.21.15.70:0/1163602169 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.759+0000 7fadcb7fe640 1 -- 172.21.15.70:0/1163602169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 msgr2=0x5614bb7c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.759+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 0x5614bb7c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.759+0000 7fadcb7fe640 1 -- 172.21.15.70:0/1163602169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 msgr2=0x5614bb7c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.759+0000 7fadca7fc640 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.759+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.759+0000 7fadcb7fe640 1 -- 172.21.15.70:0/1163602169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5614bb7c5f20 con 0x5614bb7bd370 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.759+0000 7fadca7fc640 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.760+0000 7fadcb7fe640 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7bd370 0x5614bb7c2270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fadc4051040 tx=0x7fadc40319e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=243506221977d444 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:39.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.760+0000 7fadaaffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:31:39.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.760+0000 7fadaaffd640 1 -- 172.21.15.70:0/1163602169 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc4053070 con 0x5614bb7bd370 2024-09-19T04:31:39.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.760+0000 7fadd3c0d740 1 -- 172.21.15.70:0/1163602169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadc4036050 con 0x5614bb7bd370 2024-09-19T04:31:39.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.760+0000 7fadaaffd640 1 -- 172.21.15.70:0/1163602169 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fadc402fc20 con 0x5614bb7bd370 2024-09-19T04:31:39.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.760+0000 7fadaaffd640 1 -- 172.21.15.70:0/1163602169 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fadc4004820 con 0x5614bb7bd370 2024-09-19T04:31:39.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.760+0000 7fadd3c0d740 10 client.24952 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.760+0000 7fadd3c0d740 1 -- 172.21.15.70:0/1163602169 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x5614bb8380a0 con 0x5614bb7bd370 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.761+0000 7fadaaffd640 1 -- 172.21.15.70:0/1163602169 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadc4036050 con 0x5614bb7bd370 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.761+0000 7fadaaffd640 1 -- 172.21.15.70:0/1163602169 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fadc405e020 con 0x5614bb7bd370 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.761+0000 7fadd3c0d740 10 client.24952 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.761+0000 7fadd3c0d740 10 client.24952 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.761+0000 7fadd3c0d740 20 client.24952 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.761+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5614bb838430 0x5614bb83a820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.761+0000 7fadd3c0d740 4 client.24952 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.761+0000 7fadd3c0d740 1 -- 172.21.15.70:0/1163602169 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5614bb71fd70 con 0x5614bb838430 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadcaffd640 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5614bb838430 0x5614bb83a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:39.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadaaffd640 10 client.24952 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadcaffd640 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5614bb838430 0x5614bb83a820 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a69623837b954694 server_cookie=dea9e0764afafaa4 in_seq=0 out_seq=0 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadaaffd640 1 -- 172.21.15.70:0/1163602169 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5614bb71fd70 con 0x5614bb838430 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadaaffd640 10 client.24952 handle_command_reply: tid=0 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadd3c0d740 1 client.24952 shutdown 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadd3c0d740 1 -- 172.21.15.70:0/1163602169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7bd370 msgr2=0x5614bb7c2270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7bd370 0x5614bb7c2270 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fadc4051040 tx=0x7fadc40319e0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadd3c0d740 1 -- 172.21.15.70:0/1163602169 shutdown_connections 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.762+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5614bb838430 0x5614bb83a820 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.763+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5614bb7bd370 0x5614bb7c2270 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.763+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5614bb7b3b40 0x5614bb7c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.763+0000 7fadd3c0d740 1 --2- 172.21.15.70:0/1163602169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5614bb7b25d0 0x5614bb7c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.763+0000 7fadd3c0d740 1 -- 172.21.15.70:0/1163602169 >> 172.21.15.70:0/1163602169 conn(0x5614bb77b310 msgr2=0x5614bb7bc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:39.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.763+0000 7fadaaffd640 0 client.24952 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:31:39.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.763+0000 7fadd3c0d740 1 -- 172.21.15.70:0/1163602169 shutdown_connections 2024-09-19T04:31:39.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.763+0000 7fadd3c0d740 1 -- 172.21.15.70:0/1163602169 wait complete. 2024-09-19T04:31:39.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.763+0000 7fadd3c0d740 20 client.24952 trim_cache size 0 max 16384 2024-09-19T04:31:39.770 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:31:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 -- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadb40a35e0 msgr2=0x7fadb40a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadb40a35e0 0x7fadb40a5aa0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x5614bb7afac0 tx=0x7fadbc009480 comp rx=0 tx=0).stop 2024-09-19T04:31:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 -- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc1012d0 msgr2=0x7fadcc19ab80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc1012d0 0x7fadcc19ab80 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fadc000d950 tx=0x7fadc000de10 comp rx=0 tx=0).stop 2024-09-19T04:31:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 -- 172.21.15.70:0/698013492 shutdown_connections 2024-09-19T04:31:39.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadb40a35e0 0x7fadb40a5aa0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fadcc10e4d0 0x7fadcc19ef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fadcc1012d0 0x7fadcc19ab80 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 --2- 172.21.15.70:0/698013492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fadcc100920 0x7fadcc19a640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 -- 172.21.15.70:0/698013492 >> 172.21.15.70:0/698013492 conn(0x7fadcc0fc790 msgr2=0x7fadcc0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 -- 172.21.15.70:0/698013492 shutdown_connections 2024-09-19T04:31:39.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:39.764+0000 7fadd1834640 1 -- 172.21.15.70:0/698013492 wait complete. 2024-09-19T04:31:39.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:39 smithi167 ceph-mon[34339]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:40.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:39 smithi134 ceph-mon[34525]: pgmap v29: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:40.529 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:31:40.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:40 smithi070 ceph-mon[30942]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:40.897 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:31:40.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:40 smithi167 ceph-mon[34339]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:40 smithi134 ceph-mon[34525]: pgmap v30: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.450+0000 7fc355757640 1 -- 172.21.15.70:0/2739451386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 msgr2=0x7fc350100db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.450+0000 7fc355757640 1 --2- 172.21.15.70:0/2739451386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 0x7fc350100db0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7fc340009860 tx=0x7fc34002a340 comp rx=0 tx=0).stop 2024-09-19T04:31:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.451+0000 7fc355757640 1 -- 172.21.15.70:0/2739451386 shutdown_connections 2024-09-19T04:31:41.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.451+0000 7fc355757640 1 --2- 172.21.15.70:0/2739451386 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc35010e4f0 0x7fc350110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.451+0000 7fc355757640 1 --2- 172.21.15.70:0/2739451386 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc350101380 0x7fc35010dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.451+0000 7fc355757640 1 --2- 172.21.15.70:0/2739451386 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 0x7fc350100db0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.451+0000 7fc355757640 1 -- 172.21.15.70:0/2739451386 >> 172.21.15.70:0/2739451386 conn(0x7fc3500fc7d0 msgr2=0x7fc3500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.451+0000 7fc355757640 1 -- 172.21.15.70:0/2739451386 shutdown_connections 2024-09-19T04:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.451+0000 7fc355757640 1 -- 172.21.15.70:0/2739451386 wait complete. 2024-09-19T04:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc355757640 1 Processor -- start 2024-09-19T04:31:41.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc355757640 1 -- start start 2024-09-19T04:31:41.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc355757640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 0x7fc35019a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc355757640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc350101380 0x7fc35019ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc355757640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc35010e4f0 0x7fc35019f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc355757640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc350114230 con 0x7fc3501009d0 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc355757640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501140b0 con 0x7fc350101380 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc355757640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc3501143b0 con 0x7fc35010e4f0 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc34e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc350101380 0x7fc35019ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.452+0000 7fc34e7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc350101380 0x7fc35019ac70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:40382/0 (socket says 172.21.15.70:40382) 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34e7fc640 1 -- 172.21.15.70:0/1240570870 learned_addr learned my addr 172.21.15.70:0/1240570870 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc35010e4f0 0x7fc35019f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34effd640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 0x7fc35019a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34e7fc640 1 -- 172.21.15.70:0/1240570870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc35010e4f0 msgr2=0x7fc35019f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc35010e4f0 0x7fc35019f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34e7fc640 1 -- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 msgr2=0x7fc35019a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 0x7fc35019a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34e7fc640 1 -- 172.21.15.70:0/1240570870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc35019f6e0 con 0x7fc350101380 2024-09-19T04:31:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34effd640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 0x7fc35019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:31:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc350101380 0x7fc35019ac70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc34400e9c0 tx=0x7fc34400ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.453+0000 7fc337fff640 1 -- 172.21.15.70:0/1240570870 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34400ccc0 con 0x7fc350101380 2024-09-19T04:31:41.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.454+0000 7fc355757640 1 -- 172.21.15.70:0/1240570870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc35019f9d0 con 0x7fc350101380 2024-09-19T04:31:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.454+0000 7fc337fff640 1 -- 172.21.15.70:0/1240570870 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc3440054f0 con 0x7fc350101380 2024-09-19T04:31:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.454+0000 7fc337fff640 1 -- 172.21.15.70:0/1240570870 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc344010430 con 0x7fc350101380 2024-09-19T04:31:41.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.454+0000 7fc355757640 1 -- 172.21.15.70:0/1240570870 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc3501a72b0 con 0x7fc350101380 2024-09-19T04:31:41.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.457+0000 7fc337fff640 1 -- 172.21.15.70:0/1240570870 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7fc3440046c0 con 0x7fc350101380 2024-09-19T04:31:41.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.457+0000 7fc357b30740 1 Processor -- start 2024-09-19T04:31:41.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.457+0000 7fc357b30740 1 -- start start 2024-09-19T04:31:41.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.457+0000 7fc357b30740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a54b40 0x55f0e4a53090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.457+0000 7fc357b30740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a53a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.457+0000 7fc357b30740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a66b80 0x55f0e4a68f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.457+0000 7fc357b30740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f0e49b92f0 con 0x55f0e4a66b80 2024-09-19T04:31:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc357b30740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f0e4960cf0 con 0x55f0e4a54b40 2024-09-19T04:31:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc357b30740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f0e49b52b0 con 0x55f0e4a535d0 2024-09-19T04:31:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a54b40 0x55f0e4a53090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a66b80 0x55f0e4a68f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34f7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a54b40 0x55f0e4a53090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:40384/0 (socket says 172.21.15.70:40384) 2024-09-19T04:31:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34f7fe640 1 -- 172.21.15.70:0/1007848071 learned_addr learned my addr 172.21.15.70:0/1007848071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34effd640 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a53a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34f7fe640 1 -- 172.21.15.70:0/1007848071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 msgr2=0x55f0e4a53a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a53a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34f7fe640 1 -- 172.21.15.70:0/1007848071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a66b80 msgr2=0x55f0e4a68f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc337fff640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3380a3560 0x7fc3380a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a66b80 0x55f0e4a68f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34effd640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3380a3560 0x7fc3380a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc34f7fe640 1 -- 172.21.15.70:0/1007848071 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e49453a0 con 0x55f0e4a54b40 2024-09-19T04:31:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.458+0000 7fc337fff640 1 -- 172.21.15.70:0/1240570870 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc3440d02f0 con 0x7fc350101380 2024-09-19T04:31:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.459+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a66b80 0x55f0e4a68f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:31:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.459+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a54b40 0x55f0e4a53090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc348009f30 tx=0x7fc3480118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2313f78edb7421f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.459+0000 7fc34effd640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3380a3560 0x7fc3380a5a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc340005a90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.459+0000 7fc3357fa640 1 -- 172.21.15.70:0/1007848071 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348004d20 con 0x55f0e4a54b40 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.459+0000 7fc3357fa640 1 -- 172.21.15.70:0/1007848071 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc348004050 con 0x55f0e4a54b40 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.459+0000 7fc3357fa640 1 -- 172.21.15.70:0/1007848071 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348005260 con 0x55f0e4a54b40 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 -- 172.21.15.70:0/1007848071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a54b40 msgr2=0x55f0e4a53090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a54b40 0x55f0e4a53090 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fc348009f30 tx=0x7fc3480118d0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 -- 172.21.15.70:0/1007848071 shutdown_connections 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a66b80 0x55f0e4a68f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a53a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 --2- 172.21.15.70:0/1007848071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a54b40 0x55f0e4a53090 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 -- 172.21.15.70:0/1007848071 >> 172.21.15.70:0/1007848071 conn(0x55f0e4a1c310 msgr2=0x55f0e4a4fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 -- 172.21.15.70:0/1007848071 shutdown_connections 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 -- 172.21.15.70:0/1007848071 wait complete. 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 -- start start 2024-09-19T04:31:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.460+0000 7fc357b30740 1 Processor -- start 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc357b30740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a60330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc357b30740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a54b40 0x55f0e4a60870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc357b30740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a66040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc357b30740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f0e4a56550 con 0x55f0e4a54b40 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc357b30740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f0e4974060 con 0x55f0e4a66b80 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc357b30740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f0e4a566d0 con 0x55f0e4a535d0 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc357b30740 10 client.0 _ll_register_callbacks cb 0x55f0e46c78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a54b40 0x55f0e4a60870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a54b40 0x55f0e4a60870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59550/0 (socket says 172.21.15.70:59550) 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34e7fc640 1 -- 172.21.15.70:0/3700004042 learned_addr learned my addr 172.21.15.70:0/3700004042 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34effd640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a60330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a66040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34effd640 1 -- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 msgr2=0x55f0e4a66040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34effd640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a66040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34effd640 1 -- 172.21.15.70:0/3700004042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a54b40 msgr2=0x55f0e4a60870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34effd640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a54b40 0x55f0e4a60870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34effd640 1 -- 172.21.15.70:0/3700004042 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e472a3c0 con 0x55f0e4a535d0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.461+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a54b40 0x55f0e4a60870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a66040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc34effd640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a60330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc34002a930 tx=0x7fc34002a340 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c7ed12521e1476 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc332ff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc332ff5640 1 -- 172.21.15.70:0/3700004042 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34004c020 con 0x55f0e4a535d0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc357b30740 1 -- 172.21.15.70:0/3700004042 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc348004050 con 0x55f0e4a535d0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc332ff5640 1 -- 172.21.15.70:0/3700004042 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc3400037f0 con 0x55f0e4a535d0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc332ff5640 1 -- 172.21.15.70:0/3700004042 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc340057050 con 0x55f0e4a535d0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc357b30740 10 client.24964 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc357b30740 1 -- 172.21.15.70:0/3700004042 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f0e4a7dcb0 con 0x55f0e4a535d0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.462+0000 7fc332ff5640 1 -- 172.21.15.70:0/3700004042 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc348004050 con 0x55f0e4a535d0 2024-09-19T04:31:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc332ff5640 1 -- 172.21.15.70:0/3700004042 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc340033740 con 0x55f0e4a535d0 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc357b30740 10 client.24964 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc357b30740 10 client.24964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc357b30740 20 client.24964 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc357b30740 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f0e4a7f390 0x55f0e4a817e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc357b30740 4 client.24964 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc357b30740 1 -- 172.21.15.70:0/3700004042 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f0e49c6860 con 0x55f0e4a7f390 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f0e4a7f390 0x55f0e4a817e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc332ff5640 10 client.24964 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.463+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f0e4a7f390 0x55f0e4a817e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d4a7cfc457d706ec server_cookie=b1b0153877c4cf49 in_seq=0 out_seq=0 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc332ff5640 1 -- 172.21.15.70:0/3700004042 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f0e49c6860 con 0x55f0e4a7f390 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc332ff5640 10 client.24964 handle_command_reply: tid=0 2024-09-19T04:31:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 client.24964 shutdown 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 -- 172.21.15.70:0/3700004042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 msgr2=0x55f0e4a60330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a60330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fc34002a930 tx=0x7fc34002a340 comp rx=0 tx=0).stop 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 -- 172.21.15.70:0/3700004042 shutdown_connections 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f0e4a7f390 0x55f0e4a817e0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a66040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a54b40 0x55f0e4a60870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 --2- 172.21.15.70:0/3700004042 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a535d0 0x55f0e4a60330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 -- 172.21.15.70:0/3700004042 >> 172.21.15.70:0/3700004042 conn(0x55f0e4a1c310 msgr2=0x55f0e4a55960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc332ff5640 0 client.24964 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 -- 172.21.15.70:0/3700004042 shutdown_connections 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 1 -- 172.21.15.70:0/3700004042 wait complete. 2024-09-19T04:31:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.464+0000 7fc357b30740 20 client.24964 trim_cache size 0 max 16384 2024-09-19T04:31:41.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.477+0000 7fc357b30740 1 Processor -- start 2024-09-19T04:31:41.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.477+0000 7fc357b30740 1 -- start start 2024-09-19T04:31:41.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.477+0000 7fc357b30740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a535d0 0x55f0e4a65fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.477+0000 7fc357b30740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 0x55f0e4a813a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.477+0000 7fc357b30740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a59f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.477+0000 7fc357b30740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc350072600 con 0x55f0e4a535d0 2024-09-19T04:31:41.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.477+0000 7fc357b30740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc35006fed0 con 0x55f0e4a66b80 2024-09-19T04:31:41.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.477+0000 7fc357b30740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc35006dd20 con 0x55f0e4a54b40 2024-09-19T04:31:41.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a535d0 0x55f0e4a65fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a535d0 0x55f0e4a65fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59564/0 (socket says 172.21.15.70:59564) 2024-09-19T04:31:41.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 -- 172.21.15.70:0/2697054703 learned_addr learned my addr 172.21.15.70:0/2697054703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a59f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 0x55f0e4a813a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 -- 172.21.15.70:0/2697054703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 msgr2=0x55f0e4a813a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 0x55f0e4a813a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 -- 172.21.15.70:0/2697054703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 msgr2=0x55f0e4a59f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a59f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 -- 172.21.15.70:0/2697054703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0e4a5b730 con 0x55f0e4a535d0 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc34effd640 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a535d0 0x55f0e4a65fb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc340030790 tx=0x7fc340005f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ed31de871570d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.478+0000 7fc334ff9640 1 -- 172.21.15.70:0/2697054703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc340060070 con 0x55f0e4a535d0 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc334ff9640 1 -- 172.21.15.70:0/2697054703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc3400044c0 con 0x55f0e4a535d0 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc334ff9640 1 -- 172.21.15.70:0/2697054703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc34004c070 con 0x55f0e4a535d0 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 -- 172.21.15.70:0/2697054703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a535d0 msgr2=0x55f0e4a65fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a535d0 0x55f0e4a65fb0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7fc340030790 tx=0x7fc340005f10 comp rx=0 tx=0).stop 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 -- 172.21.15.70:0/2697054703 shutdown_connections 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a59f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 0x55f0e4a813a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 --2- 172.21.15.70:0/2697054703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a535d0 0x55f0e4a65fb0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 -- 172.21.15.70:0/2697054703 >> 172.21.15.70:0/2697054703 conn(0x55f0e4a1c310 msgr2=0x55f0e4a60330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 -- 172.21.15.70:0/2697054703 shutdown_connections 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.479+0000 7fc357b30740 1 -- 172.21.15.70:0/2697054703 wait complete. 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 1 -- start start 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 1 Processor -- start 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 0x55f0e4a92d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a932c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a57ac0 0x55f0e4a57f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc35006e390 con 0x55f0e4a57ac0 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc35006f800 con 0x55f0e4a66b80 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc35006ea60 con 0x55f0e4a54b40 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc357b30740 10 client.0 _ll_register_callbacks cb 0x7fc340035070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc34f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a57ac0 0x55f0e4a57f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc34f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a57ac0 0x55f0e4a57f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:59570/0 (socket says 172.21.15.70:59570) 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc34effd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 0x55f0e4a92d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc34f7fe640 1 -- 172.21.15.70:0/3373973167 learned_addr learned my addr 172.21.15.70:0/3373973167 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.480+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a932c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc34f7fe640 1 -- 172.21.15.70:0/3373973167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 msgr2=0x55f0e4a92d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 0x55f0e4a92d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc34f7fe640 1 -- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 msgr2=0x55f0e4a932c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a932c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc34f7fe640 1 -- 172.21.15.70:0/3373973167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0e4a58480 con 0x55f0e4a57ac0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc34e7fc640 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a932c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc34f7fe640 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a57ac0 0x55f0e4a57f40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc34802c040 tx=0x7fc348004280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c28c402c017f978 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc332ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc332ff5640 1 -- 172.21.15.70:0/3373973167 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc348004780 con 0x55f0e4a57ac0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc332ff5640 1 -- 172.21.15.70:0/3373973167 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc34802a440 con 0x55f0e4a57ac0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc357b30740 1 -- 172.21.15.70:0/3373973167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f0e4a81b70 con 0x55f0e4a57ac0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc332ff5640 1 -- 172.21.15.70:0/3373973167 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fc34802a640 con 0x55f0e4a57ac0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc357b30740 10 client.15429 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.481+0000 7fc357b30740 1 -- 172.21.15.70:0/3373973167 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f0e4a69800 con 0x55f0e4a57ac0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc332ff5640 1 -- 172.21.15.70:0/3373973167 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc34802acb0 con 0x55f0e4a57ac0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc332ff5640 1 -- 172.21.15.70:0/3373973167 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7fc348047070 con 0x55f0e4a57ac0 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc357b30740 10 client.15429 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc357b30740 10 client.15429 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:31:41.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc357b30740 20 client.15429 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:41.491 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:31:41.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc357b30740 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f0e4a69d90 0x55f0e4a6c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:41.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc357b30740 4 client.15429 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:31:41.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc357b30740 1 -- 172.21.15.70:0/3373973167 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f0e4a81b70 con 0x55f0e4a69d90 2024-09-19T04:31:41.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.482+0000 7fc34effd640 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f0e4a69d90 0x55f0e4a6c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:41.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc332ff5640 10 client.15429 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:41.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc34effd640 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f0e4a69d90 0x55f0e4a6c1b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42b9084678b9c2eb server_cookie=11092fe6a02b1f41 in_seq=0 out_seq=0 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc332ff5640 1 -- 172.21.15.70:0/3373973167 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f0e4a81b70 con 0x55f0e4a69d90 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc332ff5640 10 client.15429 handle_command_reply: tid=0 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 client.15429 shutdown 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 -- 172.21.15.70:0/3373973167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a57ac0 msgr2=0x55f0e4a57f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a57ac0 0x55f0e4a57f40 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fc34802c040 tx=0x7fc348004280 comp rx=0 tx=0).stop 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 -- 172.21.15.70:0/3373973167 shutdown_connections 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f0e4a69d90 0x55f0e4a6c1b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc332ff5640 0 client.15429 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f0e4a57ac0 0x55f0e4a57f40 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f0e4a66b80 0x55f0e4a932c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 --2- 172.21.15.70:0/3373973167 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f0e4a54b40 0x55f0e4a92d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 -- 172.21.15.70:0/3373973167 >> 172.21.15.70:0/3373973167 conn(0x55f0e4a1c310 msgr2=0x55f0e4a59e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 -- 172.21.15.70:0/3373973167 shutdown_connections 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 1 -- 172.21.15.70:0/3373973167 wait complete. 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.483+0000 7fc357b30740 20 client.15429 trim_cache size 0 max 16384 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 -- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3380a3560 msgr2=0x7fc3380a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3380a3560 0x7fc3380a5a20 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fc340000c00 tx=0x7fc340005a90 comp rx=0 tx=0).stop 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 -- 172.21.15.70:0/1240570870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc350101380 msgr2=0x7fc35019ac70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc350101380 0x7fc35019ac70 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fc34400e9c0 tx=0x7fc34400ee80 comp rx=0 tx=0).stop 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 -- 172.21.15.70:0/1240570870 shutdown_connections 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc3380a3560 0x7fc3380a5a20 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc35010e4f0 0x7fc35019f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc350101380 0x7fc35019ac70 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 --2- 172.21.15.70:0/1240570870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc3501009d0 0x7fc35019a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:41.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 -- 172.21.15.70:0/1240570870 >> 172.21.15.70:0/1240570870 conn(0x7fc3500fc7d0 msgr2=0x7fc3500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:41.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 -- 172.21.15.70:0/1240570870 shutdown_connections 2024-09-19T04:31:41.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:41.484+0000 7fc355757640 1 -- 172.21.15.70:0/1240570870 wait complete. 2024-09-19T04:31:43.141 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:31:43.141 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:31:43.421 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:31:43.832 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:43 smithi070 ceph-mon[30942]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:43.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 -- 172.21.15.70:0/1464522407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c102d30 msgr2=0x7f509c103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 --2- 172.21.15.70:0/1464522407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c102d30 0x7f509c103110 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5090009930 tx=0x7f509002a420 comp rx=0 tx=0).stop 2024-09-19T04:31:43.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 -- 172.21.15.70:0/1464522407 shutdown_connections 2024-09-19T04:31:43.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 --2- 172.21.15.70:0/1464522407 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c1082a0 0x7f509c10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.942 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 --2- 172.21.15.70:0/1464522407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c1036e0 0x7f509c107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 --2- 172.21.15.70:0/1464522407 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c102d30 0x7f509c103110 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 -- 172.21.15.70:0/1464522407 >> 172.21.15.70:0/1464522407 conn(0x7f509c0fc7d0 msgr2=0x7f509c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 -- 172.21.15.70:0/1464522407 shutdown_connections 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.924+0000 7f50a2b90640 1 -- 172.21.15.70:0/1464522407 wait complete. 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.925+0000 7f50a2b90640 1 Processor -- start 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.925+0000 7f50a2b90640 1 -- start start 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.925+0000 7f50a2b90640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102d30 0x7f509c1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f50a2b90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c1036e0 0x7f509c198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f50a2b90640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c1082a0 0x7f509c19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c1036e0 0x7f509c198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f50a092c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102d30 0x7f509c1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.943 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c1036e0 0x7f509c198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39224/0 (socket says 172.21.15.70:39224) 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f50a092c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102d30 0x7f509c1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:59486/0 (socket says 172.21.15.70:59486) 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 -- 172.21.15.70:0/4259944639 learned_addr learned my addr 172.21.15.70:0/4259944639 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f509c112070 con 0x7f509c1036e0 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f509c111ef0 con 0x7f509c102d30 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1121f0 con 0x7f509c1082a0 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 -- 172.21.15.70:0/4259944639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c1082a0 msgr2=0x7f509c19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c1082a0 0x7f509c19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 -- 172.21.15.70:0/4259944639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102d30 msgr2=0x7f509c1985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102d30 0x7f509c1985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 -- 172.21.15.70:0/4259944639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c19d550 con 0x7f509c1036e0 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.926+0000 7f509bfff640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c1036e0 0x7f509c198ae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f508800d950 tx=0x7f508800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:43.944 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.927+0000 7f5099ffb640 1 -- 172.21.15.70:0/4259944639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088017070 con 0x7f509c1036e0 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.927+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c19d840 con 0x7f509c1036e0 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.927+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c1a5120 con 0x7f509c1036e0 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.927+0000 7f5099ffb640 1 -- 172.21.15.70:0/4259944639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5088009c30 con 0x7f509c1036e0 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.927+0000 7f5099ffb640 1 -- 172.21.15.70:0/4259944639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5088004e20 con 0x7f509c1036e0 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.931+0000 7f5099ffb640 1 -- 172.21.15.70:0/4259944639 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f5088004020 con 0x7f509c1036e0 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.931+0000 7f50a4f69740 1 Processor -- start 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.931+0000 7f50a4f69740 1 -- start start 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.931+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 0x55f618e02f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.931+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e034a0 0x55f618e0d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0dd60 0x55f618e10150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a4f69740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f618d68280 con 0x55f618e034a0 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a4f69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f618d0fb10 con 0x55f618e0dd60 2024-09-19T04:31:43.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a4f69740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f618d64240 con 0x55f618e02b80 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a092c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e034a0 0x55f618e0d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f5099ffb640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f508c0a35e0 0x7f508c0a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a092c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e034a0 0x55f618e0d820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39230/0 (socket says 172.21.15.70:39230) 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a092c640 1 -- 172.21.15.70:0/2619266382 learned_addr learned my addr 172.21.15.70:0/2619266382 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f5099ffb640 1 -- 172.21.15.70:0/4259944639 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f50880cfbf0 con 0x7f509c1036e0 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a092c640 1 -- 172.21.15.70:0/2619266382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 msgr2=0x55f618e02f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a092c640 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 0x55f618e02f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a092c640 1 -- 172.21.15.70:0/2619266382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0dd60 msgr2=0x55f618e10150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a112d640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f508c0a35e0 0x7f508c0a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f509bfff640 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0dd60 0x55f618e10150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a092c640 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0dd60 0x55f618e10150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f50a092c640 1 -- 172.21.15.70:0/2619266382 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f618d1c1f0 con 0x55f618e034a0 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.932+0000 7f509bfff640 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0dd60 0x55f618e10150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.933+0000 7f50a092c640 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e034a0 0x55f618e0d820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5090000c00 tx=0x7f5090032c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d45f516baa3af5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.933+0000 7f50a112d640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f508c0a35e0 0x7f508c0a5aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5094009370 tx=0x7f5094009240 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.933+0000 7f5086ffd640 1 -- 172.21.15.70:0/2619266382 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090040070 con 0x55f618e034a0 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.933+0000 7f5086ffd640 1 -- 172.21.15.70:0/2619266382 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5090031710 con 0x55f618e034a0 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.933+0000 7f5086ffd640 1 -- 172.21.15.70:0/2619266382 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090035040 con 0x55f618e034a0 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 -- 172.21.15.70:0/2619266382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e034a0 msgr2=0x55f618e0d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e034a0 0x55f618e0d820 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7f5090000c00 tx=0x7f5090032c10 comp rx=0 tx=0).stop 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 -- 172.21.15.70:0/2619266382 shutdown_connections 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0dd60 0x55f618e10150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e034a0 0x55f618e0d820 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2619266382 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 0x55f618e02f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 -- 172.21.15.70:0/2619266382 >> 172.21.15.70:0/2619266382 conn(0x55f618dff110 msgr2=0x55f618dff4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 -- 172.21.15.70:0/2619266382 shutdown_connections 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 -- 172.21.15.70:0/2619266382 wait complete. 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.934+0000 7f50a4f69740 1 -- start start 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.935+0000 7f50a4f69740 1 Processor -- start 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.935+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e02b80 0x55f618e0ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.935+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0dd60 0x55f618e0b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.935+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e0b7a0 0x55f618e19e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.935+0000 7f50a4f69740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f618e109d0 con 0x55f618e0b7a0 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.935+0000 7f50a4f69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f618d22f10 con 0x55f618e02b80 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.935+0000 7f50a4f69740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f618e10b50 con 0x55f618e0dd60 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.935+0000 7f50a4f69740 10 client.0 _ll_register_callbacks cb 0x55f618ceba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:43.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f50a112d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e0b7a0 0x55f618e19e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f509bfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0dd60 0x55f618e0b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f50a092c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e02b80 0x55f618e0ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f50a112d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e0b7a0 0x55f618e19e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39232/0 (socket says 172.21.15.70:39232) 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f50a112d640 1 -- 172.21.15.70:0/2521297072 learned_addr learned my addr 172.21.15.70:0/2521297072 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f509bfff640 1 -- 172.21.15.70:0/2521297072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e02b80 msgr2=0x55f618e0ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f509bfff640 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e02b80 0x55f618e0ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f509bfff640 1 -- 172.21.15.70:0/2521297072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e0b7a0 msgr2=0x55f618e19e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f509bfff640 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e0b7a0 0x55f618e19e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f509bfff640 1 -- 172.21.15.70:0/2521297072 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f618ad96a0 con 0x55f618e0dd60 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f50a112d640 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e0b7a0 0x55f618e19e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f509bfff640 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0dd60 0x55f618e0b260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50880cd120 tx=0x7f5088009ea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=638466f984f91ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.936+0000 7f507bfff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:31:43.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f507bfff640 1 -- 172.21.15.70:0/2521297072 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880a4920 con 0x55f618e0dd60 2024-09-19T04:31:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 1 -- 172.21.15.70:0/2521297072 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5090031710 con 0x55f618e0dd60 2024-09-19T04:31:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f507bfff640 1 -- 172.21.15.70:0/2521297072 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f5088004310 con 0x55f618e0dd60 2024-09-19T04:31:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f507bfff640 1 -- 172.21.15.70:0/2521297072 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f5088098320 con 0x55f618e0dd60 2024-09-19T04:31:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 10 client.24976 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 1 -- 172.21.15.70:0/2521297072 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f618e20ee0 con 0x55f618e0dd60 2024-09-19T04:31:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f507bfff640 1 -- 172.21.15.70:0/2521297072 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5090031710 con 0x55f618e0dd60 2024-09-19T04:31:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f507bfff640 1 -- 172.21.15.70:0/2521297072 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f50880cdab0 con 0x55f618e0dd60 2024-09-19T04:31:43.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 10 client.24976 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 10 client.24976 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 20 client.24976 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f618e222e0 0x55f618e246d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 4 client.24976 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.937+0000 7f50a4f69740 1 -- 172.21.15.70:0/2521297072 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f618d757f0 con 0x55f618e222e0 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.938+0000 7f50a092c640 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f618e222e0 0x55f618e246d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.938+0000 7f507bfff640 10 client.24976 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.938+0000 7f50a092c640 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f618e222e0 0x55f618e246d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=453e4ff166ecbc49 server_cookie=87f924dbcbe350f7 in_seq=0 out_seq=0 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f507bfff640 1 -- 172.21.15.70:0/2521297072 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f618d757f0 con 0x55f618e222e0 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f507bfff640 10 client.24976 handle_command_reply: tid=0 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 client.24976 shutdown 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 -- 172.21.15.70:0/2521297072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0dd60 msgr2=0x55f618e0b260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0dd60 0x55f618e0b260 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f50880cd120 tx=0x7f5088009ea0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 -- 172.21.15.70:0/2521297072 shutdown_connections 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f618e222e0 0x55f618e246d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e0b7a0 0x55f618e19e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0dd60 0x55f618e0b260 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 --2- 172.21.15.70:0/2521297072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e02b80 0x55f618e0ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 -- 172.21.15.70:0/2521297072 >> 172.21.15.70:0/2521297072 conn(0x55f618dff110 msgr2=0x55f618e04df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f507bfff640 0 client.24976 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 -- 172.21.15.70:0/2521297072 shutdown_connections 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 1 -- 172.21.15.70:0/2521297072 wait complete. 2024-09-19T04:31:43.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.939+0000 7f50a4f69740 20 client.24976 trim_cache size 0 max 16384 2024-09-19T04:31:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.956+0000 7f50a4f69740 1 Processor -- start 2024-09-19T04:31:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a4f69740 1 -- start start 2024-09-19T04:31:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618dff110 0x55f618e19c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 0x55f618e29fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0b7a0 0x55f618e2a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a4f69740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1adef0 con 0x55f618dff110 2024-09-19T04:31:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a4f69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1ab7c0 con 0x55f618e0b7a0 2024-09-19T04:31:43.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a4f69740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1a9630 con 0x55f618e02b80 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a092c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618dff110 0x55f618e19c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a092c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618dff110 0x55f618e19c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39238/0 (socket says 172.21.15.70:39238) 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a092c640 1 -- 172.21.15.70:0/755107371 learned_addr learned my addr 172.21.15.70:0/755107371 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f509bfff640 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 0x55f618e29fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a112d640 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0b7a0 0x55f618e2a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a092c640 1 -- 172.21.15.70:0/755107371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 msgr2=0x55f618e29fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a092c640 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 0x55f618e29fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a092c640 1 -- 172.21.15.70:0/755107371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0b7a0 msgr2=0x55f618e2a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a092c640 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0b7a0 0x55f618e2a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f50a092c640 1 -- 172.21.15.70:0/755107371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f618e0db30 con 0x55f618dff110 2024-09-19T04:31:43.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.957+0000 7f509bfff640 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 0x55f618e29fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:31:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.958+0000 7f50a092c640 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618dff110 0x55f618e19c60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f50900314b0 tx=0x7f5090009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9eba93d55f6e9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.958+0000 7f50867fc640 1 -- 172.21.15.70:0/755107371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090035070 con 0x55f618dff110 2024-09-19T04:31:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.958+0000 7f50867fc640 1 -- 172.21.15.70:0/755107371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5090031d80 con 0x55f618dff110 2024-09-19T04:31:43.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.958+0000 7f50867fc640 1 -- 172.21.15.70:0/755107371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090049040 con 0x55f618dff110 2024-09-19T04:31:43.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:43 smithi167 ceph-mon[34339]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:43.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 -- 172.21.15.70:0/755107371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618dff110 msgr2=0x55f618e19c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618dff110 0x55f618e19c60 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f50900314b0 tx=0x7f5090009260 comp rx=0 tx=0).stop 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 -- 172.21.15.70:0/755107371 shutdown_connections 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618e0b7a0 0x55f618e2a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e02b80 0x55f618e29fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 --2- 172.21.15.70:0/755107371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618dff110 0x55f618e19c60 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 -- 172.21.15.70:0/755107371 >> 172.21.15.70:0/755107371 conn(0x55f618e0b3c0 msgr2=0x55f618e095f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 -- 172.21.15.70:0/755107371 shutdown_connections 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 -- 172.21.15.70:0/755107371 wait complete. 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 -- start start 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.959+0000 7f50a4f69740 1 Processor -- start 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618dff110 0x55f618e11bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e02b80 0x55f618e12130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a4f69740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0b7a0 0x55f618e12670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a4f69740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1a9c80 con 0x55f618e02b80 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a4f69740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1ab0f0 con 0x55f618dff110 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a4f69740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1aa350 con 0x55f618e0b7a0 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a4f69740 10 client.0 _ll_register_callbacks cb 0x7f508800b600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f509bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e02b80 0x55f618e12130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f509bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e02b80 0x55f618e12130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39250/0 (socket says 172.21.15.70:39250) 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f509bfff640 1 -- 172.21.15.70:0/3817850080 learned_addr learned my addr 172.21.15.70:0/3817850080 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a092c640 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618dff110 0x55f618e11bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f50a112d640 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0b7a0 0x55f618e12670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f509bfff640 1 -- 172.21.15.70:0/3817850080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0b7a0 msgr2=0x55f618e12670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f509bfff640 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0b7a0 0x55f618e12670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f509bfff640 1 -- 172.21.15.70:0/3817850080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618dff110 msgr2=0x55f618e11bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f509bfff640 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618dff110 0x55f618e11bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.960+0000 7f509bfff640 1 -- 172.21.15.70:0/3817850080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f618e8c040 con 0x55f618e02b80 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f509bfff640 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e02b80 0x55f618e12130 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5088005fd0 tx=0x7f5088098080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed557b4758d088b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f507bfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f507bfff640 1 -- 172.21.15.70:0/3817850080 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50880984c0 con 0x55f618e02b80 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f507bfff640 1 -- 172.21.15.70:0/3817850080 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f5088097a00 con 0x55f618e02b80 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f50a4f69740 1 -- 172.21.15.70:0/3817850080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5090031d80 con 0x55f618e02b80 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f507bfff640 1 -- 172.21.15.70:0/3817850080 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f508809b610 con 0x55f618e02b80 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f50a4f69740 10 client.15447 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f50a4f69740 1 -- 172.21.15.70:0/3817850080 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55f618e8d360 con 0x55f618e02b80 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.961+0000 7f507bfff640 1 -- 172.21.15.70:0/3817850080 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5090031d80 con 0x55f618e02b80 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.962+0000 7f507bfff640 1 -- 172.21.15.70:0/3817850080 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f508809ac80 con 0x55f618e02b80 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.962+0000 7f50a4f69740 10 client.15447 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:43.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.962+0000 7f50a4f69740 10 client.15447 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:31:43.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.962+0000 7f50a4f69740 20 client.15447 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:43.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.962+0000 7f50a4f69740 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f618e0dd60 0x55f618e8f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:43.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.962+0000 7f50a4f69740 4 client.15447 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:31:43.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.962+0000 7f50a4f69740 1 -- 172.21.15.70:0/3817850080 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f618d6fd00 con 0x55f618e0dd60 2024-09-19T04:31:43.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.962+0000 7f50a092c640 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f618e0dd60 0x55f618e8f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.963+0000 7f507bfff640 10 client.15447 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.963+0000 7f50a092c640 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f618e0dd60 0x55f618e8f9c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9aba02ece94689c3 server_cookie=91d0e7e80d13711 in_seq=0 out_seq=0 2024-09-19T04:31:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f507bfff640 1 -- 172.21.15.70:0/3817850080 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f618d6fd00 con 0x55f618e0dd60 2024-09-19T04:31:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f507bfff640 10 client.15447 handle_command_reply: tid=0 2024-09-19T04:31:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 client.15447 shutdown 2024-09-19T04:31:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 -- 172.21.15.70:0/3817850080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e02b80 msgr2=0x55f618e12130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e02b80 0x55f618e12130 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f5088005fd0 tx=0x7f5088098080 comp rx=0 tx=0).stop 2024-09-19T04:31:43.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 -- 172.21.15.70:0/3817850080 shutdown_connections 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f618e0dd60 0x55f618e8f9c0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f618e0b7a0 0x55f618e12670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f618e02b80 0x55f618e12130 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 --2- 172.21.15.70:0/3817850080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f618dff110 0x55f618e11bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f50a4f69740 1 -- 172.21.15.70:0/3817850080 >> 172.21.15.70:0/3817850080 conn(0x55f618e0b3c0 msgr2=0x55f618e0c580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.964+0000 7f507bfff640 0 client.15447 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.965+0000 7f50a4f69740 1 -- 172.21.15.70:0/3817850080 shutdown_connections 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.965+0000 7f50a4f69740 1 -- 172.21.15.70:0/3817850080 wait complete. 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.965+0000 7f50a4f69740 20 client.15447 trim_cache size 0 max 16384 2024-09-19T04:31:43.969 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:31:43.970 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:31:43.970 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "63ce68cd-32dc-4369-9e9d-07edf992c5ff", 2024-09-19T04:31:43.970 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:31:43.970 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:31:43.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f508c0a35e0 msgr2=0x7f508c0a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f508c0a35e0 0x7f508c0a5aa0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5094009370 tx=0x7f5094009240 comp rx=0 tx=0).stop 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c1036e0 msgr2=0x7f509c198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c1036e0 0x7f509c198ae0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f508800d950 tx=0x7f508800de10 comp rx=0 tx=0).stop 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 shutdown_connections 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f508c0a35e0 0x7f508c0a5aa0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f509c1082a0 0x7f509c19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f509c1036e0 0x7f509c198ae0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 --2- 172.21.15.70:0/4259944639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f509c102d30 0x7f509c1985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 >> 172.21.15.70:0/4259944639 conn(0x7f509c0fc7d0 msgr2=0x7f509c105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 shutdown_connections 2024-09-19T04:31:43.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:43.966+0000 7f50a2b90640 1 -- 172.21.15.70:0/4259944639 wait complete. 2024-09-19T04:31:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:43 smithi134 ceph-mon[34525]: pgmap v31: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:31:44.666 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:31:44.952 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:31:45.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 -- 172.21.15.70:0/409579560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c103670 msgr2=0x7f713c10bb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 --2- 172.21.15.70:0/409579560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c103670 0x7f713c10bb60 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f7130009900 tx=0x7f713002a480 comp rx=0 tx=0).stop 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 -- 172.21.15.70:0/409579560 shutdown_connections 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 --2- 172.21.15.70:0/409579560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f713c10c180 0x7f713c10e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 --2- 172.21.15.70:0/409579560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c103670 0x7f713c10bb60 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 --2- 172.21.15.70:0/409579560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f713c102d50 0x7f713c103130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 -- 172.21.15.70:0/409579560 >> 172.21.15.70:0/409579560 conn(0x7f713c0fc7d0 msgr2=0x7f713c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 -- 172.21.15.70:0/409579560 shutdown_connections 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.445+0000 7f71418b8640 1 -- 172.21.15.70:0/409579560 wait complete. 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.446+0000 7f71418b8640 1 Processor -- start 2024-09-19T04:31:45.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.446+0000 7f71418b8640 1 -- start start 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f71418b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c102d50 0x7f713c198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f71418b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f713c103670 0x7f713c198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f71418b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f713c10c180 0x7f713c19ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f71418b8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f713c111f50 con 0x7f713c102d50 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f71418b8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f713c111dd0 con 0x7f713c10c180 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f71418b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1120d0 con 0x7f713c103670 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c102d50 0x7f713c198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c102d50 0x7f713c198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39272/0 (socket says 172.21.15.70:39272) 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713affd640 1 -- 172.21.15.70:0/2467296741 learned_addr learned my addr 172.21.15.70:0/2467296741 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713a7fc640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f713c103670 0x7f713c198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713b7fe640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f713c10c180 0x7f713c19ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713affd640 1 -- 172.21.15.70:0/2467296741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f713c103670 msgr2=0x7f713c198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713affd640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f713c103670 0x7f713c198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713affd640 1 -- 172.21.15.70:0/2467296741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f713c10c180 msgr2=0x7f713c19ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713affd640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f713c10c180 0x7f713c19ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.447+0000 7f713affd640 1 -- 172.21.15.70:0/2467296741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713c19d4e0 con 0x7f713c102d50 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.448+0000 7f713affd640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c102d50 0x7f713c198530 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f712c00d770 tx=0x7f712c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.448+0000 7f71408b6640 1 -- 172.21.15.70:0/2467296741 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c017070 con 0x7f713c102d50 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.448+0000 7f71408b6640 1 -- 172.21.15.70:0/2467296741 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f712c0054f0 con 0x7f713c102d50 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.448+0000 7f71418b8640 1 -- 172.21.15.70:0/2467296741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713c19d7d0 con 0x7f713c102d50 2024-09-19T04:31:45.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.448+0000 7f71418b8640 1 -- 172.21.15.70:0/2467296741 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f713c1008e0 con 0x7f713c102d50 2024-09-19T04:31:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.449+0000 7f71408b6640 1 -- 172.21.15.70:0/2467296741 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c004d60 con 0x7f713c102d50 2024-09-19T04:31:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.451+0000 7f7143c91740 1 Processor -- start 2024-09-19T04:31:45.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.451+0000 7f7143c91740 1 -- start start 2024-09-19T04:31:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.451+0000 7f7143c91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c46a4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.451+0000 7f7143c91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 0x55c4c46af140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.451+0000 7f7143c91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.451+0000 7f7143c91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c4c460a2e0 con 0x55c4c46af680 2024-09-19T04:31:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.451+0000 7f7143c91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c4c45b1ce0 con 0x55c4c46a4dc0 2024-09-19T04:31:45.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.451+0000 7f7143c91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c4c46062a0 con 0x55c4c46a44a0 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c46a4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c46a4880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:34906/0 (socket says 172.21.15.70:34906) 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 -- 172.21.15.70:0/4254266716 learned_addr learned my addr 172.21.15.70:0/4254266716 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f71408b6640 1 -- 172.21.15.70:0/2467296741 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f712c009c30 con 0x7f713c102d50 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 -- 172.21.15.70:0/4254266716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 msgr2=0x55c4c46af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 --2- 172.21.15.70:0/4254266716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 0x55c4c46af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 -- 172.21.15.70:0/4254266716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 msgr2=0x55c4c46b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 --2- 172.21.15.70:0/4254266716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 -- 172.21.15.70:0/4254266716 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c4596440 con 0x55c4c46a44a0 2024-09-19T04:31:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713a7fc640 1 --2- 172.21.15.70:0/4254266716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:31:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.452+0000 7f713b7fe640 1 --2- 172.21.15.70:0/4254266716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c46a4880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f713400ae10 tx=0x7f713400f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f72737d082eaaa1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.453+0000 7f7121ffb640 1 -- 172.21.15.70:0/4254266716 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134003b70 con 0x55c4c46a44a0 2024-09-19T04:31:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.453+0000 7f7121ffb640 1 -- 172.21.15.70:0/4254266716 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7134003d10 con 0x55c4c46a44a0 2024-09-19T04:31:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.453+0000 7f7121ffb640 1 -- 172.21.15.70:0/4254266716 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134010a60 con 0x55c4c46a44a0 2024-09-19T04:31:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.453+0000 7f71408b6640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71240a3440 0x7f71240a5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.453+0000 7f713affd640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71240a3440 0x7f71240a5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f71408b6640 1 -- 172.21.15.70:0/2467296741 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f712c0cf5b0 con 0x7f713c102d50 2024-09-19T04:31:45.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f7143c91740 1 -- 172.21.15.70:0/4254266716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 msgr2=0x55c4c46a4880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f713affd640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71240a3440 0x7f71240a5900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ccb40 tx=0x7f712c097290 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f7143c91740 1 --2- 172.21.15.70:0/4254266716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c46a4880 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f713400ae10 tx=0x7f713400f790 comp rx=0 tx=0).stop 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f7143c91740 1 -- 172.21.15.70:0/4254266716 shutdown_connections 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f7143c91740 1 --2- 172.21.15.70:0/4254266716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f7143c91740 1 --2- 172.21.15.70:0/4254266716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 0x55c4c46af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f7143c91740 1 --2- 172.21.15.70:0/4254266716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c46a4880 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.454+0000 7f7143c91740 1 -- 172.21.15.70:0/4254266716 >> 172.21.15.70:0/4254266716 conn(0x55c4c46a0a30 msgr2=0x55c4c46a0e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.455+0000 7f7143c91740 1 -- 172.21.15.70:0/4254266716 shutdown_connections 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.455+0000 7f7143c91740 1 -- 172.21.15.70:0/4254266716 wait complete. 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.455+0000 7f7143c91740 1 -- start start 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.455+0000 7f7143c91740 1 Processor -- start 2024-09-19T04:31:45.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f7143c91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a44a0 0x55c4c46aef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f713b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a44a0 0x55c4c46aef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f713b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a44a0 0x55c4c46aef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39284/0 (socket says 172.21.15.70:39284) 2024-09-19T04:31:45.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f713b7fe640 1 -- 172.21.15.70:0/2963462920 learned_addr learned my addr 172.21.15.70:0/2963462920 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:45.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f7143c91740 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a4dc0 0x55c4c46ac210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f7143c91740 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46af680 0x55c4c46ac750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c4c46b2250 con 0x55c4c46a44a0 2024-09-19T04:31:45.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c4c45c5050 con 0x55c4c46af680 2024-09-19T04:31:45.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c4c46b23d0 con 0x55c4c46a4dc0 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f713b7fe640 1 -- 172.21.15.70:0/2963462920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a4dc0 msgr2=0x55c4c46ac210 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f713b7fe640 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a4dc0 0x55c4c46ac210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f713b7fe640 1 -- 172.21.15.70:0/2963462920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46af680 msgr2=0x55c4c46ac750 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f713b7fe640 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46af680 0x55c4c46ac750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.456+0000 7f713b7fe640 1 -- 172.21.15.70:0/2963462920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c437b3c0 con 0x55c4c46a44a0 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.457+0000 7f713b7fe640 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a44a0 0x55c4c46aef60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f713401a040 tx=0x7f7134003ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba15f60e874557c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.457+0000 7f7143c91740 10 client.0 _ll_register_callbacks cb 0x55c4c4605160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.457+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7134003d10 con 0x55c4c46a44a0 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.457+0000 7f711affd640 10 client.15459 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.457+0000 7f711affd640 1 -- 172.21.15.70:0/2963462920 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134027020 con 0x55c4c46a44a0 2024-09-19T04:31:45.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.457+0000 7f711affd640 1 -- 172.21.15.70:0/2963462920 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f71340107c0 con 0x55c4c46a44a0 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.457+0000 7f711affd640 1 -- 172.21.15.70:0/2963462920 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7134010a20 con 0x55c4c46a44a0 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f7143c91740 10 client.15459 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({fsmap=24}) -- 0x55c4c46bd9c0 con 0x55c4c46a44a0 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f711affd640 1 -- 172.21.15.70:0/2963462920 <== mon.0 v2:172.21.15.70:3300/0 4 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7134010bc0 con 0x55c4c46a44a0 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f7143c91740 10 client.15459 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f7143c91740 10 client.15459 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f7143c91740 20 client.15459 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f7143c91740 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c4c46bed70 0x55c4c46c1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f7143c91740 4 client.15459 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.458+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c4c4617850 con 0x55c4c46bed70 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.459+0000 7f713a7fc640 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c4c46bed70 0x55c4c46c1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.459+0000 7f713a7fc640 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c4c46bed70 0x55c4c46c1160 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=af8773fd0d84bf5f server_cookie=ad481f5c7ee8252c in_seq=0 out_seq=0 2024-09-19T04:31:45.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.459+0000 7f711affd640 10 client.15459 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.460+0000 7f711affd640 1 -- 172.21.15.70:0/2963462920 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c4c4617850 con 0x55c4c46bed70 2024-09-19T04:31:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.460+0000 7f711affd640 10 client.15459 handle_command_reply: tid=0 2024-09-19T04:31:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.460+0000 7f7143c91740 1 client.15459 shutdown 2024-09-19T04:31:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.460+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a44a0 msgr2=0x55c4c46aef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.460+0000 7f7143c91740 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a44a0 0x55c4c46aef60 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f713401a040 tx=0x7f7134003ec0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 shutdown_connections 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c4c46bed70 0x55c4c46c1160 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46af680 0x55c4c46ac750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a4dc0 0x55c4c46ac210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 1 --2- 172.21.15.70:0/2963462920 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a44a0 0x55c4c46aef60 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 >> 172.21.15.70:0/2963462920 conn(0x55c4c46a0a30 msgr2=0x55c4c46a6710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f711affd640 0 client.15459 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 shutdown_connections 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 1 -- 172.21.15.70:0/2963462920 wait complete. 2024-09-19T04:31:45.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.461+0000 7f7143c91740 20 client.15459 trim_cache size 0 max 16384 2024-09-19T04:31:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.494+0000 7f7143c91740 1 Processor -- start 2024-09-19T04:31:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.494+0000 7f7143c91740 1 -- start start 2024-09-19T04:31:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.494+0000 7f7143c91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c469fa60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.494+0000 7f7143c91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 0x55c4c469ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.494+0000 7f7143c91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46c67c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.494+0000 7f7143c91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1b2000 con 0x55c4c46af680 2024-09-19T04:31:45.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.494+0000 7f7143c91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1af8d0 con 0x55c4c46a4dc0 2024-09-19T04:31:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.494+0000 7f7143c91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1ad720 con 0x55c4c46a44a0 2024-09-19T04:31:45.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46c67c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46c67c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39298/0 (socket says 172.21.15.70:39298) 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 -- 172.21.15.70:0/1935225223 learned_addr learned my addr 172.21.15.70:0/1935225223 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c469fa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713a7fc640 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 0x55c4c469ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 -- 172.21.15.70:0/1935225223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 msgr2=0x55c4c469fa60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c469fa60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 -- 172.21.15.70:0/1935225223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 msgr2=0x55c4c469ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 0x55c4c469ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 -- 172.21.15.70:0/1935225223 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c4c46a04e0 con 0x55c4c46af680 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f713b7fe640 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46c67c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7134000f80 tx=0x7f713401d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37a9ddd0839c8c2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f71217fa640 1 -- 172.21.15.70:0/1935225223 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134027070 con 0x55c4c46af680 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.495+0000 7f71217fa640 1 -- 172.21.15.70:0/1935225223 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7134003d10 con 0x55c4c46af680 2024-09-19T04:31:45.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.496+0000 7f71217fa640 1 -- 172.21.15.70:0/1935225223 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7134023960 con 0x55c4c46af680 2024-09-19T04:31:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.496+0000 7f7143c91740 1 -- 172.21.15.70:0/1935225223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 msgr2=0x55c4c46c67c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.496+0000 7f7143c91740 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46c67c0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f7134000f80 tx=0x7f713401d000 comp rx=0 tx=0).stop 2024-09-19T04:31:45.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 -- 172.21.15.70:0/1935225223 shutdown_connections 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46af680 0x55c4c46c67c0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a4dc0 0x55c4c469ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 --2- 172.21.15.70:0/1935225223 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46a44a0 0x55c4c469fa60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 -- 172.21.15.70:0/1935225223 >> 172.21.15.70:0/1935225223 conn(0x55c4c46a0a30 msgr2=0x55c4c469f350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 -- 172.21.15.70:0/1935225223 shutdown_connections 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 -- 172.21.15.70:0/1935225223 wait complete. 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 -- start start 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.497+0000 7f7143c91740 1 Processor -- start 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f7143c91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a44a0 0x55c4c46b4b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f7143c91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a4dc0 0x55c4c46b5040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f7143c91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46af680 0x55c4c472ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f7143c91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1add90 con 0x55c4c46a4dc0 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f7143c91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1af200 con 0x55c4c46a44a0 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f7143c91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f713c1ae460 con 0x55c4c46af680 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f7143c91740 10 client.0 _ll_register_callbacks cb 0x7f7130009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f713a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a4dc0 0x55c4c46b5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f713a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a4dc0 0x55c4c46b5040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39310/0 (socket says 172.21.15.70:39310) 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f713a7fc640 1 -- 172.21.15.70:0/1356040793 learned_addr learned my addr 172.21.15.70:0/1356040793 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f713a7fc640 1 -- 172.21.15.70:0/1356040793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46af680 msgr2=0x55c4c472ffa0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f713a7fc640 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46af680 0x55c4c472ffa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f713a7fc640 1 -- 172.21.15.70:0/1356040793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a44a0 msgr2=0x55c4c46b4b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f713a7fc640 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a44a0 0x55c4c46b4b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.498+0000 7f713a7fc640 1 -- 172.21.15.70:0/1356040793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c4c47304e0 con 0x55c4c46a4dc0 2024-09-19T04:31:45.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f713a7fc640 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a4dc0 0x55c4c46b5040 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f713002a4c0 tx=0x7f7130004300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=351082854990c4d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f711affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f711affd640 1 -- 172.21.15.70:0/1356040793 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7130035040 con 0x55c4c46a4dc0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f711affd640 1 -- 172.21.15.70:0/1356040793 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f7130005040 con 0x55c4c46a4dc0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f7143c91740 1 -- 172.21.15.70:0/1356040793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7134003d10 con 0x55c4c46a4dc0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f711affd640 1 -- 172.21.15.70:0/1356040793 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f7130005240 con 0x55c4c46a4dc0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f7143c91740 10 client.15465 fetch_fsmap learned FSMap version 24 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f7143c91740 1 -- 172.21.15.70:0/1356040793 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=24,monmap=4+}) -- 0x55c4c4731820 con 0x55c4c46a4dc0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.499+0000 7f711affd640 1 -- 172.21.15.70:0/1356040793 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7134003d10 con 0x55c4c46a4dc0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.500+0000 7f711affd640 1 -- 172.21.15.70:0/1356040793 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 24) ==== 8346+0+0 (secure 0 0 0) 0x7f7130003680 con 0x55c4c46a4dc0 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.500+0000 7f7143c91740 10 client.15465 fetch_fsmap finished waiting for FSMap version 24 2024-09-19T04:31:45.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.500+0000 7f7143c91740 10 client.15465 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:31:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.500+0000 7f7143c91740 20 client.15465 populate_metadata read hostname 'smithi070' 2024-09-19T04:31:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.500+0000 7f7143c91740 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c4c4731f20 0x55c4c4734340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:31:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.500+0000 7f7143c91740 4 client.15465 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:31:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.500+0000 7f7143c91740 1 -- 172.21.15.70:0/1356040793 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c4c4611d60 con 0x55c4c4731f20 2024-09-19T04:31:45.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.500+0000 7f713b7fe640 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c4c4731f20 0x55c4c4734340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:31:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f711affd640 10 client.15465 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f713b7fe640 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c4c4731f20 0x55c4c4734340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad78ef2107898eb server_cookie=7821ad6df57d2f44 in_seq=0 out_seq=0 2024-09-19T04:31:45.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f711affd640 1 -- 172.21.15.70:0/1356040793 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55c4c4611d60 con 0x55c4c4731f20 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f711affd640 10 client.15465 handle_command_reply: tid=0 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 client.15465 shutdown 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 -- 172.21.15.70:0/1356040793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a4dc0 msgr2=0x55c4c46b5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a4dc0 0x55c4c46b5040 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f713002a4c0 tx=0x7f7130004300 comp rx=0 tx=0).stop 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 -- 172.21.15.70:0/1356040793 shutdown_connections 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c4c4731f20 0x55c4c4734340 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c4c46af680 0x55c4c472ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c4c46a4dc0 0x55c4c46b5040 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 --2- 172.21.15.70:0/1356040793 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c4c46a44a0 0x55c4c46b4b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f7143c91740 1 -- 172.21.15.70:0/1356040793 >> 172.21.15.70:0/1356040793 conn(0x55c4c46a0a30 msgr2=0x55c4c469fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.501+0000 7f711affd640 0 client.15465 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.502+0000 7f7143c91740 1 -- 172.21.15.70:0/1356040793 shutdown_connections 2024-09-19T04:31:45.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.502+0000 7f7143c91740 1 -- 172.21.15.70:0/1356040793 wait complete. 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.502+0000 7f7143c91740 20 client.15465 trim_cache size 0 max 16384 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "63ce68cd-32dc-4369-9e9d-07edf992c5ff": { 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "63ce68cd-32dc-4369-9e9d-07edf992c5ff", 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:31:45.507 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:31:45.508 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:31:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 -- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71240a3440 msgr2=0x7f71240a5900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71240a3440 0x7f71240a5900 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f712c0ccb40 tx=0x7f712c097290 comp rx=0 tx=0).stop 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 -- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c102d50 msgr2=0x7f713c198530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c102d50 0x7f713c198530 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f712c00d770 tx=0x7f712c00dc30 comp rx=0 tx=0).stop 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 -- 172.21.15.70:0/2467296741 shutdown_connections 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71240a3440 0x7f71240a5900 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f713c10c180 0x7f713c19ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f713c103670 0x7f713c198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 --2- 172.21.15.70:0/2467296741 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f713c102d50 0x7f713c198530 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 -- 172.21.15.70:0/2467296741 >> 172.21.15.70:0/2467296741 conn(0x7f713c0fc7d0 msgr2=0x7f713c0fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 -- 172.21.15.70:0/2467296741 shutdown_connections 2024-09-19T04:31:45.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:31:45.503+0000 7f71418b8640 1 -- 172.21.15.70:0/2467296741 wait complete. 2024-09-19T04:31:45.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:45 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:31:45.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:45 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:31:45.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:45 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:31:45.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:45 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:31:45.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:45 smithi070 ceph-mon[30942]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:45.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:45 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:31:45.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:45 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:31:45.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:45 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:31:45.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:45 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:31:45.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:45 smithi167 ceph-mon[34339]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:46.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:45 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:31:46.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:45 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:31:46.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:45 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:31:46.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:45 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:31:46.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:45 smithi134 ceph-mon[34525]: pgmap v32: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:46.276 INFO:tasks.cephfs.filesystem:scrub status for tag:63ce68cd-32dc-4369-9e9d-07edf992c5ff - {'path': '/', 'tag': '63ce68cd-32dc-4369-9e9d-07edf992c5ff', 'options': 'recursive,force'} 2024-09-19T04:31:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:47 smithi070 ceph-mon[30942]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:47.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:47 smithi167 ceph-mon[34339]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:47 smithi134 ceph-mon[34525]: pgmap v33: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:31:48.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:48 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:31:48.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:48 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:31:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:48 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:31:49.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:49 smithi070 ceph-mon[30942]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:31:49.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:49 smithi167 ceph-mon[34339]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:31:50.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:49 smithi134 ceph-mon[34525]: pgmap v34: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:31:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:50 smithi070 ceph-mon[30942]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:50.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:50 smithi167 ceph-mon[34339]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:50 smithi134 ceph-mon[34525]: pgmap v35: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:53.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:53 smithi070 ceph-mon[30942]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:31:53.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:53 smithi167 ceph-mon[34339]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:31:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:53 smithi134 ceph-mon[34525]: pgmap v36: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:31:55.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:55 smithi070 ceph-mon[30942]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:55.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:55 smithi167 ceph-mon[34339]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:56.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:55 smithi134 ceph-mon[34525]: pgmap v37: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:56.643 INFO:tasks.workunit.client.0.smithi070.stderr:Note: switching to '6fad5dd73c93545e52f57f681e140a9c3529c11e'. 2024-09-19T04:31:56.643 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-19T04:31:56.643 INFO:tasks.workunit.client.0.smithi070.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-09-19T04:31:56.643 INFO:tasks.workunit.client.0.smithi070.stderr:changes and commit them, and you can discard any commits you make in this 2024-09-19T04:31:56.643 INFO:tasks.workunit.client.0.smithi070.stderr:state without impacting any branches by switching back to a branch. 2024-09-19T04:31:56.643 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-19T04:31:56.643 INFO:tasks.workunit.client.0.smithi070.stderr:If you want to create a new branch to retain commits you create, you may 2024-09-19T04:31:56.643 INFO:tasks.workunit.client.0.smithi070.stderr:do so (now or later) by using -c with the switch command. Example: 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr: git switch -c 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr:Or undo this operation with: 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr: git switch - 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr: 2024-09-19T04:31:56.644 INFO:tasks.workunit.client.0.smithi070.stderr:HEAD is now at 6fad5dd73c9 Merge pull request #59812 from neha-ojha/wip-rtd-squid 2024-09-19T04:31:56.649 DEBUG:teuthology.orchestra.run.smithi070:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-09-19T04:31:56.673 INFO:tasks.workunit.client.0.smithi070.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-09-19T04:31:56.675 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T04:31:56.676 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-09-19T04:31:57.396 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-09-19T04:31:57.479 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-09-19T04:31:57.529 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-09-19T04:31:57.530 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T04:31:57.530 INFO:tasks.workunit.client.0.smithi070.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-09-19T04:31:57.569 INFO:tasks.workunit.client.0.smithi070.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-09-19T04:31:57.573 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:31:57.573 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-09-19T04:31:57.634 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-09-19T04:31:57.635 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-09-19T04:31:57.636 DEBUG:teuthology.orchestra.run.smithi070:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=6fad5dd73c93545e52f57f681e140a9c3529c11e TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-09-19T04:31:57.700 INFO:tasks.workunit.client.0.smithi070.stderr:+ KERNEL=linux-4.0.5 2024-09-19T04:31:57.700 INFO:tasks.workunit.client.0.smithi070.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-09-19T04:31:57.837 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:57 smithi134 ceph-mon[34525]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:57.837 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:57 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:31:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:57 smithi070 ceph-mon[30942]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:57 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:31:57.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:57 smithi167 ceph-mon[34339]: pgmap v38: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:31:57.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:57 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:31:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:31:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:31:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:31:58.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:31:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:31:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:31:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:31:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:31:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:31:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:31:59 smithi070 ceph-mon[30942]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:31:59.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:31:59 smithi167 ceph-mon[34339]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:32:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:31:59 smithi134 ceph-mon[34525]: pgmap v39: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:32:01.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:01 smithi070 ceph-mon[30942]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:32:01.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:01 smithi167 ceph-mon[34339]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:32:02.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:01 smithi134 ceph-mon[34525]: pgmap v40: 97 pgs: 97 active+clean; 1.3 MiB data, 368 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:32:02.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:02 smithi070 ceph-mon[30942]: pgmap v41: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 787 KiB/s wr, 23 op/s 2024-09-19T04:32:02.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:02 smithi167 ceph-mon[34339]: pgmap v41: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 787 KiB/s wr, 23 op/s 2024-09-19T04:32:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:02 smithi134 ceph-mon[34525]: pgmap v41: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 787 KiB/s wr, 23 op/s 2024-09-19T04:32:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:04 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:32:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:04 smithi070 ceph-mon[30942]: pgmap v42: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 787 KiB/s wr, 20 op/s 2024-09-19T04:32:04.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:04 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:32:04.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:04 smithi167 ceph-mon[34339]: pgmap v42: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 787 KiB/s wr, 20 op/s 2024-09-19T04:32:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:04 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:32:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:04 smithi134 ceph-mon[34525]: pgmap v42: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 787 KiB/s wr, 20 op/s 2024-09-19T04:32:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:07 smithi070 ceph-mon[30942]: pgmap v43: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 787 KiB/s wr, 20 op/s 2024-09-19T04:32:07.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:07 smithi167 ceph-mon[34339]: pgmap v43: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 787 KiB/s wr, 20 op/s 2024-09-19T04:32:08.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:07 smithi134 ceph-mon[34525]: pgmap v43: 97 pgs: 97 active+clean; 10 MiB data, 395 MiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 787 KiB/s wr, 20 op/s 2024-09-19T04:32:09.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:09 smithi070 ceph-mon[30942]: pgmap v44: 97 pgs: 97 active+clean; 21 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.7 MiB/s wr, 25 op/s 2024-09-19T04:32:09.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:09 smithi167 ceph-mon[34339]: pgmap v44: 97 pgs: 97 active+clean; 21 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.7 MiB/s wr, 25 op/s 2024-09-19T04:32:10.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:09 smithi134 ceph-mon[34525]: pgmap v44: 97 pgs: 97 active+clean; 21 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 19 KiB/s rd, 1.7 MiB/s wr, 25 op/s 2024-09-19T04:32:11.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:11 smithi070 ceph-mon[30942]: pgmap v45: 97 pgs: 97 active+clean; 21 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 22 op/s 2024-09-19T04:32:11.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:11 smithi167 ceph-mon[34339]: pgmap v45: 97 pgs: 97 active+clean; 21 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 22 op/s 2024-09-19T04:32:12.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:11 smithi134 ceph-mon[34525]: pgmap v45: 97 pgs: 97 active+clean; 21 MiB data, 428 MiB used, 1.0 TiB / 1.0 TiB avail; 18 KiB/s rd, 1.7 MiB/s wr, 22 op/s 2024-09-19T04:32:13.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:13 smithi070 ceph-mon[30942]: pgmap v46: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-09-19T04:32:13.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:13 smithi167 ceph-mon[34339]: pgmap v46: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-09-19T04:32:14.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:13 smithi134 ceph-mon[34525]: pgmap v46: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 20 KiB/s rd, 3.0 MiB/s wr, 25 op/s 2024-09-19T04:32:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:15 smithi070 ceph-mon[30942]: pgmap v47: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 7 op/s 2024-09-19T04:32:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:15 smithi167 ceph-mon[34339]: pgmap v47: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 7 op/s 2024-09-19T04:32:16.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:15 smithi134 ceph-mon[34525]: pgmap v47: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 7 op/s 2024-09-19T04:32:16.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:32:16.526 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:32:16.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:16 smithi070 ceph-mon[30942]: pgmap v48: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 7 op/s 2024-09-19T04:32:16.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:16 smithi167 ceph-mon[34339]: pgmap v48: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 7 op/s 2024-09-19T04:32:17.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 -- 172.21.15.70:0/2875159595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8105e00 msgr2=0x7f95c810d980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 --2- 172.21.15.70:0/2875159595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8105e00 0x7f95c810d980 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f95c0009ca0 tx=0x7f95c002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 -- 172.21.15.70:0/2875159595 shutdown_connections 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 --2- 172.21.15.70:0/2875159595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8105e00 0x7f95c810d980 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 --2- 172.21.15.70:0/2875159595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c8101fc0 0x7f95c81056d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 --2- 172.21.15.70:0/2875159595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8101610 0x7f95c81019f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 -- 172.21.15.70:0/2875159595 >> 172.21.15.70:0/2875159595 conn(0x7f95c80fc5c0 msgr2=0x7f95c80fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 -- 172.21.15.70:0/2875159595 shutdown_connections 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.023+0000 7f95d0031640 1 -- 172.21.15.70:0/2875159595 wait complete. 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95d0031640 1 Processor -- start 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95d0031640 1 -- start start 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95d0031640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8101610 0x7f95c80fca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95d0031640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c8101fc0 0x7f95c80fcfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95d0031640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8105e00 0x7f95c80fd4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95d0031640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8110e30 con 0x7f95c8101610 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95d0031640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8110cb0 con 0x7f95c8105e00 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95d0031640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95c8110fb0 con 0x7f95c8101fc0 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95cddcd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8101610 0x7f95c80fca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95cddcd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8101610 0x7f95c80fca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49668/0 (socket says 172.21.15.70:49668) 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.024+0000 7f95cddcd640 1 -- 172.21.15.70:0/2308227912 learned_addr learned my addr 172.21.15.70:0/2308227912 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95ce5ce640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8105e00 0x7f95c80fd4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95cd5cc640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c8101fc0 0x7f95c80fcfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95cddcd640 1 -- 172.21.15.70:0/2308227912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c8101fc0 msgr2=0x7f95c80fcfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95cddcd640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c8101fc0 0x7f95c80fcfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95cddcd640 1 -- 172.21.15.70:0/2308227912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8105e00 msgr2=0x7f95c80fd4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95cddcd640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8105e00 0x7f95c80fd4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95cddcd640 1 -- 172.21.15.70:0/2308227912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95c81a67a0 con 0x7f95c8101610 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95cddcd640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8101610 0x7f95c80fca70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c920 tx=0x7f95c400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95beffd640 1 -- 172.21.15.70:0/2308227912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4007c70 con 0x7f95c8101610 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95d0031640 1 -- 172.21.15.70:0/2308227912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95c81a6a90 con 0x7f95c8101610 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95beffd640 1 -- 172.21.15.70:0/2308227912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95c4007e10 con 0x7f95c8101610 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95beffd640 1 -- 172.21.15.70:0/2308227912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4018850 con 0x7f95c8101610 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.025+0000 7f95d0031640 1 -- 172.21.15.70:0/2308227912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95c81a6fd0 con 0x7f95c8101610 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.027+0000 7f95beffd640 1 -- 172.21.15.70:0/2308227912 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 24) ==== 138639+0+0 (secure 0 0 0) 0x7f95c4018a30 con 0x7f95c8101610 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95d240a740 1 Processor -- start 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95d240a740 1 -- start start 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95d240a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 0x55723d177880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95d240a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d177dc0 0x55723d182140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95d240a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d182680 0x55723d184a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95d240a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55723d0dd2e0 con 0x55723d177dc0 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95d240a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55723d084ce0 con 0x55723d182680 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95d240a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55723d0d92a0 con 0x55723d1774a0 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95beffd640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95b40a3560 0x7f95b40a5a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95cddcd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d177dc0 0x55723d182140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95cddcd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d177dc0 0x55723d182140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49672/0 (socket says 172.21.15.70:49672) 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95cddcd640 1 -- 172.21.15.70:0/1114234138 learned_addr learned my addr 172.21.15.70:0/1114234138 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95ce5ce640 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 0x55723d177880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95ce5ce640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95b40a3560 0x7f95b40a5a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.028+0000 7f95cd5cc640 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d182680 0x55723d184a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95beffd640 1 -- 172.21.15.70:0/2308227912 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f95c40d01a0 con 0x7f95c8101610 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95cddcd640 1 -- 172.21.15.70:0/1114234138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 msgr2=0x55723d177880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95cddcd640 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 0x55723d177880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95cddcd640 1 -- 172.21.15.70:0/1114234138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d182680 msgr2=0x55723d184a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95cddcd640 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d182680 0x55723d184a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95cddcd640 1 -- 172.21.15.70:0/1114234138 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723d069440 con 0x55723d177dc0 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95ce5ce640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95b40a3560 0x7f95b40a5a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f95c0005fe0 tx=0x7f95c002f310 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95cddcd640 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d177dc0 0x55723d182140 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f95c40cd850 tx=0x7f95c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52629143c0d524c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95b3fff640 1 -- 172.21.15.70:0/1114234138 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c400de20 con 0x55723d177dc0 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95b3fff640 1 -- 172.21.15.70:0/1114234138 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95c40a8040 con 0x55723d177dc0 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.029+0000 7f95b3fff640 1 -- 172.21.15.70:0/1114234138 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4098910 con 0x55723d177dc0 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 -- 172.21.15.70:0/1114234138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d177dc0 msgr2=0x55723d182140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d177dc0 0x55723d182140 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f95c40cd850 tx=0x7f95c4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 -- 172.21.15.70:0/1114234138 shutdown_connections 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d182680 0x55723d184a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d177dc0 0x55723d182140 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 --2- 172.21.15.70:0/1114234138 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 0x55723d177880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 -- 172.21.15.70:0/1114234138 >> 172.21.15.70:0/1114234138 conn(0x55723d173a30 msgr2=0x55723d173e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 -- 172.21.15.70:0/1114234138 shutdown_connections 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 -- 172.21.15.70:0/1114234138 wait complete. 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 -- start start 2024-09-19T04:32:17.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.030+0000 7f95d240a740 1 Processor -- start 2024-09-19T04:32:17.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:16 smithi134 ceph-mon[34525]: pgmap v48: 97 pgs: 97 active+clean; 37 MiB data, 468 MiB used, 1.0 TiB / 1.0 TiB avail; 7.1 KiB/s rd, 2.3 MiB/s wr, 7 op/s 2024-09-19T04:32:17.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.031+0000 7f95d240a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 0x55723d181fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.031+0000 7f95d240a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d177dc0 0x55723d17f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.031+0000 7f95d240a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d182680 0x55723d17f7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.031+0000 7f95d240a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55723d185250 con 0x55723d182680 2024-09-19T04:32:17.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.031+0000 7f95d240a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55723d098050 con 0x55723d177dc0 2024-09-19T04:32:17.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.031+0000 7f95d240a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55723d1853d0 con 0x55723d1774a0 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.031+0000 7f95d240a740 10 client.0 _ll_register_callbacks cb 0x55723d0d8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.031+0000 7f95ce5ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d182680 0x55723d17f7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95ce5ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d182680 0x55723d17f7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49684/0 (socket says 172.21.15.70:49684) 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95ce5ce640 1 -- 172.21.15.70:0/3387395935 learned_addr learned my addr 172.21.15.70:0/3387395935 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95cd5cc640 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d177dc0 0x55723d17f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95cddcd640 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 0x55723d181fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95ce5ce640 1 -- 172.21.15.70:0/3387395935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 msgr2=0x55723d181fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95ce5ce640 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 0x55723d181fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95ce5ce640 1 -- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d177dc0 msgr2=0x55723d17f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95ce5ce640 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d177dc0 0x55723d17f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95ce5ce640 1 -- 172.21.15.70:0/3387395935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723ce4e3c0 con 0x55723d182680 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95cd5cc640 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d177dc0 0x55723d17f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:32:17.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95ce5ce640 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d182680 0x55723d17f7a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f95c0035000 tx=0x7f95c0009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b02c3a218eaccf6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95b17fa640 1 -- 172.21.15.70:0/3387395935 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c0051070 con 0x55723d182680 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95d240a740 1 -- 172.21.15.70:0/3387395935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95c40a8040 con 0x55723d182680 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95b17fa640 1 -- 172.21.15.70:0/3387395935 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f95c0004b40 con 0x55723d182680 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95b17fa640 1 -- 172.21.15.70:0/3387395935 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95c005d050 con 0x55723d182680 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95d240a740 10 client.15477 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.032+0000 7f95d240a740 1 -- 172.21.15.70:0/3387395935 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55723d190c30 con 0x55723d182680 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95b17fa640 1 -- 172.21.15.70:0/3387395935 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95c40a8040 con 0x55723d182680 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95b17fa640 1 -- 172.21.15.70:0/3387395935 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f95c004a040 con 0x55723d182680 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95d240a740 10 client.15477 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95d240a740 10 client.15477 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:32:17.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95d240a740 20 client.15477 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95d240a740 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55723d192100 0x55723d194560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95d240a740 4 client.15477 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95d240a740 1 -- 172.21.15.70:0/3387395935 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55723d0ea850 con 0x55723d192100 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.033+0000 7f95cddcd640 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55723d192100 0x55723d194560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.034+0000 7f95b17fa640 10 client.15477 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.034+0000 7f95cddcd640 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55723d192100 0x55723d194560 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e4733dce81f445a9 server_cookie=7b44becccf83d4f2 in_seq=0 out_seq=0 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.034+0000 7f95b17fa640 1 -- 172.21.15.70:0/3387395935 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55723d0ea850 con 0x55723d192100 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.034+0000 7f95b17fa640 10 client.15477 handle_command_reply: tid=0 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.034+0000 7f95d240a740 1 client.15477 shutdown 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.034+0000 7f95d240a740 1 -- 172.21.15.70:0/3387395935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d182680 msgr2=0x55723d17f7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.034+0000 7f95d240a740 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d182680 0x55723d17f7a0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f95c0035000 tx=0x7f95c0009380 comp rx=0 tx=0).stop 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 1 -- 172.21.15.70:0/3387395935 shutdown_connections 2024-09-19T04:32:17.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55723d192100 0x55723d194560 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d182680 0x55723d17f7a0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d177dc0 0x55723d17f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95b17fa640 0 client.15477 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:17.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 1 --2- 172.21.15.70:0/3387395935 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d1774a0 0x55723d181fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 1 -- 172.21.15.70:0/3387395935 >> 172.21.15.70:0/3387395935 conn(0x55723d173a30 msgr2=0x55723d179710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:17.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 1 -- 172.21.15.70:0/3387395935 shutdown_connections 2024-09-19T04:32:17.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 1 -- 172.21.15.70:0/3387395935 wait complete. 2024-09-19T04:32:17.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.035+0000 7f95d240a740 20 client.15477 trim_cache size 0 max 16384 2024-09-19T04:32:17.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95d240a740 1 Processor -- start 2024-09-19T04:32:17.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95d240a740 1 -- start start 2024-09-19T04:32:17.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95d240a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d173a30 0x55723d18e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95d240a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d1774a0 0x55723d17f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95d240a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 0x55723d17a7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95d240a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81b2110 con 0x55723d173a30 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95d240a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81af9e0 con 0x55723d1774a0 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95d240a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81ad830 con 0x55723d177dc0 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95cddcd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d173a30 0x55723d18e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95cddcd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d173a30 0x55723d18e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49686/0 (socket says 172.21.15.70:49686) 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95cddcd640 1 -- 172.21.15.70:0/3389982426 learned_addr learned my addr 172.21.15.70:0/3389982426 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95cddcd640 1 -- 172.21.15.70:0/3389982426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 msgr2=0x55723d17a7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95cddcd640 1 --2- 172.21.15.70:0/3389982426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 0x55723d17a7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95cddcd640 1 -- 172.21.15.70:0/3389982426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d1774a0 msgr2=0x55723d17f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95cddcd640 1 --2- 172.21.15.70:0/3389982426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d1774a0 0x55723d17f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.052+0000 7f95cddcd640 1 -- 172.21.15.70:0/3389982426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55723d182320 con 0x55723d173a30 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95cddcd640 1 --2- 172.21.15.70:0/3389982426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d173a30 0x55723d18e4e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f95c4098c70 tx=0x7f95c409bde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=993e01e106e516c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:17.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95b37fe640 1 -- 172.21.15.70:0/3389982426 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c409c2a0 con 0x55723d173a30 2024-09-19T04:32:17.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95b37fe640 1 -- 172.21.15.70:0/3389982426 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95c400de20 con 0x55723d173a30 2024-09-19T04:32:17.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95b37fe640 1 -- 172.21.15.70:0/3389982426 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95c4098910 con 0x55723d173a30 2024-09-19T04:32:17.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95d240a740 1 -- 172.21.15.70:0/3389982426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d173a30 msgr2=0x55723d18e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95d240a740 1 --2- 172.21.15.70:0/3389982426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d173a30 0x55723d18e4e0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f95c4098c70 tx=0x7f95c409bde0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95d240a740 1 -- 172.21.15.70:0/3389982426 shutdown_connections 2024-09-19T04:32:17.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95d240a740 1 --2- 172.21.15.70:0/3389982426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 0x55723d17a7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95d240a740 1 --2- 172.21.15.70:0/3389982426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d1774a0 0x55723d17f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95d240a740 1 --2- 172.21.15.70:0/3389982426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d173a30 0x55723d18e4e0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.053+0000 7f95d240a740 1 -- 172.21.15.70:0/3389982426 >> 172.21.15.70:0/3389982426 conn(0x55723d17f900 msgr2=0x55723d17a090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:17.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 -- 172.21.15.70:0/3389982426 shutdown_connections 2024-09-19T04:32:17.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 -- 172.21.15.70:0/3389982426 wait complete. 2024-09-19T04:32:17.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 -- start start 2024-09-19T04:32:17.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 Processor -- start 2024-09-19T04:32:17.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d173a30 0x55723d18af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d1774a0 0x55723d1862c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 0x55723d186a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81adea0 con 0x55723d1774a0 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81af310 con 0x55723d173a30 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95c81ae570 con 0x55723d177dc0 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95d240a740 10 client.0 _ll_register_callbacks cb 0x7f95c0032f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95cd5cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d1774a0 0x55723d1862c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95cd5cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d1774a0 0x55723d1862c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49702/0 (socket says 172.21.15.70:49702) 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.054+0000 7f95cd5cc640 1 -- 172.21.15.70:0/1251159479 learned_addr learned my addr 172.21.15.70:0/1251159479 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95cddcd640 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d173a30 0x55723d18af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95ce5ce640 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 0x55723d186a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95cd5cc640 1 -- 172.21.15.70:0/1251159479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 msgr2=0x55723d186a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95cd5cc640 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 0x55723d186a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95cd5cc640 1 -- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d173a30 msgr2=0x55723d18af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95cd5cc640 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d173a30 0x55723d18af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95cd5cc640 1 -- 172.21.15.70:0/1251159479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55723d1fbe00 con 0x55723d1774a0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95cddcd640 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d173a30 0x55723d18af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95cd5cc640 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d1774a0 0x55723d1862c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f95c80fe500 tx=0x7f95b800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9123ca94c5052e7e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95b17fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95b17fa640 1 -- 172.21.15.70:0/1251159479 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b801d020 con 0x55723d1774a0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95b17fa640 1 -- 172.21.15.70:0/1251159479 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f95b800ec50 con 0x55723d1774a0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.055+0000 7f95d240a740 1 -- 172.21.15.70:0/1251159479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95c400de20 con 0x55723d1774a0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95b17fa640 1 -- 172.21.15.70:0/1251159479 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f95b800ee50 con 0x55723d1774a0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95d240a740 10 client.15483 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95d240a740 1 -- 172.21.15.70:0/1251159479 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55723d1fd040 con 0x55723d1774a0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95b17fa640 1 -- 172.21.15.70:0/1251159479 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95c400de20 con 0x55723d1774a0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95b17fa640 1 -- 172.21.15.70:0/1251159479 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f95b8018070 con 0x55723d1774a0 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95d240a740 10 client.15483 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:17.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95d240a740 10 client.15483 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95d240a740 20 client.15483 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95d240a740 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55723d182680 0x55723d1ff8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95d240a740 4 client.15483 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95d240a740 1 -- 172.21.15.70:0/1251159479 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55723d0e4d60 con 0x55723d182680 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.056+0000 7f95cddcd640 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55723d182680 0x55723d1ff8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95b17fa640 10 client.15483 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95cddcd640 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55723d182680 0x55723d1ff8b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf707b228589e67 server_cookie=c0f219b7a927abf2 in_seq=0 out_seq=0 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95b17fa640 1 -- 172.21.15.70:0/1251159479 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55723d0e4d60 con 0x55723d182680 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95b17fa640 10 client.15483 handle_command_reply: tid=0 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 client.15483 shutdown 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 -- 172.21.15.70:0/1251159479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d1774a0 msgr2=0x55723d1862c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d1774a0 0x55723d1862c0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f95c80fe500 tx=0x7f95b800bf60 comp rx=0 tx=0).stop 2024-09-19T04:32:17.064 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 -- 172.21.15.70:0/1251159479 shutdown_connections 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55723d182680 0x55723d1ff8b0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55723d177dc0 0x55723d186a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95b17fa640 0 client.15483 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55723d1774a0 0x55723d1862c0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 --2- 172.21.15.70:0/1251159479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55723d173a30 0x55723d18af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 -- 172.21.15.70:0/1251159479 >> 172.21.15.70:0/1251159479 conn(0x55723d17f900 msgr2=0x55723d1812e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 -- 172.21.15.70:0/1251159479 shutdown_connections 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 1 -- 172.21.15.70:0/1251159479 wait complete. 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.057+0000 7f95d240a740 20 client.15483 trim_cache size 0 max 16384 2024-09-19T04:32:17.065 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:32:17.066 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:32:17.066 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:32:17.066 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:32:17.066 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 -- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95b40a3560 msgr2=0x7f95b40a5a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95b40a3560 0x7f95b40a5a20 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f95c0005fe0 tx=0x7f95c002f310 comp rx=0 tx=0).stop 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 -- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8101610 msgr2=0x7f95c80fca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8101610 0x7f95c80fca70 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f95c400c920 tx=0x7f95c400cde0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 -- 172.21.15.70:0/2308227912 shutdown_connections 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95b40a3560 0x7f95b40a5a20 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95c8105e00 0x7f95c80fd4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95c8101fc0 0x7f95c80fcfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 --2- 172.21.15.70:0/2308227912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95c8101610 0x7f95c80fca70 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 -- 172.21.15.70:0/2308227912 >> 172.21.15.70:0/2308227912 conn(0x7f95c80fc5c0 msgr2=0x7f95c8100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 -- 172.21.15.70:0/2308227912 shutdown_connections 2024-09-19T04:32:17.067 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:17.058+0000 7f95d0031640 1 -- 172.21.15.70:0/2308227912 wait complete. 2024-09-19T04:32:17.908 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:32:17.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:32:18.169 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:32:18.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 -- 172.21.15.70:0/2078194566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c102df0 msgr2=0x7f287c1031d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:18.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 --2- 172.21.15.70:0/2078194566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c102df0 0x7f287c1031d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f286c009900 tx=0x7f286c02a410 comp rx=0 tx=0).stop 2024-09-19T04:32:18.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 -- 172.21.15.70:0/2078194566 shutdown_connections 2024-09-19T04:32:18.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 --2- 172.21.15.70:0/2078194566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c10c2f0 0x7f287c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 --2- 172.21.15.70:0/2078194566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f287c1037a0 0x7f287c10bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 --2- 172.21.15.70:0/2078194566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c102df0 0x7f287c1031d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 -- 172.21.15.70:0/2078194566 >> 172.21.15.70:0/2078194566 conn(0x7f287c0fc7d0 msgr2=0x7f287c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 -- 172.21.15.70:0/2078194566 shutdown_connections 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.658+0000 7f2881035640 1 -- 172.21.15.70:0/2078194566 wait complete. 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.659+0000 7f2881035640 1 Processor -- start 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.659+0000 7f2881035640 1 -- start start 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f2881035640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c102df0 0x7f287c1986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f2881035640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f287c1037a0 0x7f287c198c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:18.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f2881035640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c10c2f0 0x7f287c19cf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f2881035640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f287c1121c0 con 0x7f287c10c2f0 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f2881035640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f287c112040 con 0x7f287c102df0 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f2881035640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f287c112340 con 0x7f287c1037a0 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c10c2f0 0x7f287c19cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c10c2f0 0x7f287c19cf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49714/0 (socket says 172.21.15.70:49714) 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 -- 172.21.15.70:0/627746865 learned_addr learned my addr 172.21.15.70:0/627746865 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287ad9d640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c102df0 0x7f287c1986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f2873fff640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f287c1037a0 0x7f287c198c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 -- 172.21.15.70:0/627746865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f287c1037a0 msgr2=0x7f287c198c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f287c1037a0 0x7f287c198c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 -- 172.21.15.70:0/627746865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c102df0 msgr2=0x7f287c1986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c102df0 0x7f287c1986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 -- 172.21.15.70:0/627746865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f287c19d670 con 0x7f287c10c2f0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287ad9d640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c102df0 0x7f287c1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f287b59e640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c10c2f0 0x7f287c19cf90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f287400b970 tx=0x7f287400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.660+0000 7f2878d99640 1 -- 172.21.15.70:0/627746865 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874019070 con 0x7f287c10c2f0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.661+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f287c19d960 con 0x7f287c10c2f0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.661+0000 7f2878d99640 1 -- 172.21.15.70:0/627746865 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f287400cb40 con 0x7f287c10c2f0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.661+0000 7f2878d99640 1 -- 172.21.15.70:0/627746865 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2874007650 con 0x7f287c10c2f0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.661+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f287c1a5240 con 0x7f287c10c2f0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.662+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f287c06a790 con 0x7f287c10c2f0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.663+0000 7f2878d99640 1 -- 172.21.15.70:0/627746865 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f287401c070 con 0x7f287c10c2f0 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.663+0000 7f2878d99640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28680a33b0 0x7f28680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:18.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.664+0000 7f287ad9d640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28680a33b0 0x7f28680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:18.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.664+0000 7f2878d99640 1 -- 172.21.15.70:0/627746865 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f28740cf780 con 0x7f287c10c2f0 2024-09-19T04:32:18.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.664+0000 7f287ad9d640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28680a33b0 0x7f28680a5870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f286c02a930 tx=0x7f286c000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:18.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.667+0000 7f2878d99640 1 -- 172.21.15.70:0/627746865 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f287409c290 con 0x7f287c10c2f0 2024-09-19T04:32:18.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.881+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f287c1031d0 con 0x7f287c10c2f0 2024-09-19T04:32:18.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.881+0000 7f2878d99640 1 -- 172.21.15.70:0/627746865 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11915 (secure 0 0 0) 0x7f287c1031d0 con 0x7f287c10c2f0 2024-09-19T04:32:18.883 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:32:18.883 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":25,"btime":"2024-09-19T04:32:03:589143+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:32:02.592571+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:32:18.883 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 25 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28680a33b0 msgr2=0x7f28680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28680a33b0 0x7f28680a5870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f286c02a930 tx=0x7f286c000bc0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c10c2f0 msgr2=0x7f287c19cf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c10c2f0 0x7f287c19cf90 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f287400b970 tx=0x7f287400be30 comp rx=0 tx=0).stop 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 shutdown_connections 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28680a33b0 0x7f28680a5870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f287c10c2f0 0x7f287c19cf90 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f287c1037a0 0x7f287c198c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 --2- 172.21.15.70:0/627746865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f287c102df0 0x7f287c1986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 >> 172.21.15.70:0/627746865 conn(0x7f287c0fc7d0 msgr2=0x7f287c0fd490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 shutdown_connections 2024-09-19T04:32:18.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:18.884+0000 7f2881035640 1 -- 172.21.15.70:0/627746865 wait complete. 2024-09-19T04:32:19.682 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:32:19.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:19 smithi070 ceph-mon[30942]: pgmap v49: 97 pgs: 97 active+clean; 45 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 2.9 MiB/s wr, 11 op/s 2024-09-19T04:32:19.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:19 smithi070 ceph-mon[30942]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T04:32:19.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:19 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/627746865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:32:19.939 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:32:19.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:19 smithi167 ceph-mon[34339]: pgmap v49: 97 pgs: 97 active+clean; 45 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 2.9 MiB/s wr, 11 op/s 2024-09-19T04:32:19.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:19 smithi167 ceph-mon[34339]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T04:32:19.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:19 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/627746865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:32:20.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:19 smithi134 ceph-mon[34525]: pgmap v49: 97 pgs: 97 active+clean; 45 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 9.6 KiB/s rd, 2.9 MiB/s wr, 11 op/s 2024-09-19T04:32:20.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:19 smithi134 ceph-mon[34525]: mgrmap e25: x(active, since 92s), standbys: y, z 2024-09-19T04:32:20.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:19 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/627746865' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 -- 172.21.15.70:0/1826922291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c100e20 msgr2=0x7eff8c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 --2- 172.21.15.70:0/1826922291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c100e20 0x7eff8c101200 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7eff7c009900 tx=0x7eff7c02a480 comp rx=0 tx=0).stop 2024-09-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 -- 172.21.15.70:0/1826922291 shutdown_connections 2024-09-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 --2- 172.21.15.70:0/1826922291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff8c102ef0 0x7eff8c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 --2- 172.21.15.70:0/1826922291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c102570 0x7eff8c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 --2- 172.21.15.70:0/1826922291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c100e20 0x7eff8c101200 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 -- 172.21.15.70:0/1826922291 >> 172.21.15.70:0/1826922291 conn(0x7eff8c0fc7d0 msgr2=0x7eff8c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:20.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 -- 172.21.15.70:0/1826922291 shutdown_connections 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 -- 172.21.15.70:0/1826922291 wait complete. 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.441+0000 7eff9206f640 1 Processor -- start 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff9206f640 1 -- start start 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff9206f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff8c100e20 0x7eff8c1992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff9206f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c102570 0x7eff8c199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff9206f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c102ef0 0x7eff8c1a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff9206f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c110f70 con 0x7eff8c102570 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff9206f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c110df0 con 0x7eff8c100e20 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff9206f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c1110f0 con 0x7eff8c102ef0 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c102570 0x7eff8c199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c102570 0x7eff8c199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49734/0 (socket says 172.21.15.70:49734) 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 -- 172.21.15.70:0/10060347 learned_addr learned my addr 172.21.15.70:0/10060347 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:20.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8bfff640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c102ef0 0x7eff8c1a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff8c100e20 0x7eff8c1992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 -- 172.21.15.70:0/10060347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c102ef0 msgr2=0x7eff8c1a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c102ef0 0x7eff8c1a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 -- 172.21.15.70:0/10060347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff8c100e20 msgr2=0x7eff8c1992e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff8c100e20 0x7eff8c1992e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 -- 172.21.15.70:0/10060347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8c1a48a0 con 0x7eff8c102570 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.442+0000 7eff8affd640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c102570 0x7eff8c199820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7eff8000c920 tx=0x7eff8000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.443+0000 7eff88ff9640 1 -- 172.21.15.70:0/10060347 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80007c70 con 0x7eff8c102570 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.443+0000 7eff88ff9640 1 -- 172.21.15.70:0/10060347 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7eff80007e10 con 0x7eff8c102570 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.443+0000 7eff9206f640 1 -- 172.21.15.70:0/10060347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff8c1a4a70 con 0x7eff8c102570 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.443+0000 7eff88ff9640 1 -- 172.21.15.70:0/10060347 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff80018850 con 0x7eff8c102570 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.443+0000 7eff9206f640 1 -- 172.21.15.70:0/10060347 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff8c1a4fb0 con 0x7eff8c102570 2024-09-19T04:32:20.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.445+0000 7eff88ff9640 1 -- 172.21.15.70:0/10060347 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7eff80018a30 con 0x7eff8c102570 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.445+0000 7eff94448740 1 Processor -- start 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.445+0000 7eff94448740 1 -- start start 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff94448740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9387e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff94448740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9387ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff94448740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff94448740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e937e42f0 con 0x558e9387fb40 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff94448740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558e9378bcf0 con 0x558e9388d780 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff94448740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558e937e02b0 con 0x558e9387e5d0 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff88ff9640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7eff740a3430 0x7eff740a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9387e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9387e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49742/0 (socket says 172.21.15.70:49742) 2024-09-19T04:32:20.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 -- 172.21.15.70:0/3968491179 learned_addr learned my addr 172.21.15.70:0/3968491179 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7eff740a3430 0x7eff740a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9387ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff88ff9640 1 -- 172.21.15.70:0/10060347 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7eff800cfda0 con 0x7eff8c102570 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8affd640 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 -- 172.21.15.70:0/3968491179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 msgr2=0x558e9387ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9387ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 -- 172.21.15.70:0/3968491179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 msgr2=0x558e9388fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 -- 172.21.15.70:0/3968491179 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e937703a0 con 0x558e9387fb40 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8affd640 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.446+0000 7eff8bfff640 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9387e090 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7eff84014a60 tx=0x7eff84014e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea52e02424aa340 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:20.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff71ffb640 1 -- 172.21.15.70:0/3968491179 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84004d20 con 0x558e9387fb40 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff71ffb640 1 -- 172.21.15.70:0/3968491179 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7eff84023070 con 0x558e9387fb40 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff71ffb640 1 -- 172.21.15.70:0/3968491179 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff84005540 con 0x558e9387fb40 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff8bfff640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7eff740a3430 0x7eff740a58f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff84022000 tx=0x7eff8401e000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 -- 172.21.15.70:0/3968491179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 msgr2=0x558e9387e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9387e090 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7eff84014a60 tx=0x7eff84014e60 comp rx=0 tx=0).stop 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 -- 172.21.15.70:0/3968491179 shutdown_connections 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9387ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 --2- 172.21.15.70:0/3968491179 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9387e090 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 -- 172.21.15.70:0/3968491179 >> 172.21.15.70:0/3968491179 conn(0x558e93847310 msgr2=0x558e9387ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 -- 172.21.15.70:0/3968491179 shutdown_connections 2024-09-19T04:32:20.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.447+0000 7eff94448740 1 -- 172.21.15.70:0/3968491179 wait complete. 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 1 -- start start 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 1 Processor -- start 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9388d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9388a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e93890480 con 0x558e9387fb40 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558e9379f060 con 0x558e9388d780 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558e93890600 con 0x558e9387e5d0 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff94448740 10 client.0 _ll_register_callbacks cb 0x558e934f28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff8affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9388a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff8affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9388a3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49752/0 (socket says 172.21.15.70:49752) 2024-09-19T04:32:20.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.448+0000 7eff8affd640 1 -- 172.21.15.70:0/861187500 learned_addr learned my addr 172.21.15.70:0/861187500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9388d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8bfff640 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8affd640 1 -- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 msgr2=0x558e9388d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8affd640 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9388d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8affd640 1 -- 172.21.15.70:0/861187500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 msgr2=0x558e9388a9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8affd640 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388a9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8affd640 1 -- 172.21.15.70:0/861187500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e935553c0 con 0x558e9387fb40 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9388d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff8affd640 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9388a3f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7eff800984a0 tx=0x7eff8000fb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=414e7644873486e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff6affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff6affd640 1 -- 172.21.15.70:0/861187500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800b4070 con 0x558e9387fb40 2024-09-19T04:32:20.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff6affd640 1 -- 172.21.15.70:0/861187500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7eff800cd730 con 0x558e9387fb40 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff94448740 1 -- 172.21.15.70:0/861187500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff84023070 con 0x558e9387fb40 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff6affd640 1 -- 172.21.15.70:0/861187500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff800cd930 con 0x558e9387fb40 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff94448740 10 client.15501 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff94448740 1 -- 172.21.15.70:0/861187500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e9389be50 con 0x558e9387fb40 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff6affd640 1 -- 172.21.15.70:0/861187500 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7eff84023070 con 0x558e9387fb40 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff6affd640 1 -- 172.21.15.70:0/861187500 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7eff80097d90 con 0x558e9387fb40 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff94448740 10 client.15501 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff94448740 10 client.15501 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.449+0000 7eff94448740 20 client.15501 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.450+0000 7eff94448740 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x558e9389d1a0 0x558e9389f5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.450+0000 7eff94448740 4 client.15501 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.450+0000 7eff94448740 1 -- 172.21.15.70:0/861187500 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e937f1860 con 0x558e9389d1a0 2024-09-19T04:32:20.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.450+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x558e9389d1a0 0x558e9389f5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.450+0000 7eff6affd640 10 client.15501 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.450+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x558e9389d1a0 0x558e9389f5b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cb9cc61714b268fe server_cookie=1f69281be7f82 in_seq=0 out_seq=0 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff6affd640 1 -- 172.21.15.70:0/861187500 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e937f1860 con 0x558e9389d1a0 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff6affd640 10 client.15501 handle_command_reply: tid=0 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 client.15501 shutdown 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 -- 172.21.15.70:0/861187500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 msgr2=0x558e9388a3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9388a3f0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7eff800984a0 tx=0x7eff8000fb90 comp rx=0 tx=0).stop 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 -- 172.21.15.70:0/861187500 shutdown_connections 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x558e9389d1a0 0x558e9389f5b0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e9388a9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff6affd640 0 client.15501 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:32:20.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e9388a3f0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 --2- 172.21.15.70:0/861187500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387e5d0 0x558e9388d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 -- 172.21.15.70:0/861187500 >> 172.21.15.70:0/861187500 conn(0x558e93847310 msgr2=0x558e93880960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 -- 172.21.15.70:0/861187500 shutdown_connections 2024-09-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 1 -- 172.21.15.70:0/861187500 wait complete. 2024-09-19T04:32:20.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.451+0000 7eff94448740 20 client.15501 trim_cache size 0 max 16384 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff94448740 1 Processor -- start 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff94448740 1 -- start start 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff94448740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387e5d0 0x558e93899720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff94448740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387fb40 0x558e93888cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff94448740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e93889200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff94448740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c1ade20 con 0x558e9387e5d0 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff94448740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c1ab6f0 con 0x558e9388d780 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff94448740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c1a9540 con 0x558e9387fb40 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff8b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387e5d0 0x558e93899720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.464+0000 7eff8b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387e5d0 0x558e93899720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49754/0 (socket says 172.21.15.70:49754) 2024-09-19T04:32:20.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8b7fe640 1 -- 172.21.15.70:0/1877337177 learned_addr learned my addr 172.21.15.70:0/1877337177 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8bfff640 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e93889200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8affd640 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387fb40 0x558e93888cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8b7fe640 1 -- 172.21.15.70:0/1877337177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387fb40 msgr2=0x558e93888cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387fb40 0x558e93888cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8b7fe640 1 -- 172.21.15.70:0/1877337177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 msgr2=0x558e93889200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e93889200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8b7fe640 1 -- 172.21.15.70:0/1877337177 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e9387b960 con 0x558e9387e5d0 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8affd640 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387fb40 0x558e93888cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8bfff640 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e93889200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387e5d0 0x558e93899720 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7eff7c02aa40 tx=0x7eff7c005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71c9373fdb717576 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff717fa640 1 -- 172.21.15.70:0/1877337177 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c035040 con 0x558e9387e5d0 2024-09-19T04:32:20.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff717fa640 1 -- 172.21.15.70:0/1877337177 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7eff7c04a070 con 0x558e9387e5d0 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.465+0000 7eff717fa640 1 -- 172.21.15.70:0/1877337177 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c0457e0 con 0x558e9387e5d0 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 -- 172.21.15.70:0/1877337177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387e5d0 msgr2=0x558e93899720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387e5d0 0x558e93899720 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7eff7c02aa40 tx=0x7eff7c005a20 comp rx=0 tx=0).stop 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 -- 172.21.15.70:0/1877337177 shutdown_connections 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9388d780 0x558e93889200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9387fb40 0x558e93888cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 --2- 172.21.15.70:0/1877337177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387e5d0 0x558e93899720 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 -- 172.21.15.70:0/1877337177 >> 172.21.15.70:0/1877337177 conn(0x558e93847310 msgr2=0x558e93885720 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 -- 172.21.15.70:0/1877337177 shutdown_connections 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 -- 172.21.15.70:0/1877337177 wait complete. 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 -- start start 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.466+0000 7eff94448740 1 Processor -- start 2024-09-19T04:32:20.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff94448740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9387e5d0 0x558e93896100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff94448740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e93891430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff94448740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9388d780 0x558e93891a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff94448740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c1a9bb0 con 0x558e9387fb40 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff94448740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c1ab020 con 0x558e9387e5d0 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff94448740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c1aa280 con 0x558e9388d780 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff94448740 10 client.0 _ll_register_callbacks cb 0x7eff8000fd80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e93891430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e93891430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49760/0 (socket says 172.21.15.70:49760) 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 -- 172.21.15.70:0/4213721966 learned_addr learned my addr 172.21.15.70:0/4213721966 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8bfff640 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9388d780 0x558e93891a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9387e5d0 0x558e93896100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 -- 172.21.15.70:0/4213721966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9388d780 msgr2=0x558e93891a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9388d780 0x558e93891a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 -- 172.21.15.70:0/4213721966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9387e5d0 msgr2=0x558e93896100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9387e5d0 0x558e93896100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 -- 172.21.15.70:0/4213721966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e93892250 con 0x558e9387fb40 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff8affd640 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e93891430 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff8009bd40 tx=0x7eff8009bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ff8193fb2a36ef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff6affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff6affd640 1 -- 172.21.15.70:0/4213721966 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff800a8060 con 0x558e9387fb40 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff6affd640 1 -- 172.21.15.70:0/4213721966 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7eff800cd730 con 0x558e9387fb40 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.467+0000 7eff94448740 1 -- 172.21.15.70:0/4213721966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff7c04a070 con 0x558e9387fb40 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff6affd640 1 -- 172.21.15.70:0/4213721966 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7eff800cd930 con 0x558e9387fb40 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff94448740 10 client.15507 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:20.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff94448740 1 -- 172.21.15.70:0/4213721966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e93907ed0 con 0x558e9387fb40 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff6affd640 1 -- 172.21.15.70:0/4213721966 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7eff7c04a070 con 0x558e9387fb40 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff6affd640 1 -- 172.21.15.70:0/4213721966 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7eff800b0150 con 0x558e9387fb40 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff94448740 10 client.15507 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff94448740 10 client.15507 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff94448740 20 client.15507 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff94448740 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x558e939084c0 0x558e9390a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff94448740 4 client.15507 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff94448740 1 -- 172.21.15.70:0/4213721966 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e937ebd70 con 0x558e939084c0 2024-09-19T04:32:20.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.468+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x558e939084c0 0x558e9390a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff6affd640 10 client.15507 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff8b7fe640 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x558e939084c0 0x558e9390a8e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=ab34362034ccc20d server_cookie=366b42591df573d8 in_seq=0 out_seq=0 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff6affd640 1 -- 172.21.15.70:0/4213721966 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e937ebd70 con 0x558e939084c0 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff6affd640 10 client.15507 handle_command_reply: tid=0 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 client.15507 shutdown 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 -- 172.21.15.70:0/4213721966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 msgr2=0x558e93891430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e93891430 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7eff8009bd40 tx=0x7eff8009bc00 comp rx=0 tx=0).stop 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 -- 172.21.15.70:0/4213721966 shutdown_connections 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x558e939084c0 0x558e9390a8e0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e9388d780 0x558e93891a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e9387fb40 0x558e93891430 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 --2- 172.21.15.70:0/4213721966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e9387e5d0 0x558e93896100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff6affd640 0 client.15507 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:32:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 -- 172.21.15.70:0/4213721966 >> 172.21.15.70:0/4213721966 conn(0x558e93847310 msgr2=0x558e93888880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 -- 172.21.15.70:0/4213721966 shutdown_connections 2024-09-19T04:32:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 1 -- 172.21.15.70:0/4213721966 wait complete. 2024-09-19T04:32:20.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.469+0000 7eff94448740 20 client.15507 trim_cache size 0 max 16384 2024-09-19T04:32:20.481 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 -- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7eff740a3430 msgr2=0x7eff740a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7eff740a3430 0x7eff740a58f0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7eff84022000 tx=0x7eff8401e000 comp rx=0 tx=0).stop 2024-09-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 -- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c102570 msgr2=0x7eff8c199820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c102570 0x7eff8c199820 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7eff8000c920 tx=0x7eff8000cde0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 -- 172.21.15.70:0/10060347 shutdown_connections 2024-09-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7eff740a3430 0x7eff740a58f0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7eff8c102ef0 0x7eff8c1a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7eff8c102570 0x7eff8c199820 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 --2- 172.21.15.70:0/10060347 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff8c100e20 0x7eff8c1992e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 -- 172.21.15.70:0/10060347 >> 172.21.15.70:0/10060347 conn(0x7eff8c0fc7d0 msgr2=0x7eff8c105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 -- 172.21.15.70:0/10060347 shutdown_connections 2024-09-19T04:32:20.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:20.470+0000 7eff9206f640 1 -- 172.21.15.70:0/10060347 wait complete. 2024-09-19T04:32:21.265 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:32:21.514 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:32:21.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:21 smithi070 ceph-mon[30942]: pgmap v50: 97 pgs: 97 active+clean; 45 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 MiB/s wr, 7 op/s 2024-09-19T04:32:21.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:21 smithi167 ceph-mon[34339]: pgmap v50: 97 pgs: 97 active+clean; 45 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 MiB/s wr, 7 op/s 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 -- 172.21.15.70:0/1350739505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 msgr2=0x7f8b2c10d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 --2- 172.21.15.70:0/1350739505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 0x7f8b2c10d970 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7f8b24009ca0 tx=0x7f8b2402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 -- 172.21.15.70:0/1350739505 shutdown_connections 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 --2- 172.21.15.70:0/1350739505 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 0x7f8b2c10d970 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 --2- 172.21.15.70:0/1350739505 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b2c1011c0 0x7f8b2c101620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 --2- 172.21.15.70:0/1350739505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b2c105ad0 0x7f8b2c105eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 -- 172.21.15.70:0/1350739505 >> 172.21.15.70:0/1350739505 conn(0x7f8b2c077210 msgr2=0x7f8b2c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 -- 172.21.15.70:0/1350739505 shutdown_connections 2024-09-19T04:32:21.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.964+0000 7f8b345a0640 1 -- 172.21.15.70:0/1350739505 wait complete. 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b345a0640 1 Processor -- start 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b345a0640 1 -- start start 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b345a0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b2c1011c0 0x7f8b2c0fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b345a0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 0x7f8b2c0fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b345a0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b2c105ad0 0x7f8b2c0fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b345a0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c110ec0 con 0x7f8b2c101b60 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b345a0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c110d40 con 0x7f8b2c1011c0 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b345a0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c111040 con 0x7f8b2c105ad0 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b31b3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 0x7f8b2c0fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b31b3b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 0x7f8b2c0fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49786/0 (socket says 172.21.15.70:49786) 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b31b3b640 1 -- 172.21.15.70:0/164576277 learned_addr learned my addr 172.21.15.70:0/164576277 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b2c105ad0 0x7f8b2c0fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.965+0000 7f8b3233c640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b2c1011c0 0x7f8b2c0fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b31b3b640 1 -- 172.21.15.70:0/164576277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b2c105ad0 msgr2=0x7f8b2c0fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b31b3b640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b2c105ad0 0x7f8b2c0fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b31b3b640 1 -- 172.21.15.70:0/164576277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b2c1011c0 msgr2=0x7f8b2c0fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b31b3b640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b2c1011c0 0x7f8b2c0fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b31b3b640 1 -- 172.21.15.70:0/164576277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c1a68a0 con 0x7f8b2c101b60 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b3233c640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b2c1011c0 0x7f8b2c0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b31b3b640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 0x7f8b2c0fcbd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00d770 tx=0x7f8b1c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b237fe640 1 -- 172.21.15.70:0/164576277 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c017070 con 0x7f8b2c101b60 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b345a0640 1 -- 172.21.15.70:0/164576277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c1a6b90 con 0x7f8b2c101b60 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b237fe640 1 -- 172.21.15.70:0/164576277 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8b1c0054f0 con 0x7f8b2c101b60 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b237fe640 1 -- 172.21.15.70:0/164576277 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b1c004d60 con 0x7f8b2c101b60 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.966+0000 7f8b345a0640 1 -- 172.21.15.70:0/164576277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c1a7080 con 0x7f8b2c101b60 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.968+0000 7f8b237fe640 1 -- 172.21.15.70:0/164576277 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8b1c004f00 con 0x7f8b2c101b60 2024-09-19T04:32:21.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.968+0000 7f8b36979740 1 Processor -- start 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b36979740 1 -- start start 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b36979740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e72294090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b36979740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 0x558e72294a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b237fe640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8b180a33b0 0x7f8b180a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b36979740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e722a1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b36979740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e721fa2f0 con 0x558e72295b40 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b36979740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558e721a1cf0 con 0x558e722945d0 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b36979740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558e721f62b0 con 0x558e7229f370 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e72294090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b31b3b640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8b180a33b0 0x7f8b180a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e72294090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49788/0 (socket says 172.21.15.70:49788) 2024-09-19T04:32:21.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 -- 172.21.15.70:0/4104960929 learned_addr learned my addr 172.21.15.70:0/4104960929 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b237fe640 1 -- 172.21.15.70:0/164576277 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8b1c0cf7b0 con 0x7f8b2c101b60 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e722a1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b3233c640 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 0x558e72294a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 -- 172.21.15.70:0/4104960929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 msgr2=0x558e722a1760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e722a1760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 -- 172.21.15.70:0/4104960929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 msgr2=0x558e72294a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 0x558e72294a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.969+0000 7f8b32b3d640 1 -- 172.21.15.70:0/4104960929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e721863a0 con 0x558e72295b40 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.970+0000 7f8b31b3b640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8b180a33b0 0x7f8b180a5870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0cd520 tx=0x7f8b1c009db0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.970+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e72294090 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8b2402f500 tx=0x7f8b24005fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34f1bf0f02a6a0f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.970+0000 7f8b20ff9640 1 -- 172.21.15.70:0/4104960929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24049070 con 0x558e72295b40 2024-09-19T04:32:21.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.970+0000 7f8b20ff9640 1 -- 172.21.15.70:0/4104960929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8b24036040 con 0x558e72295b40 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.970+0000 7f8b20ff9640 1 -- 172.21.15.70:0/4104960929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24004350 con 0x558e72295b40 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.970+0000 7f8b36979740 1 -- 172.21.15.70:0/4104960929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 msgr2=0x558e72294090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.970+0000 7f8b36979740 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e72294090 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f8b2402f500 tx=0x7f8b24005fa0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 -- 172.21.15.70:0/4104960929 shutdown_connections 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e722a1760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 0x558e72294a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 --2- 172.21.15.70:0/4104960929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e72294090 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 -- 172.21.15.70:0/4104960929 >> 172.21.15.70:0/4104960929 conn(0x558e7225d310 msgr2=0x558e72290c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 -- 172.21.15.70:0/4104960929 shutdown_connections 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 -- 172.21.15.70:0/4104960929 wait complete. 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 -- start start 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 Processor -- start 2024-09-19T04:32:21.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 0x558e7229ed50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e7229c000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e7229c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558e722a2010 con 0x558e72295b40 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558e721b5060 con 0x558e722945d0 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558e722a2190 con 0x558e7229f370 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b36979740 10 client.0 _ll_register_callbacks cb 0x558e71f088c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b3233c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e7229c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b3233c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e7229c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49802/0 (socket says 172.21.15.70:49802) 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.971+0000 7f8b3233c640 1 -- 172.21.15.70:0/2078296262 learned_addr learned my addr 172.21.15.70:0/2078296262 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 0x558e7229ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e7229c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b3233c640 1 -- 172.21.15.70:0/2078296262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 msgr2=0x558e7229c5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:21.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b3233c640 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e7229c5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b3233c640 1 -- 172.21.15.70:0/2078296262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 msgr2=0x558e7229ed50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b3233c640 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 0x558e7229ed50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b3233c640 1 -- 172.21.15.70:0/2078296262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e71f6b3c0 con 0x558e72295b40 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b3233c640 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e7229c000 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800e6e0 tx=0x7f8b2800eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92a6aa402d4e5878 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b15ffb640 1 -- 172.21.15.70:0/2078296262 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b2801c060 con 0x558e72295b40 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b15ffb640 1 -- 172.21.15.70:0/2078296262 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8b28009a80 con 0x558e72295b40 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b36979740 1 -- 172.21.15.70:0/2078296262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b24036040 con 0x558e72295b40 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b15ffb640 1 -- 172.21.15.70:0/2078296262 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b28009c80 con 0x558e72295b40 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b36979740 10 client.15519 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b36979740 1 -- 172.21.15.70:0/2078296262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e722adba0 con 0x558e72295b40 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.972+0000 7f8b15ffb640 1 -- 172.21.15.70:0/2078296262 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8b24036040 con 0x558e72295b40 2024-09-19T04:32:21.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.973+0000 7f8b15ffb640 1 -- 172.21.15.70:0/2078296262 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f8b2801f390 con 0x558e72295b40 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.973+0000 7f8b36979740 10 client.15519 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.973+0000 7f8b36979740 10 client.15519 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.973+0000 7f8b36979740 20 client.15519 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.973+0000 7f8b36979740 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558e722af0b0 0x558e722b14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.973+0000 7f8b36979740 4 client.15519 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.973+0000 7f8b36979740 1 -- 172.21.15.70:0/2078296262 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558e72207860 con 0x558e722af0b0 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.973+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558e722af0b0 0x558e722b14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558e722af0b0 0x558e722b14d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=bf889c194560fd87 server_cookie=5159ae9768455856 in_seq=0 out_seq=0 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b15ffb640 10 client.15519 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b15ffb640 1 -- 172.21.15.70:0/2078296262 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558e72207860 con 0x558e722af0b0 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b15ffb640 10 client.15519 handle_command_reply: tid=0 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 client.15519 shutdown 2024-09-19T04:32:21.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 -- 172.21.15.70:0/2078296262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 msgr2=0x558e7229c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e7229c000 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f8b2800e6e0 tx=0x7f8b2800eba0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 -- 172.21.15.70:0/2078296262 shutdown_connections 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558e722af0b0 0x558e722b14d0 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e7229c5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e72295b40 0x558e7229c000 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 --2- 172.21.15.70:0/2078296262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e722945d0 0x558e7229ed50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b15ffb640 0 client.15519 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.974+0000 7f8b36979740 1 -- 172.21.15.70:0/2078296262 >> 172.21.15.70:0/2078296262 conn(0x558e7225d310 msgr2=0x558e72296930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.975+0000 7f8b36979740 1 -- 172.21.15.70:0/2078296262 shutdown_connections 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.975+0000 7f8b36979740 1 -- 172.21.15.70:0/2078296262 wait complete. 2024-09-19T04:32:21.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.975+0000 7f8b36979740 20 client.15519 trim_cache size 0 max 16384 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.987+0000 7f8b36979740 1 Processor -- start 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b36979740 1 -- start start 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b36979740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e7228bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b36979740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e72295b40 0x558e722ab310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b36979740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e7229afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b36979740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c1b21e0 con 0x558e722945d0 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b36979740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c1afab0 con 0x558e72295b40 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b36979740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c1ad920 con 0x558e7229f370 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e7228bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e7228bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49810/0 (socket says 172.21.15.70:49810) 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 -- 172.21.15.70:0/759317248 learned_addr learned my addr 172.21.15.70:0/759317248 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 -- 172.21.15.70:0/759317248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 msgr2=0x558e7229afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:21.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/759317248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e7229afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 -- 172.21.15.70:0/759317248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e72295b40 msgr2=0x558e722ab310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/759317248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e72295b40 0x558e722ab310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 -- 172.21.15.70:0/759317248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558e72290de0 con 0x558e722945d0 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/759317248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e7228bc60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b24005e30 tx=0x7f8b24004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6af3d978b2c73c48 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b17fff640 1 -- 172.21.15.70:0/759317248 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24055020 con 0x558e722945d0 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b17fff640 1 -- 172.21.15.70:0/759317248 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8b24036040 con 0x558e722945d0 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.988+0000 7f8b17fff640 1 -- 172.21.15.70:0/759317248 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24040040 con 0x558e722945d0 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 -- 172.21.15.70:0/759317248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 msgr2=0x558e7228bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 --2- 172.21.15.70:0/759317248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e7228bc60 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f8b24005e30 tx=0x7f8b24004a40 comp rx=0 tx=0).stop 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 -- 172.21.15.70:0/759317248 shutdown_connections 2024-09-19T04:32:22.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 --2- 172.21.15.70:0/759317248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e7229f370 0x558e7229afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 --2- 172.21.15.70:0/759317248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e72295b40 0x558e722ab310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 --2- 172.21.15.70:0/759317248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e7228bc60 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 -- 172.21.15.70:0/759317248 >> 172.21.15.70:0/759317248 conn(0x558e7225d310 msgr2=0x558e7229a8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 -- 172.21.15.70:0/759317248 shutdown_connections 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 -- 172.21.15.70:0/759317248 wait complete. 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 -- start start 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.989+0000 7f8b36979740 1 Processor -- start 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b36979740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e722a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:22.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b36979740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e72295b40 0x558e722a7c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b36979740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e7229f370 0x558e722989b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b36979740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c1adf70 con 0x558e722945d0 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b36979740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c1af3e0 con 0x558e7229f370 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b36979740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c1ae640 con 0x558e72295b40 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b36979740 10 client.0 _ll_register_callbacks cb 0x7f8b28005f10 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e722a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e722a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49820/0 (socket says 172.21.15.70:49820) 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 -- 172.21.15.70:0/145343046 learned_addr learned my addr 172.21.15.70:0/145343046 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e7229f370 0x558e722989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:22.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b3233c640 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e72295b40 0x558e722a7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 -- 172.21.15.70:0/145343046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e72295b40 msgr2=0x558e722a7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e72295b40 0x558e722a7c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 -- 172.21.15.70:0/145343046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e7229f370 msgr2=0x558e722989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e7229f370 0x558e722989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 -- 172.21.15.70:0/145343046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558e722991e0 con 0x558e722945d0 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b32b3d640 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e722a76f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8b24002230 tx=0x7f8b24003a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d63951bec169ca71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b15ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b15ffb640 1 -- 172.21.15.70:0/145343046 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b24061020 con 0x558e722945d0 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b15ffb640 1 -- 172.21.15.70:0/145343046 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8b2402fae0 con 0x558e722945d0 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.990+0000 7f8b36979740 1 -- 172.21.15.70:0/145343046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8b24036040 con 0x558e722945d0 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b15ffb640 1 -- 172.21.15.70:0/145343046 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f8b24040070 con 0x558e722945d0 2024-09-19T04:32:22.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b36979740 10 client.15525 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b36979740 1 -- 172.21.15.70:0/145343046 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558e723198f0 con 0x558e722945d0 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b15ffb640 1 -- 172.21.15.70:0/145343046 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8b24036040 con 0x558e722945d0 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b15ffb640 1 -- 172.21.15.70:0/145343046 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f8b2405d440 con 0x558e722945d0 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b36979740 10 client.15525 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b36979740 10 client.15525 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b36979740 20 client.15525 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b36979740 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558e72319b70 0x558e7231bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b36979740 4 client.15525 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b36979740 1 -- 172.21.15.70:0/145343046 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x558e72201d70 con 0x558e72319b70 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.991+0000 7f8b3233c640 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558e72319b70 0x558e7231bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b15ffb640 10 client.15525 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:32:22.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b3233c640 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558e72319b70 0x558e7231bf60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=febb9d3323b0a2d1 server_cookie=c81322242003a81f in_seq=0 out_seq=0 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b15ffb640 1 -- 172.21.15.70:0/145343046 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x558e72201d70 con 0x558e72319b70 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b15ffb640 10 client.15525 handle_command_reply: tid=0 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 client.15525 shutdown 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 -- 172.21.15.70:0/145343046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 msgr2=0x558e722a76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e722a76f0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8b24002230 tx=0x7f8b24003a90 comp rx=0 tx=0).stop 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 -- 172.21.15.70:0/145343046 shutdown_connections 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558e72319b70 0x558e7231bf60 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558e7229f370 0x558e722989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558e72295b40 0x558e722a7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 --2- 172.21.15.70:0/145343046 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558e722945d0 0x558e722a76f0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 -- 172.21.15.70:0/145343046 >> 172.21.15.70:0/145343046 conn(0x558e7225d310 msgr2=0x558e7229b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b15ffb640 0 client.15525 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:32:22.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 -- 172.21.15.70:0/145343046 shutdown_connections 2024-09-19T04:32:22.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 1 -- 172.21.15.70:0/145343046 wait complete. 2024-09-19T04:32:22.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.992+0000 7f8b36979740 20 client.15525 trim_cache size 0 max 16384 2024-09-19T04:32:22.006 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:32:22.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 -- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8b180a33b0 msgr2=0x7f8b180a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8b180a33b0 0x7f8b180a5870 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0cd520 tx=0x7f8b1c009db0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 -- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 msgr2=0x7f8b2c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 0x7f8b2c0fcbd0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c00d770 tx=0x7f8b1c00dc30 comp rx=0 tx=0).stop 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 -- 172.21.15.70:0/164576277 shutdown_connections 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8b180a33b0 0x7f8b180a5870 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8b2c105ad0 0x7f8b2c0fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8b2c101b60 0x7f8b2c0fcbd0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 --2- 172.21.15.70:0/164576277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b2c1011c0 0x7f8b2c0fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 -- 172.21.15.70:0/164576277 >> 172.21.15.70:0/164576277 conn(0x7f8b2c077210 msgr2=0x7f8b2c100340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 -- 172.21.15.70:0/164576277 shutdown_connections 2024-09-19T04:32:22.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:21.993+0000 7f8b345a0640 1 -- 172.21.15.70:0/164576277 wait complete. 2024-09-19T04:32:22.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:21 smithi134 ceph-mon[34525]: pgmap v50: 97 pgs: 97 active+clean; 45 MiB data, 500 MiB used, 1.0 TiB / 1.0 TiB avail; 4.9 KiB/s rd, 2.0 MiB/s wr, 7 op/s 2024-09-19T04:32:22.708 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:32:22.962 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:32:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 -- 172.21.15.70:0/3158511415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102570 msgr2=0x7fde541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/3158511415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102570 0x7fde541029b0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fde40009900 tx=0x7fde4002a480 comp rx=0 tx=0).stop 2024-09-19T04:32:23.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 -- 172.21.15.70:0/3158511415 shutdown_connections 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/3158511415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde54102ef0 0x7fde5410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/3158511415 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102570 0x7fde541029b0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/3158511415 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde54100e20 0x7fde54101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 -- 172.21.15.70:0/3158511415 >> 172.21.15.70:0/3158511415 conn(0x7fde540fc7d0 msgr2=0x7fde540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 -- 172.21.15.70:0/3158511415 shutdown_connections 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.424+0000 7fde5ad2e640 1 -- 172.21.15.70:0/3158511415 wait complete. 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde5ad2e640 1 Processor -- start 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde5ad2e640 1 -- start start 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde5ad2e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde54100e20 0x7fde54198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde5ad2e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde54102570 0x7fde54198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde5ad2e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102ef0 0x7fde5419cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde5ad2e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde54110f90 con 0x7fde54102ef0 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde5ad2e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde54110e10 con 0x7fde54100e20 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde5ad2e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde54111110 con 0x7fde54102570 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde592cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102ef0 0x7fde5419cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde592cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102ef0 0x7fde5419cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55630/0 (socket says 172.21.15.70:55630) 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde592cb640 1 -- 172.21.15.70:0/688271602 learned_addr learned my addr 172.21.15.70:0/688271602 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde53fff640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde54102570 0x7fde54198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.425+0000 7fde58aca640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde54100e20 0x7fde54198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde592cb640 1 -- 172.21.15.70:0/688271602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde54102570 msgr2=0x7fde54198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde592cb640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde54102570 0x7fde54198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde592cb640 1 -- 172.21.15.70:0/688271602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde54100e20 msgr2=0x7fde54198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde592cb640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde54100e20 0x7fde54198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde592cb640 1 -- 172.21.15.70:0/688271602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5419d4d0 con 0x7fde54102ef0 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde58aca640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde54100e20 0x7fde54198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde592cb640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102ef0 0x7fde5419cdf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00b970 tx=0x7fde4c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde51ffb640 1 -- 172.21.15.70:0/688271602 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c019070 con 0x7fde54102ef0 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde51ffb640 1 -- 172.21.15.70:0/688271602 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fde4c00cb40 con 0x7fde54102ef0 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde5ad2e640 1 -- 172.21.15.70:0/688271602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5419d7c0 con 0x7fde54102ef0 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde51ffb640 1 -- 172.21.15.70:0/688271602 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c007650 con 0x7fde54102ef0 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.426+0000 7fde5ad2e640 1 -- 172.21.15.70:0/688271602 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde541a50a0 con 0x7fde54102ef0 2024-09-19T04:32:23.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.428+0000 7fde51ffb640 1 -- 172.21.15.70:0/688271602 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fde4c01c070 con 0x7fde54102ef0 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde5d107740 1 Processor -- start 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde5d107740 1 -- start start 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde51ffb640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fde440a33b0 0x7fde440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde5d107740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aed7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde5d107740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed75d0 0x564e1aed7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde5d107740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aee2370 0x564e1aee4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde5d107740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564e1ae3d2f0 con 0x564e1aed8b40 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde5d107740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e1ade4cf0 con 0x564e1aed75d0 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde5d107740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564e1ae392b0 con 0x564e1aee2370 2024-09-19T04:32:23.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde53fff640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fde440a33b0 0x7fde440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde58aca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aed7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde58aca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aed7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55642/0 (socket says 172.21.15.70:55642) 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde58aca640 1 -- 172.21.15.70:0/63941081 learned_addr learned my addr 172.21.15.70:0/63941081 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde51ffb640 1 -- 172.21.15.70:0/688271602 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fde4c0cf270 con 0x7fde54102ef0 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde592cb640 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aee2370 0x564e1aee4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.429+0000 7fde53fff640 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed75d0 0x564e1aed7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde58aca640 1 -- 172.21.15.70:0/63941081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aee2370 msgr2=0x564e1aee4760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde58aca640 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aee2370 0x564e1aee4760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde58aca640 1 -- 172.21.15.70:0/63941081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed75d0 msgr2=0x564e1aed7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde58aca640 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed75d0 0x564e1aed7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde58aca640 1 -- 172.21.15.70:0/63941081 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e1adc93a0 con 0x564e1aed8b40 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde58aca640 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aed7090 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fde4800bd40 tx=0x7fde4800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d42849d971730f7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde53fff640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fde440a33b0 0x7fde440a5870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde40006010 tx=0x7fde400314a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde3effd640 1 -- 172.21.15.70:0/63941081 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48015070 con 0x564e1aed8b40 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde3effd640 1 -- 172.21.15.70:0/63941081 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fde4800be30 con 0x564e1aed8b40 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.430+0000 7fde3effd640 1 -- 172.21.15.70:0/63941081 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde48011990 con 0x564e1aed8b40 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 -- 172.21.15.70:0/63941081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 msgr2=0x564e1aed7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aed7090 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7fde4800bd40 tx=0x7fde4800f730 comp rx=0 tx=0).stop 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 -- 172.21.15.70:0/63941081 shutdown_connections 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aee2370 0x564e1aee4760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed75d0 0x564e1aed7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 --2- 172.21.15.70:0/63941081 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aed7090 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 -- 172.21.15.70:0/63941081 >> 172.21.15.70:0/63941081 conn(0x564e1aea0310 msgr2=0x564e1aed3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 -- 172.21.15.70:0/63941081 shutdown_connections 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 -- 172.21.15.70:0/63941081 wait complete. 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 -- start start 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.431+0000 7fde5d107740 1 Processor -- start 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde5d107740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aee1d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde5d107740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aedefd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde5d107740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aedf570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde5d107740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564e1aee5070 con 0x564e1aee2370 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde5d107740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e1adf8060 con 0x564e1aed8b40 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde5d107740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564e1aee51f0 con 0x564e1aed75d0 2024-09-19T04:32:23.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde5d107740 10 client.0 _ll_register_callbacks cb 0x564e1ab4b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aedf570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aedf570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55654/0 (socket says 172.21.15.70:55654) 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 -- 172.21.15.70:0/1618870616 learned_addr learned my addr 172.21.15.70:0/1618870616 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde58aca640 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aee1d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 -- 172.21.15.70:0/1618870616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 msgr2=0x564e1aee1d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aee1d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde53fff640 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aedefd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 -- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 msgr2=0x564e1aedefd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:23.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aedefd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 -- 172.21.15.70:0/1618870616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e1abae3c0 con 0x564e1aee2370 2024-09-19T04:32:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde53fff640 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aedefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde592cb640 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aedf570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0ccb50 tx=0x7fde4c09b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dedcb15d5aa5d4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde33fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde33fff640 1 -- 172.21.15.70:0/1618870616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c099af0 con 0x564e1aee2370 2024-09-19T04:32:23.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde33fff640 1 -- 172.21.15.70:0/1618870616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fde4c0149a0 con 0x564e1aee2370 2024-09-19T04:32:23.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.432+0000 7fde5d107740 1 -- 172.21.15.70:0/1618870616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde4800be30 con 0x564e1aee2370 2024-09-19T04:32:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde33fff640 1 -- 172.21.15.70:0/1618870616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fde4c0c0080 con 0x564e1aee2370 2024-09-19T04:32:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde5d107740 10 client.15537 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde5d107740 1 -- 172.21.15.70:0/1618870616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564e1aef0ac0 con 0x564e1aee2370 2024-09-19T04:32:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde33fff640 1 -- 172.21.15.70:0/1618870616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fde4800be30 con 0x564e1aee2370 2024-09-19T04:32:23.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde33fff640 1 -- 172.21.15.70:0/1618870616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fde4c0a3ef0 con 0x564e1aee2370 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde5d107740 10 client.15537 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde5d107740 10 client.15537 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde5d107740 20 client.15537 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde5d107740 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e1aef1ed0 0x564e1aef4390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde5d107740 4 client.15537 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde5d107740 1 -- 172.21.15.70:0/1618870616 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e1ae4a860 con 0x564e1aef1ed0 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.433+0000 7fde58aca640 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e1aef1ed0 0x564e1aef4390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.434+0000 7fde33fff640 10 client.15537 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.434+0000 7fde58aca640 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e1aef1ed0 0x564e1aef4390 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=86244315d4d1b9da server_cookie=9e0c68bf0932b385 in_seq=0 out_seq=0 2024-09-19T04:32:23.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde33fff640 1 -- 172.21.15.70:0/1618870616 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e1ae4a860 con 0x564e1aef1ed0 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde33fff640 10 client.15537 handle_command_reply: tid=0 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 client.15537 shutdown 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 -- 172.21.15.70:0/1618870616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 msgr2=0x564e1aedf570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aedf570 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fde4c0ccb50 tx=0x7fde4c09b870 comp rx=0 tx=0).stop 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 -- 172.21.15.70:0/1618870616 shutdown_connections 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e1aef1ed0 0x564e1aef4390 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aedf570 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde33fff640 0 client.15537 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aedefd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 --2- 172.21.15.70:0/1618870616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aee1d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 -- 172.21.15.70:0/1618870616 >> 172.21.15.70:0/1618870616 conn(0x564e1aea0310 msgr2=0x564e1aed9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:23.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 -- 172.21.15.70:0/1618870616 shutdown_connections 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 1 -- 172.21.15.70:0/1618870616 wait complete. 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.435+0000 7fde5d107740 20 client.15537 trim_cache size 0 max 16384 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.448+0000 7fde5d107740 1 Processor -- start 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde5d107740 1 -- start start 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde5d107740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aee0f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde5d107740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aeda120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde5d107740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aee2370 0x564e1aeda660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde5d107740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde541b0150 con 0x564e1aed8b40 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde5d107740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde541ada20 con 0x564e1aee2370 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde5d107740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde541ab870 con 0x564e1aed75d0 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aeda120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aeda120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55662/0 (socket says 172.21.15.70:55662) 2024-09-19T04:32:23.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 -- 172.21.15.70:0/1766408532 learned_addr learned my addr 172.21.15.70:0/1766408532 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde592cb640 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aee2370 0x564e1aeda660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 -- 172.21.15.70:0/1766408532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 msgr2=0x564e1aee0f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aee0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 -- 172.21.15.70:0/1766408532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aee2370 msgr2=0x564e1aeda660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aee2370 0x564e1aeda660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 -- 172.21.15.70:0/1766408532 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e1aed7be0 con 0x564e1aed8b40 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde592cb640 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aee2370 0x564e1aeda660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.449+0000 7fde53fff640 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aeda120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fde4002a9a0 tx=0x7fde40047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bad837fea7439b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde3e7fc640 1 -- 172.21.15.70:0/1766408532 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde40035040 con 0x564e1aed8b40 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde3e7fc640 1 -- 172.21.15.70:0/1766408532 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fde40003cc0 con 0x564e1aed8b40 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde3e7fc640 1 -- 172.21.15.70:0/1766408532 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4004bb70 con 0x564e1aed8b40 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 -- 172.21.15.70:0/1766408532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 msgr2=0x564e1aeda120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aeda120 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fde4002a9a0 tx=0x7fde40047000 comp rx=0 tx=0).stop 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 -- 172.21.15.70:0/1766408532 shutdown_connections 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aee2370 0x564e1aeda660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aed8b40 0x564e1aeda120 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 --2- 172.21.15.70:0/1766408532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aee0f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 -- 172.21.15.70:0/1766408532 >> 172.21.15.70:0/1766408532 conn(0x564e1aea0310 msgr2=0x564e1aee0830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 -- 172.21.15.70:0/1766408532 shutdown_connections 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.450+0000 7fde5d107740 1 -- 172.21.15.70:0/1766408532 wait complete. 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 1 -- start start 2024-09-19T04:32:23.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 1 Processor -- start 2024-09-19T04:32:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aeea480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aeea9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aee7450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fde541abee0 con 0x564e1aee2370 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fde541ad350 con 0x564e1aed8b40 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fde541ac5b0 con 0x564e1aed75d0 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde5d107740 10 client.0 _ll_register_callbacks cb 0x7fde4c09b580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde592cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aee7450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde592cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aee7450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55670/0 (socket says 172.21.15.70:55670) 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.451+0000 7fde592cb640 1 -- 172.21.15.70:0/417278283 learned_addr learned my addr 172.21.15.70:0/417278283 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde53fff640 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aeea9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde58aca640 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aeea480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde592cb640 1 -- 172.21.15.70:0/417278283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 msgr2=0x564e1aeea480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde592cb640 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aeea480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde592cb640 1 -- 172.21.15.70:0/417278283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 msgr2=0x564e1aeea9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde592cb640 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aeea9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde592cb640 1 -- 172.21.15.70:0/417278283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e1aee79c0 con 0x564e1aee2370 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde592cb640 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aee7450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fde4c097b40 tx=0x7fde4c09b090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97da26da06f33052 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde33fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde33fff640 1 -- 172.21.15.70:0/417278283 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fde4c099af0 con 0x564e1aee2370 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde33fff640 1 -- 172.21.15.70:0/417278283 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fde4c097da0 con 0x564e1aee2370 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde5d107740 1 -- 172.21.15.70:0/417278283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fde40003cc0 con 0x564e1aee2370 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde33fff640 1 -- 172.21.15.70:0/417278283 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7fde4c0974d0 con 0x564e1aee2370 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde5d107740 10 client.15543 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.452+0000 7fde5d107740 1 -- 172.21.15.70:0/417278283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x564e1af5d440 con 0x564e1aee2370 2024-09-19T04:32:23.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde33fff640 1 -- 172.21.15.70:0/417278283 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fde40003cc0 con 0x564e1aee2370 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde33fff640 1 -- 172.21.15.70:0/417278283 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7fde4c0b1c50 con 0x564e1aee2370 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde5d107740 10 client.15543 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde5d107740 10 client.15543 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde5d107740 20 client.15543 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde5d107740 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e1af5db50 0x564e1af5ff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde5d107740 4 client.15543 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde5d107740 1 -- 172.21.15.70:0/417278283 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564e1ae44d70 con 0x564e1af5db50 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde58aca640 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e1af5db50 0x564e1af5ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde33fff640 10 client.15543 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.453+0000 7fde58aca640 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e1af5db50 0x564e1af5ff70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4da14f86fc546840 server_cookie=c9b8eb01efb953fc in_seq=0 out_seq=0 2024-09-19T04:32:23.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde33fff640 1 -- 172.21.15.70:0/417278283 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564e1ae44d70 con 0x564e1af5db50 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde33fff640 10 client.15543 handle_command_reply: tid=0 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 client.15543 shutdown 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 -- 172.21.15.70:0/417278283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 msgr2=0x564e1aee7450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aee7450 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fde4c097b40 tx=0x7fde4c09b090 comp rx=0 tx=0).stop 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 -- 172.21.15.70:0/417278283 shutdown_connections 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e1af5db50 0x564e1af5ff70 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e1aee2370 0x564e1aee7450 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e1aed8b40 0x564e1aeea9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde33fff640 0 client.15543 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 --2- 172.21.15.70:0/417278283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e1aed75d0 0x564e1aeea480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 -- 172.21.15.70:0/417278283 >> 172.21.15.70:0/417278283 conn(0x564e1aea0310 msgr2=0x564e1aee1050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:23.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 -- 172.21.15.70:0/417278283 shutdown_connections 2024-09-19T04:32:23.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 1 -- 172.21.15.70:0/417278283 wait complete. 2024-09-19T04:32:23.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.454+0000 7fde5d107740 20 client.15543 trim_cache size 0 max 16384 2024-09-19T04:32:23.480 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 -- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fde440a33b0 msgr2=0x7fde440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fde440a33b0 0x7fde440a5870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fde40006010 tx=0x7fde400314a0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 -- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102ef0 msgr2=0x7fde5419cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102ef0 0x7fde5419cdf0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7fde4c00b970 tx=0x7fde4c00be30 comp rx=0 tx=0).stop 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 -- 172.21.15.70:0/688271602 shutdown_connections 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fde440a33b0 0x7fde440a5870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fde54102ef0 0x7fde5419cdf0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fde54102570 0x7fde54198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 --2- 172.21.15.70:0/688271602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fde54100e20 0x7fde54198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:23.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 -- 172.21.15.70:0/688271602 >> 172.21.15.70:0/688271602 conn(0x7fde540fc7d0 msgr2=0x7fde5406a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:23.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 -- 172.21.15.70:0/688271602 shutdown_connections 2024-09-19T04:32:23.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:23.455+0000 7fde5ad2e640 1 -- 172.21.15.70:0/688271602 wait complete. 2024-09-19T04:32:23.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:23 smithi070 ceph-mon[30942]: pgmap v51: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-19T04:32:23.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:23 smithi167 ceph-mon[34339]: pgmap v51: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-19T04:32:24.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:23 smithi134 ceph-mon[34525]: pgmap v51: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 6.6 KiB/s rd, 2.3 MiB/s wr, 10 op/s 2024-09-19T04:32:25.150 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:32:25.151 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:32:25.405 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:32:25.842 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:25 smithi070 ceph-mon[30942]: pgmap v52: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 7 op/s 2024-09-19T04:32:25.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 -- 172.21.15.70:0/3560532152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 msgr2=0x7f275410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 --2- 172.21.15.70:0/3560532152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 0x7f275410ea90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f274c009ca0 tx=0x7f274c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 -- 172.21.15.70:0/3560532152 shutdown_connections 2024-09-19T04:32:25.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 --2- 172.21.15.70:0/3560532152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 0x7f275410ea90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 --2- 172.21.15.70:0/3560532152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2754102790 0x7f27541067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 --2- 172.21.15.70:0/3560532152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2754101de0 0x7f27541021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 -- 172.21.15.70:0/3560532152 >> 172.21.15.70:0/3560532152 conn(0x7f27540fd8c0 msgr2=0x7f27540ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:25.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 -- 172.21.15.70:0/3560532152 shutdown_connections 2024-09-19T04:32:25.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.926+0000 7f2758851640 1 -- 172.21.15.70:0/3560532152 wait complete. 2024-09-19T04:32:25.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2758851640 1 Processor -- start 2024-09-19T04:32:25.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2758851640 1 -- start start 2024-09-19T04:32:25.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2758851640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2754101de0 0x7f27540744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2758851640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2754102790 0x7f2754074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2758851640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 0x7f2754074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2758851640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2754111f40 con 0x7f2754106f10 2024-09-19T04:32:25.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2758851640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2754111dc0 con 0x7f2754101de0 2024-09-19T04:32:25.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2758851640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27541120c0 con 0x7f2754102790 2024-09-19T04:32:25.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2752d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 0x7f2754074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2752d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 0x7f2754074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55690/0 (socket says 172.21.15.70:55690) 2024-09-19T04:32:25.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2752d9d640 1 -- 172.21.15.70:0/3357923951 learned_addr learned my addr 172.21.15.70:0/3357923951 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:25.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.927+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2754102790 0x7f2754074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f275259c640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2754101de0 0x7f27540744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2752d9d640 1 -- 172.21.15.70:0/3357923951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2754102790 msgr2=0x7f2754074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2752d9d640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2754102790 0x7f2754074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2752d9d640 1 -- 172.21.15.70:0/3357923951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2754101de0 msgr2=0x7f27540744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2752d9d640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2754101de0 0x7f27540744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2752d9d640 1 -- 172.21.15.70:0/3357923951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f27541a6740 con 0x7f2754106f10 2024-09-19T04:32:25.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2754102790 0x7f2754074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:32:25.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f275259c640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2754101de0 0x7f27540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:25.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2752d9d640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 0x7f2754074f70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f274c0097b0 tx=0x7f274c003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:25.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f27437fe640 1 -- 172.21.15.70:0/3357923951 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c031890 con 0x7f2754106f10 2024-09-19T04:32:25.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2758851640 1 -- 172.21.15.70:0/3357923951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f27541a69d0 con 0x7f2754106f10 2024-09-19T04:32:25.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f27437fe640 1 -- 172.21.15.70:0/3357923951 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f274c004510 con 0x7f2754106f10 2024-09-19T04:32:25.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f27437fe640 1 -- 172.21.15.70:0/3357923951 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c02fd40 con 0x7f2754106f10 2024-09-19T04:32:25.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.928+0000 7f2758851640 1 -- 172.21.15.70:0/3357923951 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27541a6f10 con 0x7f2754106f10 2024-09-19T04:32:25.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.930+0000 7f27437fe640 1 -- 172.21.15.70:0/3357923951 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f274c004040 con 0x7f2754106f10 2024-09-19T04:32:25.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275ac2a740 1 Processor -- start 2024-09-19T04:32:25.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275ac2a740 1 -- start start 2024-09-19T04:32:25.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c880b60 0x558b6c880f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f27437fe640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f273c0a33b0 0x7f273c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c881480 0x558b6c88b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 0x558b6c88e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275ac2a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558b6c7e6280 con 0x558b6c880b60 2024-09-19T04:32:25.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275ac2a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558b6c78db10 con 0x558b6c88bd40 2024-09-19T04:32:25.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275ac2a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558b6c7e2240 con 0x558b6c881480 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f275259c640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f273c0a33b0 0x7f273c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f2751d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c880b60 0x558b6c880f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f27437fe640 1 -- 172.21.15.70:0/3357923951 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f274c0f14c0 con 0x7f2754106f10 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f2751d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c880b60 0x558b6c880f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55700/0 (socket says 172.21.15.70:55700) 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f2751d9b640 1 -- 172.21.15.70:0/3533462429 learned_addr learned my addr 172.21.15.70:0/3533462429 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f2752d9d640 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 0x558b6c88e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.931+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c881480 0x558b6c88b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2751d9b640 1 -- 172.21.15.70:0/3533462429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c881480 msgr2=0x558b6c88b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c881480 0x558b6c88b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2751d9b640 1 -- 172.21.15.70:0/3533462429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 msgr2=0x558b6c88e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 0x558b6c88e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2751d9b640 1 -- 172.21.15.70:0/3533462429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6c79a1f0 con 0x558b6c880b60 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f275259c640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f273c0a33b0 0x7f273c0a5870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f274400baa0 tx=0x7f2744005d90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c880b60 0x558b6c880f40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2748005e10 tx=0x7f2748008850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e10dcc659d98bed3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2740ff9640 1 -- 172.21.15.70:0/3533462429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27480120d0 con 0x558b6c880b60 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2740ff9640 1 -- 172.21.15.70:0/3533462429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2748004c70 con 0x558b6c880b60 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.932+0000 7f2740ff9640 1 -- 172.21.15.70:0/3533462429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274800e5d0 con 0x558b6c880b60 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 -- 172.21.15.70:0/3533462429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c880b60 msgr2=0x558b6c880f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c880b60 0x558b6c880f40 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f2748005e10 tx=0x7f2748008850 comp rx=0 tx=0).stop 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 -- 172.21.15.70:0/3533462429 shutdown_connections 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 0x558b6c88e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c881480 0x558b6c88b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3533462429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c880b60 0x558b6c880f40 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 -- 172.21.15.70:0/3533462429 >> 172.21.15.70:0/3533462429 conn(0x558b6c87d0f0 msgr2=0x558b6c87d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 -- 172.21.15.70:0/3533462429 shutdown_connections 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 -- 172.21.15.70:0/3533462429 wait complete. 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 -- start start 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.933+0000 7f275ac2a740 1 Processor -- start 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c888b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8892d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275ac2a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558b6c88e910 con 0x558b6c88bd40 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275ac2a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558b6c7a0f10 con 0x558b6c881480 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275ac2a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558b6c88ea90 con 0x558b6c880b60 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275ac2a740 10 client.0 _ll_register_callbacks cb 0x558b6c769a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:25.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8892d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8892d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55708/0 (socket says 172.21.15.70:55708) 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 -- 172.21.15.70:0/1754346339 learned_addr learned my addr 172.21.15.70:0/1754346339 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2751d9b640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c888b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275259c640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 -- 172.21.15.70:0/1754346339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 msgr2=0x558b6c88b7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88b7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 -- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 msgr2=0x558b6c888b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c888b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 -- 172.21.15.70:0/1754346339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6c5576a0 con 0x558b6c88bd40 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275259c640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2751d9b640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c888b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:32:25.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2752d9d640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8892d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f274c0bd860 tx=0x7f274c0d6ad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71a18cef83d30888 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2739ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2739ffb640 1 -- 172.21.15.70:0/1754346339 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c004330 con 0x558b6c88bd40 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2739ffb640 1 -- 172.21.15.70:0/1754346339 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f274c0b9f40 con 0x558b6c88bd40 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f275ac2a740 1 -- 172.21.15.70:0/1754346339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2748004c70 con 0x558b6c88bd40 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.934+0000 7f2739ffb640 1 -- 172.21.15.70:0/1754346339 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f274c0bdfd0 con 0x558b6c88bd40 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275ac2a740 10 client.15555 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275ac2a740 1 -- 172.21.15.70:0/1754346339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558b6c88e910 con 0x558b6c88bd40 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f2739ffb640 1 -- 172.21.15.70:0/1754346339 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2748004c70 con 0x558b6c88bd40 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f2739ffb640 1 -- 172.21.15.70:0/1754346339 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f274c0d6e90 con 0x558b6c88bd40 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275ac2a740 10 client.15555 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275ac2a740 10 client.15555 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275ac2a740 20 client.15555 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:25.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275ac2a740 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558b6c89b960 0x558b6c89ddc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275ac2a740 4 client.15555 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275ac2a740 1 -- 172.21.15.70:0/1754346339 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b6c7f37f0 con 0x558b6c89b960 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.935+0000 7f275259c640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558b6c89b960 0x558b6c89ddc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.936+0000 7f275259c640 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558b6c89b960 0x558b6c89ddc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2e329b17bffe8dfa server_cookie=761513f86b51b0b3 in_seq=0 out_seq=0 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.936+0000 7f2739ffb640 10 client.15555 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.936+0000 7f2739ffb640 1 -- 172.21.15.70:0/1754346339 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558b6c7f37f0 con 0x558b6c89b960 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.936+0000 7f2739ffb640 10 client.15555 handle_command_reply: tid=0 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.936+0000 7f275ac2a740 1 client.15555 shutdown 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.936+0000 7f275ac2a740 1 -- 172.21.15.70:0/1754346339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 msgr2=0x558b6c8892d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.936+0000 7f275ac2a740 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8892d0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f274c0bd860 tx=0x7f274c0d6ad0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 1 -- 172.21.15.70:0/1754346339 shutdown_connections 2024-09-19T04:32:25.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558b6c89b960 0x558b6c89ddc0 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8892d0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c888b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 1 --2- 172.21.15.70:0/1754346339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88b7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 1 -- 172.21.15.70:0/1754346339 >> 172.21.15.70:0/1754346339 conn(0x558b6c87d0f0 msgr2=0x558b6c882dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:25.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f2739ffb640 0 client.15555 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:25.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 1 -- 172.21.15.70:0/1754346339 shutdown_connections 2024-09-19T04:32:25.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 1 -- 172.21.15.70:0/1754346339 wait complete. 2024-09-19T04:32:25.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.937+0000 7f275ac2a740 20 client.15555 trim_cache size 0 max 16384 2024-09-19T04:32:25.966 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:25 smithi167 ceph-mon[34339]: pgmap v52: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 7 op/s 2024-09-19T04:32:25.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.954+0000 7f275ac2a740 1 Processor -- start 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.954+0000 7f275ac2a740 1 -- start start 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.954+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c8835c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.954+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c8a36d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.954+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8a3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8a3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8a3c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55722/0 (socket says 172.21.15.70:55722) 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f275ac2a740 1 -- 172.21.15.70:0/4222310761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f27541b2130 con 0x558b6c88bd40 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 -- 172.21.15.70:0/4222310761 learned_addr learned my addr 172.21.15.70:0/4222310761 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f275ac2a740 1 -- 172.21.15.70:0/4222310761 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27541afa00 con 0x558b6c881480 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f275ac2a740 1 -- 172.21.15.70:0/4222310761 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27541ad850 con 0x558b6c880b60 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f275259c640 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c8835c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2751d9b640 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c8a36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 -- 172.21.15.70:0/4222310761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 msgr2=0x558b6c8835c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c8835c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 -- 172.21.15.70:0/4222310761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 msgr2=0x558b6c8a36d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c8a36d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 -- 172.21.15.70:0/4222310761 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b6c878830 con 0x558b6c88bd40 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2751d9b640 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c8a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f2752d9d640 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8a3c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f274c0c6010 tx=0x7f274c004a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6c99da901f8dd21 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f273bfff640 1 -- 172.21.15.70:0/4222310761 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0098d0 con 0x558b6c88bd40 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f273bfff640 1 -- 172.21.15.70:0/4222310761 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f274c036040 con 0x558b6c88bd40 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.955+0000 7f273bfff640 1 -- 172.21.15.70:0/4222310761 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f274c0bd8d0 con 0x558b6c88bd40 2024-09-19T04:32:25.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 -- 172.21.15.70:0/4222310761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 msgr2=0x558b6c8a3c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8a3c10 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f274c0c6010 tx=0x7f274c004a60 comp rx=0 tx=0).stop 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 -- 172.21.15.70:0/4222310761 shutdown_connections 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c88bd40 0x558b6c8a3c10 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c881480 0x558b6c8a36d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 --2- 172.21.15.70:0/4222310761 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c8835c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 -- 172.21.15.70:0/4222310761 >> 172.21.15.70:0/4222310761 conn(0x558b6c87d0f0 msgr2=0x558b6c887410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 -- 172.21.15.70:0/4222310761 shutdown_connections 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 -- 172.21.15.70:0/4222310761 wait complete. 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.956+0000 7f275ac2a740 1 -- start start 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275ac2a740 1 Processor -- start 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c881480 0x558b6c88d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275ac2a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 0x558b6c88d8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275ac2a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f27541adec0 con 0x558b6c881480 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275ac2a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f27541af330 con 0x558b6c88bd40 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275ac2a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f27541ae590 con 0x558b6c880b60 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c881480 0x558b6c88d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275ac2a740 10 client.0 _ll_register_callbacks cb 0x7f274c0bd770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c881480 0x558b6c88d360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55734/0 (socket says 172.21.15.70:55734) 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 -- 172.21.15.70:0/3663918429 learned_addr learned my addr 172.21.15.70:0/3663918429 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f275259c640 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2752d9d640 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 0x558b6c88d8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 -- 172.21.15.70:0/3663918429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 msgr2=0x558b6c88ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:25.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 -- 172.21.15.70:0/3663918429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 msgr2=0x558b6c88d8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 0x558b6c88d8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 -- 172.21.15.70:0/3663918429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b6c892100 con 0x558b6c881480 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2751d9b640 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c881480 0x558b6c88d360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2748005da0 tx=0x7f27480085d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2a3e39a20daf0a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.957+0000 7f2739ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f2739ffb640 1 -- 172.21.15.70:0/3663918429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2748005600 con 0x558b6c881480 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f2739ffb640 1 -- 172.21.15.70:0/3663918429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2748004680 con 0x558b6c881480 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 1 -- 172.21.15.70:0/3663918429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f274c036040 con 0x558b6c881480 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f2739ffb640 1 -- 172.21.15.70:0/3663918429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f2748004880 con 0x558b6c881480 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 10 client.15561 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 1 -- 172.21.15.70:0/3663918429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x558b6c906910 con 0x558b6c881480 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f2739ffb640 1 -- 172.21.15.70:0/3663918429 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f274c036040 con 0x558b6c881480 2024-09-19T04:32:25.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f2739ffb640 1 -- 172.21.15.70:0/3663918429 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f274802e020 con 0x558b6c881480 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 10 client.15561 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 10 client.15561 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 20 client.15561 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558b6c906f20 0x558b6c909340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 4 client.15561 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.958+0000 7f275ac2a740 1 -- 172.21.15.70:0/3663918429 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558b6c7edd00 con 0x558b6c906f20 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.959+0000 7f275259c640 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558b6c906f20 0x558b6c909340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.959+0000 7f275259c640 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558b6c906f20 0x558b6c909340 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=907529acb633b115 server_cookie=82f0d4529645e934 in_seq=0 out_seq=0 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.959+0000 7f2739ffb640 10 client.15561 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:25.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f2739ffb640 1 -- 172.21.15.70:0/3663918429 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558b6c7edd00 con 0x558b6c906f20 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f2739ffb640 10 client.15561 handle_command_reply: tid=0 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 client.15561 shutdown 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 -- 172.21.15.70:0/3663918429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c881480 msgr2=0x558b6c88d360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c881480 0x558b6c88d360 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f2748005da0 tx=0x7f27480085d0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 -- 172.21.15.70:0/3663918429 shutdown_connections 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558b6c906f20 0x558b6c909340 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558b6c88bd40 0x558b6c88d8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558b6c881480 0x558b6c88d360 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f2739ffb640 0 client.15561 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 --2- 172.21.15.70:0/3663918429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558b6c880b60 0x558b6c88ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 -- 172.21.15.70:0/3663918429 >> 172.21.15.70:0/3663918429 conn(0x558b6c87d0f0 msgr2=0x558b6c87c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:25.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 -- 172.21.15.70:0/3663918429 shutdown_connections 2024-09-19T04:32:25.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.960+0000 7f275ac2a740 1 -- 172.21.15.70:0/3663918429 wait complete. 2024-09-19T04:32:25.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f275ac2a740 20 client.15561 trim_cache size 0 max 16384 2024-09-19T04:32:25.980 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:32:25.980 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:32:25.980 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "055b528e-c69e-46a8-a92d-d04513c926c8", 2024-09-19T04:32:25.981 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:32:25.981 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:32:25.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 -- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f273c0a33b0 msgr2=0x7f273c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f273c0a33b0 0x7f273c0a5870 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f274400baa0 tx=0x7f2744005d90 comp rx=0 tx=0).stop 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 -- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 msgr2=0x7f2754074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 0x7f2754074f70 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f274c0097b0 tx=0x7f274c003f30 comp rx=0 tx=0).stop 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 -- 172.21.15.70:0/3357923951 shutdown_connections 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f273c0a33b0 0x7f273c0a5870 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2754106f10 0x7f2754074f70 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2754102790 0x7f2754074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 --2- 172.21.15.70:0/3357923951 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2754101de0 0x7f27540744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 -- 172.21.15.70:0/3357923951 >> 172.21.15.70:0/3357923951 conn(0x7f27540fd8c0 msgr2=0x7f27540ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 -- 172.21.15.70:0/3357923951 shutdown_connections 2024-09-19T04:32:25.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:25.961+0000 7f2758851640 1 -- 172.21.15.70:0/3357923951 wait complete. 2024-09-19T04:32:26.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:25 smithi134 ceph-mon[34525]: pgmap v52: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 7 op/s 2024-09-19T04:32:26.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:32:26.886 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:32:26.894 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:26 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:32:26.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:26 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:26.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:26 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:32:26.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:26 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:26 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:32:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:26 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:27.862 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:27 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:32:27.862 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:27 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:27.862 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:27 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:32:27.863 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:27 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:27.863 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:27 smithi167 ceph-mon[34339]: pgmap v53: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 7 op/s 2024-09-19T04:32:27.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:27 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:32:27.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:27 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:27.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:27 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:32:27.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:27 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:27.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:27 smithi070 ceph-mon[30942]: pgmap v53: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 7 op/s 2024-09-19T04:32:27.936 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:27 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:32:27.937 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:27 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:27.937 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:27 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:32:27.937 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:27 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:32:27.937 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:27 smithi134 ceph-mon[34525]: pgmap v53: 97 pgs: 97 active+clean; 49 MiB data, 512 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 7 op/s 2024-09-19T04:32:29.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:29 smithi070 ceph-mon[30942]: pgmap v54: 97 pgs: 97 active+clean; 57 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-09-19T04:32:29.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:29 smithi167 ceph-mon[34339]: pgmap v54: 97 pgs: 97 active+clean; 57 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-09-19T04:32:30.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:29 smithi134 ceph-mon[34525]: pgmap v54: 97 pgs: 97 active+clean; 57 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 6.7 KiB/s rd, 1.7 MiB/s wr, 10 op/s 2024-09-19T04:32:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 -- 172.21.15.70:0/789229974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138100a80 msgr2=0x7f8138100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 --2- 172.21.15.70:0/789229974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138100a80 0x7f8138100ee0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f812c009930 tx=0x7f812c02a420 comp rx=0 tx=0).stop 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 -- 172.21.15.70:0/789229974 shutdown_connections 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 --2- 172.21.15.70:0/789229974 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8138101420 0x7f813810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 --2- 172.21.15.70:0/789229974 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138100a80 0x7f8138100ee0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 --2- 172.21.15.70:0/789229974 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8138106a80 0x7f8138106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 -- 172.21.15.70:0/789229974 >> 172.21.15.70:0/789229974 conn(0x7f81380fc7a0 msgr2=0x7f81380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 -- 172.21.15.70:0/789229974 shutdown_connections 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 -- 172.21.15.70:0/789229974 wait complete. 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 Processor -- start 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.109+0000 7f813e2a7640 1 -- start start 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813e2a7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8138100a80 0x7f81380fcd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813e2a7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8138101420 0x7f81380fd280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813e2a7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138106a80 0x7f81380fd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813e2a7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8138110e10 con 0x7f8138106a80 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813e2a7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8138110c90 con 0x7f8138101420 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813e2a7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8138110f90 con 0x7f8138100a80 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138106a80 0x7f81380fd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138106a80 0x7f81380fd7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55750/0 (socket says 172.21.15.70:55750) 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 -- 172.21.15.70:0/3161346798 learned_addr learned my addr 172.21.15.70:0/3161346798 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f8137fff640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8138100a80 0x7f81380fcd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 -- 172.21.15.70:0/3161346798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8138100a80 msgr2=0x7f81380fcd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8138100a80 0x7f81380fcd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 -- 172.21.15.70:0/3161346798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8138101420 msgr2=0x7f81380fd280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f81377fe640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8138101420 0x7f81380fd280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8138101420 0x7f81380fd280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 -- 172.21.15.70:0/3161346798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81381a68a0 con 0x7f8138106a80 2024-09-19T04:32:30.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.110+0000 7f813c844640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138106a80 0x7f81380fd7c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f813000eaa0 tx=0x7f813000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.111+0000 7f81357fa640 1 -- 172.21.15.70:0/3161346798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8130004d20 con 0x7f8138106a80 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.111+0000 7f813e2a7640 1 -- 172.21.15.70:0/3161346798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81381a6b90 con 0x7f8138106a80 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.111+0000 7f81357fa640 1 -- 172.21.15.70:0/3161346798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8130005020 con 0x7f8138106a80 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.111+0000 7f81357fa640 1 -- 172.21.15.70:0/3161346798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81300116d0 con 0x7f8138106a80 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.111+0000 7f813e2a7640 1 -- 172.21.15.70:0/3161346798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81381a7080 con 0x7f8138106a80 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.113+0000 7f81357fa640 1 -- 172.21.15.70:0/3161346798 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f81300051d0 con 0x7f8138106a80 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.113+0000 7f8140680740 1 Processor -- start 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.113+0000 7f8140680740 1 -- start start 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.113+0000 7f81357fa640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81200a33b0 0x7f81200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.113+0000 7f8140680740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbf14a0 0x55620bbf1880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.113+0000 7f8140680740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf1dc0 0x55620bbfc140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.113+0000 7f8140680740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbfc680 0x55620bbfea70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f8140680740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55620bb572e0 con 0x55620bbf1dc0 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f8140680740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55620bafece0 con 0x55620bbf14a0 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f8140680740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55620bb532a0 con 0x55620bbfc680 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81200a33b0 0x7f81200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81357fa640 1 -- 172.21.15.70:0/3161346798 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f81300cff90 con 0x7f8138106a80 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf1dc0 0x55620bbfc140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf1dc0 0x55620bbfc140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55762/0 (socket says 172.21.15.70:55762) 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f8137fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbf14a0 0x55620bbf1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 -- 172.21.15.70:0/1860226611 learned_addr learned my addr 172.21.15.70:0/1860226611 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f813c844640 1 --2- 172.21.15.70:0/1860226611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbfc680 0x55620bbfea70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 -- 172.21.15.70:0/1860226611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbfc680 msgr2=0x55620bbfea70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 --2- 172.21.15.70:0/1860226611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbfc680 0x55620bbfea70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 -- 172.21.15.70:0/1860226611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbf14a0 msgr2=0x55620bbf1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:30.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 --2- 172.21.15.70:0/1860226611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbf14a0 0x55620bbf1880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 -- 172.21.15.70:0/1860226611 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55620bae3440 con 0x55620bbf1dc0 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81200a33b0 0x7f81200a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f812c0096c0 tx=0x7f812c040040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f81377fe640 1 --2- 172.21.15.70:0/1860226611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf1dc0 0x55620bbfc140 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f812c009900 tx=0x7f812c044000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ff8c7bb6c528c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f811e7fc640 1 -- 172.21.15.70:0/1860226611 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c04c070 con 0x55620bbf1dc0 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f811e7fc640 1 -- 172.21.15.70:0/1860226611 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f812c003cc0 con 0x55620bbf1dc0 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.114+0000 7f811e7fc640 1 -- 172.21.15.70:0/1860226611 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c035070 con 0x55620bbf1dc0 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 -- 172.21.15.70:0/1860226611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf1dc0 msgr2=0x55620bbfc140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 --2- 172.21.15.70:0/1860226611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf1dc0 0x55620bbfc140 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7f812c009900 tx=0x7f812c044000 comp rx=0 tx=0).stop 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 -- 172.21.15.70:0/1860226611 shutdown_connections 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 --2- 172.21.15.70:0/1860226611 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbfc680 0x55620bbfea70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 --2- 172.21.15.70:0/1860226611 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf1dc0 0x55620bbfc140 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 --2- 172.21.15.70:0/1860226611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbf14a0 0x55620bbf1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 -- 172.21.15.70:0/1860226611 >> 172.21.15.70:0/1860226611 conn(0x55620bbeda30 msgr2=0x55620bbede10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 -- 172.21.15.70:0/1860226611 shutdown_connections 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 -- 172.21.15.70:0/1860226611 wait complete. 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.115+0000 7f8140680740 1 -- start start 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8140680740 1 Processor -- start 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8140680740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbfbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8140680740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bbf9210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8140680740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbfc680 0x55620bbf9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8140680740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55620bbff250 con 0x55620bbf14a0 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8140680740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55620bb12050 con 0x55620bbfc680 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8140680740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55620bbff3d0 con 0x55620bbf1dc0 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8140680740 10 client.0 _ll_register_callbacks cb 0x55620bb52160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8137fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbfbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8137fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbfbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55774/0 (socket says 172.21.15.70:55774) 2024-09-19T04:32:30.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8137fff640 1 -- 172.21.15.70:0/3063063115 learned_addr learned my addr 172.21.15.70:0/3063063115 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f81377fe640 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bbf9210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f813c844640 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbfc680 0x55620bbf9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8137fff640 1 -- 172.21.15.70:0/3063063115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 msgr2=0x55620bbf9210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8137fff640 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bbf9210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8137fff640 1 -- 172.21.15.70:0/3063063115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbfc680 msgr2=0x55620bbf9750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.116+0000 7f8137fff640 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbfc680 0x55620bbf9750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f8137fff640 1 -- 172.21.15.70:0/3063063115 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55620b8c83c0 con 0x55620bbf14a0 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f8137fff640 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbfbf60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8128010a20 tx=0x7f8128010ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9765b139cd184f9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f81177fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f81177fe640 1 -- 172.21.15.70:0/3063063115 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812801e060 con 0x55620bbf14a0 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f81177fe640 1 -- 172.21.15.70:0/3063063115 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f812800fc50 con 0x55620bbf14a0 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f8140680740 1 -- 172.21.15.70:0/3063063115 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f812c003cc0 con 0x55620bbf14a0 2024-09-19T04:32:30.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f81177fe640 1 -- 172.21.15.70:0/3063063115 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f812800fe50 con 0x55620bbf14a0 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f8140680740 10 client.15573 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f8140680740 1 -- 172.21.15.70:0/3063063115 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55620bc0ac50 con 0x55620bbf14a0 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.117+0000 7f81177fe640 1 -- 172.21.15.70:0/3063063115 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f812c003cc0 con 0x55620bbf14a0 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f81177fe640 1 -- 172.21.15.70:0/3063063115 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f81280215b0 con 0x55620bbf14a0 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f8140680740 10 client.15573 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f8140680740 10 client.15573 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f8140680740 20 client.15573 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f8140680740 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55620bc0c110 0x55620bc0e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f8140680740 4 client.15573 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f8140680740 1 -- 172.21.15.70:0/3063063115 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55620bb64850 con 0x55620bc0c110 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f81377fe640 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55620bc0c110 0x55620bc0e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f81177fe640 10 client.15573 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.118+0000 7f81377fe640 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55620bc0c110 0x55620bc0e520 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c970a4cb5ee72471 server_cookie=39384946d7c54184 in_seq=0 out_seq=0 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f81177fe640 1 -- 172.21.15.70:0/3063063115 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55620bb64850 con 0x55620bc0c110 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f81177fe640 10 client.15573 handle_command_reply: tid=0 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 client.15573 shutdown 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 -- 172.21.15.70:0/3063063115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 msgr2=0x55620bbfbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbfbf60 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f8128010a20 tx=0x7f8128010ee0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 -- 172.21.15.70:0/3063063115 shutdown_connections 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55620bc0c110 0x55620bc0e520 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbfc680 0x55620bbf9750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bbf9210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 --2- 172.21.15.70:0/3063063115 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbfbf60 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 -- 172.21.15.70:0/3063063115 >> 172.21.15.70:0/3063063115 conn(0x55620bbeda30 msgr2=0x55620bbecb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:30.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f81177fe640 0 client.15573 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 -- 172.21.15.70:0/3063063115 shutdown_connections 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 1 -- 172.21.15.70:0/3063063115 wait complete. 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.119+0000 7f8140680740 20 client.15573 trim_cache size 0 max 16384 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f8140680740 1 Processor -- start 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f8140680740 1 -- start start 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f8140680740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc084e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f8140680740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbf7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f8140680740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bbeca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f8140680740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f81381b2220 con 0x55620bbf14a0 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f8140680740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81381afaf0 con 0x55620bbeda30 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f8140680740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ad940 con 0x55620bbf1dc0 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f81377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbf7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f81377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbf7ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55780/0 (socket says 172.21.15.70:55780) 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.137+0000 7f81377fe640 1 -- 172.21.15.70:0/868564256 learned_addr learned my addr 172.21.15.70:0/868564256 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f813c844640 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bbeca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f8137fff640 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f81377fe640 1 -- 172.21.15.70:0/868564256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 msgr2=0x55620bbeca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f81377fe640 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bbeca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f81377fe640 1 -- 172.21.15.70:0/868564256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 msgr2=0x55620bc084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f81377fe640 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc084e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f81377fe640 1 -- 172.21.15.70:0/868564256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55620bbf81c0 con 0x55620bbf14a0 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f8137fff640 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f81377fe640 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbf7ae0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f812c009900 tx=0x7f812c03d670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e358bd8120a385a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f811dffb640 1 -- 172.21.15.70:0/868564256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c035070 con 0x55620bbf14a0 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f811dffb640 1 -- 172.21.15.70:0/868564256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f812c003cc0 con 0x55620bbf14a0 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.138+0000 7f811dffb640 1 -- 172.21.15.70:0/868564256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c04c040 con 0x55620bbf14a0 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 -- 172.21.15.70:0/868564256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 msgr2=0x55620bbf7ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbf7ae0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f812c009900 tx=0x7f812c03d670 comp rx=0 tx=0).stop 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 -- 172.21.15.70:0/868564256 shutdown_connections 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bbeca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bbf7ae0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 --2- 172.21.15.70:0/868564256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 -- 172.21.15.70:0/868564256 >> 172.21.15.70:0/868564256 conn(0x55620bbf98b0 msgr2=0x55620bbec350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 -- 172.21.15.70:0/868564256 shutdown_connections 2024-09-19T04:32:30.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 -- 172.21.15.70:0/868564256 wait complete. 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 -- start start 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.139+0000 7f8140680740 1 Processor -- start 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8140680740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc00640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8140680740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bc00b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8140680740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bc010c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8140680740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f81381adfb0 con 0x55620bbf14a0 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8140680740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81381af420 con 0x55620bbeda30 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8140680740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81381ae680 con 0x55620bbf1dc0 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8140680740 10 client.0 _ll_register_callbacks cb 0x7f812800a7e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bc00b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bc00b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55788/0 (socket says 172.21.15.70:55788) 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 -- 172.21.15.70:0/413535696 learned_addr learned my addr 172.21.15.70:0/413535696 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:32:30.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8137fff640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc00640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f813c844640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bc010c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 -- 172.21.15.70:0/413535696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 msgr2=0x55620bc010c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bc010c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 -- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 msgr2=0x55620bc00640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc00640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 -- 172.21.15.70:0/413535696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55620bc76060 con 0x55620bbf14a0 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8137fff640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc00640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f813c844640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bc010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81377fe640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bc00b80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f812c000c00 tx=0x7f812c005a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87a73044c40957fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81177fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81177fe640 1 -- 172.21.15.70:0/413535696 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f812c069060 con 0x55620bbf14a0 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f81177fe640 1 -- 172.21.15.70:0/413535696 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f812c0037f0 con 0x55620bbf14a0 2024-09-19T04:32:30.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.140+0000 7f8140680740 1 -- 172.21.15.70:0/413535696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f812c003cc0 con 0x55620bbf14a0 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f81177fe640 1 -- 172.21.15.70:0/413535696 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f812c035040 con 0x55620bbf14a0 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8140680740 10 client.15579 fetch_fsmap learned FSMap version 25 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8140680740 1 -- 172.21.15.70:0/413535696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55620bc772c0 con 0x55620bbf14a0 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f81177fe640 1 -- 172.21.15.70:0/413535696 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f812c003cc0 con 0x55620bbf14a0 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f81177fe640 1 -- 172.21.15.70:0/413535696 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 25) ==== 8350+0+0 (secure 0 0 0) 0x7f812c03a040 con 0x55620bbf14a0 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8140680740 10 client.15579 fetch_fsmap finished waiting for FSMap version 25 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8140680740 10 client.15579 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8140680740 20 client.15579 populate_metadata read hostname 'smithi070' 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8140680740 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55620bbfc680 0x55620bc79540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8140680740 4 client.15579 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:32:30.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8140680740 1 -- 172.21.15.70:0/413535696 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55620bb5ed60 con 0x55620bbfc680 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "055b528e-c69e-46a8-a92d-d04513c926c8": { 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "055b528e-c69e-46a8-a92d-d04513c926c8", 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:32:30.653 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.141+0000 7f8137fff640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55620bbfc680 0x55620bc79540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8137fff640 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55620bbfc680 0x55620bc79540 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9da493e049410da4 server_cookie=dfa6d0b483086939 in_seq=0 out_seq=0 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f81177fe640 10 client.15579 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f81177fe640 1 -- 172.21.15.70:0/413535696 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55620bb5ed60 con 0x55620bbfc680 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f81177fe640 10 client.15579 handle_command_reply: tid=0 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 client.15579 shutdown 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 -- 172.21.15.70:0/413535696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 msgr2=0x55620bc00b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bc00b80 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f812c000c00 tx=0x7f812c005a40 comp rx=0 tx=0).stop 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 -- 172.21.15.70:0/413535696 shutdown_connections 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55620bbfc680 0x55620bc79540 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55620bbf1dc0 0x55620bc010c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55620bbf14a0 0x55620bc00b80 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f81177fe640 0 client.15579 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 --2- 172.21.15.70:0/413535696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55620bbeda30 0x55620bc00640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 -- 172.21.15.70:0/413535696 >> 172.21.15.70:0/413535696 conn(0x55620bbf98b0 msgr2=0x55620bbf36f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 -- 172.21.15.70:0/413535696 shutdown_connections 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.142+0000 7f8140680740 1 -- 172.21.15.70:0/413535696 wait complete. 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f8140680740 20 client.15579 trim_cache size 0 max 16384 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 -- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81200a33b0 msgr2=0x7f81200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81200a33b0 0x7f81200a5870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f812c0096c0 tx=0x7f812c040040 comp rx=0 tx=0).stop 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 -- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138106a80 msgr2=0x7f81380fd7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138106a80 0x7f81380fd7c0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f813000eaa0 tx=0x7f813000eea0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 -- 172.21.15.70:0/3161346798 shutdown_connections 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81200a33b0 0x7f81200a5870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8138106a80 0x7f81380fd7c0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8138101420 0x7f81380fd280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 --2- 172.21.15.70:0/3161346798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8138100a80 0x7f81380fcd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:32:30.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 -- 172.21.15.70:0/3161346798 >> 172.21.15.70:0/3161346798 conn(0x7f81380fc7a0 msgr2=0x7f813806a9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:32:30.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 -- 172.21.15.70:0/3161346798 shutdown_connections 2024-09-19T04:32:30.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:32:30.143+0000 7f813e2a7640 1 -- 172.21.15.70:0/3161346798 wait complete. 2024-09-19T04:32:31.340 INFO:tasks.cephfs.filesystem:scrub status for tag:055b528e-c69e-46a8-a92d-d04513c926c8 - {'path': '/', 'tag': '055b528e-c69e-46a8-a92d-d04513c926c8', 'options': 'recursive,force'} 2024-09-19T04:32:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:31 smithi070 ceph-mon[30942]: pgmap v55: 97 pgs: 97 active+clean; 57 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-09-19T04:32:31.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:31 smithi167 ceph-mon[34339]: pgmap v55: 97 pgs: 97 active+clean; 57 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-09-19T04:32:32.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:31 smithi134 ceph-mon[34525]: pgmap v55: 97 pgs: 97 active+clean; 57 MiB data, 536 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1.0 MiB/s wr, 6 op/s 2024-09-19T04:32:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:33 smithi070 ceph-mon[30942]: pgmap v56: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-19T04:32:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:33 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:32:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:33 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:32:33.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:33 smithi167 ceph-mon[34339]: pgmap v56: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-19T04:32:33.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:33 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:32:33.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:33 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:32:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:33 smithi134 ceph-mon[34525]: pgmap v56: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 5.5 KiB/s rd, 1.7 MiB/s wr, 8 op/s 2024-09-19T04:32:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:33 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:32:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:33 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:32:35.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:35 smithi070 ceph-mon[30942]: pgmap v57: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:35.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:35 smithi167 ceph-mon[34339]: pgmap v57: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:36.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:35 smithi134 ceph-mon[34525]: pgmap v57: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:36 smithi070 ceph-mon[30942]: pgmap v58: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:36.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:36 smithi167 ceph-mon[34339]: pgmap v58: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:36 smithi134 ceph-mon[34525]: pgmap v58: 97 pgs: 97 active+clean; 65 MiB data, 560 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:37.985 INFO:tasks.workunit.client.0.smithi070.stderr:+ mkdir untar_tar 2024-09-19T04:32:38.079 INFO:tasks.workunit.client.0.smithi070.stderr:+ cd untar_tar 2024-09-19T04:32:38.079 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-09-19T04:32:38.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ 2024-09-19T04:32:38.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/00-INDEX 2024-09-19T04:32:38.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/ 2024-09-19T04:32:38.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/README 2024-09-19T04:32:38.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-09-19T04:32:38.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-09-19T04:32:38.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-09-19T04:32:38.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-09-19T04:32:38.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-09-19T04:32:38.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-09-19T04:32:38.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-09-19T04:32:38.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-09-19T04:32:38.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-09-19T04:32:38.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-09-19T04:32:38.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-09-19T04:32:38.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-09-19T04:32:38.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-09-19T04:32:38.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-09-19T04:32:38.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-09-19T04:32:38.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-09-19T04:32:38.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-09-19T04:32:38.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-09-19T04:32:38.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-09-19T04:32:38.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-09-19T04:32:38.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-09-19T04:32:38.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-09-19T04:32:38.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-09-19T04:32:38.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-09-19T04:32:38.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-09-19T04:32:38.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-09-19T04:32:38.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-09-19T04:32:38.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-09-19T04:32:38.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-09-19T04:32:38.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-09-19T04:32:38.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-09-19T04:32:38.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-09-19T04:32:38.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-09-19T04:32:38.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-09-19T04:32:38.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-09-19T04:32:38.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-09-19T04:32:38.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-09-19T04:32:38.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-09-19T04:32:38.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-09-19T04:32:38.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-09-19T04:32:38.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-09-19T04:32:38.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-09-19T04:32:38.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-09-19T04:32:38.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-09-19T04:32:38.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-09-19T04:32:38.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-09-19T04:32:38.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-09-19T04:32:38.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-09-19T04:32:38.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-09-19T04:32:38.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-09-19T04:32:38.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-09-19T04:32:38.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-09-19T04:32:38.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-09-19T04:32:38.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-09-19T04:32:38.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-09-19T04:32:38.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-09-19T04:32:38.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-09-19T04:32:38.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-09-19T04:32:38.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-09-19T04:32:38.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-09-19T04:32:38.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-09-19T04:32:38.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-09-19T04:32:38.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-09-19T04:32:38.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-09-19T04:32:38.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-09-19T04:32:38.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-09-19T04:32:38.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-09-19T04:32:38.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-09-19T04:32:38.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-09-19T04:32:38.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-09-19T04:32:38.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-09-19T04:32:38.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-09-19T04:32:38.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-09-19T04:32:38.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-09-19T04:32:38.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-09-19T04:32:38.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-09-19T04:32:38.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-09-19T04:32:38.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-09-19T04:32:38.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-09-19T04:32:38.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-09-19T04:32:38.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-09-19T04:32:38.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-09-19T04:32:38.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-09-19T04:32:38.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-09-19T04:32:38.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-09-19T04:32:38.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-09-19T04:32:38.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-09-19T04:32:38.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-09-19T04:32:38.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-09-19T04:32:38.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-09-19T04:32:38.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-09-19T04:32:38.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-09-19T04:32:38.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-09-19T04:32:38.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-09-19T04:32:38.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-09-19T04:32:38.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-09-19T04:32:38.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-09-19T04:32:38.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-09-19T04:32:38.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-09-19T04:32:38.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-09-19T04:32:38.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-09-19T04:32:38.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-09-19T04:32:38.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-09-19T04:32:38.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-09-19T04:32:38.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-09-19T04:32:38.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-09-19T04:32:38.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-09-19T04:32:38.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-09-19T04:32:38.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-09-19T04:32:38.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-09-19T04:32:38.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-09-19T04:32:38.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-09-19T04:32:38.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-09-19T04:32:38.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-09-19T04:32:38.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-09-19T04:32:38.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-09-19T04:32:38.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-09-19T04:32:38.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-09-19T04:32:38.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-09-19T04:32:38.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-09-19T04:32:38.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-09-19T04:32:38.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-09-19T04:32:38.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-09-19T04:32:38.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-09-19T04:32:38.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-09-19T04:32:38.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-09-19T04:32:38.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-09-19T04:32:38.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-09-19T04:32:38.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-09-19T04:32:38.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-09-19T04:32:38.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-09-19T04:32:38.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-09-19T04:32:38.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-09-19T04:32:38.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-09-19T04:32:38.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-09-19T04:32:38.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-09-19T04:32:38.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-09-19T04:32:38.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-09-19T04:32:38.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-09-19T04:32:38.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-09-19T04:32:38.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-09-19T04:32:38.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-09-19T04:32:38.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-09-19T04:32:38.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-09-19T04:32:38.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-09-19T04:32:38.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-09-19T04:32:38.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-09-19T04:32:38.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-09-19T04:32:38.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-09-19T04:32:38.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-09-19T04:32:38.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-09-19T04:32:38.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-09-19T04:32:38.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-09-19T04:32:38.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-09-19T04:32:38.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-09-19T04:32:38.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-09-19T04:32:38.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-09-19T04:32:38.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-09-19T04:32:38.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-09-19T04:32:38.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-09-19T04:32:38.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-09-19T04:32:38.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-09-19T04:32:38.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-09-19T04:32:38.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-09-19T04:32:38.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-09-19T04:32:38.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-09-19T04:32:38.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-09-19T04:32:38.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-09-19T04:32:38.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-09-19T04:32:38.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-09-19T04:32:38.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-09-19T04:32:38.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-09-19T04:32:38.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-09-19T04:32:38.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-09-19T04:32:38.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-09-19T04:32:38.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-09-19T04:32:38.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-09-19T04:32:38.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-09-19T04:32:38.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-09-19T04:32:38.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-09-19T04:32:38.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-09-19T04:32:38.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-09-19T04:32:38.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-09-19T04:32:39.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-09-19T04:32:39.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-09-19T04:32:39.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-09-19T04:32:39.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-09-19T04:32:39.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-09-19T04:32:39.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-09-19T04:32:39.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-09-19T04:32:39.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-09-19T04:32:39.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-09-19T04:32:39.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-09-19T04:32:39.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-09-19T04:32:39.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-09-19T04:32:39.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-09-19T04:32:39.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-09-19T04:32:39.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-09-19T04:32:39.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-09-19T04:32:39.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-09-19T04:32:39.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-09-19T04:32:39.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-09-19T04:32:39.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-09-19T04:32:39.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-09-19T04:32:39.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-09-19T04:32:39.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-09-19T04:32:39.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-09-19T04:32:39.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-09-19T04:32:39.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-09-19T04:32:39.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-09-19T04:32:39.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-09-19T04:32:39.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-09-19T04:32:39.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-09-19T04:32:39.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-09-19T04:32:39.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-09-19T04:32:39.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-09-19T04:32:39.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-09-19T04:32:39.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-09-19T04:32:39.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-09-19T04:32:39.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-09-19T04:32:39.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-09-19T04:32:39.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-09-19T04:32:39.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-09-19T04:32:39.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-09-19T04:32:39.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-09-19T04:32:39.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-09-19T04:32:39.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-09-19T04:32:39.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-09-19T04:32:39.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-09-19T04:32:39.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-09-19T04:32:39.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-09-19T04:32:39.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-09-19T04:32:39.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-09-19T04:32:39.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-09-19T04:32:39.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-09-19T04:32:39.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-09-19T04:32:39.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-09-19T04:32:39.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-09-19T04:32:39.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-09-19T04:32:39.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-09-19T04:32:39.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-09-19T04:32:39.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-09-19T04:32:39.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-09-19T04:32:39.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-09-19T04:32:39.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-09-19T04:32:39.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-09-19T04:32:39.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Changes 2024-09-19T04:32:39.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-09-19T04:32:39.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/CodingStyle 2024-09-19T04:32:39.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-09-19T04:32:39.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-09-19T04:32:39.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-09-19T04:32:39.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-09-19T04:32:39.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/ 2024-09-19T04:32:39.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-09-19T04:32:39.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-09-19T04:32:39.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-09-19T04:32:39.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-09-19T04:32:39.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-09-19T04:32:39.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-09-19T04:32:39.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-09-19T04:32:39.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-09-19T04:32:39.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-09-19T04:32:39.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-09-19T04:32:39.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-09-19T04:32:39.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-09-19T04:32:39.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-09-19T04:32:39.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-09-19T04:32:39.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-09-19T04:32:39.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-09-19T04:32:39.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-09-19T04:32:39.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-09-19T04:32:39.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-09-19T04:32:39.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-09-19T04:32:39.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-09-19T04:32:39.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-09-19T04:32:39.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-09-19T04:32:39.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-09-19T04:32:39.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-09-19T04:32:39.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-09-19T04:32:39.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-09-19T04:32:39.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-09-19T04:32:39.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-09-19T04:32:39.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-09-19T04:32:39.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-09-19T04:32:39.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-09-19T04:32:39.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-09-19T04:32:39.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-09-19T04:32:39.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-09-19T04:32:39.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-09-19T04:32:39.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-09-19T04:32:39.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-09-19T04:32:39.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-09-19T04:32:39.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-09-19T04:32:39.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-09-19T04:32:39.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-09-19T04:32:39.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-09-19T04:32:39.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-09-19T04:32:39.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-09-19T04:32:39.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-09-19T04:32:39.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-09-19T04:32:39.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-09-19T04:32:39.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-09-19T04:32:39.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-09-19T04:32:39.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-09-19T04:32:39.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-09-19T04:32:39.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-09-19T04:32:39.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-09-19T04:32:39.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-09-19T04:32:39.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-09-19T04:32:39.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-09-19T04:32:39.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-09-19T04:32:39.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-09-19T04:32:39.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-09-19T04:32:39.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-09-19T04:32:39.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-09-19T04:32:39.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-09-19T04:32:39.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-09-19T04:32:39.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-09-19T04:32:39.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-09-19T04:32:39.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-09-19T04:32:39.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-09-19T04:32:39.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-09-19T04:32:39.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-09-19T04:32:39.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-09-19T04:32:39.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-09-19T04:32:39.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-09-19T04:32:39.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-09-19T04:32:39.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-09-19T04:32:39.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-09-19T04:32:39.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-09-19T04:32:39.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-09-19T04:32:39.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-09-19T04:32:39.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-09-19T04:32:39.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-09-19T04:32:39.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-09-19T04:32:39.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-09-19T04:32:39.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-09-19T04:32:39.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-09-19T04:32:39.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-09-19T04:32:39.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-09-19T04:32:39.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-09-19T04:32:39.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-09-19T04:32:39.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-09-19T04:32:39.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-09-19T04:32:39.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-09-19T04:32:39.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-09-19T04:32:39.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-09-19T04:32:39.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-09-19T04:32:39.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-09-19T04:32:39.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-09-19T04:32:39.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-09-19T04:32:39.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-09-19T04:32:39.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-09-19T04:32:39.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-09-19T04:32:39.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-09-19T04:32:39.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-09-19T04:32:39.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-09-19T04:32:39.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-09-19T04:32:39.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-09-19T04:32:39.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-09-19T04:32:39.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-09-19T04:32:39.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-09-19T04:32:39.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-09-19T04:32:39.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-09-19T04:32:39.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-09-19T04:32:39.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-09-19T04:32:39.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-09-19T04:32:39.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-09-19T04:32:39.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-09-19T04:32:39.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-09-19T04:32:39.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-09-19T04:32:39.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-09-19T04:32:39.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-09-19T04:32:39.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-09-19T04:32:39.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-09-19T04:32:39.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-09-19T04:32:39.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-09-19T04:32:39.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-09-19T04:32:39.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-09-19T04:32:39.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-09-19T04:32:39.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-09-19T04:32:39.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-09-19T04:32:39.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-09-19T04:32:39.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-09-19T04:32:39.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-09-19T04:32:39.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-09-19T04:32:39.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-09-19T04:32:39.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-09-19T04:32:39.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-09-19T04:32:39.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-09-19T04:32:39.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-09-19T04:32:39.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-09-19T04:32:39.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-09-19T04:32:39.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-09-19T04:32:39.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-09-19T04:32:39.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-09-19T04:32:39.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-09-19T04:32:39.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-09-19T04:32:39.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-09-19T04:32:39.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-09-19T04:32:39.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-09-19T04:32:39.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-09-19T04:32:39.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-09-19T04:32:39.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-09-19T04:32:39.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-09-19T04:32:39.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-09-19T04:32:39.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-09-19T04:32:39.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-09-19T04:32:39.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-09-19T04:32:39.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-09-19T04:32:39.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-09-19T04:32:39.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-09-19T04:32:39.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-09-19T04:32:39.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-09-19T04:32:39.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-09-19T04:32:39.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-09-19T04:32:39.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-09-19T04:32:39.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-09-19T04:32:39.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-09-19T04:32:39.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-09-19T04:32:39.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-09-19T04:32:39.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-09-19T04:32:39.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-09-19T04:32:39.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-09-19T04:32:39.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-09-19T04:32:39.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-09-19T04:32:39.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-09-19T04:32:39.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-09-19T04:32:39.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-09-19T04:32:39.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-09-19T04:32:39.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-09-19T04:32:39.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-09-19T04:32:39.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-09-19T04:32:39.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-09-19T04:32:39.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-09-19T04:32:39.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-09-19T04:32:39.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-09-19T04:32:39.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-09-19T04:32:39.890 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-09-19T04:32:39.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-09-19T04:32:39.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:39 smithi070 ceph-mon[30942]: pgmap v59: 97 pgs: 97 active+clean; 73 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-19T04:32:39.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-09-19T04:32:39.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-09-19T04:32:39.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-09-19T04:32:39.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-09-19T04:32:39.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-09-19T04:32:39.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-09-19T04:32:39.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-09-19T04:32:39.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-09-19T04:32:39.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-09-19T04:32:39.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-09-19T04:32:39.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-09-19T04:32:39.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:39 smithi167 ceph-mon[34339]: pgmap v59: 97 pgs: 97 active+clean; 73 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-19T04:32:40.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:39 smithi134 ceph-mon[34525]: pgmap v59: 97 pgs: 97 active+clean; 73 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 2.0 MiB/s wr, 8 op/s 2024-09-19T04:32:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:41 smithi070 ceph-mon[30942]: pgmap v60: 97 pgs: 97 active+clean; 73 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:41.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:41 smithi167 ceph-mon[34339]: pgmap v60: 97 pgs: 97 active+clean; 73 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:42.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:41 smithi134 ceph-mon[34525]: pgmap v60: 97 pgs: 97 active+clean; 73 MiB data, 584 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 1.3 MiB/s wr, 5 op/s 2024-09-19T04:32:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:43 smithi070 ceph-mon[30942]: pgmap v61: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.2 MiB/s wr, 48 op/s 2024-09-19T04:32:43.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:43 smithi167 ceph-mon[34339]: pgmap v61: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.2 MiB/s wr, 48 op/s 2024-09-19T04:32:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:43 smithi134 ceph-mon[34525]: pgmap v61: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 38 KiB/s rd, 2.2 MiB/s wr, 48 op/s 2024-09-19T04:32:44.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-09-19T04:32:44.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-09-19T04:32:44.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-09-19T04:32:44.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-09-19T04:32:44.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-09-19T04:32:44.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-09-19T04:32:44.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-09-19T04:32:44.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-09-19T04:32:44.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-09-19T04:32:44.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-09-19T04:32:44.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-09-19T04:32:44.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-09-19T04:32:44.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-09-19T04:32:44.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-09-19T04:32:44.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-09-19T04:32:44.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-09-19T04:32:44.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-09-19T04:32:44.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-09-19T04:32:44.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-09-19T04:32:44.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-09-19T04:32:44.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-09-19T04:32:44.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-09-19T04:32:44.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-09-19T04:32:44.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-09-19T04:32:44.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-09-19T04:32:44.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-09-19T04:32:44.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-09-19T04:32:44.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-09-19T04:32:44.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-09-19T04:32:44.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-09-19T04:32:44.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-09-19T04:32:44.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-09-19T04:32:44.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-09-19T04:32:44.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-09-19T04:32:44.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/ 2024-09-19T04:32:44.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-09-19T04:32:44.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-09-19T04:32:44.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-09-19T04:32:44.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-09-19T04:32:44.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-09-19T04:32:44.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-09-19T04:32:44.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-09-19T04:32:44.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-09-19T04:32:44.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-09-19T04:32:44.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/EDID/hex 2024-09-19T04:32:44.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/HOWTO 2024-09-19T04:32:44.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-09-19T04:32:44.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-09-19T04:32:44.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-09-19T04:32:44.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-09-19T04:32:44.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-09-19T04:32:44.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/Makefile 2024-09-19T04:32:44.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-09-19T04:32:44.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/ 2024-09-19T04:32:44.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-09-19T04:32:44.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-09-19T04:32:44.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-09-19T04:32:44.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-09-19T04:32:44.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-09-19T04:32:44.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-09-19T04:32:44.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-09-19T04:32:44.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/ 2024-09-19T04:32:44.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-09-19T04:32:44.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-09-19T04:32:44.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-09-19T04:32:44.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-09-19T04:32:44.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-09-19T04:32:44.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-09-19T04:32:44.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-09-19T04:32:44.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-09-19T04:32:44.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-09-19T04:32:44.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-09-19T04:32:44.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-09-19T04:32:44.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-09-19T04:32:44.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-09-19T04:32:44.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-09-19T04:32:44.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-09-19T04:32:44.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-09-19T04:32:44.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-09-19T04:32:44.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-09-19T04:32:44.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SAK.txt 2024-09-19T04:32:44.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SM501.txt 2024-09-19T04:32:44.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-09-19T04:32:44.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-09-19T04:32:44.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-09-19T04:32:44.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-09-19T04:32:44.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-09-19T04:32:44.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/ 2024-09-19T04:32:44.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-09-19T04:32:44.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-09-19T04:32:44.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-09-19T04:32:44.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-09-19T04:32:44.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-09-19T04:32:44.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-09-19T04:32:44.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-09-19T04:32:44.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/ 2024-09-19T04:32:44.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-09-19T04:32:44.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-09-19T04:32:44.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-09-19T04:32:44.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-09-19T04:32:44.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-09-19T04:32:44.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-09-19T04:32:44.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-09-19T04:32:44.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-09-19T04:32:44.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-09-19T04:32:44.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-09-19T04:32:44.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-09-19T04:32:44.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-09-19T04:32:44.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-09-19T04:32:44.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/ 2024-09-19T04:32:44.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-09-19T04:32:44.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-09-19T04:32:44.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-09-19T04:32:44.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-09-19T04:32:44.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-09-19T04:32:44.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-09-19T04:32:44.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-09-19T04:32:44.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/ 2024-09-19T04:32:44.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-09-19T04:32:44.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-09-19T04:32:44.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-09-19T04:32:44.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Booting 2024-09-19T04:32:44.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-09-19T04:32:44.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-09-19T04:32:44.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-09-19T04:32:44.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-09-19T04:32:44.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-09-19T04:32:44.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-09-19T04:32:44.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-09-19T04:32:44.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-09-19T04:32:44.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-09-19T04:32:44.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-09-19T04:32:44.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Porting 2024-09-19T04:32:44.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/README 2024-09-19T04:32:44.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-09-19T04:32:44.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-09-19T04:32:44.670 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-09-19T04:32:44.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-09-19T04:32:44.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-09-19T04:32:44.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-09-19T04:32:44.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-09-19T04:32:44.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-09-19T04:32:44.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-09-19T04:32:44.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-09-19T04:32:44.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-09-19T04:32:44.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-09-19T04:32:44.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-09-19T04:32:44.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-09-19T04:32:44.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-09-19T04:32:44.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-09-19T04:32:44.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-09-19T04:32:44.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-09-19T04:32:44.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-09-19T04:32:44.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-09-19T04:32:44.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-09-19T04:32:44.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-09-19T04:32:44.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-09-19T04:32:44.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-09-19T04:32:44.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-09-19T04:32:44.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-09-19T04:32:44.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-09-19T04:32:44.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-09-19T04:32:44.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-09-19T04:32:44.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-09-19T04:32:44.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-09-19T04:32:44.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-09-19T04:32:44.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-09-19T04:32:44.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-09-19T04:32:44.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-09-19T04:32:44.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-09-19T04:32:44.735 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-09-19T04:32:44.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-09-19T04:32:44.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-09-19T04:32:44.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-09-19T04:32:44.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-09-19T04:32:44.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-09-19T04:32:44.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-09-19T04:32:44.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/Setup 2024-09-19T04:32:44.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-09-19T04:32:44.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-09-19T04:32:44.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-09-19T04:32:44.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-09-19T04:32:44.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-09-19T04:32:44.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-09-19T04:32:44.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-09-19T04:32:44.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-09-19T04:32:44.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-09-19T04:32:44.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-09-19T04:32:44.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-09-19T04:32:44.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-09-19T04:32:44.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-09-19T04:32:44.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-09-19T04:32:44.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-09-19T04:32:44.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-09-19T04:32:44.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-09-19T04:32:44.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-09-19T04:32:44.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-09-19T04:32:44.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-09-19T04:32:44.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-09-19T04:32:44.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-09-19T04:32:44.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-09-19T04:32:44.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-09-19T04:32:44.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-09-19T04:32:44.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-09-19T04:32:44.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-09-19T04:32:44.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-09-19T04:32:44.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-09-19T04:32:44.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-09-19T04:32:44.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/ 2024-09-19T04:32:44.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-09-19T04:32:44.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-09-19T04:32:44.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-09-19T04:32:44.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-09-19T04:32:44.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-09-19T04:32:44.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-09-19T04:32:44.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-09-19T04:32:44.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-09-19T04:32:44.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-09-19T04:32:44.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-09-19T04:32:44.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-09-19T04:32:44.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-09-19T04:32:44.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/backlight/ 2024-09-19T04:32:44.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-09-19T04:32:44.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-09-19T04:32:44.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-09-19T04:32:44.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bcache.txt 2024-09-19T04:32:44.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-09-19T04:32:44.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/ 2024-09-19T04:32:44.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-09-19T04:32:44.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-09-19T04:32:44.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-09-19T04:32:44.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-09-19T04:32:44.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-09-19T04:32:44.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/ 2024-09-19T04:32:44.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-09-19T04:32:44.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-09-19T04:32:44.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-09-19T04:32:44.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-09-19T04:32:44.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-09-19T04:32:44.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-09-19T04:32:44.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-09-19T04:32:44.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-09-19T04:32:44.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-09-19T04:32:44.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-09-19T04:32:44.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-09-19T04:32:44.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/request.txt 2024-09-19T04:32:44.888 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-09-19T04:32:44.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-09-19T04:32:44.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-09-19T04:32:44.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/ 2024-09-19T04:32:44.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-09-19T04:32:44.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-09-19T04:32:44.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-09-19T04:32:44.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-09-19T04:32:45.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-09-19T04:32:45.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-09-19T04:32:45.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-09-19T04:32:45.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-09-19T04:32:45.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-09-19T04:32:45.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-09-19T04:32:45.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-09-19T04:32:45.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-09-19T04:32:45.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-09-19T04:32:45.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-09-19T04:32:45.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-09-19T04:32:45.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-09-19T04:32:45.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-09-19T04:32:45.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-09-19T04:32:45.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-09-19T04:32:45.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-09-19T04:32:45.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-09-19T04:32:45.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-09-19T04:32:45.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-09-19T04:32:45.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-09-19T04:32:45.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-09-19T04:32:45.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-09-19T04:32:45.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/ 2024-09-19T04:32:45.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-09-19T04:32:45.049 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-09-19T04:32:45.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-09-19T04:32:45.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-09-19T04:32:45.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-09-19T04:32:45.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/ 2024-09-19T04:32:45.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-09-19T04:32:45.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-09-19T04:32:45.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-09-19T04:32:45.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-09-19T04:32:45.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-09-19T04:32:45.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-09-19T04:32:45.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-09-19T04:32:45.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-09-19T04:32:45.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-09-19T04:32:45.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-09-19T04:32:45.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-09-19T04:32:45.084 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-09-19T04:32:45.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-09-19T04:32:45.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-09-19T04:32:45.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/clk.txt 2024-09-19T04:32:45.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-09-19T04:32:45.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/ 2024-09-19T04:32:45.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-09-19T04:32:45.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-09-19T04:32:45.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-09-19T04:32:45.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-09-19T04:32:45.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-09-19T04:32:45.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/console/ 2024-09-19T04:32:45.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/console/console.txt 2024-09-19T04:32:45.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-09-19T04:32:45.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-09-19T04:32:45.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-09-19T04:32:45.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-09-19T04:32:45.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-09-19T04:32:45.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-09-19T04:32:45.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-09-19T04:32:45.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-09-19T04:32:45.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-09-19T04:32:45.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-09-19T04:32:45.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-09-19T04:32:45.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-09-19T04:32:45.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-09-19T04:32:45.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-09-19T04:32:45.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-09-19T04:32:45.139 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-09-19T04:32:45.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-09-19T04:32:45.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-09-19T04:32:45.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-09-19T04:32:45.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-09-19T04:32:45.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crc32.txt 2024-09-19T04:32:45.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cris/ 2024-09-19T04:32:45.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/cris/README 2024-09-19T04:32:45.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/ 2024-09-19T04:32:45.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-09-19T04:32:45.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-09-19T04:32:45.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-09-19T04:32:45.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-09-19T04:32:45.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-09-19T04:32:45.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-09-19T04:32:45.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-09-19T04:32:45.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-09-19T04:32:45.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-09-19T04:32:45.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/ 2024-09-19T04:32:45.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-09-19T04:32:45.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-09-19T04:32:45.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-09-19T04:32:45.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-09-19T04:32:45.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-09-19T04:32:45.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-09-19T04:32:45.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-09-19T04:32:45.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-09-19T04:32:45.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-09-19T04:32:45.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-09-19T04:32:45.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-09-19T04:32:45.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-09-19T04:32:45.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-09-19T04:32:45.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-09-19T04:32:45.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-09-19T04:32:45.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-09-19T04:32:45.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-09-19T04:32:45.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-09-19T04:32:45.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-09-19T04:32:45.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-09-19T04:32:45.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-09-19T04:32:45.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-09-19T04:32:45.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-09-19T04:32:45.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-09-19T04:32:45.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-09-19T04:32:45.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-09-19T04:32:45.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-09-19T04:32:45.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-09-19T04:32:45.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-09-19T04:32:45.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-09-19T04:32:45.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-09-19T04:32:45.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devices.txt 2024-09-19T04:32:45.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/ 2024-09-19T04:32:45.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-09-19T04:32:45.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-09-19T04:32:45.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-09-19T04:32:45.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-09-19T04:32:45.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-09-19T04:32:45.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-09-19T04:32:45.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-09-19T04:32:45.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-09-19T04:32:45.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-09-19T04:32:45.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-09-19T04:32:45.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-09-19T04:32:45.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-09-19T04:32:45.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-09-19T04:32:45.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-09-19T04:32:45.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-09-19T04:32:45.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-09-19T04:32:45.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-09-19T04:32:45.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-09-19T04:32:45.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-09-19T04:32:45.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-09-19T04:32:45.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-09-19T04:32:45.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-09-19T04:32:45.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-09-19T04:32:45.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-09-19T04:32:45.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-09-19T04:32:45.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-09-19T04:32:45.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-09-19T04:32:45.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-09-19T04:32:45.303 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-09-19T04:32:45.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-09-19T04:32:45.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-09-19T04:32:45.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-09-19T04:32:45.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-09-19T04:32:45.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-09-19T04:32:45.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-09-19T04:32:45.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-09-19T04:32:45.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-09-19T04:32:45.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-09-19T04:32:45.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-09-19T04:32:45.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-09-19T04:32:45.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-09-19T04:32:45.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-09-19T04:32:45.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-09-19T04:32:45.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-09-19T04:32:45.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-09-19T04:32:45.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-09-19T04:32:45.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-09-19T04:32:45.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-09-19T04:32:45.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-09-19T04:32:45.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-09-19T04:32:45.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-09-19T04:32:45.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-09-19T04:32:45.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-09-19T04:32:45.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-09-19T04:32:45.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-09-19T04:32:45.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-09-19T04:32:45.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-09-19T04:32:45.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-09-19T04:32:45.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-09-19T04:32:45.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-09-19T04:32:45.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-09-19T04:32:45.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-09-19T04:32:45.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-09-19T04:32:45.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-09-19T04:32:45.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-09-19T04:32:45.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-09-19T04:32:45.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-09-19T04:32:45.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-09-19T04:32:45.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-09-19T04:32:45.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-09-19T04:32:45.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-09-19T04:32:45.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-09-19T04:32:45.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-09-19T04:32:45.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-09-19T04:32:45.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-09-19T04:32:45.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-09-19T04:32:45.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-09-19T04:32:45.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-09-19T04:32:45.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-09-19T04:32:45.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-09-19T04:32:45.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-09-19T04:32:45.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-09-19T04:32:45.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-09-19T04:32:45.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-09-19T04:32:45.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-09-19T04:32:45.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-09-19T04:32:45.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-09-19T04:32:45.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-09-19T04:32:45.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-09-19T04:32:45.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-09-19T04:32:45.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-09-19T04:32:45.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-09-19T04:32:45.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-09-19T04:32:45.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-09-19T04:32:45.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-09-19T04:32:45.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-09-19T04:32:45.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-09-19T04:32:45.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-09-19T04:32:45.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-09-19T04:32:45.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-09-19T04:32:45.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-09-19T04:32:45.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-09-19T04:32:45.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-09-19T04:32:45.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-09-19T04:32:45.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-09-19T04:32:45.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-09-19T04:32:45.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-09-19T04:32:45.467 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-09-19T04:32:45.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-09-19T04:32:45.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-09-19T04:32:45.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-09-19T04:32:45.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-09-19T04:32:45.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-09-19T04:32:45.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-09-19T04:32:45.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-09-19T04:32:45.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-09-19T04:32:45.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-09-19T04:32:45.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-09-19T04:32:45.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-09-19T04:32:45.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-09-19T04:32:45.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-09-19T04:32:45.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-09-19T04:32:45.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-09-19T04:32:45.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-09-19T04:32:45.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-09-19T04:32:45.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-09-19T04:32:45.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-09-19T04:32:45.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-09-19T04:32:45.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-09-19T04:32:45.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-09-19T04:32:45.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-09-19T04:32:45.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-09-19T04:32:45.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-09-19T04:32:45.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-09-19T04:32:45.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-09-19T04:32:45.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-09-19T04:32:45.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-09-19T04:32:45.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-09-19T04:32:45.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-09-19T04:32:45.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-09-19T04:32:45.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-09-19T04:32:45.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-09-19T04:32:45.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-09-19T04:32:45.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-09-19T04:32:45.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-09-19T04:32:45.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-09-19T04:32:45.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-09-19T04:32:45.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-09-19T04:32:45.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-09-19T04:32:45.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-09-19T04:32:45.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-09-19T04:32:45.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-09-19T04:32:45.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-09-19T04:32:45.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-09-19T04:32:45.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-09-19T04:32:45.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-09-19T04:32:45.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-09-19T04:32:45.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-09-19T04:32:45.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-09-19T04:32:45.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-09-19T04:32:45.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-09-19T04:32:45.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-09-19T04:32:45.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-09-19T04:32:45.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-09-19T04:32:45.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-09-19T04:32:45.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-09-19T04:32:45.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-09-19T04:32:45.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-09-19T04:32:45.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-09-19T04:32:45.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-09-19T04:32:45.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-09-19T04:32:45.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-09-19T04:32:45.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-09-19T04:32:45.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-09-19T04:32:45.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-09-19T04:32:45.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-09-19T04:32:45.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-09-19T04:32:45.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-09-19T04:32:45.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-09-19T04:32:45.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-09-19T04:32:45.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-09-19T04:32:45.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-09-19T04:32:45.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-09-19T04:32:45.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-09-19T04:32:45.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-09-19T04:32:45.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-09-19T04:32:45.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-09-19T04:32:45.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-09-19T04:32:45.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-09-19T04:32:45.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-09-19T04:32:45.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-09-19T04:32:45.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-09-19T04:32:45.894 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:45 smithi070 ceph-mon[30942]: pgmap v62: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-19T04:32:45.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-09-19T04:32:45.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-09-19T04:32:45.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-09-19T04:32:45.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-09-19T04:32:45.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-09-19T04:32:45.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-09-19T04:32:45.907 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-09-19T04:32:45.914 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-09-19T04:32:45.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-09-19T04:32:45.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-09-19T04:32:45.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-09-19T04:32:45.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-09-19T04:32:45.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-09-19T04:32:45.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-09-19T04:32:45.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-09-19T04:32:45.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-09-19T04:32:45.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-09-19T04:32:45.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-09-19T04:32:45.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-09-19T04:32:45.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-09-19T04:32:45.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-09-19T04:32:45.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-09-19T04:32:45.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-09-19T04:32:45.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-09-19T04:32:45.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-09-19T04:32:45.951 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-09-19T04:32:45.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-09-19T04:32:45.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-09-19T04:32:45.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-09-19T04:32:45.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-09-19T04:32:45.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:45 smithi167 ceph-mon[34339]: pgmap v62: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-19T04:32:45.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-09-19T04:32:45.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-09-19T04:32:45.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-09-19T04:32:45.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-09-19T04:32:45.970 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-09-19T04:32:45.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-09-19T04:32:45.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-09-19T04:32:45.976 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-09-19T04:32:45.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-09-19T04:32:45.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-09-19T04:32:45.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-09-19T04:32:45.986 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-09-19T04:32:45.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-09-19T04:32:45.990 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-09-19T04:32:45.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-09-19T04:32:45.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-09-19T04:32:45.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-09-19T04:32:45.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-09-19T04:32:46.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-09-19T04:32:46.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-09-19T04:32:46.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-09-19T04:32:46.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-09-19T04:32:46.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-09-19T04:32:46.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-09-19T04:32:46.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-09-19T04:32:46.015 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-09-19T04:32:46.017 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-09-19T04:32:46.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-09-19T04:32:46.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-09-19T04:32:46.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-09-19T04:32:46.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-09-19T04:32:46.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-09-19T04:32:46.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-09-19T04:32:46.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-09-19T04:32:46.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:45 smithi134 ceph-mon[34525]: pgmap v62: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-19T04:32:46.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-09-19T04:32:46.037 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-09-19T04:32:46.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-09-19T04:32:46.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-09-19T04:32:46.045 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-09-19T04:32:46.047 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-09-19T04:32:46.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-09-19T04:32:46.052 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-09-19T04:32:46.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-09-19T04:32:46.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-09-19T04:32:46.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-09-19T04:32:46.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-09-19T04:32:46.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-09-19T04:32:46.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-09-19T04:32:46.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-09-19T04:32:46.068 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-09-19T04:32:46.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-09-19T04:32:46.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-09-19T04:32:46.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-09-19T04:32:46.077 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-09-19T04:32:46.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-09-19T04:32:46.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-09-19T04:32:46.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-09-19T04:32:46.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-09-19T04:32:46.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-09-19T04:32:46.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-09-19T04:32:46.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-09-19T04:32:46.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-09-19T04:32:46.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-09-19T04:32:46.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-09-19T04:32:46.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-09-19T04:32:46.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-09-19T04:32:46.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-09-19T04:32:46.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-09-19T04:32:46.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-09-19T04:32:46.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-09-19T04:32:46.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-09-19T04:32:46.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-09-19T04:32:46.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-09-19T04:32:46.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-09-19T04:32:46.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-09-19T04:32:46.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-09-19T04:32:46.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-09-19T04:32:46.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-09-19T04:32:46.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-09-19T04:32:46.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-09-19T04:32:46.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-09-19T04:32:46.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-09-19T04:32:46.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-09-19T04:32:46.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-09-19T04:32:46.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-09-19T04:32:46.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-09-19T04:32:46.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-09-19T04:32:46.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-09-19T04:32:46.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-09-19T04:32:46.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-09-19T04:32:46.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-09-19T04:32:46.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-09-19T04:32:46.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-09-19T04:32:46.163 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-09-19T04:32:46.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-09-19T04:32:46.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-09-19T04:32:46.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-09-19T04:32:46.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-09-19T04:32:46.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-09-19T04:32:46.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-09-19T04:32:46.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-09-19T04:32:46.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-09-19T04:32:46.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-09-19T04:32:46.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-09-19T04:32:46.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-09-19T04:32:46.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-09-19T04:32:46.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-09-19T04:32:46.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-09-19T04:32:46.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-09-19T04:32:46.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-09-19T04:32:46.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-09-19T04:32:46.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-09-19T04:32:46.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-09-19T04:32:46.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-09-19T04:32:46.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-09-19T04:32:46.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-09-19T04:32:46.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-09-19T04:32:46.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-09-19T04:32:46.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-09-19T04:32:46.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-09-19T04:32:46.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-09-19T04:32:46.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-09-19T04:32:46.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-09-19T04:32:46.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-09-19T04:32:46.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-09-19T04:32:46.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-09-19T04:32:46.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-09-19T04:32:46.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-09-19T04:32:46.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-09-19T04:32:46.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-09-19T04:32:46.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-09-19T04:32:46.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-09-19T04:32:46.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-09-19T04:32:46.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-09-19T04:32:46.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-09-19T04:32:46.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-09-19T04:32:46.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-09-19T04:32:46.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-09-19T04:32:46.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-09-19T04:32:46.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-09-19T04:32:46.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-09-19T04:32:46.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-09-19T04:32:46.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-09-19T04:32:46.269 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-09-19T04:32:46.271 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-09-19T04:32:46.273 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-09-19T04:32:46.275 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-09-19T04:32:46.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-09-19T04:32:46.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-09-19T04:32:46.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-09-19T04:32:46.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-09-19T04:32:46.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-09-19T04:32:46.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-09-19T04:32:46.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-09-19T04:32:46.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-09-19T04:32:46.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-09-19T04:32:46.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-09-19T04:32:46.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-09-19T04:32:46.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-09-19T04:32:46.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-09-19T04:32:46.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-09-19T04:32:46.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-09-19T04:32:46.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-09-19T04:32:46.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-09-19T04:32:46.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-09-19T04:32:46.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-09-19T04:32:46.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-09-19T04:32:46.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-09-19T04:32:46.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-09-19T04:32:46.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-09-19T04:32:46.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-09-19T04:32:46.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-09-19T04:32:46.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-09-19T04:32:46.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-09-19T04:32:46.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-09-19T04:32:46.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-09-19T04:32:46.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-09-19T04:32:46.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-09-19T04:32:46.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-09-19T04:32:46.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-09-19T04:32:46.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-09-19T04:32:46.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-09-19T04:32:46.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-09-19T04:32:46.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-09-19T04:32:46.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-09-19T04:32:46.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-09-19T04:32:46.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-09-19T04:32:46.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-09-19T04:32:46.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-09-19T04:32:46.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-09-19T04:32:46.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-09-19T04:32:46.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-09-19T04:32:46.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-09-19T04:32:46.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-09-19T04:32:46.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-09-19T04:32:46.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-09-19T04:32:46.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-09-19T04:32:46.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-09-19T04:32:46.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-09-19T04:32:46.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-09-19T04:32:46.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-09-19T04:32:46.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-09-19T04:32:46.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-09-19T04:32:46.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-09-19T04:32:46.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-09-19T04:32:46.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-09-19T04:32:46.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-09-19T04:32:46.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-09-19T04:32:46.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-09-19T04:32:46.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-09-19T04:32:46.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-09-19T04:32:46.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-09-19T04:32:46.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-09-19T04:32:46.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-09-19T04:32:46.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-09-19T04:32:46.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-09-19T04:32:46.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-09-19T04:32:46.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-09-19T04:32:46.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-09-19T04:32:46.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-09-19T04:32:46.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-09-19T04:32:46.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-09-19T04:32:46.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-09-19T04:32:46.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-09-19T04:32:46.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-09-19T04:32:46.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-09-19T04:32:46.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-09-19T04:32:46.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-09-19T04:32:46.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-09-19T04:32:46.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-09-19T04:32:46.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-09-19T04:32:46.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-09-19T04:32:46.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-09-19T04:32:46.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-09-19T04:32:46.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-09-19T04:32:46.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-09-19T04:32:46.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-09-19T04:32:46.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-09-19T04:32:46.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-09-19T04:32:46.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-09-19T04:32:46.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-09-19T04:32:46.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-09-19T04:32:46.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-09-19T04:32:46.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-09-19T04:32:46.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-09-19T04:32:46.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-09-19T04:32:46.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-09-19T04:32:46.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-09-19T04:32:46.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-09-19T04:32:46.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-09-19T04:32:46.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-09-19T04:32:46.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-09-19T04:32:46.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-09-19T04:32:46.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-09-19T04:32:46.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-09-19T04:32:46.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-09-19T04:32:46.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-09-19T04:32:46.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-09-19T04:32:46.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-09-19T04:32:46.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-09-19T04:32:46.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-09-19T04:32:46.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-09-19T04:32:46.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-09-19T04:32:46.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-09-19T04:32:46.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-09-19T04:32:46.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-09-19T04:32:46.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-09-19T04:32:46.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-09-19T04:32:46.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-09-19T04:32:46.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-09-19T04:32:46.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-09-19T04:32:46.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-09-19T04:32:46.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-09-19T04:32:46.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-09-19T04:32:46.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-09-19T04:32:46.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-09-19T04:32:46.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-09-19T04:32:46.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-09-19T04:32:46.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-09-19T04:32:46.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-09-19T04:32:46.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-09-19T04:32:46.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-09-19T04:32:46.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-09-19T04:32:46.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-09-19T04:32:46.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-09-19T04:32:46.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-09-19T04:32:46.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-09-19T04:32:46.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-09-19T04:32:46.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-09-19T04:32:46.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-09-19T04:32:46.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-09-19T04:32:46.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-09-19T04:32:46.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-09-19T04:32:46.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-09-19T04:32:46.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-09-19T04:32:46.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-09-19T04:32:46.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-09-19T04:32:46.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-09-19T04:32:46.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-09-19T04:32:46.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-09-19T04:32:46.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-09-19T04:32:46.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-09-19T04:32:46.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-09-19T04:32:46.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-09-19T04:32:46.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-09-19T04:32:46.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-09-19T04:32:46.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-09-19T04:32:46.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-09-19T04:32:46.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-09-19T04:32:46.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-09-19T04:32:46.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-09-19T04:32:46.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-09-19T04:32:46.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-09-19T04:32:46.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-09-19T04:32:46.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-09-19T04:32:46.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-09-19T04:32:46.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-09-19T04:32:46.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-09-19T04:32:46.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-09-19T04:32:46.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-09-19T04:32:46.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-09-19T04:32:46.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-09-19T04:32:46.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-09-19T04:32:46.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-09-19T04:32:46.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-09-19T04:32:46.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-09-19T04:32:46.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-09-19T04:32:46.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-09-19T04:32:46.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-09-19T04:32:46.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-09-19T04:32:46.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-09-19T04:32:46.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-09-19T04:32:46.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-09-19T04:32:46.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-09-19T04:32:46.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-09-19T04:32:46.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-09-19T04:32:46.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-09-19T04:32:46.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-09-19T04:32:46.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-09-19T04:32:46.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-09-19T04:32:46.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-09-19T04:32:46.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-09-19T04:32:46.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-09-19T04:32:46.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-09-19T04:32:46.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-09-19T04:32:46.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-09-19T04:32:46.699 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-09-19T04:32:46.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-09-19T04:32:46.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-09-19T04:32:46.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-09-19T04:32:46.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-09-19T04:32:46.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-09-19T04:32:46.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-09-19T04:32:46.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-09-19T04:32:46.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-09-19T04:32:46.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-09-19T04:32:46.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-09-19T04:32:46.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-09-19T04:32:46.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-09-19T04:32:46.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-09-19T04:32:46.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-09-19T04:32:46.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-09-19T04:32:46.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-09-19T04:32:46.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-09-19T04:32:46.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-09-19T04:32:46.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-09-19T04:32:46.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-09-19T04:32:46.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-09-19T04:32:46.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-09-19T04:32:46.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-09-19T04:32:46.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-09-19T04:32:46.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-09-19T04:32:46.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-09-19T04:32:46.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-09-19T04:32:46.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-09-19T04:32:46.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-09-19T04:32:46.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-09-19T04:32:46.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-09-19T04:32:46.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-09-19T04:32:46.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-09-19T04:32:46.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-09-19T04:32:46.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-09-19T04:32:46.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-09-19T04:32:46.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-09-19T04:32:46.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-09-19T04:32:46.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-09-19T04:32:46.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-09-19T04:32:46.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-09-19T04:32:46.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-09-19T04:32:46.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-09-19T04:32:46.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-09-19T04:32:46.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-09-19T04:32:46.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-09-19T04:32:46.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-09-19T04:32:46.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-09-19T04:32:46.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-09-19T04:32:46.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-09-19T04:32:46.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-09-19T04:32:46.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-09-19T04:32:46.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-09-19T04:32:46.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-09-19T04:32:46.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-09-19T04:32:46.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-09-19T04:32:46.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-09-19T04:32:46.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-09-19T04:32:46.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-09-19T04:32:46.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-09-19T04:32:46.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-09-19T04:32:46.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-09-19T04:32:46.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-09-19T04:32:46.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-09-19T04:32:46.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-09-19T04:32:46.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-09-19T04:32:46.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-09-19T04:32:46.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-09-19T04:32:46.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-09-19T04:32:46.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-09-19T04:32:46.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-09-19T04:32:46.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-09-19T04:32:46.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-09-19T04:32:46.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-09-19T04:32:46.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-09-19T04:32:46.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-09-19T04:32:46.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-09-19T04:32:46.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-09-19T04:32:46.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-09-19T04:32:46.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-09-19T04:32:46.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-09-19T04:32:46.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-09-19T04:32:46.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-09-19T04:32:46.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-09-19T04:32:46.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-09-19T04:32:46.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-09-19T04:32:46.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-09-19T04:32:46.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-09-19T04:32:46.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-09-19T04:32:46.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-09-19T04:32:46.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-09-19T04:32:46.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-09-19T04:32:46.894 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:46 smithi070 ceph-mon[30942]: pgmap v63: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-19T04:32:46.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-09-19T04:32:46.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-09-19T04:32:46.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-09-19T04:32:46.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:46 smithi167 ceph-mon[34339]: pgmap v63: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-19T04:32:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:46 smithi134 ceph-mon[34525]: pgmap v63: 97 pgs: 97 active+clean; 84 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 37 KiB/s rd, 1.6 MiB/s wr, 46 op/s 2024-09-19T04:32:47.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-09-19T04:32:47.090 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-09-19T04:32:47.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-09-19T04:32:47.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-09-19T04:32:47.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-09-19T04:32:47.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-09-19T04:32:47.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-09-19T04:32:47.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-09-19T04:32:47.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-09-19T04:32:47.106 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-09-19T04:32:47.108 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-09-19T04:32:47.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-09-19T04:32:47.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-09-19T04:32:47.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-09-19T04:32:47.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-09-19T04:32:47.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-09-19T04:32:47.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-09-19T04:32:47.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-09-19T04:32:47.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-09-19T04:32:47.126 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-09-19T04:32:47.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-09-19T04:32:47.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-09-19T04:32:47.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-09-19T04:32:47.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-09-19T04:32:47.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-09-19T04:32:47.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-09-19T04:32:47.141 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-09-19T04:32:47.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-09-19T04:32:47.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-09-19T04:32:47.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-09-19T04:32:47.149 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-09-19T04:32:47.151 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-09-19T04:32:47.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-09-19T04:32:47.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-09-19T04:32:47.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-09-19T04:32:47.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-09-19T04:32:47.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-09-19T04:32:47.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-09-19T04:32:47.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-09-19T04:32:47.167 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-09-19T04:32:47.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-09-19T04:32:47.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-09-19T04:32:47.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-09-19T04:32:47.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-09-19T04:32:47.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-09-19T04:32:47.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-09-19T04:32:47.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-09-19T04:32:47.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-09-19T04:32:47.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-09-19T04:32:47.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-09-19T04:32:47.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-09-19T04:32:47.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-09-19T04:32:47.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-09-19T04:32:47.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-09-19T04:32:47.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-09-19T04:32:47.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-09-19T04:32:47.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-09-19T04:32:47.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-09-19T04:32:47.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-09-19T04:32:47.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-09-19T04:32:47.210 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-09-19T04:32:47.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-09-19T04:32:47.214 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-09-19T04:32:47.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-09-19T04:32:47.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-09-19T04:32:47.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-09-19T04:32:47.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-09-19T04:32:47.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-09-19T04:32:47.226 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-09-19T04:32:47.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-09-19T04:32:47.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-09-19T04:32:47.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-09-19T04:32:47.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-09-19T04:32:47.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-09-19T04:32:47.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-09-19T04:32:47.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-09-19T04:32:47.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-09-19T04:32:47.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-09-19T04:32:47.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-09-19T04:32:47.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-09-19T04:32:47.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-09-19T04:32:47.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-09-19T04:32:47.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-09-19T04:32:47.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-09-19T04:32:47.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-09-19T04:32:47.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-09-19T04:32:47.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-09-19T04:32:47.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-09-19T04:32:47.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-09-19T04:32:47.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-09-19T04:32:47.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-09-19T04:32:47.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-09-19T04:32:47.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-09-19T04:32:47.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-09-19T04:32:47.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-09-19T04:32:47.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-09-19T04:32:47.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-09-19T04:32:47.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-09-19T04:32:47.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-09-19T04:32:47.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-09-19T04:32:47.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-09-19T04:32:47.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-09-19T04:32:47.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-09-19T04:32:47.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-09-19T04:32:47.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-09-19T04:32:47.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-09-19T04:32:47.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-09-19T04:32:47.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-09-19T04:32:47.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-09-19T04:32:47.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-09-19T04:32:47.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-09-19T04:32:47.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-09-19T04:32:47.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-09-19T04:32:47.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-09-19T04:32:47.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-09-19T04:32:47.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-09-19T04:32:47.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-09-19T04:32:47.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-09-19T04:32:47.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-09-19T04:32:47.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-09-19T04:32:47.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-09-19T04:32:47.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-09-19T04:32:47.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-09-19T04:32:47.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-09-19T04:32:47.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-09-19T04:32:47.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-09-19T04:32:47.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-09-19T04:32:47.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-09-19T04:32:47.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-09-19T04:32:47.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-09-19T04:32:47.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-09-19T04:32:47.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-09-19T04:32:47.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-09-19T04:32:47.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-09-19T04:32:47.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-09-19T04:32:47.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-09-19T04:32:47.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-09-19T04:32:47.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-09-19T04:32:47.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-09-19T04:32:47.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-09-19T04:32:47.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-09-19T04:32:47.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-09-19T04:32:47.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-09-19T04:32:47.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-09-19T04:32:47.391 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-09-19T04:32:47.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-09-19T04:32:47.395 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-09-19T04:32:47.397 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-09-19T04:32:47.399 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-09-19T04:32:47.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-09-19T04:32:47.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-09-19T04:32:47.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-09-19T04:32:47.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-09-19T04:32:47.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-09-19T04:32:47.411 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-09-19T04:32:47.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-09-19T04:32:47.415 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-09-19T04:32:47.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-09-19T04:32:47.419 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-09-19T04:32:47.421 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-09-19T04:32:47.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-09-19T04:32:47.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-09-19T04:32:47.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-09-19T04:32:47.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-09-19T04:32:47.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-09-19T04:32:47.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-09-19T04:32:47.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-09-19T04:32:47.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-09-19T04:32:47.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-09-19T04:32:47.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-09-19T04:32:47.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-09-19T04:32:47.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-09-19T04:32:47.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-09-19T04:32:47.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-09-19T04:32:47.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-09-19T04:32:47.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-09-19T04:32:47.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-09-19T04:32:47.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-09-19T04:32:47.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-09-19T04:32:47.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-09-19T04:32:47.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-09-19T04:32:47.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-09-19T04:32:47.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-09-19T04:32:47.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-09-19T04:32:47.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-09-19T04:32:47.474 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-09-19T04:32:47.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-09-19T04:32:47.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-09-19T04:32:47.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-09-19T04:32:47.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-09-19T04:32:47.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-09-19T04:32:47.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-09-19T04:32:47.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-09-19T04:32:47.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-09-19T04:32:47.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-09-19T04:32:47.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-09-19T04:32:47.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-09-19T04:32:47.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-09-19T04:32:47.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-09-19T04:32:47.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-09-19T04:32:47.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-09-19T04:32:47.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-09-19T04:32:47.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-09-19T04:32:47.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-09-19T04:32:47.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-09-19T04:32:47.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-09-19T04:32:47.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-09-19T04:32:47.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-09-19T04:32:47.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-09-19T04:32:47.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-09-19T04:32:47.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-09-19T04:32:47.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-09-19T04:32:47.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-09-19T04:32:47.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-09-19T04:32:47.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-09-19T04:32:47.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-09-19T04:32:47.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-09-19T04:32:47.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-09-19T04:32:47.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-09-19T04:32:47.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-09-19T04:32:47.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-09-19T04:32:47.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-09-19T04:32:47.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-09-19T04:32:47.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-09-19T04:32:47.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-09-19T04:32:47.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-09-19T04:32:47.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-09-19T04:32:47.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-09-19T04:32:47.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-09-19T04:32:47.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-09-19T04:32:47.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-09-19T04:32:47.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-09-19T04:32:47.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-09-19T04:32:47.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-09-19T04:32:47.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-09-19T04:32:47.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-09-19T04:32:47.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-09-19T04:32:47.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-09-19T04:32:47.587 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-09-19T04:32:47.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-09-19T04:32:47.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-09-19T04:32:47.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-09-19T04:32:47.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-09-19T04:32:47.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-09-19T04:32:47.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-09-19T04:32:47.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-09-19T04:32:47.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-09-19T04:32:47.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-09-19T04:32:47.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-09-19T04:32:47.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-09-19T04:32:47.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-09-19T04:32:47.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-09-19T04:32:47.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-09-19T04:32:47.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-09-19T04:32:47.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-09-19T04:32:47.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-09-19T04:32:47.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-09-19T04:32:47.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-09-19T04:32:47.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-09-19T04:32:47.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-09-19T04:32:47.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-09-19T04:32:47.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-09-19T04:32:47.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-09-19T04:32:47.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-09-19T04:32:47.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-09-19T04:32:47.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-09-19T04:32:47.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-09-19T04:32:47.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-09-19T04:32:47.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-09-19T04:32:47.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-09-19T04:32:47.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-09-19T04:32:47.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-09-19T04:32:47.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-09-19T04:32:47.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-09-19T04:32:47.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-09-19T04:32:47.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-09-19T04:32:47.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-09-19T04:32:47.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-09-19T04:32:47.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-09-19T04:32:47.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-09-19T04:32:47.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-09-19T04:32:47.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-09-19T04:32:47.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-09-19T04:32:47.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-09-19T04:32:47.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-09-19T04:32:47.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-09-19T04:32:47.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-09-19T04:32:47.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-09-19T04:32:47.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-09-19T04:32:47.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-09-19T04:32:47.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-09-19T04:32:47.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-09-19T04:32:47.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-09-19T04:32:47.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-09-19T04:32:47.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-09-19T04:32:47.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-09-19T04:32:47.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-09-19T04:32:47.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-09-19T04:32:47.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-09-19T04:32:47.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-09-19T04:32:47.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-09-19T04:32:47.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-09-19T04:32:47.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-09-19T04:32:47.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-09-19T04:32:47.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-09-19T04:32:47.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-09-19T04:32:47.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-09-19T04:32:47.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-09-19T04:32:47.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-09-19T04:32:47.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-09-19T04:32:47.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-09-19T04:32:47.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-09-19T04:32:47.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-09-19T04:32:47.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-09-19T04:32:47.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-09-19T04:32:47.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-09-19T04:32:47.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-09-19T04:32:47.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-09-19T04:32:47.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-09-19T04:32:47.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-09-19T04:32:47.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-09-19T04:32:47.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-09-19T04:32:47.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-09-19T04:32:47.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-09-19T04:32:47.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-09-19T04:32:47.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-09-19T04:32:47.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-09-19T04:32:47.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-09-19T04:32:47.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-09-19T04:32:47.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-09-19T04:32:47.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-09-19T04:32:47.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-09-19T04:32:47.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-09-19T04:32:47.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-09-19T04:32:47.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-09-19T04:32:47.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-09-19T04:32:47.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-09-19T04:32:47.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-09-19T04:32:47.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-09-19T04:32:47.799 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-09-19T04:32:47.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-09-19T04:32:47.803 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-09-19T04:32:47.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-09-19T04:32:47.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-09-19T04:32:47.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-09-19T04:32:47.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-09-19T04:32:47.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-09-19T04:32:47.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-09-19T04:32:47.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-09-19T04:32:47.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-09-19T04:32:47.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-09-19T04:32:47.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-09-19T04:32:47.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-09-19T04:32:47.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-09-19T04:32:47.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-09-19T04:32:47.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-09-19T04:32:47.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-09-19T04:32:47.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-09-19T04:32:47.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-09-19T04:32:47.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-09-19T04:32:47.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-09-19T04:32:47.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-09-19T04:32:47.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-09-19T04:32:47.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-09-19T04:32:47.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-09-19T04:32:47.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-09-19T04:32:47.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-09-19T04:32:47.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-09-19T04:32:47.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-09-19T04:32:47.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-09-19T04:32:47.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-09-19T04:32:47.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-09-19T04:32:47.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-09-19T04:32:47.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-09-19T04:32:47.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-09-19T04:32:47.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-09-19T04:32:47.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-09-19T04:32:47.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-09-19T04:32:47.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-09-19T04:32:47.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-09-19T04:32:47.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-09-19T04:32:47.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-09-19T04:32:47.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-09-19T04:32:47.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-09-19T04:32:47.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-09-19T04:32:47.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-09-19T04:32:47.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-09-19T04:32:47.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-09-19T04:32:47.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-09-19T04:32:47.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-09-19T04:32:47.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-09-19T04:32:47.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-09-19T04:32:47.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-09-19T04:32:47.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-09-19T04:32:47.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-09-19T04:32:47.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-09-19T04:32:47.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-09-19T04:32:47.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-09-19T04:32:47.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-09-19T04:32:47.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-09-19T04:32:47.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-09-19T04:32:47.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-09-19T04:32:47.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-09-19T04:32:47.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-09-19T04:32:47.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-09-19T04:32:47.953 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-09-19T04:32:47.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-09-19T04:32:47.957 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-09-19T04:32:47.959 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-09-19T04:32:47.961 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-09-19T04:32:47.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-09-19T04:32:47.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-09-19T04:32:47.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-09-19T04:32:47.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-09-19T04:32:47.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-09-19T04:32:47.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-09-19T04:32:47.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-09-19T04:32:47.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-09-19T04:32:47.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-09-19T04:32:47.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-09-19T04:32:47.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-09-19T04:32:47.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-09-19T04:32:47.988 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-09-19T04:32:47.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-09-19T04:32:47.992 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-09-19T04:32:47.994 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-09-19T04:32:47.996 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-09-19T04:32:47.998 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-09-19T04:32:48.000 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-09-19T04:32:48.002 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-09-19T04:32:48.004 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-09-19T04:32:48.006 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-09-19T04:32:48.008 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-09-19T04:32:48.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-09-19T04:32:48.013 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-09-19T04:32:48.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-09-19T04:32:48.019 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-09-19T04:32:48.021 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-09-19T04:32:48.023 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-09-19T04:32:48.025 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-09-19T04:32:48.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-09-19T04:32:48.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-09-19T04:32:48.032 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-09-19T04:32:48.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-09-19T04:32:48.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-09-19T04:32:48.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-09-19T04:32:48.040 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-09-19T04:32:48.042 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-09-19T04:32:48.044 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-09-19T04:32:48.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-09-19T04:32:48.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-09-19T04:32:48.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-09-19T04:32:48.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-09-19T04:32:48.055 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-09-19T04:32:48.057 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-09-19T04:32:48.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-09-19T04:32:48.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-09-19T04:32:48.063 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-09-19T04:32:48.065 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-09-19T04:32:48.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-09-19T04:32:48.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-09-19T04:32:48.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-09-19T04:32:48.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-09-19T04:32:48.075 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-09-19T04:32:48.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-09-19T04:32:48.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-09-19T04:32:48.082 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-09-19T04:32:48.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-09-19T04:32:48.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-09-19T04:32:48.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-09-19T04:32:48.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-09-19T04:32:48.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-09-19T04:32:48.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-09-19T04:32:48.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-09-19T04:32:48.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-09-19T04:32:48.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-09-19T04:32:48.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-09-19T04:32:48.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-09-19T04:32:48.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-09-19T04:32:48.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-09-19T04:32:48.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-09-19T04:32:48.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-09-19T04:32:48.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-09-19T04:32:48.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-09-19T04:32:48.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-09-19T04:32:48.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-09-19T04:32:48.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-09-19T04:32:48.124 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-09-19T04:32:48.127 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-09-19T04:32:48.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-09-19T04:32:48.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-09-19T04:32:48.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-09-19T04:32:48.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-09-19T04:32:48.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-09-19T04:32:48.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-09-19T04:32:48.143 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-09-19T04:32:48.145 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-09-19T04:32:48.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-09-19T04:32:48.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-09-19T04:32:48.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-09-19T04:32:48.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-09-19T04:32:48.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-09-19T04:32:48.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-09-19T04:32:48.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-09-19T04:32:48.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-09-19T04:32:48.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-09-19T04:32:48.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-09-19T04:32:48.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-09-19T04:32:48.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-09-19T04:32:48.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-09-19T04:32:48.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-09-19T04:32:48.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-09-19T04:32:48.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-09-19T04:32:48.183 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-09-19T04:32:48.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-09-19T04:32:48.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-09-19T04:32:48.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-09-19T04:32:48.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-09-19T04:32:48.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-09-19T04:32:48.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-09-19T04:32:48.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-09-19T04:32:48.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-09-19T04:32:48.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-09-19T04:32:48.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-09-19T04:32:48.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-09-19T04:32:48.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-09-19T04:32:48.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-09-19T04:32:48.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-09-19T04:32:48.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-09-19T04:32:48.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-09-19T04:32:48.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-09-19T04:32:48.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-09-19T04:32:48.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-09-19T04:32:48.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-09-19T04:32:48.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-09-19T04:32:48.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-09-19T04:32:48.233 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-09-19T04:32:48.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-09-19T04:32:48.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-09-19T04:32:48.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-09-19T04:32:48.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-09-19T04:32:48.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-09-19T04:32:48.245 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-09-19T04:32:48.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-09-19T04:32:48.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-09-19T04:32:48.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-09-19T04:32:48.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-09-19T04:32:48.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-09-19T04:32:48.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-09-19T04:32:48.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-09-19T04:32:48.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-09-19T04:32:48.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-09-19T04:32:48.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-09-19T04:32:48.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-09-19T04:32:48.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-09-19T04:32:48.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-09-19T04:32:48.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-09-19T04:32:48.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-09-19T04:32:48.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-09-19T04:32:48.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-09-19T04:32:48.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-09-19T04:32:48.284 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-09-19T04:32:48.286 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-09-19T04:32:48.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-09-19T04:32:48.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-09-19T04:32:48.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-09-19T04:32:48.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-09-19T04:32:48.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-09-19T04:32:48.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-09-19T04:32:48.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-09-19T04:32:48.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-09-19T04:32:48.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-09-19T04:32:48.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-09-19T04:32:48.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-09-19T04:32:48.311 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-09-19T04:32:48.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-09-19T04:32:48.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-09-19T04:32:48.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-09-19T04:32:48.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-09-19T04:32:48.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-09-19T04:32:48.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-09-19T04:32:48.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-09-19T04:32:48.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-09-19T04:32:48.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-09-19T04:32:48.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-09-19T04:32:48.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-09-19T04:32:48.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-09-19T04:32:48.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-09-19T04:32:48.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-09-19T04:32:48.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-09-19T04:32:48.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-09-19T04:32:48.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-09-19T04:32:48.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-09-19T04:32:48.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-09-19T04:32:48.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-09-19T04:32:48.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-09-19T04:32:48.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-09-19T04:32:48.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-09-19T04:32:48.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-09-19T04:32:48.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-09-19T04:32:48.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-09-19T04:32:48.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-09-19T04:32:48.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-09-19T04:32:48.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-09-19T04:32:48.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-09-19T04:32:48.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-09-19T04:32:48.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-09-19T04:32:48.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-09-19T04:32:48.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-09-19T04:32:48.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-09-19T04:32:48.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-09-19T04:32:48.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-09-19T04:32:48.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-09-19T04:32:48.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-09-19T04:32:48.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-09-19T04:32:48.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-09-19T04:32:48.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-09-19T04:32:48.404 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-09-19T04:32:48.406 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-09-19T04:32:48.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-09-19T04:32:48.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-09-19T04:32:48.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-09-19T04:32:48.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-09-19T04:32:48.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-09-19T04:32:48.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-09-19T04:32:48.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-09-19T04:32:48.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-09-19T04:32:48.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-09-19T04:32:48.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-09-19T04:32:48.428 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-09-19T04:32:48.430 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-09-19T04:32:48.432 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-09-19T04:32:48.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-09-19T04:32:48.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-09-19T04:32:48.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-09-19T04:32:48.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-09-19T04:32:48.442 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-09-19T04:32:48.444 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-09-19T04:32:48.446 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-09-19T04:32:48.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-09-19T04:32:48.450 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-09-19T04:32:48.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-09-19T04:32:48.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-09-19T04:32:48.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-09-19T04:32:48.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-09-19T04:32:48.461 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-09-19T04:32:48.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-09-19T04:32:48.465 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-09-19T04:32:48.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-09-19T04:32:48.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-09-19T04:32:48.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-09-19T04:32:48.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-09-19T04:32:48.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-09-19T04:32:48.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-09-19T04:32:48.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-09-19T04:32:48.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-09-19T04:32:48.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-09-19T04:32:48.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-09-19T04:32:48.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-09-19T04:32:48.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-09-19T04:32:48.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-09-19T04:32:48.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-09-19T04:32:48.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-09-19T04:32:48.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-09-19T04:32:48.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-09-19T04:32:48.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-09-19T04:32:48.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-09-19T04:32:48.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-09-19T04:32:48.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-09-19T04:32:48.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-09-19T04:32:48.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-09-19T04:32:48.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-09-19T04:32:48.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-09-19T04:32:48.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-09-19T04:32:48.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-09-19T04:32:48.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-09-19T04:32:48.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-09-19T04:32:48.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-09-19T04:32:48.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-09-19T04:32:48.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-09-19T04:32:48.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-09-19T04:32:48.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-09-19T04:32:48.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-09-19T04:32:48.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-09-19T04:32:48.542 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-09-19T04:32:48.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-09-19T04:32:48.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-09-19T04:32:48.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-09-19T04:32:48.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-09-19T04:32:48.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-09-19T04:32:48.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-09-19T04:32:48.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-09-19T04:32:48.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-09-19T04:32:48.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-09-19T04:32:48.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-09-19T04:32:48.566 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-09-19T04:32:48.568 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-09-19T04:32:48.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-09-19T04:32:48.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-09-19T04:32:48.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-09-19T04:32:48.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-09-19T04:32:48.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-09-19T04:32:48.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-09-19T04:32:48.583 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-09-19T04:32:48.585 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-09-19T04:32:48.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-09-19T04:32:48.589 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-09-19T04:32:48.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-09-19T04:32:48.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-09-19T04:32:48.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-09-19T04:32:48.597 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-09-19T04:32:48.599 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-09-19T04:32:48.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-09-19T04:32:48.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-09-19T04:32:48.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-09-19T04:32:48.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-09-19T04:32:48.609 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-09-19T04:32:48.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-09-19T04:32:48.613 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-09-19T04:32:48.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-09-19T04:32:48.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-09-19T04:32:48.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-09-19T04:32:48.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-09-19T04:32:48.625 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-09-19T04:32:48.627 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-09-19T04:32:48.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-09-19T04:32:48.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-09-19T04:32:48.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-09-19T04:32:48.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-09-19T04:32:48.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-09-19T04:32:48.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-09-19T04:32:48.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-09-19T04:32:48.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-09-19T04:32:48.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-09-19T04:32:48.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-09-19T04:32:48.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-09-19T04:32:48.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-09-19T04:32:48.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-09-19T04:32:48.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-09-19T04:32:48.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-09-19T04:32:48.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-09-19T04:32:48.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-09-19T04:32:48.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-09-19T04:32:48.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-09-19T04:32:48.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-09-19T04:32:48.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-09-19T04:32:48.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-09-19T04:32:48.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-09-19T04:32:48.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-09-19T04:32:48.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-09-19T04:32:48.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-09-19T04:32:48.684 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-09-19T04:32:48.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-09-19T04:32:48.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-09-19T04:32:48.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-09-19T04:32:48.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-09-19T04:32:48.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-09-19T04:32:48.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-09-19T04:32:48.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-09-19T04:32:48.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-09-19T04:32:48.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-09-19T04:32:48.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-09-19T04:32:48.705 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-09-19T04:32:48.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-09-19T04:32:48.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-09-19T04:32:48.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-09-19T04:32:48.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-09-19T04:32:48.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-09-19T04:32:48.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-09-19T04:32:48.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-09-19T04:32:48.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-09-19T04:32:48.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-09-19T04:32:48.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-09-19T04:32:48.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-09-19T04:32:48.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-09-19T04:32:48.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-09-19T04:32:48.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-09-19T04:32:48.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-09-19T04:32:48.738 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-09-19T04:32:48.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-09-19T04:32:48.742 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-09-19T04:32:48.744 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-09-19T04:32:48.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-09-19T04:32:48.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-09-19T04:32:48.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-09-19T04:32:48.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-09-19T04:32:48.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-09-19T04:32:48.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-09-19T04:32:48.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-09-19T04:32:48.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-09-19T04:32:48.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-09-19T04:32:48.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-09-19T04:32:48.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-09-19T04:32:48.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-09-19T04:32:48.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-09-19T04:32:48.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-09-19T04:32:48.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-09-19T04:32:48.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-09-19T04:32:48.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-09-19T04:32:48.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-09-19T04:32:48.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-09-19T04:32:48.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-09-19T04:32:48.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-09-19T04:32:48.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-09-19T04:32:48.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-09-19T04:32:48.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-09-19T04:32:48.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-09-19T04:32:48.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-09-19T04:32:48.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-09-19T04:32:48.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-09-19T04:32:48.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-09-19T04:32:48.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-09-19T04:32:48.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-09-19T04:32:48.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-09-19T04:32:48.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-09-19T04:32:48.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-09-19T04:32:48.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-09-19T04:32:48.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-09-19T04:32:48.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-09-19T04:32:48.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-09-19T04:32:48.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-09-19T04:32:48.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-09-19T04:32:48.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-09-19T04:32:48.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-09-19T04:32:48.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-09-19T04:32:48.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-09-19T04:32:48.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-09-19T04:32:48.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-09-19T04:32:48.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-09-19T04:32:48.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-09-19T04:32:48.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-09-19T04:32:48.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-09-19T04:32:48.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-09-19T04:32:48.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-09-19T04:32:48.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-09-19T04:32:48.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-09-19T04:32:48.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-09-19T04:32:48.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-09-19T04:32:48.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-09-19T04:32:48.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-09-19T04:32:48.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-09-19T04:32:48.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-09-19T04:32:48.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-09-19T04:32:48.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-09-19T04:32:48.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-09-19T04:32:48.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-09-19T04:32:48.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-09-19T04:32:48.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-09-19T04:32:48.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-09-19T04:32:48.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-09-19T04:32:48.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-09-19T04:32:48.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-09-19T04:32:48.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-09-19T04:32:48.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-09-19T04:32:48.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-09-19T04:32:48.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-09-19T04:32:48.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-09-19T04:32:48.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-09-19T04:32:48.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-09-19T04:32:48.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-09-19T04:32:48.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-09-19T04:32:48.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-09-19T04:32:48.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-09-19T04:32:48.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-09-19T04:32:48.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-09-19T04:32:48.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-09-19T04:32:48.922 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-09-19T04:32:48.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-09-19T04:32:48.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-09-19T04:32:48.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-09-19T04:32:48.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-09-19T04:32:48.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-09-19T04:32:48.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-09-19T04:32:48.938 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-09-19T04:32:48.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-09-19T04:32:48.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-09-19T04:32:48.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-09-19T04:32:48.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-09-19T04:32:48.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-09-19T04:32:48.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-09-19T04:32:48.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-09-19T04:32:48.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-09-19T04:32:48.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-09-19T04:32:48.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-09-19T04:32:48.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-09-19T04:32:48.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-09-19T04:32:48.966 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-09-19T04:32:48.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-09-19T04:32:48.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-09-19T04:32:48.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-09-19T04:32:48.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-09-19T04:32:48.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-09-19T04:32:48.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-09-19T04:32:48.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-09-19T04:32:48.983 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-09-19T04:32:48.985 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-09-19T04:32:48.987 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-09-19T04:32:48.989 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-09-19T04:32:48.991 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-09-19T04:32:48.993 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-09-19T04:32:48.995 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-09-19T04:32:48.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-09-19T04:32:48.999 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-09-19T04:32:49.001 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-09-19T04:32:49.003 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-09-19T04:32:49.005 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-09-19T04:32:49.007 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-09-19T04:32:49.009 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-09-19T04:32:49.012 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-09-19T04:32:49.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-09-19T04:32:49.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-09-19T04:32:49.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-09-19T04:32:49.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-09-19T04:32:49.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-09-19T04:32:49.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-09-19T04:32:49.026 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-09-19T04:32:49.028 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-09-19T04:32:49.030 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-09-19T04:32:49.033 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-09-19T04:32:49.035 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-09-19T04:32:49.038 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-09-19T04:32:49.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-09-19T04:32:49.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-09-19T04:32:49.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-09-19T04:32:49.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-09-19T04:32:49.051 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-09-19T04:32:49.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-09-19T04:32:49.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-09-19T04:32:49.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-09-19T04:32:49.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-09-19T04:32:49.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-09-19T04:32:49.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-09-19T04:32:49.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-09-19T04:32:49.072 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-09-19T04:32:49.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-09-19T04:32:49.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-09-19T04:32:49.079 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-09-19T04:32:49.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-09-19T04:32:49.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-09-19T04:32:49.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-09-19T04:32:49.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-09-19T04:32:49.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-09-19T04:32:49.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-09-19T04:32:49.093 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-09-19T04:32:49.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-09-19T04:32:49.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-09-19T04:32:49.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-09-19T04:32:49.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-09-19T04:32:49.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-09-19T04:32:49.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-09-19T04:32:49.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-09-19T04:32:49.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-09-19T04:32:49.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-09-19T04:32:49.114 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-09-19T04:32:49.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-09-19T04:32:49.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-09-19T04:32:49.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-09-19T04:32:49.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-09-19T04:32:49.123 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-09-19T04:32:49.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-09-19T04:32:49.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-09-19T04:32:49.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-09-19T04:32:49.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-09-19T04:32:49.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-09-19T04:32:49.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-09-19T04:32:49.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-09-19T04:32:49.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-09-19T04:32:49.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-09-19T04:32:49.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-09-19T04:32:49.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-09-19T04:32:49.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-09-19T04:32:49.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-09-19T04:32:49.154 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-09-19T04:32:49.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-09-19T04:32:49.158 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-09-19T04:32:49.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-09-19T04:32:49.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-09-19T04:32:49.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-09-19T04:32:49.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-09-19T04:32:49.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-09-19T04:32:49.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-09-19T04:32:49.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-09-19T04:32:49.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-09-19T04:32:49.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-09-19T04:32:49.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-09-19T04:32:49.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-09-19T04:32:49.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-09-19T04:32:49.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-09-19T04:32:49.188 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-09-19T04:32:49.190 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-09-19T04:32:49.192 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-09-19T04:32:49.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-09-19T04:32:49.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-09-19T04:32:49.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-09-19T04:32:49.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-09-19T04:32:49.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-09-19T04:32:49.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-09-19T04:32:49.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-09-19T04:32:49.212 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-09-19T04:32:49.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-09-19T04:32:49.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-09-19T04:32:49.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-09-19T04:32:49.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-09-19T04:32:49.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-09-19T04:32:49.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-09-19T04:32:49.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-09-19T04:32:49.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-09-19T04:32:49.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-09-19T04:32:49.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-09-19T04:32:49.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-09-19T04:32:49.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-09-19T04:32:49.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-09-19T04:32:49.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-09-19T04:32:49.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-09-19T04:32:49.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-09-19T04:32:49.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-09-19T04:32:49.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-09-19T04:32:49.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-09-19T04:32:49.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-09-19T04:32:49.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-09-19T04:32:49.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-09-19T04:32:49.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-09-19T04:32:49.615 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-09-19T04:32:49.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-09-19T04:32:49.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-09-19T04:32:49.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-09-19T04:32:49.629 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-09-19T04:32:49.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-09-19T04:32:49.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-09-19T04:32:49.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-09-19T04:32:49.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-09-19T04:32:49.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-09-19T04:32:49.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-09-19T04:32:49.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-09-19T04:32:49.646 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-09-19T04:32:49.648 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-09-19T04:32:49.650 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-09-19T04:32:49.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-09-19T04:32:49.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-09-19T04:32:49.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-09-19T04:32:49.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-09-19T04:32:49.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-09-19T04:32:49.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-09-19T04:32:49.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-09-19T04:32:49.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-09-19T04:32:49.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-09-19T04:32:49.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-09-19T04:32:49.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-09-19T04:32:49.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-09-19T04:32:49.677 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-09-19T04:32:49.679 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-09-19T04:32:49.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-09-19T04:32:49.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-09-19T04:32:49.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-09-19T04:32:49.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-09-19T04:32:49.689 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-09-19T04:32:49.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-09-19T04:32:49.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-09-19T04:32:49.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-09-19T04:32:49.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-09-19T04:32:49.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-09-19T04:32:49.701 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-09-19T04:32:49.703 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-09-19T04:32:49.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-09-19T04:32:49.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-09-19T04:32:49.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-09-19T04:32:49.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-09-19T04:32:49.715 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-09-19T04:32:49.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-09-19T04:32:49.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/digsig.txt 2024-09-19T04:32:49.721 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-09-19T04:32:49.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-09-19T04:32:49.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-09-19T04:32:49.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-09-19T04:32:49.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-09-19T04:32:49.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-09-19T04:32:49.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dontdiff 2024-09-19T04:32:49.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/ 2024-09-19T04:32:49.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-09-19T04:32:49.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-09-19T04:32:49.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-09-19T04:32:49.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-09-19T04:32:49.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-09-19T04:32:49.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-09-19T04:32:49.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-09-19T04:32:49.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-09-19T04:32:49.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-09-19T04:32:49.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-09-19T04:32:49.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ 2024-09-19T04:32:49.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-09-19T04:32:49.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-09-19T04:32:49.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-09-19T04:32:49.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-09-19T04:32:49.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-09-19T04:32:49.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-09-19T04:32:49.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-09-19T04:32:49.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-09-19T04:32:49.776 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-09-19T04:32:49.778 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-09-19T04:32:49.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-09-19T04:32:49.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-09-19T04:32:49.784 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-09-19T04:32:49.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-09-19T04:32:49.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-09-19T04:32:49.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-09-19T04:32:49.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-09-19T04:32:49.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-09-19T04:32:49.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/edac.txt 2024-09-19T04:32:49.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-09-19T04:32:49.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/eisa.txt 2024-09-19T04:32:49.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-09-19T04:32:49.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/extcon/ 2024-09-19T04:32:49.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-09-19T04:32:49.807 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-09-19T04:32:49.809 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-09-19T04:32:49.811 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-09-19T04:32:49.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-09-19T04:32:49.815 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/ 2024-09-19T04:32:49.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-09-19T04:32:49.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-09-19T04:32:49.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-09-19T04:32:49.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-09-19T04:32:49.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-09-19T04:32:49.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-09-19T04:32:49.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-09-19T04:32:49.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-09-19T04:32:49.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-09-19T04:32:49.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-09-19T04:32:49.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-09-19T04:32:49.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-09-19T04:32:49.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-09-19T04:32:49.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-09-19T04:32:49.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-09-19T04:32:49.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-09-19T04:32:49.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-09-19T04:32:49.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-09-19T04:32:49.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-09-19T04:32:49.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-09-19T04:32:49.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-09-19T04:32:49.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-09-19T04:32:49.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-09-19T04:32:49.865 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-09-19T04:32:49.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-09-19T04:32:49.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-09-19T04:32:49.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-09-19T04:32:49.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-09-19T04:32:49.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-09-19T04:32:49.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-09-19T04:32:49.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-09-19T04:32:49.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-09-19T04:32:49.882 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-09-19T04:32:49.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-09-19T04:32:49.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-09-19T04:32:49.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ 2024-09-19T04:32:49.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-09-19T04:32:49.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-09-19T04:32:49.894 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:49 smithi070 ceph-mon[30942]: pgmap v64: 97 pgs: 97 active+clean; 91 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 2.2 MiB/s wr, 145 op/s 2024-09-19T04:32:49.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-09-19T04:32:49.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-09-19T04:32:49.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-09-19T04:32:49.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-09-19T04:32:49.902 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-09-19T04:32:49.904 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-09-19T04:32:49.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-09-19T04:32:49.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-09-19T04:32:49.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-09-19T04:32:49.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-09-19T04:32:49.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-09-19T04:32:49.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-09-19T04:32:49.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-09-19T04:32:49.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-09-19T04:32:49.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-09-19T04:32:49.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-09-19T04:32:49.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:49 smithi167 ceph-mon[34339]: pgmap v64: 97 pgs: 97 active+clean; 91 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 2.2 MiB/s wr, 145 op/s 2024-09-19T04:32:50.011 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-09-19T04:32:50.014 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-09-19T04:32:50.016 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-09-19T04:32:50.018 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-09-19T04:32:50.020 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-09-19T04:32:50.022 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-09-19T04:32:50.024 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-09-19T04:32:50.027 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-09-19T04:32:50.029 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-09-19T04:32:50.031 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-09-19T04:32:50.034 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-09-19T04:32:50.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:49 smithi134 ceph-mon[34525]: pgmap v64: 97 pgs: 97 active+clean; 91 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 244 KiB/s rd, 2.2 MiB/s wr, 145 op/s 2024-09-19T04:32:50.036 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-09-19T04:32:50.039 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-09-19T04:32:50.041 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-09-19T04:32:50.043 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-09-19T04:32:50.046 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-09-19T04:32:50.048 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-09-19T04:32:50.050 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-09-19T04:32:50.053 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-09-19T04:32:50.054 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-09-19T04:32:50.056 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-09-19T04:32:50.058 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-09-19T04:32:50.060 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-09-19T04:32:50.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-09-19T04:32:50.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-09-19T04:32:50.066 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-09-19T04:32:50.067 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-09-19T04:32:50.069 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-09-19T04:32:50.071 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-09-19T04:32:50.074 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-09-19T04:32:50.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-09-19T04:32:50.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-09-19T04:32:50.080 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-09-19T04:32:50.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-09-19T04:32:50.085 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-09-19T04:32:50.087 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-09-19T04:32:50.089 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-09-19T04:32:50.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-09-19T04:32:50.092 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-09-19T04:32:50.094 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-09-19T04:32:50.096 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-09-19T04:32:50.098 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-09-19T04:32:50.100 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-09-19T04:32:50.102 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-09-19T04:32:50.104 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-09-19T04:32:50.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-09-19T04:32:50.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-09-19T04:32:50.110 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-09-19T04:32:50.112 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-09-19T04:32:50.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-09-19T04:32:50.115 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-09-19T04:32:50.117 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-09-19T04:32:50.119 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-09-19T04:32:50.121 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-09-19T04:32:50.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-09-19T04:32:50.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-09-19T04:32:50.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-09-19T04:32:50.129 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-09-19T04:32:50.131 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-09-19T04:32:50.133 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-09-19T04:32:50.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-09-19T04:32:50.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-09-19T04:32:50.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-09-19T04:32:50.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-09-19T04:32:50.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-09-19T04:32:50.147 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-09-19T04:32:50.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-09-19T04:32:50.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-09-19T04:32:50.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-09-19T04:32:50.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-09-19T04:32:50.156 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-09-19T04:32:50.158 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-09-19T04:32:50.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-09-19T04:32:50.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-09-19T04:32:50.165 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-09-19T04:32:50.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-09-19T04:32:50.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-09-19T04:32:50.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-09-19T04:32:50.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-09-19T04:32:50.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-09-19T04:32:50.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-09-19T04:32:50.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-09-19T04:32:50.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-09-19T04:32:50.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-09-19T04:32:50.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-09-19T04:32:50.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-09-19T04:32:50.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-09-19T04:32:50.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-09-19T04:32:50.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-09-19T04:32:50.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-09-19T04:32:50.202 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-09-19T04:32:50.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-09-19T04:32:50.206 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-09-19T04:32:50.208 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-09-19T04:32:50.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-09-19T04:32:50.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-09-19T04:32:50.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-09-19T04:32:50.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-09-19T04:32:50.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-09-19T04:32:50.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-09-19T04:32:50.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-09-19T04:32:50.228 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/ 2024-09-19T04:32:50.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-09-19T04:32:50.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-09-19T04:32:50.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-09-19T04:32:50.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-09-19T04:32:50.237 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-09-19T04:32:50.239 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-09-19T04:32:50.241 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-09-19T04:32:50.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-09-19T04:32:50.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-09-19T04:32:50.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-09-19T04:32:50.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-09-19T04:32:50.250 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/ 2024-09-19T04:32:50.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-09-19T04:32:50.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-09-19T04:32:50.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-09-19T04:32:50.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-09-19T04:32:50.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-09-19T04:32:50.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-09-19T04:32:50.263 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-09-19T04:32:50.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-09-19T04:32:50.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-09-19T04:32:50.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-09-19T04:32:50.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-09-19T04:32:50.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gcov.txt 2024-09-19T04:32:50.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-09-19T04:32:50.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/ 2024-09-19T04:32:50.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-09-19T04:32:50.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-09-19T04:32:50.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-09-19T04:32:50.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-09-19T04:32:50.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-09-19T04:32:50.290 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-09-19T04:32:50.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-09-19T04:32:50.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/ 2024-09-19T04:32:50.295 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-09-19T04:32:50.297 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-09-19T04:32:50.299 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-09-19T04:32:50.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-09-19T04:32:50.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-09-19T04:32:50.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/highuid.txt 2024-09-19T04:32:50.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hsi.txt 2024-09-19T04:32:50.309 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-09-19T04:32:50.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ 2024-09-19T04:32:50.313 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-09-19T04:32:50.315 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-09-19T04:32:50.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-09-19T04:32:50.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-09-19T04:32:50.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-09-19T04:32:50.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-09-19T04:32:50.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-09-19T04:32:50.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-09-19T04:32:50.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-09-19T04:32:50.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-09-19T04:32:50.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-09-19T04:32:50.334 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-09-19T04:32:50.336 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-09-19T04:32:50.338 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-09-19T04:32:50.340 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-09-19T04:32:50.342 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-09-19T04:32:50.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-09-19T04:32:50.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-09-19T04:32:50.347 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-09-19T04:32:50.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-09-19T04:32:50.352 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-09-19T04:32:50.354 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-09-19T04:32:50.356 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-09-19T04:32:50.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-09-19T04:32:50.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-09-19T04:32:50.362 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-09-19T04:32:50.364 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-09-19T04:32:50.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-09-19T04:32:50.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-09-19T04:32:50.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-09-19T04:32:50.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-09-19T04:32:50.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-09-19T04:32:50.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-09-19T04:32:50.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-09-19T04:32:50.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-09-19T04:32:50.383 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-09-19T04:32:50.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-09-19T04:32:50.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-09-19T04:32:50.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-09-19T04:32:50.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-09-19T04:32:50.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-09-19T04:32:50.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-09-19T04:32:50.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-09-19T04:32:50.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-09-19T04:32:50.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-09-19T04:32:50.402 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-09-19T04:32:50.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-09-19T04:32:50.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-09-19T04:32:50.409 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-09-19T04:32:50.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-09-19T04:32:50.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-09-19T04:32:50.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-09-19T04:32:50.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-09-19T04:32:50.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-09-19T04:32:50.422 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-09-19T04:32:50.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-09-19T04:32:50.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-09-19T04:32:50.427 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-09-19T04:32:50.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-09-19T04:32:50.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-09-19T04:32:50.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-09-19T04:32:50.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-09-19T04:32:50.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-09-19T04:32:50.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-09-19T04:32:50.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-09-19T04:32:50.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-09-19T04:32:50.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-09-19T04:32:50.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-09-19T04:32:50.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-09-19T04:32:50.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-09-19T04:32:50.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-09-19T04:32:50.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-09-19T04:32:50.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-09-19T04:32:50.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-09-19T04:32:50.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-09-19T04:32:50.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-09-19T04:32:50.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-09-19T04:32:50.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-09-19T04:32:50.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-09-19T04:32:50.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-09-19T04:32:50.471 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-09-19T04:32:50.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-09-19T04:32:50.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-09-19T04:32:50.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-09-19T04:32:50.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-09-19T04:32:50.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-09-19T04:32:50.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-09-19T04:32:50.484 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-09-19T04:32:50.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-09-19T04:32:50.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-09-19T04:32:50.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-09-19T04:32:50.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-09-19T04:32:50.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-09-19T04:32:50.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-09-19T04:32:50.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-09-19T04:32:50.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-09-19T04:32:50.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-09-19T04:32:50.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-09-19T04:32:50.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-09-19T04:32:50.508 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-09-19T04:32:50.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-09-19T04:32:50.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-09-19T04:32:50.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-09-19T04:32:50.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-09-19T04:32:50.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-09-19T04:32:50.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-09-19T04:32:50.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-09-19T04:32:50.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-09-19T04:32:50.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-09-19T04:32:50.528 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-09-19T04:32:50.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-09-19T04:32:50.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-09-19T04:32:50.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-09-19T04:32:50.536 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-09-19T04:32:50.538 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-09-19T04:32:50.540 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-09-19T04:32:50.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-09-19T04:32:50.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-09-19T04:32:50.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-09-19T04:32:50.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-09-19T04:32:50.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-09-19T04:32:50.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-09-19T04:32:50.553 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-09-19T04:32:50.555 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-09-19T04:32:50.557 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-09-19T04:32:50.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-09-19T04:32:50.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-09-19T04:32:50.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-09-19T04:32:50.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-09-19T04:32:50.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-09-19T04:32:50.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-09-19T04:32:50.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-09-19T04:32:50.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-09-19T04:32:50.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-09-19T04:32:50.578 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-09-19T04:32:50.580 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-09-19T04:32:50.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-09-19T04:32:50.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/ 2024-09-19T04:32:50.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-09-19T04:32:50.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-09-19T04:32:50.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-09-19T04:32:50.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-09-19T04:32:50.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-09-19T04:32:50.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-09-19T04:32:50.600 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-09-19T04:32:50.602 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-09-19T04:32:50.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-09-19T04:32:50.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-09-19T04:32:50.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-09-19T04:32:50.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-09-19T04:32:50.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-09-19T04:32:50.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-09-19T04:32:50.616 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-09-19T04:32:50.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-09-19T04:32:50.620 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-09-19T04:32:50.622 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-09-19T04:32:50.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-09-19T04:32:50.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-09-19T04:32:50.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-09-19T04:32:50.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-09-19T04:32:50.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-09-19T04:32:50.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-09-19T04:32:50.637 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-09-19T04:32:50.639 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-09-19T04:32:50.641 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-09-19T04:32:50.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-09-19T04:32:50.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-09-19T04:32:50.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-09-19T04:32:50.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-09-19T04:32:50.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-09-19T04:32:50.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/summary 2024-09-19T04:32:50.655 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-09-19T04:32:50.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-09-19T04:32:50.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-09-19T04:32:50.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/ 2024-09-19T04:32:50.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/README 2024-09-19T04:32:50.665 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-09-19T04:32:50.667 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/ 2024-09-19T04:32:50.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-09-19T04:32:50.672 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-09-19T04:32:50.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-09-19T04:32:50.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/README 2024-09-19T04:32:50.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-09-19T04:32:50.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-09-19T04:32:50.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-09-19T04:32:50.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-09-19T04:32:50.686 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-09-19T04:32:50.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-09-19T04:32:50.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-09-19T04:32:50.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-09-19T04:32:50.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ 2024-09-19T04:32:50.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-09-19T04:32:50.697 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-09-19T04:32:50.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-09-19T04:32:50.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-09-19T04:32:50.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-09-19T04:32:50.706 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-09-19T04:32:50.708 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-09-19T04:32:50.710 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/ 2024-09-19T04:32:50.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-09-19T04:32:50.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-09-19T04:32:50.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-09-19T04:32:50.717 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-09-19T04:32:50.719 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-09-19T04:32:50.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/init.txt 2024-09-19T04:32:50.724 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/initrd.txt 2024-09-19T04:32:50.726 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ 2024-09-19T04:32:50.728 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-09-19T04:32:50.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-09-19T04:32:50.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-09-19T04:32:50.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-09-19T04:32:50.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-09-19T04:32:50.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-09-19T04:32:50.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-09-19T04:32:50.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-09-19T04:32:50.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-09-19T04:32:50.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-09-19T04:32:50.750 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-09-19T04:32:50.752 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-09-19T04:32:50.754 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-09-19T04:32:50.756 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-09-19T04:32:50.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-09-19T04:32:50.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-09-19T04:32:50.762 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-09-19T04:32:50.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/input.txt 2024-09-19T04:32:50.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-09-19T04:32:50.768 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-09-19T04:32:50.770 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-09-19T04:32:50.772 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-09-19T04:32:50.774 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-09-19T04:32:50.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-09-19T04:32:50.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-09-19T04:32:50.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-09-19T04:32:50.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-09-19T04:32:50.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-09-19T04:32:50.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-09-19T04:32:50.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-09-19T04:32:50.791 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-09-19T04:32:50.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-09-19T04:32:50.796 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-09-19T04:32:50.798 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-09-19T04:32:50.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ 2024-09-19T04:32:50.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-09-19T04:32:50.804 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-09-19T04:32:50.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-09-19T04:32:50.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-09-19T04:32:50.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-09-19T04:32:50.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-09-19T04:32:50.814 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/iostats.txt 2024-09-19T04:32:50.817 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-09-19T04:32:50.819 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-09-19T04:32:50.821 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/ 2024-09-19T04:32:50.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-09-19T04:32:50.825 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-09-19T04:32:50.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-09-19T04:32:50.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-09-19T04:32:50.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-09-19T04:32:50.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-09-19T04:32:50.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README 2024-09-19T04:32:50.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-09-19T04:32:50.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-09-19T04:32:50.842 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-09-19T04:32:50.844 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-09-19T04:32:50.846 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-09-19T04:32:50.848 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-09-19T04:32:50.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-09-19T04:32:50.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-09-19T04:32:50.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-09-19T04:32:50.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-09-19T04:32:50.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-09-19T04:32:50.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-09-19T04:32:50.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-09-19T04:32:50.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-09-19T04:32:50.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-09-19T04:32:50.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-09-19T04:32:50.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-09-19T04:32:50.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-09-19T04:32:50.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-09-19T04:32:50.876 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-09-19T04:32:50.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-09-19T04:32:50.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-09-19T04:32:50.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-09-19T04:32:50.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-09-19T04:32:50.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/java.txt 2024-09-19T04:32:50.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kasan.txt 2024-09-19T04:32:50.893 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/ 2024-09-19T04:32:50.894 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:50 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:32:50.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-09-19T04:32:50.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-09-19T04:32:50.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-09-19T04:32:50.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-09-19T04:32:50.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-09-19T04:32:50.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-09-19T04:32:50.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-09-19T04:32:50.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/ 2024-09-19T04:32:50.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-09-19T04:32:50.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-09-19T04:32:50.916 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-09-19T04:32:50.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-09-19T04:32:50.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-09-19T04:32:50.926 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-09-19T04:32:50.928 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-09-19T04:32:50.930 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-09-19T04:32:50.932 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-09-19T04:32:50.934 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-09-19T04:32:50.936 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-09-19T04:32:50.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kobject.txt 2024-09-19T04:32:50.941 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-09-19T04:32:50.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kref.txt 2024-09-19T04:32:50.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:50 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:32:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:50 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:32:51.059 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-09-19T04:32:51.061 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/ 2024-09-19T04:32:51.062 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-09-19T04:32:51.064 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-09-19T04:32:51.070 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-09-19T04:32:51.073 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-09-19T04:32:51.076 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-09-19T04:32:51.078 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-09-19T04:32:51.081 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-09-19T04:32:51.083 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-09-19T04:32:51.086 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-09-19T04:32:51.088 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-09-19T04:32:51.091 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-09-19T04:32:51.095 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-09-19T04:32:51.097 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ldm.txt 2024-09-19T04:32:51.099 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ 2024-09-19T04:32:51.101 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-09-19T04:32:51.103 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-09-19T04:32:51.105 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-09-19T04:32:51.107 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-09-19T04:32:51.109 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-09-19T04:32:51.111 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-09-19T04:32:51.113 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-09-19T04:32:51.116 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-09-19T04:32:51.118 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-09-19T04:32:51.120 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-09-19T04:32:51.122 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-09-19T04:32:51.125 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-09-19T04:32:51.128 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/ 2024-09-19T04:32:51.130 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-09-19T04:32:51.132 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-09-19T04:32:51.135 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-09-19T04:32:51.137 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-09-19T04:32:51.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-09-19T04:32:51.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-09-19T04:32:51.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-09-19T04:32:51.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-09-19T04:32:51.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-09-19T04:32:51.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-09-19T04:32:51.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-09-19T04:32:51.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/logo.gif 2024-09-19T04:32:51.160 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/logo.txt 2024-09-19T04:32:51.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/lzo.txt 2024-09-19T04:32:51.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/ 2024-09-19T04:32:51.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-09-19T04:32:51.169 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-09-19T04:32:51.171 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-09-19T04:32:51.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-09-19T04:32:51.177 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-09-19T04:32:51.179 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/md.txt 2024-09-19T04:32:51.181 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-09-19T04:32:51.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-09-19T04:32:51.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-09-19T04:32:51.455 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-09-19T04:32:51.457 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-09-19T04:32:51.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/ 2024-09-19T04:32:51.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-09-19T04:32:51.463 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-09-19T04:32:51.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/ 2024-09-19T04:32:51.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-09-19T04:32:51.469 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-09-19T04:32:51.472 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-09-19T04:32:51.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-09-19T04:32:51.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-09-19T04:32:51.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-09-19T04:32:51.479 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-09-19T04:32:51.481 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-09-19T04:32:51.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-09-19T04:32:51.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-09-19T04:32:51.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/ 2024-09-19T04:32:51.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-09-19T04:32:51.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-09-19T04:32:51.493 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-09-19T04:32:51.495 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-09-19T04:32:51.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-09-19T04:32:51.499 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-09-19T04:32:51.501 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-09-19T04:32:51.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-09-19T04:32:51.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-09-19T04:32:51.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-09-19T04:32:51.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-09-19T04:32:51.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-09-19T04:32:51.512 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-09-19T04:32:51.514 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-09-19T04:32:51.516 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-09-19T04:32:51.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-09-19T04:32:51.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-09-19T04:32:51.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-09-19T04:32:51.523 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-09-19T04:32:51.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-09-19T04:32:51.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-09-19T04:32:51.530 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/ 2024-09-19T04:32:51.532 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-09-19T04:32:51.534 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-09-19T04:32:51.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-09-19T04:32:51.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-09-19T04:32:51.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/ 2024-09-19T04:32:51.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-09-19T04:32:51.543 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-09-19T04:32:51.545 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-09-19T04:32:51.547 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mono.txt 2024-09-19T04:32:51.549 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/ 2024-09-19T04:32:51.551 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-09-19T04:32:51.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-09-19T04:32:51.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-09-19T04:32:51.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-09-19T04:32:51.558 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/ 2024-09-19T04:32:51.560 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-09-19T04:32:51.562 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-09-19T04:32:51.564 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/ 2024-09-19T04:32:51.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-09-19T04:32:51.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-09-19T04:32:51.569 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-09-19T04:32:51.571 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-09-19T04:32:51.573 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-09-19T04:32:51.575 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ 2024-09-19T04:32:51.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-09-19T04:32:51.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-09-19T04:32:51.581 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-09-19T04:32:51.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-09-19T04:32:51.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-09-19T04:32:51.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-09-19T04:32:51.591 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-09-19T04:32:51.593 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-09-19T04:32:51.595 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-09-19T04:32:51.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-09-19T04:32:51.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-09-19T04:32:51.603 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-09-19T04:32:51.605 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-09-19T04:32:51.607 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-09-19T04:32:51.611 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-09-19T04:32:51.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-09-19T04:32:51.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-09-19T04:32:51.619 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-09-19T04:32:51.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-09-19T04:32:51.623 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-09-19T04:32:51.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-09-19T04:32:51.630 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-09-19T04:32:51.631 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-09-19T04:32:51.633 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-09-19T04:32:51.635 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-09-19T04:32:51.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-09-19T04:32:51.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-09-19T04:32:51.643 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-09-19T04:32:51.645 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-09-19T04:32:51.647 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-09-19T04:32:51.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-09-19T04:32:51.652 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-09-19T04:32:51.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-09-19T04:32:51.656 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-09-19T04:32:51.658 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-09-19T04:32:51.660 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-09-19T04:32:51.662 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-09-19T04:32:51.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-09-19T04:32:51.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-09-19T04:32:51.668 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-09-19T04:32:51.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-09-19T04:32:51.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-09-19T04:32:51.673 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-09-19T04:32:51.675 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-09-19T04:32:51.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-09-19T04:32:51.680 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-09-19T04:32:51.682 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-09-19T04:32:51.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-09-19T04:32:51.687 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-09-19T04:32:51.690 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-09-19T04:32:51.692 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-09-19T04:32:51.694 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-09-19T04:32:51.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-09-19T04:32:51.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-09-19T04:32:51.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-09-19T04:32:51.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-09-19T04:32:51.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-09-19T04:32:51.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-09-19T04:32:51.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-09-19T04:32:51.712 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-09-19T04:32:51.714 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-09-19T04:32:51.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-09-19T04:32:51.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-09-19T04:32:51.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-09-19T04:32:51.722 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-09-19T04:32:51.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-09-19T04:32:51.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-09-19T04:32:51.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-09-19T04:32:51.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-09-19T04:32:51.731 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-09-19T04:32:51.733 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-09-19T04:32:51.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-09-19T04:32:51.737 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-09-19T04:32:51.740 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-09-19T04:32:51.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-09-19T04:32:51.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-09-19T04:32:51.745 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-09-19T04:32:51.747 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-09-19T04:32:51.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-09-19T04:32:51.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-09-19T04:32:51.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-09-19T04:32:51.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-09-19T04:32:51.757 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-09-19T04:32:51.759 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-09-19T04:32:51.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-09-19T04:32:51.763 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-09-19T04:32:51.765 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-09-19T04:32:51.766 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-09-19T04:32:51.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-09-19T04:32:51.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-09-19T04:32:51.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-09-19T04:32:51.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-09-19T04:32:51.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-09-19T04:32:51.780 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-09-19T04:32:51.782 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-09-19T04:32:51.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-09-19T04:32:51.786 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-09-19T04:32:51.788 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-09-19T04:32:51.790 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-09-19T04:32:51.792 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-09-19T04:32:51.794 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-09-19T04:32:51.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-09-19T04:32:51.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-09-19T04:32:51.802 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-09-19T04:32:51.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-09-19T04:32:51.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-09-19T04:32:51.808 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-09-19T04:32:51.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-09-19T04:32:51.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-09-19T04:32:51.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-09-19T04:32:51.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-09-19T04:32:51.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-09-19T04:32:51.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-09-19T04:32:51.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-09-19T04:32:51.823 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-09-19T04:32:51.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-09-19T04:32:51.827 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-09-19T04:32:51.829 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-09-19T04:32:51.831 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-09-19T04:32:51.833 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-09-19T04:32:51.835 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-09-19T04:32:51.837 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-09-19T04:32:51.839 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-09-19T04:32:51.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-09-19T04:32:51.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-09-19T04:32:51.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-09-19T04:32:51.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-09-19T04:32:51.849 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-09-19T04:32:51.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-09-19T04:32:51.853 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-09-19T04:32:51.855 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-09-19T04:32:51.857 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-09-19T04:32:51.859 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-09-19T04:32:51.861 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-09-19T04:32:51.863 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-09-19T04:32:51.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/ 2024-09-19T04:32:51.867 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-09-19T04:32:51.869 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-09-19T04:32:51.871 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nios2/ 2024-09-19T04:32:51.873 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nios2/README 2024-09-19T04:32:51.875 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-09-19T04:32:51.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/numastat.txt 2024-09-19T04:32:51.879 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-09-19T04:32:51.881 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/padata.txt 2024-09-19T04:32:51.884 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/ 2024-09-19T04:32:51.885 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-09-19T04:32:51.887 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-09-19T04:32:51.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parisc/registers 2024-09-19T04:32:51.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-09-19T04:32:51.894 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/parport.txt 2024-09-19T04:32:51.894 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:51 smithi070 ceph-mon[30942]: pgmap v65: 97 pgs: 97 active+clean; 91 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.6 MiB/s wr, 142 op/s 2024-09-19T04:32:51.896 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-09-19T04:32:51.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-09-19T04:32:51.899 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-09-19T04:32:51.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-09-19T04:32:51.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-09-19T04:32:51.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-09-19T04:32:51.906 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-09-19T04:32:51.909 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-09-19T04:32:51.911 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-09-19T04:32:51.913 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy.txt 2024-09-19T04:32:51.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy/ 2024-09-19T04:32:51.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-09-19T04:32:51.918 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-09-19T04:32:51.921 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-09-19T04:32:51.924 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/platform/ 2024-09-19T04:32:51.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-09-19T04:32:51.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pnp.txt 2024-09-19T04:32:51.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/ 2024-09-19T04:32:51.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-09-19T04:32:51.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-09-19T04:32:51.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-09-19T04:32:51.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-09-19T04:32:51.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-09-19T04:32:51.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-09-19T04:32:51.944 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-09-19T04:32:51.946 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-09-19T04:32:51.948 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-09-19T04:32:51.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-09-19T04:32:51.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-09-19T04:32:51.955 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-09-19T04:32:51.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:51 smithi167 ceph-mon[34339]: pgmap v65: 97 pgs: 97 active+clean; 91 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.6 MiB/s wr, 142 op/s 2024-09-19T04:32:51.981 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-09-19T04:32:52.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:51 smithi134 ceph-mon[34525]: pgmap v65: 97 pgs: 97 active+clean; 91 MiB data, 666 MiB used, 1.0 TiB / 1.0 TiB avail; 242 KiB/s rd, 1.6 MiB/s wr, 142 op/s 2024-09-19T04:32:52.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-09-19T04:32:52.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-09-19T04:32:52.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-09-19T04:32:52.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-09-19T04:32:52.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-09-19T04:32:52.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-09-19T04:32:52.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-09-19T04:32:52.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-09-19T04:32:52.152 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-09-19T04:32:52.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-09-19T04:32:52.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/states.txt 2024-09-19T04:32:52.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-09-19T04:32:52.161 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-09-19T04:32:52.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-09-19T04:32:52.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-09-19T04:32:52.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-09-19T04:32:52.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-09-19T04:32:52.172 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-09-19T04:32:52.174 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/power/video.txt 2024-09-19T04:32:52.176 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/ 2024-09-19T04:32:52.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-09-19T04:32:52.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-09-19T04:32:52.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-09-19T04:32:52.184 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-09-19T04:32:52.186 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-09-19T04:32:52.189 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-09-19T04:32:52.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-09-19T04:32:52.194 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-09-19T04:32:52.196 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-09-19T04:32:52.198 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-09-19T04:32:52.200 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-09-19T04:32:52.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-09-19T04:32:52.204 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-09-19T04:32:52.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pps/ 2024-09-19T04:32:52.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-09-19T04:32:52.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/ 2024-09-19T04:32:52.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-09-19T04:32:52.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-09-19T04:32:52.215 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-09-19T04:32:52.217 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-09-19T04:32:52.219 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-09-19T04:32:52.221 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-09-19T04:32:52.223 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-09-19T04:32:52.225 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-09-19T04:32:52.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-09-19T04:32:52.229 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pti/ 2024-09-19T04:32:52.231 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-09-19T04:32:52.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/ 2024-09-19T04:32:52.234 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-09-19T04:32:52.236 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-09-19T04:32:52.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-09-19T04:32:52.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-09-19T04:32:52.242 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-09-19T04:32:52.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/pwm.txt 2024-09-19T04:32:52.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-09-19T04:32:52.248 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/ 2024-09-19T04:32:52.249 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-09-19T04:32:52.252 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-09-19T04:32:52.254 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-09-19T04:32:52.256 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-09-19T04:32:52.258 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-09-19T04:32:52.260 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-09-19T04:32:52.262 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-09-19T04:32:52.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-09-19T04:32:52.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-09-19T04:32:52.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/rtc.txt 2024-09-19T04:32:52.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/ 2024-09-19T04:32:52.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-09-19T04:32:52.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-09-19T04:32:52.276 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-09-19T04:32:52.278 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-09-19T04:32:52.280 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/DASD 2024-09-19T04:32:52.282 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-09-19T04:32:52.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-09-19T04:32:52.288 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-09-19T04:32:52.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-09-19T04:32:52.292 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-09-19T04:32:52.294 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-09-19T04:32:52.296 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-09-19T04:32:52.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-09-19T04:32:52.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-09-19T04:32:52.302 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/ 2024-09-19T04:32:52.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-09-19T04:32:52.306 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-09-19T04:32:52.308 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-09-19T04:32:52.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-09-19T04:32:52.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-09-19T04:32:52.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-09-19T04:32:52.316 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-09-19T04:32:52.318 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-09-19T04:32:52.320 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-09-19T04:32:52.322 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-09-19T04:32:52.324 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ 2024-09-19T04:32:52.326 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-09-19T04:32:52.328 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-09-19T04:32:52.330 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-09-19T04:32:52.332 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-09-19T04:32:52.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-09-19T04:32:52.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-09-19T04:32:52.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-09-19T04:32:52.343 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-09-19T04:32:52.345 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-09-19T04:32:52.348 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-09-19T04:32:52.350 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-09-19T04:32:52.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-09-19T04:32:52.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-09-19T04:32:52.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-09-19T04:32:52.359 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-09-19T04:32:52.361 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-09-19T04:32:52.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-09-19T04:32:52.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-09-19T04:32:52.367 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-09-19T04:32:52.368 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-09-19T04:32:52.370 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-09-19T04:32:52.372 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-09-19T04:32:52.375 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-09-19T04:32:52.377 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-09-19T04:32:52.379 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-09-19T04:32:52.381 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-09-19T04:32:52.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-09-19T04:32:52.384 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-09-19T04:32:52.386 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-09-19T04:32:52.388 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-09-19T04:32:52.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-09-19T04:32:52.392 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-09-19T04:32:52.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-09-19T04:32:52.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-09-19T04:32:52.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-09-19T04:32:52.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-09-19T04:32:52.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-09-19T04:32:52.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-09-19T04:32:52.407 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-09-19T04:32:52.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-09-19T04:32:52.412 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-09-19T04:32:52.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-09-19T04:32:52.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-09-19T04:32:52.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-09-19T04:32:52.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-09-19T04:32:52.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-09-19T04:32:52.424 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-09-19T04:32:52.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-09-19T04:32:52.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-09-19T04:32:52.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-09-19T04:32:52.434 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-09-19T04:32:52.436 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-09-19T04:32:52.438 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-09-19T04:32:52.440 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-09-19T04:32:52.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-09-19T04:32:52.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-09-19T04:32:52.448 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-09-19T04:32:52.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-09-19T04:32:52.453 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-09-19T04:32:52.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/ 2024-09-19T04:32:52.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-09-19T04:32:52.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-09-19T04:32:52.460 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-09-19T04:32:52.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-09-19T04:32:52.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-09-19T04:32:52.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-09-19T04:32:52.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-09-19T04:32:52.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-09-19T04:32:52.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-09-19T04:32:52.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-09-19T04:32:52.477 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-09-19T04:32:52.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-09-19T04:32:52.483 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-09-19T04:32:52.486 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-09-19T04:32:52.488 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/ 2024-09-19T04:32:52.490 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-09-19T04:32:52.492 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-09-19T04:32:52.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/driver 2024-09-19T04:32:52.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-09-19T04:32:52.498 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-09-19T04:32:52.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-09-19T04:32:52.503 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-09-19T04:32:52.505 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-09-19T04:32:52.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-09-19T04:32:52.510 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/ 2024-09-19T04:32:52.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-09-19T04:32:52.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-09-19T04:32:52.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-09-19T04:32:52.518 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/ 2024-09-19T04:32:52.519 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-09-19T04:32:52.521 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-09-19T04:32:52.525 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-09-19T04:32:52.527 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-09-19T04:32:52.529 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-09-19T04:32:52.531 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-09-19T04:32:52.533 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-09-19T04:32:52.535 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-09-19T04:32:52.537 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-09-19T04:32:52.539 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-09-19T04:32:52.541 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-09-19T04:32:52.544 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-09-19T04:32:52.546 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-09-19T04:32:52.548 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-09-19T04:32:52.550 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-09-19T04:32:52.552 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-09-19T04:32:52.554 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-09-19T04:32:52.556 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-09-19T04:32:52.559 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-09-19T04:32:52.561 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-09-19T04:32:52.563 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-09-19T04:32:52.565 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-09-19T04:32:52.567 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-09-19T04:32:52.570 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-09-19T04:32:52.572 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-09-19T04:32:52.574 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-09-19T04:32:52.576 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-09-19T04:32:52.577 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-09-19T04:32:52.579 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-09-19T04:32:52.582 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-09-19T04:32:52.584 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-09-19T04:32:52.586 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-09-19T04:32:52.588 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-09-19T04:32:52.590 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-09-19T04:32:52.592 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-09-19T04:32:52.594 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-09-19T04:32:52.596 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-09-19T04:32:52.598 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-09-19T04:32:52.601 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-09-19T04:32:52.604 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-09-19T04:32:52.606 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-09-19T04:32:52.608 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-09-19T04:32:52.610 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-09-19T04:32:52.612 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-09-19T04:32:52.614 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-09-19T04:32:52.617 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-09-19T04:32:52.618 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-09-19T04:32:52.621 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-09-19T04:32:52.624 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-09-19T04:32:52.626 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-09-19T04:32:52.628 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-09-19T04:32:52.632 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-09-19T04:32:52.634 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-09-19T04:32:52.636 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-09-19T04:32:52.638 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-09-19T04:32:52.640 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-09-19T04:32:52.642 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-09-19T04:32:52.644 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-09-19T04:32:52.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-09-19T04:32:52.649 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-09-19T04:32:52.651 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-09-19T04:32:52.653 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-09-19T04:32:52.654 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sparse.txt 2024-09-19T04:32:52.657 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/ 2024-09-19T04:32:52.659 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-09-19T04:32:52.661 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-09-19T04:32:52.663 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-09-19T04:32:52.664 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-09-19T04:32:52.666 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-09-19T04:32:52.669 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-09-19T04:32:52.671 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-09-19T04:32:52.674 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-09-19T04:32:52.676 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-09-19T04:32:52.678 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev 2024-09-19T04:32:52.681 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-09-19T04:32:52.683 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-09-19T04:32:52.685 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-09-19T04:32:52.688 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-09-19T04:32:52.691 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-09-19T04:32:52.693 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/svga.txt 2024-09-19T04:32:52.695 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/ 2024-09-19T04:32:52.696 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-09-19T04:32:52.698 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/README 2024-09-19T04:32:52.700 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-09-19T04:32:52.702 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-09-19T04:32:52.704 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-09-19T04:32:52.707 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-09-19T04:32:52.709 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-09-19T04:32:52.711 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-09-19T04:32:52.713 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-09-19T04:32:52.716 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-09-19T04:32:52.718 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/ 2024-09-19T04:32:52.720 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-09-19T04:32:52.723 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-09-19T04:32:52.725 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-09-19T04:32:52.727 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/ 2024-09-19T04:32:52.729 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-09-19T04:32:52.730 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-09-19T04:32:52.732 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-09-19T04:32:52.734 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-09-19T04:32:52.736 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-09-19T04:32:52.739 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-09-19T04:32:52.741 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-09-19T04:32:52.743 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-09-19T04:32:52.746 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/ 2024-09-19T04:32:52.748 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-09-19T04:32:52.749 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-09-19T04:32:52.751 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-09-19T04:32:52.753 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-09-19T04:32:52.755 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-09-19T04:32:52.758 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-09-19T04:32:52.760 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-09-19T04:32:52.761 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-09-19T04:32:52.764 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-09-19T04:32:52.767 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-09-19T04:32:52.769 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-09-19T04:32:52.771 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/tpm/ 2024-09-19T04:32:52.773 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-09-19T04:32:52.775 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ 2024-09-19T04:32:52.777 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-09-19T04:32:52.779 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-09-19T04:32:52.781 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-09-19T04:32:52.783 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-09-19T04:32:52.785 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-09-19T04:32:52.787 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-09-19T04:32:52.789 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-09-19T04:32:52.793 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-09-19T04:32:52.795 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-09-19T04:32:52.797 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-09-19T04:32:52.800 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-09-19T04:32:52.801 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-09-19T04:32:52.805 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-09-19T04:32:52.806 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-09-19T04:32:52.810 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-09-19T04:32:52.812 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-09-19T04:32:52.813 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-09-19T04:32:52.816 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-09-19T04:32:52.818 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unicode.txt 2024-09-19T04:32:52.820 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/unshare.txt 2024-09-19T04:32:52.822 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ 2024-09-19T04:32:52.824 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-09-19T04:32:52.826 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-09-19T04:32:52.828 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-09-19T04:32:52.830 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-09-19T04:32:52.832 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-09-19T04:32:52.834 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-09-19T04:32:52.836 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-09-19T04:32:52.838 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-09-19T04:32:52.840 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-09-19T04:32:52.841 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-09-19T04:32:52.843 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-09-19T04:32:52.845 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-09-19T04:32:52.847 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-09-19T04:32:52.850 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-09-19T04:32:52.851 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-09-19T04:32:52.854 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-09-19T04:32:52.856 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-09-19T04:32:52.858 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-09-19T04:32:52.860 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-09-19T04:32:52.862 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-09-19T04:32:52.864 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-09-19T04:32:52.866 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-09-19T04:32:52.868 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-09-19T04:32:52.870 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-09-19T04:32:52.872 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-09-19T04:32:52.874 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-09-19T04:32:52.877 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-09-19T04:32:52.878 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-09-19T04:32:52.880 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-09-19T04:32:52.883 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-09-19T04:32:52.886 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-09-19T04:32:52.889 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-09-19T04:32:52.891 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-09-19T04:32:52.892 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-09-19T04:32:52.894 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:52 smithi070 ceph-mon[30942]: pgmap v66: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 2.8 MiB/s wr, 299 op/s 2024-09-19T04:32:52.895 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-09-19T04:32:52.897 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-09-19T04:32:52.900 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/ 2024-09-19T04:32:52.901 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-09-19T04:32:52.903 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-09-19T04:32:52.905 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-09-19T04:32:52.908 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-09-19T04:32:52.910 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-09-19T04:32:52.912 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vfio.txt 2024-09-19T04:32:52.915 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-09-19T04:32:52.917 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video-output.txt 2024-09-19T04:32:52.919 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/ 2024-09-19T04:32:52.920 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-09-19T04:32:52.923 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-09-19T04:32:52.925 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-09-19T04:32:52.927 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-09-19T04:32:52.929 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-09-19T04:32:52.931 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-09-19T04:32:52.933 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-09-19T04:32:52.935 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-09-19T04:32:52.937 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-09-19T04:32:52.939 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-09-19T04:32:52.942 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-09-19T04:32:52.943 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-09-19T04:32:52.945 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-09-19T04:32:52.947 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-09-19T04:32:52.949 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-09-19T04:32:52.950 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-09-19T04:32:52.952 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-09-19T04:32:52.954 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-09-19T04:32:52.956 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-09-19T04:32:52.958 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-09-19T04:32:52.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:52 smithi167 ceph-mon[34339]: pgmap v66: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 2.8 MiB/s wr, 299 op/s 2024-09-19T04:32:52.960 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-09-19T04:32:52.962 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-09-19T04:32:52.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-09-19T04:32:52.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-09-19T04:32:52.968 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-09-19T04:32:52.971 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-09-19T04:32:52.973 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-09-19T04:32:52.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-09-19T04:32:52.977 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-09-19T04:32:52.979 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-09-19T04:32:52.997 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-09-19T04:32:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:52 smithi134 ceph-mon[34525]: pgmap v66: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 706 KiB/s rd, 2.8 MiB/s wr, 299 op/s 2024-09-19T04:32:53.134 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-09-19T04:32:53.136 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-09-19T04:32:53.138 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-09-19T04:32:53.140 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-09-19T04:32:53.142 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-09-19T04:32:53.144 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-09-19T04:32:53.146 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-09-19T04:32:53.148 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-09-19T04:32:53.150 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-09-19T04:32:53.153 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-09-19T04:32:53.155 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-09-19T04:32:53.157 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-09-19T04:32:53.159 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-09-19T04:32:53.162 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-09-19T04:32:53.164 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-09-19T04:32:53.166 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-09-19T04:32:53.168 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-09-19T04:32:53.170 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-09-19T04:32:53.173 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-09-19T04:32:53.175 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-09-19T04:32:53.178 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-09-19T04:32:53.180 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-09-19T04:32:53.182 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-09-19T04:32:53.185 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-09-19T04:32:53.187 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-09-19T04:32:53.191 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-09-19T04:32:53.193 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-09-19T04:32:53.195 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-09-19T04:32:53.197 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-09-19T04:32:53.199 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-09-19T04:32:53.201 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-09-19T04:32:53.203 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-09-19T04:32:53.205 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-09-19T04:32:53.207 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-09-19T04:32:53.209 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-09-19T04:32:53.211 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-09-19T04:32:53.213 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-09-19T04:32:53.216 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-09-19T04:32:53.218 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-09-19T04:32:53.220 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-09-19T04:32:53.222 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-09-19T04:32:53.224 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-09-19T04:32:53.227 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-09-19T04:32:53.230 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-09-19T04:32:53.232 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-09-19T04:32:53.235 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-09-19T04:32:53.238 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-09-19T04:32:53.240 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/ 2024-09-19T04:32:53.243 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-09-19T04:32:53.244 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-09-19T04:32:53.246 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-09-19T04:32:53.247 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-09-19T04:32:53.251 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-09-19T04:32:53.253 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-09-19T04:32:53.255 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-09-19T04:32:53.257 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-09-19T04:32:53.259 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-09-19T04:32:53.261 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-09-19T04:32:53.264 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-09-19T04:32:53.266 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-09-19T04:32:53.268 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-09-19T04:32:53.270 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-09-19T04:32:53.272 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-09-19T04:32:53.274 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-09-19T04:32:53.277 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-09-19T04:32:53.279 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-09-19T04:32:53.281 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-09-19T04:32:53.283 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-09-19T04:32:53.285 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-09-19T04:32:53.287 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-09-19T04:32:53.289 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-09-19T04:32:53.291 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-09-19T04:32:53.293 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-09-19T04:32:53.298 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/ 2024-09-19T04:32:53.300 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-09-19T04:32:53.301 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-09-19T04:32:53.304 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-09-19T04:32:53.305 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/balance 2024-09-19T04:32:53.307 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-09-19T04:32:53.310 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-09-19T04:32:53.312 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-09-19T04:32:53.314 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-09-19T04:32:53.317 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-09-19T04:32:53.319 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-09-19T04:32:53.321 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/numa 2024-09-19T04:32:53.323 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-09-19T04:32:53.325 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-09-19T04:32:53.327 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-09-19T04:32:53.329 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-09-19T04:32:53.331 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-09-19T04:32:53.333 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-09-19T04:32:53.335 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-09-19T04:32:53.337 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-09-19T04:32:53.339 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-09-19T04:32:53.341 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-09-19T04:32:53.344 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-09-19T04:32:53.346 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-09-19T04:32:53.349 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-09-19T04:32:53.351 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-09-19T04:32:53.353 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/ 2024-09-19T04:32:53.355 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-09-19T04:32:53.357 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-09-19T04:32:53.358 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-09-19T04:32:53.360 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-09-19T04:32:53.363 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-09-19T04:32:53.365 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-09-19T04:32:53.366 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-09-19T04:32:53.369 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-09-19T04:32:53.371 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-09-19T04:32:53.373 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-09-19T04:32:53.374 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-09-19T04:32:53.376 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-09-19T04:32:53.378 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-09-19T04:32:53.380 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-09-19T04:32:53.382 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-09-19T04:32:53.385 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-09-19T04:32:53.387 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/ 2024-09-19T04:32:53.389 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-09-19T04:32:53.390 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-09-19T04:32:53.393 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-09-19T04:32:53.394 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-09-19T04:32:53.396 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-09-19T04:32:53.398 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-09-19T04:32:53.400 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-09-19T04:32:53.401 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-09-19T04:32:53.403 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-09-19T04:32:53.405 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-09-19T04:32:53.408 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-09-19T04:32:53.410 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-09-19T04:32:53.413 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-09-19T04:32:53.414 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/ 2024-09-19T04:32:53.416 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-09-19T04:32:53.418 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-09-19T04:32:53.420 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-09-19T04:32:53.423 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/ 2024-09-19T04:32:53.425 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-09-19T04:32:53.426 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-09-19T04:32:53.429 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-09-19T04:32:53.431 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-09-19T04:32:53.433 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-09-19T04:32:53.435 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-09-19T04:32:53.437 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-09-19T04:32:53.439 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-09-19T04:32:53.441 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-09-19T04:32:53.443 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-09-19T04:32:53.445 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-09-19T04:32:53.447 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-09-19T04:32:53.449 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-09-19T04:32:53.451 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-09-19T04:32:53.452 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-09-19T04:32:53.454 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-09-19T04:32:53.456 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-09-19T04:32:53.458 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-09-19T04:32:53.459 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-09-19T04:32:53.462 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-09-19T04:32:53.464 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-09-19T04:32:53.466 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-09-19T04:32:53.468 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-09-19T04:32:53.470 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-09-19T04:32:53.473 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/ 2024-09-19T04:32:53.475 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-09-19T04:32:53.476 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-09-19T04:32:53.478 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/xz.txt 2024-09-19T04:32:53.480 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-09-19T04:32:53.482 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-09-19T04:32:53.485 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-09-19T04:32:53.487 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-09-19T04:32:53.489 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-09-19T04:32:53.491 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-09-19T04:32:53.494 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-09-19T04:32:53.496 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-09-19T04:32:53.497 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-09-19T04:32:53.500 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-09-19T04:32:53.502 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-09-19T04:32:53.504 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-09-19T04:32:53.506 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-09-19T04:32:53.507 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-09-19T04:32:53.509 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-09-19T04:32:53.511 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-09-19T04:32:53.513 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-09-19T04:32:53.515 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-09-19T04:32:53.517 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-09-19T04:32:53.520 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-09-19T04:32:53.522 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-09-19T04:32:53.524 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-09-19T04:32:53.526 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-09-19T04:32:53.963 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-09-19T04:32:53.965 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-09-19T04:32:53.967 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-09-19T04:32:53.969 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-09-19T04:32:53.972 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-09-19T04:32:53.975 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-09-19T04:32:53.978 INFO:tasks.workunit.client.0.smithi070.stdout:linux-4.0.5/Documentation/zorro.txt 2024-09-19T04:32:55.872 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:55 smithi070 ceph-mon[30942]: pgmap v67: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2024-09-19T04:32:55.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:55 smithi167 ceph-mon[34339]: pgmap v67: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2024-09-19T04:32:56.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:55 smithi134 ceph-mon[34525]: pgmap v67: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2024-09-19T04:32:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:57 smithi070 ceph-mon[30942]: pgmap v68: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2024-09-19T04:32:57.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:57 smithi167 ceph-mon[34339]: pgmap v68: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2024-09-19T04:32:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:57 smithi134 ceph-mon[34525]: pgmap v68: 97 pgs: 97 active+clean; 104 MiB data, 729 MiB used, 1.0 TiB / 1.0 TiB avail; 670 KiB/s rd, 1.9 MiB/s wr, 256 op/s 2024-09-19T04:32:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:32:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:32:58.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:32:58.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:58 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:32:58.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:58 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:32:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:59.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:32:59.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:32:59.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:58 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:32:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:32:59 smithi070 ceph-mon[30942]: pgmap v69: 97 pgs: 97 active+clean; 113 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 304 op/s 2024-09-19T04:32:59.939 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar cf doc.tar linux-4.0.5 2024-09-19T04:32:59.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:32:59 smithi167 ceph-mon[34339]: pgmap v69: 97 pgs: 97 active+clean; 113 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 304 op/s 2024-09-19T04:33:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:32:59 smithi134 ceph-mon[34525]: pgmap v69: 97 pgs: 97 active+clean; 113 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.7 MiB/s wr, 304 op/s 2024-09-19T04:33:00.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:00 smithi167 ceph-mon[34339]: pgmap v70: 97 pgs: 97 active+clean; 113 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 2.0 MiB/s wr, 204 op/s 2024-09-19T04:33:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:00 smithi134 ceph-mon[34525]: pgmap v70: 97 pgs: 97 active+clean; 113 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 2.0 MiB/s wr, 204 op/s 2024-09-19T04:33:01.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:00 smithi070 ceph-mon[30942]: pgmap v70: 97 pgs: 97 active+clean; 113 MiB data, 745 MiB used, 1.0 TiB / 1.0 TiB avail; 951 KiB/s rd, 2.0 MiB/s wr, 204 op/s 2024-09-19T04:33:01.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:33:01.627 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:03.682 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xf doc.tar 2024-09-19T04:33:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 -- 172.21.15.70:0/2965002830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6241049a0 msgr2=0x7fc6241089f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 --2- 172.21.15.70:0/2965002830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6241049a0 0x7fc6241089f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fc618009900 tx=0x7fc61802a410 comp rx=0 tx=0).stop 2024-09-19T04:33:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 -- 172.21.15.70:0/2965002830 shutdown_connections 2024-09-19T04:33:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 --2- 172.21.15.70:0/2965002830 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc624109120 0x7fc624110ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 --2- 172.21.15.70:0/2965002830 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc6241049a0 0x7fc6241089f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 --2- 172.21.15.70:0/2965002830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc624103ff0 0x7fc6241043d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 -- 172.21.15.70:0/2965002830 >> 172.21.15.70:0/2965002830 conn(0x7fc6240ffab0 msgr2=0x7fc624101ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:03.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 -- 172.21.15.70:0/2965002830 shutdown_connections 2024-09-19T04:33:03.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.827+0000 7fc62a884640 1 -- 172.21.15.70:0/2965002830 wait complete. 2024-09-19T04:33:03.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc62a884640 1 Processor -- start 2024-09-19T04:33:03.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc62a884640 1 -- start start 2024-09-19T04:33:03.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc62a884640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc624103ff0 0x7fc62419a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc62a884640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6241049a0 0x7fc62419ab70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc62a884640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc624109120 0x7fc62419ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc62a884640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc624114150 con 0x7fc624109120 2024-09-19T04:33:03.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc62a884640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc624113fd0 con 0x7fc624103ff0 2024-09-19T04:33:03.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc62a884640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241142d0 con 0x7fc6241049a0 2024-09-19T04:33:03.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc628e21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc624109120 0x7fc62419ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc623fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc624103ff0 0x7fc62419a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc628e21640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc624109120 0x7fc62419ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42394/0 (socket says 172.21.15.70:42394) 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc628e21640 1 -- 172.21.15.70:0/2871734320 learned_addr learned my addr 172.21.15.70:0/2871734320 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.828+0000 7fc6237fe640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6241049a0 0x7fc62419ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc628e21640 1 -- 172.21.15.70:0/2871734320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6241049a0 msgr2=0x7fc62419ab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc628e21640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6241049a0 0x7fc62419ab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc628e21640 1 -- 172.21.15.70:0/2871734320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc624103ff0 msgr2=0x7fc62419a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc628e21640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc624103ff0 0x7fc62419a630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc628e21640 1 -- 172.21.15.70:0/2871734320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc62419f5e0 con 0x7fc624109120 2024-09-19T04:33:03.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc623fff640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc624103ff0 0x7fc62419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:03.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc628e21640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc624109120 0x7fc62419ef00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00eaa0 tx=0x7fc61c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:03.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc6217fa640 1 -- 172.21.15.70:0/2871734320 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c00cdb0 con 0x7fc624109120 2024-09-19T04:33:03.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc62a884640 1 -- 172.21.15.70:0/2871734320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc62419f8d0 con 0x7fc624109120 2024-09-19T04:33:03.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc6217fa640 1 -- 172.21.15.70:0/2871734320 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc61c005020 con 0x7fc624109120 2024-09-19T04:33:03.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc6217fa640 1 -- 172.21.15.70:0/2871734320 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61c0116b0 con 0x7fc624109120 2024-09-19T04:33:03.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.829+0000 7fc62a884640 1 -- 172.21.15.70:0/2871734320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc6241a71b0 con 0x7fc624109120 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc6217fa640 1 -- 172.21.15.70:0/2871734320 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc61c0051d0 con 0x7fc624109120 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc62cc5d740 1 Processor -- start 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc62cc5d740 1 -- start start 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b136880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b141140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b143a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f28b09c2e0 con 0x55f28b141680 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f28b043ce0 con 0x55f28b1364a0 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f28b0982a0 con 0x55f28b136dc0 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b143a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc623fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b141140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b143a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42398/0 (socket says 172.21.15.70:42398) 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc6237fe640 1 -- 172.21.15.70:0/4039437860 learned_addr learned my addr 172.21.15.70:0/4039437860 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.833+0000 7fc6237fe640 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b136880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc6217fa640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc60c0a3430 0x7fc60c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc623fff640 1 -- 172.21.15.70:0/4039437860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 msgr2=0x55f28b136880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc623fff640 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b136880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc623fff640 1 -- 172.21.15.70:0/4039437860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 msgr2=0x55f28b143a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc623fff640 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b143a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc623fff640 1 -- 172.21.15.70:0/4039437860 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f28b028440 con 0x55f28b136dc0 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc6237fe640 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b136880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc6217fa640 1 -- 172.21.15.70:0/2871734320 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc61c0cfdd0 con 0x7fc624109120 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc628e21640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc60c0a3430 0x7fc60c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc623fff640 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b141140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6140103d0 tx=0x7fc614010890 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9532016e37325a06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:03.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc60a7fc640 1 -- 172.21.15.70:0/4039437860 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614004220 con 0x55f28b136dc0 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc60a7fc640 1 -- 172.21.15.70:0/4039437860 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc6140043c0 con 0x55f28b136dc0 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.834+0000 7fc60a7fc640 1 -- 172.21.15.70:0/4039437860 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6140119c0 con 0x55f28b136dc0 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 -- 172.21.15.70:0/4039437860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 msgr2=0x55f28b141140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b141140 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fc6140103d0 tx=0x7fc614010890 comp rx=0 tx=0).stop 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc628e21640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc60c0a3430 0x7fc60c0a58f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc61c09c110 tx=0x7fc61c009270 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 -- 172.21.15.70:0/4039437860 shutdown_connections 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b143a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b141140 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/4039437860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b136880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 -- 172.21.15.70:0/4039437860 >> 172.21.15.70:0/4039437860 conn(0x55f28b132a30 msgr2=0x55f28b132e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 -- 172.21.15.70:0/4039437860 shutdown_connections 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 -- 172.21.15.70:0/4039437860 wait complete. 2024-09-19T04:33:03.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.835+0000 7fc62cc5d740 1 -- start start 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc62cc5d740 1 Processor -- start 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b1364a0 0x55f28b140f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b13e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b141680 0x55f28b13e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f28b144250 con 0x55f28b1364a0 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f28b057050 con 0x55f28b141680 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f28b1443d0 con 0x55f28b136dc0 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc62cc5d740 10 client.0 _ll_register_callbacks cb 0x55f28b097160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b1364a0 0x55f28b140f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc623fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b13e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b1364a0 0x55f28b140f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42400/0 (socket says 172.21.15.70:42400) 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc6237fe640 1 -- 172.21.15.70:0/3060807502 learned_addr learned my addr 172.21.15.70:0/3060807502 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:03.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.836+0000 7fc6237fe640 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b141680 0x55f28b13e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc623fff640 1 -- 172.21.15.70:0/3060807502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b141680 msgr2=0x55f28b13e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc623fff640 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b141680 0x55f28b13e760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc623fff640 1 -- 172.21.15.70:0/3060807502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b1364a0 msgr2=0x55f28b140f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc623fff640 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b1364a0 0x55f28b140f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc623fff640 1 -- 172.21.15.70:0/3060807502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f28ae0d3c0 con 0x55f28b136dc0 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc6237fe640 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b1364a0 0x55f28b140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc623fff640 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b13e220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc61400b5f0 tx=0x7fc614004250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=85a322b71bee0285 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc6037fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:33:03.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc6037fe640 1 -- 172.21.15.70:0/3060807502 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61402a060 con 0x55f28b136dc0 2024-09-19T04:33:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc62cc5d740 1 -- 172.21.15.70:0/3060807502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc6140043c0 con 0x55f28b136dc0 2024-09-19T04:33:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc6037fe640 1 -- 172.21.15.70:0/3060807502 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc614005250 con 0x55f28b136dc0 2024-09-19T04:33:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc6037fe640 1 -- 172.21.15.70:0/3060807502 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc614005450 con 0x55f28b136dc0 2024-09-19T04:33:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc62cc5d740 10 client.25084 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:03.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.837+0000 7fc62cc5d740 1 -- 172.21.15.70:0/3060807502 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f28b14fc20 con 0x55f28b136dc0 2024-09-19T04:33:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc6037fe640 1 -- 172.21.15.70:0/3060807502 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc6140043c0 con 0x55f28b136dc0 2024-09-19T04:33:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc6037fe640 1 -- 172.21.15.70:0/3060807502 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fc614004880 con 0x55f28b136dc0 2024-09-19T04:33:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc62cc5d740 10 client.25084 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc62cc5d740 10 client.25084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc62cc5d740 20 client.25084 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:03.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f28b151030 0x55f28b153420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc62cc5d740 4 client.25084 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc62cc5d740 1 -- 172.21.15.70:0/3060807502 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f28b0a9850 con 0x55f28b151030 2024-09-19T04:33:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.838+0000 7fc6237fe640 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f28b151030 0x55f28b153420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.839+0000 7fc6237fe640 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f28b151030 0x55f28b153420 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=767d65a8eb469fa3 server_cookie=4697f0b6281a059e in_seq=0 out_seq=0 2024-09-19T04:33:03.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.839+0000 7fc6037fe640 10 client.25084 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.839+0000 7fc6037fe640 1 -- 172.21.15.70:0/3060807502 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f28b0a9850 con 0x55f28b151030 2024-09-19T04:33:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.839+0000 7fc6037fe640 10 client.25084 handle_command_reply: tid=0 2024-09-19T04:33:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.839+0000 7fc62cc5d740 1 client.25084 shutdown 2024-09-19T04:33:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 -- 172.21.15.70:0/3060807502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 msgr2=0x55f28b13e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b13e220 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc61400b5f0 tx=0x7fc614004250 comp rx=0 tx=0).stop 2024-09-19T04:33:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 -- 172.21.15.70:0/3060807502 shutdown_connections 2024-09-19T04:33:03.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f28b151030 0x55f28b153420 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b141680 0x55f28b13e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b13e220 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc6037fe640 0 client.25084 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/3060807502 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b1364a0 0x55f28b140f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 -- 172.21.15.70:0/3060807502 >> 172.21.15.70:0/3060807502 conn(0x55f28b132a30 msgr2=0x55f28b138710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 -- 172.21.15.70:0/3060807502 shutdown_connections 2024-09-19T04:33:03.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 1 -- 172.21.15.70:0/3060807502 wait complete. 2024-09-19T04:33:03.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.840+0000 7fc62cc5d740 20 client.25084 trim_cache size 0 max 16384 2024-09-19T04:33:03.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc62cc5d740 1 Processor -- start 2024-09-19T04:33:03.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc62cc5d740 1 -- start start 2024-09-19T04:33:03.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b14d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b139900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b140190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241b2390 con 0x55f28b141680 2024-09-19T04:33:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241afc00 con 0x55f28b1364a0 2024-09-19T04:33:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241ada50 con 0x55f28b136dc0 2024-09-19T04:33:03.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc623fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b139900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b140190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42406/0 (socket says 172.21.15.70:42406) 2024-09-19T04:33:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc6237fe640 1 -- 172.21.15.70:0/2361102560 learned_addr learned my addr 172.21.15.70:0/2361102560 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc6237fe640 1 --2- 172.21.15.70:0/2361102560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b14d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc623fff640 1 -- 172.21.15.70:0/2361102560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 msgr2=0x55f28b14d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:03.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc623fff640 1 --2- 172.21.15.70:0/2361102560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b14d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc623fff640 1 -- 172.21.15.70:0/2361102560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 msgr2=0x55f28b140190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc623fff640 1 --2- 172.21.15.70:0/2361102560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b140190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.858+0000 7fc623fff640 1 -- 172.21.15.70:0/2361102560 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f28b136bb0 con 0x55f28b136dc0 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.859+0000 7fc623fff640 1 --2- 172.21.15.70:0/2361102560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b139900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc61400b620 tx=0x7fc61400bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6a7ca56090e3d97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.859+0000 7fc609ffb640 1 -- 172.21.15.70:0/2361102560 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614005250 con 0x55f28b136dc0 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.859+0000 7fc609ffb640 1 -- 172.21.15.70:0/2361102560 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc61400be30 con 0x55f28b136dc0 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.859+0000 7fc609ffb640 1 -- 172.21.15.70:0/2361102560 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614003a10 con 0x55f28b136dc0 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.859+0000 7fc62cc5d740 1 -- 172.21.15.70:0/2361102560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 msgr2=0x55f28b139900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.859+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/2361102560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b139900 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc61400b620 tx=0x7fc61400bb20 comp rx=0 tx=0).stop 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.859+0000 7fc62cc5d740 1 -- 172.21.15.70:0/2361102560 shutdown_connections 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.860+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/2361102560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b140190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.860+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/2361102560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b139900 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.860+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/2361102560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b14d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.860+0000 7fc62cc5d740 1 -- 172.21.15.70:0/2361102560 >> 172.21.15.70:0/2361102560 conn(0x55f28b132a30 msgr2=0x55f28b13fa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.860+0000 7fc62cc5d740 1 -- 172.21.15.70:0/2361102560 shutdown_connections 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.860+0000 7fc62cc5d740 1 -- 172.21.15.70:0/2361102560 wait complete. 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.860+0000 7fc62cc5d740 1 -- start start 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.860+0000 7fc62cc5d740 1 Processor -- start 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b149950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b149e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc62cc5d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b144d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241ae0c0 con 0x55f28b141680 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241af530 con 0x55f28b1364a0 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc62cc5d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6241ae790 con 0x55f28b136dc0 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b144d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc6237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b144d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42420/0 (socket says 172.21.15.70:42420) 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc6237fe640 1 -- 172.21.15.70:0/108847017 learned_addr learned my addr 172.21.15.70:0/108847017 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc62cc5d740 10 client.0 _ll_register_callbacks cb 0x7fc618009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc623fff640 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b149e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc6237fe640 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b149950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc623fff640 1 -- 172.21.15.70:0/108847017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 msgr2=0x55f28b149950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc623fff640 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b149950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc623fff640 1 -- 172.21.15.70:0/108847017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 msgr2=0x55f28b144d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc623fff640 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b144d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc623fff640 1 -- 172.21.15.70:0/108847017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f28b145560 con 0x55f28b136dc0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc6237fe640 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc623fff640 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b149e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc6140103d0 tx=0x7fc614004480 comp rx=0 tx=0).ready entity=mon.1 client_cookie=480e10d986b17be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.861+0000 7fc6037fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc6037fe640 1 -- 172.21.15.70:0/108847017 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614004e70 con 0x55f28b136dc0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 1 -- 172.21.15.70:0/108847017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc61400be30 con 0x55f28b136dc0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc6037fe640 1 -- 172.21.15.70:0/108847017 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc614005250 con 0x55f28b136dc0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc6037fe640 1 -- 172.21.15.70:0/108847017 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc614005830 con 0x55f28b136dc0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 10 client.25090 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 1 -- 172.21.15.70:0/108847017 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f28b1bb600 con 0x55f28b136dc0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc6037fe640 1 -- 172.21.15.70:0/108847017 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc61400be30 con 0x55f28b136dc0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc6037fe640 1 -- 172.21.15.70:0/108847017 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fc6140115c0 con 0x55f28b136dc0 2024-09-19T04:33:03.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 10 client.25090 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 10 client.25090 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 20 client.25090 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f28b151030 0x55f28b1bdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 4 client.25090 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.862+0000 7fc62cc5d740 1 -- 172.21.15.70:0/108847017 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55f28b0a3d60 con 0x55f28b151030 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.863+0000 7fc6237fe640 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f28b151030 0x55f28b1bdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.863+0000 7fc6237fe640 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f28b151030 0x55f28b1bdc70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=75598f8ac0595fcc server_cookie=b565ed0b17c5ed70 in_seq=0 out_seq=0 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.863+0000 7fc6037fe640 10 client.25090 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.863+0000 7fc6037fe640 1 -- 172.21.15.70:0/108847017 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55f28b0a3d60 con 0x55f28b151030 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.863+0000 7fc6037fe640 10 client.25090 handle_command_reply: tid=0 2024-09-19T04:33:03.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.863+0000 7fc62cc5d740 1 client.25090 shutdown 2024-09-19T04:33:03.864 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:33:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:33:03.864 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:33:03.864 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:33:03.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 -- 172.21.15.70:0/108847017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 msgr2=0x55f28b149e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b149e90 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc6140103d0 tx=0x7fc614004480 comp rx=0 tx=0).stop 2024-09-19T04:33:03.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 -- 172.21.15.70:0/108847017 shutdown_connections 2024-09-19T04:33:03.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f28b151030 0x55f28b1bdc70 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f28b141680 0x55f28b144d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f28b136dc0 0x55f28b149e90 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 --2- 172.21.15.70:0/108847017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f28b1364a0 0x55f28b149950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc6037fe640 0 client.25090 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 -- 172.21.15.70:0/108847017 >> 172.21.15.70:0/108847017 conn(0x55f28b132a30 msgr2=0x55f28b131350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 -- 172.21.15.70:0/108847017 shutdown_connections 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 1 -- 172.21.15.70:0/108847017 wait complete. 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62cc5d740 20 client.25090 trim_cache size 0 max 16384 2024-09-19T04:33:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62a884640 1 -- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc60c0a3430 msgr2=0x7fc60c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62a884640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc60c0a3430 0x7fc60c0a58f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7fc61c09c110 tx=0x7fc61c009270 comp rx=0 tx=0).stop 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62a884640 1 -- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc624109120 msgr2=0x7fc62419ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.864+0000 7fc62a884640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc624109120 0x7fc62419ef00 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fc61c00eaa0 tx=0x7fc61c00ef60 comp rx=0 tx=0).stop 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.865+0000 7fc62a884640 1 -- 172.21.15.70:0/2871734320 shutdown_connections 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.865+0000 7fc62a884640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc60c0a3430 0x7fc60c0a58f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.865+0000 7fc62a884640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc624109120 0x7fc62419ef00 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.865+0000 7fc62a884640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc6241049a0 0x7fc62419ab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.865+0000 7fc62a884640 1 --2- 172.21.15.70:0/2871734320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc624103ff0 0x7fc62419a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.865+0000 7fc62a884640 1 -- 172.21.15.70:0/2871734320 >> 172.21.15.70:0/2871734320 conn(0x7fc6240ffab0 msgr2=0x7fc624100e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.865+0000 7fc62a884640 1 -- 172.21.15.70:0/2871734320 shutdown_connections 2024-09-19T04:33:03.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:02.865+0000 7fc62a884640 1 -- 172.21.15.70:0/2871734320 wait complete. 2024-09-19T04:33:03.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:03 smithi070 ceph-mon[30942]: pgmap v71: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 228 op/s 2024-09-19T04:33:03.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:03 smithi167 ceph-mon[34339]: pgmap v71: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 228 op/s 2024-09-19T04:33:04.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:03 smithi134 ceph-mon[34525]: pgmap v71: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.0 MiB/s wr, 228 op/s 2024-09-19T04:33:05.858 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:05 smithi070 ceph-mon[30942]: pgmap v72: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.8 MiB/s wr, 71 op/s 2024-09-19T04:33:05.889 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:33:05.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:33:05.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:05 smithi167 ceph-mon[34339]: pgmap v72: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.8 MiB/s wr, 71 op/s 2024-09-19T04:33:06.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:05 smithi134 ceph-mon[34525]: pgmap v72: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.8 MiB/s wr, 71 op/s 2024-09-19T04:33:06.163 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:06.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.648+0000 7fb82c974640 1 -- 172.21.15.70:0/2153850594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8281027c0 msgr2=0x7fb828106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:06.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.648+0000 7fb82c974640 1 --2- 172.21.15.70:0/2153850594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8281027c0 0x7fb828106810 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb81c009900 tx=0x7fb81c02a410 comp rx=0 tx=0).stop 2024-09-19T04:33:06.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 -- 172.21.15.70:0/2153850594 shutdown_connections 2024-09-19T04:33:06.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 --2- 172.21.15.70:0/2153850594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb828106f40 0x7fb82810eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 --2- 172.21.15.70:0/2153850594 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb8281027c0 0x7fb828106810 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 --2- 172.21.15.70:0/2153850594 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb828101e10 0x7fb8281021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 -- 172.21.15.70:0/2153850594 >> 172.21.15.70:0/2153850594 conn(0x7fb8280fd8d0 msgr2=0x7fb8280ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 -- 172.21.15.70:0/2153850594 shutdown_connections 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 -- 172.21.15.70:0/2153850594 wait complete. 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 Processor -- start 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.649+0000 7fb82c974640 1 -- start start 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82c974640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb828101e10 0x7fb82819a680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82c974640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8281027c0 0x7fb82819abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82c974640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb828106f40 0x7fb82819ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:06.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82c974640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb828114180 con 0x7fb828106f40 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82c974640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb828114000 con 0x7fb8281027c0 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82c974640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb828114300 con 0x7fb828101e10 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb826d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb828106f40 0x7fb82819ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb828101e10 0x7fb82819a680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb828101e10 0x7fb82819a680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:42540/0 (socket says 172.21.15.70:42540) 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb826d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb828106f40 0x7fb82819ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42940/0 (socket says 172.21.15.70:42940) 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 -- 172.21.15.70:0/3710154152 learned_addr learned my addr 172.21.15.70:0/3710154152 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb825d9b640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8281027c0 0x7fb82819abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 -- 172.21.15.70:0/3710154152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8281027c0 msgr2=0x7fb82819abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8281027c0 0x7fb82819abc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 -- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb828106f40 msgr2=0x7fb82819ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb828106f40 0x7fb82819ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 -- 172.21.15.70:0/3710154152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb82819f630 con 0x7fb828101e10 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb826d9d640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb828106f40 0x7fb82819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb825d9b640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8281027c0 0x7fb82819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.650+0000 7fb82659c640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb828101e10 0x7fb82819a680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb81800d950 tx=0x7fb81800de10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.651+0000 7fb8177fe640 1 -- 172.21.15.70:0/3710154152 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb818017070 con 0x7fb828101e10 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.651+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb82819f920 con 0x7fb828101e10 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.651+0000 7fb8177fe640 1 -- 172.21.15.70:0/3710154152 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb818009c30 con 0x7fb828101e10 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.651+0000 7fb8177fe640 1 -- 172.21.15.70:0/3710154152 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb81800f6b0 con 0x7fb828101e10 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.651+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb8281a7200 con 0x7fb828101e10 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.652+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb8281021f0 con 0x7fb828101e10 2024-09-19T04:33:06.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.653+0000 7fb8177fe640 1 -- 172.21.15.70:0/3710154152 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb818010a50 con 0x7fb828101e10 2024-09-19T04:33:06.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.653+0000 7fb8177fe640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb8100a33b0 0x7fb8100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:06.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.653+0000 7fb825d9b640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb8100a33b0 0x7fb8100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:06.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.654+0000 7fb8177fe640 1 -- 172.21.15.70:0/3710154152 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fb8180cf870 con 0x7fb828101e10 2024-09-19T04:33:06.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.654+0000 7fb825d9b640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb8100a33b0 0x7fb8100a5870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb81c004770 tx=0x7fb81c005a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:06.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.657+0000 7fb8177fe640 1 -- 172.21.15.70:0/3710154152 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb818009de0 con 0x7fb828101e10 2024-09-19T04:33:06.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.893+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb82819b9e0 con 0x7fb828101e10 2024-09-19T04:33:06.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.893+0000 7fb8177fe640 1 -- 172.21.15.70:0/3710154152 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11918 (secure 0 0 0) 0x7fb81809bbc0 con 0x7fb828101e10 2024-09-19T04:33:06.895 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:33:06.895 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":26,"btime":"2024-09-19T04:32:49:587399+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:32:49.218947+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:33:06.896 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 26 2024-09-19T04:33:06.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb8100a33b0 msgr2=0x7fb8100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:06.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb8100a33b0 0x7fb8100a5870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fb81c004770 tx=0x7fb81c005a40 comp rx=0 tx=0).stop 2024-09-19T04:33:06.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb828101e10 msgr2=0x7fb82819a680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:06.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb828101e10 0x7fb82819a680 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb81800d950 tx=0x7fb81800de10 comp rx=0 tx=0).stop 2024-09-19T04:33:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 shutdown_connections 2024-09-19T04:33:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb8100a33b0 0x7fb8100a5870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb828106f40 0x7fb82819ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8281027c0 0x7fb82819abc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 --2- 172.21.15.70:0/3710154152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb828101e10 0x7fb82819a680 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 >> 172.21.15.70:0/3710154152 conn(0x7fb8280fd8d0 msgr2=0x7fb8280fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 shutdown_connections 2024-09-19T04:33:06.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:06.896+0000 7fb82c974640 1 -- 172.21.15.70:0/3710154152 wait complete. 2024-09-19T04:33:07.619 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:33:07.877 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:07 smithi070 ceph-mon[30942]: pgmap v73: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.8 MiB/s wr, 71 op/s 2024-09-19T04:33:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:07 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3710154152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:33:07.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:07 smithi167 ceph-mon[34339]: pgmap v73: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.8 MiB/s wr, 71 op/s 2024-09-19T04:33:07.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:07 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3710154152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:33:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:07 smithi134 ceph-mon[34525]: pgmap v73: 97 pgs: 97 active+clean; 125 MiB data, 778 MiB used, 1.0 TiB / 1.0 TiB avail; 823 KiB/s rd, 1.8 MiB/s wr, 71 op/s 2024-09-19T04:33:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:07 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3710154152' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 -- 172.21.15.70:0/4133386232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102ef0 msgr2=0x7f3bb010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 --2- 172.21.15.70:0/4133386232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102ef0 0x7f3bb010da40 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8009ca0 tx=0x7f3ba802a950 comp rx=0 tx=0).stop 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 -- 172.21.15.70:0/4133386232 shutdown_connections 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 --2- 172.21.15.70:0/4133386232 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102ef0 0x7f3bb010da40 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 --2- 172.21.15.70:0/4133386232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb0102570 0x7f3bb01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 --2- 172.21.15.70:0/4133386232 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb0100e20 0x7f3bb0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 -- 172.21.15.70:0/4133386232 >> 172.21.15.70:0/4133386232 conn(0x7f3bb00fc7d0 msgr2=0x7f3bb00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 -- 172.21.15.70:0/4133386232 shutdown_connections 2024-09-19T04:33:08.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.382+0000 7f3bb5444640 1 -- 172.21.15.70:0/4133386232 wait complete. 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.383+0000 7f3bb5444640 1 Processor -- start 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.383+0000 7f3bb5444640 1 -- start start 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.383+0000 7f3bb5444640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb0100e20 0x7f3bb00fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.383+0000 7f3bb5444640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102570 0x7f3bb00fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bb5444640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb0102ef0 0x7f3bb00fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bb5444640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb0110f50 con 0x7f3bb0102570 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bb5444640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb0110dd0 con 0x7f3bb0102ef0 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bb5444640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01110d0 con 0x7f3bb0100e20 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102570 0x7f3bb00fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3baeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb0100e20 0x7f3bb00fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3baeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb0100e20 0x7f3bb00fcc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:42544/0 (socket says 172.21.15.70:42544) 2024-09-19T04:33:08.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3baeffd640 1 -- 172.21.15.70:0/1846571257 learned_addr learned my addr 172.21.15.70:0/1846571257 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb0102ef0 0x7f3bb00fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bae7fc640 1 -- 172.21.15.70:0/1846571257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb0100e20 msgr2=0x7f3bb00fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb0100e20 0x7f3bb00fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bae7fc640 1 -- 172.21.15.70:0/1846571257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb0102ef0 msgr2=0x7f3bb00fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb0102ef0 0x7f3bb00fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bae7fc640 1 -- 172.21.15.70:0/1846571257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3bb01a68c0 con 0x7f3bb0102570 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102570 0x7f3bb00fd1c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400e9f0 tx=0x7f3ba400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3b97fff640 1 -- 172.21.15.70:0/1846571257 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba400ccc0 con 0x7f3bb0102570 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bb5444640 1 -- 172.21.15.70:0/1846571257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3bb01a6bb0 con 0x7f3bb0102570 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3b97fff640 1 -- 172.21.15.70:0/1846571257 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3ba4010900 con 0x7f3bb0102570 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3b97fff640 1 -- 172.21.15.70:0/1846571257 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba4018960 con 0x7f3bb0102570 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.384+0000 7f3bb5444640 1 -- 172.21.15.70:0/1846571257 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3bb01a70f0 con 0x7f3bb0102570 2024-09-19T04:33:08.410 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.387+0000 7f3b97fff640 1 -- 172.21.15.70:0/1846571257 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3ba4010ab0 con 0x7f3bb0102570 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.387+0000 7f3bb781d740 1 Processor -- start 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.387+0000 7f3bb781d740 1 -- start start 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b538f9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538f95d0 0x556b538f9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b53904370 0x556b53906760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3bb781d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b5385f2f0 con 0x556b538f95d0 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3bb781d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556b53806cf0 con 0x556b53904370 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3bb781d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556b5385b2b0 con 0x556b538fab40 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3b97fff640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3b980a33b0 0x7f3b980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538f95d0 0x556b538f9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b538f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538f95d0 0x556b538f9a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42962/0 (socket says 172.21.15.70:42962) 2024-09-19T04:33:08.411 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 -- 172.21.15.70:0/2327304930 learned_addr learned my addr 172.21.15.70:0/2327304930 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/2327304930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b53904370 0x556b53906760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3b980a33b0 0x7f3b980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 -- 172.21.15.70:0/2327304930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 msgr2=0x556b538f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 --2- 172.21.15.70:0/2327304930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b538f9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 -- 172.21.15.70:0/2327304930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b53904370 msgr2=0x556b53906760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 --2- 172.21.15.70:0/2327304930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b53904370 0x556b53906760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 -- 172.21.15.70:0/2327304930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b537eb3a0 con 0x556b538f95d0 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3b97fff640 1 -- 172.21.15.70:0/1846571257 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f3ba40cffb0 con 0x7f3bb0102570 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baeffd640 1 --2- 172.21.15.70:0/2327304930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538f95d0 0x556b538f9a10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000adb0 tx=0x7f3ba000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dab63204744633a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3b980a33b0 0x7f3b980a5870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8005e30 tx=0x7f3ba8005c50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.388+0000 7f3b957fa640 1 -- 172.21.15.70:0/2327304930 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba001d070 con 0x556b538f95d0 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3b957fa640 1 -- 172.21.15.70:0/2327304930 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3ba0010d10 con 0x556b538f95d0 2024-09-19T04:33:08.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3b957fa640 1 -- 172.21.15.70:0/2327304930 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba0018cc0 con 0x556b538f95d0 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 -- 172.21.15.70:0/2327304930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538f95d0 msgr2=0x556b538f9a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2327304930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538f95d0 0x556b538f9a10 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3ba000adb0 tx=0x7f3ba000f790 comp rx=0 tx=0).stop 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 -- 172.21.15.70:0/2327304930 shutdown_connections 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2327304930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b53904370 0x556b53906760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2327304930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538f95d0 0x556b538f9a10 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2327304930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b538f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 -- 172.21.15.70:0/2327304930 >> 172.21.15.70:0/2327304930 conn(0x556b538c2310 msgr2=0x556b538f5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 -- 172.21.15.70:0/2327304930 shutdown_connections 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.389+0000 7f3bb781d740 1 -- 172.21.15.70:0/2327304930 wait complete. 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 1 -- start start 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 1 Processor -- start 2024-09-19T04:33:08.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b53903d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b53900fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b53901560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556b53907070 con 0x556b53904370 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556b5381a060 con 0x556b538f95d0 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556b539071f0 con 0x556b538fab40 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bb781d740 10 client.0 _ll_register_callbacks cb 0x556b5356d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3baeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b53903d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3baf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b53901560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bae7fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b53900fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3baeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b53903d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:46576/0 (socket says 172.21.15.70:46576) 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3baeffd640 1 -- 172.21.15.70:0/2458137397 learned_addr learned my addr 172.21.15.70:0/2458137397 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b53900fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:42548/0 (socket says 172.21.15.70:42548) 2024-09-19T04:33:08.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bae7fc640 1 -- 172.21.15.70:0/2458137397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 msgr2=0x556b53903d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b53903d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bae7fc640 1 -- 172.21.15.70:0/2458137397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 msgr2=0x556b53901560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b53901560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3bae7fc640 1 -- 172.21.15.70:0/2458137397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b535d03c0 con 0x556b538fab40 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.390+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b53901560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b53900fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40cd6c0 tx=0x7f3ba409c300 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e0eb70ad7ed4351 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3b92ff5640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2458137397 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40cdb50 con 0x556b538fab40 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2458137397 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f3ba40bc270 con 0x556b538fab40 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 1 -- 172.21.15.70:0/2458137397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ba0010d10 con 0x556b538fab40 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2458137397 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3ba40a00e0 con 0x556b538fab40 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 10 client.25105 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 1 -- 172.21.15.70:0/2458137397 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b53912b10 con 0x556b538fab40 2024-09-19T04:33:08.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2458137397 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3ba0010d10 con 0x556b538fab40 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2458137397 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f3ba4098050 con 0x556b538fab40 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 10 client.25105 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 10 client.25105 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 20 client.25105 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x556b53913f20 0x556b53916360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 4 client.25105 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.391+0000 7f3bb781d740 1 -- 172.21.15.70:0/2458137397 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556b5386c860 con 0x556b53913f20 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.392+0000 7f3baeffd640 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x556b53913f20 0x556b53916360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.392+0000 7f3baeffd640 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x556b53913f20 0x556b53916360 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70813f91a8e59034 server_cookie=88f43ede92c85fd7 in_seq=0 out_seq=0 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.392+0000 7f3b92ff5640 10 client.25105 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.392+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2458137397 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556b5386c860 con 0x556b53913f20 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3b92ff5640 10 client.25105 handle_command_reply: tid=0 2024-09-19T04:33:08.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 client.25105 shutdown 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 -- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 msgr2=0x556b53900fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b53900fc0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f3ba40cd6c0 tx=0x7f3ba409c300 comp rx=0 tx=0).stop 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 -- 172.21.15.70:0/2458137397 shutdown_connections 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x556b53913f20 0x556b53916360 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b53901560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3b92ff5640 0 client.25105 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538fab40 0x556b53900fc0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2458137397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b53903d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 -- 172.21.15.70:0/2458137397 >> 172.21.15.70:0/2458137397 conn(0x556b538c2310 msgr2=0x556b538fb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 -- 172.21.15.70:0/2458137397 shutdown_connections 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 1 -- 172.21.15.70:0/2458137397 wait complete. 2024-09-19T04:33:08.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.393+0000 7f3bb781d740 20 client.25105 trim_cache size 0 max 16384 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.407+0000 7f3bb781d740 1 Processor -- start 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.407+0000 7f3bb781d740 1 -- start start 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.407+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b538f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.407+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538fab40 0x556b53910310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.407+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b53904370 0x556b5391bc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.407+0000 7f3bb781d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01b2210 con 0x556b538fab40 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.407+0000 7f3bb781d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01afa80 con 0x556b538f95d0 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.407+0000 7f3bb781d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01ad8d0 con 0x556b53904370 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538fab40 0x556b53910310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538fab40 0x556b53910310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42972/0 (socket says 172.21.15.70:42972) 2024-09-19T04:33:08.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 -- 172.21.15.70:0/3276556405 learned_addr learned my addr 172.21.15.70:0/3276556405 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3baeffd640 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b538f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b53904370 0x556b5391bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 -- 172.21.15.70:0/3276556405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b53904370 msgr2=0x556b5391bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b53904370 0x556b5391bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 -- 172.21.15.70:0/3276556405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 msgr2=0x556b538f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b538f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 -- 172.21.15.70:0/3276556405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556b538f54f0 con 0x556b538fab40 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b53904370 0x556b5391bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538fab40 0x556b53910310 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3ba409a5b0 tx=0x7f3ba409bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fca9e63df9f572b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3b94ff9640 1 -- 172.21.15.70:0/3276556405 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40cdb50 con 0x556b538fab40 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3b94ff9640 1 -- 172.21.15.70:0/3276556405 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3ba409b750 con 0x556b538fab40 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.408+0000 7f3b94ff9640 1 -- 172.21.15.70:0/3276556405 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba40bc0b0 con 0x556b538fab40 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 -- 172.21.15.70:0/3276556405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538fab40 msgr2=0x556b53910310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538fab40 0x556b53910310 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f3ba409a5b0 tx=0x7f3ba409bd90 comp rx=0 tx=0).stop 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 -- 172.21.15.70:0/3276556405 shutdown_connections 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b53904370 0x556b5391bc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b538fab40 0x556b53910310 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 --2- 172.21.15.70:0/3276556405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538f95d0 0x556b538f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 -- 172.21.15.70:0/3276556405 >> 172.21.15.70:0/3276556405 conn(0x556b538c2310 msgr2=0x556b538f5700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 -- 172.21.15.70:0/3276556405 shutdown_connections 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 -- 172.21.15.70:0/3276556405 wait complete. 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.409+0000 7f3bb781d740 1 -- start start 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bb781d740 1 Processor -- start 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538f95d0 0x556b538fe040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538fab40 0x556b538fe580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bb781d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b538feac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bb781d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01adf40 con 0x556b53904370 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bb781d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01af3b0 con 0x556b538fab40 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bb781d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3bb01ae610 con 0x556b538f95d0 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bb781d740 10 client.0 _ll_register_callbacks cb 0x7f3ba4010da0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538f95d0 0x556b538fe040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538f95d0 0x556b538fe040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:42558/0 (socket says 172.21.15.70:42558) 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b538feac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3bae7fc640 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538fab40 0x556b538fe580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baeffd640 1 -- 172.21.15.70:0/2244941199 learned_addr learned my addr 172.21.15.70:0/2244941199 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baf7fe640 1 -- 172.21.15.70:0/2244941199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538f95d0 msgr2=0x556b538fe040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538f95d0 0x556b538fe040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baf7fe640 1 -- 172.21.15.70:0/2244941199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538fab40 msgr2=0x556b538fe580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538fab40 0x556b538fe580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baf7fe640 1 -- 172.21.15.70:0/2244941199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556b5397dc50 con 0x556b53904370 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3baf7fe640 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b538feac0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8005cc0 tx=0x7f3ba802a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe196fadf7842913 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.410+0000 7f3b92ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2244941199 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3ba8034070 con 0x556b53904370 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2244941199 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f3ba8004250 con 0x556b53904370 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 1 -- 172.21.15.70:0/2244941199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3ba409b750 con 0x556b53904370 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2244941199 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3ba8004450 con 0x556b53904370 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 10 client.15621 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 1 -- 172.21.15.70:0/2244941199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556b5397eec0 con 0x556b53904370 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2244941199 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3ba409b750 con 0x556b53904370 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2244941199 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f3ba805c020 con 0x556b53904370 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 10 client.15621 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 10 client.15621 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:33:08.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 20 client.15621 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x556b5397f6f0 0x556b53981b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 4 client.15621 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3bb781d740 1 -- 172.21.15.70:0/2244941199 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556b53866d70 con 0x556b5397f6f0 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.411+0000 7f3baeffd640 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x556b5397f6f0 0x556b53981b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3b92ff5640 10 client.15621 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3baeffd640 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x556b5397f6f0 0x556b53981b10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5af68ca6756c21 server_cookie=c52daddf5f32c77 in_seq=0 out_seq=0 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3b92ff5640 1 -- 172.21.15.70:0/2244941199 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556b53866d70 con 0x556b5397f6f0 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3b92ff5640 10 client.15621 handle_command_reply: tid=0 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 client.15621 shutdown 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 -- 172.21.15.70:0/2244941199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 msgr2=0x556b538feac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b538feac0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8005cc0 tx=0x7f3ba802a950 comp rx=0 tx=0).stop 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 -- 172.21.15.70:0/2244941199 shutdown_connections 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x556b5397f6f0 0x556b53981b10 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556b53904370 0x556b538feac0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556b538fab40 0x556b538fe580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3b92ff5640 0 client.15621 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:33:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 --2- 172.21.15.70:0/2244941199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556b538f95d0 0x556b538fe040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 -- 172.21.15.70:0/2244941199 >> 172.21.15.70:0/2244941199 conn(0x556b538c2310 msgr2=0x556b53902820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 -- 172.21.15.70:0/2244941199 shutdown_connections 2024-09-19T04:33:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 1 -- 172.21.15.70:0/2244941199 wait complete. 2024-09-19T04:33:08.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.412+0000 7f3bb781d740 20 client.15621 trim_cache size 0 max 16384 2024-09-19T04:33:08.428 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:33:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 -- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3b980a33b0 msgr2=0x7f3b980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3b980a33b0 0x7f3b980a5870 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f3ba8005e30 tx=0x7f3ba8005c50 comp rx=0 tx=0).stop 2024-09-19T04:33:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 -- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102570 msgr2=0x7f3bb00fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102570 0x7f3bb00fd1c0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f3ba400e9f0 tx=0x7f3ba400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 -- 172.21.15.70:0/1846571257 shutdown_connections 2024-09-19T04:33:08.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3b980a33b0 0x7f3b980a5870 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3bb0102ef0 0x7f3bb00fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3bb0102570 0x7f3bb00fd1c0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 --2- 172.21.15.70:0/1846571257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3bb0100e20 0x7f3bb00fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 -- 172.21.15.70:0/1846571257 >> 172.21.15.70:0/1846571257 conn(0x7f3bb00fc7d0 msgr2=0x7f3bb006a170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 -- 172.21.15.70:0/1846571257 shutdown_connections 2024-09-19T04:33:08.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:08.413+0000 7f3bb5444640 1 -- 172.21.15.70:0/1846571257 wait complete. 2024-09-19T04:33:08.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:08 smithi167 ceph-mon[34339]: pgmap v74: 97 pgs: 97 active+clean; 146 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.6 MiB/s wr, 151 op/s 2024-09-19T04:33:09.032 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:08 smithi070 ceph-mon[30942]: pgmap v74: 97 pgs: 97 active+clean; 146 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.6 MiB/s wr, 151 op/s 2024-09-19T04:33:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:08 smithi134 ceph-mon[34525]: pgmap v74: 97 pgs: 97 active+clean; 146 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 3.6 MiB/s wr, 151 op/s 2024-09-19T04:33:09.167 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:33:09.444 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 -- 172.21.15.70:0/1529280188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102ef0 msgr2=0x7fade010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 --2- 172.21.15.70:0/1529280188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102ef0 0x7fade010da40 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fadd8009ca0 tx=0x7fadd802a950 comp rx=0 tx=0).stop 2024-09-19T04:33:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 -- 172.21.15.70:0/1529280188 shutdown_connections 2024-09-19T04:33:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 --2- 172.21.15.70:0/1529280188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102ef0 0x7fade010da40 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 --2- 172.21.15.70:0/1529280188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0102570 0x7fade01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 --2- 172.21.15.70:0/1529280188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade0100e20 0x7fade0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 -- 172.21.15.70:0/1529280188 >> 172.21.15.70:0/1529280188 conn(0x7fade00fc7d0 msgr2=0x7fade00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 -- 172.21.15.70:0/1529280188 shutdown_connections 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.928+0000 7fade561c640 1 -- 172.21.15.70:0/1529280188 wait complete. 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fade561c640 1 Processor -- start 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fade561c640 1 -- start start 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fade561c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade0100e20 0x7fade0199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fade561c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102570 0x7fade0199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fade561c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0102ef0 0x7fade01a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fade561c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fade0110f50 con 0x7fade0102570 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fade561c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fade0110dd0 con 0x7fade0100e20 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fade561c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fade01110d0 con 0x7fade0102ef0 2024-09-19T04:33:09.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102570 0x7fade0199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102570 0x7fade0199840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42994/0 (socket says 172.21.15.70:42994) 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7faddeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade0100e20 0x7fade0199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7fadd7fff640 1 -- 172.21.15.70:0/4109006005 learned_addr learned my addr 172.21.15.70:0/4109006005 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.929+0000 7faddf7fe640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0102ef0 0x7fade01a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7fadd7fff640 1 -- 172.21.15.70:0/4109006005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0102ef0 msgr2=0x7fade01a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7fadd7fff640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0102ef0 0x7fade01a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7fadd7fff640 1 -- 172.21.15.70:0/4109006005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade0100e20 msgr2=0x7fade0199300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7fadd7fff640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade0100e20 0x7fade0199300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7fadd7fff640 1 -- 172.21.15.70:0/4109006005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fade01a48c0 con 0x7fade0102570 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7faddeffd640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade0100e20 0x7fade0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7faddf7fe640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0102ef0 0x7fade01a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7fadd7fff640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102570 0x7fade0199840 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e9f0 tx=0x7fadc800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:09.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7faddcff9640 1 -- 172.21.15.70:0/4109006005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc800cd80 con 0x7fade0102570 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7faddcff9640 1 -- 172.21.15.70:0/4109006005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadc8010900 con 0x7fade0102570 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7faddcff9640 1 -- 172.21.15.70:0/4109006005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc80189e0 con 0x7fade0102570 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7fade561c640 1 -- 172.21.15.70:0/4109006005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fade01a4a90 con 0x7fade0102570 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.930+0000 7fade561c640 1 -- 172.21.15.70:0/4109006005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fade01a5020 con 0x7fade0102570 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.932+0000 7faddcff9640 1 -- 172.21.15.70:0/4109006005 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fadc8010ab0 con 0x7fade0102570 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fade79f5740 1 Processor -- start 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fade79f5740 1 -- start start 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fade79f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc88090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fade79f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc88a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fade79f5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc95760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fade79f5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b44fbee2f0 con 0x55b44fc93370 2024-09-19T04:33:09.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fade79f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b44fb95cf0 con 0x55b44fc885d0 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fade79f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b44fbea2b0 con 0x55b44fc89b40 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc88090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7faddeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc88a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc88090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:42582/0 (socket says 172.21.15.70:42582) 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7faddf7fe640 1 -- 172.21.15.70:0/1424221564 learned_addr learned my addr 172.21.15.70:0/1424221564 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.933+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc95760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddcff9640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadcc0a3430 0x7fadcc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddeffd640 1 -- 172.21.15.70:0/1424221564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 msgr2=0x55b44fc88090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddeffd640 1 --2- 172.21.15.70:0/1424221564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc88090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddeffd640 1 -- 172.21.15.70:0/1424221564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 msgr2=0x55b44fc95760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddeffd640 1 --2- 172.21.15.70:0/1424221564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc95760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddeffd640 1 -- 172.21.15.70:0/1424221564 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b44fb7a3a0 con 0x55b44fc885d0 2024-09-19T04:33:09.965 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddf7fe640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadcc0a3430 0x7fadcc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddcff9640 1 -- 172.21.15.70:0/4109006005 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fadc80cfec0 con 0x7fade0102570 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7faddeffd640 1 --2- 172.21.15.70:0/1424221564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc88a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009fd0 tx=0x7fadd00118d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a697d7fbdb6cd945 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7fadd57fa640 1 -- 172.21.15.70:0/1424221564 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004030 con 0x55b44fc885d0 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7fadd57fa640 1 -- 172.21.15.70:0/1424221564 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadd00054f0 con 0x55b44fc885d0 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.934+0000 7fadd57fa640 1 -- 172.21.15.70:0/1424221564 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd0004d10 con 0x55b44fc885d0 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 -- 172.21.15.70:0/1424221564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 msgr2=0x55b44fc88a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7faddf7fe640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadcc0a3430 0x7fadcc0a58f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadd802fd40 tx=0x7fadd80095c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 --2- 172.21.15.70:0/1424221564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc88a10 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fadd0009fd0 tx=0x7fadd00118d0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 -- 172.21.15.70:0/1424221564 shutdown_connections 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 --2- 172.21.15.70:0/1424221564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc95760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 --2- 172.21.15.70:0/1424221564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc88a10 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 --2- 172.21.15.70:0/1424221564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc88090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 -- 172.21.15.70:0/1424221564 >> 172.21.15.70:0/1424221564 conn(0x55b44fc51310 msgr2=0x55b44fc84c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 -- 172.21.15.70:0/1424221564 shutdown_connections 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 -- 172.21.15.70:0/1424221564 wait complete. 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 -- start start 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.935+0000 7fade79f5740 1 Processor -- start 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fade79f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc92c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fade79f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc8ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fade79f5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc90480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fade79f5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b44fc96070 con 0x55b44fc93370 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fade79f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b44fba9060 con 0x55b44fc885d0 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fade79f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b44fc961f0 con 0x55b44fc89b40 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fade79f5740 10 client.0 _ll_register_callbacks cb 0x55b44f8fc8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:09.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc90480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddeffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc92c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc90480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43006/0 (socket says 172.21.15.70:43006) 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 -- 172.21.15.70:0/498481408 learned_addr learned my addr 172.21.15.70:0/498481408 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fadd7fff640 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc8ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 -- 172.21.15.70:0/498481408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 msgr2=0x55b44fc8ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc8ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 -- 172.21.15.70:0/498481408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 msgr2=0x55b44fc92c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc92c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 -- 172.21.15.70:0/498481408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b44f95f3c0 con 0x55b44fc93370 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fadd7fff640 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc8ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddeffd640 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc92c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:09.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7faddf7fe640 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc90480 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fadd802f620 tx=0x7fadd803c040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9312443fdc36dce7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.936+0000 7fadc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fadc67fc640 1 -- 172.21.15.70:0/498481408 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8034040 con 0x55b44fc93370 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fadc67fc640 1 -- 172.21.15.70:0/498481408 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fadd8003970 con 0x55b44fc93370 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 1 -- 172.21.15.70:0/498481408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd00054f0 con 0x55b44fc93370 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fadc67fc640 1 -- 172.21.15.70:0/498481408 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fadd8003b70 con 0x55b44fc93370 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 10 client.15633 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 1 -- 172.21.15.70:0/498481408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b44fca1a60 con 0x55b44fc93370 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fadc67fc640 1 -- 172.21.15.70:0/498481408 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadd00054f0 con 0x55b44fc93370 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fadc67fc640 1 -- 172.21.15.70:0/498481408 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fadd804f440 con 0x55b44fc93370 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 10 client.15633 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 10 client.15633 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 20 client.15633 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55b44fca2f20 0x55b44fca53c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 4 client.15633 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7fade79f5740 1 -- 172.21.15.70:0/498481408 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b44fbfb860 con 0x55b44fca2f20 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.937+0000 7faddeffd640 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55b44fca2f20 0x55b44fca53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.938+0000 7fadc67fc640 10 client.15633 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.938+0000 7faddeffd640 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55b44fca2f20 0x55b44fca53c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=db0775b22165ce42 server_cookie=fe3a101eb30c5cdf in_seq=0 out_seq=0 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fadc67fc640 1 -- 172.21.15.70:0/498481408 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b44fbfb860 con 0x55b44fca2f20 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fadc67fc640 10 client.15633 handle_command_reply: tid=0 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 client.15633 shutdown 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 -- 172.21.15.70:0/498481408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 msgr2=0x55b44fc90480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc90480 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fadd802f620 tx=0x7fadd803c040 comp rx=0 tx=0).stop 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 -- 172.21.15.70:0/498481408 shutdown_connections 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55b44fca2f20 0x55b44fca53c0 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc93370 0x55b44fc90480 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc89b40 0x55b44fc8ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 --2- 172.21.15.70:0/498481408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc885d0 0x55b44fc92c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 -- 172.21.15.70:0/498481408 >> 172.21.15.70:0/498481408 conn(0x55b44fc51310 msgr2=0x55b44fc8a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fadc67fc640 0 client.15633 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 -- 172.21.15.70:0/498481408 shutdown_connections 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 1 -- 172.21.15.70:0/498481408 wait complete. 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.939+0000 7fade79f5740 20 client.15633 trim_cache size 0 max 16384 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.953+0000 7fade79f5740 1 Processor -- start 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.953+0000 7fade79f5740 1 -- start start 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.953+0000 7fade79f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc84e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.953+0000 7fade79f5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc9f340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.953+0000 7fade79f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc8b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.953+0000 7fade79f5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fade01adf80 con 0x55b44fc885d0 2024-09-19T04:33:09.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.953+0000 7fade79f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fade01ab7f0 con 0x55b44fc89b40 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.953+0000 7fade79f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fade01a9640 con 0x55b44fc51310 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc84e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc8b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc9f340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc8b120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:46632/0 (socket says 172.21.15.70:46632) 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc84e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:42604/0 (socket says 172.21.15.70:42604) 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 -- 172.21.15.70:0/2934411596 learned_addr learned my addr 172.21.15.70:0/2934411596 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 -- 172.21.15.70:0/2934411596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 msgr2=0x55b44fc84e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 --2- 172.21.15.70:0/2934411596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc84e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 -- 172.21.15.70:0/2934411596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 msgr2=0x55b44fc9f340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 --2- 172.21.15.70:0/2934411596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc9f340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 -- 172.21.15.70:0/2934411596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b44fc89760 con 0x55b44fc89b40 2024-09-19T04:33:09.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddeffd640 1 --2- 172.21.15.70:0/2934411596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc84e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7faddf7fe640 1 --2- 172.21.15.70:0/2934411596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc8b120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadd804f860 tx=0x7fadd802fec0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1bf0a792398bc15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7fadd4ff9640 1 -- 172.21.15.70:0/2934411596 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8068070 con 0x55b44fc89b40 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7fadd4ff9640 1 -- 172.21.15.70:0/2934411596 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadd8003970 con 0x55b44fc89b40 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.954+0000 7fadd4ff9640 1 -- 172.21.15.70:0/2934411596 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadd8034040 con 0x55b44fc89b40 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 -- 172.21.15.70:0/2934411596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 msgr2=0x55b44fc8b120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 --2- 172.21.15.70:0/2934411596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc8b120 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7fadd804f860 tx=0x7fadd802fec0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 -- 172.21.15.70:0/2934411596 shutdown_connections 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 --2- 172.21.15.70:0/2934411596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc8b120 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 --2- 172.21.15.70:0/2934411596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc9f340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 --2- 172.21.15.70:0/2934411596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc84e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 -- 172.21.15.70:0/2934411596 >> 172.21.15.70:0/2934411596 conn(0x55b44fc905e0 msgr2=0x55b44fc84700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 -- 172.21.15.70:0/2934411596 shutdown_connections 2024-09-19T04:33:09.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.955+0000 7fade79f5740 1 -- 172.21.15.70:0/2934411596 wait complete. 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 1 -- start start 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 1 Processor -- start 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc9b8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc96bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc97130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fade01a9cb0 con 0x55b44fc885d0 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fade01ab120 con 0x55b44fc89b40 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fade01aa380 con 0x55b44fc51310 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fade79f5740 10 client.0 _ll_register_callbacks cb 0x7fadd8009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc96bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fadd7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc96bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43028/0 (socket says 172.21.15.70:43028) 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fadd7fff640 1 -- 172.21.15.70:0/446727848 learned_addr learned my addr 172.21.15.70:0/446727848 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:09.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7faddf7fe640 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc97130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7faddeffd640 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc9b8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fadd7fff640 1 -- 172.21.15.70:0/446727848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 msgr2=0x55b44fc9b8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.956+0000 7fadd7fff640 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc9b8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadd7fff640 1 -- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 msgr2=0x55b44fc97130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadd7fff640 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc97130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadd7fff640 1 -- 172.21.15.70:0/446727848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b44fc97670 con 0x55b44fc885d0 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7faddf7fe640 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc97130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadd7fff640 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc96bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fadc809bf70 tx=0x7fadc8010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a9ffc7530708e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadc67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadc67fc640 1 -- 172.21.15.70:0/446727848 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadc809bbd0 con 0x55b44fc885d0 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadc67fc640 1 -- 172.21.15.70:0/446727848 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fadc80bc0b0 con 0x55b44fc885d0 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 1 -- 172.21.15.70:0/446727848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fadd8003970 con 0x55b44fc885d0 2024-09-19T04:33:09.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadc67fc640 1 -- 172.21.15.70:0/446727848 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fadc80bc2b0 con 0x55b44fc885d0 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 10 client.15639 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 1 -- 172.21.15.70:0/446727848 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b44fd0d980 con 0x55b44fc885d0 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadc67fc640 1 -- 172.21.15.70:0/446727848 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fadd8003970 con 0x55b44fc885d0 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fadc67fc640 1 -- 172.21.15.70:0/446727848 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7fadc8018b80 con 0x55b44fc885d0 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 10 client.15639 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 10 client.15639 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 20 client.15639 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55b44fc93370 0x55b44fd10190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 4 client.15639 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.957+0000 7fade79f5740 1 -- 172.21.15.70:0/446727848 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b44fbf5d70 con 0x55b44fc93370 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7faddeffd640 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55b44fc93370 0x55b44fd10190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7faddeffd640 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55b44fc93370 0x55b44fd10190 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3c5496d339a294d2 server_cookie=bc400f57b26145ba in_seq=0 out_seq=0 2024-09-19T04:33:09.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fadc67fc640 10 client.15639 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fadc67fc640 1 -- 172.21.15.70:0/446727848 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b44fbf5d70 con 0x55b44fc93370 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fadc67fc640 10 client.15639 handle_command_reply: tid=0 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 client.15639 shutdown 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 -- 172.21.15.70:0/446727848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 msgr2=0x55b44fc96bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc96bf0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fadc809bf70 tx=0x7fadc8010f40 comp rx=0 tx=0).stop 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 -- 172.21.15.70:0/446727848 shutdown_connections 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55b44fc93370 0x55b44fd10190 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b44fc89b40 0x55b44fc97130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b44fc885d0 0x55b44fc96bf0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 --2- 172.21.15.70:0/446727848 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b44fc51310 0x55b44fc9b8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fade79f5740 1 -- 172.21.15.70:0/446727848 >> 172.21.15.70:0/446727848 conn(0x55b44fc905e0 msgr2=0x55b44fc834e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:09.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.958+0000 7fadc67fc640 0 client.15639 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:33:09.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade79f5740 1 -- 172.21.15.70:0/446727848 shutdown_connections 2024-09-19T04:33:09.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade79f5740 1 -- 172.21.15.70:0/446727848 wait complete. 2024-09-19T04:33:09.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade79f5740 20 client.15639 trim_cache size 0 max 16384 2024-09-19T04:33:09.978 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 -- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadcc0a3430 msgr2=0x7fadcc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadcc0a3430 0x7fadcc0a58f0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fadd802fd40 tx=0x7fadd80095c0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 -- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102570 msgr2=0x7fade0199840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102570 0x7fade0199840 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fadc800e9f0 tx=0x7fadc800eeb0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 -- 172.21.15.70:0/4109006005 shutdown_connections 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fadcc0a3430 0x7fadcc0a58f0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fade0102ef0 0x7fade01a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fade0102570 0x7fade0199840 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 --2- 172.21.15.70:0/4109006005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fade0100e20 0x7fade0199300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:09.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 -- 172.21.15.70:0/4109006005 >> 172.21.15.70:0/4109006005 conn(0x7fade00fc7d0 msgr2=0x7fade0106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:09.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 -- 172.21.15.70:0/4109006005 shutdown_connections 2024-09-19T04:33:09.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:09.959+0000 7fade561c640 1 -- 172.21.15.70:0/4109006005 wait complete. 2024-09-19T04:33:10.735 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:33:11.011 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:11.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.524+0000 7f3ce5eab640 1 -- 172.21.15.70:0/712990639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0102570 msgr2=0x7f3ce01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.524+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/712990639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0102570 0x7f3ce01029b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4009900 tx=0x7f3cd402a480 comp rx=0 tx=0).stop 2024-09-19T04:33:11.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.524+0000 7f3ce5eab640 1 -- 172.21.15.70:0/712990639 shutdown_connections 2024-09-19T04:33:11.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.524+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/712990639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ce0102ef0 0x7f3ce010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.524+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/712990639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0102570 0x7f3ce01029b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.524+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/712990639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ce0100e20 0x7f3ce0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.524+0000 7f3ce5eab640 1 -- 172.21.15.70:0/712990639 >> 172.21.15.70:0/712990639 conn(0x7f3ce00fc7d0 msgr2=0x7f3ce00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:11.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.524+0000 7f3ce5eab640 1 -- 172.21.15.70:0/712990639 shutdown_connections 2024-09-19T04:33:11.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.525+0000 7f3ce5eab640 1 -- 172.21.15.70:0/712990639 wait complete. 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.525+0000 7f3ce5eab640 1 Processor -- start 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.525+0000 7f3ce5eab640 1 -- start start 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3ce5eab640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0100e20 0x7f3ce0198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3ce5eab640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ce0102570 0x7f3ce0198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3ce5eab640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ce0102ef0 0x7f3ce019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3ce5eab640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0110fa0 con 0x7f3ce0100e20 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3ce5eab640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0110e20 con 0x7f3ce0102ef0 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3ce5eab640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce0111120 con 0x7f3ce0102570 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0100e20 0x7f3ce0198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0100e20 0x7f3ce0198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43050/0 (socket says 172.21.15.70:43050) 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ce0102570 0x7f3ce0198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 -- 172.21.15.70:0/1558237794 learned_addr learned my addr 172.21.15.70:0/1558237794 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdffff640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ce0102ef0 0x7f3ce019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 -- 172.21.15.70:0/1558237794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ce0102570 msgr2=0x7f3ce0198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ce0102570 0x7f3ce0198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 -- 172.21.15.70:0/1558237794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ce0102ef0 msgr2=0x7f3ce019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ce0102ef0 0x7f3ce019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 -- 172.21.15.70:0/1558237794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ce019d4c0 con 0x7f3ce0100e20 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ce0102570 0x7f3ce0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0100e20 0x7f3ce0198510 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000e9f0 tx=0x7f3cd000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.526+0000 7f3cdcff9640 1 -- 172.21.15.70:0/1558237794 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd000cd80 con 0x7f3ce0100e20 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.527+0000 7f3cdcff9640 1 -- 172.21.15.70:0/1558237794 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3cd00054f0 con 0x7f3ce0100e20 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.527+0000 7f3ce5eab640 1 -- 172.21.15.70:0/1558237794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ce019d7b0 con 0x7f3ce0100e20 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.527+0000 7f3cdcff9640 1 -- 172.21.15.70:0/1558237794 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0010690 con 0x7f3ce0100e20 2024-09-19T04:33:11.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.527+0000 7f3ce5eab640 1 -- 172.21.15.70:0/1558237794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ce01a5090 con 0x7f3ce0100e20 2024-09-19T04:33:11.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.529+0000 7f3cdcff9640 1 -- 172.21.15.70:0/1558237794 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3cd0004f20 con 0x7f3ce0100e20 2024-09-19T04:33:11.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.529+0000 7f3ce8284740 1 Processor -- start 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.529+0000 7f3ce8284740 1 -- start start 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870504090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608705045d0 0x560870504a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x560870511760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3ce8284740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56087046a2f0 con 0x560870505b40 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3ce8284740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560870411cf0 con 0x56087050f370 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3ce8284740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5608704662b0 con 0x5608705045d0 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870504090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdcff9640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3cc80a3430 0x7f3cc80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870504090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43062/0 (socket says 172.21.15.70:43062) 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 -- 172.21.15.70:0/3587050893 learned_addr learned my addr 172.21.15.70:0/3587050893 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608705045d0 0x560870504a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3cc80a3430 0x7f3cc80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdcff9640 1 -- 172.21.15.70:0/1558237794 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f3cd00d00d0 con 0x7f3ce0100e20 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x560870511760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 -- 172.21.15.70:0/3587050893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608705045d0 msgr2=0x560870504a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608705045d0 0x560870504a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 -- 172.21.15.70:0/3587050893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 msgr2=0x560870511760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x560870511760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdffff640 1 -- 172.21.15.70:0/3587050893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608703f63a0 con 0x560870505b40 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.530+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x560870511760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.531+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608705045d0 0x560870504a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.531+0000 7f3cdffff640 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870504090 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8005c40 tx=0x7f3cd800f3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4de33a30ca773ba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.531+0000 7f3cdffff640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3cc80a3430 0x7f3cc80a58f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8023000 tx=0x7f3cd8021000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.531+0000 7f3cc5ffb640 1 -- 172.21.15.70:0/3587050893 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8022020 con 0x560870505b40 2024-09-19T04:33:11.534 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.531+0000 7f3cc5ffb640 1 -- 172.21.15.70:0/3587050893 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3cd8013170 con 0x560870505b40 2024-09-19T04:33:11.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.531+0000 7f3cc5ffb640 1 -- 172.21.15.70:0/3587050893 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd8010810 con 0x560870505b40 2024-09-19T04:33:11.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 -- 172.21.15.70:0/3587050893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 msgr2=0x560870504090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870504090 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8005c40 tx=0x7f3cd800f3c0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 -- 172.21.15.70:0/3587050893 shutdown_connections 2024-09-19T04:33:11.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x560870511760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608705045d0 0x560870504a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3587050893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870504090 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 -- 172.21.15.70:0/3587050893 >> 172.21.15.70:0/3587050893 conn(0x5608704cd310 msgr2=0x560870500c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 -- 172.21.15.70:0/3587050893 shutdown_connections 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 -- 172.21.15.70:0/3587050893 wait complete. 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 -- start start 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.532+0000 7f3ce8284740 1 Processor -- start 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608705045d0 0x56087050eda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560870505b40 0x56087050c050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x56087050c7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3ce8284740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560870512070 con 0x5608705045d0 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3ce8284740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560870425060 con 0x56087050f370 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3ce8284740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5608705121f0 con 0x560870505b40 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3ce8284740 10 client.0 _ll_register_callbacks cb 0x5608701788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560870505b40 0x56087050c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560870505b40 0x56087050c050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:42644/0 (socket says 172.21.15.70:42644) 2024-09-19T04:33:11.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 -- 172.21.15.70:0/3153430911 learned_addr learned my addr 172.21.15.70:0/3153430911 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608705045d0 0x56087050eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdffff640 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x56087050c7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 -- 172.21.15.70:0/3153430911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 msgr2=0x56087050c7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x56087050c7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 -- 172.21.15.70:0/3153430911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608705045d0 msgr2=0x56087050eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608705045d0 0x56087050eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 -- 172.21.15.70:0/3153430911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608701db3c0 con 0x560870505b40 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608705045d0 0x56087050eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560870505b40 0x56087050c050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cd402aa70 tx=0x7f3cd4005250 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1db1dcd8196d0032 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.533+0000 7f3cbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3cbeffd640 1 -- 172.21.15.70:0/3153430911 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4035030 con 0x560870505b40 2024-09-19T04:33:11.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 1 -- 172.21.15.70:0/3153430911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd8013170 con 0x560870505b40 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3cbeffd640 1 -- 172.21.15.70:0/3153430911 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f3cd4004950 con 0x560870505b40 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3cbeffd640 1 -- 172.21.15.70:0/3153430911 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3cd4005650 con 0x560870505b40 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 10 client.25138 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 1 -- 172.21.15.70:0/3153430911 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56087051dac0 con 0x560870505b40 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3cbeffd640 1 -- 172.21.15.70:0/3153430911 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3cd8013170 con 0x560870505b40 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3cbeffd640 1 -- 172.21.15.70:0/3153430911 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f3cd40314a0 con 0x560870505b40 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 10 client.25138 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 10 client.25138 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 20 client.25138 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56087051ef80 0x560870521390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 4 client.25138 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.534+0000 7f3ce8284740 1 -- 172.21.15.70:0/3153430911 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560870477860 con 0x56087051ef80 2024-09-19T04:33:11.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.535+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56087051ef80 0x560870521390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.535+0000 7f3cbeffd640 10 client.25138 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.535+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56087051ef80 0x560870521390 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed3a7ce780d656e4 server_cookie=5d75c42dc76fa5c3 in_seq=0 out_seq=0 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3cbeffd640 1 -- 172.21.15.70:0/3153430911 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560870477860 con 0x56087051ef80 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3cbeffd640 10 client.25138 handle_command_reply: tid=0 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 client.25138 shutdown 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 -- 172.21.15.70:0/3153430911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560870505b40 msgr2=0x56087050c050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560870505b40 0x56087050c050 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cd402aa70 tx=0x7f3cd4005250 comp rx=0 tx=0).stop 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 -- 172.21.15.70:0/3153430911 shutdown_connections 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56087051ef80 0x560870521390 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3cbeffd640 0 client.25138 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56087050f370 0x56087050c7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560870505b40 0x56087050c050 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 --2- 172.21.15.70:0/3153430911 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608705045d0 0x56087050eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 -- 172.21.15.70:0/3153430911 >> 172.21.15.70:0/3153430911 conn(0x5608704cd310 msgr2=0x560870506960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:11.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 -- 172.21.15.70:0/3153430911 shutdown_connections 2024-09-19T04:33:11.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 1 -- 172.21.15.70:0/3153430911 wait complete. 2024-09-19T04:33:11.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.536+0000 7f3ce8284740 20 client.25138 trim_cache size 0 max 16384 2024-09-19T04:33:11.552 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.550+0000 7f3ce8284740 1 Processor -- start 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.550+0000 7f3ce8284740 1 -- start start 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.550+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870505300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.550+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x56087050a920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.550+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 0x56087050ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.550+0000 7f3ce8284740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01b0140 con 0x560870505b40 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.550+0000 7f3ce8284740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01ad9b0 con 0x5608705045d0 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.550+0000 7f3ce8284740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01ab800 con 0x56087050f370 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x56087050a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870505300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x56087050a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43092/0 (socket says 172.21.15.70:43092) 2024-09-19T04:33:11.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdeffd640 1 -- 172.21.15.70:0/411999723 learned_addr learned my addr 172.21.15.70:0/411999723 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdf7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870505300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:46692/0 (socket says 172.21.15.70:46692) 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdffff640 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 0x56087050ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdf7fe640 1 -- 172.21.15.70:0/411999723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 msgr2=0x56087050ae60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 0x56087050ae60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdf7fe640 1 -- 172.21.15.70:0/411999723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 msgr2=0x56087050a920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x56087050a920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdf7fe640 1 -- 172.21.15.70:0/411999723 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56087050cb50 con 0x5608705045d0 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x56087050a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870505300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00cd840 tx=0x7f3cd001a040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b192eaaf029226ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cc57fa640 1 -- 172.21.15.70:0/411999723 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd009cad0 con 0x5608705045d0 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cc57fa640 1 -- 172.21.15.70:0/411999723 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3cd009c3d0 con 0x5608705045d0 2024-09-19T04:33:11.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.551+0000 7f3cc57fa640 1 -- 172.21.15.70:0/411999723 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0098a40 con 0x5608705045d0 2024-09-19T04:33:11.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 -- 172.21.15.70:0/411999723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 msgr2=0x560870505300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870505300 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f3cd00cd840 tx=0x7f3cd001a040 comp rx=0 tx=0).stop 2024-09-19T04:33:11.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 -- 172.21.15.70:0/411999723 shutdown_connections 2024-09-19T04:33:11.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 0x56087050ae60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x56087050a920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 --2- 172.21.15.70:0/411999723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870505300 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 -- 172.21.15.70:0/411999723 >> 172.21.15.70:0/411999723 conn(0x5608704cd310 msgr2=0x5608704fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 -- 172.21.15.70:0/411999723 shutdown_connections 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 -- 172.21.15.70:0/411999723 wait complete. 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.552+0000 7f3ce8284740 1 -- start start 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3ce8284740 1 Processor -- start 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870512bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870513100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3ce8284740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 0x560870581c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3ce8284740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01abe70 con 0x560870505b40 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3ce8284740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01ad2e0 con 0x5608705045d0 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870513100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3ce8284740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3ce01ac540 con 0x56087050f370 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3cdeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870513100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43102/0 (socket says 172.21.15.70:43102) 2024-09-19T04:33:11.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3cdeffd640 1 -- 172.21.15.70:0/2426701412 learned_addr learned my addr 172.21.15.70:0/2426701412 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3cdffff640 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 0x560870581c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870512bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.553+0000 7f3ce8284740 10 client.0 _ll_register_callbacks cb 0x7f3cd0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cdeffd640 1 -- 172.21.15.70:0/2426701412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 msgr2=0x560870581c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 0x560870581c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cdeffd640 1 -- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 msgr2=0x560870512bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870512bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cdeffd640 1 -- 172.21.15.70:0/2426701412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608705822d0 con 0x560870505b40 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870512bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cdeffd640 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870513100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4005a80 tx=0x7f3cd40316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbc54d54dd9e3b14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cbeffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:11.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cbeffd640 1 -- 172.21.15.70:0/2426701412 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cd4052040 con 0x560870505b40 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cbeffd640 1 -- 172.21.15.70:0/2426701412 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f3cd4004950 con 0x560870505b40 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3ce8284740 1 -- 172.21.15.70:0/2426701412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3cd009c3d0 con 0x560870505b40 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3cbeffd640 1 -- 172.21.15.70:0/2426701412 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3cd4035040 con 0x560870505b40 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3ce8284740 10 client.15657 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.554+0000 7f3ce8284740 1 -- 172.21.15.70:0/2426701412 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x560870589630 con 0x560870505b40 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3cbeffd640 1 -- 172.21.15.70:0/2426701412 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3cd4041070 con 0x560870505b40 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3cbeffd640 1 -- 172.21.15.70:0/2426701412 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f3cd405e070 con 0x560870505b40 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3ce8284740 10 client.15657 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3ce8284740 10 client.15657 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3ce8284740 20 client.15657 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3ce8284740 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56087051ef80 0x56087058bea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3ce8284740 4 client.15657 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:33:11.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3ce8284740 1 -- 172.21.15.70:0/2426701412 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f3cd009c3d0 con 0x56087051ef80 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56087051ef80 0x56087058bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.555+0000 7f3cbeffd640 10 client.15657 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3cdf7fe640 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56087051ef80 0x56087058bea0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=11b76f957d20158a server_cookie=a406cda765369cb6 in_seq=0 out_seq=0 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3cbeffd640 1 -- 172.21.15.70:0/2426701412 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f3cd009c3d0 con 0x56087051ef80 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3cbeffd640 10 client.15657 handle_command_reply: tid=0 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 client.15657 shutdown 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 -- 172.21.15.70:0/2426701412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 msgr2=0x560870513100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870513100 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f3cd4005a80 tx=0x7f3cd40316d0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 -- 172.21.15.70:0/2426701412 shutdown_connections 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56087051ef80 0x56087058bea0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56087050f370 0x560870581c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560870505b40 0x560870513100 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 --2- 172.21.15.70:0/2426701412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608705045d0 0x560870512bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3cbeffd640 0 client.15657 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:11.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 -- 172.21.15.70:0/2426701412 >> 172.21.15.70:0/2426701412 conn(0x5608704cd310 msgr2=0x56087050d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:11.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 -- 172.21.15.70:0/2426701412 shutdown_connections 2024-09-19T04:33:11.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 1 -- 172.21.15.70:0/2426701412 wait complete. 2024-09-19T04:33:11.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.556+0000 7f3ce8284740 20 client.15657 trim_cache size 0 max 16384 2024-09-19T04:33:11.563 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 -- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3cc80a3430 msgr2=0x7f3cc80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3cc80a3430 0x7f3cc80a58f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f3cd8023000 tx=0x7f3cd8021000 comp rx=0 tx=0).stop 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 -- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0100e20 msgr2=0x7f3ce0198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0100e20 0x7f3ce0198510 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f3cd000e9f0 tx=0x7f3cd000edf0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 -- 172.21.15.70:0/1558237794 shutdown_connections 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3cc80a3430 0x7f3cc80a58f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ce0102ef0 0x7f3ce019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3ce0102570 0x7f3ce0198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 --2- 172.21.15.70:0/1558237794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3ce0100e20 0x7f3ce0198510 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:11.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 -- 172.21.15.70:0/1558237794 >> 172.21.15.70:0/1558237794 conn(0x7f3ce00fc7d0 msgr2=0x7f3ce006a1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:11.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 -- 172.21.15.70:0/1558237794 shutdown_connections 2024-09-19T04:33:11.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:11.557+0000 7f3ce5eab640 1 -- 172.21.15.70:0/1558237794 wait complete. 2024-09-19T04:33:11.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:11 smithi070 ceph-mon[30942]: pgmap v75: 97 pgs: 97 active+clean; 146 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 2.8 MiB/s wr, 103 op/s 2024-09-19T04:33:11.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:11 smithi167 ceph-mon[34339]: pgmap v75: 97 pgs: 97 active+clean; 146 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 2.8 MiB/s wr, 103 op/s 2024-09-19T04:33:12.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:11 smithi134 ceph-mon[34525]: pgmap v75: 97 pgs: 97 active+clean; 146 MiB data, 847 MiB used, 1.0 TiB / 1.0 TiB avail; 568 KiB/s rd, 2.8 MiB/s wr, 103 op/s 2024-09-19T04:33:13.458 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:33:13.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:33:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:13.874 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:13 smithi070 ceph-mon[30942]: pgmap v76: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-09-19T04:33:13.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:13 smithi167 ceph-mon[34339]: pgmap v76: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-09-19T04:33:14.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:13 smithi134 ceph-mon[34525]: pgmap v76: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 3.5 MiB/s wr, 259 op/s 2024-09-19T04:33:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 -- 172.21.15.70:0/1992776532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f501027a0 msgr2=0x7f8f501067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 --2- 172.21.15.70:0/1992776532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f501027a0 0x7f8f501067f0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f8f44009900 tx=0x7f8f4402a410 comp rx=0 tx=0).stop 2024-09-19T04:33:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 -- 172.21.15.70:0/1992776532 shutdown_connections 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 --2- 172.21.15.70:0/1992776532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f50106f20 0x7f8f5010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 --2- 172.21.15.70:0/1992776532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f501027a0 0x7f8f501067f0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 --2- 172.21.15.70:0/1992776532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f50101df0 0x7f8f501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 -- 172.21.15.70:0/1992776532 >> 172.21.15.70:0/1992776532 conn(0x7f8f500fd8f0 msgr2=0x7f8f500ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 -- 172.21.15.70:0/1992776532 shutdown_connections 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.334+0000 7f8f54982640 1 -- 172.21.15.70:0/1992776532 wait complete. 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f54982640 1 Processor -- start 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f54982640 1 -- start start 2024-09-19T04:33:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f54982640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f50101df0 0x7f8f500744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f54982640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f501027a0 0x7f8f50074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f54982640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f50106f20 0x7f8f50074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f54982640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50111f50 con 0x7f8f50106f20 2024-09-19T04:33:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f54982640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f50111dd0 con 0x7f8f50101df0 2024-09-19T04:33:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f54982640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501120d0 con 0x7f8f501027a0 2024-09-19T04:33:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f50106f20 0x7f8f50074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f50106f20 0x7f8f50074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34982/0 (socket says 172.21.15.70:34982) 2024-09-19T04:33:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4ed9d640 1 -- 172.21.15.70:0/2079854493 learned_addr learned my addr 172.21.15.70:0/2079854493 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f501027a0 0x7f8f50074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f50101df0 0x7f8f500744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4ed9d640 1 -- 172.21.15.70:0/2079854493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f501027a0 msgr2=0x7f8f50074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4ed9d640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f501027a0 0x7f8f50074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4ed9d640 1 -- 172.21.15.70:0/2079854493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f50101df0 msgr2=0x7f8f500744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4ed9d640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f50101df0 0x7f8f500744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4ed9d640 1 -- 172.21.15.70:0/2079854493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f501a6a10 con 0x7f8f50106f20 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.335+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f501027a0 0x7f8f50074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.336+0000 7f8f4ed9d640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f50106f20 0x7f8f50074f70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800eb10 tx=0x7f8f4800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.336+0000 7f8f3f7fe640 1 -- 172.21.15.70:0/2079854493 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48004b20 con 0x7f8f50106f20 2024-09-19T04:33:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.336+0000 7f8f3f7fe640 1 -- 172.21.15.70:0/2079854493 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f48004cc0 con 0x7f8f50106f20 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.336+0000 7f8f54982640 1 -- 172.21.15.70:0/2079854493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f501a6d00 con 0x7f8f50106f20 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.336+0000 7f8f3f7fe640 1 -- 172.21.15.70:0/2079854493 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f48010700 con 0x7f8f50106f20 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.336+0000 7f8f54982640 1 -- 172.21.15.70:0/2079854493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f501a7210 con 0x7f8f50106f20 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.338+0000 7f8f3f7fe640 1 -- 172.21.15.70:0/2079854493 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8f48004e70 con 0x7f8f50106f20 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f56d5b740 1 Processor -- start 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f56d5b740 1 -- start start 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e20b60 0x556bd9e20f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e2b800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e2bd40 0x556bd9e2e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556bd9d86280 con 0x556bd9e2bd40 2024-09-19T04:33:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556bd9d2db10 con 0x556bd9e21480 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556bd9d82240 con 0x556bd9e20b60 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f4dd9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e20b60 0x556bd9e20f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f4e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e2b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f4e59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e2b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:52806/0 (socket says 172.21.15.70:52806) 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f4e59c640 1 -- 172.21.15.70:0/287737421 learned_addr learned my addr 172.21.15.70:0/287737421 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.339+0000 7f8f3f7fe640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8f380a33b0 0x7f8f380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e2bd40 0x556bd9e2e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f3f7fe640 1 -- 172.21.15.70:0/2079854493 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8f480d01d0 con 0x7f8f50106f20 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4e59c640 1 -- 172.21.15.70:0/287737421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e20b60 msgr2=0x556bd9e20f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4ed9d640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8f380a33b0 0x7f8f380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e20b60 0x556bd9e20f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4e59c640 1 -- 172.21.15.70:0/287737421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e2bd40 msgr2=0x556bd9e2e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e2bd40 0x556bd9e2e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4e59c640 1 -- 172.21.15.70:0/287737421 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bd9d3a1f0 con 0x556bd9e21480 2024-09-19T04:33:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e20b60 0x556bd9e20f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e2b800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009cf0 tx=0x7f8f40011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9e9011228e6c4b4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f3cff9640 1 -- 172.21.15.70:0/287737421 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40004230 con 0x556bd9e21480 2024-09-19T04:33:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f3cff9640 1 -- 172.21.15.70:0/287737421 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f400043d0 con 0x556bd9e21480 2024-09-19T04:33:14.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.340+0000 7f8f3cff9640 1 -- 172.21.15.70:0/287737421 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f40019860 con 0x556bd9e21480 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 -- 172.21.15.70:0/287737421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 msgr2=0x556bd9e2b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f4ed9d640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8f380a33b0 0x7f8f380a5870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f480cd9f0 tx=0x7f8f48009200 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e2b800 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f8f40009cf0 tx=0x7f8f40011810 comp rx=0 tx=0).stop 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 -- 172.21.15.70:0/287737421 shutdown_connections 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e2bd40 0x556bd9e2e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e2b800 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/287737421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e20b60 0x556bd9e20f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 -- 172.21.15.70:0/287737421 >> 172.21.15.70:0/287737421 conn(0x556bd9e1d0f0 msgr2=0x556bd9e1d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 -- 172.21.15.70:0/287737421 shutdown_connections 2024-09-19T04:33:14.352 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.341+0000 7f8f56d5b740 1 -- 172.21.15.70:0/287737421 wait complete. 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 1 -- start start 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 1 Processor -- start 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e2b7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e21480 0x556bd9e28b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e2bd40 0x556bd9e292d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556bd9e2e910 con 0x556bd9e20b60 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556bd9d40f10 con 0x556bd9e2bd40 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556bd9e2ea90 con 0x556bd9e21480 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f56d5b740 10 client.0 _ll_register_callbacks cb 0x556bd9d09a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e2b7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e2b7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35010/0 (socket says 172.21.15.70:35010) 2024-09-19T04:33:14.353 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/918115752 learned_addr learned my addr 172.21.15.70:0/918115752 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e2bd40 0x556bd9e292d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e21480 0x556bd9e28b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/918115752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e21480 msgr2=0x556bd9e28b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e21480 0x556bd9e28b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/918115752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e2bd40 msgr2=0x556bd9e292d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e2bd40 0x556bd9e292d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.342+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/918115752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bd9af76a0 con 0x556bd9e20b60 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e2b7f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8f44032fd0 tx=0x7f8f4402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ca8cfaaab13366 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f35ffb640 1 -- 172.21.15.70:0/918115752 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44035040 con 0x556bd9e20b60 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f35ffb640 1 -- 172.21.15.70:0/918115752 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8f44004250 con 0x556bd9e20b60 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f56d5b740 1 -- 172.21.15.70:0/918115752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f400043d0 con 0x556bd9e20b60 2024-09-19T04:33:14.354 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f35ffb640 1 -- 172.21.15.70:0/918115752 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8f44004450 con 0x556bd9e20b60 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f56d5b740 10 client.15669 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f56d5b740 1 -- 172.21.15.70:0/918115752 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556bd9e3a470 con 0x556bd9e20b60 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.343+0000 7f8f35ffb640 1 -- 172.21.15.70:0/918115752 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f400043d0 con 0x556bd9e20b60 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f35ffb640 1 -- 172.21.15.70:0/918115752 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f8f44052020 con 0x556bd9e20b60 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f56d5b740 10 client.15669 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f56d5b740 10 client.15669 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f56d5b740 20 client.15669 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556bd9e3b880 0x556bd9e3dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f56d5b740 4 client.15669 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f56d5b740 1 -- 172.21.15.70:0/918115752 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556bd9d937f0 con 0x556bd9e3b880 2024-09-19T04:33:14.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556bd9e3b880 0x556bd9e3dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556bd9e3b880 0x556bd9e3dc90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f8e06de8cadcb1 server_cookie=fd20b365e744e344 in_seq=0 out_seq=0 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.344+0000 7f8f35ffb640 10 client.15669 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f35ffb640 1 -- 172.21.15.70:0/918115752 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556bd9d937f0 con 0x556bd9e3b880 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f35ffb640 10 client.15669 handle_command_reply: tid=0 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 client.15669 shutdown 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 -- 172.21.15.70:0/918115752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 msgr2=0x556bd9e2b7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e2b7f0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f8f44032fd0 tx=0x7f8f4402a410 comp rx=0 tx=0).stop 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 -- 172.21.15.70:0/918115752 shutdown_connections 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556bd9e3b880 0x556bd9e3dc90 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e2bd40 0x556bd9e292d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e21480 0x556bd9e28b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f35ffb640 0 client.15669 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/918115752 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e2b7f0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 -- 172.21.15.70:0/918115752 >> 172.21.15.70:0/918115752 conn(0x556bd9e1d0f0 msgr2=0x556bd9e1c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 -- 172.21.15.70:0/918115752 shutdown_connections 2024-09-19T04:33:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 1 -- 172.21.15.70:0/918115752 wait complete. 2024-09-19T04:33:14.357 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.345+0000 7f8f56d5b740 20 client.15669 trim_cache size 0 max 16384 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.364+0000 7f8f56d5b740 1 Processor -- start 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.364+0000 7f8f56d5b740 1 -- start start 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e20b60 0x556bd9e2a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e21480 0x556bd9e43560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 0x556bd9e43aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501b23b0 con 0x556bd9e21480 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501afc20 con 0x556bd9e20b60 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501ada90 con 0x556bd9e2bd40 2024-09-19T04:33:14.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e21480 0x556bd9e43560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4dd9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e20b60 0x556bd9e2a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e21480 0x556bd9e43560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35012/0 (socket says 172.21.15.70:35012) 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4e59c640 1 -- 172.21.15.70:0/2867919864 learned_addr learned my addr 172.21.15.70:0/2867919864 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2867919864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 0x556bd9e43aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/2867919864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 msgr2=0x556bd9e43aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2867919864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 0x556bd9e43aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/2867919864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e21480 msgr2=0x556bd9e43560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2867919864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e21480 0x556bd9e43560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/2867919864 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556bd9e27b10 con 0x556bd9e20b60 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.365+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2867919864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e20b60 0x556bd9e2a9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f44033000 tx=0x7f8f44005fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4d5d789831bbf9e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:14.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f37fff640 1 -- 172.21.15.70:0/2867919864 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44035030 con 0x556bd9e20b60 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f37fff640 1 -- 172.21.15.70:0/2867919864 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f44041020 con 0x556bd9e20b60 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f37fff640 1 -- 172.21.15.70:0/2867919864 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44003e10 con 0x556bd9e20b60 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2867919864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e20b60 msgr2=0x556bd9e2a9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2867919864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e20b60 0x556bd9e2a9a0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f8f44033000 tx=0x7f8f44005fd0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2867919864 shutdown_connections 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2867919864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 0x556bd9e43aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2867919864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e21480 0x556bd9e43560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2867919864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e20b60 0x556bd9e2a9a0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2867919864 >> 172.21.15.70:0/2867919864 conn(0x556bd9e1d0f0 msgr2=0x556bd9e2a290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.366+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2867919864 shutdown_connections 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2867919864 wait complete. 2024-09-19T04:33:14.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 -- start start 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 Processor -- start 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e342e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e30ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 0x556bd9e31220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501ae0e0 con 0x556bd9e20b60 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501af550 con 0x556bd9e21480 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8f501ae7b0 con 0x556bd9e2bd40 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f56d5b740 10 client.0 _ll_register_callbacks cb 0x7f8f44005040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f4dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f4dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e342e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35016/0 (socket says 172.21.15.70:35016) 2024-09-19T04:33:14.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/2912084963 learned_addr learned my addr 172.21.15.70:0/2912084963 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.367+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e30ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 0x556bd9e31220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/2912084963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 msgr2=0x556bd9e31220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 0x556bd9e31220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/2912084963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 msgr2=0x556bd9e30ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e30ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f4dd9b640 1 -- 172.21.15.70:0/2912084963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556bd9e318c0 con 0x556bd9e20b60 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f4dd9b640 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e342e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8f44001eb0 tx=0x7f8f44031680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e424f12ada4025f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f35ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:14.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f35ffb640 1 -- 172.21.15.70:0/2912084963 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4405a040 con 0x556bd9e20b60 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f35ffb640 1 -- 172.21.15.70:0/2912084963 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8f44003dc0 con 0x556bd9e20b60 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2912084963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8f44041020 con 0x556bd9e20b60 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f35ffb640 1 -- 172.21.15.70:0/2912084963 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8f44067050 con 0x556bd9e20b60 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f56d5b740 10 client.15675 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2912084963 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556bd9ea7410 con 0x556bd9e20b60 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.368+0000 7f8f35ffb640 1 -- 172.21.15.70:0/2912084963 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8f44041020 con 0x556bd9e20b60 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f35ffb640 1 -- 172.21.15.70:0/2912084963 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f8f44052030 con 0x556bd9e20b60 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f56d5b740 10 client.15675 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f56d5b740 10 client.15675 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f56d5b740 20 client.15675 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:14.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556bd9ea7a10 0x556bd9ea9e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f56d5b740 4 client.15675 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2912084963 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x556bd9d8dd00 con 0x556bd9ea7a10 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556bd9ea7a10 0x556bd9ea9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f4e59c640 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556bd9ea7a10 0x556bd9ea9e30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bb12af6b232d84a8 server_cookie=1a6091428a3f616e in_seq=0 out_seq=0 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.369+0000 7f8f35ffb640 10 client.15675 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f35ffb640 1 -- 172.21.15.70:0/2912084963 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x556bd9d8dd00 con 0x556bd9ea7a10 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f35ffb640 10 client.15675 handle_command_reply: tid=0 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 client.15675 shutdown 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2912084963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 msgr2=0x556bd9e342e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e342e0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8f44001eb0 tx=0x7f8f44031680 comp rx=0 tx=0).stop 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2912084963 shutdown_connections 2024-09-19T04:33:14.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556bd9ea7a10 0x556bd9ea9e30 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f35ffb640 0 client.15675 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:14.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556bd9e2bd40 0x556bd9e31220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556bd9e21480 0x556bd9e30ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 --2- 172.21.15.70:0/2912084963 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556bd9e20b60 0x556bd9e342e0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.370+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2912084963 >> 172.21.15.70:0/2912084963 conn(0x556bd9e1d0f0 msgr2=0x556bd9e1c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:14.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2912084963 shutdown_connections 2024-09-19T04:33:14.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f56d5b740 1 -- 172.21.15.70:0/2912084963 wait complete. 2024-09-19T04:33:14.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f56d5b740 20 client.15675 trim_cache size 0 max 16384 2024-09-19T04:33:14.381 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:33:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:33:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "d5d20e30-a908-4238-bc38-3e9faf9b26c4", 2024-09-19T04:33:14.381 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:33:14.382 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:33:14.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 -- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8f380a33b0 msgr2=0x7f8f380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8f380a33b0 0x7f8f380a5870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8f480cd9f0 tx=0x7f8f48009200 comp rx=0 tx=0).stop 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 -- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f50106f20 msgr2=0x7f8f50074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f50106f20 0x7f8f50074f70 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f8f4800eb10 tx=0x7f8f4800c2d0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 -- 172.21.15.70:0/2079854493 shutdown_connections 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8f380a33b0 0x7f8f380a5870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8f50106f20 0x7f8f50074f70 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8f501027a0 0x7f8f50074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 --2- 172.21.15.70:0/2079854493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f50101df0 0x7f8f500744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.371+0000 7f8f54982640 1 -- 172.21.15.70:0/2079854493 >> 172.21.15.70:0/2079854493 conn(0x7f8f500fd8f0 msgr2=0x7f8f500fed30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.372+0000 7f8f54982640 1 -- 172.21.15.70:0/2079854493 shutdown_connections 2024-09-19T04:33:14.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:14.372+0000 7f8f54982640 1 -- 172.21.15.70:0/2079854493 wait complete. 2024-09-19T04:33:15.242 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:33:15.515 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:33:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:15.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:15 smithi070 ceph-mon[30942]: pgmap v77: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T04:33:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:15.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:15 smithi167 ceph-mon[34339]: pgmap v77: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T04:33:16.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.016+0000 7f7138ee5640 1 -- 172.21.15.70:0/514238465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134100e20 msgr2=0x7f7134101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.016+0000 7f7138ee5640 1 --2- 172.21.15.70:0/514238465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134100e20 0x7f7134101200 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f7124009900 tx=0x7f712402a480 comp rx=0 tx=0).stop 2024-09-19T04:33:16.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.017+0000 7f7138ee5640 1 -- 172.21.15.70:0/514238465 shutdown_connections 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.017+0000 7f7138ee5640 1 --2- 172.21.15.70:0/514238465 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134102ef0 0x7f713410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.017+0000 7f7138ee5640 1 --2- 172.21.15.70:0/514238465 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7134102570 0x7f71341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.017+0000 7f7138ee5640 1 --2- 172.21.15.70:0/514238465 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134100e20 0x7f7134101200 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.017+0000 7f7138ee5640 1 -- 172.21.15.70:0/514238465 >> 172.21.15.70:0/514238465 conn(0x7f71340fc7d0 msgr2=0x7f71340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.017+0000 7f7138ee5640 1 -- 172.21.15.70:0/514238465 shutdown_connections 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.017+0000 7f7138ee5640 1 -- 172.21.15.70:0/514238465 wait complete. 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.017+0000 7f7138ee5640 1 Processor -- start 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7138ee5640 1 -- start start 2024-09-19T04:33:16.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7138ee5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134100e20 0x7f713419a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7138ee5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7134102570 0x7f713419abd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7138ee5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134102ef0 0x7f713419ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7138ee5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7134110f20 con 0x7f7134102ef0 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7138ee5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7134110da0 con 0x7f7134102570 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7138ee5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71341110a0 con 0x7f7134100e20 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134102ef0 0x7f713419ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f713259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134100e20 0x7f713419a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7134102570 0x7f713419abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f713259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134100e20 0x7f713419a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:39158/0 (socket says 172.21.15.70:39158) 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134102ef0 0x7f713419ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35038/0 (socket says 172.21.15.70:35038) 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7134102570 0x7f713419abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:52870/0 (socket says 172.21.15.70:52870) 2024-09-19T04:33:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f713259c640 1 -- 172.21.15.70:0/1641940983 learned_addr learned my addr 172.21.15.70:0/1641940983 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f713259c640 1 -- 172.21.15.70:0/1641940983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7134102570 msgr2=0x7f713419abd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f713259c640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7134102570 0x7f713419abd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f713259c640 1 -- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134102ef0 msgr2=0x7f713419ef60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f713259c640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134102ef0 0x7f713419ef60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f713259c640 1 -- 172.21.15.70:0/1641940983 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f713419f640 con 0x7f7134100e20 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.018+0000 7f7132d9d640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134102ef0 0x7f713419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.019+0000 7f713259c640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134100e20 0x7f713419a690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7124005940 tx=0x7f71240042f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.019+0000 7f71237fe640 1 -- 172.21.15.70:0/1641940983 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712403f030 con 0x7f7134100e20 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.019+0000 7f7138ee5640 1 -- 172.21.15.70:0/1641940983 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f713419f8d0 con 0x7f7134100e20 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.019+0000 7f71237fe640 1 -- 172.21.15.70:0/1641940983 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7124003ac0 con 0x7f7134100e20 2024-09-19T04:33:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.019+0000 7f71237fe640 1 -- 172.21.15.70:0/1641940983 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124035070 con 0x7f7134100e20 2024-09-19T04:33:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.019+0000 7f7138ee5640 1 -- 172.21.15.70:0/1641940983 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71341a7210 con 0x7f7134100e20 2024-09-19T04:33:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.021+0000 7f71237fe640 1 -- 172.21.15.70:0/1641940983 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7124042030 con 0x7f7134100e20 2024-09-19T04:33:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.021+0000 7f713b2be740 1 Processor -- start 2024-09-19T04:33:16.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f713b2be740 1 -- start start 2024-09-19T04:33:16.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f713b2be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5224880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f713b2be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf522f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f713b2be740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5231a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f713b2be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bbf518a2e0 con 0x55bbf52244a0 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f713b2be740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bbf5131ce0 con 0x55bbf522f680 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f713b2be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bbf51862a0 con 0x55bbf5224dc0 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5224880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f713259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf522f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5224880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35048/0 (socket says 172.21.15.70:35048) 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7132d9d640 1 -- 172.21.15.70:0/290268371 learned_addr learned my addr 172.21.15.70:0/290268371 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f71237fe640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f711c0a33b0 0x7f711c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7131d9b640 1 --2- 172.21.15.70:0/290268371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5231a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7132d9d640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f711c0a33b0 0x7f711c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7132d9d640 1 -- 172.21.15.70:0/290268371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 msgr2=0x55bbf522f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7132d9d640 1 --2- 172.21.15.70:0/290268371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf522f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f71237fe640 1 -- 172.21.15.70:0/1641940983 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f71240f0100 con 0x7f7134100e20 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7132d9d640 1 -- 172.21.15.70:0/290268371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 msgr2=0x55bbf5231a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.022+0000 7f7132d9d640 1 --2- 172.21.15.70:0/290268371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5231a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.023+0000 7f7132d9d640 1 -- 172.21.15.70:0/290268371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf5116440 con 0x55bbf52244a0 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.023+0000 7f7132d9d640 1 --2- 172.21.15.70:0/290268371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5224880 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f712c009fd0 tx=0x7f712c00f7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41f56e4aa8634b4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.023+0000 7f7120ff9640 1 -- 172.21.15.70:0/290268371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c023020 con 0x55bbf52244a0 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.023+0000 7f7120ff9640 1 -- 172.21.15.70:0/290268371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f712c0138a0 con 0x55bbf52244a0 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.023+0000 7f7120ff9640 1 -- 172.21.15.70:0/290268371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c010670 con 0x55bbf52244a0 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.023+0000 7f7132d9d640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f711c0a33b0 0x7f711c0a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f712c024000 tx=0x7f712c022000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:16.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 -- 172.21.15.70:0/290268371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 msgr2=0x55bbf5224880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 --2- 172.21.15.70:0/290268371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5224880 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f712c009fd0 tx=0x7f712c00f7d0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 -- 172.21.15.70:0/290268371 shutdown_connections 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 --2- 172.21.15.70:0/290268371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5231a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 --2- 172.21.15.70:0/290268371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf522f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 --2- 172.21.15.70:0/290268371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5224880 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 -- 172.21.15.70:0/290268371 >> 172.21.15.70:0/290268371 conn(0x55bbf5220a30 msgr2=0x55bbf5220e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 -- 172.21.15.70:0/290268371 shutdown_connections 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 -- 172.21.15.70:0/290268371 wait complete. 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 -- start start 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.024+0000 7f713b2be740 1 Processor -- start 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f713b2be740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf52244a0 0x55bbf522f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f713b2be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf5224dc0 0x55bbf522c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f713b2be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf522f680 0x55bbf522c830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f713b2be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bbf5232250 con 0x55bbf5224dc0 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f713b2be740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bbf5145050 con 0x55bbf52244a0 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f713b2be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bbf52323d0 con 0x55bbf522f680 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f713b2be740 10 client.0 _ll_register_callbacks cb 0x55bbf5185160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf522f680 0x55bbf522c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf5224dc0 0x55bbf522c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf5224dc0 0x55bbf522c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35056/0 (socket says 172.21.15.70:35056) 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7131d9b640 1 -- 172.21.15.70:0/2608024038 learned_addr learned my addr 172.21.15.70:0/2608024038 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f713259c640 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf52244a0 0x55bbf522f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7132d9d640 1 -- 172.21.15.70:0/2608024038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf52244a0 msgr2=0x55bbf522f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7132d9d640 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf52244a0 0x55bbf522f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7132d9d640 1 -- 172.21.15.70:0/2608024038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf5224dc0 msgr2=0x55bbf522c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7132d9d640 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf5224dc0 0x55bbf522c2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.025+0000 7f7132d9d640 1 -- 172.21.15.70:0/2608024038 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf4efb3c0 con 0x55bbf522f680 2024-09-19T04:33:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f7132d9d640 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf522f680 0x55bbf522c830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f712c005fd0 tx=0x7f712c01fd00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a2b41035ac5ac40c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f7119ffb640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:33:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f7119ffb640 1 -- 172.21.15.70:0/2608024038 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c023070 con 0x55bbf522f680 2024-09-19T04:33:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f713b2be740 1 -- 172.21.15.70:0/2608024038 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55bbf5197850 con 0x55bbf522f680 2024-09-19T04:33:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f7119ffb640 1 -- 172.21.15.70:0/2608024038 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f712c004a00 con 0x55bbf522f680 2024-09-19T04:33:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f7119ffb640 1 -- 172.21.15.70:0/2608024038 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f712c010650 con 0x55bbf522f680 2024-09-19T04:33:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f713b2be740 10 client.25174 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:16.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f713b2be740 1 -- 172.21.15.70:0/2608024038 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bbf523dc40 con 0x55bbf522f680 2024-09-19T04:33:16.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.026+0000 7f7119ffb640 1 -- 172.21.15.70:0/2608024038 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f712c012260 con 0x55bbf522f680 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f7119ffb640 1 -- 172.21.15.70:0/2608024038 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f712c02f070 con 0x55bbf522f680 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f713b2be740 10 client.25174 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f713b2be740 10 client.25174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f713b2be740 20 client.25174 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f713b2be740 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bbf523f520 0x55bbf5241960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f713b2be740 4 client.25174 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f713b2be740 1 -- 172.21.15.70:0/2608024038 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbf5197850 con 0x55bbf523f520 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f713259c640 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bbf523f520 0x55bbf5241960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f713259c640 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bbf523f520 0x55bbf5241960 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4a582d361ca10677 server_cookie=48476c68f1206217 in_seq=0 out_seq=0 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.027+0000 7f7119ffb640 10 client.25174 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f7119ffb640 1 -- 172.21.15.70:0/2608024038 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bbf5197850 con 0x55bbf523f520 2024-09-19T04:33:16.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f7119ffb640 10 client.25174 handle_command_reply: tid=0 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 client.25174 shutdown 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 -- 172.21.15.70:0/2608024038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf522f680 msgr2=0x55bbf522c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf522f680 0x55bbf522c830 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f712c005fd0 tx=0x7f712c01fd00 comp rx=0 tx=0).stop 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 -- 172.21.15.70:0/2608024038 shutdown_connections 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bbf523f520 0x55bbf5241960 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf522f680 0x55bbf522c830 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf5224dc0 0x55bbf522c2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f7119ffb640 0 client.25174 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 --2- 172.21.15.70:0/2608024038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf52244a0 0x55bbf522f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 -- 172.21.15.70:0/2608024038 >> 172.21.15.70:0/2608024038 conn(0x55bbf5220a30 msgr2=0x55bbf5226710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 -- 172.21.15.70:0/2608024038 shutdown_connections 2024-09-19T04:33:16.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.028+0000 7f713b2be740 1 -- 172.21.15.70:0/2608024038 wait complete. 2024-09-19T04:33:16.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.029+0000 7f713b2be740 20 client.25174 trim_cache size 0 max 16384 2024-09-19T04:33:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:33:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:16.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.039 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:15 smithi134 ceph-mon[34525]: pgmap v77: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T04:33:16.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713b2be740 1 Processor -- start 2024-09-19T04:33:16.050 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713b2be740 1 -- start start 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713b2be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf522e220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713b2be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf5247020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713b2be740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5247560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713b2be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f71341b2240 con 0x55bbf52244a0 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713b2be740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71341afab0 con 0x55bbf522f680 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713b2be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71341ad900 con 0x55bbf5224dc0 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5247560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf5247020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f713259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf522e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5247560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:52900/0 (socket says 172.21.15.70:52900) 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f7132d9d640 1 -- 172.21.15.70:0/507116087 learned_addr learned my addr 172.21.15.70:0/507116087 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f7132d9d640 1 -- 172.21.15.70:0/507116087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 msgr2=0x55bbf5247020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:16.051 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f7132d9d640 1 --2- 172.21.15.70:0/507116087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf5247020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f7132d9d640 1 -- 172.21.15.70:0/507116087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 msgr2=0x55bbf522e220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:16.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.048+0000 7f7132d9d640 1 --2- 172.21.15.70:0/507116087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf522e220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.049+0000 7f7132d9d640 1 -- 172.21.15.70:0/507116087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbf5231e10 con 0x55bbf522f680 2024-09-19T04:33:16.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.049+0000 7f713259c640 1 --2- 172.21.15.70:0/507116087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf522e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:16.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.049+0000 7f7132d9d640 1 --2- 172.21.15.70:0/507116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5247560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f712c005d70 tx=0x7f712c013d00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=861dbc487bf3db92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:16.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.049+0000 7f711bfff640 1 -- 172.21.15.70:0/507116087 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c023070 con 0x55bbf522f680 2024-09-19T04:33:16.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.049+0000 7f711bfff640 1 -- 172.21.15.70:0/507116087 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f712c012260 con 0x55bbf522f680 2024-09-19T04:33:16.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.049+0000 7f711bfff640 1 -- 172.21.15.70:0/507116087 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f712c010b30 con 0x55bbf522f680 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 -- 172.21.15.70:0/507116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 msgr2=0x55bbf5247560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 --2- 172.21.15.70:0/507116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5247560 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f712c005d70 tx=0x7f712c013d00 comp rx=0 tx=0).stop 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 -- 172.21.15.70:0/507116087 shutdown_connections 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 --2- 172.21.15.70:0/507116087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf5247560 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 --2- 172.21.15.70:0/507116087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf5247020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 --2- 172.21.15.70:0/507116087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf522e220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 -- 172.21.15.70:0/507116087 >> 172.21.15.70:0/507116087 conn(0x55bbf5220a30 msgr2=0x55bbf522db10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 -- 172.21.15.70:0/507116087 shutdown_connections 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 -- 172.21.15.70:0/507116087 wait complete. 2024-09-19T04:33:16.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 -- start start 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.050+0000 7f713b2be740 1 Processor -- start 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713b2be740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5246890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713b2be740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf5246dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713b2be740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf52a20c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713b2be740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f71341adf70 con 0x55bbf52244a0 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713b2be740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f71341af3e0 con 0x55bbf522f680 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713b2be740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f71341ae640 con 0x55bbf5224dc0 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713b2be740 10 client.0 _ll_register_callbacks cb 0x7f71240bc280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5246890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf52a20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f7132d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf52a20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:52910/0 (socket says 172.21.15.70:52910) 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f7132d9d640 1 -- 172.21.15.70:0/3762104188 learned_addr learned my addr 172.21.15.70:0/3762104188 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:16.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5246890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35084/0 (socket says 172.21.15.70:35084) 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f7131d9b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf5246dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713259c640 1 -- 172.21.15.70:0/3762104188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 msgr2=0x55bbf5246dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713259c640 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf5246dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713259c640 1 -- 172.21.15.70:0/3762104188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 msgr2=0x55bbf52a20c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713259c640 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf52a20c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.051+0000 7f713259c640 1 -- 172.21.15.70:0/3762104188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbf52a2760 con 0x55bbf52244a0 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.052+0000 7f713259c640 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5246890 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f71240ed870 tx=0x7f71240dc040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3686fa56d51f9d61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.052+0000 7f7119ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.052+0000 7f7119ffb640 1 -- 172.21.15.70:0/3762104188 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7124049040 con 0x55bbf52244a0 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.052+0000 7f7119ffb640 1 -- 172.21.15.70:0/3762104188 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f7124003c70 con 0x55bbf52244a0 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.052+0000 7f713b2be740 1 -- 172.21.15.70:0/3762104188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f712c012260 con 0x55bbf52244a0 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.052+0000 7f7119ffb640 1 -- 172.21.15.70:0/3762104188 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f71240bbe10 con 0x55bbf52244a0 2024-09-19T04:33:16.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.052+0000 7f713b2be740 10 client.15693 fetch_fsmap learned FSMap version 26 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.052+0000 7f713b2be740 1 -- 172.21.15.70:0/3762104188 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bbf52a9b60 con 0x55bbf52244a0 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f7119ffb640 1 -- 172.21.15.70:0/3762104188 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f712c012260 con 0x55bbf52244a0 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f7119ffb640 1 -- 172.21.15.70:0/3762104188 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 26) ==== 8358+0+0 (secure 0 0 0) 0x7f71240b8b20 con 0x55bbf52244a0 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f713b2be740 10 client.15693 fetch_fsmap finished waiting for FSMap version 26 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f713b2be740 10 client.15693 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f713b2be740 20 client.15693 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f713b2be740 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bbf52aa2b0 0x55bbf52ac6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f713b2be740 4 client.15693 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f713b2be740 1 -- 172.21.15.70:0/3762104188 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55bbf5191d60 con 0x55bbf52aa2b0 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.053+0000 7f7131d9b640 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bbf52aa2b0 0x55bbf52ac6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:16.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f7131d9b640 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bbf52aa2b0 0x55bbf52ac6d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c022ef116a732a2 server_cookie=587d13b895407e32 in_seq=0 out_seq=0 2024-09-19T04:33:16.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f7119ffb640 10 client.15693 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f7119ffb640 1 -- 172.21.15.70:0/3762104188 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55bbf5191d60 con 0x55bbf52aa2b0 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f7119ffb640 10 client.15693 handle_command_reply: tid=0 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 client.15693 shutdown 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 -- 172.21.15.70:0/3762104188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 msgr2=0x55bbf5246890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5246890 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f71240ed870 tx=0x7f71240dc040 comp rx=0 tx=0).stop 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 -- 172.21.15.70:0/3762104188 shutdown_connections 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bbf52aa2b0 0x55bbf52ac6d0 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bbf522f680 0x55bbf52a20c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bbf5224dc0 0x55bbf5246dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 --2- 172.21.15.70:0/3762104188 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bbf52244a0 0x55bbf5246890 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 -- 172.21.15.70:0/3762104188 >> 172.21.15.70:0/3762104188 conn(0x55bbf5220a30 msgr2=0x55bbf522a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:16.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f7119ffb640 0 client.15693 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 -- 172.21.15.70:0/3762104188 shutdown_connections 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 1 -- 172.21.15.70:0/3762104188 wait complete. 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.054+0000 7f713b2be740 20 client.15693 trim_cache size 0 max 16384 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "d5d20e30-a908-4238-bc38-3e9faf9b26c4": { 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "d5d20e30-a908-4238-bc38-3e9faf9b26c4", 2024-09-19T04:33:16.061 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:33:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:33:16.062 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:33:16.062 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:33:16.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 -- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f711c0a33b0 msgr2=0x7f711c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f711c0a33b0 0x7f711c0a5870 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f712c024000 tx=0x7f712c022000 comp rx=0 tx=0).stop 2024-09-19T04:33:16.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 -- 172.21.15.70:0/1641940983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134100e20 msgr2=0x7f713419a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134100e20 0x7f713419a690 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f7124005940 tx=0x7f71240042f0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 -- 172.21.15.70:0/1641940983 shutdown_connections 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f711c0a33b0 0x7f711c0a5870 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7134102ef0 0x7f713419ef60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7134102570 0x7f713419abd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 --2- 172.21.15.70:0/1641940983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7134100e20 0x7f713419a690 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 -- 172.21.15.70:0/1641940983 >> 172.21.15.70:0/1641940983 conn(0x7f71340fc7d0 msgr2=0x7f713406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 -- 172.21.15.70:0/1641940983 shutdown_connections 2024-09-19T04:33:16.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:16.055+0000 7f7138ee5640 1 -- 172.21.15.70:0/1641940983 wait complete. 2024-09-19T04:33:16.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:16 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:16.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:16 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:16 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:16.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:16 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:16 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:16.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:16 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:16 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.907 INFO:tasks.cephfs.filesystem:scrub status for tag:d5d20e30-a908-4238-bc38-3e9faf9b26c4 - {'path': '/', 'tag': 'd5d20e30-a908-4238-bc38-3e9faf9b26c4', 'options': 'recursive,force'} 2024-09-19T04:33:16.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:16 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:16 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:16 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:16 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:16 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:16 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:16 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:16 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:16 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:16 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:16 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:16 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:16 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:16 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:17.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:17 smithi070 ceph-mon[30942]: pgmap v78: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T04:33:17.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:17 smithi167 ceph-mon[34339]: pgmap v78: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T04:33:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:17 smithi134 ceph-mon[34525]: pgmap v78: 97 pgs: 97 active+clean; 153 MiB data, 907 MiB used, 1.0 TiB / 1.0 TiB avail; 1017 KiB/s rd, 2.5 MiB/s wr, 235 op/s 2024-09-19T04:33:18.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:18 smithi070 ceph-mon[30942]: pgmap v79: 97 pgs: 97 active+clean; 164 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 388 op/s 2024-09-19T04:33:18.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:18 smithi167 ceph-mon[34339]: pgmap v79: 97 pgs: 97 active+clean; 164 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 388 op/s 2024-09-19T04:33:19.333 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:18 smithi134 ceph-mon[34525]: pgmap v79: 97 pgs: 97 active+clean; 164 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 388 op/s 2024-09-19T04:33:21.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:21 smithi070 ceph-mon[30942]: pgmap v80: 97 pgs: 97 active+clean; 164 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-09-19T04:33:21.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:21 smithi167 ceph-mon[34339]: pgmap v80: 97 pgs: 97 active+clean; 164 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-09-19T04:33:22.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:21 smithi134 ceph-mon[34525]: pgmap v80: 97 pgs: 97 active+clean; 164 MiB data, 957 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.7 MiB/s wr, 308 op/s 2024-09-19T04:33:23.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:23 smithi070 ceph-mon[30942]: pgmap v81: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2024-09-19T04:33:23.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:23 smithi167 ceph-mon[34339]: pgmap v81: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2024-09-19T04:33:24.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:23 smithi134 ceph-mon[34525]: pgmap v81: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 3.0 MiB/s wr, 444 op/s 2024-09-19T04:33:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:25 smithi070 ceph-mon[30942]: pgmap v82: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-09-19T04:33:25.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:25 smithi167 ceph-mon[34339]: pgmap v82: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-09-19T04:33:26.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:25 smithi134 ceph-mon[34525]: pgmap v82: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-09-19T04:33:26.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:26 smithi167 ceph-mon[34339]: pgmap v83: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-09-19T04:33:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:26 smithi134 ceph-mon[34525]: pgmap v83: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-09-19T04:33:27.085 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:26 smithi070 ceph-mon[30942]: pgmap v83: 97 pgs: 97 active+clean; 180 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 2.3 MiB/s wr, 288 op/s 2024-09-19T04:33:27.936 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:27 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:33:27.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:27 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:33:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:27 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:33:28.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:28 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:33:28.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:28 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:33:28.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:28 smithi167 ceph-mon[34339]: pgmap v84: 97 pgs: 97 active+clean; 189 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 433 op/s 2024-09-19T04:33:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:28 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:33:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:28 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:33:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:28 smithi134 ceph-mon[34525]: pgmap v84: 97 pgs: 97 active+clean; 189 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 433 op/s 2024-09-19T04:33:29.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:28 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:33:29.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:28 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:33:29.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:28 smithi070 ceph-mon[30942]: pgmap v84: 97 pgs: 97 active+clean; 189 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 3.1 MiB/s wr, 433 op/s 2024-09-19T04:33:29.569 INFO:tasks.workunit.client.0.smithi070.stderr:+ sync 2024-09-19T04:33:31.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:31 smithi070 ceph-mon[30942]: pgmap v85: 97 pgs: 97 active+clean; 189 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 280 op/s 2024-09-19T04:33:31.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:31 smithi167 ceph-mon[34339]: pgmap v85: 97 pgs: 97 active+clean; 189 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 280 op/s 2024-09-19T04:33:31.989 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar c linux-4.0.5 2024-09-19T04:33:32.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:31 smithi134 ceph-mon[34525]: pgmap v85: 97 pgs: 97 active+clean; 189 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 280 op/s 2024-09-19T04:33:33.701 INFO:tasks.workunit.client.0.smithi070.stderr:+ rm -rf linux-4.0.5 2024-09-19T04:33:33.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:33 smithi070 ceph-mon[30942]: pgmap v86: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 382 op/s 2024-09-19T04:33:33.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:33 smithi167 ceph-mon[34339]: pgmap v86: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 382 op/s 2024-09-19T04:33:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:33 smithi134 ceph-mon[34525]: pgmap v86: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.9 MiB/s wr, 382 op/s 2024-09-19T04:33:35.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:35 smithi167 ceph-mon[34339]: pgmap v87: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-19T04:33:35.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:35 smithi134 ceph-mon[34525]: pgmap v87: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-19T04:33:35.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:35 smithi070 ceph-mon[30942]: pgmap v87: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-19T04:33:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:37 smithi070 ceph-mon[30942]: pgmap v88: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-19T04:33:37.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:37 smithi167 ceph-mon[34339]: pgmap v88: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-19T04:33:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:37 smithi134 ceph-mon[34525]: pgmap v88: 97 pgs: 97 active+clean; 197 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1012 KiB/s rd, 1.5 MiB/s wr, 247 op/s 2024-09-19T04:33:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:38 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:33:38.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:38 smithi070 ceph-mon[30942]: pgmap v89: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 309 op/s 2024-09-19T04:33:38.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:38 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:33:38.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:38 smithi167 ceph-mon[34339]: pgmap v89: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 309 op/s 2024-09-19T04:33:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:38 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:33:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:38 smithi134 ceph-mon[34525]: pgmap v89: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 2.1 MiB/s wr, 309 op/s 2024-09-19T04:33:41.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:41 smithi070 ceph-mon[30942]: pgmap v90: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 164 op/s 2024-09-19T04:33:41.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:41 smithi167 ceph-mon[34339]: pgmap v90: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 164 op/s 2024-09-19T04:33:42.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:41 smithi134 ceph-mon[34525]: pgmap v90: 97 pgs: 97 active+clean; 203 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.0 MiB/s rd, 1.3 MiB/s wr, 164 op/s 2024-09-19T04:33:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:43 smithi070 ceph-mon[30942]: pgmap v91: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 346 op/s 2024-09-19T04:33:43.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:43 smithi167 ceph-mon[34339]: pgmap v91: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 346 op/s 2024-09-19T04:33:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:43 smithi134 ceph-mon[34525]: pgmap v91: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.0 MiB/s wr, 346 op/s 2024-09-19T04:33:44.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:44 smithi070 ceph-mon[30942]: pgmap v92: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 243 op/s 2024-09-19T04:33:44.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:44 smithi167 ceph-mon[34339]: pgmap v92: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 243 op/s 2024-09-19T04:33:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:44 smithi134 ceph-mon[34525]: pgmap v92: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 243 op/s 2024-09-19T04:33:45.958 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar xf doc.tar 2024-09-19T04:33:46.908 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:33:47.209 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:47.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 -- 172.21.15.70:0/2949875645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102ef0 msgr2=0x7f534410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 --2- 172.21.15.70:0/2949875645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102ef0 0x7f534410da40 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f533c009ca0 tx=0x7f533c02a950 comp rx=0 tx=0).stop 2024-09-19T04:33:47.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 -- 172.21.15.70:0/2949875645 shutdown_connections 2024-09-19T04:33:47.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 --2- 172.21.15.70:0/2949875645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102ef0 0x7f534410da40 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 --2- 172.21.15.70:0/2949875645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344102570 0x7f53441029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 --2- 172.21.15.70:0/2949875645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5344100e20 0x7f5344101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 -- 172.21.15.70:0/2949875645 >> 172.21.15.70:0/2949875645 conn(0x7f53440fc7d0 msgr2=0x7f53440febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 -- 172.21.15.70:0/2949875645 shutdown_connections 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.732+0000 7f5349c2c640 1 -- 172.21.15.70:0/2949875645 wait complete. 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.733+0000 7f5349c2c640 1 Processor -- start 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.733+0000 7f5349c2c640 1 -- start start 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.733+0000 7f5349c2c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344100e20 0x7f534419a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.733+0000 7f5349c2c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102570 0x7f534419ac20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.733+0000 7f5349c2c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5344102ef0 0x7f534419efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.733+0000 7f5349c2c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5344110f50 con 0x7f5344102570 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.733+0000 7f5349c2c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5344110dd0 con 0x7f5344100e20 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.733+0000 7f5349c2c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f53441110d0 con 0x7f5344102ef0 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5342ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102570 0x7f534419ac20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344100e20 0x7f534419a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344100e20 0x7f534419a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:54564/0 (socket says 172.21.15.70:54564) 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5342ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102570 0x7f534419ac20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60800/0 (socket says 172.21.15.70:60800) 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 -- 172.21.15.70:0/1855099268 learned_addr learned my addr 172.21.15.70:0/1855099268 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5343fff640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5344102ef0 0x7f534419efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 -- 172.21.15.70:0/1855099268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5344102ef0 msgr2=0x7f534419efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5344102ef0 0x7f534419efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 -- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102570 msgr2=0x7f534419ac20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102570 0x7f534419ac20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 -- 172.21.15.70:0/1855099268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f534419f690 con 0x7f5344100e20 2024-09-19T04:33:47.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5342ffd640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102570 0x7f534419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f53437fe640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344100e20 0x7f534419a6e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f533400e9f0 tx=0x7f533400eeb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5340ff9640 1 -- 172.21.15.70:0/1855099268 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533400cd80 con 0x7f5344100e20 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5340ff9640 1 -- 172.21.15.70:0/1855099268 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5334010900 con 0x7f5344100e20 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5340ff9640 1 -- 172.21.15.70:0/1855099268 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340189e0 con 0x7f5344100e20 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5349c2c640 1 -- 172.21.15.70:0/1855099268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f534419f980 con 0x7f5344100e20 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.734+0000 7f5349c2c640 1 -- 172.21.15.70:0/1855099268 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53441a7260 con 0x7f5344100e20 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.737+0000 7f5340ff9640 1 -- 172.21.15.70:0/1855099268 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5334010ab0 con 0x7f5344100e20 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.737+0000 7f534c005740 1 Processor -- start 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.737+0000 7f534c005740 1 -- start start 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.737+0000 7f534c005740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c2f3880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f534c005740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 0x56168c2fe140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f534c005740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c300a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f534c005740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56168c2592e0 con 0x56168c2fe680 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f534c005740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56168c200ce0 con 0x56168c2f3dc0 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f534c005740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56168c2552a0 con 0x56168c2f34a0 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c2f3880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c2f3880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:58290/0 (socket says 172.21.15.70:58290) 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 -- 172.21.15.70:0/773633618 learned_addr learned my addr 172.21.15.70:0/773633618 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f53437fe640 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 0x56168c2fe140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5342ffd640 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c300a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5340ff9640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f532c0a33b0 0x7f532c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 -- 172.21.15.70:0/773633618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 msgr2=0x56168c2fe140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 0x56168c2fe140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 -- 172.21.15.70:0/773633618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 msgr2=0x56168c300a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c300a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 -- 172.21.15.70:0/773633618 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168c1e5440 con 0x56168c2f34a0 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5342ffd640 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c300a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5340ff9640 1 -- 172.21.15.70:0/1855099268 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f53340d0050 con 0x7f5344100e20 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.738+0000 7f5343fff640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f532c0a33b0 0x7f532c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.739+0000 7f5343fff640 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c2f3880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f533c035000 tx=0x7f533c009a20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f34a2032c1eb336f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.739+0000 7f5329ffb640 1 -- 172.21.15.70:0/773633618 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c034040 con 0x56168c2f34a0 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.739+0000 7f5343fff640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f532c0a33b0 0x7f532c0a5870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f533c04b000 tx=0x7f533c04c000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.739+0000 7f5329ffb640 1 -- 172.21.15.70:0/773633618 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f533c003e40 con 0x56168c2f34a0 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.740+0000 7f5329ffb640 1 -- 172.21.15.70:0/773633618 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c044460 con 0x56168c2f34a0 2024-09-19T04:33:47.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.740+0000 7f534c005740 1 -- 172.21.15.70:0/773633618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 msgr2=0x56168c2f3880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.740+0000 7f534c005740 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c2f3880 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f533c035000 tx=0x7f533c009a20 comp rx=0 tx=0).stop 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.740+0000 7f534c005740 1 -- 172.21.15.70:0/773633618 shutdown_connections 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.740+0000 7f534c005740 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c300a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.740+0000 7f534c005740 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 0x56168c2fe140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.740+0000 7f534c005740 1 --2- 172.21.15.70:0/773633618 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c2f3880 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.740+0000 7f534c005740 1 -- 172.21.15.70:0/773633618 >> 172.21.15.70:0/773633618 conn(0x56168c2efa30 msgr2=0x56168c2efe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.741+0000 7f534c005740 1 -- 172.21.15.70:0/773633618 shutdown_connections 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.741+0000 7f534c005740 1 -- 172.21.15.70:0/773633618 wait complete. 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.741+0000 7f534c005740 1 -- start start 2024-09-19T04:33:47.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.741+0000 7f534c005740 1 Processor -- start 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f534c005740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2f34a0 0x56168c2fdf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f534c005740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c2fb240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f534c005740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2fe680 0x56168c2fb780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f534c005740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56168c3012a0 con 0x56168c2f34a0 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f53437fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2f34a0 0x56168c2fdf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f5342ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c2fb240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f5342ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c2fb240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:58306/0 (socket says 172.21.15.70:58306) 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f5342ffd640 1 -- 172.21.15.70:0/3031758674 learned_addr learned my addr 172.21.15.70:0/3031758674 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56168c214050 con 0x56168c2fe680 2024-09-19T04:33:47.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56168c301420 con 0x56168c2f3dc0 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.742+0000 7f5343fff640 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2fe680 0x56168c2fb780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.743+0000 7f534c005740 10 client.0 _ll_register_callbacks cb 0x56168c254160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.743+0000 7f5343fff640 1 -- 172.21.15.70:0/3031758674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 msgr2=0x56168c2fb240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.743+0000 7f5343fff640 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c2fb240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.743+0000 7f5343fff640 1 -- 172.21.15.70:0/3031758674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2f34a0 msgr2=0x56168c2fdf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.743+0000 7f5343fff640 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2f34a0 0x56168c2fdf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.743+0000 7f5343fff640 1 -- 172.21.15.70:0/3031758674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56168bfca3c0 con 0x56168c2fe680 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.743+0000 7f53437fe640 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2f34a0 0x56168c2fdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f5343fff640 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2fe680 0x56168c2fb780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f533c006010 tx=0x7f533c003dd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b16197ccb6e649c0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f5322ffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:33:47.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f5322ffd640 1 -- 172.21.15.70:0/3031758674 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533c05c060 con 0x56168c2fe680 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f5322ffd640 1 -- 172.21.15.70:0/3031758674 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f533c004720 con 0x56168c2fe680 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56168c266850 con 0x56168c2fe680 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f5322ffd640 1 -- 172.21.15.70:0/3031758674 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f533c034050 con 0x56168c2fe680 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f534c005740 10 client.25154 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56168c30cbc0 con 0x56168c2fe680 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.744+0000 7f5322ffd640 1 -- 172.21.15.70:0/3031758674 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x56168c266850 con 0x56168c2fe680 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.745+0000 7f5322ffd640 1 -- 172.21.15.70:0/3031758674 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f533c056070 con 0x56168c2fe680 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.745+0000 7f534c005740 10 client.25154 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.745+0000 7f534c005740 10 client.25154 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:47.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.745+0000 7f534c005740 20 client.25154 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:47.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.745+0000 7f534c005740 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56168c30df10 0x56168c310300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.745+0000 7f534c005740 4 client.25154 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:47.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.745+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56168c260d60 con 0x56168c30df10 2024-09-19T04:33:47.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.745+0000 7f53437fe640 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56168c30df10 0x56168c310300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.746+0000 7f53437fe640 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56168c30df10 0x56168c310300 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ad6167f3765c65ec server_cookie=5875503099f360da in_seq=0 out_seq=0 2024-09-19T04:33:47.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.746+0000 7f5322ffd640 10 client.25154 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:47.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.746+0000 7f5322ffd640 1 -- 172.21.15.70:0/3031758674 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56168c260d60 con 0x56168c30df10 2024-09-19T04:33:47.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.746+0000 7f5322ffd640 10 client.25154 handle_command_reply: tid=0 2024-09-19T04:33:47.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.746+0000 7f534c005740 1 client.25154 shutdown 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2fe680 msgr2=0x56168c2fb780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2fe680 0x56168c2fb780 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f533c006010 tx=0x7f533c003dd0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 shutdown_connections 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56168c30df10 0x56168c310300 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2fe680 0x56168c2fb780 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c2fb240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 --2- 172.21.15.70:0/3031758674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2f34a0 0x56168c2fdf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f5322ffd640 0 client.25154 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 >> 172.21.15.70:0/3031758674 conn(0x56168c2efa30 msgr2=0x56168c2f5760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 shutdown_connections 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.747+0000 7f534c005740 1 -- 172.21.15.70:0/3031758674 wait complete. 2024-09-19T04:33:47.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.748+0000 7f534c005740 20 client.25154 trim_cache size 0 max 16384 2024-09-19T04:33:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f534c005740 1 Processor -- start 2024-09-19T04:33:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f534c005740 1 -- start start 2024-09-19T04:33:47.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f534c005740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c30a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f534c005740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 0x56168c2f9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f534c005740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c315960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f534c005740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53441ae0c0 con 0x56168c2fe680 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f534c005740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53441ab900 con 0x56168c2f3dc0 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f534c005740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f53441a9790 con 0x56168c2f34a0 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f5343fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c315960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f53437fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c30a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f5343fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c315960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60818/0 (socket says 172.21.15.70:60818) 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f5343fff640 1 -- 172.21.15.70:0/898809405 learned_addr learned my addr 172.21.15.70:0/898809405 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:47.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f5342ffd640 1 --2- 172.21.15.70:0/898809405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 0x56168c2f9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f53437fe640 1 -- 172.21.15.70:0/898809405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 msgr2=0x56168c2f9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f53437fe640 1 --2- 172.21.15.70:0/898809405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 0x56168c2f9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f53437fe640 1 -- 172.21.15.70:0/898809405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 msgr2=0x56168c315960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f53437fe640 1 --2- 172.21.15.70:0/898809405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c315960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.769+0000 7f53437fe640 1 -- 172.21.15.70:0/898809405 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56168c2fe300 con 0x56168c2f34a0 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.770+0000 7f53437fe640 1 --2- 172.21.15.70:0/898809405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c30a550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53340cd7c0 tx=0x7f53340d2560 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ce6593fda41ae3fa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.770+0000 7f53297fa640 1 -- 172.21.15.70:0/898809405 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340a0700 con 0x56168c2f34a0 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.770+0000 7f53297fa640 1 -- 172.21.15.70:0/898809405 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f533409c400 con 0x56168c2f34a0 2024-09-19T04:33:47.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.770+0000 7f53297fa640 1 -- 172.21.15.70:0/898809405 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53340a0230 con 0x56168c2f34a0 2024-09-19T04:33:47.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 -- 172.21.15.70:0/898809405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 msgr2=0x56168c30a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 --2- 172.21.15.70:0/898809405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c30a550 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f53340cd7c0 tx=0x7f53340d2560 comp rx=0 tx=0).stop 2024-09-19T04:33:47.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 -- 172.21.15.70:0/898809405 shutdown_connections 2024-09-19T04:33:47.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 --2- 172.21.15.70:0/898809405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c315960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 --2- 172.21.15.70:0/898809405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f3dc0 0x56168c2f9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 --2- 172.21.15.70:0/898809405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f34a0 0x56168c30a550 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 -- 172.21.15.70:0/898809405 >> 172.21.15.70:0/898809405 conn(0x56168c2efa30 msgr2=0x56168c2fd2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 -- 172.21.15.70:0/898809405 shutdown_connections 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 -- 172.21.15.70:0/898809405 wait complete. 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.771+0000 7f534c005740 1 -- start start 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f534c005740 1 Processor -- start 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f534c005740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f34a0 0x56168c303b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f534c005740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c3040b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f534c005740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c376930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f534c005740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f53441a9de0 con 0x56168c2fe680 2024-09-19T04:33:47.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f534c005740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f53441ab230 con 0x56168c2f34a0 2024-09-19T04:33:47.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f534c005740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f53441aa490 con 0x56168c2f3dc0 2024-09-19T04:33:47.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5342ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c3040b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5343fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c376930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5342ffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c3040b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:58324/0 (socket says 172.21.15.70:58324) 2024-09-19T04:33:47.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5342ffd640 1 -- 172.21.15.70:0/3747987254 learned_addr learned my addr 172.21.15.70:0/3747987254 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:47.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f53437fe640 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f34a0 0x56168c303b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f534c005740 10 client.0 _ll_register_callbacks cb 0x7f533c009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5342ffd640 1 -- 172.21.15.70:0/3747987254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f34a0 msgr2=0x56168c303b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5342ffd640 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f34a0 0x56168c303b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5342ffd640 1 -- 172.21.15.70:0/3747987254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 msgr2=0x56168c376930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5342ffd640 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c376930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.772+0000 7f5342ffd640 1 -- 172.21.15.70:0/3747987254 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56168c376e70 con 0x56168c2f3dc0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f5342ffd640 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c3040b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56168c2fc880 tx=0x7f5338011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=20f5a7b5bbd50012 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f5322ffd640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f5322ffd640 1 -- 172.21.15.70:0/3747987254 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5338004250 con 0x56168c2f3dc0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f534c005740 1 -- 172.21.15.70:0/3747987254 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533409c400 con 0x56168c2f3dc0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f5322ffd640 1 -- 172.21.15.70:0/3747987254 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f53380043f0 con 0x56168c2f3dc0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f5322ffd640 1 -- 172.21.15.70:0/3747987254 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f5338005020 con 0x56168c2f3dc0 2024-09-19T04:33:47.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f534c005740 10 client.25198 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f534c005740 1 -- 172.21.15.70:0/3747987254 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x56168c378240 con 0x56168c2f3dc0 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f5322ffd640 1 -- 172.21.15.70:0/3747987254 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f533409c400 con 0x56168c2f3dc0 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f5322ffd640 1 -- 172.21.15.70:0/3747987254 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f5338024020 con 0x56168c2f3dc0 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.773+0000 7f534c005740 10 client.25198 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f534c005740 10 client.25198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f534c005740 20 client.25198 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f534c005740 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56168c378a50 0x56168c37ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f534c005740 4 client.25198 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f534c005740 1 -- 172.21.15.70:0/3747987254 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56168c1dd210 con 0x56168c378a50 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f53437fe640 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56168c378a50 0x56168c37ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f53437fe640 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56168c378a50 0x56168c37ae70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6aa608dc4a88d93b server_cookie=5443541e4f834959 in_seq=0 out_seq=0 2024-09-19T04:33:47.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f5322ffd640 10 client.25198 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f5322ffd640 1 -- 172.21.15.70:0/3747987254 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56168c1dd210 con 0x56168c378a50 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f5322ffd640 10 client.25198 handle_command_reply: tid=0 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.774+0000 7f534c005740 1 client.25198 shutdown 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 -- 172.21.15.70:0/3747987254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 msgr2=0x56168c3040b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c3040b0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x56168c2fc880 tx=0x7f5338011810 comp rx=0 tx=0).stop 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 -- 172.21.15.70:0/3747987254 shutdown_connections 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56168c378a50 0x56168c37ae70 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56168c2fe680 0x56168c376930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f5322ffd640 0 client.25198 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56168c2f3dc0 0x56168c3040b0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 --2- 172.21.15.70:0/3747987254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56168c2f34a0 0x56168c303b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 -- 172.21.15.70:0/3747987254 >> 172.21.15.70:0/3747987254 conn(0x56168c2efa30 msgr2=0x56168c2ee370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:47.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 -- 172.21.15.70:0/3747987254 shutdown_connections 2024-09-19T04:33:47.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 1 -- 172.21.15.70:0/3747987254 wait complete. 2024-09-19T04:33:47.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.775+0000 7f534c005740 20 client.25198 trim_cache size 0 max 16384 2024-09-19T04:33:47.784 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:33:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:33:47.784 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:33:47.784 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 -- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f532c0a33b0 msgr2=0x7f532c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f532c0a33b0 0x7f532c0a5870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f533c04b000 tx=0x7f533c04c000 comp rx=0 tx=0).stop 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 -- 172.21.15.70:0/1855099268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344100e20 msgr2=0x7f534419a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344100e20 0x7f534419a6e0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f533400e9f0 tx=0x7f533400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 -- 172.21.15.70:0/1855099268 shutdown_connections 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f532c0a33b0 0x7f532c0a5870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5344102ef0 0x7f534419efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5344102570 0x7f534419ac20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 --2- 172.21.15.70:0/1855099268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5344100e20 0x7f534419a6e0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:47.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 -- 172.21.15.70:0/1855099268 >> 172.21.15.70:0/1855099268 conn(0x7f53440fc7d0 msgr2=0x7f534406a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:47.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 -- 172.21.15.70:0/1855099268 shutdown_connections 2024-09-19T04:33:47.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:47.776+0000 7f5349c2c640 1 -- 172.21.15.70:0/1855099268 wait complete. 2024-09-19T04:33:47.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:47 smithi070 ceph-mon[30942]: pgmap v93: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 243 op/s 2024-09-19T04:33:47.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:47 smithi167 ceph-mon[34339]: pgmap v93: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 243 op/s 2024-09-19T04:33:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:47 smithi134 ceph-mon[34525]: pgmap v93: 97 pgs: 97 active+clean; 205 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.3 MiB/s wr, 243 op/s 2024-09-19T04:33:48.646 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:33:48.646 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:33:48.956 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:49.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 -- 172.21.15.70:0/2082246559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1798102d30 msgr2=0x7f1798103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:49.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 --2- 172.21.15.70:0/2082246559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1798102d30 0x7f1798103110 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f1788009930 tx=0x7f178802a420 comp rx=0 tx=0).stop 2024-09-19T04:33:49.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 -- 172.21.15.70:0/2082246559 shutdown_connections 2024-09-19T04:33:49.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 --2- 172.21.15.70:0/2082246559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17981082a0 0x7f179810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 --2- 172.21.15.70:0/2082246559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17981036e0 0x7f1798107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 --2- 172.21.15.70:0/2082246559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1798102d30 0x7f1798103110 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 -- 172.21.15.70:0/2082246559 >> 172.21.15.70:0/2082246559 conn(0x7f17980fc7d0 msgr2=0x7f17980febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 -- 172.21.15.70:0/2082246559 shutdown_connections 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.473+0000 7f179c974640 1 -- 172.21.15.70:0/2082246559 wait complete. 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.474+0000 7f179c974640 1 Processor -- start 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.474+0000 7f179c974640 1 -- start start 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.474+0000 7f179c974640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1798102d30 0x7f1798198640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179c974640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17981036e0 0x7f1798198b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179c974640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17981082a0 0x7f179819cf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179c974640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1798112090 con 0x7f17981036e0 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179c974640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1798111f10 con 0x7f1798102d30 2024-09-19T04:33:49.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179c974640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1798112210 con 0x7f17981082a0 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f1795d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17981036e0 0x7f1798198b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1798102d30 0x7f1798198640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f1796d9d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17981082a0 0x7f179819cf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1798102d30 0x7f1798198640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:54628/0 (socket says 172.21.15.70:54628) 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f1795d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17981036e0 0x7f1798198b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60834/0 (socket says 172.21.15.70:60834) 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 -- 172.21.15.70:0/838987719 learned_addr learned my addr 172.21.15.70:0/838987719 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 -- 172.21.15.70:0/838987719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17981082a0 msgr2=0x7f179819cf10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17981082a0 0x7f179819cf10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 -- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17981036e0 msgr2=0x7f1798198b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17981036e0 0x7f1798198b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 -- 172.21.15.70:0/838987719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f179819d5f0 con 0x7f1798102d30 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.475+0000 7f179659c640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1798102d30 0x7f1798198640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f17880314b0 tx=0x7f1788004040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:49.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.476+0000 7f17877fe640 1 -- 172.21.15.70:0/838987719 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f178803f030 con 0x7f1798102d30 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.476+0000 7f17877fe640 1 -- 172.21.15.70:0/838987719 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1788004440 con 0x7f1798102d30 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.476+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f179819d880 con 0x7f1798102d30 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.476+0000 7f17877fe640 1 -- 172.21.15.70:0/838987719 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1788035070 con 0x7f1798102d30 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.476+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17981a51c0 con 0x7f1798102d30 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.477+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1798103110 con 0x7f1798102d30 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.478+0000 7f17877fe640 1 -- 172.21.15.70:0/838987719 <== mon.2 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1788042030 con 0x7f1798102d30 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.479+0000 7f17877fe640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17800a3430 0x7f17800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.479+0000 7f1795d9b640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17800a3430 0x7f17800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.479+0000 7f17877fe640 1 -- 172.21.15.70:0/838987719 <== mon.2 v2:172.21.15.134:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f17880efdf0 con 0x7f1798102d30 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.479+0000 7f1795d9b640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17800a3430 0x7f17800a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17980feeb0 tx=0x7f178c005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:49.492 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.484+0000 7f17877fe640 1 -- 172.21.15.70:0/838987719 <== mon.2 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1788049030 con 0x7f1798102d30 2024-09-19T04:33:49.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:49 smithi070 ceph-mon[30942]: pgmap v94: 97 pgs: 97 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 423 op/s 2024-09-19T04:33:49.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.745+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f179810a2b0 con 0x7f1798102d30 2024-09-19T04:33:49.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.746+0000 7f17877fe640 1 -- 172.21.15.70:0/838987719 <== mon.2 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 27 v27) ==== 94+0+11919 (secure 0 0 0) 0x7f17880bc1a0 con 0x7f1798102d30 2024-09-19T04:33:49.813 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:33:49.813 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":27,"btime":"2024-09-19T04:33:37:596182+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":27,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:33:36.699209+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:33:49.814 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 27 2024-09-19T04:33:49.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17800a3430 msgr2=0x7f17800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:49.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17800a3430 0x7f17800a58f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f17980feeb0 tx=0x7f178c005f90 comp rx=0 tx=0).stop 2024-09-19T04:33:49.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1798102d30 msgr2=0x7f1798198640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1798102d30 0x7f1798198640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f17880314b0 tx=0x7f1788004040 comp rx=0 tx=0).stop 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 shutdown_connections 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17800a3430 0x7f17800a58f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f17981082a0 0x7f179819cf10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f17981036e0 0x7f1798198b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.748+0000 7f179c974640 1 --2- 172.21.15.70:0/838987719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1798102d30 0x7f1798198640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.749+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 >> 172.21.15.70:0/838987719 conn(0x7f17980fc7d0 msgr2=0x7f1798105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.749+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 shutdown_connections 2024-09-19T04:33:49.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:49.749+0000 7f179c974640 1 -- 172.21.15.70:0/838987719 wait complete. 2024-09-19T04:33:49.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:49 smithi167 ceph-mon[34339]: pgmap v94: 97 pgs: 97 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 423 op/s 2024-09-19T04:33:50.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:49 smithi134 ceph-mon[34525]: pgmap v94: 97 pgs: 97 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.0 MiB/s wr, 423 op/s 2024-09-19T04:33:50.765 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:33:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/838987719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:33:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:50 smithi070 ceph-mon[30942]: pgmap v95: 97 pgs: 97 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 361 op/s 2024-09-19T04:33:50.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:50 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/838987719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:33:50.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:50 smithi167 ceph-mon[34339]: pgmap v95: 97 pgs: 97 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 361 op/s 2024-09-19T04:33:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:50 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/838987719' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:33:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:50 smithi134 ceph-mon[34525]: pgmap v95: 97 pgs: 97 active+clean; 202 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.4 MiB/s wr, 361 op/s 2024-09-19T04:33:51.051 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:51.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.542+0000 7fd859ea3640 1 -- 172.21.15.70:0/4128842454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd854101df0 msgr2=0x7fd8541021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.542+0000 7fd859ea3640 1 --2- 172.21.15.70:0/4128842454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd854101df0 0x7fd8541021d0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fd844009900 tx=0x7fd84402a410 comp rx=0 tx=0).stop 2024-09-19T04:33:51.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.543+0000 7fd859ea3640 1 -- 172.21.15.70:0/4128842454 shutdown_connections 2024-09-19T04:33:51.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.543+0000 7fd859ea3640 1 --2- 172.21.15.70:0/4128842454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854106f20 0x7fd85410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.543+0000 7fd859ea3640 1 --2- 172.21.15.70:0/4128842454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8541027a0 0x7fd8541067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.543+0000 7fd859ea3640 1 --2- 172.21.15.70:0/4128842454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd854101df0 0x7fd8541021d0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.543+0000 7fd859ea3640 1 -- 172.21.15.70:0/4128842454 >> 172.21.15.70:0/4128842454 conn(0x7fd8540fd8f0 msgr2=0x7fd8540ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.543+0000 7fd859ea3640 1 -- 172.21.15.70:0/4128842454 shutdown_connections 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.543+0000 7fd859ea3640 1 -- 172.21.15.70:0/4128842454 wait complete. 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.543+0000 7fd859ea3640 1 Processor -- start 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd859ea3640 1 -- start start 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd859ea3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd854101df0 0x7fd854198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd859ea3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8541027a0 0x7fd8541989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd859ea3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854106f20 0x7fd85419cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd859ea3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd854111f90 con 0x7fd8541027a0 2024-09-19T04:33:51.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd859ea3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd854111e10 con 0x7fd854101df0 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd859ea3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd854112110 con 0x7fd854106f20 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8541027a0 0x7fd8541989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd853fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854106f20 0x7fd85419cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8541027a0 0x7fd8541989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60846/0 (socket says 172.21.15.70:60846) 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd852ffd640 1 -- 172.21.15.70:0/3607638943 learned_addr learned my addr 172.21.15.70:0/3607638943 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd8537fe640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd854101df0 0x7fd854198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd852ffd640 1 -- 172.21.15.70:0/3607638943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854106f20 msgr2=0x7fd85419cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd852ffd640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854106f20 0x7fd85419cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd852ffd640 1 -- 172.21.15.70:0/3607638943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd854101df0 msgr2=0x7fd854198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd852ffd640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd854101df0 0x7fd854198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.544+0000 7fd852ffd640 1 -- 172.21.15.70:0/3607638943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd85419d420 con 0x7fd8541027a0 2024-09-19T04:33:51.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.545+0000 7fd852ffd640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8541027a0 0x7fd8541989b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd84800b4a0 tx=0x7fd84800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.545+0000 7fd850ff9640 1 -- 172.21.15.70:0/3607638943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848014070 con 0x7fd8541027a0 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.545+0000 7fd859ea3640 1 -- 172.21.15.70:0/3607638943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd85419d710 con 0x7fd8541027a0 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.545+0000 7fd850ff9640 1 -- 172.21.15.70:0/3607638943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd848010ae0 con 0x7fd8541027a0 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.545+0000 7fd850ff9640 1 -- 172.21.15.70:0/3607638943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848017c70 con 0x7fd8541027a0 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.545+0000 7fd859ea3640 1 -- 172.21.15.70:0/3607638943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8541a4ff0 con 0x7fd8541027a0 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.547+0000 7fd850ff9640 1 -- 172.21.15.70:0/3607638943 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd848017070 con 0x7fd8541027a0 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.547+0000 7fd85c27c740 1 Processor -- start 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.547+0000 7fd85c27c740 1 -- start start 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a427bc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427bca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427c7370 0x557a427c9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd85c27c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557a427222f0 con 0x557a427c7370 2024-09-19T04:33:51.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd85c27c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557a426c9cf0 con 0x557a427bdb40 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd85c27c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557a4271e2b0 con 0x557a427bc5d0 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd850ff9640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd83c0a33b0 0x7fd83c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427c7370 0x557a427c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd853fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a427bc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427bca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd853fff640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd83c0a33b0 0x7fd83c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427c7370 0x557a427c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60856/0 (socket says 172.21.15.70:60856) 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427bca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:58388/0 (socket says 172.21.15.70:58388) 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 -- 172.21.15.70:0/2455964825 learned_addr learned my addr 172.21.15.70:0/2455964825 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd850ff9640 1 -- 172.21.15.70:0/3607638943 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd8480ceee0 con 0x7fd8541027a0 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 -- 172.21.15.70:0/2455964825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 msgr2=0x557a427bca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:51.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427bca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 -- 172.21.15.70:0/2455964825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 msgr2=0x557a427bc090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a427bc090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 -- 172.21.15.70:0/2455964825 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a426ae3a0 con 0x557a427c7370 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd8537fe640 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd853fff640 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a427bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd852ffd640 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427c7370 0x557a427c9760 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd84800c3d0 tx=0x7fd8480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f922a6b9bf593174 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd853fff640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd83c0a33b0 0x7fd83c0a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009fd0 tx=0x7fd84c0096a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.548+0000 7fd839ffb640 1 -- 172.21.15.70:0/2455964825 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84801e020 con 0x557a427c7370 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd839ffb640 1 -- 172.21.15.70:0/2455964825 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8480a2a20 con 0x557a427c7370 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd839ffb640 1 -- 172.21.15.70:0/2455964825 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd848017360 con 0x557a427c7370 2024-09-19T04:33:51.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 -- 172.21.15.70:0/2455964825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427c7370 msgr2=0x557a427c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427c7370 0x557a427c9760 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fd84800c3d0 tx=0x7fd8480046c0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 -- 172.21.15.70:0/2455964825 shutdown_connections 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427c7370 0x557a427c9760 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427bca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2455964825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a427bc090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 -- 172.21.15.70:0/2455964825 >> 172.21.15.70:0/2455964825 conn(0x557a42785310 msgr2=0x557a427b8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 -- 172.21.15.70:0/2455964825 shutdown_connections 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.549+0000 7fd85c27c740 1 -- 172.21.15.70:0/2455964825 wait complete. 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 1 -- start start 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 1 Processor -- start 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427c6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427c4050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x557a427ca010 con 0x557a427bdb40 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x557a426dd060 con 0x557a427c7370 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x557a427ca190 con 0x557a427bc5d0 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd85c27c740 10 client.0 _ll_register_callbacks cb 0x557a424308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427c4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427c4050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60858/0 (socket says 172.21.15.70:60858) 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd852ffd640 1 -- 172.21.15.70:0/821590215 learned_addr learned my addr 172.21.15.70:0/821590215 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd8537fe640 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427c6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd852ffd640 1 -- 172.21.15.70:0/821590215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 msgr2=0x557a427c6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd852ffd640 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427c6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd852ffd640 1 -- 172.21.15.70:0/821590215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 msgr2=0x557a427c47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd853fff640 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd852ffd640 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c47e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.550+0000 7fd852ffd640 1 -- 172.21.15.70:0/821590215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a424933c0 con 0x557a427bdb40 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd852ffd640 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427c4050 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd8480ccc50 tx=0x7fd84809b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=761b448717f4a56a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd832ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd832ffd640 1 -- 172.21.15.70:0/821590215 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84801e070 con 0x557a427bdb40 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd832ffd640 1 -- 172.21.15.70:0/821590215 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd848097a10 con 0x557a427bdb40 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 1 -- 172.21.15.70:0/821590215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8480a2a20 con 0x557a427bdb40 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd832ffd640 1 -- 172.21.15.70:0/821590215 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd8480a2de0 con 0x557a427bdb40 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 10 client.15726 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 1 -- 172.21.15.70:0/821590215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557a427d5af0 con 0x557a427bdb40 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd832ffd640 1 -- 172.21.15.70:0/821590215 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8480a2a20 con 0x557a427bdb40 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd832ffd640 1 -- 172.21.15.70:0/821590215 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd8480cc840 con 0x557a427bdb40 2024-09-19T04:33:51.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 10 client.15726 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 10 client.15726 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 20 client.15726 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x557a427d6e40 0x557a427d9230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 4 client.15726 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.551+0000 7fd85c27c740 1 -- 172.21.15.70:0/821590215 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557a4272f860 con 0x557a427d6e40 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.552+0000 7fd8537fe640 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x557a427d6e40 0x557a427d9230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.552+0000 7fd832ffd640 10 client.15726 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.552+0000 7fd8537fe640 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x557a427d6e40 0x557a427d9230 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=756a272142b734de server_cookie=41af8023cb4e7ebc in_seq=0 out_seq=0 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd832ffd640 1 -- 172.21.15.70:0/821590215 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557a4272f860 con 0x557a427d6e40 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd832ffd640 10 client.15726 handle_command_reply: tid=0 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 client.15726 shutdown 2024-09-19T04:33:51.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 -- 172.21.15.70:0/821590215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 msgr2=0x557a427c4050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427c4050 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7fd8480ccc50 tx=0x7fd84809b4a0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 -- 172.21.15.70:0/821590215 shutdown_connections 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x557a427d6e40 0x557a427d9230 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427c4050 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 --2- 172.21.15.70:0/821590215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427c6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd832ffd640 0 client.15726 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.553+0000 7fd85c27c740 1 -- 172.21.15.70:0/821590215 >> 172.21.15.70:0/821590215 conn(0x557a42785310 msgr2=0x557a427be990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.554+0000 7fd85c27c740 1 -- 172.21.15.70:0/821590215 shutdown_connections 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.554+0000 7fd85c27c740 1 -- 172.21.15.70:0/821590215 wait complete. 2024-09-19T04:33:51.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.554+0000 7fd85c27c740 20 client.15726 trim_cache size 0 max 16384 2024-09-19T04:33:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.566+0000 7fd85c27c740 1 Processor -- start 2024-09-19T04:33:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.566+0000 7fd85c27c740 1 -- start start 2024-09-19T04:33:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427cf800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427cfd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c3910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd85c27c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541b0110 con 0x557a427bdb40 2024-09-19T04:33:51.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd85c27c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541ad950 con 0x557a427c7370 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd85c27c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541ab7a0 con 0x557a427bc5d0 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427cfd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427cfd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60866/0 (socket says 172.21.15.70:60866) 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 -- 172.21.15.70:0/632417689 learned_addr learned my addr 172.21.15.70:0/632417689 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd8537fe640 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427cf800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd853fff640 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c3910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 -- 172.21.15.70:0/632417689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 msgr2=0x557a427cf800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427cf800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 -- 172.21.15.70:0/632417689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 msgr2=0x557a427c3910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c3910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 -- 172.21.15.70:0/632417689 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557a427bf120 con 0x557a427bdb40 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd853fff640 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd852ffd640 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427cfd40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd84809b330 tx=0x7fd8480047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcbfec8ac5884ffb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd8397fa640 1 -- 172.21.15.70:0/632417689 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84801e070 con 0x557a427bdb40 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd8397fa640 1 -- 172.21.15.70:0/632417689 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd848010610 con 0x557a427bdb40 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.567+0000 7fd8397fa640 1 -- 172.21.15.70:0/632417689 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8480b4120 con 0x557a427bdb40 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 -- 172.21.15.70:0/632417689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 msgr2=0x557a427cfd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427cfd40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fd84809b330 tx=0x7fd8480047d0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 -- 172.21.15.70:0/632417689 shutdown_connections 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427c7370 0x557a427c3910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bdb40 0x557a427cfd40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 --2- 172.21.15.70:0/632417689 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427bc5d0 0x557a427cf800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 -- 172.21.15.70:0/632417689 >> 172.21.15.70:0/632417689 conn(0x557a42785310 msgr2=0x557a427c2920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 -- 172.21.15.70:0/632417689 shutdown_connections 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.568+0000 7fd85c27c740 1 -- 172.21.15.70:0/632417689 wait complete. 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 1 -- start start 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 1 Processor -- start 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bc5d0 0x557a4283cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a4283d170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427c7370 0x557a427de020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541abe10 con 0x557a427bc5d0 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541ad280 con 0x557a427bdb40 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd8541ac4e0 con 0x557a427c7370 2024-09-19T04:33:51.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bc5d0 0x557a4283cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd8537fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bc5d0 0x557a4283cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60868/0 (socket says 172.21.15.70:60868) 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd8537fe640 1 -- 172.21.15.70:0/2416029472 learned_addr learned my addr 172.21.15.70:0/2416029472 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd853fff640 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427c7370 0x557a427de020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd85c27c740 10 client.0 _ll_register_callbacks cb 0x7fd84c009f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd852ffd640 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a4283d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd8537fe640 1 -- 172.21.15.70:0/2416029472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427c7370 msgr2=0x557a427de020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd8537fe640 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427c7370 0x557a427de020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd8537fe640 1 -- 172.21.15.70:0/2416029472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 msgr2=0x557a4283d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.569+0000 7fd8537fe640 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a4283d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd8537fe640 1 -- 172.21.15.70:0/2416029472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557a427de830 con 0x557a427bc5d0 2024-09-19T04:33:51.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd852ffd640 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a4283d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd8537fe640 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bc5d0 0x557a4283cc30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd8440096c0 tx=0x7fd844004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86e63f955119f5fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd832ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd832ffd640 1 -- 172.21.15.70:0/2416029472 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd84404a070 con 0x557a427bc5d0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd832ffd640 1 -- 172.21.15.70:0/2416029472 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd844005040 con 0x557a427bc5d0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 1 -- 172.21.15.70:0/2416029472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd848010610 con 0x557a427bc5d0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd832ffd640 1 -- 172.21.15.70:0/2416029472 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fd844056050 con 0x557a427bc5d0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 10 client.15732 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 1 -- 172.21.15.70:0/2416029472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557a42845550 con 0x557a427bc5d0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd832ffd640 1 -- 172.21.15.70:0/2416029472 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd848010610 con 0x557a427bc5d0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd832ffd640 1 -- 172.21.15.70:0/2416029472 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fd844031710 con 0x557a427bc5d0 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 10 client.15732 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 10 client.15732 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:33:51.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 20 client.15732 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x557a42845d00 0x557a42848140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 4 client.15732 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:33:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.570+0000 7fd85c27c740 1 -- 172.21.15.70:0/2416029472 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x557a42729d70 con 0x557a42845d00 2024-09-19T04:33:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.571+0000 7fd852ffd640 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x557a42845d00 0x557a42848140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.571+0000 7fd852ffd640 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x557a42845d00 0x557a42848140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f89db76312727cc5 server_cookie=744d337f1fac9f40 in_seq=0 out_seq=0 2024-09-19T04:33:51.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.571+0000 7fd832ffd640 10 client.15732 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:33:51.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.572+0000 7fd832ffd640 1 -- 172.21.15.70:0/2416029472 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x557a42729d70 con 0x557a42845d00 2024-09-19T04:33:51.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.572+0000 7fd832ffd640 10 client.15732 handle_command_reply: tid=0 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.572+0000 7fd85c27c740 1 client.15732 shutdown 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.572+0000 7fd85c27c740 1 -- 172.21.15.70:0/2416029472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bc5d0 msgr2=0x557a4283cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.572+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bc5d0 0x557a4283cc30 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fd8440096c0 tx=0x7fd844004090 comp rx=0 tx=0).stop 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.572+0000 7fd85c27c740 1 -- 172.21.15.70:0/2416029472 shutdown_connections 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.572+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x557a42845d00 0x557a42848140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.572+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x557a427c7370 0x557a427de020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557a427bdb40 0x557a4283d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd85c27c740 1 --2- 172.21.15.70:0/2416029472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x557a427bc5d0 0x557a4283cc30 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd85c27c740 1 -- 172.21.15.70:0/2416029472 >> 172.21.15.70:0/2416029472 conn(0x557a42785310 msgr2=0x557a427c38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd832ffd640 0 client.15732 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd85c27c740 1 -- 172.21.15.70:0/2416029472 shutdown_connections 2024-09-19T04:33:51.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd85c27c740 1 -- 172.21.15.70:0/2416029472 wait complete. 2024-09-19T04:33:51.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd85c27c740 20 client.15732 trim_cache size 0 max 16384 2024-09-19T04:33:51.584 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:33:51.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 -- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd83c0a33b0 msgr2=0x7fd83c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd83c0a33b0 0x7fd83c0a5870 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd84c009fd0 tx=0x7fd84c0096a0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 -- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8541027a0 msgr2=0x7fd8541989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:51.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8541027a0 0x7fd8541989b0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7fd84800b4a0 tx=0x7fd84800b960 comp rx=0 tx=0).stop 2024-09-19T04:33:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 -- 172.21.15.70:0/3607638943 shutdown_connections 2024-09-19T04:33:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd83c0a33b0 0x7fd83c0a5870 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd854106f20 0x7fd85419cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd8541027a0 0x7fd8541989b0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 --2- 172.21.15.70:0/3607638943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd854101df0 0x7fd854198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 -- 172.21.15.70:0/3607638943 >> 172.21.15.70:0/3607638943 conn(0x7fd8540fd8f0 msgr2=0x7fd8540fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 -- 172.21.15.70:0/3607638943 shutdown_connections 2024-09-19T04:33:51.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:51.573+0000 7fd859ea3640 1 -- 172.21.15.70:0/3607638943 wait complete. 2024-09-19T04:33:52.425 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:33:52.697 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 -- 172.21.15.70:0/4249930260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f81027a0 msgr2=0x7f95f81067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 --2- 172.21.15.70:0/4249930260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f81027a0 0x7f95f81067f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f95e4009900 tx=0x7f95e402a410 comp rx=0 tx=0).stop 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 -- 172.21.15.70:0/4249930260 shutdown_connections 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 --2- 172.21.15.70:0/4249930260 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95f8106f20 0x7f95f810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 --2- 172.21.15.70:0/4249930260 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f81027a0 0x7f95f81067f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 --2- 172.21.15.70:0/4249930260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f8101df0 0x7f95f81021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 -- 172.21.15.70:0/4249930260 >> 172.21.15.70:0/4249930260 conn(0x7f95f80fd8f0 msgr2=0x7f95f80ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 -- 172.21.15.70:0/4249930260 shutdown_connections 2024-09-19T04:33:53.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.186+0000 7f95fec2f640 1 -- 172.21.15.70:0/4249930260 wait complete. 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fec2f640 1 Processor -- start 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fec2f640 1 -- start start 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fec2f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95f8101df0 0x7f95f80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fec2f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81027a0 0x7f95f8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fec2f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f8106f20 0x7f95f8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fec2f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8111f10 con 0x7f95f8106f20 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fec2f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8111d90 con 0x7f95f81027a0 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fec2f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95f8112090 con 0x7f95f8101df0 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fc9cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95f8101df0 0x7f95f80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81027a0 0x7f95f8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fc9cb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95f8101df0 0x7f95f80744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:58432/0 (socket says 172.21.15.70:58432) 2024-09-19T04:33:53.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fc9cb640 1 -- 172.21.15.70:0/2414811172 learned_addr learned my addr 172.21.15.70:0/2414811172 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.187+0000 7f95fd1cc640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f8106f20 0x7f95f8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95fd1cc640 1 -- 172.21.15.70:0/2414811172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95f8101df0 msgr2=0x7f95f80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95fd1cc640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95f8101df0 0x7f95f80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95fd1cc640 1 -- 172.21.15.70:0/2414811172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81027a0 msgr2=0x7f95f8074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95fd1cc640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81027a0 0x7f95f8074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95fd1cc640 1 -- 172.21.15.70:0/2414811172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95f81a68d0 con 0x7f95f8106f20 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95f7fff640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81027a0 0x7f95f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95fd1cc640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f8106f20 0x7f95f8074f70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f95f000e940 tx=0x7f95f000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95f5ffb640 1 -- 172.21.15.70:0/2414811172 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f0004d20 con 0x7f95f8106f20 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95f5ffb640 1 -- 172.21.15.70:0/2414811172 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95f0005020 con 0x7f95f8106f20 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95fec2f640 1 -- 172.21.15.70:0/2414811172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95f81a6bc0 con 0x7f95f8106f20 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95f5ffb640 1 -- 172.21.15.70:0/2414811172 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95f00116b0 con 0x7f95f8106f20 2024-09-19T04:33:53.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.188+0000 7f95fec2f640 1 -- 172.21.15.70:0/2414811172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95f81a7080 con 0x7f95f8106f20 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.191+0000 7f95f5ffb640 1 -- 172.21.15.70:0/2414811172 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f95f000cb20 con 0x7f95f8106f20 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.191+0000 7f9601008740 1 Processor -- start 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.191+0000 7f9601008740 1 -- start start 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.191+0000 7f9601008740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d465090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.191+0000 7f9601008740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d465a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.191+0000 7f9601008740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d470370 0x559e1d472760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f9601008740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559e1d3cb2f0 con 0x559e1d4655d0 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f9601008740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559e1d372cf0 con 0x559e1d466b40 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f9601008740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559e1d3c72b0 con 0x559e1d470370 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d465a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d465a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60892/0 (socket says 172.21.15.70:60892) 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 -- 172.21.15.70:0/1949054267 learned_addr learned my addr 172.21.15.70:0/1949054267 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:53.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95f7fff640 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d470370 0x559e1d472760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95f5ffb640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95e80a33b0 0x7f95e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95f7fff640 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d465090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 -- 172.21.15.70:0/1949054267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d470370 msgr2=0x559e1d472760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d470370 0x559e1d472760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 -- 172.21.15.70:0/1949054267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 msgr2=0x559e1d465090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d465090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 -- 172.21.15.70:0/1949054267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1d3573a0 con 0x559e1d4655d0 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fd1cc640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95e80a33b0 0x7f95e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95f5ffb640 1 -- 172.21.15.70:0/2414811172 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f95f00cf9a0 con 0x7f95f8106f20 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.192+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d465a10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00adb0 tx=0x7f95ec00f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42bb79513946cf76 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:53.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f95e2ffd640 1 -- 172.21.15.70:0/1949054267 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec01d070 con 0x559e1d4655d0 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f95e2ffd640 1 -- 172.21.15.70:0/1949054267 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95ec010d10 con 0x559e1d4655d0 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f95fd1cc640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95e80a33b0 0x7f95e80a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95f0098720 tx=0x7f95f001d000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f95e2ffd640 1 -- 172.21.15.70:0/1949054267 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec018cc0 con 0x559e1d4655d0 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 -- 172.21.15.70:0/1949054267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 msgr2=0x559e1d465a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d465a10 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f95ec00adb0 tx=0x7f95ec00f790 comp rx=0 tx=0).stop 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 -- 172.21.15.70:0/1949054267 shutdown_connections 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d470370 0x559e1d472760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d465a10 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 --2- 172.21.15.70:0/1949054267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d465090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 -- 172.21.15.70:0/1949054267 >> 172.21.15.70:0/1949054267 conn(0x559e1d42e310 msgr2=0x559e1d461c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 -- 172.21.15.70:0/1949054267 shutdown_connections 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.193+0000 7f9601008740 1 -- 172.21.15.70:0/1949054267 wait complete. 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 1 -- start start 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 1 Processor -- start 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d46fce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d466b40 0x559e1d46cf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d470370 0x559e1d46d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559e1d473070 con 0x559e1d4655d0 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559e1d386060 con 0x559e1d470370 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559e1d4731f0 con 0x559e1d466b40 2024-09-19T04:33:53.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f9601008740 10 client.0 _ll_register_callbacks cb 0x559e1d0d98c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d46fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d46fce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60898/0 (socket says 172.21.15.70:60898) 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f95f7fff640 1 -- 172.21.15.70:0/4039263579 learned_addr learned my addr 172.21.15.70:0/4039263579 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.194+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d466b40 0x559e1d46cf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95f7fff640 1 -- 172.21.15.70:0/4039263579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d466b40 msgr2=0x559e1d46cf90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95f7fff640 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d466b40 0x559e1d46cf90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95f7fff640 1 -- 172.21.15.70:0/4039263579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d470370 msgr2=0x559e1d46d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95f7fff640 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d470370 0x559e1d46d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95f7fff640 1 -- 172.21.15.70:0/4039263579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1d13c3c0 con 0x559e1d4655d0 2024-09-19T04:33:53.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95f7fff640 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d46fce0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f95e4004730 tx=0x7f95e40319c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db15a5d1e81fd5eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95d7fff640 1 -- 172.21.15.70:0/4039263579 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4043030 con 0x559e1d4655d0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95d7fff640 1 -- 172.21.15.70:0/4039263579 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f95e40052d0 con 0x559e1d4655d0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f9601008740 1 -- 172.21.15.70:0/4039263579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95ec010d10 con 0x559e1d4655d0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95d7fff640 1 -- 172.21.15.70:0/4039263579 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95e4035040 con 0x559e1d4655d0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f9601008740 10 client.15744 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f9601008740 1 -- 172.21.15.70:0/4039263579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559e1d47eab0 con 0x559e1d4655d0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.195+0000 7f95d7fff640 1 -- 172.21.15.70:0/4039263579 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95ec010d10 con 0x559e1d4655d0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f95d7fff640 1 -- 172.21.15.70:0/4039263579 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f95e404f020 con 0x559e1d4655d0 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f9601008740 10 client.15744 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f9601008740 10 client.15744 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:33:53.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f9601008740 20 client.15744 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f9601008740 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559e1d4802e0 0x559e1d482710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f9601008740 4 client.15744 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f9601008740 1 -- 172.21.15.70:0/4039263579 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559e1d3d8860 con 0x559e1d4802e0 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559e1d4802e0 0x559e1d482710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559e1d4802e0 0x559e1d482710 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=42560c393521fe1e server_cookie=e5a1024644b837e9 in_seq=0 out_seq=0 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.196+0000 7f95d7fff640 10 client.15744 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f95d7fff640 1 -- 172.21.15.70:0/4039263579 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559e1d3d8860 con 0x559e1d4802e0 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f95d7fff640 10 client.15744 handle_command_reply: tid=0 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 client.15744 shutdown 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 -- 172.21.15.70:0/4039263579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 msgr2=0x559e1d46fce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d46fce0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f95e4004730 tx=0x7f95e40319c0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 -- 172.21.15.70:0/4039263579 shutdown_connections 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559e1d4802e0 0x559e1d482710 crc :-1 s=READY pgs=41 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d470370 0x559e1d46d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d466b40 0x559e1d46cf90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 --2- 172.21.15.70:0/4039263579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d4655d0 0x559e1d46fce0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 -- 172.21.15.70:0/4039263579 >> 172.21.15.70:0/4039263579 conn(0x559e1d42e310 msgr2=0x559e1d467930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f95d7fff640 0 client.15744 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 -- 172.21.15.70:0/4039263579 shutdown_connections 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.197+0000 7f9601008740 1 -- 172.21.15.70:0/4039263579 wait complete. 2024-09-19T04:33:53.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.198+0000 7f9601008740 20 client.15744 trim_cache size 0 max 16384 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f9601008740 1 Processor -- start 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f9601008740 1 -- start start 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f9601008740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 0x559e1d461e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f9601008740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d47c340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f9601008740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d46c850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f9601008740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81b2310 con 0x559e1d470370 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f9601008740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81afb50 con 0x559e1d466b40 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f9601008740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ad9a0 con 0x559e1d4655d0 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d46c850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d46c850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:60912/0 (socket says 172.21.15.70:60912) 2024-09-19T04:33:53.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f95f7fff640 1 -- 172.21.15.70:0/2090992350 learned_addr learned my addr 172.21.15.70:0/2090992350 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f95f7fff640 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 0x559e1d461e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.213+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d47c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95f7fff640 1 -- 172.21.15.70:0/2090992350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 msgr2=0x559e1d461e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95f7fff640 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 0x559e1d461e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95f7fff640 1 -- 172.21.15.70:0/2090992350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 msgr2=0x559e1d47c340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95f7fff640 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d47c340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95f7fff640 1 -- 172.21.15.70:0/2090992350 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559e1d46bf40 con 0x559e1d470370 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95f7fff640 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d46c850 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f95e4000c00 tx=0x7f95e403f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a04a7afc7279328 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95e27fc640 1 -- 172.21.15.70:0/2090992350 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4043020 con 0x559e1d470370 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95e27fc640 1 -- 172.21.15.70:0/2090992350 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95e4058040 con 0x559e1d470370 2024-09-19T04:33:53.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.214+0000 7f95e27fc640 1 -- 172.21.15.70:0/2090992350 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95e4057070 con 0x559e1d470370 2024-09-19T04:33:53.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 -- 172.21.15.70:0/2090992350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 msgr2=0x559e1d46c850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d46c850 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f95e4000c00 tx=0x7f95e403f040 comp rx=0 tx=0).stop 2024-09-19T04:33:53.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 -- 172.21.15.70:0/2090992350 shutdown_connections 2024-09-19T04:33:53.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d46c850 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d47c340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 --2- 172.21.15.70:0/2090992350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 0x559e1d461e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 -- 172.21.15.70:0/2090992350 >> 172.21.15.70:0/2090992350 conn(0x559e1d42e310 msgr2=0x559e1d461700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:53.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 -- 172.21.15.70:0/2090992350 shutdown_connections 2024-09-19T04:33:53.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 -- 172.21.15.70:0/2090992350 wait complete. 2024-09-19T04:33:53.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 -- start start 2024-09-19T04:33:53.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.215+0000 7f9601008740 1 Processor -- start 2024-09-19T04:33:53.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f9601008740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 0x559e1d478690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f9601008740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d478bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f9601008740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d4697c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f9601008740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ae010 con 0x559e1d470370 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f9601008740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81af480 con 0x559e1d466b40 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f9601008740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f95f81ae6e0 con 0x559e1d4655d0 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f9601008740 10 client.0 _ll_register_callbacks cb 0x7f95e4009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 0x559e1d478690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d4697c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95fc9cb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d478bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95f7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d4697c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37344/0 (socket says 172.21.15.70:37344) 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95f7fff640 1 -- 172.21.15.70:0/4284272525 learned_addr learned my addr 172.21.15.70:0/4284272525 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95fc9cb640 1 -- 172.21.15.70:0/4284272525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 msgr2=0x559e1d478690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:53.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 0x559e1d478690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95fc9cb640 1 -- 172.21.15.70:0/4284272525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 msgr2=0x559e1d4697c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d4697c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95fc9cb640 1 -- 172.21.15.70:0/4284272525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559e1d469e50 con 0x559e1d466b40 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.216+0000 7f95f7fff640 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d4697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f95fc9cb640 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d478bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f95ec01b040 tx=0x7f95ec005040 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3d4e0820a6bb129 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f95d7fff640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f95d7fff640 1 -- 172.21.15.70:0/4284272525 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95ec01d040 con 0x559e1d466b40 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 1 -- 172.21.15.70:0/4284272525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f95e4058040 con 0x559e1d466b40 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f95d7fff640 1 -- 172.21.15.70:0/4284272525 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f95ec0055c0 con 0x559e1d466b40 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f95d7fff640 1 -- 172.21.15.70:0/4284272525 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f95ec004660 con 0x559e1d466b40 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 10 client.25187 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:53.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 1 -- 172.21.15.70:0/4284272525 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x559e1d4ea950 con 0x559e1d466b40 2024-09-19T04:33:53.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f95d7fff640 1 -- 172.21.15.70:0/4284272525 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f95e4058040 con 0x559e1d466b40 2024-09-19T04:33:53.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f95d7fff640 1 -- 172.21.15.70:0/4284272525 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f95ec036030 con 0x559e1d466b40 2024-09-19T04:33:53.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 10 client.25187 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:53.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 10 client.25187 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:33:53.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 20 client.25187 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559e1d4eae90 0x559e1d4ed2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 4 client.25187 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.217+0000 7f9601008740 1 -- 172.21.15.70:0/4284272525 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559e1d3d2d70 con 0x559e1d4eae90 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.218+0000 7f95f7fff640 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559e1d4eae90 0x559e1d4ed2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.218+0000 7f95f7fff640 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559e1d4eae90 0x559e1d4ed2b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cdf5c4304c74339 server_cookie=f4806ff8e67095e9 in_seq=0 out_seq=0 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.218+0000 7f95d7fff640 10 client.25187 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.218+0000 7f95d7fff640 1 -- 172.21.15.70:0/4284272525 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559e1d3d2d70 con 0x559e1d4eae90 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.218+0000 7f95d7fff640 10 client.25187 handle_command_reply: tid=0 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.218+0000 7f9601008740 1 client.25187 shutdown 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 -- 172.21.15.70:0/4284272525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 msgr2=0x559e1d478bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d478bd0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f95ec01b040 tx=0x7f95ec005040 comp rx=0 tx=0).stop 2024-09-19T04:33:53.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 -- 172.21.15.70:0/4284272525 shutdown_connections 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559e1d4eae90 0x559e1d4ed2b0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559e1d470370 0x559e1d4697c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559e1d466b40 0x559e1d478bd0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95d7fff640 0 client.25187 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 --2- 172.21.15.70:0/4284272525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559e1d4655d0 0x559e1d478690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 -- 172.21.15.70:0/4284272525 >> 172.21.15.70:0/4284272525 conn(0x559e1d42e310 msgr2=0x559e1d461700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 -- 172.21.15.70:0/4284272525 shutdown_connections 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 1 -- 172.21.15.70:0/4284272525 wait complete. 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f9601008740 20 client.25187 trim_cache size 0 max 16384 2024-09-19T04:33:53.228 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:33:53.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 -- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95e80a33b0 msgr2=0x7f95e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95e80a33b0 0x7f95e80a5870 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f95f0098720 tx=0x7f95f001d000 comp rx=0 tx=0).stop 2024-09-19T04:33:53.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 -- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f8106f20 msgr2=0x7f95f8074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:53.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f8106f20 0x7f95f8074f70 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f95f000e940 tx=0x7f95f000ee00 comp rx=0 tx=0).stop 2024-09-19T04:33:53.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 -- 172.21.15.70:0/2414811172 shutdown_connections 2024-09-19T04:33:53.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f95e80a33b0 0x7f95e80a5870 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f95f8106f20 0x7f95f8074f70 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f81027a0 0x7f95f8074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.219+0000 7f95fec2f640 1 --2- 172.21.15.70:0/2414811172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f95f8101df0 0x7f95f80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:53.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.220+0000 7f95fec2f640 1 -- 172.21.15.70:0/2414811172 >> 172.21.15.70:0/2414811172 conn(0x7f95f80fd8f0 msgr2=0x7f95f80fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:53.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.220+0000 7f95fec2f640 1 -- 172.21.15.70:0/2414811172 shutdown_connections 2024-09-19T04:33:53.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:53.220+0000 7f95fec2f640 1 -- 172.21.15.70:0/2414811172 wait complete. 2024-09-19T04:33:53.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:53 smithi070 ceph-mon[30942]: pgmap v96: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 529 op/s 2024-09-19T04:33:53.934 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:33:53.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:53 smithi167 ceph-mon[34339]: pgmap v96: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 529 op/s 2024-09-19T04:33:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:53 smithi134 ceph-mon[34525]: pgmap v96: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.4 MiB/s wr, 529 op/s 2024-09-19T04:33:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:54.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/24464808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d84102d30 msgr2=0x7f8d84103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/24464808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d84102d30 0x7f8d84103110 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f8d74009930 tx=0x7f8d7402a420 comp rx=0 tx=0).stop 2024-09-19T04:33:54.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/24464808 shutdown_connections 2024-09-19T04:33:54.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/24464808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d841082a0 0x7f8d8410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/24464808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d841036e0 0x7f8d84107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/24464808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d84102d30 0x7f8d84103110 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/24464808 >> 172.21.15.70:0/24464808 conn(0x7f8d840fc7d0 msgr2=0x7f8d840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/24464808 shutdown_connections 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.746+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/24464808 wait complete. 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d8a4bf640 1 Processor -- start 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d8a4bf640 1 -- start start 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d8a4bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d84102d30 0x7f8d841a0420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d8a4bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d841036e0 0x7f8d841a0960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d8a4bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841082a0 0x7f8d8419a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d8a4bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84112090 con 0x7f8d841082a0 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d8a4bf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84111f10 con 0x7f8d841036e0 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d8a4bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d84112210 con 0x7f8d84102d30 2024-09-19T04:33:54.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d88a5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841082a0 0x7f8d8419a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d88a5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841082a0 0x7f8d8419a5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37366/0 (socket says 172.21.15.70:37366) 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d88a5c640 1 -- 172.21.15.70:0/2857939381 learned_addr learned my addr 172.21.15.70:0/2857939381 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d83fff640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d84102d30 0x7f8d841a0420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.747+0000 7f8d837fe640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d841036e0 0x7f8d841a0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d88a5c640 1 -- 172.21.15.70:0/2857939381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d84102d30 msgr2=0x7f8d841a0420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d84102d30 0x7f8d841a0420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d88a5c640 1 -- 172.21.15.70:0/2857939381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d841036e0 msgr2=0x7f8d841a0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d841036e0 0x7f8d841a0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d88a5c640 1 -- 172.21.15.70:0/2857939381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d8419ad10 con 0x7f8d841082a0 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841082a0 0x7f8d8419a5e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00eb10 tx=0x7f8d7c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d817fa640 1 -- 172.21.15.70:0/2857939381 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c004b20 con 0x7f8d841082a0 2024-09-19T04:33:54.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d817fa640 1 -- 172.21.15.70:0/2857939381 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8d7c004cc0 con 0x7f8d841082a0 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/2857939381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d8419b000 con 0x7f8d841082a0 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d817fa640 1 -- 172.21.15.70:0/2857939381 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c010700 con 0x7f8d841082a0 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.748+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/2857939381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d841a72f0 con 0x7f8d841082a0 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d817fa640 1 -- 172.21.15.70:0/2857939381 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8d7c004e70 con 0x7f8d841082a0 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d8c898740 1 Processor -- start 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d8c898740 1 -- start start 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x557419292090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574192925d0 0x557419292a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55741929d370 0x55741929f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d8c898740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574191f82f0 con 0x5574192925d0 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d8c898740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55741919fcf0 con 0x557419293b40 2024-09-19T04:33:54.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d8c898740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5574191f42b0 con 0x55741929d370 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574192925d0 0x557419292a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574192925d0 0x557419292a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37376/0 (socket says 172.21.15.70:37376) 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d837fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x557419292090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.751+0000 7f8d83fff640 1 -- 172.21.15.70:0/1961485717 learned_addr learned my addr 172.21.15.70:0/1961485717 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d83fff640 1 -- 172.21.15.70:0/1961485717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55741929d370 msgr2=0x55741929f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d83fff640 1 --2- 172.21.15.70:0/1961485717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55741929d370 0x55741929f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d83fff640 1 -- 172.21.15.70:0/1961485717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 msgr2=0x557419292090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d83fff640 1 --2- 172.21.15.70:0/1961485717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x557419292090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d83fff640 1 -- 172.21.15.70:0/1961485717 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5574191843a0 con 0x5574192925d0 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d837fe640 1 --2- 172.21.15.70:0/1961485717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x557419292090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d817fa640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d6c0a33b0 0x7f8d6c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d83fff640 1 --2- 172.21.15.70:0/1961485717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574192925d0 0x557419292a10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8d74000c00 tx=0x7f8d74005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bdde064b7f80170 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d837fe640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d6c0a33b0 0x7f8d6c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d817fa640 1 -- 172.21.15.70:0/2857939381 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8d7c0d01d0 con 0x7f8d841082a0 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d6a7fc640 1 -- 172.21.15.70:0/1961485717 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74040070 con 0x5574192925d0 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d6a7fc640 1 -- 172.21.15.70:0/1961485717 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8d74004030 con 0x5574192925d0 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.752+0000 7f8d6a7fc640 1 -- 172.21.15.70:0/1961485717 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74035040 con 0x5574192925d0 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d837fe640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d6c0a33b0 0x7f8d6c0a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d780058c0 tx=0x7f8d78005850 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 -- 172.21.15.70:0/1961485717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574192925d0 msgr2=0x557419292a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1961485717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574192925d0 0x557419292a10 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f8d74000c00 tx=0x7f8d74005dd0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 -- 172.21.15.70:0/1961485717 shutdown_connections 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1961485717 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55741929d370 0x55741929f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1961485717 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5574192925d0 0x557419292a10 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1961485717 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x557419292090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 -- 172.21.15.70:0/1961485717 >> 172.21.15.70:0/1961485717 conn(0x55741925b310 msgr2=0x55741928ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 -- 172.21.15.70:0/1961485717 shutdown_connections 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.753+0000 7f8d8c898740 1 -- 172.21.15.70:0/1961485717 wait complete. 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 1 -- start start 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 1 Processor -- start 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x55741929cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x55741929a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741929a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5574192a0010 con 0x55741929d370 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5574191b3060 con 0x557419293b40 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5574192a0190 con 0x5574192925d0 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d8c898740 10 client.0 _ll_register_callbacks cb 0x557418f068c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:54.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d88a5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741929a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x55741929cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x55741929cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:46912/0 (socket says 172.21.15.70:46912) 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d88a5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741929a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37386/0 (socket says 172.21.15.70:37386) 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d83fff640 1 -- 172.21.15.70:0/1949753656 learned_addr learned my addr 172.21.15.70:0/1949753656 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.754+0000 7f8d837fe640 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x55741929a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d83fff640 1 -- 172.21.15.70:0/1949753656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 msgr2=0x55741929a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d83fff640 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x55741929a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d83fff640 1 -- 172.21.15.70:0/1949753656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 msgr2=0x55741929a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d83fff640 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741929a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d83fff640 1 -- 172.21.15.70:0/1949753656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557418f693c0 con 0x5574192925d0 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741929a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:54.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d83fff640 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x55741929cd70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d7402a940 tx=0x7f8d74009640 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d477564cfbabc3af server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d637fe640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d637fe640 1 -- 172.21.15.70:0/1949753656 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d74040070 con 0x5574192925d0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d8c898740 1 -- 172.21.15.70:0/1949753656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8d74004030 con 0x5574192925d0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d637fe640 1 -- 172.21.15.70:0/1949753656 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8d74005480 con 0x5574192925d0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d637fe640 1 -- 172.21.15.70:0/1949753656 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8d74056050 con 0x5574192925d0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d8c898740 10 client.25249 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d8c898740 1 -- 172.21.15.70:0/1949753656 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x5574192a0010 con 0x5574192925d0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.755+0000 7f8d637fe640 1 -- 172.21.15.70:0/1949753656 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8d74004030 con 0x5574192925d0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d637fe640 1 -- 172.21.15.70:0/1949753656 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8d740035f0 con 0x5574192925d0 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d8c898740 10 client.25249 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d8c898740 10 client.25249 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:54.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d8c898740 20 client.25249 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5574192acc60 0x5574192af050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d8c898740 4 client.25249 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d8c898740 1 -- 172.21.15.70:0/1949753656 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557419205860 con 0x5574192acc60 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d837fe640 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5574192acc60 0x5574192af050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d637fe640 10 client.25249 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.756+0000 7f8d837fe640 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5574192acc60 0x5574192af050 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2b35ce6b062f1b8d server_cookie=1d125306c7c8f47f in_seq=0 out_seq=0 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d637fe640 1 -- 172.21.15.70:0/1949753656 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x557419205860 con 0x5574192acc60 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d637fe640 10 client.25249 handle_command_reply: tid=0 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 client.25249 shutdown 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 -- 172.21.15.70:0/1949753656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 msgr2=0x55741929cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x55741929cd70 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8d7402a940 tx=0x7f8d74009640 comp rx=0 tx=0).stop 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 -- 172.21.15.70:0/1949753656 shutdown_connections 2024-09-19T04:33:54.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5574192acc60 0x5574192af050 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741929a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x55741929a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1949753656 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x55741929cd70 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d637fe640 0 client.25249 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 -- 172.21.15.70:0/1949753656 >> 172.21.15.70:0/1949753656 conn(0x55741925b310 msgr2=0x557419294930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 -- 172.21.15.70:0/1949753656 shutdown_connections 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.757+0000 7f8d8c898740 1 -- 172.21.15.70:0/1949753656 wait complete. 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.758+0000 7f8d8c898740 20 client.25249 trim_cache size 0 max 16384 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.770+0000 7f8d8c898740 1 Processor -- start 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.770+0000 7f8d8c898740 1 -- start start 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.770+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x557419293410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.770+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a92e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.770+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741928e700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.770+0000 7f8d8c898740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841b23f0 con 0x55741929d370 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.770+0000 7f8d8c898740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841afc30 con 0x557419293b40 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.770+0000 7f8d8c898740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ada80 con 0x5574192925d0 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741928e700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741928e700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37388/0 (socket says 172.21.15.70:37388) 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 -- 172.21.15.70:0/4148108053 learned_addr learned my addr 172.21.15.70:0/4148108053 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x557419293410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d837fe640 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a92e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 -- 172.21.15.70:0/4148108053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 msgr2=0x557419293410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x557419293410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 -- 172.21.15.70:0/4148108053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 msgr2=0x5574192a92e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a92e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 -- 172.21.15.70:0/4148108053 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55741928f960 con 0x55741929d370 2024-09-19T04:33:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d837fe640 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:33:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d83fff640 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x557419293410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:54.792 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:33:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741928e700 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c004af0 tx=0x7f8d7c098870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97107e0f9b48c57a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d69ffb640 1 -- 172.21.15.70:0/4148108053 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0b4070 con 0x55741929d370 2024-09-19T04:33:54.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d69ffb640 1 -- 172.21.15.70:0/4148108053 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8d7c005580 con 0x55741929d370 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.771+0000 7f8d69ffb640 1 -- 172.21.15.70:0/4148108053 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0b5260 con 0x55741929d370 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 -- 172.21.15.70:0/4148108053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 msgr2=0x55741928e700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741928e700 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c004af0 tx=0x7f8d7c098870 comp rx=0 tx=0).stop 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 -- 172.21.15.70:0/4148108053 shutdown_connections 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741928e700 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a92e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 --2- 172.21.15.70:0/4148108053 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x557419293410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 -- 172.21.15.70:0/4148108053 >> 172.21.15.70:0/4148108053 conn(0x55741925b310 msgr2=0x5574192952f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 -- 172.21.15.70:0/4148108053 shutdown_connections 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 -- 172.21.15.70:0/4148108053 wait complete. 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 -- start start 2024-09-19T04:33:54.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.772+0000 7f8d8c898740 1 Processor -- start 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x5574192a0b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a10d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d8c898740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741930f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d8c898740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ae0f0 con 0x55741929d370 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d8c898740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841af560 con 0x557419293b40 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d8c898740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8d841ae7c0 con 0x5574192925d0 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d8c898740 10 client.0 _ll_register_callbacks cb 0x7f8d74009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741930f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741930f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37400/0 (socket says 172.21.15.70:37400) 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d83fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x5574192a0b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 -- 172.21.15.70:0/1331570863 learned_addr learned my addr 172.21.15.70:0/1331570863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d837fe640 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 -- 172.21.15.70:0/1331570863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 msgr2=0x5574192a0b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:54.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x5574192a0b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 -- 172.21.15.70:0/1331570863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 msgr2=0x5574192a10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 -- 172.21.15.70:0/1331570863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55741930fed0 con 0x55741929d370 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d88a5c640 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741930f830 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0988e0 tx=0x7f8d7c00c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65825db70da8c1c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d637fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d637fe640 1 -- 172.21.15.70:0/1331570863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d7c0b4070 con 0x55741929d370 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d637fe640 1 -- 172.21.15.70:0/1331570863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f8d7c09c930 con 0x55741929d370 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.773+0000 7f8d8c898740 1 -- 172.21.15.70:0/1331570863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5574191ffd70 con 0x55741929d370 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d637fe640 1 -- 172.21.15.70:0/1331570863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f8d7c09cbd0 con 0x55741929d370 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d8c898740 10 client.15768 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d8c898740 1 -- 172.21.15.70:0/1331570863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557419317260 con 0x55741929d370 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d637fe640 1 -- 172.21.15.70:0/1331570863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x5574191ffd70 con 0x55741929d370 2024-09-19T04:33:54.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d637fe640 1 -- 172.21.15.70:0/1331570863 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f8d7c098420 con 0x55741929d370 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d8c898740 10 client.15768 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d8c898740 10 client.15768 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d8c898740 20 client.15768 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x557419317970 0x557419319d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d8c898740 4 client.15768 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d8c898740 1 -- 172.21.15.70:0/1331570863 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55741917c170 con 0x557419317970 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.774+0000 7f8d83fff640 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x557419317970 0x557419319d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d83fff640 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x557419317970 0x557419319d90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=503e7c74abc0f015 server_cookie=f4a5610e587c46c6 in_seq=0 out_seq=0 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d637fe640 10 client.15768 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d637fe640 1 -- 172.21.15.70:0/1331570863 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55741917c170 con 0x557419317970 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d637fe640 10 client.15768 handle_command_reply: tid=0 2024-09-19T04:33:54.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 client.15768 shutdown 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 -- 172.21.15.70:0/1331570863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 msgr2=0x55741930f830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741930f830 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c0988e0 tx=0x7f8d7c00c950 comp rx=0 tx=0).stop 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 -- 172.21.15.70:0/1331570863 shutdown_connections 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x557419317970 0x557419319d90 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55741929d370 0x55741930f830 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x557419293b40 0x5574192a10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 --2- 172.21.15.70:0/1331570863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5574192925d0 0x5574192a0b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d637fe640 0 client.15768 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 -- 172.21.15.70:0/1331570863 >> 172.21.15.70:0/1331570863 conn(0x55741925b310 msgr2=0x5574192984f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 -- 172.21.15.70:0/1331570863 shutdown_connections 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 1 -- 172.21.15.70:0/1331570863 wait complete. 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.775+0000 7f8d8c898740 20 client.15768 trim_cache size 0 max 16384 2024-09-19T04:33:54.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d6c0a33b0 msgr2=0x7f8d6c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d6c0a33b0 0x7f8d6c0a5870 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8d780058c0 tx=0x7f8d78005850 comp rx=0 tx=0).stop 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841082a0 msgr2=0x7f8d8419a5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841082a0 0x7f8d8419a5e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7f8d7c00eb10 tx=0x7f8d7c00c2d0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/2857939381 shutdown_connections 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8d6c0a33b0 0x7f8d6c0a5870 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8d841082a0 0x7f8d8419a5e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8d841036e0 0x7f8d841a0960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 --2- 172.21.15.70:0/2857939381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8d84102d30 0x7f8d841a0420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/2857939381 >> 172.21.15.70:0/2857939381 conn(0x7f8d840fc7d0 msgr2=0x7f8d84100d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/2857939381 shutdown_connections 2024-09-19T04:33:54.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:54.776+0000 7f8d8a4bf640 1 -- 172.21.15.70:0/2857939381 wait complete. 2024-09-19T04:33:54.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:54 smithi167 ceph-mon[34339]: pgmap v97: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 347 op/s 2024-09-19T04:33:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:54 smithi134 ceph-mon[34525]: pgmap v97: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 347 op/s 2024-09-19T04:33:55.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:54 smithi070 ceph-mon[30942]: pgmap v97: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 347 op/s 2024-09-19T04:33:57.039 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:33:57.040 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:33:57.331 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:33:57.749 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:57 smithi070 ceph-mon[30942]: pgmap v98: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 347 op/s 2024-09-19T04:33:57.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:57 smithi167 ceph-mon[34339]: pgmap v98: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 347 op/s 2024-09-19T04:33:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:57 smithi134 ceph-mon[34525]: pgmap v98: 97 pgs: 97 active+clean; 212 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 1.8 MiB/s wr, 347 op/s 2024-09-19T04:33:58.117 INFO:tasks.workunit.client.0.smithi070.stderr:+ sync 2024-09-19T04:33:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 -- 172.21.15.70:0/3188306999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 msgr2=0x7f2bdc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/3188306999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 0x7f2bdc103110 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc009930 tx=0x7f2bcc02a420 comp rx=0 tx=0).stop 2024-09-19T04:33:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 -- 172.21.15.70:0/3188306999 shutdown_connections 2024-09-19T04:33:58.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/3188306999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bdc1082a0 0x7f2bdc10ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/3188306999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bdc1036e0 0x7f2bdc107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/3188306999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 0x7f2bdc103110 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 -- 172.21.15.70:0/3188306999 >> 172.21.15.70:0/3188306999 conn(0x7f2bdc0fc7d0 msgr2=0x7f2bdc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 -- 172.21.15.70:0/3188306999 shutdown_connections 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.831+0000 7f2be1cf5640 1 -- 172.21.15.70:0/3188306999 wait complete. 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.832+0000 7f2be1cf5640 1 Processor -- start 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.832+0000 7f2be1cf5640 1 -- start start 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.832+0000 7f2be1cf5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 0x7f2bdc1985d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.832+0000 7f2be1cf5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bdc1036e0 0x7f2bdc198b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.832+0000 7f2be1cf5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bdc1082a0 0x7f2bdc19cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.832+0000 7f2be1cf5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc112090 con 0x7f2bdc102d30 2024-09-19T04:33:58.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.832+0000 7f2be1cf5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc111f10 con 0x7f2bdc1082a0 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.832+0000 7f2be1cf5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc112210 con 0x7f2bdc1036e0 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 0x7f2bdc1985d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 0x7f2bdc1985d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37422/0 (socket says 172.21.15.70:37422) 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/1508483899 learned_addr learned my addr 172.21.15.70:0/1508483899 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bdc1036e0 0x7f2bdc198b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bdc1082a0 0x7f2bdc19cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/1508483899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bdc1036e0 msgr2=0x7f2bdc198b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bdc1036e0 0x7f2bdc198b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/1508483899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bdc1082a0 msgr2=0x7f2bdc19cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bdc1082a0 0x7f2bdc19cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/1508483899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2bdc19d580 con 0x7f2bdc102d30 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bdc1036e0 0x7f2bdc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 0x7f2bdc1985d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0314b0 tx=0x7f2bcc0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bd8ff9640 1 -- 172.21.15.70:0/1508483899 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc03f030 con 0x7f2bdc102d30 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2be1cf5640 1 -- 172.21.15.70:0/1508483899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2bdc19d810 con 0x7f2bdc102d30 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bd8ff9640 1 -- 172.21.15.70:0/1508483899 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2bcc0044c0 con 0x7f2bdc102d30 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2bd8ff9640 1 -- 172.21.15.70:0/1508483899 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc035070 con 0x7f2bdc102d30 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.833+0000 7f2be1cf5640 1 -- 172.21.15.70:0/1508483899 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2bdc1a5150 con 0x7f2bdc102d30 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2bd8ff9640 1 -- 172.21.15.70:0/1508483899 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2bcc042030 con 0x7f2bdc102d30 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2be40ce740 1 Processor -- start 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2be40ce740 1 -- start start 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 0x55a145391f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145392480 0x55a14539c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a14539cd40 0x55a14539f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2be40ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a1452f7280 con 0x55a145392480 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2be40ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a14529eb10 con 0x55a145391b60 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2be40ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a1452f3240 con 0x55a14539cd40 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2bdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145392480 0x55a14539c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2bdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145392480 0x55a14539c800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37436/0 (socket says 172.21.15.70:37436) 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/3592018998 learned_addr learned my addr 172.21.15.70:0/3592018998 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2bd8ff9640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2bc40a33b0 0x7f2bc40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.836+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a14539cd40 0x55a14539f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 0x55a145391f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2bc40a33b0 0x7f2bc40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bd8ff9640 1 -- 172.21.15.70:0/1508483899 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2bcc0f0110 con 0x7f2bdc102d30 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdaffd640 1 -- 172.21.15.70:0/3592018998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 msgr2=0x55a145391f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 0x55a145391f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdaffd640 1 -- 172.21.15.70:0/3592018998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145392480 msgr2=0x55a14539c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145392480 0x55a14539c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdaffd640 1 -- 172.21.15.70:0/3592018998 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a1452ab1f0 con 0x55a14539cd40 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a14539cd40 0x55a14539f130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0005d00 tx=0x7f2bd000bf90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ee902f6e3df6c6a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2bc40a33b0 0x7f2bc40a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4005fd0 tx=0x7f2bd4009500 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bc1ffb640 1 -- 172.21.15.70:0/3592018998 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd0011700 con 0x55a14539cd40 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bc1ffb640 1 -- 172.21.15.70:0/3592018998 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2bd0011d70 con 0x55a14539cd40 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.837+0000 7f2bc1ffb640 1 -- 172.21.15.70:0/3592018998 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd001a380 con 0x55a14539cd40 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 -- 172.21.15.70:0/3592018998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a14539cd40 msgr2=0x55a14539f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a14539cd40 0x55a14539f130 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f2bd0005d00 tx=0x7f2bd000bf90 comp rx=0 tx=0).stop 2024-09-19T04:33:58.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 -- 172.21.15.70:0/3592018998 shutdown_connections 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a14539cd40 0x55a14539f130 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145392480 0x55a14539c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3592018998 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 0x55a145391f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 -- 172.21.15.70:0/3592018998 >> 172.21.15.70:0/3592018998 conn(0x55a14538e0f0 msgr2=0x55a14538e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 -- 172.21.15.70:0/3592018998 shutdown_connections 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 -- 172.21.15.70:0/3592018998 wait complete. 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.838+0000 7f2be40ce740 1 -- start start 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2be40ce740 1 Processor -- start 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 0x55a145399bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a14539a100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a14539a640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2be40ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a14539f910 con 0x55a14539cd40 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2be40ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a1452b1f10 con 0x55a145391b60 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2be40ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a14539fa90 con 0x55a145392480 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2be40ce740 10 client.0 _ll_register_callbacks cb 0x55a14527aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a14539a640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a14539a640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37450/0 (socket says 172.21.15.70:37450) 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdaffd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a14539a100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 -- 172.21.15.70:0/627170729 learned_addr learned my addr 172.21.15.70:0/627170729 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 0x55a145399bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 -- 172.21.15.70:0/627170729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 msgr2=0x55a14539a100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a14539a100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 -- 172.21.15.70:0/627170729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 msgr2=0x55a145399bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:58.221 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 0x55a145399bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 -- 172.21.15.70:0/627170729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1450686a0 con 0x55a14539cd40 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a14539a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a14539a640 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4020b80 tx=0x7f2bd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2e4a517f697f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.839+0000 7f2bbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2bbaffd640 1 -- 172.21.15.70:0/627170729 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd4010c00 con 0x55a14539cd40 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2bbaffd640 1 -- 172.21.15.70:0/627170729 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2bd4010da0 con 0x55a14539cd40 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 1 -- 172.21.15.70:0/627170729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2bd0011d70 con 0x55a14539cd40 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2bbaffd640 1 -- 172.21.15.70:0/627170729 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2bd4029440 con 0x55a14539cd40 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 10 client.15780 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 1 -- 172.21.15.70:0/627170729 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a1453ab520 con 0x55a14539cd40 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2bbaffd640 1 -- 172.21.15.70:0/627170729 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2bd0011d70 con 0x55a14539cd40 2024-09-19T04:33:58.222 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2bbaffd640 1 -- 172.21.15.70:0/627170729 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2bd4030070 con 0x55a14539cd40 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 10 client.15780 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 10 client.15780 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 20 client.15780 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a1453aca80 0x55a1453aeef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 4 client.15780 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2be40ce740 1 -- 172.21.15.70:0/627170729 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a1453047f0 con 0x55a1453aca80 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.840+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a1453aca80 0x55a1453aeef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.841+0000 7f2bbaffd640 10 client.15780 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.841+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a1453aca80 0x55a1453aeef0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f57f805a358d379e server_cookie=5b8fd18f8fd0667f in_seq=0 out_seq=0 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.841+0000 7f2bbaffd640 1 -- 172.21.15.70:0/627170729 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a1453047f0 con 0x55a1453aca80 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2bbaffd640 10 client.15780 handle_command_reply: tid=0 2024-09-19T04:33:58.223 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 client.15780 shutdown 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 -- 172.21.15.70:0/627170729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 msgr2=0x55a14539a640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a14539a640 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4020b80 tx=0x7f2bd4004a40 comp rx=0 tx=0).stop 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 -- 172.21.15.70:0/627170729 shutdown_connections 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a1453aca80 0x55a1453aeef0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a14539a640 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a14539a100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2bbaffd640 0 client.15780 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 --2- 172.21.15.70:0/627170729 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145391b60 0x55a145399bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 -- 172.21.15.70:0/627170729 >> 172.21.15.70:0/627170729 conn(0x55a14538e0f0 msgr2=0x55a145393e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 -- 172.21.15.70:0/627170729 shutdown_connections 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 1 -- 172.21.15.70:0/627170729 wait complete. 2024-09-19T04:33:58.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.842+0000 7f2be40ce740 20 client.15780 trim_cache size 0 max 16384 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.860+0000 7f2be40ce740 1 Processor -- start 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.860+0000 7f2be40ce740 1 -- start start 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.860+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145391b60 0x55a14538d160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.860+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a1453b47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.860+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a14539cd40 0x55a1453b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.860+0000 7f2be40ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc1b0200 con 0x55a145391b60 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.860+0000 7f2be40ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc1ada40 con 0x55a14539cd40 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.860+0000 7f2be40ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc1ab890 con 0x55a145392480 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145391b60 0x55a14538d160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145391b60 0x55a14538d160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37464/0 (socket says 172.21.15.70:37464) 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/2893592207 learned_addr learned my addr 172.21.15.70:0/2893592207 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a1453b47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a14539cd40 0x55a1453b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/2893592207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 msgr2=0x55a1453b47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a1453b47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/2893592207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a14539cd40 msgr2=0x55a1453b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a14539cd40 0x55a1453b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/2893592207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a14538df20 con 0x55a145391b60 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145391b60 0x55a14538d160 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0bc450 tx=0x7f2bcc0f2040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96ef14a778b01548 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bc17fa640 1 -- 172.21.15.70:0/2893592207 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0b8760 con 0x55a145391b60 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bc17fa640 1 -- 172.21.15.70:0/2893592207 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2bcc03b460 con 0x55a145391b60 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.861+0000 7f2bc17fa640 1 -- 172.21.15.70:0/2893592207 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bcc0b8b30 con 0x55a145391b60 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 -- 172.21.15.70:0/2893592207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145391b60 msgr2=0x55a14538d160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145391b60 0x55a14538d160 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0bc450 tx=0x7f2bcc0f2040 comp rx=0 tx=0).stop 2024-09-19T04:33:58.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 -- 172.21.15.70:0/2893592207 shutdown_connections 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a14539cd40 0x55a1453b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145392480 0x55a1453b47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 --2- 172.21.15.70:0/2893592207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a145391b60 0x55a14538d160 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 -- 172.21.15.70:0/2893592207 >> 172.21.15.70:0/2893592207 conn(0x55a14538e0f0 msgr2=0x55a14538ca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 -- 172.21.15.70:0/2893592207 shutdown_connections 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.862+0000 7f2be40ce740 1 -- 172.21.15.70:0/2893592207 wait complete. 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 1 -- start start 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 1 Processor -- start 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145391b60 0x55a1453a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145392480 0x55a1453a5220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a1453a1cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc1abf00 con 0x55a14539cd40 2024-09-19T04:33:58.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc1ad370 con 0x55a145392480 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2bdc1ac5d0 con 0x55a145391b60 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2be40ce740 10 client.0 _ll_register_callbacks cb 0x7f2bd4011370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2bdb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145391b60 0x55a1453a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2bdb7fe640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145391b60 0x55a1453a4ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:47004/0 (socket says 172.21.15.70:47004) 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145392480 0x55a1453a5220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.863+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a1453a1cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bdb7fe640 1 -- 172.21.15.70:0/3397394360 learned_addr learned my addr 172.21.15.70:0/3397394360 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bdaffd640 1 -- 172.21.15.70:0/3397394360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145391b60 msgr2=0x55a1453a4ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145391b60 0x55a1453a4ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bdaffd640 1 -- 172.21.15.70:0/3397394360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 msgr2=0x55a1453a1cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a1453a1cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bdaffd640 1 -- 172.21.15.70:0/3397394360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a1453a58c0 con 0x55a145392480 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bdbfff640 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a1453a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bdaffd640 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145392480 0x55a1453a5220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2bd001ca20 tx=0x7f2bd001c720 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2b279f4cbff8e12d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bbaffd640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bbaffd640 1 -- 172.21.15.70:0/3397394360 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2bd002d060 con 0x55a145392480 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2be40ce740 1 -- 172.21.15.70:0/3397394360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a1452fed00 con 0x55a145392480 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.864+0000 7f2bbaffd640 1 -- 172.21.15.70:0/3397394360 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2bd0005450 con 0x55a145392480 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2bbaffd640 1 -- 172.21.15.70:0/3397394360 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f2bd0004020 con 0x55a145392480 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2be40ce740 10 client.25223 fetch_fsmap learned FSMap version 27 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2be40ce740 1 -- 172.21.15.70:0/3397394360 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a14541c190 con 0x55a145392480 2024-09-19T04:33:58.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2bbaffd640 1 -- 172.21.15.70:0/3397394360 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55a1452fed00 con 0x55a145392480 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2bbaffd640 1 -- 172.21.15.70:0/3397394360 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f2bd00035f0 con 0x55a145392480 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2be40ce740 10 client.25223 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2be40ce740 10 client.25223 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2be40ce740 20 client.25223 populate_metadata read hostname 'smithi070' 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a14541c730 0x55a14541eb50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2be40ce740 4 client.25223 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2be40ce740 1 -- 172.21.15.70:0/3397394360 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a14527b110 con 0x55a14541c730 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.865+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a14541c730 0x55a14541eb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.866+0000 7f2bbaffd640 10 client.25223 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.866+0000 7f2bdb7fe640 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a14541c730 0x55a14541eb50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe5e3a093ef37a4d server_cookie=a1e826c018f226c4 in_seq=0 out_seq=0 2024-09-19T04:33:58.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.866+0000 7f2bbaffd640 1 -- 172.21.15.70:0/3397394360 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a14527b110 con 0x55a14541c730 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2bbaffd640 10 client.25223 handle_command_reply: tid=0 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 client.25223 shutdown 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 -- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145392480 msgr2=0x55a1453a5220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145392480 0x55a1453a5220 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2bd001ca20 tx=0x7f2bd001c720 comp rx=0 tx=0).stop 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 -- 172.21.15.70:0/3397394360 shutdown_connections 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a14541c730 0x55a14541eb50 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a14539cd40 0x55a1453a1cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a145392480 0x55a1453a5220 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.231 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "a48f8efe-01d1-4c6b-8be7-d8a794e8f985", 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 --2- 172.21.15.70:0/3397394360 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a145391b60 0x55a1453a4ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2bbaffd640 0 client.25223 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 -- 172.21.15.70:0/3397394360 >> 172.21.15.70:0/3397394360 conn(0x55a14538e0f0 msgr2=0x55a14539a3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 -- 172.21.15.70:0/3397394360 shutdown_connections 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 1 -- 172.21.15.70:0/3397394360 wait complete. 2024-09-19T04:33:58.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.867+0000 7f2be40ce740 20 client.25223 trim_cache size 0 max 16384 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 -- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2bc40a33b0 msgr2=0x7f2bc40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2bc40a33b0 0x7f2bc40a5870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f2bd4005fd0 tx=0x7f2bd4009500 comp rx=0 tx=0).stop 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 -- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 msgr2=0x7f2bdc1985d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 0x7f2bdc1985d0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f2bcc0314b0 tx=0x7f2bcc0040c0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 -- 172.21.15.70:0/1508483899 shutdown_connections 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2bc40a33b0 0x7f2bc40a5870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2bdc1082a0 0x7f2bdc19cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2bdc1036e0 0x7f2bdc198b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 --2- 172.21.15.70:0/1508483899 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2bdc102d30 0x7f2bdc1985d0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 -- 172.21.15.70:0/1508483899 >> 172.21.15.70:0/1508483899 conn(0x7f2bdc0fc7d0 msgr2=0x7f2bdc105da0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 -- 172.21.15.70:0/1508483899 shutdown_connections 2024-09-19T04:33:58.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:33:57.868+0000 7f2be1cf5640 1 -- 172.21.15.70:0/1508483899 wait complete. 2024-09-19T04:33:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:58 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:58 smithi070 ceph-mon[30942]: pgmap v99: 97 pgs: 97 active+clean; 228 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 469 op/s 2024-09-19T04:33:58.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:58 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:58.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:58 smithi167 ceph-mon[34339]: pgmap v99: 97 pgs: 97 active+clean; 228 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 469 op/s 2024-09-19T04:33:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:58 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:33:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:58 smithi134 ceph-mon[34525]: pgmap v99: 97 pgs: 97 active+clean; 228 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.2 MiB/s wr, 469 op/s 2024-09-19T04:33:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:33:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.896 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.897 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.898 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.898 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.898 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.898 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:33:59.898 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.898 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:33:59.898 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:33:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:33:59.963 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:33:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:34:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:00.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:34:00.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:33:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:00.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:00 smithi070 ceph-mon[30942]: pgmap v100: 97 pgs: 97 active+clean; 228 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.5 MiB/s wr, 290 op/s 2024-09-19T04:34:00.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:00 smithi167 ceph-mon[34339]: pgmap v100: 97 pgs: 97 active+clean; 228 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.5 MiB/s wr, 290 op/s 2024-09-19T04:34:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:00 smithi134 ceph-mon[34525]: pgmap v100: 97 pgs: 97 active+clean; 228 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1014 KiB/s rd, 2.5 MiB/s wr, 290 op/s 2024-09-19T04:34:01.285 INFO:tasks.workunit.client.0.smithi070.stderr:+ tar c linux-4.0.5 2024-09-19T04:34:01.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:01 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:34:01.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:01 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:34:01.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:01 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:34:01.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:01 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:34:01.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:01 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:34:01.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:01 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:34:01.978 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:34:02.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:01 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:34:02.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:01 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:34:02.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:01 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:34:02.250 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:34:02.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:02 smithi070 ceph-mon[30942]: pgmap v101: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-09-19T04:34:02.676 INFO:tasks.workunit.client.0.smithi070.stdout:Ok 2024-09-19T04:34:02.677 INFO:tasks.workunit.client.0.smithi070.stderr:+ echo Ok 2024-09-19T04:34:02.677 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-09-19T04:34:02.677 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-09-19T04:34:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 -- 172.21.15.70:0/3957431408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0101de0 msgr2=0x7f85f01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3957431408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0101de0 0x7f85f01021c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f85e0009900 tx=0x7f85e002a410 comp rx=0 tx=0).stop 2024-09-19T04:34:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 -- 172.21.15.70:0/3957431408 shutdown_connections 2024-09-19T04:34:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3957431408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0106f10 0x7f85f010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3957431408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85f0102790 0x7f85f01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3957431408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0101de0 0x7f85f01021c0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 -- 172.21.15.70:0/3957431408 >> 172.21.15.70:0/3957431408 conn(0x7f85f00fd8c0 msgr2=0x7f85f00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 -- 172.21.15.70:0/3957431408 shutdown_connections 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 -- 172.21.15.70:0/3957431408 wait complete. 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 Processor -- start 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.743+0000 7f85f57f1640 1 -- start start 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85f57f1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85f0101de0 0x7f85f019a610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85f57f1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0102790 0x7f85f019ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85f57f1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0106f10 0x7f85f019eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85f57f1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85f0111f40 con 0x7f85f0102790 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85f57f1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85f0111dc0 con 0x7f85f0101de0 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85f57f1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01120c0 con 0x7f85f0106f10 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0102790 0x7f85f019ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0102790 0x7f85f019ab50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37486/0 (socket says 172.21.15.70:37486) 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 -- 172.21.15.70:0/3457185501 learned_addr learned my addr 172.21.15.70:0/3457185501 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ef7fe640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0106f10 0x7f85f019eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85eeffd640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85f0101de0 0x7f85f019a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 -- 172.21.15.70:0/3457185501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0106f10 msgr2=0x7f85f019eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0106f10 0x7f85f019eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 -- 172.21.15.70:0/3457185501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85f0101de0 msgr2=0x7f85f019a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85f0101de0 0x7f85f019a610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 -- 172.21.15.70:0/3457185501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85f019f5c0 con 0x7f85f0102790 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.744+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0102790 0x7f85f019ab50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f85e400e9f0 tx=0x7f85e400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.745+0000 7f85d7fff640 1 -- 172.21.15.70:0/3457185501 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e400cd80 con 0x7f85f0102790 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.745+0000 7f85f57f1640 1 -- 172.21.15.70:0/3457185501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85f019f8b0 con 0x7f85f0102790 2024-09-19T04:34:02.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.745+0000 7f85d7fff640 1 -- 172.21.15.70:0/3457185501 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f85e4010900 con 0x7f85f0102790 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.745+0000 7f85d7fff640 1 -- 172.21.15.70:0/3457185501 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e40189e0 con 0x7f85f0102790 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.745+0000 7f85f57f1640 1 -- 172.21.15.70:0/3457185501 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85f01a7190 con 0x7f85f0102790 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.747+0000 7f85d7fff640 1 -- 172.21.15.70:0/3457185501 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f85e4010ab0 con 0x7f85f0102790 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.747+0000 7f85f7bca740 1 Processor -- start 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.747+0000 7f85f7bca740 1 -- start start 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b54a0 0x55d0f80b5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80c0140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80c0680 0x55d0f80c2a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85f7bca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d0f801b2e0 con 0x55d0f80c0680 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85f7bca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7fc2ce0 con 0x55d0f80b54a0 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85f7bca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d0f80172a0 con 0x55d0f80b5dc0 2024-09-19T04:34:02.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80c0680 0x55d0f80c2a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ef7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b54a0 0x55d0f80b5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85d7fff640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f85d80a33b0 0x7f85d80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ef7fe640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b54a0 0x55d0f80b5880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:56492/0 (socket says 172.21.15.70:56492) 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ef7fe640 1 -- 172.21.15.70:0/2560643319 learned_addr learned my addr 172.21.15.70:0/2560643319 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85eeffd640 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80c0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ef7fe640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f85d80a33b0 0x7f85d80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85d7fff640 1 -- 172.21.15.70:0/3457185501 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f85e40d0100 con 0x7f85f0102790 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ee7fc640 1 -- 172.21.15.70:0/2560643319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 msgr2=0x55d0f80c0140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80c0140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ee7fc640 1 -- 172.21.15.70:0/2560643319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b54a0 msgr2=0x55d0f80b5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b54a0 0x55d0f80b5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85ee7fc640 1 -- 172.21.15.70:0/2560643319 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f7fa7440 con 0x55d0f80c0680 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.748+0000 7f85eeffd640 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.749+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80c0680 0x55d0f80c2a70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f85e40cd870 tx=0x7f85e400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca85589446e2b701 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.749+0000 7f85ef7fe640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f85d80a33b0 0x7f85d80a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85e8013d40 tx=0x7f85e8004ab0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.749+0000 7f85d57fa640 1 -- 172.21.15.70:0/2560643319 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e409cb00 con 0x55d0f80c0680 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.749+0000 7f85d57fa640 1 -- 172.21.15.70:0/2560643319 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f85e409c400 con 0x55d0f80c0680 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.749+0000 7f85d57fa640 1 -- 172.21.15.70:0/2560643319 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e40d2110 con 0x55d0f80c0680 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- 172.21.15.70:0/2560643319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80c0680 msgr2=0x55d0f80c2a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80c0680 0x55d0f80c2a70 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f85e40cd870 tx=0x7f85e400cf20 comp rx=0 tx=0).stop 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- 172.21.15.70:0/2560643319 shutdown_connections 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80c0680 0x55d0f80c2a70 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80c0140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 --2- 172.21.15.70:0/2560643319 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b54a0 0x55d0f80b5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- 172.21.15.70:0/2560643319 >> 172.21.15.70:0/2560643319 conn(0x55d0f80b1a30 msgr2=0x55d0f80b1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- 172.21.15.70:0/2560643319 shutdown_connections 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- 172.21.15.70:0/2560643319 wait complete. 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- start start 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 Processor -- start 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80bffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80bd260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80c0680 0x55d0f80bd7a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d0f80c3250 con 0x55d0f80b54a0 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d0f7fd6050 con 0x55d0f80b5dc0 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d0f80c33d0 con 0x55d0f80c0680 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85f7bca740 10 client.0 _ll_register_callbacks cb 0x55d0f8016160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85eeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80bffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.750+0000 7f85eeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80bffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37508/0 (socket says 172.21.15.70:37508) 2024-09-19T04:34:02.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80bd260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85eeffd640 1 -- 172.21.15.70:0/3796527121 learned_addr learned my addr 172.21.15.70:0/3796527121 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85ef7fe640 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80c0680 0x55d0f80bd7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85ee7fc640 1 -- 172.21.15.70:0/3796527121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80c0680 msgr2=0x55d0f80bd7a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80c0680 0x55d0f80bd7a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85ee7fc640 1 -- 172.21.15.70:0/3796527121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 msgr2=0x55d0f80bffb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80bffb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85ee7fc640 1 -- 172.21.15.70:0/3796527121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f7d8c3c0 con 0x55d0f80b5dc0 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85eeffd640 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80bd260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85e409c390 tx=0x7f85e4098d10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c18d854b5e213fb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85d2ff5640 1 -- 172.21.15.70:0/3796527121 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e409cb00 con 0x55d0f80b5dc0 2024-09-19T04:34:02.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85f7bca740 1 -- 172.21.15.70:0/3796527121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85e409c400 con 0x55d0f80b5dc0 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85d2ff5640 1 -- 172.21.15.70:0/3796527121 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f85e4018d90 con 0x55d0f80b5dc0 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85d2ff5640 1 -- 172.21.15.70:0/3796527121 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f85e40a5070 con 0x55d0f80b5dc0 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85f7bca740 10 client.25232 fetch_fsmap learned FSMap version 27 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.751+0000 7f85f7bca740 1 -- 172.21.15.70:0/3796527121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d0f80cec00 con 0x55d0f80b5dc0 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85d2ff5640 1 -- 172.21.15.70:0/3796527121 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f85e409c400 con 0x55d0f80b5dc0 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85d2ff5640 1 -- 172.21.15.70:0/3796527121 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f85e409b8e0 con 0x55d0f80b5dc0 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85f7bca740 10 client.25232 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85f7bca740 10 client.25232 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85f7bca740 20 client.25232 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85f7bca740 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d0f80cff50 0x55d0f80d2340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85f7bca740 4 client.25232 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85f7bca740 1 -- 172.21.15.70:0/3796527121 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d0f8028850 con 0x55d0f80cff50 2024-09-19T04:34:02.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85eeffd640 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d0f80cff50 0x55d0f80d2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85d2ff5640 10 client.25232 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:02.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.752+0000 7f85eeffd640 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d0f80cff50 0x55d0f80d2340 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2086dbba699e17 server_cookie=2846fdc0785f87c2 in_seq=0 out_seq=0 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85d2ff5640 1 -- 172.21.15.70:0/3796527121 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d0f8028850 con 0x55d0f80cff50 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85d2ff5640 10 client.25232 handle_command_reply: tid=0 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 client.25232 shutdown 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 -- 172.21.15.70:0/3796527121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 msgr2=0x55d0f80bd260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80bd260 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f85e409c390 tx=0x7f85e4098d10 comp rx=0 tx=0).stop 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 -- 172.21.15.70:0/3796527121 shutdown_connections 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d0f80cff50 0x55d0f80d2340 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80c0680 0x55d0f80bd7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80bd260 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.764 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 --2- 172.21.15.70:0/3796527121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80bffb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85d2ff5640 0 client.25232 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 -- 172.21.15.70:0/3796527121 >> 172.21.15.70:0/3796527121 conn(0x55d0f80b1a30 msgr2=0x55d0f80b7710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 -- 172.21.15.70:0/3796527121 shutdown_connections 2024-09-19T04:34:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 1 -- 172.21.15.70:0/3796527121 wait complete. 2024-09-19T04:34:02.765 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.753+0000 7f85f7bca740 20 client.25232 trim_cache size 0 max 16384 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85f7bca740 1 Processor -- start 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85f7bca740 1 -- start start 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b1a30 0x55d0f80bc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80d58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85f7bca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01b22f0 con 0x55d0f80b54a0 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85f7bca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01afb30 con 0x55d0f80b1a30 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85f7bca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01ad980 con 0x55d0f80b5dc0 2024-09-19T04:34:02.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37524/0 (socket says 172.21.15.70:37524) 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 -- 172.21.15.70:0/421228158 learned_addr learned my addr 172.21.15.70:0/421228158 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85eeffd640 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b1a30 0x55d0f80bc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ef7fe640 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80d58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 -- 172.21.15.70:0/421228158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 msgr2=0x55d0f80d58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80d58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 -- 172.21.15.70:0/421228158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b1a30 msgr2=0x55d0f80bc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b1a30 0x55d0f80bc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 -- 172.21.15.70:0/421228158 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0f80b5bf0 con 0x55d0f80b54a0 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.772+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d5360 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f85e40a5230 tx=0x7f85e4098a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8457991b14ad6619 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85d4ff9640 1 -- 172.21.15.70:0/421228158 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e409c400 con 0x55d0f80b54a0 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85d4ff9640 1 -- 172.21.15.70:0/421228158 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f85e40a07b0 con 0x55d0f80b54a0 2024-09-19T04:34:02.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85d4ff9640 1 -- 172.21.15.70:0/421228158 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e40d23e0 con 0x55d0f80b54a0 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 -- 172.21.15.70:0/421228158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 msgr2=0x55d0f80d5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d5360 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f85e40a5230 tx=0x7f85e4098a70 comp rx=0 tx=0).stop 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 -- 172.21.15.70:0/421228158 shutdown_connections 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b5dc0 0x55d0f80d58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d5360 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 --2- 172.21.15.70:0/421228158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b1a30 0x55d0f80bc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 -- 172.21.15.70:0/421228158 >> 172.21.15.70:0/421228158 conn(0x55d0f80bd900 msgr2=0x55d0f80bbb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 -- 172.21.15.70:0/421228158 shutdown_connections 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.773+0000 7f85f7bca740 1 -- 172.21.15.70:0/421228158 wait complete. 2024-09-19T04:34:02.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 1 -- start start 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 1 Processor -- start 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b1a30 0x55d0f80d5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d2dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80d3300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01adff0 con 0x55d0f80b54a0 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01af460 con 0x55d0f80b5dc0 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f85f01ae6c0 con 0x55d0f80b1a30 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85f7bca740 10 client.0 _ll_register_callbacks cb 0x7f85e8013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d2dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85ee7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d2dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37540/0 (socket says 172.21.15.70:37540) 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85ee7fc640 1 -- 172.21.15.70:0/1619144921 learned_addr learned my addr 172.21.15.70:0/1619144921 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85ef7fe640 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80d3300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85eeffd640 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b1a30 0x55d0f80d5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85ee7fc640 1 -- 172.21.15.70:0/1619144921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b1a30 msgr2=0x55d0f80d5a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b1a30 0x55d0f80d5a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85ee7fc640 1 -- 172.21.15.70:0/1619144921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 msgr2=0x55d0f80d3300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.774+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80d3300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85ee7fc640 1 -- 172.21.15.70:0/1619144921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0f80d3ae0 con 0x55d0f80b54a0 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85ee7fc640 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d2dc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f85e4098220 tx=0x7f85e400cf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684d8a1dd418b85 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85d2ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85d2ff5640 1 -- 172.21.15.70:0/1619144921 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85e409ba50 con 0x55d0f80b54a0 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85d2ff5640 1 -- 172.21.15.70:0/1619144921 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f85e40d2110 con 0x55d0f80b54a0 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 1 -- 172.21.15.70:0/1619144921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85e40a07b0 con 0x55d0f80b54a0 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85d2ff5640 1 -- 172.21.15.70:0/1619144921 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f85e409c400 con 0x55d0f80b54a0 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 10 client.15804 fetch_fsmap learned FSMap version 27 2024-09-19T04:34:02.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 1 -- 172.21.15.70:0/1619144921 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55d0f80d3ae0 con 0x55d0f80b54a0 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85d2ff5640 1 -- 172.21.15.70:0/1619144921 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f85e40a07b0 con 0x55d0f80b54a0 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85d2ff5640 1 -- 172.21.15.70:0/1619144921 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f85e40a1a40 con 0x55d0f80b54a0 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 10 client.15804 fetch_fsmap finished waiting for FSMap version 27 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 10 client.15804 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 20 client.15804 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d0f80c0680 0x55d0f813cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 4 client.15804 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.775+0000 7f85f7bca740 1 -- 172.21.15.70:0/1619144921 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d0f8022d60 con 0x55d0f80c0680 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.776+0000 7f85eeffd640 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d0f80c0680 0x55d0f813cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.776+0000 7f85eeffd640 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d0f80c0680 0x55d0f813cbe0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a4ee6da72f0adda4 server_cookie=f10a7d1e0b41c0 in_seq=0 out_seq=0 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.776+0000 7f85d2ff5640 10 client.15804 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.776+0000 7f85d2ff5640 1 -- 172.21.15.70:0/1619144921 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d0f8022d60 con 0x55d0f80c0680 2024-09-19T04:34:02.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.776+0000 7f85d2ff5640 10 client.15804 handle_command_reply: tid=0 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.776+0000 7f85f7bca740 1 client.15804 shutdown 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 -- 172.21.15.70:0/1619144921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 msgr2=0x55d0f80d2dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d2dc0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f85e4098220 tx=0x7f85e400cf20 comp rx=0 tx=0).stop 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 -- 172.21.15.70:0/1619144921 shutdown_connections 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d0f80c0680 0x55d0f813cbe0 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0f80b5dc0 0x55d0f80d3300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85d2ff5640 0 client.15804 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0f80b54a0 0x55d0f80d2dc0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 --2- 172.21.15.70:0/1619144921 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0f80b1a30 0x55d0f80d5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 -- 172.21.15.70:0/1619144921 >> 172.21.15.70:0/1619144921 conn(0x55d0f80bd900 msgr2=0x55d0f80bc350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 -- 172.21.15.70:0/1619144921 shutdown_connections 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 1 -- 172.21.15.70:0/1619144921 wait complete. 2024-09-19T04:34:02.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f7bca740 20 client.15804 trim_cache size 0 max 16384 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout: "a48f8efe-01d1-4c6b-8be7-d8a794e8f985": { 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "a48f8efe-01d1-4c6b-8be7-d8a794e8f985", 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:34:02.784 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:34:02.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 -- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f85d80a33b0 msgr2=0x7f85d80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f85d80a33b0 0x7f85d80a5870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f85e8013d40 tx=0x7f85e8004ab0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 -- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0102790 msgr2=0x7f85f019ab50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:02.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0102790 0x7f85f019ab50 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f85e400e9f0 tx=0x7f85e400eeb0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 -- 172.21.15.70:0/3457185501 shutdown_connections 2024-09-19T04:34:02.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f85d80a33b0 0x7f85d80a5870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f85f0106f10 0x7f85f019eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f85f0102790 0x7f85f019ab50 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 --2- 172.21.15.70:0/3457185501 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f85f0101de0 0x7f85f019a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:02.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.777+0000 7f85f57f1640 1 -- 172.21.15.70:0/3457185501 >> 172.21.15.70:0/3457185501 conn(0x7f85f00fd8c0 msgr2=0x7f85f00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:02.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.778+0000 7f85f57f1640 1 -- 172.21.15.70:0/3457185501 shutdown_connections 2024-09-19T04:34:02.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:02.778+0000 7f85f57f1640 1 -- 172.21.15.70:0/3457185501 wait complete. 2024-09-19T04:34:02.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:02 smithi167 ceph-mon[34339]: pgmap v101: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-09-19T04:34:03.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:02 smithi134 ceph-mon[34525]: pgmap v101: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 3.2 MiB/s wr, 330 op/s 2024-09-19T04:34:03.678 INFO:tasks.cephfs.filesystem:scrub status for tag:a48f8efe-01d1-4c6b-8be7-d8a794e8f985 - {'path': '/', 'tag': 'a48f8efe-01d1-4c6b-8be7-d8a794e8f985', 'options': 'recursive,force'} 2024-09-19T04:34:04.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:04 smithi167 ceph-mon[34339]: pgmap v102: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 162 op/s 2024-09-19T04:34:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:04 smithi134 ceph-mon[34525]: pgmap v102: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 162 op/s 2024-09-19T04:34:05.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:04 smithi070 ceph-mon[30942]: pgmap v102: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 162 op/s 2024-09-19T04:34:06.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:06 smithi167 ceph-mon[34339]: pgmap v103: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 162 op/s 2024-09-19T04:34:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:06 smithi134 ceph-mon[34525]: pgmap v103: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 162 op/s 2024-09-19T04:34:07.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:06 smithi070 ceph-mon[30942]: pgmap v103: 97 pgs: 97 active+clean; 236 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.1 MiB/s rd, 2.1 MiB/s wr, 162 op/s 2024-09-19T04:34:08.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:08 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:34:08.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:08 smithi167 ceph-mon[34339]: pgmap v104: 97 pgs: 97 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 265 op/s 2024-09-19T04:34:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:08 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:34:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:08 smithi134 ceph-mon[34525]: pgmap v104: 97 pgs: 97 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 265 op/s 2024-09-19T04:34:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:08 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:34:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:08 smithi070 ceph-mon[30942]: pgmap v104: 97 pgs: 97 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 2.9 MiB/s wr, 265 op/s 2024-09-19T04:34:10.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:10 smithi167 ceph-mon[34339]: pgmap v105: 97 pgs: 97 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-09-19T04:34:11.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:10 smithi134 ceph-mon[34525]: pgmap v105: 97 pgs: 97 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-09-19T04:34:11.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:10 smithi070 ceph-mon[30942]: pgmap v105: 97 pgs: 97 active+clean; 245 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.2 MiB/s rd, 1.5 MiB/s wr, 143 op/s 2024-09-19T04:34:12.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:12 smithi167 ceph-mon[34339]: pgmap v106: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 288 op/s 2024-09-19T04:34:12.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:12 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:34:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:12 smithi134 ceph-mon[34525]: pgmap v106: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 288 op/s 2024-09-19T04:34:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:12 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:34:13.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:12 smithi070 ceph-mon[30942]: pgmap v106: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.2 MiB/s wr, 288 op/s 2024-09-19T04:34:13.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:12 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:34:13.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:13 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:34:13.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:13 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:34:14.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:13 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:34:14.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:13 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:34:14.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:13 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:34:14.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:13 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:34:14.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:14 smithi167 ceph-mon[34339]: pgmap v107: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 248 op/s 2024-09-19T04:34:15.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:14 smithi134 ceph-mon[34525]: pgmap v107: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 248 op/s 2024-09-19T04:34:15.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:14 smithi070 ceph-mon[30942]: pgmap v107: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 248 op/s 2024-09-19T04:34:16.110 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-09-19T04:34:16.110 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-09-19T04:34:16.401 DEBUG:teuthology.parallel:result is None 2024-09-19T04:34:16.402 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T04:34:16.434 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-09-19T04:34:16.434 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-09-19T04:34:16.446 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-09-19T04:34:16.446 INFO:teuthology.task.exec:Executing custom commands... 2024-09-19T04:34:16.446 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:34:16.446 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-09-19T04:34:16.500 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-09-19T04:34:16.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:16 smithi167 ceph-mon[34339]: pgmap v108: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 248 op/s 2024-09-19T04:34:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:16 smithi134 ceph-mon[34525]: pgmap v108: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 248 op/s 2024-09-19T04:34:17.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:16 smithi070 ceph-mon[30942]: pgmap v108: 97 pgs: 97 active+clean; 254 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.5 MiB/s wr, 248 op/s 2024-09-19T04:34:18.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:18 smithi167 ceph-mon[34339]: pgmap v109: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 398 op/s 2024-09-19T04:34:19.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:18 smithi134 ceph-mon[34525]: pgmap v109: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 398 op/s 2024-09-19T04:34:19.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:18 smithi070 ceph-mon[30942]: pgmap v109: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 2.1 MiB/s wr, 398 op/s 2024-09-19T04:34:20.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:20 smithi167 ceph-mon[34339]: pgmap v110: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 294 op/s 2024-09-19T04:34:21.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:20 smithi134 ceph-mon[34525]: pgmap v110: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 294 op/s 2024-09-19T04:34:21.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:20 smithi070 ceph-mon[30942]: pgmap v110: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 294 op/s 2024-09-19T04:34:22.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:22 smithi167 ceph-mon[34339]: pgmap v111: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-09-19T04:34:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:22 smithi134 ceph-mon[34525]: pgmap v111: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-09-19T04:34:23.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:22 smithi070 ceph-mon[30942]: pgmap v111: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.3 MiB/s wr, 306 op/s 2024-09-19T04:34:24.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:24 smithi167 ceph-mon[34339]: pgmap v112: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T04:34:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:24 smithi134 ceph-mon[34525]: pgmap v112: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T04:34:25.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:24 smithi070 ceph-mon[30942]: pgmap v112: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T04:34:26.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:26 smithi070 ceph-mon[30942]: pgmap v113: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T04:34:26.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:26 smithi167 ceph-mon[34339]: pgmap v113: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T04:34:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:26 smithi134 ceph-mon[34525]: pgmap v113: 97 pgs: 97 active+clean; 260 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 639 KiB/s rd, 607 KiB/s wr, 162 op/s 2024-09-19T04:34:28.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:28 smithi167 ceph-mon[34339]: pgmap v114: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 613 KiB/s wr, 166 op/s 2024-09-19T04:34:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:28 smithi134 ceph-mon[34525]: pgmap v114: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 613 KiB/s wr, 166 op/s 2024-09-19T04:34:29.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:28 smithi070 ceph-mon[30942]: pgmap v114: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 646 KiB/s rd, 613 KiB/s wr, 166 op/s 2024-09-19T04:34:30.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:30 smithi167 ceph-mon[34339]: pgmap v115: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T04:34:31.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:30 smithi134 ceph-mon[34525]: pgmap v115: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T04:34:31.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:30 smithi070 ceph-mon[30942]: pgmap v115: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 34 KiB/s rd, 20 KiB/s wr, 16 op/s 2024-09-19T04:34:32.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:32 smithi167 ceph-mon[34339]: pgmap v116: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-19T04:34:33.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:32 smithi134 ceph-mon[34525]: pgmap v116: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-19T04:34:33.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:32 smithi070 ceph-mon[30942]: pgmap v116: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 35 KiB/s rd, 21 KiB/s wr, 19 op/s 2024-09-19T04:34:33.680 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:34:33.943 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:34:34.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 -- 172.21.15.70:0/2254070736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 msgr2=0x7fbef010d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 --2- 172.21.15.70:0/2254070736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 0x7fbef010d950 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7fbee8009cd0 tx=0x7fbee802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 -- 172.21.15.70:0/2254070736 shutdown_connections 2024-09-19T04:34:34.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 --2- 172.21.15.70:0/2254070736 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 0x7fbef010d950 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 --2- 172.21.15.70:0/2254070736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef0100a80 0x7fbef0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 --2- 172.21.15.70:0/2254070736 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbef0106a80 0x7fbef0106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 -- 172.21.15.70:0/2254070736 >> 172.21.15.70:0/2254070736 conn(0x7fbef00fc7a0 msgr2=0x7fbef00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 -- 172.21.15.70:0/2254070736 shutdown_connections 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.410+0000 7fbef6a91640 1 -- 172.21.15.70:0/2254070736 wait complete. 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef6a91640 1 Processor -- start 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef6a91640 1 -- start start 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef6a91640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef0100a80 0x7fbef0102650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef6a91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 0x7fbef0102b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef6a91640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbef0106a80 0x7fbef01030d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef6a91640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0110f10 con 0x7fbef0101420 2024-09-19T04:34:34.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef6a91640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0110d90 con 0x7fbef0100a80 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef6a91640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbef0111090 con 0x7fbef0106a80 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 0x7fbef0102b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 0x7fbef0102b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41298/0 (socket says 172.21.15.70:41298) 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbeeffff640 1 -- 172.21.15.70:0/412410819 learned_addr learned my addr 172.21.15.70:0/412410819 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef502e640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbef0106a80 0x7fbef01030d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.411+0000 7fbef482d640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef0100a80 0x7fbef0102650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeeffff640 1 -- 172.21.15.70:0/412410819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbef0106a80 msgr2=0x7fbef01030d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeeffff640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbef0106a80 0x7fbef01030d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeeffff640 1 -- 172.21.15.70:0/412410819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef0100a80 msgr2=0x7fbef0102650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeeffff640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef0100a80 0x7fbef0102650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeeffff640 1 -- 172.21.15.70:0/412410819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbef01a6a20 con 0x7fbef0101420 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeeffff640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 0x7fbef0102b90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00b4a0 tx=0x7fbedc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeedffb640 1 -- 172.21.15.70:0/412410819 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc014070 con 0x7fbef0101420 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbef6a91640 1 -- 172.21.15.70:0/412410819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbef01a6d10 con 0x7fbef0101420 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeedffb640 1 -- 172.21.15.70:0/412410819 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbedc010ae0 con 0x7fbef0101420 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbeedffb640 1 -- 172.21.15.70:0/412410819 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc01e060 con 0x7fbef0101420 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.412+0000 7fbef6a91640 1 -- 172.21.15.70:0/412410819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbef01a71f0 con 0x7fbef0101420 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.414+0000 7fbeedffb640 1 -- 172.21.15.70:0/412410819 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbedc017070 con 0x7fbef0101420 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef8e6a740 1 Processor -- start 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef8e6a740 1 -- start start 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeedffb640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbee00a33b0 0x7fbee00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd33880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd3e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd3e680 0x5583efd40a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583efc992e0 con 0x5583efd33dc0 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5583efc40ce0 con 0x5583efd334a0 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5583efc952a0 con 0x5583efd3e680 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeedffb640 1 -- 172.21.15.70:0/412410819 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fbedc0cf350 con 0x7fbef0101420 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef502e640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbee00a33b0 0x7fbee00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd3e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd3e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41302/0 (socket says 172.21.15.70:41302) 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeeffff640 1 -- 172.21.15.70:0/1771398956 learned_addr learned my addr 172.21.15.70:0/1771398956 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbef482d640 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd33880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeeffff640 1 -- 172.21.15.70:0/1771398956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd3e680 msgr2=0x5583efd40a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeeffff640 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd3e680 0x5583efd40a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeeffff640 1 -- 172.21.15.70:0/1771398956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 msgr2=0x5583efd33880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.415+0000 7fbeeffff640 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd33880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbeeffff640 1 -- 172.21.15.70:0/1771398956 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583efc25440 con 0x5583efd33dc0 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbef482d640 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd33880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbeeffff640 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd3e140 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbedc098130 tx=0x7fbedc09bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fb982645959e337 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbef502e640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbee00a33b0 0x7fbee00a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006010 tx=0x7fbee8009900 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbedaffd640 1 -- 172.21.15.70:0/1771398956 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc0a43d0 con 0x5583efd33dc0 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbedaffd640 1 -- 172.21.15.70:0/1771398956 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbedc017360 con 0x5583efd33dc0 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbedaffd640 1 -- 172.21.15.70:0/1771398956 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc05a890 con 0x5583efd33dc0 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbef8e6a740 1 -- 172.21.15.70:0/1771398956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 msgr2=0x5583efd3e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.416+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd3e140 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7fbedc098130 tx=0x7fbedc09bf20 comp rx=0 tx=0).stop 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 -- 172.21.15.70:0/1771398956 shutdown_connections 2024-09-19T04:34:34.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd3e680 0x5583efd40a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd3e140 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/1771398956 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd33880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 -- 172.21.15.70:0/1771398956 >> 172.21.15.70:0/1771398956 conn(0x5583efd2fa30 msgr2=0x5583efd2fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 -- 172.21.15.70:0/1771398956 shutdown_connections 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 -- 172.21.15.70:0/1771398956 wait complete. 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 -- start start 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 Processor -- start 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd334a0 0x5583efd3dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 0x5583efd3b250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd3e680 0x5583efd3b790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5583efd41250 con 0x5583efd3e680 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5583efc54050 con 0x5583efd33dc0 2024-09-19T04:34:34.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5583efd413d0 con 0x5583efd334a0 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef8e6a740 10 client.0 _ll_register_callbacks cb 0x5583efc94160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef502e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd3e680 0x5583efd3b790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef502e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd3e680 0x5583efd3b790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41314/0 (socket says 172.21.15.70:41314) 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.417+0000 7fbef502e640 1 -- 172.21.15.70:0/606623529 learned_addr learned my addr 172.21.15.70:0/606623529 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbeeffff640 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 0x5583efd3b250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef482d640 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd334a0 0x5583efd3dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef502e640 1 -- 172.21.15.70:0/606623529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd334a0 msgr2=0x5583efd3dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef502e640 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd334a0 0x5583efd3dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef502e640 1 -- 172.21.15.70:0/606623529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 msgr2=0x5583efd3b250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef502e640 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 0x5583efd3b250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef502e640 1 -- 172.21.15.70:0/606623529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583efa0a3c0 con 0x5583efd3e680 2024-09-19T04:34:34.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef482d640 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd334a0 0x5583efd3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef502e640 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd3e680 0x5583efd3b790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbee8003ba0 tx=0x7fbee802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=943535009182f736 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbecffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbecffff640 1 -- 172.21.15.70:0/606623529 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee804d070 con 0x5583efd3e680 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbecffff640 1 -- 172.21.15.70:0/606623529 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fbee80305a0 con 0x5583efd3e680 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef8e6a740 1 -- 172.21.15.70:0/606623529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbedc017360 con 0x5583efd3e680 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbecffff640 1 -- 172.21.15.70:0/606623529 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbee8059050 con 0x5583efd3e680 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef8e6a740 10 client.15816 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.418+0000 7fbef8e6a740 1 -- 172.21.15.70:0/606623529 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583efd4cb40 con 0x5583efd3e680 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbecffff640 1 -- 172.21.15.70:0/606623529 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbedc017360 con 0x5583efd3e680 2024-09-19T04:34:34.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbecffff640 1 -- 172.21.15.70:0/606623529 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbee8030070 con 0x5583efd3e680 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbef8e6a740 10 client.15816 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbef8e6a740 10 client.15816 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbef8e6a740 20 client.15816 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5583efd4dfa0 0x5583efd503f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbef8e6a740 4 client.15816 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbef8e6a740 1 -- 172.21.15.70:0/606623529 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5583efca6850 con 0x5583efd4dfa0 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.419+0000 7fbef482d640 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5583efd4dfa0 0x5583efd503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.420+0000 7fbecffff640 10 client.15816 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.420+0000 7fbef482d640 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5583efd4dfa0 0x5583efd503f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a29de92ccff9e05b server_cookie=8fcad81d5d3bf011 in_seq=0 out_seq=0 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.420+0000 7fbecffff640 1 -- 172.21.15.70:0/606623529 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5583efca6850 con 0x5583efd4dfa0 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.420+0000 7fbecffff640 10 client.15816 handle_command_reply: tid=0 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.420+0000 7fbef8e6a740 1 client.15816 shutdown 2024-09-19T04:34:34.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 -- 172.21.15.70:0/606623529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd3e680 msgr2=0x5583efd3b790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd3e680 0x5583efd3b790 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7fbee8003ba0 tx=0x7fbee802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 -- 172.21.15.70:0/606623529 shutdown_connections 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5583efd4dfa0 0x5583efd503f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd3e680 0x5583efd3b790 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 0x5583efd3b250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/606623529 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd334a0 0x5583efd3dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 -- 172.21.15.70:0/606623529 >> 172.21.15.70:0/606623529 conn(0x5583efd2fa30 msgr2=0x5583efd35760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbecffff640 0 client.15816 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 -- 172.21.15.70:0/606623529 shutdown_connections 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 1 -- 172.21.15.70:0/606623529 wait complete. 2024-09-19T04:34:34.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.421+0000 7fbef8e6a740 20 client.15816 trim_cache size 0 max 16384 2024-09-19T04:34:34.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef8e6a740 1 Processor -- start 2024-09-19T04:34:34.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef8e6a740 1 -- start start 2024-09-19T04:34:34.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd4a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd55cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd56200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01b2500 con 0x5583efd33dc0 2024-09-19T04:34:34.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01afd10 con 0x5583efd334a0 2024-09-19T04:34:34.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01adb60 con 0x5583efd2fa30 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef482d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd4a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef502e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd56200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef482d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd4a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:32848/0 (socket says 172.21.15.70:32848) 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbef482d640 1 -- 172.21.15.70:0/554617499 learned_addr learned my addr 172.21.15.70:0/554617499 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.438+0000 7fbeeffff640 1 --2- 172.21.15.70:0/554617499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd55cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbef502e640 1 -- 172.21.15.70:0/554617499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 msgr2=0x5583efd4a4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbef502e640 1 --2- 172.21.15.70:0/554617499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd4a4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbef502e640 1 -- 172.21.15.70:0/554617499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 msgr2=0x5583efd55cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbef502e640 1 --2- 172.21.15.70:0/554617499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd55cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbef502e640 1 -- 172.21.15.70:0/554617499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583efd33220 con 0x5583efd33dc0 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbef502e640 1 --2- 172.21.15.70:0/554617499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd56200 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbee802ae00 tx=0x7fbee8031610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ec62a12ccf3a74 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:34.448 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbeda7fc640 1 -- 172.21.15.70:0/554617499 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee804d070 con 0x5583efd33dc0 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbeda7fc640 1 -- 172.21.15.70:0/554617499 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbee8041040 con 0x5583efd33dc0 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.439+0000 7fbeda7fc640 1 -- 172.21.15.70:0/554617499 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbee8043070 con 0x5583efd33dc0 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 -- 172.21.15.70:0/554617499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 msgr2=0x5583efd56200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/554617499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd56200 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fbee802ae00 tx=0x7fbee8031610 comp rx=0 tx=0).stop 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 -- 172.21.15.70:0/554617499 shutdown_connections 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/554617499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd33dc0 0x5583efd56200 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/554617499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd334a0 0x5583efd55cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/554617499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd4a4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 -- 172.21.15.70:0/554617499 >> 172.21.15.70:0/554617499 conn(0x5583efd3b8f0 msgr2=0x5583efd39b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 -- 172.21.15.70:0/554617499 shutdown_connections 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 -- 172.21.15.70:0/554617499 wait complete. 2024-09-19T04:34:34.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 -- start start 2024-09-19T04:34:34.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.440+0000 7fbef8e6a740 1 Processor -- start 2024-09-19T04:34:34.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd42540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd334a0 0x5583efd42a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef8e6a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 0x5583efd42fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01ae1d0 con 0x5583efd334a0 2024-09-19T04:34:34.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01af640 con 0x5583efd33dc0 2024-09-19T04:34:34.450 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef8e6a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbef01ae8a0 con 0x5583efd2fa30 2024-09-19T04:34:34.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef8e6a740 10 client.0 _ll_register_callbacks cb 0x7fbee8031f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:34.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd334a0 0x5583efd42a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd334a0 0x5583efd42a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41334/0 (socket says 172.21.15.70:41334) 2024-09-19T04:34:34.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 -- 172.21.15.70:0/934164316 learned_addr learned my addr 172.21.15.70:0/934164316 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:34.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef502e640 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 0x5583efd42fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef482d640 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd42540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 -- 172.21.15.70:0/934164316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 msgr2=0x5583efd42540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:34.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd42540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 -- 172.21.15.70:0/934164316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 msgr2=0x5583efd42fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:34.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 0x5583efd42fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 -- 172.21.15.70:0/934164316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583efdb7e90 con 0x5583efd334a0 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbeeffff640 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd334a0 0x5583efd42a80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0ccc80 tx=0x7fbedc0173e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c71ff85b6b57f9b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbecffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbecffff640 1 -- 172.21.15.70:0/934164316 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbedc054020 con 0x5583efd334a0 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbecffff640 1 -- 172.21.15.70:0/934164316 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fbedc017c50 con 0x5583efd334a0 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.441+0000 7fbef8e6a740 1 -- 172.21.15.70:0/934164316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbee8041040 con 0x5583efd334a0 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbecffff640 1 -- 172.21.15.70:0/934164316 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbedc05a040 con 0x5583efd334a0 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef8e6a740 10 client.15822 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef8e6a740 1 -- 172.21.15.70:0/934164316 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5583efdb9140 con 0x5583efd334a0 2024-09-19T04:34:34.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbecffff640 1 -- 172.21.15.70:0/934164316 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbee8041040 con 0x5583efd334a0 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbecffff640 1 -- 172.21.15.70:0/934164316 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbedc05a7f0 con 0x5583efd334a0 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef8e6a740 10 client.15822 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef8e6a740 10 client.15822 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef8e6a740 20 client.15822 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5583efd3e680 0x5583efdbb540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef8e6a740 4 client.15822 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef8e6a740 1 -- 172.21.15.70:0/934164316 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5583efca0d60 con 0x5583efd3e680 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.442+0000 7fbef482d640 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5583efd3e680 0x5583efdbb540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:34.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef482d640 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5583efd3e680 0x5583efdbb540 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cafbb3d579e5002 server_cookie=b864d83a67cf3abe in_seq=0 out_seq=0 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbecffff640 10 client.15822 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbecffff640 1 -- 172.21.15.70:0/934164316 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5583efca0d60 con 0x5583efd3e680 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbecffff640 10 client.15822 handle_command_reply: tid=0 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 client.15822 shutdown 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 -- 172.21.15.70:0/934164316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd334a0 msgr2=0x5583efd42a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd334a0 0x5583efd42a80 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fbedc0ccc80 tx=0x7fbedc0173e0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 -- 172.21.15.70:0/934164316 shutdown_connections 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5583efd3e680 0x5583efdbb540 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5583efd33dc0 0x5583efd42fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5583efd334a0 0x5583efd42a80 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 --2- 172.21.15.70:0/934164316 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5583efd2fa30 0x5583efd42540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbecffff640 0 client.15822 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:34.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 -- 172.21.15.70:0/934164316 >> 172.21.15.70:0/934164316 conn(0x5583efd3b8f0 msgr2=0x5583efd396f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:34.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 -- 172.21.15.70:0/934164316 shutdown_connections 2024-09-19T04:34:34.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.443+0000 7fbef8e6a740 1 -- 172.21.15.70:0/934164316 wait complete. 2024-09-19T04:34:34.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef8e6a740 20 client.15822 trim_cache size 0 max 16384 2024-09-19T04:34:34.456 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:34:34.456 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:34:34.456 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:34:34.456 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:34:34.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 -- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbee00a33b0 msgr2=0x7fbee00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbee00a33b0 0x7fbee00a5870 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fbee8006010 tx=0x7fbee8009900 comp rx=0 tx=0).stop 2024-09-19T04:34:34.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 -- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 msgr2=0x7fbef0102b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:34.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 0x7fbef0102b90 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7fbedc00b4a0 tx=0x7fbedc00b960 comp rx=0 tx=0).stop 2024-09-19T04:34:34.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 -- 172.21.15.70:0/412410819 shutdown_connections 2024-09-19T04:34:34.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbee00a33b0 0x7fbee00a5870 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbef0106a80 0x7fbef01030d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbef0101420 0x7fbef0102b90 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 --2- 172.21.15.70:0/412410819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbef0100a80 0x7fbef0102650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:34.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 -- 172.21.15.70:0/412410819 >> 172.21.15.70:0/412410819 conn(0x7fbef00fc7a0 msgr2=0x7fbef01048d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:34.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 -- 172.21.15.70:0/412410819 shutdown_connections 2024-09-19T04:34:34.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:34.444+0000 7fbef6a91640 1 -- 172.21.15.70:0/412410819 wait complete. 2024-09-19T04:34:34.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:34 smithi167 ceph-mon[34339]: pgmap v117: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-19T04:34:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:34 smithi134 ceph-mon[34525]: pgmap v117: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-19T04:34:35.101 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:34 smithi070 ceph-mon[30942]: pgmap v117: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-19T04:34:35.170 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:34:35.171 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:34:35.416 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:34:35.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 -- 172.21.15.70:0/1017305898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec102790 msgr2=0x7f3fec1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:35.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/1017305898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec102790 0x7f3fec1067e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0009ca0 tx=0x7f3fe002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:34:35.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 -- 172.21.15.70:0/1017305898 shutdown_connections 2024-09-19T04:34:35.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/1017305898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fec106f10 0x7f3fec10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:35.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/1017305898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec102790 0x7f3fec1067e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:35.925 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/1017305898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fec101de0 0x7f3fec1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 -- 172.21.15.70:0/1017305898 >> 172.21.15.70:0/1017305898 conn(0x7f3fec0fd8c0 msgr2=0x7f3fec0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 -- 172.21.15.70:0/1017305898 shutdown_connections 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.892+0000 7f3ff3f15640 1 -- 172.21.15.70:0/1017305898 wait complete. 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff3f15640 1 Processor -- start 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff3f15640 1 -- start start 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff3f15640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec101de0 0x7f3fec1985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff3f15640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fec102790 0x7f3fec198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff3f15640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fec106f10 0x7f3fec19ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff3f15640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec112000 con 0x7f3fec101de0 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff3f15640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec111e80 con 0x7f3fec102790 2024-09-19T04:34:35.926 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff3f15640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3fec112180 con 0x7f3fec106f10 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff1cb1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec101de0 0x7f3fec1985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff1cb1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec101de0 0x7f3fec1985a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41342/0 (socket says 172.21.15.70:41342) 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff1cb1640 1 -- 172.21.15.70:0/4197454186 learned_addr learned my addr 172.21.15.70:0/4197454186 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff14b0640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fec102790 0x7f3fec198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff1cb1640 1 -- 172.21.15.70:0/4197454186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fec106f10 msgr2=0x7f3fec19ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.893+0000 7f3ff24b2640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fec106f10 0x7f3fec19ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff1cb1640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fec106f10 0x7f3fec19ce70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff1cb1640 1 -- 172.21.15.70:0/4197454186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fec102790 msgr2=0x7f3fec198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff1cb1640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fec102790 0x7f3fec198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff1cb1640 1 -- 172.21.15.70:0/4197454186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fec19d550 con 0x7f3fec101de0 2024-09-19T04:34:35.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff14b0640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fec102790 0x7f3fec198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff24b2640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fec106f10 0x7f3fec19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff1cb1640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec101de0 0x7f3fec1985a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b4a0 tx=0x7f3fe400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3feaffd640 1 -- 172.21.15.70:0/4197454186 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4014070 con 0x7f3fec101de0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3feaffd640 1 -- 172.21.15.70:0/4197454186 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3fe4010ae0 con 0x7f3fec101de0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3feaffd640 1 -- 172.21.15.70:0/4197454186 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fe4017c70 con 0x7f3fec101de0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fec19d840 con 0x7f3fec101de0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.894+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fec1a5120 con 0x7f3fec101de0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.895+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3fec102240 con 0x7f3fec101de0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.896+0000 7f3feaffd640 1 -- 172.21.15.70:0/4197454186 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3fe4017070 con 0x7f3fec101de0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.897+0000 7f3feaffd640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3fd40a33b0 0x7f3fd40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.897+0000 7f3ff14b0640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3fd40a33b0 0x7f3fd40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:35.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.897+0000 7f3feaffd640 1 -- 172.21.15.70:0/4197454186 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f3fe40cf780 con 0x7f3fec101de0 2024-09-19T04:34:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.897+0000 7f3ff14b0640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3fd40a33b0 0x7f3fd40a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0000f80 tx=0x7f3fe0005ef0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:35.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:35.900+0000 7f3feaffd640 1 -- 172.21.15.70:0/4197454186 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3fe409c290 con 0x7f3fec101de0 2024-09-19T04:34:36.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.102+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3fec199900 con 0x7f3fec101de0 2024-09-19T04:34:36.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.103+0000 7f3feaffd640 1 -- 172.21.15.70:0/4197454186 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7f3fe409bb90 con 0x7f3fec101de0 2024-09-19T04:34:36.104 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:34:36.105 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-19T04:34:07:652724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:34:07.594198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:34:36.105 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-19T04:34:36.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3fd40a33b0 msgr2=0x7f3fd40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:36.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3fd40a33b0 0x7f3fd40a5870 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f3fe0000f80 tx=0x7f3fe0005ef0 comp rx=0 tx=0).stop 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec101de0 msgr2=0x7f3fec1985a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec101de0 0x7f3fec1985a0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f3fe400b4a0 tx=0x7f3fe400b960 comp rx=0 tx=0).stop 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 shutdown_connections 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3fd40a33b0 0x7f3fd40a5870 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3fec106f10 0x7f3fec19ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fec102790 0x7f3fec198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 --2- 172.21.15.70:0/4197454186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3fec101de0 0x7f3fec1985a0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 >> 172.21.15.70:0/4197454186 conn(0x7f3fec0fd8c0 msgr2=0x7f3fec0fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 shutdown_connections 2024-09-19T04:34:36.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:36.105+0000 7f3ff3f15640 1 -- 172.21.15.70:0/4197454186 wait complete. 2024-09-19T04:34:36.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:36 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4197454186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:34:36.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:36 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4197454186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:34:36.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:36 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4197454186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:34:36.858 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:34:37.106 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:34:37.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:37 smithi167 ceph-mon[34339]: pgmap v118: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-19T04:34:37.514 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:37 smithi070 ceph-mon[30942]: pgmap v118: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-19T04:34:37.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:37 smithi134 ceph-mon[34525]: pgmap v118: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 8.6 KiB/s rd, 6.7 KiB/s wr, 7 op/s 2024-09-19T04:34:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 -- 172.21.15.70:0/3648723165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 msgr2=0x7f30d410dbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 --2- 172.21.15.70:0/3648723165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 0x7f30d410dbd0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009ca0 tx=0x7f30cc02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 -- 172.21.15.70:0/3648723165 shutdown_connections 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 --2- 172.21.15.70:0/3648723165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 0x7f30d410dbd0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 --2- 172.21.15.70:0/3648723165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30d4101df0 0x7f30d4105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 --2- 172.21.15.70:0/3648723165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30d4101440 0x7f30d4101820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 -- 172.21.15.70:0/3648723165 >> 172.21.15.70:0/3648723165 conn(0x7f30d4077210 msgr2=0x7f30d40fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 -- 172.21.15.70:0/3648723165 shutdown_connections 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 -- 172.21.15.70:0/3648723165 wait complete. 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 Processor -- start 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.596+0000 7f30d900b640 1 -- start start 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d900b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30d4101440 0x7f30d4198620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d900b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30d4101df0 0x7f30d4198b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d900b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 0x7f30d419cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d900b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4111080 con 0x7f30d4106050 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d900b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4110f00 con 0x7f30d4101440 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d900b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30d4111200 con 0x7f30d4101df0 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 0x7f30d419cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 0x7f30d419cef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41360/0 (socket says 172.21.15.70:41360) 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 -- 172.21.15.70:0/3056922408 learned_addr learned my addr 172.21.15.70:0/3056922408 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30d4101440 0x7f30d4198620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30cbfff640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30d4101df0 0x7f30d4198b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 -- 172.21.15.70:0/3056922408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30d4101df0 msgr2=0x7f30d4198b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30d4101df0 0x7f30d4198b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 -- 172.21.15.70:0/3056922408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30d4101440 msgr2=0x7f30d4198620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30d4101440 0x7f30d4198620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 -- 172.21.15.70:0/3056922408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30d419d5d0 con 0x7f30d4106050 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30d4101440 0x7f30d4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.597+0000 7f30d359e640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 0x7f30d419cef0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009430 tx=0x7f30cc003ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.598+0000 7f30d0d99640 1 -- 172.21.15.70:0/3056922408 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc031650 con 0x7f30d4106050 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.598+0000 7f30d900b640 1 -- 172.21.15.70:0/3056922408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30d419d860 con 0x7f30d4106050 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.598+0000 7f30d0d99640 1 -- 172.21.15.70:0/3056922408 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30cc0317f0 con 0x7f30d4106050 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.598+0000 7f30d0d99640 1 -- 172.21.15.70:0/3056922408 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30cc02fae0 con 0x7f30d4106050 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.598+0000 7f30d900b640 1 -- 172.21.15.70:0/3056922408 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30d41a51a0 con 0x7f30d4106050 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30d0d99640 1 -- 172.21.15.70:0/3056922408 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f30cc0045a0 con 0x7f30d4106050 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30db3e4740 1 Processor -- start 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30db3e4740 1 -- start start 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3c9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3c95d0 0x55c52e3c9a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3d4370 0x55c52e3d6760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30db3e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c52e32f2f0 con 0x55c52e3d4370 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30db3e4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c52e2d6cf0 con 0x55c52e3c95d0 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.600+0000 7f30db3e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c52e32b2b0 con 0x55c52e3cab40 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30d0d99640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30c00a33b0 0x7f30c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3d4370 0x55c52e3d6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3d4370 0x55c52e3d6760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41370/0 (socket says 172.21.15.70:41370) 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 -- 172.21.15.70:0/924709424 learned_addr learned my addr 172.21.15.70:0/924709424 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3c95d0 0x55c52e3c9a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3c9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30d359e640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30c00a33b0 0x7f30c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 -- 172.21.15.70:0/924709424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 msgr2=0x55c52e3c9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3c9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 -- 172.21.15.70:0/924709424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3c95d0 msgr2=0x55c52e3c9a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:37.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3c95d0 0x55c52e3c9a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 -- 172.21.15.70:0/924709424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c52e2bb3a0 con 0x55c52e3d4370 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30d0d99640 1 -- 172.21.15.70:0/3056922408 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f30cc0f0f70 con 0x7f30d4106050 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30cbfff640 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3d4370 0x55c52e3d6760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00bf90 tx=0x7f30bc00b790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50faefbad13756b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30c97fa640 1 -- 172.21.15.70:0/924709424 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc004300 con 0x55c52e3d4370 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30d359e640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30c00a33b0 0x7f30c00a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0b97e0 tx=0x7f30cc08f100 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30c97fa640 1 -- 172.21.15.70:0/924709424 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30bc0044a0 con 0x55c52e3d4370 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.601+0000 7f30c97fa640 1 -- 172.21.15.70:0/924709424 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0035f0 con 0x55c52e3d4370 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 -- 172.21.15.70:0/924709424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3d4370 msgr2=0x55c52e3d6760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3d4370 0x55c52e3d6760 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f30bc00bf90 tx=0x7f30bc00b790 comp rx=0 tx=0).stop 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 -- 172.21.15.70:0/924709424 shutdown_connections 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3d4370 0x55c52e3d6760 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3c95d0 0x55c52e3c9a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 --2- 172.21.15.70:0/924709424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3c9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 -- 172.21.15.70:0/924709424 >> 172.21.15.70:0/924709424 conn(0x55c52e392310 msgr2=0x55c52e3c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 -- 172.21.15.70:0/924709424 shutdown_connections 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 -- 172.21.15.70:0/924709424 wait complete. 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.602+0000 7f30db3e4740 1 -- start start 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30db3e4740 1 Processor -- start 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3d3d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3d1020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3d1610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30db3e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c52e3d7070 con 0x55c52e3c95d0 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30db3e4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c52e2ea060 con 0x55c52e3d4370 2024-09-19T04:34:37.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30db3e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c52e3d71f0 con 0x55c52e3cab40 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30db3e4740 10 client.0 _ll_register_callbacks cb 0x55c52e03d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3d3d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3d3d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41372/0 (socket says 172.21.15.70:41372) 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 -- 172.21.15.70:0/3607405491 learned_addr learned my addr 172.21.15.70:0/3607405491 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3d1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 -- 172.21.15.70:0/3607405491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 msgr2=0x55c52e3d1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3d1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 -- 172.21.15.70:0/3607405491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 msgr2=0x55c52e3d1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3d1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 -- 172.21.15.70:0/3607405491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c52e0a03c0 con 0x55c52e3c95d0 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30cbfff640 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3d3d70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f30bc006010 tx=0x7f30bc005970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105b784608fce8aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:37.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.603+0000 7f30ba7fc640 1 -- 172.21.15.70:0/3607405491 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc0037f0 con 0x55c52e3c95d0 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 1 -- 172.21.15.70:0/3607405491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55c52e33c860 con 0x55c52e3c95d0 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30ba7fc640 1 -- 172.21.15.70:0/3607405491 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f30bc003990 con 0x55c52e3c95d0 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30ba7fc640 1 -- 172.21.15.70:0/3607405491 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30bc031050 con 0x55c52e3c95d0 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 10 client.15840 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 1 -- 172.21.15.70:0/3607405491 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c52e3e2b10 con 0x55c52e3c95d0 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30ba7fc640 1 -- 172.21.15.70:0/3607405491 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55c52e33c860 con 0x55c52e3c95d0 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30ba7fc640 1 -- 172.21.15.70:0/3607405491 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f30bc01c020 con 0x55c52e3c95d0 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 10 client.15840 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 10 client.15840 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 20 client.15840 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55c52e3e3ec0 0x55c52e3e62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 4 client.15840 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:34:37.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30db3e4740 1 -- 172.21.15.70:0/3607405491 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c52e336d70 con 0x55c52e3e3ec0 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.604+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55c52e3e3ec0 0x55c52e3e62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.605+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55c52e3e3ec0 0x55c52e3e62b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=57dea876d692f821 server_cookie=ed7ef4cc9dfb2e5c in_seq=0 out_seq=0 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.605+0000 7f30ba7fc640 10 client.15840 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.605+0000 7f30ba7fc640 1 -- 172.21.15.70:0/3607405491 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c52e336d70 con 0x55c52e3e3ec0 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.605+0000 7f30ba7fc640 10 client.15840 handle_command_reply: tid=0 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 client.15840 shutdown 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 -- 172.21.15.70:0/3607405491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 msgr2=0x55c52e3d3d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3d3d70 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f30bc006010 tx=0x7f30bc005970 comp rx=0 tx=0).stop 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 -- 172.21.15.70:0/3607405491 shutdown_connections 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55c52e3e3ec0 0x55c52e3e62b0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3d1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3d1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3607405491 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3d3d70 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30ba7fc640 0 client.15840 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:34:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 -- 172.21.15.70:0/3607405491 >> 172.21.15.70:0/3607405491 conn(0x55c52e392310 msgr2=0x55c52e3cb960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 -- 172.21.15.70:0/3607405491 shutdown_connections 2024-09-19T04:34:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 1 -- 172.21.15.70:0/3607405491 wait complete. 2024-09-19T04:34:37.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.606+0000 7f30db3e4740 20 client.15840 trim_cache size 0 max 16384 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30db3e4740 1 Processor -- start 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30db3e4740 1 -- start start 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3e0310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3eba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30db3e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41b0160 con 0x55c52e3c95d0 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30db3e4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41ad970 con 0x55c52e3d4370 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30db3e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41ab7c0 con 0x55c52e3cab40 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30cbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3c5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41380/0 (socket says 172.21.15.70:41380) 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.619+0000 7f30cbfff640 1 -- 172.21.15.70:0/3876466266 learned_addr learned my addr 172.21.15.70:0/3876466266 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/3876466266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3e0310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30cbfff640 1 -- 172.21.15.70:0/3876466266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 msgr2=0x55c52e3e0310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30cbfff640 1 --2- 172.21.15.70:0/3876466266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3e0310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30cbfff640 1 -- 172.21.15.70:0/3876466266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 msgr2=0x55c52e3eba90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30cbfff640 1 --2- 172.21.15.70:0/3876466266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3eba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30cbfff640 1 -- 172.21.15.70:0/3876466266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c52e3c92d0 con 0x55c52e3c95d0 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30cbfff640 1 --2- 172.21.15.70:0/3876466266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3c5df0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f30bc000c00 tx=0x7f30bc005730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3270a2e637ec02e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30c8ff9640 1 -- 172.21.15.70:0/3876466266 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc00b670 con 0x55c52e3c95d0 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30c8ff9640 1 -- 172.21.15.70:0/3876466266 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30bc01ec20 con 0x55c52e3c95d0 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.620+0000 7f30c8ff9640 1 -- 172.21.15.70:0/3876466266 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30bc003bb0 con 0x55c52e3c95d0 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- 172.21.15.70:0/3876466266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 msgr2=0x55c52e3c5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3876466266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3c5df0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f30bc000c00 tx=0x7f30bc005730 comp rx=0 tx=0).stop 2024-09-19T04:34:37.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- 172.21.15.70:0/3876466266 shutdown_connections 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3876466266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3eba90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3876466266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3cab40 0x55c52e3e0310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 --2- 172.21.15.70:0/3876466266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3c95d0 0x55c52e3c5df0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- 172.21.15.70:0/3876466266 >> 172.21.15.70:0/3876466266 conn(0x55c52e392310 msgr2=0x55c52e3c56e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- 172.21.15.70:0/3876466266 shutdown_connections 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- 172.21.15.70:0/3876466266 wait complete. 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- start start 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 Processor -- start 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3c95d0 0x55c52e3dc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3cab40 0x55c52e3dccc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3cd9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41abe30 con 0x55c52e3cab40 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41ad2a0 con 0x55c52e3d4370 2024-09-19T04:34:37.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f30d41ac500 con 0x55c52e3c95d0 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.621+0000 7f30db3e4740 10 client.0 _ll_register_callbacks cb 0x7f30c4009b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3cab40 0x55c52e3dccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3cab40 0x55c52e3dccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41396/0 (socket says 172.21.15.70:41396) 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 -- 172.21.15.70:0/1738221002 learned_addr learned my addr 172.21.15.70:0/1738221002 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30cbfff640 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3cd9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30cbfff640 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3c95d0 0x55c52e3dc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 -- 172.21.15.70:0/1738221002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3c95d0 msgr2=0x55c52e3dc780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3c95d0 0x55c52e3dc780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 -- 172.21.15.70:0/1738221002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 msgr2=0x55c52e3cd9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3cd9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 -- 172.21.15.70:0/1738221002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c52e3ce1e0 con 0x55c52e3cab40 2024-09-19T04:34:37.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30d2d9d640 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3cab40 0x55c52e3dccc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55c52e3d2660 tx=0x7f30c40045a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=837e11fe85a8c17d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30ba7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30ba7fc640 1 -- 172.21.15.70:0/1738221002 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f30c4003a00 con 0x55c52e3cab40 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30ba7fc640 1 -- 172.21.15.70:0/1738221002 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f30c4003ba0 con 0x55c52e3cab40 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30db3e4740 1 -- 172.21.15.70:0/1738221002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f30bc01ec20 con 0x55c52e3cab40 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30ba7fc640 1 -- 172.21.15.70:0/1738221002 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f30c4010e40 con 0x55c52e3cab40 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30db3e4740 10 client.15846 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.622+0000 7f30db3e4740 1 -- 172.21.15.70:0/1738221002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55c52e44e640 con 0x55c52e3cab40 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30ba7fc640 1 -- 172.21.15.70:0/1738221002 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f30bc01ec20 con 0x55c52e3cab40 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30ba7fc640 1 -- 172.21.15.70:0/1738221002 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f30c401e3f0 con 0x55c52e3cab40 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30db3e4740 10 client.15846 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30db3e4740 10 client.15846 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:34:37.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30db3e4740 20 client.15846 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30db3e4740 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55c52e44ee00 0x55c52e451220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30db3e4740 4 client.15846 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30db3e4740 1 -- 172.21.15.70:0/1738221002 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55c52e2b3170 con 0x55c52e44ee00 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.623+0000 7f30cbfff640 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55c52e44ee00 0x55c52e451220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30cbfff640 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55c52e44ee00 0x55c52e451220 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=bcd41b8b9f6b695a server_cookie=3e3421c9285ca3da in_seq=0 out_seq=0 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30ba7fc640 10 client.15846 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30ba7fc640 1 -- 172.21.15.70:0/1738221002 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55c52e2b3170 con 0x55c52e44ee00 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30ba7fc640 10 client.15846 handle_command_reply: tid=0 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 client.15846 shutdown 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 -- 172.21.15.70:0/1738221002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3cab40 msgr2=0x55c52e3dccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3cab40 0x55c52e3dccc0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x55c52e3d2660 tx=0x7f30c40045a0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 -- 172.21.15.70:0/1738221002 shutdown_connections 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55c52e44ee00 0x55c52e451220 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c52e3d4370 0x55c52e3cd9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c52e3cab40 0x55c52e3dccc0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 --2- 172.21.15.70:0/1738221002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c52e3c95d0 0x55c52e3dc780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 -- 172.21.15.70:0/1738221002 >> 172.21.15.70:0/1738221002 conn(0x55c52e392310 msgr2=0x55c52e3d2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30ba7fc640 0 client.15846 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 -- 172.21.15.70:0/1738221002 shutdown_connections 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 1 -- 172.21.15.70:0/1738221002 wait complete. 2024-09-19T04:34:37.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.624+0000 7f30db3e4740 20 client.15846 trim_cache size 0 max 16384 2024-09-19T04:34:37.637 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 -- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30c00a33b0 msgr2=0x7f30c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30c00a33b0 0x7f30c00a5870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f30cc0b97e0 tx=0x7f30cc08f100 comp rx=0 tx=0).stop 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 -- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 msgr2=0x7f30d419cef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 0x7f30d419cef0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f30cc009430 tx=0x7f30cc003ce0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 -- 172.21.15.70:0/3056922408 shutdown_connections 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30c00a33b0 0x7f30c00a5870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f30d4106050 0x7f30d419cef0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f30d4101df0 0x7f30d4198b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 --2- 172.21.15.70:0/3056922408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30d4101440 0x7f30d4198620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:37.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 -- 172.21.15.70:0/3056922408 >> 172.21.15.70:0/3056922408 conn(0x7f30d4077210 msgr2=0x7f30d41004b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:37.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 -- 172.21.15.70:0/3056922408 shutdown_connections 2024-09-19T04:34:37.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:37.625+0000 7f30d900b640 1 -- 172.21.15.70:0/3056922408 wait complete. 2024-09-19T04:34:38.355 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:34:38.605 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:34:38.924 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:38 smithi070 ceph-mon[30942]: pgmap v119: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 9 op/s 2024-09-19T04:34:38.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:38 smithi167 ceph-mon[34339]: pgmap v119: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 9 op/s 2024-09-19T04:34:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:38 smithi134 ceph-mon[34525]: pgmap v119: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 10 KiB/s rd, 7.1 KiB/s wr, 9 op/s 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 -- 172.21.15.70:0/2096477943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102ef0 msgr2=0x7fe54c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2096477943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102ef0 0x7fe54c10da40 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7fe53c009900 tx=0x7fe53c02a480 comp rx=0 tx=0).stop 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 -- 172.21.15.70:0/2096477943 shutdown_connections 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2096477943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102ef0 0x7fe54c10da40 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2096477943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe54c102570 0x7fe54c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2096477943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54c100e20 0x7fe54c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 -- 172.21.15.70:0/2096477943 >> 172.21.15.70:0/2096477943 conn(0x7fe54c0fc7d0 msgr2=0x7fe54c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 -- 172.21.15.70:0/2096477943 shutdown_connections 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 -- 172.21.15.70:0/2096477943 wait complete. 2024-09-19T04:34:39.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.135+0000 7fe5516d7640 1 Processor -- start 2024-09-19T04:34:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe5516d7640 1 -- start start 2024-09-19T04:34:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe5516d7640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe54c100e20 0x7fe54c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe5516d7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102570 0x7fe54c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe5516d7640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54c102ef0 0x7fe54c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe5516d7640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c110f90 con 0x7fe54c102570 2024-09-19T04:34:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe5516d7640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c110e10 con 0x7fe54c102ef0 2024-09-19T04:34:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe5516d7640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c111110 con 0x7fe54c100e20 2024-09-19T04:34:39.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102570 0x7fe54c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102570 0x7fe54c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41416/0 (socket says 172.21.15.70:41416) 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 -- 172.21.15.70:0/2183606472 learned_addr learned my addr 172.21.15.70:0/2183606472 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54affd640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe54c100e20 0x7fe54c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54c102ef0 0x7fe54c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 -- 172.21.15.70:0/2183606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe54c100e20 msgr2=0x7fe54c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe54c100e20 0x7fe54c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 -- 172.21.15.70:0/2183606472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54c102ef0 msgr2=0x7fe54c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54c102ef0 0x7fe54c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 -- 172.21.15.70:0/2183606472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe54c1a6ac0 con 0x7fe54c102570 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54affd640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe54c100e20 0x7fe54c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.136+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102570 0x7fe54c0fd1c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe54000ba50 tx=0x7fe54000bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:39.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.137+0000 7fe533fff640 1 -- 172.21.15.70:0/2183606472 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540019070 con 0x7fe54c102570 2024-09-19T04:34:39.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.137+0000 7fe5516d7640 1 -- 172.21.15.70:0/2183606472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe54c1a6db0 con 0x7fe54c102570 2024-09-19T04:34:39.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.137+0000 7fe533fff640 1 -- 172.21.15.70:0/2183606472 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe54000cbe0 con 0x7fe54c102570 2024-09-19T04:34:39.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.137+0000 7fe533fff640 1 -- 172.21.15.70:0/2183606472 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe540007630 con 0x7fe54c102570 2024-09-19T04:34:39.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.137+0000 7fe5516d7640 1 -- 172.21.15.70:0/2183606472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe54c1a7260 con 0x7fe54c102570 2024-09-19T04:34:39.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe533fff640 1 -- 172.21.15.70:0/2183606472 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe54001c070 con 0x7fe54c102570 2024-09-19T04:34:39.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe553ab0740 1 Processor -- start 2024-09-19T04:34:39.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe553ab0740 1 -- start start 2024-09-19T04:34:39.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 0x55ae3db42090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db42a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 0x55ae3db4f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe553ab0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ae3daa82f0 con 0x55ae3db425d0 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe553ab0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ae3da4fcf0 con 0x55ae3db43b40 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe553ab0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae3daa42b0 con 0x55ae3db4d370 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.139+0000 7fe533fff640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe5340a33b0 0x7fe5340a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db42a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41432/0 (socket says 172.21.15.70:41432) 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 -- 172.21.15.70:0/3481553351 learned_addr learned my addr 172.21.15.70:0/3481553351 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 0x55ae3db42090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe5340a33b0 0x7fe5340a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe533fff640 1 -- 172.21.15.70:0/2183606472 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fe5400cf2e0 con 0x7fe54c102570 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 0x55ae3db4f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 -- 172.21.15.70:0/3481553351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 msgr2=0x55ae3db4f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 0x55ae3db4f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 -- 172.21.15.70:0/3481553351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 msgr2=0x55ae3db42090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 0x55ae3db42090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 -- 172.21.15.70:0/3481553351 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3da343a0 con 0x55ae3db425d0 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 0x55ae3db4f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54affd640 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db42a10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe54400bd40 tx=0x7fe54400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f711accff68e33b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe5340a33b0 0x7fe5340a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe53c031440 tx=0x7fe53c009260 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe5317fa640 1 -- 172.21.15.70:0/3481553351 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544015070 con 0x55ae3db425d0 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe5317fa640 1 -- 172.21.15.70:0/3481553351 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe54400be30 con 0x55ae3db425d0 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.140+0000 7fe5317fa640 1 -- 172.21.15.70:0/3481553351 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544011970 con 0x55ae3db425d0 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 -- 172.21.15.70:0/3481553351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 msgr2=0x55ae3db42a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db42a10 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7fe54400bd40 tx=0x7fe54400f730 comp rx=0 tx=0).stop 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 -- 172.21.15.70:0/3481553351 shutdown_connections 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 0x55ae3db4f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db42a10 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3481553351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 0x55ae3db42090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 -- 172.21.15.70:0/3481553351 >> 172.21.15.70:0/3481553351 conn(0x55ae3db0b310 msgr2=0x55ae3db3ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 -- 172.21.15.70:0/3481553351 shutdown_connections 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 -- 172.21.15.70:0/3481553351 wait complete. 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 -- start start 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.141+0000 7fe553ab0740 1 Processor -- start 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db425d0 0x55ae3db4cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db43b40 0x55ae3db4a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db4d370 0x55ae3db4a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe553ab0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ae3db50070 con 0x55ae3db43b40 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe553ab0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ae3da63060 con 0x55ae3db4d370 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe553ab0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae3db501f0 con 0x55ae3db425d0 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe553ab0740 10 client.0 _ll_register_callbacks cb 0x55ae3d7b68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:39.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db43b40 0x55ae3db4a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db43b40 0x55ae3db4a020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41434/0 (socket says 172.21.15.70:41434) 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 -- 172.21.15.70:0/3074911954 learned_addr learned my addr 172.21.15.70:0/3074911954 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54affd640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db425d0 0x55ae3db4cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db4d370 0x55ae3db4a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 -- 172.21.15.70:0/3074911954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db425d0 msgr2=0x55ae3db4cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db425d0 0x55ae3db4cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 -- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db4d370 msgr2=0x55ae3db4a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db4d370 0x55ae3db4a610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 -- 172.21.15.70:0/3074911954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3d8193c0 con 0x55ae3db43b40 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54affd640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db425d0 0x55ae3db4cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db4d370 0x55ae3db4a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db43b40 0x55ae3db4a020 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe54009b3f0 tx=0x7fe54009b110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24686809f36bd989 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.142+0000 7fe52eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe52eff5640 1 -- 172.21.15.70:0/3074911954 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5400b4060 con 0x55ae3db43b40 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe52eff5640 1 -- 172.21.15.70:0/3074911954 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fe5400a3ed0 con 0x55ae3db43b40 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 1 -- 172.21.15.70:0/3074911954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe54400be30 con 0x55ae3db43b40 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe52eff5640 1 -- 172.21.15.70:0/3074911954 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe54009faa0 con 0x55ae3db43b40 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 10 client.15858 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 1 -- 172.21.15.70:0/3074911954 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae3db5bab0 con 0x55ae3db43b40 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe52eff5640 1 -- 172.21.15.70:0/3074911954 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe54400be30 con 0x55ae3db43b40 2024-09-19T04:34:39.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe52eff5640 1 -- 172.21.15.70:0/3074911954 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe540097640 con 0x55ae3db43b40 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 10 client.15858 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 10 client.15858 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 20 client.15858 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ae3db5cec0 0x55ae3db5f2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 4 client.15858 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe553ab0740 1 -- 172.21.15.70:0/3074911954 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae3dab5860 con 0x55ae3db5cec0 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.143+0000 7fe54affd640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ae3db5cec0 0x55ae3db5f2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.144+0000 7fe54affd640 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ae3db5cec0 0x55ae3db5f2d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=25693d81aae5b59b server_cookie=c3ca9a7fc5a340ad in_seq=0 out_seq=0 2024-09-19T04:34:39.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.144+0000 7fe52eff5640 10 client.15858 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:34:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe52eff5640 1 -- 172.21.15.70:0/3074911954 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae3dab5860 con 0x55ae3db5cec0 2024-09-19T04:34:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe52eff5640 10 client.15858 handle_command_reply: tid=0 2024-09-19T04:34:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 client.15858 shutdown 2024-09-19T04:34:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 -- 172.21.15.70:0/3074911954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db43b40 msgr2=0x55ae3db4a020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db43b40 0x55ae3db4a020 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fe54009b3f0 tx=0x7fe54009b110 comp rx=0 tx=0).stop 2024-09-19T04:34:39.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 -- 172.21.15.70:0/3074911954 shutdown_connections 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ae3db5cec0 0x55ae3db5f2d0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db4d370 0x55ae3db4a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db43b40 0x55ae3db4a020 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 --2- 172.21.15.70:0/3074911954 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db425d0 0x55ae3db4cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 -- 172.21.15.70:0/3074911954 >> 172.21.15.70:0/3074911954 conn(0x55ae3db0b310 msgr2=0x55ae3db44930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe52eff5640 0 client.15858 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 -- 172.21.15.70:0/3074911954 shutdown_connections 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 1 -- 172.21.15.70:0/3074911954 wait complete. 2024-09-19T04:34:39.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.145+0000 7fe553ab0740 20 client.15858 trim_cache size 0 max 16384 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe553ab0740 1 Processor -- start 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe553ab0740 1 -- start start 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db425d0 0x55ae3db3ee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db43b40 0x55ae3db59340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db4d370 0x55ae3db498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe553ab0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1b23f0 con 0x55ae3db4d370 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe553ab0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1afc00 con 0x55ae3db425d0 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe553ab0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1ada70 con 0x55ae3db43b40 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db4d370 0x55ae3db498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db4d370 0x55ae3db498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41438/0 (socket says 172.21.15.70:41438) 2024-09-19T04:34:39.160 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 -- 172.21.15.70:0/836336134 learned_addr learned my addr 172.21.15.70:0/836336134 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 -- 172.21.15.70:0/836336134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db43b40 msgr2=0x55ae3db59340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54affd640 1 --2- 172.21.15.70:0/836336134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db425d0 0x55ae3db3ee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/836336134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db43b40 0x55ae3db59340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 -- 172.21.15.70:0/836336134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db425d0 msgr2=0x55ae3db3ee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/836336134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db425d0 0x55ae3db3ee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 -- 172.21.15.70:0/836336134 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae3db43760 con 0x55ae3db4d370 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe54b7fe640 1 --2- 172.21.15.70:0/836336134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db4d370 0x55ae3db498e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe53c031a00 tx=0x7fe53c040000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e2533171fe7e6ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe530ff9640 1 -- 172.21.15.70:0/836336134 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c035040 con 0x55ae3db4d370 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe530ff9640 1 -- 172.21.15.70:0/836336134 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe53c031d10 con 0x55ae3db4d370 2024-09-19T04:34:39.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.158+0000 7fe530ff9640 1 -- 172.21.15.70:0/836336134 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe53c0324b0 con 0x55ae3db4d370 2024-09-19T04:34:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 -- 172.21.15.70:0/836336134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db4d370 msgr2=0x55ae3db498e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 --2- 172.21.15.70:0/836336134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db4d370 0x55ae3db498e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fe53c031a00 tx=0x7fe53c040000 comp rx=0 tx=0).stop 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 -- 172.21.15.70:0/836336134 shutdown_connections 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 --2- 172.21.15.70:0/836336134 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db4d370 0x55ae3db498e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 --2- 172.21.15.70:0/836336134 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db43b40 0x55ae3db59340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 --2- 172.21.15.70:0/836336134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db425d0 0x55ae3db3ee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 -- 172.21.15.70:0/836336134 >> 172.21.15.70:0/836336134 conn(0x55ae3db0b310 msgr2=0x55ae3db3e700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 -- 172.21.15.70:0/836336134 shutdown_connections 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 -- 172.21.15.70:0/836336134 wait complete. 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 -- start start 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.159+0000 7fe553ab0740 1 Processor -- start 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db505d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 0x55ae3db50b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe553ab0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 0x55ae3dbc5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe553ab0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1ae0c0 con 0x55ae3db425d0 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe553ab0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1af530 con 0x55ae3db43b40 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe553ab0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe54c1ae790 con 0x55ae3db4d370 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db505d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe553ab0740 10 client.0 _ll_register_callbacks cb 0x7fe540014b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db505d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41448/0 (socket says 172.21.15.70:41448) 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 -- 172.21.15.70:0/2564032310 learned_addr learned my addr 172.21.15.70:0/2564032310 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 0x55ae3db50b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 -- 172.21.15.70:0/2564032310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 msgr2=0x55ae3dbc5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 0x55ae3dbc5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 -- 172.21.15.70:0/2564032310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 msgr2=0x55ae3db50b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 0x55ae3db50b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 -- 172.21.15.70:0/2564032310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae3dbc60a0 con 0x55ae3db425d0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe54affd640 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db505d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe54400fc30 tx=0x7fe54400bcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9af5181a366855c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe52eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe52eff5640 1 -- 172.21.15.70:0/2564032310 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe544015040 con 0x55ae3db425d0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe52eff5640 1 -- 172.21.15.70:0/2564032310 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fe544004220 con 0x55ae3db425d0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.160+0000 7fe553ab0740 1 -- 172.21.15.70:0/2564032310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe53c031d10 con 0x55ae3db425d0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe52eff5640 1 -- 172.21.15.70:0/2564032310 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fe544035050 con 0x55ae3db425d0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe553ab0740 10 client.15864 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe553ab0740 1 -- 172.21.15.70:0/2564032310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae3dbc72e0 con 0x55ae3db425d0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe52eff5640 1 -- 172.21.15.70:0/2564032310 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe53c031d10 con 0x55ae3db425d0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe52eff5640 1 -- 172.21.15.70:0/2564032310 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fe5440118b0 con 0x55ae3db425d0 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe553ab0740 10 client.15864 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe553ab0740 10 client.15864 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe553ab0740 20 client.15864 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:39.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe553ab0740 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ae3dbc7830 0x55ae3dbc9c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe553ab0740 4 client.15864 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe553ab0740 1 -- 172.21.15.70:0/2564032310 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ae3daafd70 con 0x55ae3dbc7830 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.161+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ae3dbc7830 0x55ae3dbc9c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe52eff5640 10 client.15864 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe54a7fc640 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ae3dbc7830 0x55ae3dbc9c50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=6657079c1e0f7d5 server_cookie=f366841bd13f8b0 in_seq=0 out_seq=0 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe52eff5640 1 -- 172.21.15.70:0/2564032310 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ae3daafd70 con 0x55ae3dbc7830 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe52eff5640 10 client.15864 handle_command_reply: tid=0 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 client.15864 shutdown 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 -- 172.21.15.70:0/2564032310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 msgr2=0x55ae3db505d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db505d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fe54400fc30 tx=0x7fe54400bcc0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 -- 172.21.15.70:0/2564032310 shutdown_connections 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ae3dbc7830 0x55ae3dbc9c50 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae3db4d370 0x55ae3dbc5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae3db43b40 0x55ae3db50b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 --2- 172.21.15.70:0/2564032310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae3db425d0 0x55ae3db505d0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 -- 172.21.15.70:0/2564032310 >> 172.21.15.70:0/2564032310 conn(0x55ae3db0b310 msgr2=0x55ae3db488f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe52eff5640 0 client.15864 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:34:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 -- 172.21.15.70:0/2564032310 shutdown_connections 2024-09-19T04:34:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 1 -- 172.21.15.70:0/2564032310 wait complete. 2024-09-19T04:34:39.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.162+0000 7fe553ab0740 20 client.15864 trim_cache size 0 max 16384 2024-09-19T04:34:39.169 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:34:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 -- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe5340a33b0 msgr2=0x7fe5340a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe5340a33b0 0x7fe5340a5870 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fe53c031440 tx=0x7fe53c009260 comp rx=0 tx=0).stop 2024-09-19T04:34:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 -- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102570 msgr2=0x7fe54c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102570 0x7fe54c0fd1c0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7fe54000ba50 tx=0x7fe54000bf10 comp rx=0 tx=0).stop 2024-09-19T04:34:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 -- 172.21.15.70:0/2183606472 shutdown_connections 2024-09-19T04:34:39.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe5340a33b0 0x7fe5340a5870 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe54c102ef0 0x7fe54c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe54c102570 0x7fe54c0fd1c0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 --2- 172.21.15.70:0/2183606472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe54c100e20 0x7fe54c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 -- 172.21.15.70:0/2183606472 >> 172.21.15.70:0/2183606472 conn(0x7fe54c0fc7d0 msgr2=0x7fe54c06a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 -- 172.21.15.70:0/2183606472 shutdown_connections 2024-09-19T04:34:39.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:39.163+0000 7fe5516d7640 1 -- 172.21.15.70:0/2183606472 wait complete. 2024-09-19T04:34:39.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:34:40.210 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:34:40.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 -- 172.21.15.70:0/1940238301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc100e20 msgr2=0x7f91bc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/1940238301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc100e20 0x7f91bc101200 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f91ac009ca0 tx=0x7f91ac02a950 comp rx=0 tx=0).stop 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 -- 172.21.15.70:0/1940238301 shutdown_connections 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/1940238301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc102ef0 0x7f91bc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/1940238301 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc102570 0x7f91bc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/1940238301 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc100e20 0x7f91bc101200 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 -- 172.21.15.70:0/1940238301 >> 172.21.15.70:0/1940238301 conn(0x7f91bc0fc7d0 msgr2=0x7f91bc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 -- 172.21.15.70:0/1940238301 shutdown_connections 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.678+0000 7f91c3d5d640 1 -- 172.21.15.70:0/1940238301 wait complete. 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c3d5d640 1 Processor -- start 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c3d5d640 1 -- start start 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c3d5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc100e20 0x7f91bc1993b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c3d5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc102570 0x7f91bc1998f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c3d5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc102ef0 0x7f91bc1a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c3d5d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc110f50 con 0x7f91bc102ef0 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c3d5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc110dd0 con 0x7f91bc100e20 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c3d5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc1110d0 con 0x7f91bc102570 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c22fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc102ef0 0x7f91bc1a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c22fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc102ef0 0x7f91bc1a4430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41476/0 (socket says 172.21.15.70:41476) 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.679+0000 7f91c22fa640 1 -- 172.21.15.70:0/489989255 learned_addr learned my addr 172.21.15.70:0/489989255 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c1af9640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc100e20 0x7f91bc1993b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c12f8640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc102570 0x7f91bc1998f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c22fa640 1 -- 172.21.15.70:0/489989255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc102570 msgr2=0x7f91bc1998f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c22fa640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc102570 0x7f91bc1998f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c22fa640 1 -- 172.21.15.70:0/489989255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc100e20 msgr2=0x7f91bc1993b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c22fa640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc100e20 0x7f91bc1993b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c22fa640 1 -- 172.21.15.70:0/489989255 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91bc1a4970 con 0x7f91bc102ef0 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c22fa640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc102ef0 0x7f91bc1a4430 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f91b400d750 tx=0x7f91b400dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91baffd640 1 -- 172.21.15.70:0/489989255 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b4017070 con 0x7f91bc102ef0 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91baffd640 1 -- 172.21.15.70:0/489989255 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f91b40054f0 con 0x7f91bc102ef0 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c3d5d640 1 -- 172.21.15.70:0/489989255 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91bc1a4b40 con 0x7f91bc102ef0 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91baffd640 1 -- 172.21.15.70:0/489989255 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b4004cf0 con 0x7f91bc102ef0 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.680+0000 7f91c3d5d640 1 -- 172.21.15.70:0/489989255 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91bc1a5000 con 0x7f91bc102ef0 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.682+0000 7f91baffd640 1 -- 172.21.15.70:0/489989255 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f91b4004e90 con 0x7f91bc102ef0 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c6136740 1 Processor -- start 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c6136740 1 -- start start 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c6136740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bbbb40 0x55fd21bba090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c6136740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bbaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c6136740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bc5370 0x55fd21bc7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c6136740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd21b202f0 con 0x55fd21bc5370 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c6136740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fd21ac7cf0 con 0x55fd21bbbb40 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c6136740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fd21b1c2b0 con 0x55fd21bba5d0 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91baffd640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f91a40a33b0 0x7f91a40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c12f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bc5370 0x55fd21bc7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c12f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bc5370 0x55fd21bc7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41492/0 (socket says 172.21.15.70:41492) 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c22fa640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f91a40a33b0 0x7f91a40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c12f8640 1 -- 172.21.15.70:0/4122116029 learned_addr learned my addr 172.21.15.70:0/4122116029 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91baffd640 1 -- 172.21.15.70:0/489989255 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f91b40cf5d0 con 0x7f91bc102ef0 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.683+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bbbb40 0x55fd21bba090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91c1af9640 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bbaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91c12f8640 1 -- 172.21.15.70:0/4122116029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 msgr2=0x55fd21bbaa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:40.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bbaa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91c12f8640 1 -- 172.21.15.70:0/4122116029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bbbb40 msgr2=0x55fd21bba090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bbbb40 0x55fd21bba090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91c12f8640 1 -- 172.21.15.70:0/4122116029 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd21aac3a0 con 0x55fd21bc5370 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91c22fa640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f91a40a33b0 0x7f91a40a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91b40ccdf0 tx=0x7f91b4086040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bc5370 0x55fd21bc7760 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f91b00125c0 tx=0x7f91b000b870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc6bfc4c3979cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91a3fff640 1 -- 172.21.15.70:0/4122116029 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b00106b0 con 0x55fd21bc5370 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91a3fff640 1 -- 172.21.15.70:0/4122116029 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f91b0010d20 con 0x55fd21bc5370 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.684+0000 7f91a3fff640 1 -- 172.21.15.70:0/4122116029 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91b001dcd0 con 0x55fd21bc5370 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 -- 172.21.15.70:0/4122116029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bc5370 msgr2=0x55fd21bc7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bc5370 0x55fd21bc7760 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f91b00125c0 tx=0x7f91b000b870 comp rx=0 tx=0).stop 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 -- 172.21.15.70:0/4122116029 shutdown_connections 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bc5370 0x55fd21bc7760 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bbaa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 --2- 172.21.15.70:0/4122116029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bbbb40 0x55fd21bba090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 -- 172.21.15.70:0/4122116029 >> 172.21.15.70:0/4122116029 conn(0x55fd21b83310 msgr2=0x55fd21bb6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 -- 172.21.15.70:0/4122116029 shutdown_connections 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 -- 172.21.15.70:0/4122116029 wait complete. 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 -- start start 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.685+0000 7f91c6136740 1 Processor -- start 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c6136740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bba5d0 0x55fd21bc4d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c6136740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bc1fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c6136740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bc5370 0x55fd21bc25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c6136740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fd21bc8070 con 0x55fd21bbbb40 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c6136740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fd21adb060 con 0x55fd21bba5d0 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c6136740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fd21bc81f0 con 0x55fd21bc5370 2024-09-19T04:34:40.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c6136740 10 client.0 _ll_register_callbacks cb 0x55fd2182e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bc1fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bc1fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41502/0 (socket says 172.21.15.70:41502) 2024-09-19T04:34:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 -- 172.21.15.70:0/4148256102 learned_addr learned my addr 172.21.15.70:0/4148256102 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bc5370 0x55fd21bc25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bba5d0 0x55fd21bc4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 -- 172.21.15.70:0/4148256102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bc5370 msgr2=0x55fd21bc25d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:40.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bc5370 0x55fd21bc25d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 -- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bba5d0 msgr2=0x55fd21bc4d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bba5d0 0x55fd21bc4d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 -- 172.21.15.70:0/4148256102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd218913c0 con 0x55fd21bbbb40 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bba5d0 0x55fd21bc4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91c1af9640 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bc1fe0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f91ac006010 tx=0x7f91ac009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfb918f5634a4d70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.686+0000 7f91a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91a17fa640 1 -- 172.21.15.70:0/4148256102 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac048060 con 0x55fd21bbbb40 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91a17fa640 1 -- 172.21.15.70:0/4148256102 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f91ac003970 con 0x55fd21bbbb40 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 1 -- 172.21.15.70:0/4148256102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f91b0010d20 con 0x55fd21bbbb40 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91a17fa640 1 -- 172.21.15.70:0/4148256102 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91ac034040 con 0x55fd21bbbb40 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 10 client.15876 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 1 -- 172.21.15.70:0/4148256102 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd21bd3b00 con 0x55fd21bbbb40 2024-09-19T04:34:40.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91a17fa640 1 -- 172.21.15.70:0/4148256102 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f91b0010d20 con 0x55fd21bbbb40 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91a17fa640 1 -- 172.21.15.70:0/4148256102 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f91ac030440 con 0x55fd21bbbb40 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 10 client.15876 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 10 client.15876 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 20 client.15876 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fd21bd5060 0x55fd21bd74a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 4 client.15876 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.687+0000 7f91c6136740 1 -- 172.21.15.70:0/4148256102 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fd21b2d860 con 0x55fd21bd5060 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.688+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fd21bd5060 0x55fd21bd74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.688+0000 7f91c12f8640 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fd21bd5060 0x55fd21bd74a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d4a2715e970f4a6 server_cookie=99fe2f10959175c5 in_seq=0 out_seq=0 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.688+0000 7f91a17fa640 10 client.15876 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91a17fa640 1 -- 172.21.15.70:0/4148256102 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fd21b2d860 con 0x55fd21bd5060 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91a17fa640 10 client.15876 handle_command_reply: tid=0 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 client.15876 shutdown 2024-09-19T04:34:40.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 -- 172.21.15.70:0/4148256102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 msgr2=0x55fd21bc1fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bc1fe0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f91ac006010 tx=0x7f91ac009a10 comp rx=0 tx=0).stop 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 -- 172.21.15.70:0/4148256102 shutdown_connections 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fd21bd5060 0x55fd21bd74a0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bc5370 0x55fd21bc25d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91a17fa640 0 client.15876 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bc1fe0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 --2- 172.21.15.70:0/4148256102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bba5d0 0x55fd21bc4d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 -- 172.21.15.70:0/4148256102 >> 172.21.15.70:0/4148256102 conn(0x55fd21b83310 msgr2=0x55fd21bbc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 -- 172.21.15.70:0/4148256102 shutdown_connections 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 1 -- 172.21.15.70:0/4148256102 wait complete. 2024-09-19T04:34:40.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.689+0000 7f91c6136740 20 client.15876 trim_cache size 0 max 16384 2024-09-19T04:34:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c6136740 1 Processor -- start 2024-09-19T04:34:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c6136740 1 -- start start 2024-09-19T04:34:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c6136740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bb6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c6136740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bd1340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c6136740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bc18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c6136740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc1b01f0 con 0x55fd21bbbb40 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c6136740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc1ada00 con 0x55fd21bc5370 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c6136740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc1ab870 con 0x55fd21bba5d0 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c1af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bd1340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c1af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bd1340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41514/0 (socket says 172.21.15.70:41514) 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c1af9640 1 -- 172.21.15.70:0/450940140 learned_addr learned my addr 172.21.15.70:0/450940140 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c12f8640 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bb6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c12f8640 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bc18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c1af9640 1 -- 172.21.15.70:0/450940140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 msgr2=0x55fd21bb6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c1af9640 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bb6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.702+0000 7f91c1af9640 1 -- 172.21.15.70:0/450940140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 msgr2=0x55fd21bc18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.703+0000 7f91c1af9640 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bc18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.703+0000 7f91c1af9640 1 -- 172.21.15.70:0/450940140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fd21bb7960 con 0x55fd21bbbb40 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.703+0000 7f91c1af9640 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bd1340 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f91ac030a00 tx=0x7f91ac0021d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527cc66fb19dc5f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.703+0000 7f91a37fe640 1 -- 172.21.15.70:0/450940140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac048070 con 0x55fd21bbbb40 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.703+0000 7f91a37fe640 1 -- 172.21.15.70:0/450940140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f91ac003e40 con 0x55fd21bbbb40 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.703+0000 7f91a37fe640 1 -- 172.21.15.70:0/450940140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac004420 con 0x55fd21bbbb40 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- 172.21.15.70:0/450940140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 msgr2=0x55fd21bd1340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bd1340 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f91ac030a00 tx=0x7f91ac0021d0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- 172.21.15.70:0/450940140 shutdown_connections 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bc18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bd1340 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 --2- 172.21.15.70:0/450940140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bb6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- 172.21.15.70:0/450940140 >> 172.21.15.70:0/450940140 conn(0x55fd21b83310 msgr2=0x55fd21bb6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- 172.21.15.70:0/450940140 shutdown_connections 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- 172.21.15.70:0/450940140 wait complete. 2024-09-19T04:34:40.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- start start 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 Processor -- start 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bbef00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bbf440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bbf980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc1abec0 con 0x55fd21bbbb40 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc1ad330 con 0x55fd21bc5370 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.704+0000 7f91c6136740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f91bc1ac590 con 0x55fd21bba5d0 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c6136740 10 client.0 _ll_register_callbacks cb 0x7f91ac0098d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bbf440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bbf440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41528/0 (socket says 172.21.15.70:41528) 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 -- 172.21.15.70:0/3069727806 learned_addr learned my addr 172.21.15.70:0/3069727806 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:40.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c12f8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bbef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c12f8640 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bbf980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 -- 172.21.15.70:0/3069727806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 msgr2=0x55fd21bbef00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bbef00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 -- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 msgr2=0x55fd21bbf980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bbf980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 -- 172.21.15.70:0/3069727806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fd21c3ed80 con 0x55fd21bbbb40 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c12f8640 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bbf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c1af9640 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bbf440 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f91ac030890 tx=0x7f91ac0306f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953065e6e4250e59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91a17fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91a17fa640 1 -- 172.21.15.70:0/3069727806 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f91ac048040 con 0x55fd21bbbb40 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91a17fa640 1 -- 172.21.15.70:0/3069727806 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f91ac003b70 con 0x55fd21bbbb40 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c6136740 1 -- 172.21.15.70:0/3069727806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fd21b27d70 con 0x55fd21bbbb40 2024-09-19T04:34:40.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91a17fa640 1 -- 172.21.15.70:0/3069727806 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f91ac067050 con 0x55fd21bbbb40 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.705+0000 7f91c6136740 10 client.15882 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91c6136740 1 -- 172.21.15.70:0/3069727806 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55fd21c3ff60 con 0x55fd21bbbb40 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91a17fa640 1 -- 172.21.15.70:0/3069727806 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55fd21b27d70 con 0x55fd21bbbb40 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91a17fa640 1 -- 172.21.15.70:0/3069727806 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f91ac055630 con 0x55fd21bbbb40 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91c6136740 10 client.15882 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91c6136740 10 client.15882 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91c6136740 20 client.15882 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91c6136740 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fd21c40610 0x55fd21c42a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91c6136740 4 client.15882 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91c6136740 1 -- 172.21.15.70:0/3069727806 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fd21aa4170 con 0x55fd21c40610 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.706+0000 7f91c12f8640 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fd21c40610 0x55fd21c42a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c12f8640 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fd21c40610 0x55fd21c42a30 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f2bcb2bd3a066e67 server_cookie=b9a0d3eaf4f1d1e in_seq=0 out_seq=0 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91a17fa640 10 client.15882 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:40.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91a17fa640 1 -- 172.21.15.70:0/3069727806 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fd21aa4170 con 0x55fd21c40610 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91a17fa640 10 client.15882 handle_command_reply: tid=0 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 client.15882 shutdown 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 -- 172.21.15.70:0/3069727806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 msgr2=0x55fd21bbf440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bbf440 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f91ac030890 tx=0x7f91ac0306f0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 -- 172.21.15.70:0/3069727806 shutdown_connections 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fd21c40610 0x55fd21c42a30 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fd21bc5370 0x55fd21bbf980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91a17fa640 0 client.15882 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fd21bbbb40 0x55fd21bbf440 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 --2- 172.21.15.70:0/3069727806 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fd21bba5d0 0x55fd21bbef00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 -- 172.21.15.70:0/3069727806 >> 172.21.15.70:0/3069727806 conn(0x55fd21b83310 msgr2=0x55fd21bbc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 -- 172.21.15.70:0/3069727806 shutdown_connections 2024-09-19T04:34:40.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 1 -- 172.21.15.70:0/3069727806 wait complete. 2024-09-19T04:34:40.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.707+0000 7f91c6136740 20 client.15882 trim_cache size 0 max 16384 2024-09-19T04:34:40.720 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 -- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f91a40a33b0 msgr2=0x7f91a40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f91a40a33b0 0x7f91a40a5870 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f91b40ccdf0 tx=0x7f91b4086040 comp rx=0 tx=0).stop 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 -- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc102ef0 msgr2=0x7f91bc1a4430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc102ef0 0x7f91bc1a4430 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7f91b400d750 tx=0x7f91b400dc10 comp rx=0 tx=0).stop 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 -- 172.21.15.70:0/489989255 shutdown_connections 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f91a40a33b0 0x7f91a40a5870 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f91bc102ef0 0x7f91bc1a4430 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f91bc102570 0x7f91bc1998f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 --2- 172.21.15.70:0/489989255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f91bc100e20 0x7f91bc1993b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 -- 172.21.15.70:0/489989255 >> 172.21.15.70:0/489989255 conn(0x7f91bc0fc7d0 msgr2=0x7f91bc0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 -- 172.21.15.70:0/489989255 shutdown_connections 2024-09-19T04:34:40.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:40.708+0000 7f91c3d5d640 1 -- 172.21.15.70:0/489989255 wait complete. 2024-09-19T04:34:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:40 smithi070 ceph-mon[30942]: pgmap v120: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T04:34:41.051 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:40 smithi134 ceph-mon[34525]: pgmap v120: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T04:34:41.051 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:40 smithi167 ceph-mon[34339]: pgmap v120: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-09-19T04:34:42.431 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:34:42.432 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:34:42.692 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:34:42.813 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:42 smithi070 ceph-mon[30942]: pgmap v121: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T04:34:42.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:42 smithi167 ceph-mon[34339]: pgmap v121: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T04:34:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:42 smithi134 ceph-mon[34525]: pgmap v121: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.7 KiB/s rd, 1023 B/s wr, 7 op/s 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 -- 172.21.15.70:0/2006717237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90106f10 msgr2=0x7f2b9010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/2006717237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90106f10 0x7f2b9010ea90 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f2b88009ca0 tx=0x7f2b8802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 -- 172.21.15.70:0/2006717237 shutdown_connections 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/2006717237 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90106f10 0x7f2b9010ea90 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/2006717237 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b90102790 0x7f2b901067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/2006717237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b90101de0 0x7f2b901021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 -- 172.21.15.70:0/2006717237 >> 172.21.15.70:0/2006717237 conn(0x7f2b900fd880 msgr2=0x7f2b900ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 -- 172.21.15.70:0/2006717237 shutdown_connections 2024-09-19T04:34:43.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 -- 172.21.15.70:0/2006717237 wait complete. 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 Processor -- start 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.154+0000 7f2b97c5f640 1 -- start start 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b97c5f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90101de0 0x7f2b900744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b97c5f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b90102790 0x7f2b90074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b97c5f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b90106f10 0x7f2b90074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b97c5f640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90111f80 con 0x7f2b90101de0 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b97c5f640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90111e00 con 0x7f2b90106f10 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b97c5f640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b90112100 con 0x7f2b90102790 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90101de0 0x7f2b900744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90101de0 0x7f2b900744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41550/0 (socket says 172.21.15.70:41550) 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 -- 172.21.15.70:0/275897107 learned_addr learned my addr 172.21.15.70:0/275897107 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:43.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b961fc640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b90106f10 0x7f2b90074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 -- 172.21.15.70:0/275897107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b90102790 msgr2=0x7f2b90074a30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b90102790 0x7f2b90074a30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 -- 172.21.15.70:0/275897107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b90106f10 msgr2=0x7f2b90074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b90106f10 0x7f2b90074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 -- 172.21.15.70:0/275897107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b901a68e0 con 0x7f2b90101de0 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b961fc640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b90106f10 0x7f2b90074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b959fb640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90101de0 0x7f2b900744f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00b4a0 tx=0x7f2b8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b86ffd640 1 -- 172.21.15.70:0/275897107 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c014070 con 0x7f2b90101de0 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b97c5f640 1 -- 172.21.15.70:0/275897107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b901a6bd0 con 0x7f2b90101de0 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b86ffd640 1 -- 172.21.15.70:0/275897107 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b8c010ae0 con 0x7f2b90101de0 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.155+0000 7f2b86ffd640 1 -- 172.21.15.70:0/275897107 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c017c70 con 0x7f2b90101de0 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.156+0000 7f2b97c5f640 1 -- 172.21.15.70:0/275897107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b901a7110 con 0x7f2b90101de0 2024-09-19T04:34:43.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.158+0000 7f2b86ffd640 1 -- 172.21.15.70:0/275897107 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2b8c017070 con 0x7f2b90101de0 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.158+0000 7f2b9a038740 1 Processor -- start 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.158+0000 7f2b9a038740 1 -- start start 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d74f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7f800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d82130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b9a038740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5608b8cda280 con 0x5608b8d75480 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b9a038740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5608b8c81b10 con 0x5608b8d7fd40 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b9a038740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5608b8cd6240 con 0x5608b8d74b60 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b86ffd640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b7c0a33b0 0x7f2b7c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7f800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41554/0 (socket says 172.21.15.70:41554) 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 -- 172.21.15.70:0/4178540345 learned_addr learned my addr 172.21.15.70:0/4178540345 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:43.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b951fa640 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d82130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b961fc640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b7c0a33b0 0x7f2b7c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b961fc640 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d74f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b86ffd640 1 -- 172.21.15.70:0/275897107 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2b8c0cf020 con 0x7f2b90101de0 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 -- 172.21.15.70:0/4178540345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 msgr2=0x5608b8d74f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d74f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 -- 172.21.15.70:0/4178540345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 msgr2=0x5608b8d82130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d82130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 -- 172.21.15.70:0/4178540345 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608b8c8e1f0 con 0x5608b8d75480 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b961fc640 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d74f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b951fa640 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d82130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:34:43.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b959fb640 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7f800 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0a3b70 tx=0x7f2b8c0047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6747cd7598e636a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.159+0000 7f2b961fc640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b7c0a33b0 0x7f2b7c0a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b88005e30 tx=0x7f2b88005da0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b7bfff640 1 -- 172.21.15.70:0/4178540345 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c01e070 con 0x5608b8d75480 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b7bfff640 1 -- 172.21.15.70:0/4178540345 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b8c09b430 con 0x5608b8d75480 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b7bfff640 1 -- 172.21.15.70:0/4178540345 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8c0cca10 con 0x5608b8d75480 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 -- 172.21.15.70:0/4178540345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 msgr2=0x5608b8d7f800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7f800 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c0a3b70 tx=0x7f2b8c0047d0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 -- 172.21.15.70:0/4178540345 shutdown_connections 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d82130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7f800 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 --2- 172.21.15.70:0/4178540345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d74f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 -- 172.21.15.70:0/4178540345 >> 172.21.15.70:0/4178540345 conn(0x5608b8d710f0 msgr2=0x5608b8d714d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 -- 172.21.15.70:0/4178540345 shutdown_connections 2024-09-19T04:34:43.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.160+0000 7f2b9a038740 1 -- 172.21.15.70:0/4178540345 wait complete. 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 1 -- start start 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 1 Processor -- start 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d7cc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d7d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5608b8d82910 con 0x5608b8d75480 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5608b8c94f10 con 0x5608b8d7fd40 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5608b8d82a90 con 0x5608b8d74b60 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b9a038740 10 client.0 _ll_register_callbacks cb 0x5608b8c5da40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:43.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b951fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b951fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41568/0 (socket says 172.21.15.70:41568) 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b951fa640 1 -- 172.21.15.70:0/1382609507 learned_addr learned my addr 172.21.15.70:0/1382609507 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.161+0000 7f2b959fb640 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d7cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b961fc640 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d7d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b951fa640 1 -- 172.21.15.70:0/1382609507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 msgr2=0x5608b8d7cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b951fa640 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d7cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b951fa640 1 -- 172.21.15.70:0/1382609507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 msgr2=0x5608b8d7d6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b951fa640 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d7d6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b951fa640 1 -- 172.21.15.70:0/1382609507 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608b8a4b6a0 con 0x5608b8d75480 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b951fa640 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7d190 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000f670 tx=0x7f2b8000fb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=675be38165fcba33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b797fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:43.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b797fa640 1 -- 172.21.15.70:0/1382609507 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b80004220 con 0x5608b8d75480 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b797fa640 1 -- 172.21.15.70:0/1382609507 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2b800043c0 con 0x5608b8d75480 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b9a038740 1 -- 172.21.15.70:0/1382609507 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b8c09b430 con 0x5608b8d75480 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b797fa640 1 -- 172.21.15.70:0/1382609507 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b8000d8a0 con 0x5608b8d75480 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b9a038740 10 client.15894 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b9a038740 1 -- 172.21.15.70:0/1382609507 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5608b8d8e5d0 con 0x5608b8d75480 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b797fa640 1 -- 172.21.15.70:0/1382609507 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b8c09b430 con 0x5608b8d75480 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b797fa640 1 -- 172.21.15.70:0/1382609507 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2b8001f030 con 0x5608b8d75480 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b9a038740 10 client.15894 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.162+0000 7f2b9a038740 10 client.15894 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.163+0000 7f2b9a038740 20 client.15894 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:43.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.163+0000 7f2b9a038740 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5608b8d8fb50 0x5608b8d91f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.163+0000 7f2b9a038740 4 client.15894 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:34:43.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.163+0000 7f2b9a038740 1 -- 172.21.15.70:0/1382609507 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5608b8ce77f0 con 0x5608b8d8fb50 2024-09-19T04:34:43.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.163+0000 7f2b959fb640 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5608b8d8fb50 0x5608b8d91f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.163+0000 7f2b959fb640 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5608b8d8fb50 0x5608b8d91f40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78bbd8ee86508487 server_cookie=7748be3c3461b597 in_seq=0 out_seq=0 2024-09-19T04:34:43.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.163+0000 7f2b797fa640 10 client.15894 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:43.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b797fa640 1 -- 172.21.15.70:0/1382609507 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5608b8ce77f0 con 0x5608b8d8fb50 2024-09-19T04:34:43.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b797fa640 10 client.15894 handle_command_reply: tid=0 2024-09-19T04:34:43.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 client.15894 shutdown 2024-09-19T04:34:43.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 -- 172.21.15.70:0/1382609507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 msgr2=0x5608b8d7d190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:43.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7d190 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f2b8000f670 tx=0x7f2b8000fb30 comp rx=0 tx=0).stop 2024-09-19T04:34:43.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 -- 172.21.15.70:0/1382609507 shutdown_connections 2024-09-19T04:34:43.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5608b8d8fb50 0x5608b8d91f40 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d7d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d7d190 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b797fa640 0 client.15894 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 --2- 172.21.15.70:0/1382609507 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d7cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.164+0000 7f2b9a038740 1 -- 172.21.15.70:0/1382609507 >> 172.21.15.70:0/1382609507 conn(0x5608b8d710f0 msgr2=0x5608b8d76dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.165+0000 7f2b9a038740 1 -- 172.21.15.70:0/1382609507 shutdown_connections 2024-09-19T04:34:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.165+0000 7f2b9a038740 1 -- 172.21.15.70:0/1382609507 wait complete. 2024-09-19T04:34:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.165+0000 7f2b9a038740 20 client.15894 trim_cache size 0 max 16384 2024-09-19T04:34:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.181+0000 7f2b9a038740 1 Processor -- start 2024-09-19T04:34:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b9a038740 1 -- start start 2024-09-19T04:34:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d7d520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d97830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d97d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b9a038740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901b23f0 con 0x5608b8d75480 2024-09-19T04:34:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b9a038740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901afc00 con 0x5608b8d7fd40 2024-09-19T04:34:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b9a038740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901ada50 con 0x5608b8d74b60 2024-09-19T04:34:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d97830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d97830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41578/0 (socket says 172.21.15.70:41578) 2024-09-19T04:34:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 -- 172.21.15.70:0/2638450893 learned_addr learned my addr 172.21.15.70:0/2638450893 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b959fb640 1 --2- 172.21.15.70:0/2638450893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d7d520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 -- 172.21.15.70:0/2638450893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 msgr2=0x5608b8d7d520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:43.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 --2- 172.21.15.70:0/2638450893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d7d520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 -- 172.21.15.70:0/2638450893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 msgr2=0x5608b8d97d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:43.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 --2- 172.21.15.70:0/2638450893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d97d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 -- 172.21.15.70:0/2638450893 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5608b8d922b0 con 0x5608b8d75480 2024-09-19T04:34:43.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b951fa640 1 --2- 172.21.15.70:0/2638450893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d97830 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2b80001eb0 tx=0x7f2b8000ffb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35d5d6dbfcc4f41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:43.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.182+0000 7f2b7b7fe640 1 -- 172.21.15.70:0/2638450893 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b8000adf0 con 0x5608b8d75480 2024-09-19T04:34:43.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b7b7fe640 1 -- 172.21.15.70:0/2638450893 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b80005510 con 0x5608b8d75480 2024-09-19T04:34:43.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b7b7fe640 1 -- 172.21.15.70:0/2638450893 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b800047a0 con 0x5608b8d75480 2024-09-19T04:34:43.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 -- 172.21.15.70:0/2638450893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 msgr2=0x5608b8d97830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 --2- 172.21.15.70:0/2638450893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d97830 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2b80001eb0 tx=0x7f2b8000ffb0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 -- 172.21.15.70:0/2638450893 shutdown_connections 2024-09-19T04:34:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 --2- 172.21.15.70:0/2638450893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d7fd40 0x5608b8d97d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 --2- 172.21.15.70:0/2638450893 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d75480 0x5608b8d97830 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 --2- 172.21.15.70:0/2638450893 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d7d520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 -- 172.21.15.70:0/2638450893 >> 172.21.15.70:0/2638450893 conn(0x5608b8d710f0 msgr2=0x5608b8d76dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 -- 172.21.15.70:0/2638450893 shutdown_connections 2024-09-19T04:34:43.191 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 -- 172.21.15.70:0/2638450893 wait complete. 2024-09-19T04:34:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.183+0000 7f2b9a038740 1 -- start start 2024-09-19T04:34:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b9a038740 1 Processor -- start 2024-09-19T04:34:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d83d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d75480 0x5608b8d842b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b9a038740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d7fd40 0x5608b8d84830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b9a038740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901ae0c0 con 0x5608b8d7fd40 2024-09-19T04:34:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b9a038740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901af530 con 0x5608b8d75480 2024-09-19T04:34:43.192 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b9a038740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b901ae790 con 0x5608b8d74b60 2024-09-19T04:34:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b9a038740 10 client.0 _ll_register_callbacks cb 0x7f2b8000a4a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b961fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d7fd40 0x5608b8d84830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b961fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d7fd40 0x5608b8d84830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41582/0 (socket says 172.21.15.70:41582) 2024-09-19T04:34:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b961fc640 1 -- 172.21.15.70:0/246267994 learned_addr learned my addr 172.21.15.70:0/246267994 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b959fb640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d83d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b951fa640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d75480 0x5608b8d842b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.193 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b961fc640 1 -- 172.21.15.70:0/246267994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 msgr2=0x5608b8d83d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b961fc640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d83d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b961fc640 1 -- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d75480 msgr2=0x5608b8d842b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b961fc640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d75480 0x5608b8d842b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b961fc640 1 -- 172.21.15.70:0/246267994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5608b8df9af0 con 0x5608b8d7fd40 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b951fa640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d75480 0x5608b8d842b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.184+0000 7f2b959fb640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d83d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b961fc640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d7fd40 0x5608b8d84830 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2b88003cc0 tx=0x7f2b88009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ac7e9e28a78e018 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b797fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:43.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b797fa640 1 -- 172.21.15.70:0/246267994 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b88004240 con 0x5608b8d7fd40 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b797fa640 1 -- 172.21.15.70:0/246267994 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2b880043e0 con 0x5608b8d7fd40 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 1 -- 172.21.15.70:0/246267994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b80005510 con 0x5608b8d7fd40 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b797fa640 1 -- 172.21.15.70:0/246267994 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2b88004620 con 0x5608b8d7fd40 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 10 client.15900 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 1 -- 172.21.15.70:0/246267994 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5608b8dfae30 con 0x5608b8d7fd40 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b797fa640 1 -- 172.21.15.70:0/246267994 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b80005510 con 0x5608b8d7fd40 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b797fa640 1 -- 172.21.15.70:0/246267994 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2b8805b050 con 0x5608b8d7fd40 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 10 client.15900 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 10 client.15900 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 20 client.15900 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5608b8dfb580 0x5608b8dfd9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 4 client.15900 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:34:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.185+0000 7f2b9a038740 1 -- 172.21.15.70:0/246267994 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5608b8ce1d00 con 0x5608b8dfb580 2024-09-19T04:34:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.186+0000 7f2b959fb640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5608b8dfb580 0x5608b8dfd9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.186+0000 7f2b959fb640 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5608b8dfb580 0x5608b8dfd9a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc7df290af8bc393 server_cookie=75a651279d9c6cd7 in_seq=0 out_seq=0 2024-09-19T04:34:43.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.186+0000 7f2b797fa640 10 client.15900 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b797fa640 1 -- 172.21.15.70:0/246267994 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5608b8ce1d00 con 0x5608b8dfb580 2024-09-19T04:34:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b797fa640 10 client.15900 handle_command_reply: tid=0 2024-09-19T04:34:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 client.15900 shutdown 2024-09-19T04:34:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 -- 172.21.15.70:0/246267994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d7fd40 msgr2=0x5608b8d84830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d7fd40 0x5608b8d84830 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2b88003cc0 tx=0x7f2b88009800 comp rx=0 tx=0).stop 2024-09-19T04:34:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 -- 172.21.15.70:0/246267994 shutdown_connections 2024-09-19T04:34:43.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5608b8dfb580 0x5608b8dfd9a0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5608b8d7fd40 0x5608b8d84830 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5608b8d75480 0x5608b8d842b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b797fa640 0 client.15900 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 --2- 172.21.15.70:0/246267994 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5608b8d74b60 0x5608b8d83d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 -- 172.21.15.70:0/246267994 >> 172.21.15.70:0/246267994 conn(0x5608b8d710f0 msgr2=0x5608b8d6fa50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 -- 172.21.15.70:0/246267994 shutdown_connections 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 1 -- 172.21.15.70:0/246267994 wait complete. 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.187+0000 7f2b9a038740 20 client.15900 trim_cache size 0 max 16384 2024-09-19T04:34:43.198 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:34:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:34:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "bc76a151-e73a-47ed-9a4a-f2adb395ebc8", 2024-09-19T04:34:43.199 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:34:43.199 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 -- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b7c0a33b0 msgr2=0x7f2b7c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b7c0a33b0 0x7f2b7c0a5870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f2b88005e30 tx=0x7f2b88005da0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 -- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90101de0 msgr2=0x7f2b900744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90101de0 0x7f2b900744f0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2b8c00b4a0 tx=0x7f2b8c00b960 comp rx=0 tx=0).stop 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 -- 172.21.15.70:0/275897107 shutdown_connections 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b7c0a33b0 0x7f2b7c0a5870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b90106f10 0x7f2b90074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b90102790 0x7f2b90074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 --2- 172.21.15.70:0/275897107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b90101de0 0x7f2b900744f0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 -- 172.21.15.70:0/275897107 >> 172.21.15.70:0/275897107 conn(0x7f2b900fd880 msgr2=0x7f2b900feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 -- 172.21.15.70:0/275897107 shutdown_connections 2024-09-19T04:34:43.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:43.188+0000 7f2b97c5f640 1 -- 172.21.15.70:0/275897107 wait complete. 2024-09-19T04:34:43.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:43 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:34:43.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:43 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:43.917 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:43 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:34:43.918 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:43 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:43.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:34:43.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:43 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:34:43.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:43 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:43.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:43 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:34:43.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:43 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:43 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:34:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:43 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:43 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:34:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:43 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:34:44.191 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:34:44.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 -- 172.21.15.70:0/2272226735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88101de0 msgr2=0x7fda881021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 --2- 172.21.15.70:0/2272226735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88101de0 0x7fda881021c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fda78009900 tx=0x7fda7802a410 comp rx=0 tx=0).stop 2024-09-19T04:34:44.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 -- 172.21.15.70:0/2272226735 shutdown_connections 2024-09-19T04:34:44.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 --2- 172.21.15.70:0/2272226735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda88106f10 0x7fda8810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 --2- 172.21.15.70:0/2272226735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda88102790 0x7fda881067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 --2- 172.21.15.70:0/2272226735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88101de0 0x7fda881021c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 -- 172.21.15.70:0/2272226735 >> 172.21.15.70:0/2272226735 conn(0x7fda880fd8c0 msgr2=0x7fda880ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 -- 172.21.15.70:0/2272226735 shutdown_connections 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.634+0000 7fda8e706640 1 -- 172.21.15.70:0/2272226735 wait complete. 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8e706640 1 Processor -- start 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8e706640 1 -- start start 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8e706640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda88101de0 0x7fda881984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8e706640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda88102790 0x7fda88198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8e706640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88106f10 0x7fda8819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8e706640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda88111f80 con 0x7fda88106f10 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8e706640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda88111e00 con 0x7fda88101de0 2024-09-19T04:34:44.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8e706640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda88112100 con 0x7fda88102790 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8cca3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88106f10 0x7fda8819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8cca3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88106f10 0x7fda8819cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33736/0 (socket says 172.21.15.70:33736) 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda8cca3640 1 -- 172.21.15.70:0/393890792 learned_addr learned my addr 172.21.15.70:0/393890792 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.635+0000 7fda87fff640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda88101de0 0x7fda881984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda877fe640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda88102790 0x7fda88198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda8cca3640 1 -- 172.21.15.70:0/393890792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda88102790 msgr2=0x7fda88198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda8cca3640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda88102790 0x7fda88198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda8cca3640 1 -- 172.21.15.70:0/393890792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda88101de0 msgr2=0x7fda881984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda8cca3640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda88101de0 0x7fda881984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda8cca3640 1 -- 172.21.15.70:0/393890792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda8819d470 con 0x7fda88106f10 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda8cca3640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88106f10 0x7fda8819cd90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fda8000eaa0 tx=0x7fda8000eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:44.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda857fa640 1 -- 172.21.15.70:0/393890792 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda80004d20 con 0x7fda88106f10 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda857fa640 1 -- 172.21.15.70:0/393890792 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fda80005020 con 0x7fda88106f10 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda857fa640 1 -- 172.21.15.70:0/393890792 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda800116d0 con 0x7fda88106f10 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda8e706640 1 -- 172.21.15.70:0/393890792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda8819d760 con 0x7fda88106f10 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.636+0000 7fda8e706640 1 -- 172.21.15.70:0/393890792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda881a5040 con 0x7fda88106f10 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.638+0000 7fda857fa640 1 -- 172.21.15.70:0/393890792 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fda800051d0 con 0x7fda88106f10 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda90adf740 1 Processor -- start 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda90adf740 1 -- start start 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda90adf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dc4a0 0x5652c69dc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda90adf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dcdc0 0x5652c69e7140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda90adf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69e7680 0x5652c69e9a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda90adf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5652c69422e0 con 0x5652c69dc4a0 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda90adf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5652c68e9ce0 con 0x5652c69dcdc0 2024-09-19T04:34:44.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda90adf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5652c693e2a0 con 0x5652c69e7680 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dc4a0 0x5652c69dc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dc4a0 0x5652c69dc880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33740/0 (socket says 172.21.15.70:33740) 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda857fa640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda700a3430 0x7fda700a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.639+0000 7fda877fe640 1 -- 172.21.15.70:0/1417957140 learned_addr learned my addr 172.21.15.70:0/1417957140 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda87fff640 1 --2- 172.21.15.70:0/1417957140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dcdc0 0x5652c69e7140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda8cca3640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda700a3430 0x7fda700a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda877fe640 1 -- 172.21.15.70:0/1417957140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69e7680 msgr2=0x5652c69e9a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda877fe640 1 --2- 172.21.15.70:0/1417957140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69e7680 0x5652c69e9a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda877fe640 1 -- 172.21.15.70:0/1417957140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dcdc0 msgr2=0x5652c69e7140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda877fe640 1 --2- 172.21.15.70:0/1417957140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dcdc0 0x5652c69e7140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda857fa640 1 -- 172.21.15.70:0/393890792 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fda800cfe90 con 0x7fda88106f10 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda877fe640 1 -- 172.21.15.70:0/1417957140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c68ce440 con 0x5652c69dc4a0 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda877fe640 1 --2- 172.21.15.70:0/1417957140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dc4a0 0x5652c69dc880 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fda7c006aa0 tx=0x7fda7c009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4f79cfa04ea1515 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda8cca3640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda700a3430 0x7fda700a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda80098590 tx=0x7fda800c6f00 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda6e7fc640 1 -- 172.21.15.70:0/1417957140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c018020 con 0x5652c69dc4a0 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda6e7fc640 1 -- 172.21.15.70:0/1417957140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fda7c010dc0 con 0x5652c69dc4a0 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.640+0000 7fda6e7fc640 1 -- 172.21.15.70:0/1417957140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c0137a0 con 0x5652c69dc4a0 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 -- 172.21.15.70:0/1417957140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dc4a0 msgr2=0x5652c69dc880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 --2- 172.21.15.70:0/1417957140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dc4a0 0x5652c69dc880 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fda7c006aa0 tx=0x7fda7c009f70 comp rx=0 tx=0).stop 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 -- 172.21.15.70:0/1417957140 shutdown_connections 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 --2- 172.21.15.70:0/1417957140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69e7680 0x5652c69e9a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 --2- 172.21.15.70:0/1417957140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dcdc0 0x5652c69e7140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 --2- 172.21.15.70:0/1417957140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dc4a0 0x5652c69dc880 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 -- 172.21.15.70:0/1417957140 >> 172.21.15.70:0/1417957140 conn(0x5652c69d8a30 msgr2=0x5652c69d8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 -- 172.21.15.70:0/1417957140 shutdown_connections 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 -- 172.21.15.70:0/1417957140 wait complete. 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.641+0000 7fda90adf740 1 -- start start 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda90adf740 1 Processor -- start 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda90adf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 0x5652c69e6f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda90adf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69e41e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda90adf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 0x5652c69e4720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda90adf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5652c69ea250 con 0x5652c69dcdc0 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda90adf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5652c68fd050 con 0x5652c69e7680 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda90adf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5652c69ea3d0 con 0x5652c69dc4a0 2024-09-19T04:34:44.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda90adf740 10 client.0 _ll_register_callbacks cb 0x5652c693d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69e41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69e41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33754/0 (socket says 172.21.15.70:33754) 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 -- 172.21.15.70:0/2924082190 learned_addr learned my addr 172.21.15.70:0/2924082190 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda877fe640 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 0x5652c69e6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 -- 172.21.15.70:0/2924082190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 msgr2=0x5652c69e6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 0x5652c69e6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 -- 172.21.15.70:0/2924082190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 msgr2=0x5652c69e4720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 0x5652c69e4720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 -- 172.21.15.70:0/2924082190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c66b33c0 con 0x5652c69dcdc0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda87fff640 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69e41e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fda78009900 tx=0x7fda78031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842c71cb73165a72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.642+0000 7fda677fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda677fe640 1 -- 172.21.15.70:0/2924082190 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78035040 con 0x5652c69dcdc0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda677fe640 1 -- 172.21.15.70:0/2924082190 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fda78004040 con 0x5652c69dcdc0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 1 -- 172.21.15.70:0/2924082190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda7c010dc0 con 0x5652c69dcdc0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda677fe640 1 -- 172.21.15.70:0/2924082190 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fda78004240 con 0x5652c69dcdc0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 10 client.15912 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 1 -- 172.21.15.70:0/2924082190 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5652c69f5b70 con 0x5652c69dcdc0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda677fe640 1 -- 172.21.15.70:0/2924082190 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fda7c010dc0 con 0x5652c69dcdc0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda677fe640 1 -- 172.21.15.70:0/2924082190 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fda7804d020 con 0x5652c69dcdc0 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 10 client.15912 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:44.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 10 client.15912 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 20 client.15912 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5652c69f6fd0 0x5652c69f93c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 4 client.15912 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.643+0000 7fda90adf740 1 -- 172.21.15.70:0/2924082190 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5652c694f850 con 0x5652c69f6fd0 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.644+0000 7fda877fe640 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5652c69f6fd0 0x5652c69f93c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.644+0000 7fda877fe640 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5652c69f6fd0 0x5652c69f93c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c5ae1f693e6b2a9c server_cookie=9cb4af0341cbcdcc in_seq=0 out_seq=0 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.644+0000 7fda677fe640 10 client.15912 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda677fe640 1 -- 172.21.15.70:0/2924082190 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5652c694f850 con 0x5652c69f6fd0 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda677fe640 10 client.15912 handle_command_reply: tid=0 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 client.15912 shutdown 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 -- 172.21.15.70:0/2924082190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 msgr2=0x5652c69e41e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69e41e0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fda78009900 tx=0x7fda78031510 comp rx=0 tx=0).stop 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 -- 172.21.15.70:0/2924082190 shutdown_connections 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5652c69f6fd0 0x5652c69f93c0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 0x5652c69e4720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69e41e0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 --2- 172.21.15.70:0/2924082190 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 0x5652c69e6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda677fe640 0 client.15912 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 -- 172.21.15.70:0/2924082190 >> 172.21.15.70:0/2924082190 conn(0x5652c69d8a30 msgr2=0x5652c69de760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 -- 172.21.15.70:0/2924082190 shutdown_connections 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 1 -- 172.21.15.70:0/2924082190 wait complete. 2024-09-19T04:34:44.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.645+0000 7fda90adf740 20 client.15912 trim_cache size 0 max 16384 2024-09-19T04:34:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.662+0000 7fda90adf740 1 Processor -- start 2024-09-19T04:34:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.662+0000 7fda90adf740 1 -- start start 2024-09-19T04:34:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda90adf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dc4a0 0x5652c69f34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda90adf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dcdc0 0x5652c69fecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda90adf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69e7680 0x5652c69ff210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda90adf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda881b01e0 con 0x5652c69e7680 2024-09-19T04:34:44.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda90adf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda881ad9f0 con 0x5652c69dc4a0 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda90adf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda881ab840 con 0x5652c69dcdc0 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69e7680 0x5652c69ff210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69e7680 0x5652c69ff210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33756/0 (socket says 172.21.15.70:33756) 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 -- 172.21.15.70:0/2073671499 learned_addr learned my addr 172.21.15.70:0/2073671499 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dc4a0 0x5652c69f34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda87fff640 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dcdc0 0x5652c69fecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 -- 172.21.15.70:0/2073671499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dcdc0 msgr2=0x5652c69fecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dcdc0 0x5652c69fecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 -- 172.21.15.70:0/2073671499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dc4a0 msgr2=0x5652c69f34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dc4a0 0x5652c69f34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 -- 172.21.15.70:0/2073671499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5652c69e2730 con 0x5652c69e7680 2024-09-19T04:34:44.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.663+0000 7fda877fe640 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69e7680 0x5652c69ff210 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fda7c013410 tx=0x7fda7c0133a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4409fa73c60ccc46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.665+0000 7fda6dffb640 1 -- 172.21.15.70:0/2073671499 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c028040 con 0x5652c69e7680 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.665+0000 7fda6dffb640 1 -- 172.21.15.70:0/2073671499 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fda7c014b10 con 0x5652c69e7680 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.665+0000 7fda6dffb640 1 -- 172.21.15.70:0/2073671499 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda7c018040 con 0x5652c69e7680 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 -- 172.21.15.70:0/2073671499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69e7680 msgr2=0x5652c69ff210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69e7680 0x5652c69ff210 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fda7c013410 tx=0x7fda7c0133a0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 -- 172.21.15.70:0/2073671499 shutdown_connections 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69e7680 0x5652c69ff210 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dcdc0 0x5652c69fecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 --2- 172.21.15.70:0/2073671499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69dc4a0 0x5652c69f34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 -- 172.21.15.70:0/2073671499 >> 172.21.15.70:0/2073671499 conn(0x5652c69d8a30 msgr2=0x5652c69e32d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 -- 172.21.15.70:0/2073671499 shutdown_connections 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.666+0000 7fda90adf740 1 -- 172.21.15.70:0/2073671499 wait complete. 2024-09-19T04:34:44.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 1 -- start start 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 1 Processor -- start 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 0x5652c69efae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69eae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 0x5652c69eb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda881abeb0 con 0x5652c69dcdc0 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda881ad320 con 0x5652c69e7680 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda881ac580 con 0x5652c69dc4a0 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda90adf740 10 client.0 _ll_register_callbacks cb 0x7fda78005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda87fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69eae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda87fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69eae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:33758/0 (socket says 172.21.15.70:33758) 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda87fff640 1 -- 172.21.15.70:0/1706117124 learned_addr learned my addr 172.21.15.70:0/1706117124 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:34:44.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.667+0000 7fda877fe640 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 0x5652c69eb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda877fe640 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 0x5652c69efae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda87fff640 1 -- 172.21.15.70:0/1706117124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 msgr2=0x5652c69efae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda87fff640 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 0x5652c69efae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda87fff640 1 -- 172.21.15.70:0/1706117124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 msgr2=0x5652c69eb3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda87fff640 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 0x5652c69eb3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda87fff640 1 -- 172.21.15.70:0/1706117124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5652c69eb910 con 0x5652c69dcdc0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda87fff640 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69eae60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fda78004a40 tx=0x7fda78001e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abccc3ccf1653dac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda677fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda677fe640 1 -- 172.21.15.70:0/1706117124 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda78035040 con 0x5652c69dcdc0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda677fe640 1 -- 172.21.15.70:0/1706117124 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fda780038c0 con 0x5652c69dcdc0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda90adf740 1 -- 172.21.15.70:0/1706117124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda7c014b10 con 0x5652c69dcdc0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda677fe640 1 -- 172.21.15.70:0/1706117124 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fda78031ad0 con 0x5652c69dcdc0 2024-09-19T04:34:44.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda90adf740 10 client.15918 fetch_fsmap learned FSMap version 28 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.668+0000 7fda90adf740 1 -- 172.21.15.70:0/1706117124 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5652c6a61a40 con 0x5652c69dcdc0 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda677fe640 1 -- 172.21.15.70:0/1706117124 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fda7c014b10 con 0x5652c69dcdc0 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda677fe640 1 -- 172.21.15.70:0/1706117124 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fda7804d070 con 0x5652c69dcdc0 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda90adf740 10 client.15918 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda90adf740 10 client.15918 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda90adf740 20 client.15918 populate_metadata read hostname 'smithi070' 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda90adf740 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5652c6a62220 0x5652c6a64640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda90adf740 4 client.15918 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda90adf740 1 -- 172.21.15.70:0/1706117124 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5652c6949d60 con 0x5652c6a62220 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.669+0000 7fda877fe640 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5652c6a62220 0x5652c6a64640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda677fe640 10 client.15918 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda877fe640 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5652c6a62220 0x5652c6a64640 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f0534e71993c89f5 server_cookie=2f2a72225aad5927 in_seq=0 out_seq=0 2024-09-19T04:34:44.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda677fe640 1 -- 172.21.15.70:0/1706117124 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x5652c6949d60 con 0x5652c6a62220 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda677fe640 10 client.15918 handle_command_reply: tid=0 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 client.15918 shutdown 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 -- 172.21.15.70:0/1706117124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 msgr2=0x5652c69eae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69eae60 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fda78004a40 tx=0x7fda78001e50 comp rx=0 tx=0).stop 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 -- 172.21.15.70:0/1706117124 shutdown_connections 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5652c6a62220 0x5652c6a64640 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5652c69e7680 0x5652c69eb3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5652c69dcdc0 0x5652c69eae60 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda677fe640 0 client.15918 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 --2- 172.21.15.70:0/1706117124 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5652c69dc4a0 0x5652c69efae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 -- 172.21.15.70:0/1706117124 >> 172.21.15.70:0/1706117124 conn(0x5652c69d8a30 msgr2=0x5652c69e5a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 -- 172.21.15.70:0/1706117124 shutdown_connections 2024-09-19T04:34:44.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 1 -- 172.21.15.70:0/1706117124 wait complete. 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.670+0000 7fda90adf740 20 client.15918 trim_cache size 0 max 16384 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "bc76a151-e73a-47ed-9a4a-f2adb395ebc8": { 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "bc76a151-e73a-47ed-9a4a-f2adb395ebc8", 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:34:44.686 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:34:44.687 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:34:44.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 -- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda700a3430 msgr2=0x7fda700a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda700a3430 0x7fda700a58f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fda80098590 tx=0x7fda800c6f00 comp rx=0 tx=0).stop 2024-09-19T04:34:44.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 -- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88106f10 msgr2=0x7fda8819cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:34:44.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88106f10 0x7fda8819cd90 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fda8000eaa0 tx=0x7fda8000eea0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 -- 172.21.15.70:0/393890792 shutdown_connections 2024-09-19T04:34:44.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda700a3430 0x7fda700a58f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda88106f10 0x7fda8819cd90 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda88102790 0x7fda88198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 --2- 172.21.15.70:0/393890792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda88101de0 0x7fda881984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:34:44.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 -- 172.21.15.70:0/393890792 >> 172.21.15.70:0/393890792 conn(0x7fda880fd8c0 msgr2=0x7fda880feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:34:44.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 -- 172.21.15.70:0/393890792 shutdown_connections 2024-09-19T04:34:44.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:34:44.671+0000 7fda8e706640 1 -- 172.21.15.70:0/393890792 wait complete. 2024-09-19T04:34:44.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:44 smithi070 ceph-mon[30942]: pgmap v122: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T04:34:44.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:44 smithi167 ceph-mon[34339]: pgmap v122: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T04:34:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:44 smithi134 ceph-mon[34525]: pgmap v122: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T04:34:45.295 INFO:tasks.cephfs.filesystem:scrub status for tag:bc76a151-e73a-47ed-9a4a-f2adb395ebc8 - {'path': '/', 'tag': 'bc76a151-e73a-47ed-9a4a-f2adb395ebc8', 'options': 'recursive,force'} 2024-09-19T04:34:46.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:46 smithi167 ceph-mon[34339]: pgmap v123: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T04:34:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:46 smithi134 ceph-mon[34525]: pgmap v123: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T04:34:47.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:46 smithi070 ceph-mon[30942]: pgmap v123: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 341 B/s wr, 5 op/s 2024-09-19T04:34:47.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:47 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:34:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:47 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:34:48.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:47 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:34:48.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:48 smithi167 ceph-mon[34339]: pgmap v124: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T04:34:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:48 smithi134 ceph-mon[34525]: pgmap v124: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T04:34:49.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:48 smithi070 ceph-mon[30942]: pgmap v124: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 341 B/s wr, 7 op/s 2024-09-19T04:34:50.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:50 smithi070 ceph-mon[30942]: pgmap v125: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:50.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:50 smithi167 ceph-mon[34339]: pgmap v125: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:50 smithi134 ceph-mon[34525]: pgmap v125: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:52.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:52 smithi167 ceph-mon[34339]: pgmap v126: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:34:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:52 smithi134 ceph-mon[34525]: pgmap v126: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:34:53.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:52 smithi070 ceph-mon[30942]: pgmap v126: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:34:54.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:54 smithi167 ceph-mon[34339]: pgmap v127: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:54 smithi134 ceph-mon[34525]: pgmap v127: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:55.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:54 smithi070 ceph-mon[30942]: pgmap v127: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:56.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:56 smithi070 ceph-mon[30942]: pgmap v128: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:56.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:56 smithi167 ceph-mon[34339]: pgmap v128: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:56 smithi134 ceph-mon[34525]: pgmap v128: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:34:58.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:34:58 smithi167 ceph-mon[34339]: pgmap v129: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:34:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:34:58 smithi134 ceph-mon[34525]: pgmap v129: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:34:59.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:34:58 smithi070 ceph-mon[30942]: pgmap v129: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:00.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:00 smithi167 ceph-mon[34339]: pgmap v130: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:00 smithi134 ceph-mon[34525]: pgmap v130: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:01.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:00 smithi070 ceph-mon[30942]: pgmap v130: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:02.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:01 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:35:02.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:01 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:35:02.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:01 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:35:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:02 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:35:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:02 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:35:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:02 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:35:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:02 smithi134 ceph-mon[34525]: pgmap v131: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:02 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:35:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:02 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:35:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:02 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:35:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:02 smithi070 ceph-mon[30942]: pgmap v131: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:03.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:02 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:35:03.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:02 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:35:03.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:02 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:35:03.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:02 smithi167 ceph-mon[34339]: pgmap v131: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:04.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:04 smithi167 ceph-mon[34339]: pgmap v132: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:35:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:04 smithi134 ceph-mon[34525]: pgmap v132: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:35:05.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:04 smithi070 ceph-mon[30942]: pgmap v132: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:35:06.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:06 smithi167 ceph-mon[34339]: pgmap v133: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:35:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:06 smithi134 ceph-mon[34525]: pgmap v133: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:35:07.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:06 smithi070 ceph-mon[30942]: pgmap v133: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:35:08.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:08 smithi167 ceph-mon[34339]: pgmap v134: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:08 smithi134 ceph-mon[34525]: pgmap v134: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:08 smithi070 ceph-mon[30942]: pgmap v134: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:10.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:10 smithi167 ceph-mon[34339]: pgmap v135: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T04:35:11.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:10 smithi134 ceph-mon[34525]: pgmap v135: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T04:35:11.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:10 smithi070 ceph-mon[30942]: pgmap v135: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T04:35:12.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:12 smithi167 ceph-mon[34339]: pgmap v136: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:12 smithi134 ceph-mon[34525]: pgmap v136: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:13.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:12 smithi070 ceph-mon[30942]: pgmap v136: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:35:14.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:14 smithi167 ceph-mon[34339]: pgmap v137: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:35:15.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:14 smithi134 ceph-mon[34525]: pgmap v137: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:35:15.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:14 smithi070 ceph-mon[30942]: pgmap v137: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:35:15.296 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:35:15.558 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 -- 172.21.15.70:0/2839867876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720106a80 msgr2=0x7f9720106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 --2- 172.21.15.70:0/2839867876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720106a80 0x7f9720106e60 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f9710009930 tx=0x7f971002a420 comp rx=0 tx=0).stop 2024-09-19T04:35:16.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 -- 172.21.15.70:0/2839867876 shutdown_connections 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 --2- 172.21.15.70:0/2839867876 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9720101420 0x7f972010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 --2- 172.21.15.70:0/2839867876 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9720100a80 0x7f9720100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 --2- 172.21.15.70:0/2839867876 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720106a80 0x7f9720106e60 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 -- 172.21.15.70:0/2839867876 >> 172.21.15.70:0/2839867876 conn(0x7f97200fc7a0 msgr2=0x7f97200febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 -- 172.21.15.70:0/2839867876 shutdown_connections 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.006+0000 7f9726a1d640 1 -- 172.21.15.70:0/2839867876 wait complete. 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.007+0000 7f9726a1d640 1 Processor -- start 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.007+0000 7f9726a1d640 1 -- start start 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f9726a1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720100a80 0x7f9720198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f9726a1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9720101420 0x7f97201989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f9726a1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9720106a80 0x7f972019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f9726a1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9720110e50 con 0x7f9720100a80 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f9726a1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9720110cd0 con 0x7f9720106a80 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f9726a1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9720110fd0 con 0x7f9720101420 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720100a80 0x7f9720198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720100a80 0x7f9720198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56840/0 (socket says 172.21.15.70:56840) 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f9724fba640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9720106a80 0x7f972019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971ffff640 1 -- 172.21.15.70:0/1890325593 learned_addr learned my addr 172.21.15.70:0/1890325593 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971f7fe640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9720101420 0x7f97201989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971ffff640 1 -- 172.21.15.70:0/1890325593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9720101420 msgr2=0x7f97201989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971ffff640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9720101420 0x7f97201989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971ffff640 1 -- 172.21.15.70:0/1890325593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9720106a80 msgr2=0x7f972019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971ffff640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9720106a80 0x7f972019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.008+0000 7f971ffff640 1 -- 172.21.15.70:0/1890325593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f972019d440 con 0x7f9720100a80 2024-09-19T04:35:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.009+0000 7f971ffff640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720100a80 0x7f9720198490 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9710005940 tx=0x7f97100042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.009+0000 7f971d7fa640 1 -- 172.21.15.70:0/1890325593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971003f030 con 0x7f9720100a80 2024-09-19T04:35:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.009+0000 7f9726a1d640 1 -- 172.21.15.70:0/1890325593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f972019d6d0 con 0x7f9720100a80 2024-09-19T04:35:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.009+0000 7f9726a1d640 1 -- 172.21.15.70:0/1890325593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97200fcdb0 con 0x7f9720100a80 2024-09-19T04:35:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.009+0000 7f971d7fa640 1 -- 172.21.15.70:0/1890325593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9710003ac0 con 0x7f9720100a80 2024-09-19T04:35:16.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.009+0000 7f971d7fa640 1 -- 172.21.15.70:0/1890325593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9710035070 con 0x7f9720100a80 2024-09-19T04:35:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.012+0000 7f971d7fa640 1 -- 172.21.15.70:0/1890325593 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9710042030 con 0x7f9720100a80 2024-09-19T04:35:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.012+0000 7f9728df6740 1 Processor -- start 2024-09-19T04:35:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.012+0000 7f9728df6740 1 -- start start 2024-09-19T04:35:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9728df6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fe4a0 0x55cdda1fe880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9728df6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fedc0 0x55cdda209140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9728df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda20ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971d7fa640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f97080a33b0 0x7f97080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9728df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cdda1642e0 con 0x55cdda209680 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9728df6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cdda10bce0 con 0x55cdda1fedc0 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9728df6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cdda1602a0 con 0x55cdda1fe4a0 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda20ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9724fba640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f97080a33b0 0x7f97080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971ffff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fedc0 0x55cdda209140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda20ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56854/0 (socket says 172.21.15.70:56854) 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 -- 172.21.15.70:0/2847042614 learned_addr learned my addr 172.21.15.70:0/2847042614 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:16.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9724fba640 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fe4a0 0x55cdda1fe880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971d7fa640 1 -- 172.21.15.70:0/1890325593 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f97100efff0 con 0x7f9720100a80 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 -- 172.21.15.70:0/2847042614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fe4a0 msgr2=0x55cdda1fe880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fe4a0 0x55cdda1fe880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 -- 172.21.15.70:0/2847042614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fedc0 msgr2=0x55cdda209140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fedc0 0x55cdda209140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 -- 172.21.15.70:0/2847042614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdda0f0440 con 0x55cdda209680 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9724fba640 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fe4a0 0x55cdda1fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f9724fba640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f97080a33b0 0x7f97080a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9718009fd0 tx=0x7f9718009d60 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.013+0000 7f971f7fe640 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda20ba70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9714009320 tx=0x7f97140097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27440165265fc1c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f97067fc640 1 -- 172.21.15.70:0/2847042614 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971401f070 con 0x55cdda209680 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f97067fc640 1 -- 172.21.15.70:0/2847042614 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9714004230 con 0x55cdda209680 2024-09-19T04:35:16.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f97067fc640 1 -- 172.21.15.70:0/2847042614 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971401a820 con 0x55cdda209680 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 -- 172.21.15.70:0/2847042614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 msgr2=0x55cdda20ba70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda20ba70 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f9714009320 tx=0x7f97140097e0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 -- 172.21.15.70:0/2847042614 shutdown_connections 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda20ba70 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fedc0 0x55cdda209140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 --2- 172.21.15.70:0/2847042614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fe4a0 0x55cdda1fe880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 -- 172.21.15.70:0/2847042614 >> 172.21.15.70:0/2847042614 conn(0x55cdda1faa30 msgr2=0x55cdda1fae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 -- 172.21.15.70:0/2847042614 shutdown_connections 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.014+0000 7f9728df6740 1 -- 172.21.15.70:0/2847042614 wait complete. 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 1 -- start start 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 1 Processor -- start 2024-09-19T04:35:16.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda208f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fedc0 0x55cdda206220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda206760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cdda20c250 con 0x55cdda209680 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cdda11f050 con 0x55cdda1fe4a0 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cdda20c3d0 con 0x55cdda1fedc0 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9728df6740 10 client.0 _ll_register_callbacks cb 0x55cdda15f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9724fba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda206760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9724fba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda206760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56858/0 (socket says 172.21.15.70:56858) 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f9724fba640 1 -- 172.21.15.70:0/2406959128 learned_addr learned my addr 172.21.15.70:0/2406959128 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.015+0000 7f971ffff640 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda208f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f971f7fe640 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fedc0 0x55cdda206220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9724fba640 1 -- 172.21.15.70:0/2406959128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fedc0 msgr2=0x55cdda206220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:16.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9724fba640 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fedc0 0x55cdda206220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9724fba640 1 -- 172.21.15.70:0/2406959128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 msgr2=0x55cdda208f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9724fba640 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda208f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9724fba640 1 -- 172.21.15.70:0/2406959128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdd9ed53c0 con 0x55cdda209680 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9724fba640 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda206760 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9718010df0 tx=0x7f97180096a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33bc3b3fc6bb98de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f96ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f96ff7fe640 1 -- 172.21.15.70:0/2406959128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9718003e00 con 0x55cdda209680 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f96ff7fe640 1 -- 172.21.15.70:0/2406959128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f97180047c0 con 0x55cdda209680 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9728df6740 1 -- 172.21.15.70:0/2406959128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9714004230 con 0x55cdda209680 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f96ff7fe640 1 -- 172.21.15.70:0/2406959128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9718032050 con 0x55cdda209680 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9728df6740 10 client.15930 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f9728df6740 1 -- 172.21.15.70:0/2406959128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cdda217c20 con 0x55cdda209680 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f96ff7fe640 1 -- 172.21.15.70:0/2406959128 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9714004230 con 0x55cdda209680 2024-09-19T04:35:16.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.016+0000 7f96ff7fe640 1 -- 172.21.15.70:0/2406959128 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f971801f070 con 0x55cdda209680 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f9728df6740 10 client.15930 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f9728df6740 10 client.15930 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f9728df6740 20 client.15930 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f9728df6740 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cdda2191a0 0x55cdda21b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f9728df6740 4 client.15930 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f9728df6740 1 -- 172.21.15.70:0/2406959128 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdda171850 con 0x55cdda2191a0 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f971ffff640 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cdda2191a0 0x55cdda21b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f96ff7fe640 10 client.15930 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.017+0000 7f971ffff640 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cdda2191a0 0x55cdda21b5f0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=206e2522bcd80809 server_cookie=caae9e0bf15d33dc in_seq=0 out_seq=0 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f96ff7fe640 1 -- 172.21.15.70:0/2406959128 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cdda171850 con 0x55cdda2191a0 2024-09-19T04:35:16.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f96ff7fe640 10 client.15930 handle_command_reply: tid=0 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 client.15930 shutdown 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 -- 172.21.15.70:0/2406959128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 msgr2=0x55cdda206760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda206760 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f9718010df0 tx=0x7f97180096a0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 -- 172.21.15.70:0/2406959128 shutdown_connections 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cdda2191a0 0x55cdda21b5f0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda209680 0x55cdda206760 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda1fedc0 0x55cdda206220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f96ff7fe640 0 client.15930 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 --2- 172.21.15.70:0/2406959128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda208f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 -- 172.21.15.70:0/2406959128 >> 172.21.15.70:0/2406959128 conn(0x55cdda1faa30 msgr2=0x55cdda200710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 -- 172.21.15.70:0/2406959128 shutdown_connections 2024-09-19T04:35:16.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 1 -- 172.21.15.70:0/2406959128 wait complete. 2024-09-19T04:35:16.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.018+0000 7f9728df6740 20 client.15930 trim_cache size 0 max 16384 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.035+0000 7f9728df6740 1 Processor -- start 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.035+0000 7f9728df6740 1 -- start start 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.035+0000 7f9728df6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda215510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.035+0000 7f9728df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda208550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.035+0000 7f9728df6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda211680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.035+0000 7f9728df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f970c011020 con 0x55cdda1fedc0 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.035+0000 7f9728df6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f970c00e830 con 0x55cdda1fe4a0 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.035+0000 7f9728df6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f970c00c680 con 0x55cdda209680 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda208550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda208550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56866/0 (socket says 172.21.15.70:56866) 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 -- 172.21.15.70:0/4056777622 learned_addr learned my addr 172.21.15.70:0/4056777622 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:16.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f9724fba640 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda211680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971ffff640 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda215510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 -- 172.21.15.70:0/4056777622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 msgr2=0x55cdda211680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda211680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 -- 172.21.15.70:0/4056777622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 msgr2=0x55cdda215510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda215510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 -- 172.21.15.70:0/4056777622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdda1febf0 con 0x55cdda1fedc0 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f9724fba640 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda211680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f971f7fe640 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda208550 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9714009320 tx=0x7f971400f9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=386becde896910fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f9705ffb640 1 -- 172.21.15.70:0/4056777622 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9714028020 con 0x55cdda1fedc0 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f9705ffb640 1 -- 172.21.15.70:0/4056777622 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f97140035f0 con 0x55cdda1fedc0 2024-09-19T04:35:16.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.036+0000 7f9705ffb640 1 -- 172.21.15.70:0/4056777622 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971401f040 con 0x55cdda1fedc0 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 -- 172.21.15.70:0/4056777622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 msgr2=0x55cdda208550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda208550 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f9714009320 tx=0x7f971400f9c0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 -- 172.21.15.70:0/4056777622 shutdown_connections 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda211680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda208550 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 --2- 172.21.15.70:0/4056777622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda215510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 -- 172.21.15.70:0/4056777622 >> 172.21.15.70:0/4056777622 conn(0x55cdda1faa30 msgr2=0x55cdda1f9b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 -- 172.21.15.70:0/4056777622 shutdown_connections 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 -- 172.21.15.70:0/4056777622 wait complete. 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.037+0000 7f9728df6740 1 -- start start 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9728df6740 1 Processor -- start 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9728df6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda20f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9728df6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda20fa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9728df6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda20ff60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9728df6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f970c00ccf0 con 0x55cdda1fedc0 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9728df6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f970c00e160 con 0x55cdda1fe4a0 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9728df6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f970c00d3c0 con 0x55cdda209680 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9728df6740 10 client.0 _ll_register_callbacks cb 0x7f97180092a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda20fa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda20fa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56882/0 (socket says 172.21.15.70:56882) 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971f7fe640 1 -- 172.21.15.70:0/4033177769 learned_addr learned my addr 172.21.15.70:0/4033177769 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9724fba640 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda20ff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971ffff640 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda20f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971f7fe640 1 -- 172.21.15.70:0/4033177769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 msgr2=0x55cdda20ff60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971f7fe640 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda20ff60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971f7fe640 1 -- 172.21.15.70:0/4033177769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 msgr2=0x55cdda20f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971f7fe640 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda20f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f971f7fe640 1 -- 172.21.15.70:0/4033177769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdda282fe0 con 0x55cdda1fedc0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.038+0000 7f9724fba640 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda20ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f971f7fe640 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda20fa20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f97140092f0 tx=0x7f9714005570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=879f02e79275a413 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f96ff7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f96ff7fe640 1 -- 172.21.15.70:0/4033177769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f971401f070 con 0x55cdda1fedc0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f96ff7fe640 1 -- 172.21.15.70:0/4033177769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f97140039a0 con 0x55cdda1fedc0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 1 -- 172.21.15.70:0/4033177769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f97140035f0 con 0x55cdda1fedc0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f96ff7fe640 1 -- 172.21.15.70:0/4033177769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9714028040 con 0x55cdda1fedc0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 10 client.15936 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 1 -- 172.21.15.70:0/4033177769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55cdda2842b0 con 0x55cdda1fedc0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f96ff7fe640 1 -- 172.21.15.70:0/4033177769 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f97140035f0 con 0x55cdda1fedc0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f96ff7fe640 1 -- 172.21.15.70:0/4033177769 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f971403d070 con 0x55cdda1fedc0 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 10 client.15936 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:16.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 10 client.15936 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 20 client.15936 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cdda2191a0 0x55cdda286820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 4 client.15936 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.039+0000 7f9728df6740 1 -- 172.21.15.70:0/4033177769 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55cdda16bd60 con 0x55cdda2191a0 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f971ffff640 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cdda2191a0 0x55cdda286820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f971ffff640 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cdda2191a0 0x55cdda286820 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3332fa34e2c62a23 server_cookie=d784364874023803 in_seq=0 out_seq=0 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f96ff7fe640 10 client.15936 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f96ff7fe640 1 -- 172.21.15.70:0/4033177769 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55cdda16bd60 con 0x55cdda2191a0 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f96ff7fe640 10 client.15936 handle_command_reply: tid=0 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f9728df6740 1 client.15936 shutdown 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f9728df6740 1 -- 172.21.15.70:0/4033177769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 msgr2=0x55cdda20fa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f9728df6740 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda20fa20 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f97140092f0 tx=0x7f9714005570 comp rx=0 tx=0).stop 2024-09-19T04:35:16.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f9728df6740 1 -- 172.21.15.70:0/4033177769 shutdown_connections 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f9728df6740 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cdda2191a0 0x55cdda286820 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f9728df6740 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdda209680 0x55cdda20ff60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f9728df6740 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdda1fedc0 0x55cdda20fa20 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.040+0000 7f9728df6740 1 --2- 172.21.15.70:0/4033177769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdda1fe4a0 0x55cdda20f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9728df6740 1 -- 172.21.15.70:0/4033177769 >> 172.21.15.70:0/4033177769 conn(0x55cdda1faa30 msgr2=0x55cdda214500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f96ff7fe640 0 client.15936 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9728df6740 1 -- 172.21.15.70:0/4033177769 shutdown_connections 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9728df6740 1 -- 172.21.15.70:0/4033177769 wait complete. 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9728df6740 20 client.15936 trim_cache size 0 max 16384 2024-09-19T04:35:16.047 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:35:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:35:16.048 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:35:16.048 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:35:16.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 -- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f97080a33b0 msgr2=0x7f97080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f97080a33b0 0x7f97080a5870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f9718009fd0 tx=0x7f9718009d60 comp rx=0 tx=0).stop 2024-09-19T04:35:16.048 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 -- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720100a80 msgr2=0x7f9720198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720100a80 0x7f9720198490 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f9710005940 tx=0x7f97100042f0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 -- 172.21.15.70:0/1890325593 shutdown_connections 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f97080a33b0 0x7f97080a5870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9720106a80 0x7f972019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9720101420 0x7f97201989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 --2- 172.21.15.70:0/1890325593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9720100a80 0x7f9720198490 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 -- 172.21.15.70:0/1890325593 >> 172.21.15.70:0/1890325593 conn(0x7f97200fc7a0 msgr2=0x7f972006aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 -- 172.21.15.70:0/1890325593 shutdown_connections 2024-09-19T04:35:16.049 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:16.041+0000 7f9726a1d640 1 -- 172.21.15.70:0/1890325593 wait complete. 2024-09-19T04:35:16.851 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:35:16.851 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:35:16.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:16 smithi167 ceph-mon[34339]: pgmap v138: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:35:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:16 smithi134 ceph-mon[34525]: pgmap v138: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:35:17.112 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:17.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:16 smithi070 ceph-mon[30942]: pgmap v138: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:35:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3684507327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c741055b0 msgr2=0x7f2c7410d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3684507327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c741055b0 0x7f2c7410d130 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c009ca0 tx=0x7f2c6c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3684507327 shutdown_connections 2024-09-19T04:35:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3684507327 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c741055b0 0x7f2c7410d130 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3684507327 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c74100e30 0x7f2c74104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3684507327 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c74100480 0x7f2c74100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3684507327 >> 172.21.15.70:0/3684507327 conn(0x7f2c74077210 msgr2=0x7f2c740fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3684507327 shutdown_connections 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.538+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3684507327 wait complete. 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c7b1b4640 1 Processor -- start 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c7b1b4640 1 -- start start 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c7b1b4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c74100480 0x7f2c740fc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c7b1b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c74100e30 0x7f2c740fcbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c7b1b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c741055b0 0x7f2c740fd110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c7b1b4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7410fd50 con 0x7f2c74100e30 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c7b1b4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7410fbd0 con 0x7f2c74100480 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c7b1b4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2c7410fed0 con 0x7f2c741055b0 2024-09-19T04:35:17.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c74100e30 0x7f2c740fcbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c74100e30 0x7f2c740fcbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56900/0 (socket says 172.21.15.70:56900) 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.539+0000 7f2c6bfff640 1 -- 172.21.15.70:0/3465428333 learned_addr learned my addr 172.21.15.70:0/3465428333 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c78f50640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c74100480 0x7f2c740fc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c79751640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c741055b0 0x7f2c740fd110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c6bfff640 1 -- 172.21.15.70:0/3465428333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c741055b0 msgr2=0x7f2c740fd110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c6bfff640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c741055b0 0x7f2c740fd110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c6bfff640 1 -- 172.21.15.70:0/3465428333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c74100480 msgr2=0x7f2c740fc690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c6bfff640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c74100480 0x7f2c740fc690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c6bfff640 1 -- 172.21.15.70:0/3465428333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c741a6890 con 0x7f2c74100e30 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c6bfff640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c74100e30 0x7f2c740fcbd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400d950 tx=0x7f2c6400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c69ffb640 1 -- 172.21.15.70:0/3465428333 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c64017030 con 0x7f2c74100e30 2024-09-19T04:35:17.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c69ffb640 1 -- 172.21.15.70:0/3465428333 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2c64004020 con 0x7f2c74100e30 2024-09-19T04:35:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c741a6b80 con 0x7f2c74100e30 2024-09-19T04:35:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c69ffb640 1 -- 172.21.15.70:0/3465428333 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2c640047a0 con 0x7f2c74100e30 2024-09-19T04:35:17.545 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.540+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c741a7110 con 0x7f2c74100e30 2024-09-19T04:35:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.541+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c74100860 con 0x7f2c74100e30 2024-09-19T04:35:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.542+0000 7f2c69ffb640 1 -- 172.21.15.70:0/3465428333 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2c640041d0 con 0x7f2c74100e30 2024-09-19T04:35:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.543+0000 7f2c69ffb640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c5c0a3430 0x7f2c5c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.543+0000 7f2c78f50640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c5c0a3430 0x7f2c5c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.543+0000 7f2c69ffb640 1 -- 172.21.15.70:0/3465428333 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2c640cf580 con 0x7f2c74100e30 2024-09-19T04:35:17.546 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.543+0000 7f2c78f50640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c5c0a3430 0x7f2c5c0a58f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000ac40 tx=0x7f2c70010040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:17.548 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.547+0000 7f2c69ffb640 1 -- 172.21.15.70:0/3465428333 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2c6409bf80 con 0x7f2c74100e30 2024-09-19T04:35:17.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.751+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2c7410a210 con 0x7f2c74100e30 2024-09-19T04:35:17.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.752+0000 7f2c69ffb640 1 -- 172.21.15.70:0/3465428333 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7f2c6409b880 con 0x7f2c74100e30 2024-09-19T04:35:17.754 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:35:17.754 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-19T04:34:07:652724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:34:07.594198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:35:17.754 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-19T04:35:17.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c5c0a3430 msgr2=0x7f2c5c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:17.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c5c0a3430 0x7f2c5c0a58f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f2c7000ac40 tx=0x7f2c70010040 comp rx=0 tx=0).stop 2024-09-19T04:35:17.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c74100e30 msgr2=0x7f2c740fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c74100e30 0x7f2c740fcbd0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f2c6400d950 tx=0x7f2c6400de10 comp rx=0 tx=0).stop 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 shutdown_connections 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2c5c0a3430 0x7f2c5c0a58f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2c741055b0 0x7f2c740fd110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2c74100e30 0x7f2c740fcbd0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 --2- 172.21.15.70:0/3465428333 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c74100480 0x7f2c740fc690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 >> 172.21.15.70:0/3465428333 conn(0x7f2c74077210 msgr2=0x7f2c74103c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 shutdown_connections 2024-09-19T04:35:17.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:17.755+0000 7f2c7b1b4640 1 -- 172.21.15.70:0/3465428333 wait complete. 2024-09-19T04:35:18.121 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:17 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3465428333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:35:18.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:17 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3465428333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:35:18.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:17 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3465428333' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:35:18.526 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:35:18.774 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:19.082 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:18 smithi070 ceph-mon[30942]: pgmap v139: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T04:35:19.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:18 smithi167 ceph-mon[34339]: pgmap v139: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T04:35:19.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:18 smithi134 ceph-mon[34525]: pgmap v139: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 170 B/s wr, 7 op/s 2024-09-19T04:35:19.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 -- 172.21.15.70:0/3343055476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594106a80 msgr2=0x7f4594106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 --2- 172.21.15.70:0/3343055476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594106a80 0x7f4594106e60 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f4590009930 tx=0x7f459002a420 comp rx=0 tx=0).stop 2024-09-19T04:35:19.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 -- 172.21.15.70:0/3343055476 shutdown_connections 2024-09-19T04:35:19.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 --2- 172.21.15.70:0/3343055476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4594101420 0x7f459410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 --2- 172.21.15.70:0/3343055476 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4594100a80 0x7f4594100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 --2- 172.21.15.70:0/3343055476 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594106a80 0x7f4594106e60 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 -- 172.21.15.70:0/3343055476 >> 172.21.15.70:0/3343055476 conn(0x7f45940fc7a0 msgr2=0x7f45940febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 -- 172.21.15.70:0/3343055476 shutdown_connections 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 -- 172.21.15.70:0/3343055476 wait complete. 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.299+0000 7f459b50c640 1 Processor -- start 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f459b50c640 1 -- start start 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f459b50c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594100a80 0x7f45941984d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f459b50c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4594101420 0x7f4594198a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f459b50c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4594106a80 0x7f459419cda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f459b50c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4594110eb0 con 0x7f4594100a80 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f459b50c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4594110d30 con 0x7f4594101420 2024-09-19T04:35:19.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f459b50c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4594111030 con 0x7f4594106a80 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594100a80 0x7f45941984d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594100a80 0x7f45941984d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56918/0 (socket says 172.21.15.70:56918) 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 -- 172.21.15.70:0/2159086637 learned_addr learned my addr 172.21.15.70:0/2159086637 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f4598aa7640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4594101420 0x7f4594198a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4594106a80 0x7f459419cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 -- 172.21.15.70:0/2159086637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4594106a80 msgr2=0x7f459419cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4594106a80 0x7f459419cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 -- 172.21.15.70:0/2159086637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4594101420 msgr2=0x7f4594198a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4594101420 0x7f4594198a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 -- 172.21.15.70:0/2159086637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459419d480 con 0x7f4594100a80 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4594106a80 0x7f459419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.300+0000 7f45992a8640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594100a80 0x7f45941984d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4590005940 tx=0x7f45900042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:19.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.301+0000 7f45867fc640 1 -- 172.21.15.70:0/2159086637 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459003f030 con 0x7f4594100a80 2024-09-19T04:35:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.301+0000 7f45867fc640 1 -- 172.21.15.70:0/2159086637 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4590003ac0 con 0x7f4594100a80 2024-09-19T04:35:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.301+0000 7f459b50c640 1 -- 172.21.15.70:0/2159086637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459419d710 con 0x7f4594100a80 2024-09-19T04:35:19.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.301+0000 7f45867fc640 1 -- 172.21.15.70:0/2159086637 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590035070 con 0x7f4594100a80 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.301+0000 7f459b50c640 1 -- 172.21.15.70:0/2159086637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45941a5050 con 0x7f4594100a80 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.303+0000 7f45867fc640 1 -- 172.21.15.70:0/2159086637 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4590042030 con 0x7f4594100a80 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.303+0000 7f459d8e5740 1 Processor -- start 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f459d8e5740 1 -- start start 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bab6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bab6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bac1370 0x55b67bac3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f459d8e5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b67ba1c2f0 con 0x55b67bab65d0 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f459d8e5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b67b9c3cf0 con 0x55b67bab7b40 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f459d8e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b67ba182b0 con 0x55b67bac1370 2024-09-19T04:35:19.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45992a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bab6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45992a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bab6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56926/0 (socket says 172.21.15.70:56926) 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45992a8640 1 -- 172.21.15.70:0/1881971525 learned_addr learned my addr 172.21.15.70:0/1881971525 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45867fc640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45800a3430 0x7f45800a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f4599aa9640 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bab6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f4598aa7640 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bac1370 0x55b67bac3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45800a3430 0x7f45800a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45992a8640 1 -- 172.21.15.70:0/1881971525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bac1370 msgr2=0x55b67bac3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45992a8640 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bac1370 0x55b67bac3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45992a8640 1 -- 172.21.15.70:0/1881971525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 msgr2=0x55b67bab6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45992a8640 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bab6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45992a8640 1 -- 172.21.15.70:0/1881971525 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67b9a83a0 con 0x55b67bab65d0 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.304+0000 7f45867fc640 1 -- 172.21.15.70:0/2159086637 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f45900f0240 con 0x7f4594100a80 2024-09-19T04:35:19.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.305+0000 7f45992a8640 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bab6a10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f45900bc1e0 tx=0x7f459004b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adef1adca1df58d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.305+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45800a3430 0x7f45800a58f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f458c00e5d0 tx=0x7f458c008220 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.305+0000 7f457f7fe640 1 -- 172.21.15.70:0/1881971525 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459002f300 con 0x55b67bab65d0 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.305+0000 7f457f7fe640 1 -- 172.21.15.70:0/1881971525 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f45900047a0 con 0x55b67bab65d0 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.305+0000 7f457f7fe640 1 -- 172.21.15.70:0/1881971525 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4590038e70 con 0x55b67bab65d0 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 -- 172.21.15.70:0/1881971525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 msgr2=0x55b67bab6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bab6a10 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f45900bc1e0 tx=0x7f459004b000 comp rx=0 tx=0).stop 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 -- 172.21.15.70:0/1881971525 shutdown_connections 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bac1370 0x55b67bac3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bab6a10 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1881971525 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bab6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 -- 172.21.15.70:0/1881971525 >> 172.21.15.70:0/1881971525 conn(0x55b67ba7f310 msgr2=0x55b67bab2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:19.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 -- 172.21.15.70:0/1881971525 shutdown_connections 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 -- 172.21.15.70:0/1881971525 wait complete. 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 -- start start 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 Processor -- start 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bac0d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 0x55b67babe000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bac1370 0x55b67babe5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b67bac3e30 con 0x55b67bab65d0 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.306+0000 7f459d8e5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b67b9d7060 con 0x55b67bac1370 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f459d8e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b67bac3fb0 con 0x55b67bab7b40 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f459d8e5740 10 client.0 _ll_register_callbacks cb 0x55b67b72a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bac0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bac0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56928/0 (socket says 172.21.15.70:56928) 2024-09-19T04:35:19.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 -- 172.21.15.70:0/1999368530 learned_addr learned my addr 172.21.15.70:0/1999368530 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f4599aa9640 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bac1370 0x55b67babe5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f4598aa7640 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 0x55b67babe000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 -- 172.21.15.70:0/1999368530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 msgr2=0x55b67babe000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 0x55b67babe000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 -- 172.21.15.70:0/1999368530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bac1370 msgr2=0x55b67babe5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bac1370 0x55b67babe5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 -- 172.21.15.70:0/1999368530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67b78d3c0 con 0x55b67bab65d0 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f4599aa9640 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bac1370 0x55b67babe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f45992a8640 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bac0d50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f45900314b0 tx=0x7f459002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9508cac1144dc334 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f457cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f457cff9640 1 -- 172.21.15.70:0/1999368530 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45900d5060 con 0x55b67bab65d0 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f457cff9640 1 -- 172.21.15.70:0/1999368530 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f45900edbd0 con 0x55b67bab65d0 2024-09-19T04:35:19.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f459d8e5740 1 -- 172.21.15.70:0/1999368530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f45900047a0 con 0x55b67bab65d0 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f457cff9640 1 -- 172.21.15.70:0/1999368530 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f459002f300 con 0x55b67bab65d0 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f459d8e5740 10 client.15954 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.307+0000 7f459d8e5740 1 -- 172.21.15.70:0/1999368530 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b67bac3e30 con 0x55b67bab65d0 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f457cff9640 1 -- 172.21.15.70:0/1999368530 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f45900047a0 con 0x55b67bab65d0 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f457cff9640 1 -- 172.21.15.70:0/1999368530 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f459002fc50 con 0x55b67bab65d0 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f459d8e5740 10 client.15954 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f459d8e5740 10 client.15954 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f459d8e5740 20 client.15954 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b67bad0b00 0x55b67bad2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f459d8e5740 4 client.15954 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f459d8e5740 1 -- 172.21.15.70:0/1999368530 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b67ba29860 con 0x55b67bad0b00 2024-09-19T04:35:19.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.308+0000 7f4598aa7640 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b67bad0b00 0x55b67bad2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.309+0000 7f4598aa7640 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b67bad0b00 0x55b67bad2f40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1c8a2e8cf5c3faaf server_cookie=47a68e83f1140e40 in_seq=0 out_seq=0 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.309+0000 7f457cff9640 10 client.15954 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.309+0000 7f457cff9640 1 -- 172.21.15.70:0/1999368530 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b67ba29860 con 0x55b67bad0b00 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.309+0000 7f457cff9640 10 client.15954 handle_command_reply: tid=0 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.309+0000 7f459d8e5740 1 client.15954 shutdown 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.309+0000 7f459d8e5740 1 -- 172.21.15.70:0/1999368530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 msgr2=0x55b67bac0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.309+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bac0d50 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f45900314b0 tx=0x7f459002a420 comp rx=0 tx=0).stop 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 1 -- 172.21.15.70:0/1999368530 shutdown_connections 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b67bad0b00 0x55b67bad2f40 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bac1370 0x55b67babe5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 0x55b67babe000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f457cff9640 0 client.15954 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:35:19.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 1 --2- 172.21.15.70:0/1999368530 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bab65d0 0x55b67bac0d50 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 1 -- 172.21.15.70:0/1999368530 >> 172.21.15.70:0/1999368530 conn(0x55b67ba7f310 msgr2=0x55b67bab8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:19.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 1 -- 172.21.15.70:0/1999368530 shutdown_connections 2024-09-19T04:35:19.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 1 -- 172.21.15.70:0/1999368530 wait complete. 2024-09-19T04:35:19.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.310+0000 7f459d8e5740 20 client.15954 trim_cache size 0 max 16384 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.322+0000 7f459d8e5740 1 Processor -- start 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.322+0000 7f459d8e5740 1 -- start start 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab65d0 0x55b67bac9550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bac9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bab9120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f459d8e5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45941b01f0 con 0x55b67bac1370 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f459d8e5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45941ada00 con 0x55b67bab7b40 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f459d8e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45941ab850 con 0x55b67bab65d0 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bab9120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bab9120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56936/0 (socket says 172.21.15.70:56936) 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 -- 172.21.15.70:0/2081464429 learned_addr learned my addr 172.21.15.70:0/2081464429 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 -- 172.21.15.70:0/2081464429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab65d0 msgr2=0x55b67bac9550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab65d0 0x55b67bac9550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 -- 172.21.15.70:0/2081464429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 msgr2=0x55b67bac9a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4598aa7640 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bac9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bac9a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 -- 172.21.15.70:0/2081464429 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b67bad35c0 con 0x55b67bac1370 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4598aa7640 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bac9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bab9120 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f458c00f010 tx=0x7f458c0096f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=591fb5647cfe3e91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.323+0000 7f457effd640 1 -- 172.21.15.70:0/2081464429 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c009d20 con 0x55b67bac1370 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f457effd640 1 -- 172.21.15.70:0/2081464429 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f458c016070 con 0x55b67bac1370 2024-09-19T04:35:19.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f457effd640 1 -- 172.21.15.70:0/2081464429 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c01ce30 con 0x55b67bac1370 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 -- 172.21.15.70:0/2081464429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 msgr2=0x55b67bab9120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bab9120 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f458c00f010 tx=0x7f458c0096f0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 -- 172.21.15.70:0/2081464429 shutdown_connections 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bab9120 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab7b40 0x55b67bac9a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2081464429 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab65d0 0x55b67bac9550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 -- 172.21.15.70:0/2081464429 >> 172.21.15.70:0/2081464429 conn(0x55b67ba7f310 msgr2=0x55b67bac0080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 -- 172.21.15.70:0/2081464429 shutdown_connections 2024-09-19T04:35:19.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 -- 172.21.15.70:0/2081464429 wait complete. 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.324+0000 7f459d8e5740 1 -- start start 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f459d8e5740 1 Processor -- start 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab65d0 0x55b67bb339c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 0x55b67bb33f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f459d8e5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bb3e860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f459d8e5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45941abec0 con 0x55b67bac1370 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f459d8e5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45941ad330 con 0x55b67bab65d0 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f459d8e5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45941ac590 con 0x55b67bab7b40 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f459d8e5740 10 client.0 _ll_register_callbacks cb 0x7f45900bc360 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4599aa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bb3e860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4599aa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bb3e860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56944/0 (socket says 172.21.15.70:56944) 2024-09-19T04:35:19.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4599aa9640 1 -- 172.21.15.70:0/2674110850 learned_addr learned my addr 172.21.15.70:0/2674110850 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4598aa7640 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 0x55b67bb33f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f45992a8640 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab65d0 0x55b67bb339c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4599aa9640 1 -- 172.21.15.70:0/2674110850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 msgr2=0x55b67bb33f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 0x55b67bb33f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4599aa9640 1 -- 172.21.15.70:0/2674110850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab65d0 msgr2=0x55b67bb339c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab65d0 0x55b67bb339c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f4599aa9640 1 -- 172.21.15.70:0/2674110850 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b67bb3ee20 con 0x55b67bac1370 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.325+0000 7f45992a8640 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab65d0 0x55b67bb339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f4599aa9640 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bb3e860 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f458c004a80 tx=0x7f458c00cfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b29b691527caf14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f457cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f457cff9640 1 -- 172.21.15.70:0/2674110850 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c01cbb0 con 0x55b67bac1370 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f457cff9640 1 -- 172.21.15.70:0/2674110850 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f458c02a040 con 0x55b67bac1370 2024-09-19T04:35:19.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 1 -- 172.21.15.70:0/2674110850 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f458c016070 con 0x55b67bac1370 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f457cff9640 1 -- 172.21.15.70:0/2674110850 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f458c03b050 con 0x55b67bac1370 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 10 client.15960 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 1 -- 172.21.15.70:0/2674110850 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b67bb40070 con 0x55b67bac1370 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f457cff9640 1 -- 172.21.15.70:0/2674110850 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f458c016070 con 0x55b67bac1370 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f457cff9640 1 -- 172.21.15.70:0/2674110850 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f458c02e950 con 0x55b67bac1370 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 10 client.15960 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 10 client.15960 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 20 client.15960 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b67bb40760 0x55b67bb42b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 4 client.15960 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.326+0000 7f459d8e5740 1 -- 172.21.15.70:0/2674110850 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b67ba23d70 con 0x55b67bb40760 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.327+0000 7f45992a8640 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b67bb40760 0x55b67bb42b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.327+0000 7f45992a8640 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b67bb40760 0x55b67bb42b80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=cfc3da7047681ba0 server_cookie=78487a3b5b818b53 in_seq=0 out_seq=0 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.327+0000 7f457cff9640 10 client.15960 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:35:19.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.327+0000 7f457cff9640 1 -- 172.21.15.70:0/2674110850 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b67ba23d70 con 0x55b67bb40760 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.327+0000 7f457cff9640 10 client.15960 handle_command_reply: tid=0 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.327+0000 7f459d8e5740 1 client.15960 shutdown 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 -- 172.21.15.70:0/2674110850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 msgr2=0x55b67bb3e860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bb3e860 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f458c004a80 tx=0x7f458c00cfc0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 -- 172.21.15.70:0/2674110850 shutdown_connections 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b67bb40760 0x55b67bb42b80 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b67bac1370 0x55b67bb3e860 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b67bab7b40 0x55b67bb33f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f457cff9640 0 client.15960 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 --2- 172.21.15.70:0/2674110850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b67bab65d0 0x55b67bb339c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 -- 172.21.15.70:0/2674110850 >> 172.21.15.70:0/2674110850 conn(0x55b67ba7f310 msgr2=0x55b67bab1310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 -- 172.21.15.70:0/2674110850 shutdown_connections 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 1 -- 172.21.15.70:0/2674110850 wait complete. 2024-09-19T04:35:19.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459d8e5740 20 client.15960 trim_cache size 0 max 16384 2024-09-19T04:35:19.335 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:35:19.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 -- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45800a3430 msgr2=0x7f45800a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45800a3430 0x7f45800a58f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f458c00e5d0 tx=0x7f458c008220 comp rx=0 tx=0).stop 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 -- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594100a80 msgr2=0x7f45941984d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594100a80 0x7f45941984d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f4590005940 tx=0x7f45900042f0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 -- 172.21.15.70:0/2159086637 shutdown_connections 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45800a3430 0x7f45800a58f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4594106a80 0x7f459419cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4594101420 0x7f4594198a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 --2- 172.21.15.70:0/2159086637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4594100a80 0x7f45941984d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 -- 172.21.15.70:0/2159086637 >> 172.21.15.70:0/2159086637 conn(0x7f45940fc7a0 msgr2=0x7f459406aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.328+0000 7f459b50c640 1 -- 172.21.15.70:0/2159086637 shutdown_connections 2024-09-19T04:35:19.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:19.329+0000 7f459b50c640 1 -- 172.21.15.70:0/2159086637 wait complete. 2024-09-19T04:35:20.105 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:35:20.353 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:20.761 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:20 smithi070 ceph-mon[30942]: pgmap v140: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 -- 172.21.15.70:0/3610888267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 msgr2=0x7fa78010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 --2- 172.21.15.70:0/3610888267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 0x7fa78010e610 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7fa778009ca0 tx=0x7fa77802a950 comp rx=0 tx=0).stop 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 -- 172.21.15.70:0/3610888267 shutdown_connections 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 --2- 172.21.15.70:0/3610888267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 0x7fa78010e610 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 --2- 172.21.15.70:0/3610888267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa780103660 0x7fa78010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 --2- 172.21.15.70:0/3610888267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa780102d40 0x7fa780103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 -- 172.21.15.70:0/3610888267 >> 172.21.15.70:0/3610888267 conn(0x7fa7800fc7a0 msgr2=0x7fa7800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 -- 172.21.15.70:0/3610888267 shutdown_connections 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.840+0000 7fa78616c640 1 -- 172.21.15.70:0/3610888267 wait complete. 2024-09-19T04:35:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa78616c640 1 Processor -- start 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa78616c640 1 -- start start 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa78616c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa780102d40 0x7fa780198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa78616c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa780103660 0x7fa7801989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa78616c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 0x7fa78019cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa78616c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa780111fc0 con 0x7fa78010c170 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa78616c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa780111e40 con 0x7fa780102d40 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa78616c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa780112140 con 0x7fa780103660 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa77ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 0x7fa78019cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa77ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 0x7fa78019cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56972/0 (socket says 172.21.15.70:56972) 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa77ffff640 1 -- 172.21.15.70:0/1898879397 learned_addr learned my addr 172.21.15.70:0/1898879397 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa77effd640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa780103660 0x7fa7801989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.841+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa780102d40 0x7fa780198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77ffff640 1 -- 172.21.15.70:0/1898879397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa780103660 msgr2=0x7fa7801989c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77ffff640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa780103660 0x7fa7801989c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77ffff640 1 -- 172.21.15.70:0/1898879397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa780102d40 msgr2=0x7fa780198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77ffff640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa780102d40 0x7fa780198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77ffff640 1 -- 172.21.15.70:0/1898879397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa78019d430 con 0x7fa78010c170 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77ffff640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 0x7fa78019cd50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa778005cc0 tx=0x7fa77802f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77cff9640 1 -- 172.21.15.70:0/1898879397 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778003d80 con 0x7fa78010c170 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77cff9640 1 -- 172.21.15.70:0/1898879397 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa778030910 con 0x7fa78010c170 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa78616c640 1 -- 172.21.15.70:0/1898879397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa78019d6c0 con 0x7fa78010c170 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa77cff9640 1 -- 172.21.15.70:0/1898879397 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa778039420 con 0x7fa78010c170 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.842+0000 7fa78616c640 1 -- 172.21.15.70:0/1898879397 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa78019db40 con 0x7fa78010c170 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.844+0000 7fa77cff9640 1 -- 172.21.15.70:0/1898879397 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa778037020 con 0x7fa78010c170 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.844+0000 7fa788545740 1 Processor -- start 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.844+0000 7fa788545740 1 -- start start 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa788545740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce04090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa788545740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce04a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa788545740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce11760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa788545740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f64cd6a2f0 con 0x55f64ce045d0 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa788545740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f64cd11cf0 con 0x55f64ce05b40 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa788545740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f64cd662b0 con 0x55f64ce0f370 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce04a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce04a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56984/0 (socket says 172.21.15.70:56984) 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 -- 172.21.15.70:0/2812541024 learned_addr learned my addr 172.21.15.70:0/2812541024 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77effd640 1 --2- 172.21.15.70:0/2812541024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce04090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 -- 172.21.15.70:0/2812541024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 msgr2=0x55f64ce11760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/2812541024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce11760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 -- 172.21.15.70:0/2812541024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 msgr2=0x55f64ce04090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:20.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/2812541024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce04090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 -- 172.21.15.70:0/2812541024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f64ccf63a0 con 0x55f64ce045d0 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77cff9640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa76c0a33b0 0x7fa76c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/2812541024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce04a10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa768009a70 tx=0x7fa768009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=681e87c6b84f85ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77effd640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa76c0a33b0 0x7fa76c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa77cff9640 1 -- 172.21.15.70:0/1898879397 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fa7780f07e0 con 0x7fa78010c170 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.845+0000 7fa775ffb640 1 -- 172.21.15.70:0/2812541024 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768017070 con 0x55f64ce045d0 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa775ffb640 1 -- 172.21.15.70:0/2812541024 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa768013470 con 0x55f64ce045d0 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa775ffb640 1 -- 172.21.15.70:0/2812541024 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa7680125d0 con 0x55f64ce045d0 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 -- 172.21.15.70:0/2812541024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 msgr2=0x55f64ce04a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa77effd640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa76c0a33b0 0x7fa76c0a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa77000a450 tx=0x7fa77000a3e0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 --2- 172.21.15.70:0/2812541024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce04a10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa768009a70 tx=0x7fa768009f30 comp rx=0 tx=0).stop 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 -- 172.21.15.70:0/2812541024 shutdown_connections 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 --2- 172.21.15.70:0/2812541024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce11760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 --2- 172.21.15.70:0/2812541024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce04a10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 --2- 172.21.15.70:0/2812541024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce04090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 -- 172.21.15.70:0/2812541024 >> 172.21.15.70:0/2812541024 conn(0x55f64cdcd310 msgr2=0x55f64ce00c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 -- 172.21.15.70:0/2812541024 shutdown_connections 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.846+0000 7fa788545740 1 -- 172.21.15.70:0/2812541024 wait complete. 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 1 -- start start 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 1 Processor -- start 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce0ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce0bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce0c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f64ce12070 con 0x55f64ce045d0 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f64cd25060 con 0x55f64ce05b40 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f64ce121f0 con 0x55f64ce0f370 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa788545740 10 client.0 _ll_register_callbacks cb 0x55f64ca788c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.847+0000 7fa77f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce0ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce0ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57000/0 (socket says 172.21.15.70:57000) 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77f7fe640 1 -- 172.21.15.70:0/1200453703 learned_addr learned my addr 172.21.15.70:0/1200453703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77effd640 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce0bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77ffff640 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce0c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77f7fe640 1 -- 172.21.15.70:0/1200453703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 msgr2=0x55f64ce0c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce0c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77f7fe640 1 -- 172.21.15.70:0/1200453703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 msgr2=0x55f64ce0bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce0bf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77f7fe640 1 -- 172.21.15.70:0/1200453703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f64cadb3c0 con 0x55f64ce045d0 2024-09-19T04:35:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce0ecb0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa768006aa0 tx=0x7fa768013620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18fd802071d8062e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa75effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa75effd640 1 -- 172.21.15.70:0/1200453703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768029060 con 0x55f64ce045d0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa75effd640 1 -- 172.21.15.70:0/1200453703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fa768013ae0 con 0x55f64ce045d0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa788545740 1 -- 172.21.15.70:0/1200453703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa768013470 con 0x55f64ce045d0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa75effd640 1 -- 172.21.15.70:0/1200453703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa768017040 con 0x55f64ce045d0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa788545740 10 client.15972 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa788545740 1 -- 172.21.15.70:0/1200453703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f64ce1da60 con 0x55f64ce045d0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.848+0000 7fa75effd640 1 -- 172.21.15.70:0/1200453703 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa768013470 con 0x55f64ce045d0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.849+0000 7fa75effd640 1 -- 172.21.15.70:0/1200453703 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa7680246b0 con 0x55f64ce045d0 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.849+0000 7fa788545740 10 client.15972 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.849+0000 7fa788545740 10 client.15972 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.849+0000 7fa788545740 20 client.15972 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.849+0000 7fa788545740 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f64ce1edb0 0x55f64ce211a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.849+0000 7fa788545740 4 client.15972 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.849+0000 7fa788545740 1 -- 172.21.15.70:0/1200453703 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f64cd77860 con 0x55f64ce1edb0 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.849+0000 7fa77effd640 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f64ce1edb0 0x55f64ce211a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.850+0000 7fa77effd640 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f64ce1edb0 0x55f64ce211a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=a1dffe3c69dae493 server_cookie=c5d75a71638b5316 in_seq=0 out_seq=0 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.850+0000 7fa75effd640 10 client.15972 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.850+0000 7fa75effd640 1 -- 172.21.15.70:0/1200453703 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f64cd77860 con 0x55f64ce1edb0 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.850+0000 7fa75effd640 10 client.15972 handle_command_reply: tid=0 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.850+0000 7fa788545740 1 client.15972 shutdown 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.850+0000 7fa788545740 1 -- 172.21.15.70:0/1200453703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 msgr2=0x55f64ce0ecb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.850+0000 7fa788545740 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce0ecb0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa768006aa0 tx=0x7fa768013620 comp rx=0 tx=0).stop 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 1 -- 172.21.15.70:0/1200453703 shutdown_connections 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f64ce1edb0 0x55f64ce211a0 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce0c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce0bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 1 --2- 172.21.15.70:0/1200453703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce0ecb0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa75effd640 0 client.15972 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 1 -- 172.21.15.70:0/1200453703 >> 172.21.15.70:0/1200453703 conn(0x55f64cdcd310 msgr2=0x55f64ce06930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 1 -- 172.21.15.70:0/1200453703 shutdown_connections 2024-09-19T04:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 1 -- 172.21.15.70:0/1200453703 wait complete. 2024-09-19T04:35:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.851+0000 7fa788545740 20 client.15972 trim_cache size 0 max 16384 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.863+0000 7fa788545740 1 Processor -- start 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.863+0000 7fa788545740 1 -- start start 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa788545740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce1b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa788545740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce17860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa788545740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce17da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa788545740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801b0220 con 0x55f64ce045d0 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa788545740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801ada30 con 0x55f64ce05b40 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa788545740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801ab880 con 0x55f64ce0f370 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce1b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce1b310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57004/0 (socket says 172.21.15.70:57004) 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 -- 172.21.15.70:0/3225313841 learned_addr learned my addr 172.21.15.70:0/3225313841 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77effd640 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce17860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77ffff640 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce17da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 -- 172.21.15.70:0/3225313841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 msgr2=0x55f64ce17da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce17da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 -- 172.21.15.70:0/3225313841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 msgr2=0x55f64ce17860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce17860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 -- 172.21.15.70:0/3225313841 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f64ce11ba0 con 0x55f64ce045d0 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77ffff640 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce17da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce1b310 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa768004810 tx=0x7fa7680098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdbfc0a979073d52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa7757fa640 1 -- 172.21.15.70:0/3225313841 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa768029070 con 0x55f64ce045d0 2024-09-19T04:35:20.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa7757fa640 1 -- 172.21.15.70:0/3225313841 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa768013ce0 con 0x55f64ce045d0 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.864+0000 7fa7757fa640 1 -- 172.21.15.70:0/3225313841 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa76802cc40 con 0x55f64ce045d0 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 -- 172.21.15.70:0/3225313841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 msgr2=0x55f64ce1b310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce1b310 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fa768004810 tx=0x7fa7680098f0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 -- 172.21.15.70:0/3225313841 shutdown_connections 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce0f370 0x55f64ce17da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce05b40 0x55f64ce17860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 --2- 172.21.15.70:0/3225313841 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce045d0 0x55f64ce1b310 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 -- 172.21.15.70:0/3225313841 >> 172.21.15.70:0/3225313841 conn(0x55f64cdcd310 msgr2=0x55f64ce0a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 -- 172.21.15.70:0/3225313841 shutdown_connections 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 -- 172.21.15.70:0/3225313841 wait complete. 2024-09-19T04:35:20.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.865+0000 7fa788545740 1 -- start start 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa788545740 1 Processor -- start 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa788545740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce045d0 0x55f64ce11040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa788545740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce05b40 0x55f64ce263a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa788545740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce0f370 0x55f64ce268e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa788545740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801abef0 con 0x55f64ce05b40 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa788545740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801ad360 con 0x55f64ce0f370 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa788545740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa7801ac5c0 con 0x55f64ce045d0 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa788545740 10 client.0 _ll_register_callbacks cb 0x7fa768013f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce05b40 0x55f64ce263a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce05b40 0x55f64ce263a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57014/0 (socket says 172.21.15.70:57014) 2024-09-19T04:35:20.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 -- 172.21.15.70:0/3692958735 learned_addr learned my addr 172.21.15.70:0/3692958735 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce045d0 0x55f64ce11040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 -- 172.21.15.70:0/3692958735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce045d0 msgr2=0x55f64ce11040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77ffff640 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce0f370 0x55f64ce268e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce045d0 0x55f64ce11040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 -- 172.21.15.70:0/3692958735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce0f370 msgr2=0x55f64ce268e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce0f370 0x55f64ce268e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 -- 172.21.15.70:0/3692958735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f64ce27130 con 0x55f64ce05b40 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa77effd640 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce05b40 0x55f64ce263a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa7800fed30 tx=0x7fa7700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e72ccc9ebfbe775 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.866+0000 7fa75effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa75effd640 1 -- 172.21.15.70:0/3692958735 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa77002a070 con 0x55f64ce05b40 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa75effd640 1 -- 172.21.15.70:0/3692958735 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fa7700266d0 con 0x55f64ce05b40 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 1 -- 172.21.15.70:0/3692958735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa768013ce0 con 0x55f64ce05b40 2024-09-19T04:35:20.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa75effd640 1 -- 172.21.15.70:0/3692958735 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fa770036050 con 0x55f64ce05b40 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 10 client.15978 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 1 -- 172.21.15.70:0/3692958735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f64ce8d910 con 0x55f64ce05b40 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa75effd640 1 -- 172.21.15.70:0/3692958735 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa768013ce0 con 0x55f64ce05b40 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa75effd640 1 -- 172.21.15.70:0/3692958735 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fa77001daa0 con 0x55f64ce05b40 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 10 client.15978 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 10 client.15978 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 20 client.15978 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f64ce8e100 0x55f64ce90520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 4 client.15978 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.867+0000 7fa788545740 1 -- 172.21.15.70:0/3692958735 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f64cd71d70 con 0x55f64ce8e100 2024-09-19T04:35:20.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f64ce8e100 0x55f64ce90520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa75effd640 10 client.15978 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:35:20.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa77f7fe640 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f64ce8e100 0x55f64ce90520 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=48657df35ccb1219 server_cookie=a42a5ee6a2d217b6 in_seq=0 out_seq=0 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa75effd640 1 -- 172.21.15.70:0/3692958735 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f64cd71d70 con 0x55f64ce8e100 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa75effd640 10 client.15978 handle_command_reply: tid=0 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa788545740 1 client.15978 shutdown 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa788545740 1 -- 172.21.15.70:0/3692958735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce05b40 msgr2=0x55f64ce263a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa788545740 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce05b40 0x55f64ce263a0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa7800fed30 tx=0x7fa7700046c0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa788545740 1 -- 172.21.15.70:0/3692958735 shutdown_connections 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.868+0000 7fa788545740 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f64ce8e100 0x55f64ce90520 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa788545740 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f64ce0f370 0x55f64ce268e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa788545740 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f64ce05b40 0x55f64ce263a0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa788545740 1 --2- 172.21.15.70:0/3692958735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f64ce045d0 0x55f64ce11040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa788545740 1 -- 172.21.15.70:0/3692958735 >> 172.21.15.70:0/3692958735 conn(0x55f64cdcd310 msgr2=0x55f64ce06110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:20.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa75effd640 0 client.15978 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:35:20.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa788545740 1 -- 172.21.15.70:0/3692958735 shutdown_connections 2024-09-19T04:35:20.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa788545740 1 -- 172.21.15.70:0/3692958735 wait complete. 2024-09-19T04:35:20.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa788545740 20 client.15978 trim_cache size 0 max 16384 2024-09-19T04:35:20.877 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 -- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa76c0a33b0 msgr2=0x7fa76c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa76c0a33b0 0x7fa76c0a5870 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fa77000a450 tx=0x7fa77000a3e0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 -- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 msgr2=0x7fa78019cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 0x7fa78019cd50 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fa778005cc0 tx=0x7fa77802f6a0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 -- 172.21.15.70:0/1898879397 shutdown_connections 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa76c0a33b0 0x7fa76c0a5870 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa78010c170 0x7fa78019cd50 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa780103660 0x7fa7801989c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 --2- 172.21.15.70:0/1898879397 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa780102d40 0x7fa780198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:20.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.869+0000 7fa78616c640 1 -- 172.21.15.70:0/1898879397 >> 172.21.15.70:0/1898879397 conn(0x7fa7800fc7a0 msgr2=0x7fa7800fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:20.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.870+0000 7fa78616c640 1 -- 172.21.15.70:0/1898879397 shutdown_connections 2024-09-19T04:35:20.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:20.870+0000 7fa78616c640 1 -- 172.21.15.70:0/1898879397 wait complete. 2024-09-19T04:35:20.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:20 smithi167 ceph-mon[34339]: pgmap v140: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:35:21.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:20 smithi134 ceph-mon[34525]: pgmap v140: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:35:21.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:35:21.869 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 -- 172.21.15.70:0/154393605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 msgr2=0x7fbf5010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 --2- 172.21.15.70:0/154393605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 0x7fbf5010da40 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fbf48009ca0 tx=0x7fbf4802a950 comp rx=0 tx=0).stop 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 -- 172.21.15.70:0/154393605 shutdown_connections 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 --2- 172.21.15.70:0/154393605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 0x7fbf5010da40 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 --2- 172.21.15.70:0/154393605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf50102570 0x7fbf501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 --2- 172.21.15.70:0/154393605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf50100e20 0x7fbf50101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 -- 172.21.15.70:0/154393605 >> 172.21.15.70:0/154393605 conn(0x7fbf500fc7d0 msgr2=0x7fbf500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 -- 172.21.15.70:0/154393605 shutdown_connections 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.306+0000 7fbf572ce640 1 -- 172.21.15.70:0/154393605 wait complete. 2024-09-19T04:35:22.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf572ce640 1 Processor -- start 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf572ce640 1 -- start start 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf572ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf50100e20 0x7fbf501973b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf572ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf50102570 0x7fbf501978f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf572ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 0x7fbf5019bc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf572ce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf50110f50 con 0x7fbf50102ef0 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf572ce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf50110dd0 con 0x7fbf50100e20 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf572ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501110d0 con 0x7fbf50102570 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf5586b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 0x7fbf5019bc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf5586b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 0x7fbf5019bc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57030/0 (socket says 172.21.15.70:57030) 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf5586b640 1 -- 172.21.15.70:0/3973767732 learned_addr learned my addr 172.21.15.70:0/3973767732 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf5506a640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf50100e20 0x7fbf501973b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.307+0000 7fbf54869640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf50102570 0x7fbf501978f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf5586b640 1 -- 172.21.15.70:0/3973767732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf50102570 msgr2=0x7fbf501978f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf5586b640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf50102570 0x7fbf501978f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf5586b640 1 -- 172.21.15.70:0/3973767732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf50100e20 msgr2=0x7fbf501973b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf5586b640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf50100e20 0x7fbf501973b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf5586b640 1 -- 172.21.15.70:0/3973767732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf5019c360 con 0x7fbf50102ef0 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf54869640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf50102570 0x7fbf501978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf5586b640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 0x7fbf5019bc80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005cc0 tx=0x7fbf4802f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf467fc640 1 -- 172.21.15.70:0/3973767732 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48003d80 con 0x7fbf50102ef0 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf467fc640 1 -- 172.21.15.70:0/3973767732 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbf48030910 con 0x7fbf50102ef0 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf572ce640 1 -- 172.21.15.70:0/3973767732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf5019c5f0 con 0x7fbf50102ef0 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf467fc640 1 -- 172.21.15.70:0/3973767732 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf48039420 con 0x7fbf50102ef0 2024-09-19T04:35:22.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.308+0000 7fbf572ce640 1 -- 172.21.15.70:0/3973767732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf5019cac0 con 0x7fbf50102ef0 2024-09-19T04:35:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.310+0000 7fbf467fc640 1 -- 172.21.15.70:0/3973767732 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fbf48037020 con 0x7fbf50102ef0 2024-09-19T04:35:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.311+0000 7fbf467fc640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbf3c0a3430 0x7fbf3c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.311+0000 7fbf5506a640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbf3c0a3430 0x7fbf3c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.311+0000 7fbf467fc640 1 -- 172.21.15.70:0/3973767732 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fbf480f08c0 con 0x7fbf50102ef0 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.311+0000 7fbf596a7740 1 Processor -- start 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.311+0000 7fbf596a7740 1 -- start start 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.311+0000 7fbf5506a640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbf3c0a3430 0x7fbf3c0a58f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00abe0 tx=0x7fbf4c00a2d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e53d50 0x5651a6e522a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e527e0 0x5651a6e52c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e5f970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf596a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5651a6db62f0 con 0x5651a6e5d580 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf596a7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5651a6d5dcf0 con 0x5651a6e53d50 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf596a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5651a6db22b0 con 0x5651a6e527e0 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e5f970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e5f970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57032/0 (socket says 172.21.15.70:57032) 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 -- 172.21.15.70:0/2302921318 learned_addr learned my addr 172.21.15.70:0/2302921318 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5506a640 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e53d50 0x5651a6e522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf54869640 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e527e0 0x5651a6e52c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 -- 172.21.15.70:0/2302921318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e527e0 msgr2=0x5651a6e52c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e527e0 0x5651a6e52c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 -- 172.21.15.70:0/2302921318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e53d50 msgr2=0x5651a6e522a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e53d50 0x5651a6e522a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 -- 172.21.15.70:0/2302921318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a6d423a0 con 0x5651a6e5d580 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf5586b640 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e5f970 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbf480b9590 tx=0x7fbf480bc520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b634030148b7865 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf3b7fe640 1 -- 172.21.15.70:0/2302921318 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf480bd2c0 con 0x5651a6e5d580 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf3b7fe640 1 -- 172.21.15.70:0/2302921318 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbf480bcbc0 con 0x5651a6e5d580 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.312+0000 7fbf3b7fe640 1 -- 172.21.15.70:0/2302921318 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf480ee400 con 0x5651a6e5d580 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 -- 172.21.15.70:0/2302921318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 msgr2=0x5651a6e5f970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e5f970 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7fbf480b9590 tx=0x7fbf480bc520 comp rx=0 tx=0).stop 2024-09-19T04:35:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 -- 172.21.15.70:0/2302921318 shutdown_connections 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e5f970 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e527e0 0x5651a6e52c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2302921318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e53d50 0x5651a6e522a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 -- 172.21.15.70:0/2302921318 >> 172.21.15.70:0/2302921318 conn(0x5651a6e19310 msgr2=0x5651a6e4ee70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 -- 172.21.15.70:0/2302921318 shutdown_connections 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 -- 172.21.15.70:0/2302921318 wait complete. 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.313+0000 7fbf596a7740 1 -- start start 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf596a7740 1 Processor -- start 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e527e0 0x5651a6e583a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e588e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e5d580 0x5651a6e58e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf596a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5651a6db62f0 con 0x5651a6e527e0 2024-09-19T04:35:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf596a7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5651a6d71060 con 0x5651a6e5d580 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf596a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5651a6e4c6d0 con 0x5651a6e53d50 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf596a7740 10 client.0 _ll_register_callbacks cb 0x5651a6ac48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5506a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e527e0 0x5651a6e583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5506a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e527e0 0x5651a6e583a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57036/0 (socket says 172.21.15.70:57036) 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5506a640 1 -- 172.21.15.70:0/2680395139 learned_addr learned my addr 172.21.15.70:0/2680395139 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf54869640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e588e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5586b640 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e5d580 0x5651a6e58e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5506a640 1 -- 172.21.15.70:0/2680395139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 msgr2=0x5651a6e588e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5506a640 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e588e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5506a640 1 -- 172.21.15.70:0/2680395139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e5d580 msgr2=0x5651a6e58e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:22.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5506a640 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e5d580 0x5651a6e58e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.314+0000 7fbf5506a640 1 -- 172.21.15.70:0/2680395139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a6b273c0 con 0x5651a6e527e0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf5506a640 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e527e0 0x5651a6e583a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c01de00 tx=0x7fbf4c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f555ea8661dc6c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf38ff9640 1 -- 172.21.15.70:0/2680395139 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf4c02a060 con 0x5651a6e527e0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf38ff9640 1 -- 172.21.15.70:0/2680395139 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fbf4c01b640 con 0x5651a6e527e0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 1 -- 172.21.15.70:0/2680395139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf480bcbc0 con 0x5651a6e527e0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf38ff9640 1 -- 172.21.15.70:0/2680395139 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf4c016070 con 0x5651a6e527e0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 10 client.15990 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 1 -- 172.21.15.70:0/2680395139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5651a6e6dbc0 con 0x5651a6e527e0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf38ff9640 1 -- 172.21.15.70:0/2680395139 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbf480bcbc0 con 0x5651a6e527e0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf38ff9640 1 -- 172.21.15.70:0/2680395139 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbf4c024030 con 0x5651a6e527e0 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 10 client.15990 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 10 client.15990 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:22.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 20 client.15990 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:22.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a6e6f0d0 0x5651a6e714e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 4 client.15990 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:35:22.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.315+0000 7fbf596a7740 1 -- 172.21.15.70:0/2680395139 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651a6dc3860 con 0x5651a6e6f0d0 2024-09-19T04:35:22.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.316+0000 7fbf54869640 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a6e6f0d0 0x5651a6e714e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.316+0000 7fbf38ff9640 10 client.15990 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:22.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.316+0000 7fbf54869640 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a6e6f0d0 0x5651a6e714e0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=73a7ce8c4d3558fe server_cookie=c7cd04732a8d7fad in_seq=0 out_seq=0 2024-09-19T04:35:22.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf38ff9640 1 -- 172.21.15.70:0/2680395139 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651a6dc3860 con 0x5651a6e6f0d0 2024-09-19T04:35:22.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf38ff9640 10 client.15990 handle_command_reply: tid=0 2024-09-19T04:35:22.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 client.15990 shutdown 2024-09-19T04:35:22.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 -- 172.21.15.70:0/2680395139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e527e0 msgr2=0x5651a6e583a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e527e0 0x5651a6e583a0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c01de00 tx=0x7fbf4c004730 comp rx=0 tx=0).stop 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 -- 172.21.15.70:0/2680395139 shutdown_connections 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a6e6f0d0 0x5651a6e714e0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e5d580 0x5651a6e58e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e588e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 --2- 172.21.15.70:0/2680395139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e527e0 0x5651a6e583a0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf38ff9640 0 client.15990 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 -- 172.21.15.70:0/2680395139 >> 172.21.15.70:0/2680395139 conn(0x5651a6e19310 msgr2=0x5651a6e54ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 -- 172.21.15.70:0/2680395139 shutdown_connections 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 1 -- 172.21.15.70:0/2680395139 wait complete. 2024-09-19T04:35:22.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.317+0000 7fbf596a7740 20 client.15990 trim_cache size 0 max 16384 2024-09-19T04:35:22.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf596a7740 1 Processor -- start 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf596a7740 1 -- start start 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e5c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e76df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e77330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf596a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501adf20 con 0x5651a6e5d580 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf596a7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501ab730 con 0x5651a6e527e0 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf596a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501a95a0 con 0x5651a6e53d50 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf5586b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e77330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf5586b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e77330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57052/0 (socket says 172.21.15.70:57052) 2024-09-19T04:35:22.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf5586b640 1 -- 172.21.15.70:0/1111532625 learned_addr learned my addr 172.21.15.70:0/1111532625 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf5586b640 1 -- 172.21.15.70:0/1111532625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 msgr2=0x5651a6e76df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf54869640 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e76df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.330+0000 7fbf5506a640 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e5c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf5586b640 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e76df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf5586b640 1 -- 172.21.15.70:0/1111532625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 msgr2=0x5651a6e5c320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf5586b640 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e5c320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf5586b640 1 -- 172.21.15.70:0/1111532625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a6e5cd30 con 0x5651a6e5d580 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf54869640 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e76df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf5506a640 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e5c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:22.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf5586b640 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e77330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbf480bcb50 tx=0x7fbf480bc650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=466e4c604cf88297 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:22.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf3affd640 1 -- 172.21.15.70:0/1111532625 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf480c0f70 con 0x5651a6e5d580 2024-09-19T04:35:22.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf3affd640 1 -- 172.21.15.70:0/1111532625 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbf480d3020 con 0x5651a6e5d580 2024-09-19T04:35:22.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf3affd640 1 -- 172.21.15.70:0/1111532625 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf480b9230 con 0x5651a6e5d580 2024-09-19T04:35:22.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf596a7740 1 -- 172.21.15.70:0/1111532625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 msgr2=0x5651a6e77330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf596a7740 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e77330 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fbf480bcb50 tx=0x7fbf480bc650 comp rx=0 tx=0).stop 2024-09-19T04:35:22.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf596a7740 1 -- 172.21.15.70:0/1111532625 shutdown_connections 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf596a7740 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e77330 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf596a7740 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e76df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf596a7740 1 --2- 172.21.15.70:0/1111532625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e5c320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf596a7740 1 -- 172.21.15.70:0/1111532625 >> 172.21.15.70:0/1111532625 conn(0x5651a6e19310 msgr2=0x5651a6e5bc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.331+0000 7fbf596a7740 1 -- 172.21.15.70:0/1111532625 shutdown_connections 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 -- 172.21.15.70:0/1111532625 wait complete. 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 -- start start 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 Processor -- start 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e6a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e663a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e668e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501a9bf0 con 0x5651a6e5d580 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501ab060 con 0x5651a6e527e0 2024-09-19T04:35:22.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fbf501aa2c0 con 0x5651a6e53d50 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf596a7740 10 client.0 _ll_register_callbacks cb 0x7fbf4c00fc20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf5586b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e668e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf5586b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e668e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57062/0 (socket says 172.21.15.70:57062) 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf5586b640 1 -- 172.21.15.70:0/3575434726 learned_addr learned my addr 172.21.15.70:0/3575434726 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.332+0000 7fbf5506a640 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e6a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf54869640 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e663a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf5586b640 1 -- 172.21.15.70:0/3575434726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 msgr2=0x5651a6e663a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf5586b640 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e663a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf5586b640 1 -- 172.21.15.70:0/3575434726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 msgr2=0x5651a6e6a9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf5586b640 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e6a9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf5586b640 1 -- 172.21.15.70:0/3575434726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a6e66e20 con 0x5651a6e5d580 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf54869640 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:22.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf5586b640 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e668e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbf480a7010 tx=0x7fbf4802fd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4ef06ccbd95f71b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf38ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf38ff9640 1 -- 172.21.15.70:0/3575434726 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbf480d9070 con 0x5651a6e5d580 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf38ff9640 1 -- 172.21.15.70:0/3575434726 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fbf480bd030 con 0x5651a6e5d580 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf596a7740 1 -- 172.21.15.70:0/3575434726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbf480d3020 con 0x5651a6e5d580 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf38ff9640 1 -- 172.21.15.70:0/3575434726 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fbf480bd2c0 con 0x5651a6e5d580 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf596a7740 10 client.15996 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf596a7740 1 -- 172.21.15.70:0/3575434726 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5651a6ed9a40 con 0x5651a6e5d580 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf38ff9640 1 -- 172.21.15.70:0/3575434726 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fbf480d3020 con 0x5651a6e5d580 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf38ff9640 1 -- 172.21.15.70:0/3575434726 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fbf480a70b0 con 0x5651a6e5d580 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.333+0000 7fbf596a7740 10 client.15996 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.334+0000 7fbf596a7740 10 client.15996 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.334+0000 7fbf596a7740 20 client.15996 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:22.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.334+0000 7fbf596a7740 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a6eda040 0x5651a6edc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.334+0000 7fbf596a7740 4 client.15996 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.334+0000 7fbf596a7740 1 -- 172.21.15.70:0/3575434726 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5651a6dbdd70 con 0x5651a6eda040 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.334+0000 7fbf5506a640 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a6eda040 0x5651a6edc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.334+0000 7fbf5506a640 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a6eda040 0x5651a6edc460 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59da6408ba52e85e server_cookie=a489e1f89e80314c in_seq=0 out_seq=0 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.334+0000 7fbf38ff9640 10 client.15996 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf38ff9640 1 -- 172.21.15.70:0/3575434726 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5651a6dbdd70 con 0x5651a6eda040 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf38ff9640 10 client.15996 handle_command_reply: tid=0 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 client.15996 shutdown 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 -- 172.21.15.70:0/3575434726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 msgr2=0x5651a6e668e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e668e0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fbf480a7010 tx=0x7fbf4802fd70 comp rx=0 tx=0).stop 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 -- 172.21.15.70:0/3575434726 shutdown_connections 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a6eda040 0x5651a6edc460 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a6e5d580 0x5651a6e668e0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a6e53d50 0x5651a6e663a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf38ff9640 0 client.15996 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:22.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 --2- 172.21.15.70:0/3575434726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a6e527e0 0x5651a6e6a9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 -- 172.21.15.70:0/3575434726 >> 172.21.15.70:0/3575434726 conn(0x5651a6e19310 msgr2=0x5651a6e5c430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:22.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 -- 172.21.15.70:0/3575434726 shutdown_connections 2024-09-19T04:35:22.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 1 -- 172.21.15.70:0/3575434726 wait complete. 2024-09-19T04:35:22.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.335+0000 7fbf596a7740 20 client.15996 trim_cache size 0 max 16384 2024-09-19T04:35:22.343 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:35:22.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 -- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbf3c0a3430 msgr2=0x7fbf3c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbf3c0a3430 0x7fbf3c0a58f0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fbf4c00abe0 tx=0x7fbf4c00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 -- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 msgr2=0x7fbf5019bc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:22.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 0x7fbf5019bc80 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7fbf48005cc0 tx=0x7fbf4802f6a0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 -- 172.21.15.70:0/3973767732 shutdown_connections 2024-09-19T04:35:22.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fbf3c0a3430 0x7fbf3c0a58f0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fbf50102ef0 0x7fbf5019bc80 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fbf50102570 0x7fbf501978f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 --2- 172.21.15.70:0/3973767732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf50100e20 0x7fbf501973b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:22.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 -- 172.21.15.70:0/3973767732 >> 172.21.15.70:0/3973767732 conn(0x7fbf500fc7d0 msgr2=0x7fbf50106880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:22.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 -- 172.21.15.70:0/3973767732 shutdown_connections 2024-09-19T04:35:22.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:22.336+0000 7fbf572ce640 1 -- 172.21.15.70:0/3973767732 wait complete. 2024-09-19T04:35:22.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:22 smithi167 ceph-mon[34339]: pgmap v141: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:35:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:22 smithi134 ceph-mon[34525]: pgmap v141: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:35:23.073 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:22 smithi070 ceph-mon[30942]: pgmap v141: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:35:24.100 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:35:24.100 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:35:24.360 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:24.751 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:24 smithi070 ceph-mon[30942]: pgmap v142: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 -- 172.21.15.70:0/125737049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280102790 msgr2=0x7f52801067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 --2- 172.21.15.70:0/125737049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280102790 0x7f52801067e0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f5268009900 tx=0x7f526802a410 comp rx=0 tx=0).stop 2024-09-19T04:35:24.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 -- 172.21.15.70:0/125737049 shutdown_connections 2024-09-19T04:35:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 --2- 172.21.15.70:0/125737049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5280106f10 0x7f528010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 --2- 172.21.15.70:0/125737049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280102790 0x7f52801067e0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 --2- 172.21.15.70:0/125737049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280101de0 0x7f52801021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 -- 172.21.15.70:0/125737049 >> 172.21.15.70:0/125737049 conn(0x7f52800fd8c0 msgr2=0x7f52800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 -- 172.21.15.70:0/125737049 shutdown_connections 2024-09-19T04:35:24.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.832+0000 7f5284b4a640 1 -- 172.21.15.70:0/125737049 wait complete. 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.833+0000 7f5284b4a640 1 Processor -- start 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.833+0000 7f5284b4a640 1 -- start start 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.833+0000 7f5284b4a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280101de0 0x7f52801a3610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.833+0000 7f5284b4a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280102790 0x7f52801a3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.833+0000 7f5284b4a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5280106f10 0x7f528010dbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.833+0000 7f5284b4a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5280111f40 con 0x7f5280101de0 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.833+0000 7f5284b4a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5280111dc0 con 0x7f5280106f10 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.833+0000 7f5284b4a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52801120c0 con 0x7f5280102790 2024-09-19T04:35:24.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280101de0 0x7f52801a3610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280101de0 0x7f52801a3610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58204/0 (socket says 172.21.15.70:58204) 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 -- 172.21.15.70:0/366262111 learned_addr learned my addr 172.21.15.70:0/366262111 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f5277fff640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280102790 0x7f52801a3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527ed9d640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5280106f10 0x7f528010dbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 -- 172.21.15.70:0/366262111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280102790 msgr2=0x7f52801a3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280102790 0x7f52801a3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 -- 172.21.15.70:0/366262111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5280106f10 msgr2=0x7f528010dbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5280106f10 0x7f528010dbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 -- 172.21.15.70:0/366262111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528010e340 con 0x7f5280101de0 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f527e59c640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280101de0 0x7f52801a3610 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f527000d770 tx=0x7f527000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f52777fe640 1 -- 172.21.15.70:0/366262111 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270017070 con 0x7f5280101de0 2024-09-19T04:35:24.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f5284b4a640 1 -- 172.21.15.70:0/366262111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528010e630 con 0x7f5280101de0 2024-09-19T04:35:24.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f52777fe640 1 -- 172.21.15.70:0/366262111 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f52700054f0 con 0x7f5280101de0 2024-09-19T04:35:24.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f52777fe640 1 -- 172.21.15.70:0/366262111 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270004d60 con 0x7f5280101de0 2024-09-19T04:35:24.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.834+0000 7f5284b4a640 1 -- 172.21.15.70:0/366262111 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52801ab540 con 0x7f5280101de0 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f52777fe640 1 -- 172.21.15.70:0/366262111 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5270004f00 con 0x7f5280101de0 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f5286f23740 1 Processor -- start 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f5286f23740 1 -- start start 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f5286f23740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c02ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f5286f23740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c039800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f5286f23740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f5286f23740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bf94280 con 0x55ae7c02eb60 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f5286f23740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bf3bb10 con 0x55ae7c02f480 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f5286f23740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bf90240 con 0x55ae7c039d40 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.837+0000 7f527ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c02ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c02ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58216/0 (socket says 172.21.15.70:58216) 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 -- 172.21.15.70:0/4026357667 learned_addr learned my addr 172.21.15.70:0/4026357667 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f52777fe640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f526c0a33b0 0x7f526c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527e59c640 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c039800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f5277fff640 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f526c0a33b0 0x7f526c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 -- 172.21.15.70:0/4026357667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 msgr2=0x55ae7c03c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 -- 172.21.15.70:0/4026357667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 msgr2=0x55ae7c039800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c039800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 -- 172.21.15.70:0/4026357667 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae7bf481f0 con 0x55ae7c02eb60 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527e59c640 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c039800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:24.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f5277fff640 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f52777fe640 1 -- 172.21.15.70:0/366262111 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f52700cf7a0 con 0x7f5280101de0 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f527ed9d640 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c02ef40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5278012890 tx=0x7f5278012d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a56601830266861 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f5274ff9640 1 -- 172.21.15.70:0/4026357667 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278005020 con 0x55ae7c02eb60 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f5274ff9640 1 -- 172.21.15.70:0/4026357667 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5278005690 con 0x55ae7c02eb60 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.838+0000 7f5274ff9640 1 -- 172.21.15.70:0/4026357667 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527801c850 con 0x55ae7c02eb60 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 -- 172.21.15.70:0/4026357667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 msgr2=0x55ae7c02ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f527ed9d640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f526c0a33b0 0x7f526c0a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f527801f000 tx=0x7f527801e000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c02ef40 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f5278012890 tx=0x7f5278012d50 comp rx=0 tx=0).stop 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 -- 172.21.15.70:0/4026357667 shutdown_connections 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c039800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 --2- 172.21.15.70:0/4026357667 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c02ef40 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 -- 172.21.15.70:0/4026357667 >> 172.21.15.70:0/4026357667 conn(0x55ae7c02b0f0 msgr2=0x55ae7c02b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:24.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 -- 172.21.15.70:0/4026357667 shutdown_connections 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 -- 172.21.15.70:0/4026357667 wait complete. 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.839+0000 7f5286f23740 1 -- start start 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5286f23740 1 Processor -- start 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5286f23740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c036ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5286f23740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02f480 0x55ae7c0370e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5286f23740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c039d40 0x55ae7c037620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5286f23740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ae7c03c910 con 0x55ae7c02eb60 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5286f23740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ae7bf4ef10 con 0x55ae7c039d40 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5286f23740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ae7c03ca90 con 0x55ae7c02f480 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5286f23740 10 client.0 _ll_register_callbacks cb 0x55ae7bf17a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c036ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c036ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58230/0 (socket says 172.21.15.70:58230) 2024-09-19T04:35:24.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 -- 172.21.15.70:0/383784198 learned_addr learned my addr 172.21.15.70:0/383784198 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5277fff640 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02f480 0x55ae7c0370e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527ed9d640 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c039d40 0x55ae7c037620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 -- 172.21.15.70:0/383784198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02f480 msgr2=0x55ae7c0370e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02f480 0x55ae7c0370e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 -- 172.21.15.70:0/383784198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c039d40 msgr2=0x55ae7c037620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c039d40 0x55ae7c037620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 -- 172.21.15.70:0/383784198 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae7bd056a0 con 0x55ae7c02eb60 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f527e59c640 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c036ba0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f52700ccf70 tx=0x7f527009b400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37fe328b4358bb8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5265ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:24.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.840+0000 7f5265ffb640 1 -- 172.21.15.70:0/383784198 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270020070 con 0x55ae7c02eb60 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5265ffb640 1 -- 172.21.15.70:0/383784198 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f5270098110 con 0x55ae7c02eb60 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 1 -- 172.21.15.70:0/383784198 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5278005690 con 0x55ae7c02eb60 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5265ffb640 1 -- 172.21.15.70:0/383784198 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52700046c0 con 0x55ae7c02eb60 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 10 client.16008 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 1 -- 172.21.15.70:0/383784198 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae7c0484a0 con 0x55ae7c02eb60 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5265ffb640 1 -- 172.21.15.70:0/383784198 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5278005690 con 0x55ae7c02eb60 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5265ffb640 1 -- 172.21.15.70:0/383784198 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f52700860b0 con 0x55ae7c02eb60 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 10 client.16008 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 10 client.16008 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 20 client.16008 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ae7c049960 0x55ae7c04bd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 4 client.16008 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:35:24.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.841+0000 7f5286f23740 1 -- 172.21.15.70:0/383784198 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ae7bfa17f0 con 0x55ae7c049960 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.842+0000 7f5277fff640 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ae7c049960 0x55ae7c04bd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.842+0000 7f5277fff640 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ae7c049960 0x55ae7c04bd50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=15ab9aa813bf0471 server_cookie=d48939d1a844558e in_seq=0 out_seq=0 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.842+0000 7f5265ffb640 10 client.16008 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5265ffb640 1 -- 172.21.15.70:0/383784198 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ae7bfa17f0 con 0x55ae7c049960 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5265ffb640 10 client.16008 handle_command_reply: tid=0 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 client.16008 shutdown 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 -- 172.21.15.70:0/383784198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 msgr2=0x55ae7c036ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c036ba0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f52700ccf70 tx=0x7f527009b400 comp rx=0 tx=0).stop 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 -- 172.21.15.70:0/383784198 shutdown_connections 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ae7c049960 0x55ae7c04bd50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5265ffb640 0 client.16008 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:24.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c039d40 0x55ae7c037620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02f480 0x55ae7c0370e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 --2- 172.21.15.70:0/383784198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c036ba0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 -- 172.21.15.70:0/383784198 >> 172.21.15.70:0/383784198 conn(0x55ae7c02b0f0 msgr2=0x55ae7c030e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 -- 172.21.15.70:0/383784198 shutdown_connections 2024-09-19T04:35:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 1 -- 172.21.15.70:0/383784198 wait complete. 2024-09-19T04:35:24.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.843+0000 7f5286f23740 20 client.16008 trim_cache size 0 max 16384 2024-09-19T04:35:24.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f5286f23740 1 Processor -- start 2024-09-19T04:35:24.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f5286f23740 1 -- start start 2024-09-19T04:35:24.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f5286f23740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02eb60 0x55ae7c035b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f5286f23740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c0315c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f5286f23740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c039d40 0x55ae7c051510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f5286f23740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52801b66c0 con 0x55ae7c039d40 2024-09-19T04:35:24.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f5286f23740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52801b3ed0 con 0x55ae7c02f480 2024-09-19T04:35:24.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f5286f23740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52801b1d20 con 0x55ae7c02eb60 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f527ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c039d40 0x55ae7c051510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f527ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c039d40 0x55ae7c051510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58236/0 (socket says 172.21.15.70:58236) 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.860+0000 7f527ed9d640 1 -- 172.21.15.70:0/10045750 learned_addr learned my addr 172.21.15.70:0/10045750 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f527e59c640 1 --2- 172.21.15.70:0/10045750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02eb60 0x55ae7c035b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f527ed9d640 1 -- 172.21.15.70:0/10045750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02eb60 msgr2=0x55ae7c035b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f527ed9d640 1 --2- 172.21.15.70:0/10045750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02eb60 0x55ae7c035b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f527ed9d640 1 -- 172.21.15.70:0/10045750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 msgr2=0x55ae7c0315c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f527ed9d640 1 --2- 172.21.15.70:0/10045750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c0315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f527ed9d640 1 -- 172.21.15.70:0/10045750 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae7c02af20 con 0x55ae7c039d40 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f527ed9d640 1 --2- 172.21.15.70:0/10045750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c039d40 0x55ae7c051510 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5278010f10 tx=0x7f5278010f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de9764a9d0498bf4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5267fff640 1 -- 172.21.15.70:0/10045750 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f527801cab0 con 0x55ae7c039d40 2024-09-19T04:35:24.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5267fff640 1 -- 172.21.15.70:0/10045750 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f527801cc50 con 0x55ae7c039d40 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5267fff640 1 -- 172.21.15.70:0/10045750 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5278004020 con 0x55ae7c039d40 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5286f23740 1 -- 172.21.15.70:0/10045750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c039d40 msgr2=0x55ae7c051510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5286f23740 1 --2- 172.21.15.70:0/10045750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c039d40 0x55ae7c051510 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f5278010f10 tx=0x7f5278010f40 comp rx=0 tx=0).stop 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5286f23740 1 -- 172.21.15.70:0/10045750 shutdown_connections 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5286f23740 1 --2- 172.21.15.70:0/10045750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c039d40 0x55ae7c051510 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5286f23740 1 --2- 172.21.15.70:0/10045750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c0315c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.861+0000 7f5286f23740 1 --2- 172.21.15.70:0/10045750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c02eb60 0x55ae7c035b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 -- 172.21.15.70:0/10045750 >> 172.21.15.70:0/10045750 conn(0x55ae7c02b0f0 msgr2=0x55ae7c038b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 -- 172.21.15.70:0/10045750 shutdown_connections 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 -- 172.21.15.70:0/10045750 wait complete. 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 -- start start 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 Processor -- start 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c041ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c042220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f52801b2390 con 0x55ae7c02eb60 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f52801b3800 con 0x55ae7c02f480 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f52801b2a60 con 0x55ae7c039d40 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5286f23740 10 client.0 _ll_register_callbacks cb 0x7f5270009eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f527e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c041ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f527e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c041ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58252/0 (socket says 172.21.15.70:58252) 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f527e59c640 1 -- 172.21.15.70:0/1404948474 learned_addr learned my addr 172.21.15.70:0/1404948474 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f5277fff640 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c042220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.862+0000 7f527ed9d640 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f527e59c640 1 -- 172.21.15.70:0/1404948474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 msgr2=0x55ae7c03ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f527e59c640 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f527e59c640 1 -- 172.21.15.70:0/1404948474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 msgr2=0x55ae7c042220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f527e59c640 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c042220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f527e59c640 1 -- 172.21.15.70:0/1404948474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae7c03f1f0 con 0x55ae7c02eb60 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f527e59c640 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c041ce0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5270009f60 tx=0x7f5270098340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f30bd70d507e6e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5265ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5265ffb640 1 -- 172.21.15.70:0/1404948474 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5270014020 con 0x55ae7c02eb60 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5265ffb640 1 -- 172.21.15.70:0/1404948474 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f527009b0f0 con 0x55ae7c02eb60 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 1 -- 172.21.15.70:0/1404948474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f527801cc50 con 0x55ae7c02eb60 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5265ffb640 1 -- 172.21.15.70:0/1404948474 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f52700b9050 con 0x55ae7c02eb60 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 10 client.16014 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 1 -- 172.21.15.70:0/1404948474 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ae7c0b4cd0 con 0x55ae7c02eb60 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5265ffb640 1 -- 172.21.15.70:0/1404948474 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f527801cc50 con 0x55ae7c02eb60 2024-09-19T04:35:24.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5265ffb640 1 -- 172.21.15.70:0/1404948474 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f52700ba240 con 0x55ae7c02eb60 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 10 client.16014 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 10 client.16014 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 20 client.16014 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ae7c049960 0x55ae7c0b74e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 4 client.16014 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.863+0000 7f5286f23740 1 -- 172.21.15.70:0/1404948474 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ae7bf9bd00 con 0x55ae7c049960 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.864+0000 7f5277fff640 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ae7c049960 0x55ae7c0b74e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.864+0000 7f5277fff640 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ae7c049960 0x55ae7c0b74e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6276038b59eed46b server_cookie=41b8b65c84b81b4 in_seq=0 out_seq=0 2024-09-19T04:35:24.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.864+0000 7f5265ffb640 10 client.16014 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:24.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5265ffb640 1 -- 172.21.15.70:0/1404948474 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ae7bf9bd00 con 0x55ae7c049960 2024-09-19T04:35:24.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5265ffb640 10 client.16014 handle_command_reply: tid=0 2024-09-19T04:35:24.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 client.16014 shutdown 2024-09-19T04:35:24.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 -- 172.21.15.70:0/1404948474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 msgr2=0x55ae7c041ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c041ce0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f5270009f60 tx=0x7f5270098340 comp rx=0 tx=0).stop 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 -- 172.21.15.70:0/1404948474 shutdown_connections 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ae7c049960 0x55ae7c0b74e0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ae7c039d40 0x55ae7c03ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ae7c02f480 0x55ae7c042220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5265ffb640 0 client.16014 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 --2- 172.21.15.70:0/1404948474 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ae7c02eb60 0x55ae7c041ce0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 -- 172.21.15.70:0/1404948474 >> 172.21.15.70:0/1404948474 conn(0x55ae7c02b0f0 msgr2=0x55ae7c044b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 -- 172.21.15.70:0/1404948474 shutdown_connections 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.865+0000 7f5286f23740 1 -- 172.21.15.70:0/1404948474 wait complete. 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5286f23740 20 client.16014 trim_cache size 0 max 16384 2024-09-19T04:35:24.873 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:35:24.874 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:35:24.874 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "f8bca2d5-7beb-4df5-9913-855a60dab3d8", 2024-09-19T04:35:24.874 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:35:24.874 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:35:24.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 -- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f526c0a33b0 msgr2=0x7f526c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f526c0a33b0 0x7f526c0a5870 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f527801f000 tx=0x7f527801e000 comp rx=0 tx=0).stop 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 -- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280101de0 msgr2=0x7f52801a3610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280101de0 0x7f52801a3610 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f527000d770 tx=0x7f527000dc30 comp rx=0 tx=0).stop 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 -- 172.21.15.70:0/366262111 shutdown_connections 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f526c0a33b0 0x7f526c0a5870 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5280106f10 0x7f528010dbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5280102790 0x7f52801a3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 --2- 172.21.15.70:0/366262111 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5280101de0 0x7f52801a3610 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 -- 172.21.15.70:0/366262111 >> 172.21.15.70:0/366262111 conn(0x7f52800fd8c0 msgr2=0x7f52800ffc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 -- 172.21.15.70:0/366262111 shutdown_connections 2024-09-19T04:35:24.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:24.866+0000 7f5284b4a640 1 -- 172.21.15.70:0/366262111 wait complete. 2024-09-19T04:35:24.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:24 smithi167 ceph-mon[34339]: pgmap v142: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:24 smithi134 ceph-mon[34525]: pgmap v142: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:25.634 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:35:25.879 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:25 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:35:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:25 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:35:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:25 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:35:25.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:25 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:35:25.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:25 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:35:25.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:25 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:35:25.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:25 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:35:25.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:25 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:35:26.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:25 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:35:26.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:25 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:35:26.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:25 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:35:26.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:25 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:35:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 -- 172.21.15.70:0/3578268654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 msgr2=0x7f9618101600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 --2- 172.21.15.70:0/3578268654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 0x7f9618101600 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f9600009900 tx=0x7f960002a410 comp rx=0 tx=0).stop 2024-09-19T04:35:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 -- 172.21.15.70:0/3578268654 shutdown_connections 2024-09-19T04:35:26.334 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 --2- 172.21.15.70:0/3578268654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9618101b40 0x7f961810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 --2- 172.21.15.70:0/3578268654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 0x7f9618101600 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 --2- 172.21.15.70:0/3578268654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9618105ab0 0x7f9618105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 -- 172.21.15.70:0/3578268654 >> 172.21.15.70:0/3578268654 conn(0x7f96180fbee0 msgr2=0x7f96180fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 -- 172.21.15.70:0/3578268654 shutdown_connections 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.330+0000 7f961d8a6640 1 -- 172.21.15.70:0/3578268654 wait complete. 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f961d8a6640 1 Processor -- start 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f961d8a6640 1 -- start start 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f961d8a6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 0x7f96181993d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f961d8a6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9618101b40 0x7f9618199910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f961d8a6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9618105ab0 0x7f96181a4450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f961d8a6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9618110f40 con 0x7f96181011a0 2024-09-19T04:35:26.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f961d8a6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9618110dc0 con 0x7f9618105ab0 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f961d8a6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96181110c0 con 0x7f9618101b40 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f9616ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 0x7f96181993d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f9616ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 0x7f96181993d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58266/0 (socket says 172.21.15.70:58266) 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f9616ffd640 1 -- 172.21.15.70:0/4164490285 learned_addr learned my addr 172.21.15.70:0/4164490285 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f960e7fc640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9618101b40 0x7f9618199910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f96177fe640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9618105ab0 0x7f96181a4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f9616ffd640 1 -- 172.21.15.70:0/4164490285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9618101b40 msgr2=0x7f9618199910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f9616ffd640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9618101b40 0x7f9618199910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f9616ffd640 1 -- 172.21.15.70:0/4164490285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9618105ab0 msgr2=0x7f96181a4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f9616ffd640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9618105ab0 0x7f96181a4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f9616ffd640 1 -- 172.21.15.70:0/4164490285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96181a4990 con 0x7f96181011a0 2024-09-19T04:35:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.331+0000 7f960e7fc640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9618101b40 0x7f9618199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.332+0000 7f9616ffd640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 0x7f96181993d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f960800b4a0 tx=0x7f960800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.332+0000 7f961c8a4640 1 -- 172.21.15.70:0/4164490285 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608014070 con 0x7f96181011a0 2024-09-19T04:35:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.332+0000 7f961c8a4640 1 -- 172.21.15.70:0/4164490285 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9608010ae0 con 0x7f96181011a0 2024-09-19T04:35:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.332+0000 7f961d8a6640 1 -- 172.21.15.70:0/4164490285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96181a4b60 con 0x7f96181011a0 2024-09-19T04:35:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.332+0000 7f961c8a4640 1 -- 172.21.15.70:0/4164490285 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9608017c70 con 0x7f96181011a0 2024-09-19T04:35:26.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.332+0000 7f961d8a6640 1 -- 172.21.15.70:0/4164490285 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96181a5070 con 0x7f96181011a0 2024-09-19T04:35:26.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.334+0000 7f961c8a4640 1 -- 172.21.15.70:0/4164490285 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9608017070 con 0x7f96181011a0 2024-09-19T04:35:26.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.334+0000 7f961fc7f740 1 Processor -- start 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.334+0000 7f961fc7f740 1 -- start start 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e94a0 0x563ad59e9880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e9dc0 0x563ad59f4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad59f6a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f961fc7f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563ad594f2e0 con 0x563ad59e9dc0 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f961fc7f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563ad58f6ce0 con 0x563ad59e94a0 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f961fc7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563ad594b2a0 con 0x563ad59f4680 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e9dc0 0x563ad59f4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e9dc0 0x563ad59f4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58278/0 (socket says 172.21.15.70:58278) 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 -- 172.21.15.70:0/212559092 learned_addr learned my addr 172.21.15.70:0/212559092 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f96177fe640 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e94a0 0x563ad59e9880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f960e7fc640 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad59f6a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f961c8a4640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f96040a33b0 0x7f96040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 -- 172.21.15.70:0/212559092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 msgr2=0x563ad59f6a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad59f6a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 -- 172.21.15.70:0/212559092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e94a0 msgr2=0x563ad59e9880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e94a0 0x563ad59e9880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 -- 172.21.15.70:0/212559092 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ad58db440 con 0x563ad59e9dc0 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f96177fe640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f96040a33b0 0x7f96040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f961c8a4640 1 -- 172.21.15.70:0/4164490285 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f96080cf080 con 0x7f96181011a0 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.335+0000 7f9616ffd640 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e9dc0 0x563ad59f4140 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f96080cc7e0 tx=0x7f96080c6200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea4c25d0b192a56 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f960dffb640 1 -- 172.21.15.70:0/212559092 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960801e070 con 0x563ad59e9dc0 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f960dffb640 1 -- 172.21.15.70:0/212559092 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f96080c9b20 con 0x563ad59e9dc0 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f960dffb640 1 -- 172.21.15.70:0/212559092 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f96080cb020 con 0x563ad59e9dc0 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f961fc7f740 1 -- 172.21.15.70:0/212559092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e9dc0 msgr2=0x563ad59f4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f961fc7f740 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e9dc0 0x563ad59f4140 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f96080cc7e0 tx=0x7f96080c6200 comp rx=0 tx=0).stop 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f96177fe640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f96040a33b0 0x7f96040a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f96181066f0 tx=0x7f961000c040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f961fc7f740 1 -- 172.21.15.70:0/212559092 shutdown_connections 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f961fc7f740 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad59f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f961fc7f740 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e9dc0 0x563ad59f4140 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f961fc7f740 1 --2- 172.21.15.70:0/212559092 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e94a0 0x563ad59e9880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.336+0000 7f961fc7f740 1 -- 172.21.15.70:0/212559092 >> 172.21.15.70:0/212559092 conn(0x563ad59e5a30 msgr2=0x563ad59e5e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 -- 172.21.15.70:0/212559092 shutdown_connections 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 -- 172.21.15.70:0/212559092 wait complete. 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 -- start start 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 Processor -- start 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad59f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e9dc0 0x563ad59f1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59f4680 0x563ad59f1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563ad59f7250 con 0x563ad59e94a0 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563ad590a050 con 0x563ad59f4680 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563ad59f73d0 con 0x563ad59e9dc0 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.337+0000 7f961fc7f740 10 client.0 _ll_register_callbacks cb 0x563ad594a160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad59f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad59f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58294/0 (socket says 172.21.15.70:58294) 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 -- 172.21.15.70:0/2997233939 learned_addr learned my addr 172.21.15.70:0/2997233939 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f960e7fc640 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e9dc0 0x563ad59f1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f96177fe640 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59f4680 0x563ad59f1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 -- 172.21.15.70:0/2997233939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e9dc0 msgr2=0x563ad59f1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e9dc0 0x563ad59f1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 -- 172.21.15.70:0/2997233939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59f4680 msgr2=0x563ad59f1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:26.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59f4680 0x563ad59f1790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 -- 172.21.15.70:0/2997233939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ad56c03c0 con 0x563ad59e94a0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f9616ffd640 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad59f3fa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f96080a3b70 tx=0x7f96080092d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1ca6bfcf9c871b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f95f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f95f6ffd640 1 -- 172.21.15.70:0/2997233939 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960801e050 con 0x563ad59e94a0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f95f6ffd640 1 -- 172.21.15.70:0/2997233939 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f9608017360 con 0x563ad59e94a0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f961fc7f740 1 -- 172.21.15.70:0/2997233939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x563ad595c850 con 0x563ad59e94a0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f95f6ffd640 1 -- 172.21.15.70:0/2997233939 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f960809af70 con 0x563ad59e94a0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f961fc7f740 10 client.16026 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f961fc7f740 1 -- 172.21.15.70:0/2997233939 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563ad5a02bd0 con 0x563ad59e94a0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.338+0000 7f95f6ffd640 1 -- 172.21.15.70:0/2997233939 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x563ad595c850 con 0x563ad59e94a0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.339+0000 7f95f6ffd640 1 -- 172.21.15.70:0/2997233939 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f96080cb9e0 con 0x563ad59e94a0 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.339+0000 7f961fc7f740 10 client.16026 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:26.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.339+0000 7f961fc7f740 10 client.16026 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.339+0000 7f961fc7f740 20 client.16026 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.339+0000 7f961fc7f740 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563ad5a03f20 0x563ad5a06310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.339+0000 7f961fc7f740 4 client.16026 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.339+0000 7f961fc7f740 1 -- 172.21.15.70:0/2997233939 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ad5956d60 con 0x563ad5a03f20 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.339+0000 7f960e7fc640 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563ad5a03f20 0x563ad5a06310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.340+0000 7f95f6ffd640 10 client.16026 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.340+0000 7f960e7fc640 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563ad5a03f20 0x563ad5a06310 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cc72b837cd8a6bf server_cookie=26063eeeb002e6be in_seq=0 out_seq=0 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.340+0000 7f95f6ffd640 1 -- 172.21.15.70:0/2997233939 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563ad5956d60 con 0x563ad5a03f20 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.340+0000 7f95f6ffd640 10 client.16026 handle_command_reply: tid=0 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.340+0000 7f961fc7f740 1 client.16026 shutdown 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.340+0000 7f961fc7f740 1 -- 172.21.15.70:0/2997233939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 msgr2=0x563ad59f3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad59f3fa0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f96080a3b70 tx=0x7f96080092d0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 -- 172.21.15.70:0/2997233939 shutdown_connections 2024-09-19T04:35:26.348 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563ad5a03f20 0x563ad5a06310 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59f4680 0x563ad59f1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e9dc0 0x563ad59f1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 --2- 172.21.15.70:0/2997233939 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad59f3fa0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f95f6ffd640 0 client.16026 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:26.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 -- 172.21.15.70:0/2997233939 >> 172.21.15.70:0/2997233939 conn(0x563ad59e5a30 msgr2=0x563ad59eb760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:26.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 -- 172.21.15.70:0/2997233939 shutdown_connections 2024-09-19T04:35:26.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 1 -- 172.21.15.70:0/2997233939 wait complete. 2024-09-19T04:35:26.349 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.341+0000 7f961fc7f740 20 client.16026 trim_cache size 0 max 16384 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f961fc7f740 1 Processor -- start 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f961fc7f740 1 -- start start 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e94a0 0x563ad59efb20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad59e4a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59f4680 0x563ad59ee4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f961fc7f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96181b02e0 con 0x563ad59f4680 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f961fc7f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96181adaf0 con 0x563ad59e9dc0 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f961fc7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96181ab960 con 0x563ad59e94a0 2024-09-19T04:35:26.361 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59f4680 0x563ad59ee4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59f4680 0x563ad59ee4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58298/0 (socket says 172.21.15.70:58298) 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 -- 172.21.15.70:0/3995017578 learned_addr learned my addr 172.21.15.70:0/3995017578 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f9616ffd640 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e94a0 0x563ad59efb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f960e7fc640 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad59e4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 -- 172.21.15.70:0/3995017578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e94a0 msgr2=0x563ad59efb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e94a0 0x563ad59efb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 -- 172.21.15.70:0/3995017578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 msgr2=0x563ad59e4a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad59e4a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 -- 172.21.15.70:0/3995017578 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ad59e8c80 con 0x563ad59f4680 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f960e7fc640 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad59e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.358+0000 7f96177fe640 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59f4680 0x563ad59ee4b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f96100195a0 tx=0x7f9610004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85f55ca4c7574a00 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:26.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f960d7fa640 1 -- 172.21.15.70:0/3995017578 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610027070 con 0x563ad59f4680 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f960d7fa640 1 -- 172.21.15.70:0/3995017578 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9610016910 con 0x563ad59f4680 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f960d7fa640 1 -- 172.21.15.70:0/3995017578 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9610022860 con 0x563ad59f4680 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 -- 172.21.15.70:0/3995017578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59f4680 msgr2=0x563ad59ee4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59f4680 0x563ad59ee4b0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f96100195a0 tx=0x7f9610004a40 comp rx=0 tx=0).stop 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 -- 172.21.15.70:0/3995017578 shutdown_connections 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59f4680 0x563ad59ee4b0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad59e4a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 --2- 172.21.15.70:0/3995017578 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59e94a0 0x563ad59efb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 -- 172.21.15.70:0/3995017578 >> 172.21.15.70:0/3995017578 conn(0x563ad59e5a30 msgr2=0x563ad59e4350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 -- 172.21.15.70:0/3995017578 shutdown_connections 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.359+0000 7f961fc7f740 1 -- 172.21.15.70:0/3995017578 wait complete. 2024-09-19T04:35:26.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 1 -- start start 2024-09-19T04:35:26.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 1 Processor -- start 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad5a07360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad5a078a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad5a07de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f96181abfb0 con 0x563ad59e94a0 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f96181ad420 con 0x563ad59e9dc0 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f96181ac680 con 0x563ad59f4680 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f961fc7f740 10 client.0 _ll_register_callbacks cb 0x7f9610009650 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f9616ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad5a07360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f9616ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad5a07360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58300/0 (socket says 172.21.15.70:58300) 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f9616ffd640 1 -- 172.21.15.70:0/235849835 learned_addr learned my addr 172.21.15.70:0/235849835 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f96177fe640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad5a07de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f9616ffd640 1 -- 172.21.15.70:0/235849835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 msgr2=0x563ad5a07de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:26.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f9616ffd640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad5a07de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f960e7fc640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad5a078a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f9616ffd640 1 -- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 msgr2=0x563ad5a078a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f9616ffd640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad5a078a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f9616ffd640 1 -- 172.21.15.70:0/235849835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ad5a6db00 con 0x563ad59e94a0 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f96177fe640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad5a07de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.360+0000 7f960e7fc640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad5a078a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f9616ffd640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad5a07360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9608097890 tx=0x7f960809f860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111107c7a5e7a953 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f95f6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f95f6ffd640 1 -- 172.21.15.70:0/235849835 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f960801e050 con 0x563ad59e94a0 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f95f6ffd640 1 -- 172.21.15.70:0/235849835 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f96080a0b60 con 0x563ad59e94a0 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 1 -- 172.21.15.70:0/235849835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9610016910 con 0x563ad59e94a0 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f95f6ffd640 1 -- 172.21.15.70:0/235849835 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f960809bb30 con 0x563ad59e94a0 2024-09-19T04:35:26.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 10 client.16032 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 1 -- 172.21.15.70:0/235849835 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x563ad5a6db00 con 0x563ad59e94a0 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f95f6ffd640 1 -- 172.21.15.70:0/235849835 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9610016910 con 0x563ad59e94a0 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f95f6ffd640 1 -- 172.21.15.70:0/235849835 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9608010610 con 0x563ad59e94a0 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 10 client.16032 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 10 client.16032 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 20 client.16032 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563ad5a6f0c0 0x563ad5a714b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 4 client.16032 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.361+0000 7f961fc7f740 1 -- 172.21.15.70:0/235849835 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x563ad58d3210 con 0x563ad5a6f0c0 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.362+0000 7f960e7fc640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563ad5a6f0c0 0x563ad5a714b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.362+0000 7f95f6ffd640 10 client.16032 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:26.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.362+0000 7f960e7fc640 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563ad5a6f0c0 0x563ad5a714b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d1245a740ecee88c server_cookie=5784027b596f4a91 in_seq=0 out_seq=0 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f95f6ffd640 1 -- 172.21.15.70:0/235849835 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x563ad58d3210 con 0x563ad5a6f0c0 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f95f6ffd640 10 client.16032 handle_command_reply: tid=0 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 client.16032 shutdown 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 -- 172.21.15.70:0/235849835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 msgr2=0x563ad5a07360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad5a07360 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f9608097890 tx=0x7f960809f860 comp rx=0 tx=0).stop 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 -- 172.21.15.70:0/235849835 shutdown_connections 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563ad5a6f0c0 0x563ad5a714b0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f95f6ffd640 0 client.16032 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563ad59f4680 0x563ad5a07de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563ad59e9dc0 0x563ad5a078a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 --2- 172.21.15.70:0/235849835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563ad59e94a0 0x563ad5a07360 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 -- 172.21.15.70:0/235849835 >> 172.21.15.70:0/235849835 conn(0x563ad59e5a30 msgr2=0x563ad59f2ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:26.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 -- 172.21.15.70:0/235849835 shutdown_connections 2024-09-19T04:35:26.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 1 -- 172.21.15.70:0/235849835 wait complete. 2024-09-19T04:35:26.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961fc7f740 20 client.16032 trim_cache size 0 max 16384 2024-09-19T04:35:26.371 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:35:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:35:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:35:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "f8bca2d5-7beb-4df5-9913-855a60dab3d8": { 2024-09-19T04:35:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:35:26.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "f8bca2d5-7beb-4df5-9913-855a60dab3d8", 2024-09-19T04:35:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:35:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:35:26.372 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:35:26.372 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:35:26.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961d8a6640 1 -- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f96040a33b0 msgr2=0x7f96040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961d8a6640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f96040a33b0 0x7f96040a5870 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f96181066f0 tx=0x7f961000c040 comp rx=0 tx=0).stop 2024-09-19T04:35:26.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961d8a6640 1 -- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 msgr2=0x7f96181993d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.363+0000 7f961d8a6640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 0x7f96181993d0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f960800b4a0 tx=0x7f960800b960 comp rx=0 tx=0).stop 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.364+0000 7f961d8a6640 1 -- 172.21.15.70:0/4164490285 shutdown_connections 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.364+0000 7f961d8a6640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f96040a33b0 0x7f96040a5870 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.364+0000 7f961d8a6640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9618105ab0 0x7f96181a4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.364+0000 7f961d8a6640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9618101b40 0x7f9618199910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.364+0000 7f961d8a6640 1 --2- 172.21.15.70:0/4164490285 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f96181011a0 0x7f96181993d0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.364+0000 7f961d8a6640 1 -- 172.21.15.70:0/4164490285 >> 172.21.15.70:0/4164490285 conn(0x7f96180fbee0 msgr2=0x7f96180fc770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.364+0000 7f961d8a6640 1 -- 172.21.15.70:0/4164490285 shutdown_connections 2024-09-19T04:35:26.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:26.364+0000 7f961d8a6640 1 -- 172.21.15.70:0/4164490285 wait complete. 2024-09-19T04:35:26.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:26 smithi167 ceph-mon[34339]: pgmap v143: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:27.017 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:26 smithi070 ceph-mon[30942]: pgmap v143: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:26 smithi134 ceph-mon[34525]: pgmap v143: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:27.151 INFO:tasks.cephfs.filesystem:scrub status for tag:f8bca2d5-7beb-4df5-9913-855a60dab3d8 - {'path': '/', 'tag': 'f8bca2d5-7beb-4df5-9913-855a60dab3d8', 'options': 'recursive,force'} 2024-09-19T04:35:27.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:27 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:35:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:27 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:35:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:27 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:35:28.936 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:28 smithi134 ceph-mon[34525]: pgmap v144: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:28.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:28 smithi167 ceph-mon[34339]: pgmap v144: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:29.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:28 smithi070 ceph-mon[30942]: pgmap v144: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:30.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:30 smithi167 ceph-mon[34339]: pgmap v145: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:31.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:30 smithi134 ceph-mon[34525]: pgmap v145: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:31.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:30 smithi070 ceph-mon[30942]: pgmap v145: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:32.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:32 smithi167 ceph-mon[34339]: pgmap v146: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:33.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:32 smithi134 ceph-mon[34525]: pgmap v146: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:33.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:32 smithi070 ceph-mon[30942]: pgmap v146: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:34.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:34 smithi167 ceph-mon[34339]: pgmap v147: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:34 smithi134 ceph-mon[34525]: pgmap v147: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:34 smithi070 ceph-mon[30942]: pgmap v147: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:36 smithi070 ceph-mon[30942]: pgmap v148: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:36.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:36 smithi167 ceph-mon[34339]: pgmap v148: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:37.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:36 smithi134 ceph-mon[34525]: pgmap v148: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:35:38.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:38 smithi167 ceph-mon[34339]: pgmap v149: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:38 smithi134 ceph-mon[34525]: pgmap v149: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:39.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:38 smithi070 ceph-mon[30942]: pgmap v149: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:35:40.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:40 smithi167 ceph-mon[34339]: pgmap v150: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:40 smithi134 ceph-mon[34525]: pgmap v150: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:41.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:40 smithi070 ceph-mon[30942]: pgmap v150: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:42.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:42 smithi167 ceph-mon[34339]: pgmap v151: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:42 smithi134 ceph-mon[34525]: pgmap v151: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:43.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:42 smithi070 ceph-mon[30942]: pgmap v151: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:44.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:44 smithi167 ceph-mon[34339]: pgmap v152: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:44 smithi134 ceph-mon[34525]: pgmap v152: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:45.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:44 smithi070 ceph-mon[30942]: pgmap v152: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:46.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:46 smithi167 ceph-mon[34339]: pgmap v153: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:46 smithi134 ceph-mon[34525]: pgmap v153: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:47.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:46 smithi070 ceph-mon[30942]: pgmap v153: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:48.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:48 smithi167 ceph-mon[34339]: pgmap v154: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:48 smithi134 ceph-mon[34525]: pgmap v154: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:49.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:48 smithi070 ceph-mon[30942]: pgmap v154: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:50.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:50 smithi167 ceph-mon[34339]: pgmap v155: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:50 smithi134 ceph-mon[34525]: pgmap v155: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:51.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:50 smithi070 ceph-mon[30942]: pgmap v155: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:52.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:52 smithi167 ceph-mon[34339]: pgmap v156: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:52 smithi134 ceph-mon[34525]: pgmap v156: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:53.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:52 smithi070 ceph-mon[30942]: pgmap v156: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:54.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:54 smithi167 ceph-mon[34339]: pgmap v157: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:54 smithi134 ceph-mon[34525]: pgmap v157: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:55.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:54 smithi070 ceph-mon[30942]: pgmap v157: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:56.947 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:56 smithi070 ceph-mon[30942]: pgmap v158: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:56.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:56 smithi167 ceph-mon[34339]: pgmap v158: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:56 smithi134 ceph-mon[34525]: pgmap v158: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:35:57.153 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:35:57.412 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.843+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/3227300160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 msgr2=0x7f4cc810df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.843+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/3227300160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 0x7f4cc810df00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009900 tx=0x7f4cb002a480 comp rx=0 tx=0).stop 2024-09-19T04:35:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.843+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/3227300160 shutdown_connections 2024-09-19T04:35:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.843+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/3227300160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc810e440 0x7f4cc8110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.843+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/3227300160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 0x7f4cc810df00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.843+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/3227300160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc8074510 0x7f4cc80748f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.843+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/3227300160 >> 172.21.15.70:0/3227300160 conn(0x7f4cc80fd8c0 msgr2=0x7f4cc80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.843+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/3227300160 shutdown_connections 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.844+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/3227300160 wait complete. 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.844+0000 7f4ccdfbb640 1 Processor -- start 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.844+0000 7f4ccdfbb640 1 -- start start 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4ccdfbb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc8074510 0x7f4cc81a0560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4ccdfbb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 0x7f4cc81a0aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4ccdfbb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc810e440 0x7f4cc819a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4ccdfbb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc8114240 con 0x7f4cc8074e30 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4ccdfbb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81140c0 con 0x7f4cc8074510 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4ccdfbb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81143c0 con 0x7f4cc810e440 2024-09-19T04:35:57.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 0x7f4cc81a0aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 0x7f4cc81a0aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53454/0 (socket says 172.21.15.70:53454) 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 -- 172.21.15.70:0/417601819 learned_addr learned my addr 172.21.15.70:0/417601819 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc8074510 0x7f4cc81a0560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc810e440 0x7f4cc819a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 -- 172.21.15.70:0/417601819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc810e440 msgr2=0x7f4cc819a630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc810e440 0x7f4cc819a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 -- 172.21.15.70:0/417601819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc8074510 msgr2=0x7f4cc81a0560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc8074510 0x7f4cc81a0560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 -- 172.21.15.70:0/417601819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4cc819aea0 con 0x7f4cc8074e30 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.845+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 0x7f4cc81a0aa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009a20 tx=0x7f4cb00043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.846+0000 7f4cc57fa640 1 -- 172.21.15.70:0/417601819 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb003f030 con 0x7f4cc8074e30 2024-09-19T04:35:57.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.846+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/417601819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4cc819b130 con 0x7f4cc8074e30 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.846+0000 7f4cc57fa640 1 -- 172.21.15.70:0/417601819 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4cb0031b80 con 0x7f4cc8074e30 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.846+0000 7f4cc57fa640 1 -- 172.21.15.70:0/417601819 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0035070 con 0x7f4cc8074e30 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.846+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/417601819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4cc81a7310 con 0x7f4cc8074e30 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.848+0000 7f4cc57fa640 1 -- 172.21.15.70:0/417601819 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4cb00035f0 con 0x7f4cc8074e30 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.848+0000 7f4cd0394740 1 Processor -- start 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cd0394740 1 -- start start 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc57fa640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cb40a33b0 0x7f4cb40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b159592880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b15959d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b15959d680 0x55b15959fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cd0394740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b1594f82e0 con 0x55b1595924a0 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cd0394740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b15949fce0 con 0x55b159592dc0 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cd0394740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b1594f42a0 con 0x55b15959d680 2024-09-19T04:35:57.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cb40a33b0 0x7f4cb40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b159592880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b159592880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53466/0 (socket says 172.21.15.70:53466) 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 -- 172.21.15.70:0/3445753281 learned_addr learned my addr 172.21.15.70:0/3445753281 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc57fa640 1 -- 172.21.15.70:0/417601819 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4cb00f08c0 con 0x7f4cc8074e30 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b15959d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b15959d680 0x55b15959fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 -- 172.21.15.70:0/3445753281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b15959d680 msgr2=0x55b15959fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b15959d680 0x55b15959fa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 -- 172.21.15.70:0/3445753281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 msgr2=0x55b15959d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b15959d140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 -- 172.21.15.70:0/3445753281 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b159484440 con 0x55b1595924a0 2024-09-19T04:35:57.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b15959d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cb40a33b0 0x7f4cb40a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80754f0 tx=0x7f4cc0011610 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.849+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b159592880 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800b820 tx=0x7f4cb800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=441f491a3374bbfd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cbdffb640 1 -- 172.21.15.70:0/3445753281 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb800d8d0 con 0x55b1595924a0 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cbdffb640 1 -- 172.21.15.70:0/3445753281 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4cb8019070 con 0x55b1595924a0 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cbdffb640 1 -- 172.21.15.70:0/3445753281 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb80123e0 con 0x55b1595924a0 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 -- 172.21.15.70:0/3445753281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 msgr2=0x55b159592880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b159592880 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f4cb800b820 tx=0x7f4cb800bce0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 -- 172.21.15.70:0/3445753281 shutdown_connections 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b15959d680 0x55b15959fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b15959d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 --2- 172.21.15.70:0/3445753281 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b159592880 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 -- 172.21.15.70:0/3445753281 >> 172.21.15.70:0/3445753281 conn(0x55b15958ea30 msgr2=0x55b15958ee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 -- 172.21.15.70:0/3445753281 shutdown_connections 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.850+0000 7f4cd0394740 1 -- 172.21.15.70:0/3445753281 wait complete. 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 1 -- start start 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 1 Processor -- start 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1595924a0 0x55b15959cef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 0x55b15959a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15959d680 0x55b15959a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b1595a0250 con 0x55b15959d680 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b1594b3050 con 0x55b1595924a0 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b1595a03d0 con 0x55b159592dc0 2024-09-19T04:35:57.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cd0394740 10 client.0 _ll_register_callbacks cb 0x55b1594f3160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15959d680 0x55b15959a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cc7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15959d680 0x55b15959a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53470/0 (socket says 172.21.15.70:53470) 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cc7fff640 1 -- 172.21.15.70:0/2254332326 learned_addr learned my addr 172.21.15.70:0/2254332326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 0x55b15959a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.851+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1595924a0 0x55b15959cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cc7fff640 1 -- 172.21.15.70:0/2254332326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 msgr2=0x55b15959a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 0x55b15959a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cc7fff640 1 -- 172.21.15.70:0/2254332326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1595924a0 msgr2=0x55b15959cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1595924a0 0x55b15959cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cc7fff640 1 -- 172.21.15.70:0/2254332326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1592693c0 con 0x55b15959d680 2024-09-19T04:35:57.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15959d680 0x55b15959a6e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0018e30 tx=0x7f4cc0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2b745cb51b3c1c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4ca6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/2254332326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cc0015df0 con 0x55b15959d680 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/2254332326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4cc0011dc0 con 0x55b15959d680 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cd0394740 1 -- 172.21.15.70:0/2254332326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb8019070 con 0x55b15959d680 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/2254332326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4cc002c440 con 0x55b15959d680 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cd0394740 10 client.16044 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4cd0394740 1 -- 172.21.15.70:0/2254332326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1595abb70 con 0x55b15959d680 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.852+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/2254332326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4cb8019070 con 0x55b15959d680 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.853+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/2254332326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4cc002a020 con 0x55b15959d680 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.853+0000 7f4cd0394740 10 client.16044 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.853+0000 7f4cd0394740 10 client.16044 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.853+0000 7f4cd0394740 20 client.16044 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.853+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b1595ad070 0x55b1595af4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.853+0000 7f4cd0394740 4 client.16044 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.853+0000 7f4cd0394740 1 -- 172.21.15.70:0/2254332326 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b159505850 con 0x55b1595ad070 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.853+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b1595ad070 0x55b1595af4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.854+0000 7f4ca6ffd640 10 client.16044 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.854+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b1595ad070 0x55b1595af4f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324573c412517985 server_cookie=3a698527e1a4b4c7 in_seq=0 out_seq=0 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.854+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/2254332326 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b159505850 con 0x55b1595ad070 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.854+0000 7f4ca6ffd640 10 client.16044 handle_command_reply: tid=0 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.854+0000 7f4cd0394740 1 client.16044 shutdown 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 -- 172.21.15.70:0/2254332326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15959d680 msgr2=0x55b15959a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15959d680 0x55b15959a6e0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f4cc0018e30 tx=0x7f4cc0004a40 comp rx=0 tx=0).stop 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 -- 172.21.15.70:0/2254332326 shutdown_connections 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b1595ad070 0x55b1595af4f0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15959d680 0x55b15959a6e0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 0x55b15959a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2254332326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b1595924a0 0x55b15959cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 -- 172.21.15.70:0/2254332326 >> 172.21.15.70:0/2254332326 conn(0x55b15958ea30 msgr2=0x55b15958db90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4ca6ffd640 0 client.16044 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 -- 172.21.15.70:0/2254332326 shutdown_connections 2024-09-19T04:35:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 1 -- 172.21.15.70:0/2254332326 wait complete. 2024-09-19T04:35:57.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.855+0000 7f4cd0394740 20 client.16044 trim_cache size 0 max 16384 2024-09-19T04:35:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.885+0000 7f4cd0394740 1 Processor -- start 2024-09-19T04:35:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cd0394740 1 -- start start 2024-09-19T04:35:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15958ea30 0x55b1595b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1595924a0 0x55b1595b5300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b159597400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cd0394740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81b2450 con 0x55b15958ea30 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cd0394740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81afc60 con 0x55b159592dc0 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cd0394740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81adab0 con 0x55b1595924a0 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15958ea30 0x55b1595b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15958ea30 0x55b1595b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53474/0 (socket says 172.21.15.70:53474) 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc77fe640 1 -- 172.21.15.70:0/2304740312 learned_addr learned my addr 172.21.15.70:0/2304740312 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1595924a0 0x55b1595b5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b159597400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc77fe640 1 -- 172.21.15.70:0/2304740312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1595924a0 msgr2=0x55b1595b5300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1595924a0 0x55b1595b5300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc77fe640 1 -- 172.21.15.70:0/2304740312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 msgr2=0x55b159597400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:57.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b159597400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc77fe640 1 -- 172.21.15.70:0/2304740312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1595986f0 con 0x55b15958ea30 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.886+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b159597400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.887+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15958ea30 0x55b1595b4dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8014450 tx=0x7f4cb800f040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38781667c62e6f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.887+0000 7f4cbd7fa640 1 -- 172.21.15.70:0/2304740312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb802d070 con 0x55b15958ea30 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.887+0000 7f4cbd7fa640 1 -- 172.21.15.70:0/2304740312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4cb8019040 con 0x55b15958ea30 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.887+0000 7f4cbd7fa640 1 -- 172.21.15.70:0/2304740312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb8027650 con 0x55b15958ea30 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 -- 172.21.15.70:0/2304740312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15958ea30 msgr2=0x55b1595b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15958ea30 0x55b1595b4dc0 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f4cb8014450 tx=0x7f4cb800f040 comp rx=0 tx=0).stop 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 -- 172.21.15.70:0/2304740312 shutdown_connections 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b159592dc0 0x55b159597400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b1595924a0 0x55b1595b5300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 --2- 172.21.15.70:0/2304740312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b15958ea30 0x55b1595b4dc0 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 -- 172.21.15.70:0/2304740312 >> 172.21.15.70:0/2304740312 conn(0x55b15959a840 msgr2=0x55b159598a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 -- 172.21.15.70:0/2304740312 shutdown_connections 2024-09-19T04:35:57.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 -- 172.21.15.70:0/2304740312 wait complete. 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 -- start start 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.888+0000 7f4cd0394740 1 Processor -- start 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15958ea30 0x55b1595a17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b1595a1d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cd0394740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 0x55b159616d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cd0394740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81ae120 con 0x55b1595924a0 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cd0394740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81af590 con 0x55b15958ea30 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cd0394740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4cc81ae7f0 con 0x55b159592dc0 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cd0394740 10 client.0 _ll_register_callbacks cb 0x7f4cc0008a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:35:57.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b1595a1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b1595a1d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53486/0 (socket says 172.21.15.70:53486) 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 -- 172.21.15.70:0/1531119049 learned_addr learned my addr 172.21.15.70:0/1531119049 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15958ea30 0x55b1595a17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cc7fff640 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 0x55b159616d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 -- 172.21.15.70:0/1531119049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 msgr2=0x55b159616d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 0x55b159616d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 -- 172.21.15.70:0/1531119049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15958ea30 msgr2=0x55b1595a17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15958ea30 0x55b1595a17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 -- 172.21.15.70:0/1531119049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1595a25f0 con 0x55b1595924a0 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cbeffd640 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b1595a1d10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00b9020 tx=0x7f4cb00047a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5efe1e1b80218e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4ca6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:35:57.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/1531119049 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cb0049040 con 0x55b1595924a0 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/1531119049 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4cb00ee2b0 con 0x55b1595924a0 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.889+0000 7f4cd0394740 1 -- 172.21.15.70:0/1531119049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4cb8019040 con 0x55b1595924a0 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/1531119049 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f4cb00ee4b0 con 0x55b1595924a0 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cd0394740 10 client.16050 fetch_fsmap learned FSMap version 28 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cd0394740 1 -- 172.21.15.70:0/1531119049 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55b1596183f0 con 0x55b1595924a0 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/1531119049 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4cb00d3020 con 0x55b1595924a0 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/1531119049 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f4cb00970f0 con 0x55b1595924a0 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cd0394740 10 client.16050 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cd0394740 10 client.16050 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cd0394740 20 client.16050 populate_metadata read hostname 'smithi070' 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cd0394740 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b15959d680 0x55b15961ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cd0394740 4 client.16050 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cd0394740 1 -- 172.21.15.70:0/1531119049 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f4cb8019040 con 0x55b15959d680 2024-09-19T04:35:57.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.890+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b15959d680 0x55b15961ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cc77fe640 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b15959d680 0x55b15961ac10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6fba371196039a68 server_cookie=655b615a0f3ce23a in_seq=0 out_seq=0 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4ca6ffd640 10 client.16050 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4ca6ffd640 1 -- 172.21.15.70:0/1531119049 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x7f4cb8019040 con 0x55b15959d680 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4ca6ffd640 10 client.16050 handle_command_reply: tid=0 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 client.16050 shutdown 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 -- 172.21.15.70:0/1531119049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 msgr2=0x55b1595a1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b1595a1d10 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f4cb00b9020 tx=0x7f4cb00047a0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 -- 172.21.15.70:0/1531119049 shutdown_connections 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b15959d680 0x55b15961ac10 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b159592dc0 0x55b159616d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b1595924a0 0x55b1595a1d10 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4ca6ffd640 0 client.16050 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 --2- 172.21.15.70:0/1531119049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b15958ea30 0x55b1595a17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 -- 172.21.15.70:0/1531119049 >> 172.21.15.70:0/1531119049 conn(0x55b15959a840 msgr2=0x55b15959ba00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:57.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 -- 172.21.15.70:0/1531119049 shutdown_connections 2024-09-19T04:35:57.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 1 -- 172.21.15.70:0/1531119049 wait complete. 2024-09-19T04:35:57.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.891+0000 7f4cd0394740 20 client.16050 trim_cache size 0 max 16384 2024-09-19T04:35:57.900 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:35:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:35:57.900 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:35:57.900 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cb40a33b0 msgr2=0x7f4cb40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cb40a33b0 0x7f4cb40a5870 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f4cc80754f0 tx=0x7f4cc0011610 comp rx=0 tx=0).stop 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 msgr2=0x7f4cc81a0aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 0x7f4cc81a0aa0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f4cb0009a20 tx=0x7f4cb00043b0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/417601819 shutdown_connections 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cb40a33b0 0x7f4cb40a5870 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4cc810e440 0x7f4cc819a630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4cc8074e30 0x7f4cc81a0aa0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 --2- 172.21.15.70:0/417601819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4cc8074510 0x7f4cc81a0560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/417601819 >> 172.21.15.70:0/417601819 conn(0x7f4cc80fd8c0 msgr2=0x7f4cc80ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/417601819 shutdown_connections 2024-09-19T04:35:57.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:57.892+0000 7f4ccdfbb640 1 -- 172.21.15.70:0/417601819 wait complete. 2024-09-19T04:35:58.659 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:35:58.660 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:35:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:58 smithi070 ceph-mon[30942]: pgmap v159: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:58.921 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:35:58.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:58 smithi167 ceph-mon[34339]: pgmap v159: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:58 smithi134 ceph-mon[34525]: pgmap v159: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:35:59.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.385+0000 7fefc68ec640 1 -- 172.21.15.70:0/230378945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc01036e0 msgr2=0x7fefc0107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:59.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.385+0000 7fefc68ec640 1 --2- 172.21.15.70:0/230378945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc01036e0 0x7fefc0107b90 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009930 tx=0x7fefb402a420 comp rx=0 tx=0).stop 2024-09-19T04:35:59.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 -- 172.21.15.70:0/230378945 shutdown_connections 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 --2- 172.21.15.70:0/230378945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc01082a0 0x7fefc010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 --2- 172.21.15.70:0/230378945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc01036e0 0x7fefc0107b90 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 --2- 172.21.15.70:0/230378945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc0102d30 0x7fefc0103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 -- 172.21.15.70:0/230378945 >> 172.21.15.70:0/230378945 conn(0x7fefc00fc7d0 msgr2=0x7fefc00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 -- 172.21.15.70:0/230378945 shutdown_connections 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 -- 172.21.15.70:0/230378945 wait complete. 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 Processor -- start 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.386+0000 7fefc68ec640 1 -- start start 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc68ec640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc0102d30 0x7fefc0198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc68ec640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc01036e0 0x7fefc0198c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:59.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc68ec640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc01082a0 0x7fefc019d010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc68ec640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefc0112130 con 0x7fefc0102d30 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc68ec640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fefc0111fb0 con 0x7fefc01036e0 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc68ec640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fefc01122b0 con 0x7fefc01082a0 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc0102d30 0x7fefc0198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc0102d30 0x7fefc0198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53500/0 (socket says 172.21.15.70:53500) 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 -- 172.21.15.70:0/923514417 learned_addr learned my addr 172.21.15.70:0/923514417 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbf7fe640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc01036e0 0x7fefc0198c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc4e89640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc01082a0 0x7fefc019d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 -- 172.21.15.70:0/923514417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc01082a0 msgr2=0x7fefc019d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc01082a0 0x7fefc019d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 -- 172.21.15.70:0/923514417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc01036e0 msgr2=0x7fefc0198c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc01036e0 0x7fefc0198c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 -- 172.21.15.70:0/923514417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc019d6f0 con 0x7fefc0102d30 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc4e89640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc01082a0 0x7fefc019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbffff640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc0102d30 0x7fefc0198740 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fefb000b4a0 tx=0x7fefb000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbd7fa640 1 -- 172.21.15.70:0/923514417 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0014070 con 0x7fefc0102d30 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc019d9e0 con 0x7fefc0102d30 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbd7fa640 1 -- 172.21.15.70:0/923514417 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fefb0010ae0 con 0x7fefc0102d30 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefbd7fa640 1 -- 172.21.15.70:0/923514417 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb0017c70 con 0x7fefc0102d30 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.387+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc01a52c0 con 0x7fefc0102d30 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.388+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefc006a850 con 0x7fefc0102d30 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.389+0000 7fefbd7fa640 1 -- 172.21.15.70:0/923514417 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fefb0017070 con 0x7fefc0102d30 2024-09-19T04:35:59.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.390+0000 7fefbd7fa640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefa80a33b0 0x7fefa80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:35:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.390+0000 7fefbf7fe640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefa80a33b0 0x7fefa80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:35:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.390+0000 7fefbd7fa640 1 -- 172.21.15.70:0/923514417 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fefb00cf7e0 con 0x7fefc0102d30 2024-09-19T04:35:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.391+0000 7fefbf7fe640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefa80a33b0 0x7fefa80a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009900 tx=0x7fefb4000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:35:59.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.393+0000 7fefbd7fa640 1 -- 172.21.15.70:0/923514417 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fefb009c290 con 0x7fefc0102d30 2024-09-19T04:35:59.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.594+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fefc010a2b0 con 0x7fefc0102d30 2024-09-19T04:35:59.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.595+0000 7fefbd7fa640 1 -- 172.21.15.70:0/923514417 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7fefb009bb90 con 0x7fefc0102d30 2024-09-19T04:35:59.597 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:35:59.597 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-19T04:34:07:652724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:34:07.594198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:35:59.597 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-19T04:35:59.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefa80a33b0 msgr2=0x7fefa80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:59.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefa80a33b0 0x7fefa80a5870 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fefb4009900 tx=0x7fefb4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc0102d30 msgr2=0x7fefc0198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:35:59.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc0102d30 0x7fefc0198740 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7fefb000b4a0 tx=0x7fefb000b960 comp rx=0 tx=0).stop 2024-09-19T04:35:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 shutdown_connections 2024-09-19T04:35:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefa80a33b0 0x7fefa80a5870 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc01082a0 0x7fefc019d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc01036e0 0x7fefc0198c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 --2- 172.21.15.70:0/923514417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc0102d30 0x7fefc0198740 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:35:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 >> 172.21.15.70:0/923514417 conn(0x7fefc00fc7d0 msgr2=0x7fefc0105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:35:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.597+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 shutdown_connections 2024-09-19T04:35:59.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:35:59.598+0000 7fefc68ec640 1 -- 172.21.15.70:0/923514417 wait complete. 2024-09-19T04:35:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:35:59 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/923514417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:35:59.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:35:59 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/923514417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:35:59 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/923514417' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:00.246 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:36:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:00.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:00 smithi070 ceph-mon[30942]: pgmap v160: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:36:00.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:00 smithi167 ceph-mon[34339]: pgmap v160: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.994+0000 7f1eb594d640 1 -- 172.21.15.70:0/87507152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 msgr2=0x7f1eb0103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.994+0000 7f1eb594d640 1 --2- 172.21.15.70:0/87507152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 0x7f1eb0103120 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009ca0 tx=0x7f1ea002a950 comp rx=0 tx=0).stop 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.994+0000 7f1eb594d640 1 -- 172.21.15.70:0/87507152 shutdown_connections 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.995+0000 7f1eb594d640 1 --2- 172.21.15.70:0/87507152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb010c170 0x7f1eb010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.995+0000 7f1eb594d640 1 --2- 172.21.15.70:0/87507152 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb0103660 0x7f1eb010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.995+0000 7f1eb594d640 1 --2- 172.21.15.70:0/87507152 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 0x7f1eb0103120 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.995+0000 7f1eb594d640 1 -- 172.21.15.70:0/87507152 >> 172.21.15.70:0/87507152 conn(0x7f1eb00fc7a0 msgr2=0x7f1eb00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.995+0000 7f1eb594d640 1 -- 172.21.15.70:0/87507152 shutdown_connections 2024-09-19T04:36:01.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.995+0000 7f1eb594d640 1 -- 172.21.15.70:0/87507152 wait complete. 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.995+0000 7f1eb594d640 1 Processor -- start 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.995+0000 7f1eb594d640 1 -- start start 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb594d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 0x7f1eb0198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb594d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb0103660 0x7f1eb0198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb594d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb010c170 0x7f1eb019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb594d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0112020 con 0x7f1eb0102d40 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb594d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb0111ea0 con 0x7f1eb010c170 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb594d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb01121a0 con 0x7f1eb0103660 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 0x7f1eb0198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 0x7f1eb0198580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53522/0 (socket says 172.21.15.70:53522) 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 -- 172.21.15.70:0/531927005 learned_addr learned my addr 172.21.15.70:0/531927005 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:01.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb010c170 0x7f1eb019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb0103660 0x7f1eb0198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 -- 172.21.15.70:0/531927005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb0103660 msgr2=0x7f1eb0198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb0103660 0x7f1eb0198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 -- 172.21.15.70:0/531927005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb010c170 msgr2=0x7f1eb019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb010c170 0x7f1eb019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 -- 172.21.15.70:0/531927005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1eb019d530 con 0x7f1eb0102d40 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb010c170 0x7f1eb019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb0103660 0x7f1eb0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 0x7f1eb0198580 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009430 tx=0x7f1ea002f6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb494b640 1 -- 172.21.15.70:0/531927005 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0034030 con 0x7f1eb0102d40 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb594d640 1 -- 172.21.15.70:0/531927005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1eb019d7c0 con 0x7f1eb0102d40 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb494b640 1 -- 172.21.15.70:0/531927005 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1ea0003e40 con 0x7f1eb0102d40 2024-09-19T04:36:01.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.996+0000 7f1eb494b640 1 -- 172.21.15.70:0/531927005 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea0039420 con 0x7f1eb0102d40 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.997+0000 7f1eb594d640 1 -- 172.21.15.70:0/531927005 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1eb01a5100 con 0x7f1eb0102d40 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb494b640 1 -- 172.21.15.70:0/531927005 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1ea0037020 con 0x7f1eb0102d40 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb7d26740 1 Processor -- start 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb7d26740 1 -- start start 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 0x564433e40090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e40a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e4d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564433da62f0 con 0x564433e4b370 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564433d4dcf0 con 0x564433e405d0 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564433da22b0 con 0x564433e41b40 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e4d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eb494b640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e980a33b0 0x7f1e980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eae7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e4d760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53524/0 (socket says 172.21.15.70:53524) 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eae7fc640 1 -- 172.21.15.70:0/1010653413 learned_addr learned my addr 172.21.15.70:0/1010653413 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 0x564433e40090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:00.999+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e40a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e980a33b0 0x7f1e980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eae7fc640 1 -- 172.21.15.70:0/1010653413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 msgr2=0x564433e40090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 0x564433e40090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eae7fc640 1 -- 172.21.15.70:0/1010653413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 msgr2=0x564433e40a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e40a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eae7fc640 1 -- 172.21.15.70:0/1010653413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564433d323a0 con 0x564433e4b370 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e40a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eb494b640 1 -- 172.21.15.70:0/531927005 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f1ea00f0a80 con 0x7f1eb0102d40 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e4d760 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40077c0 tx=0x7f1ea4007c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b12987b9f6782cae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:01.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e980a33b0 0x7f1e980a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8006e10 tx=0x7f1ea8006da0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1e95ffb640 1 -- 172.21.15.70:0/1010653413 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea400d950 con 0x564433e4b370 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1e95ffb640 1 -- 172.21.15.70:0/1010653413 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1ea4018070 con 0x564433e4b370 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.000+0000 7f1e95ffb640 1 -- 172.21.15.70:0/1010653413 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea4013e60 con 0x564433e4b370 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 -- 172.21.15.70:0/1010653413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 msgr2=0x564433e4d760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e4d760 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7f1ea40077c0 tx=0x7f1ea4007c80 comp rx=0 tx=0).stop 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 -- 172.21.15.70:0/1010653413 shutdown_connections 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e4d760 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e40a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/1010653413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 0x564433e40090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 -- 172.21.15.70:0/1010653413 >> 172.21.15.70:0/1010653413 conn(0x564433e09310 msgr2=0x564433e3cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 -- 172.21.15.70:0/1010653413 shutdown_connections 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 -- 172.21.15.70:0/1010653413 wait complete. 2024-09-19T04:36:01.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 -- start start 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.001+0000 7f1eb7d26740 1 Processor -- start 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e405d0 0x564433e4ad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e41b40 0x564433e47fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e485d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564433e4e070 con 0x564433e4b370 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564433d61060 con 0x564433e41b40 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564433e4e1f0 con 0x564433e405d0 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eb7d26740 10 client.0 _ll_register_callbacks cb 0x564433ab48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e485d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e485d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53534/0 (socket says 172.21.15.70:53534) 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 -- 172.21.15.70:0/2627968191 learned_addr learned my addr 172.21.15.70:0/2627968191 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:01.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e405d0 0x564433e4ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e41b40 0x564433e47fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 -- 172.21.15.70:0/2627968191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e405d0 msgr2=0x564433e4ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e405d0 0x564433e4ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 -- 172.21.15.70:0/2627968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e41b40 msgr2=0x564433e47fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e41b40 0x564433e47fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 -- 172.21.15.70:0/2627968191 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564433b173c0 con 0x564433e4b370 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e485d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80189d0 tx=0x7f1ea80047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0b5e9e76b578f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.002+0000 7f1e8effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1e8effd640 1 -- 172.21.15.70:0/2627968191 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8028060 con 0x564433e4b370 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1e8effd640 1 -- 172.21.15.70:0/2627968191 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f1ea800f030 con 0x564433e4b370 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 1 -- 172.21.15.70:0/2627968191 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea4018070 con 0x564433e4b370 2024-09-19T04:36:01.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1e8effd640 1 -- 172.21.15.70:0/2627968191 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ea8018dd0 con 0x564433e4b370 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 10 client.16068 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 1 -- 172.21.15.70:0/2627968191 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564433e59b30 con 0x564433e4b370 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1e8effd640 1 -- 172.21.15.70:0/2627968191 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1ea4018070 con 0x564433e4b370 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1e8effd640 1 -- 172.21.15.70:0/2627968191 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1ea8015040 con 0x564433e4b370 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 10 client.16068 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 10 client.16068 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 20 client.16068 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x564433e5aff0 0x564433e5d460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 4 client.16068 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.003+0000 7f1eb7d26740 1 -- 172.21.15.70:0/2627968191 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564433db3860 con 0x564433e5aff0 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.004+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x564433e5aff0 0x564433e5d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.004+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x564433e5aff0 0x564433e5d460 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=951236b1e94349e8 server_cookie=24c63c481226edd5 in_seq=0 out_seq=0 2024-09-19T04:36:01.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.004+0000 7f1e8effd640 10 client.16068 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1e8effd640 1 -- 172.21.15.70:0/2627968191 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564433db3860 con 0x564433e5aff0 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1e8effd640 10 client.16068 handle_command_reply: tid=0 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 client.16068 shutdown 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 -- 172.21.15.70:0/2627968191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 msgr2=0x564433e485d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e485d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f1ea80189d0 tx=0x7f1ea80047d0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 -- 172.21.15.70:0/2627968191 shutdown_connections 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x564433e5aff0 0x564433e5d460 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e4b370 0x564433e485d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e41b40 0x564433e47fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/2627968191 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e405d0 0x564433e4ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1e8effd640 0 client.16068 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:01.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 -- 172.21.15.70:0/2627968191 >> 172.21.15.70:0/2627968191 conn(0x564433e09310 msgr2=0x564433e42960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:01.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 -- 172.21.15.70:0/2627968191 shutdown_connections 2024-09-19T04:36:01.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 1 -- 172.21.15.70:0/2627968191 wait complete. 2024-09-19T04:36:01.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.005+0000 7f1eb7d26740 20 client.16068 trim_cache size 0 max 16384 2024-09-19T04:36:01.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eb7d26740 1 Processor -- start 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eb7d26740 1 -- start start 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e09310 0x564433e57310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e5d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e41b40 0x564433e62d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb01b0230 con 0x564433e41b40 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb01ada40 con 0x564433e405d0 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb01ab890 con 0x564433e09310 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e41b40 0x564433e62d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaf7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e41b40 0x564433e62d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53536/0 (socket says 172.21.15.70:53536) 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaf7fe640 1 -- 172.21.15.70:0/3557161354 learned_addr learned my addr 172.21.15.70:0/3557161354 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:01.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e5d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e09310 0x564433e57310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaf7fe640 1 -- 172.21.15.70:0/3557161354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e09310 msgr2=0x564433e57310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e09310 0x564433e57310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaf7fe640 1 -- 172.21.15.70:0/3557161354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 msgr2=0x564433e5d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e5d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.018+0000 7f1eaf7fe640 1 -- 172.21.15.70:0/3557161354 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564433e5d7d0 con 0x564433e41b40 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e41b40 0x564433e62d30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800a780 tx=0x7f1ea80188e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92493ee4445d7d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1e957fa640 1 -- 172.21.15.70:0/3557161354 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea8017c80 con 0x564433e41b40 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1e957fa640 1 -- 172.21.15.70:0/3557161354 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1ea8017e20 con 0x564433e41b40 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1e957fa640 1 -- 172.21.15.70:0/3557161354 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea80066d0 con 0x564433e41b40 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 -- 172.21.15.70:0/3557161354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e41b40 msgr2=0x564433e62d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e41b40 0x564433e62d30 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f1ea800a780 tx=0x7f1ea80188e0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 -- 172.21.15.70:0/3557161354 shutdown_connections 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e41b40 0x564433e62d30 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e5d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/3557161354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e09310 0x564433e57310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 -- 172.21.15.70:0/3557161354 >> 172.21.15.70:0/3557161354 conn(0x564433e439d0 msgr2=0x564433e468b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 -- 172.21.15.70:0/3557161354 shutdown_connections 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.019+0000 7f1eb7d26740 1 -- 172.21.15.70:0/3557161354 wait complete. 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 1 -- start start 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 1 Processor -- start 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e09310 0x564433e53b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e4eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 0x564433e4f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb01abf00 con 0x564433e09310 2024-09-19T04:36:01.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb01ad370 con 0x564433e405d0 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1eb01ac5d0 con 0x564433e41b40 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eb7d26740 10 client.0 _ll_register_callbacks cb 0x7f1ea8016370 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eaeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e09310 0x564433e53b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eaeffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e09310 0x564433e53b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53538/0 (socket says 172.21.15.70:53538) 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eaeffd640 1 -- 172.21.15.70:0/4126662093 learned_addr learned my addr 172.21.15.70:0/4126662093 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eaf7fe640 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 0x564433e4f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.020+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e4eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eaeffd640 1 -- 172.21.15.70:0/4126662093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 msgr2=0x564433e4f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 0x564433e4f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eaeffd640 1 -- 172.21.15.70:0/4126662093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 msgr2=0x564433e4eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e4eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eaeffd640 1 -- 172.21.15.70:0/4126662093 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564433e4fbd0 con 0x564433e09310 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eaeffd640 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e09310 0x564433e53b80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00bca80 tx=0x7f1ea00bc7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5713dc7255c1bf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1e8effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1e8effd640 1 -- 172.21.15.70:0/4126662093 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ea00bcd80 con 0x564433e09310 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1e8effd640 1 -- 172.21.15.70:0/4126662093 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f1ea00ee470 con 0x564433e09310 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eb7d26740 1 -- 172.21.15.70:0/4126662093 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ea8017e20 con 0x564433e09310 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1e8effd640 1 -- 172.21.15.70:0/4126662093 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1ea00c1130 con 0x564433e09310 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eb7d26740 10 client.16074 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1eb7d26740 1 -- 172.21.15.70:0/4126662093 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x564433eca120 con 0x564433e09310 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.021+0000 7f1e8effd640 1 -- 172.21.15.70:0/4126662093 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1ea8017e20 con 0x564433e09310 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1e8effd640 1 -- 172.21.15.70:0/4126662093 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1ea00bcfe0 con 0x564433e09310 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1eb7d26740 10 client.16074 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1eb7d26740 10 client.16074 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:01.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1eb7d26740 20 client.16074 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x564433e4b370 0x564433ecc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1eb7d26740 4 client.16074 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1eb7d26740 1 -- 172.21.15.70:0/4126662093 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564433dadd70 con 0x564433e4b370 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x564433e4b370 0x564433ecc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1eae7fc640 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x564433e4b370 0x564433ecc810 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a586951937359b34 server_cookie=30829829599ded8e in_seq=0 out_seq=0 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1e8effd640 10 client.16074 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1e8effd640 1 -- 172.21.15.70:0/4126662093 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564433dadd70 con 0x564433e4b370 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.022+0000 7f1e8effd640 10 client.16074 handle_command_reply: tid=0 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 client.16074 shutdown 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 -- 172.21.15.70:0/4126662093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e09310 msgr2=0x564433e53b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e09310 0x564433e53b80 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f1ea00bca80 tx=0x7f1ea00bc7a0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 -- 172.21.15.70:0/4126662093 shutdown_connections 2024-09-19T04:36:01.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x564433e4b370 0x564433ecc810 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564433e41b40 0x564433e4f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564433e405d0 0x564433e4eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 --2- 172.21.15.70:0/4126662093 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564433e09310 0x564433e53b80 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 -- 172.21.15.70:0/4126662093 >> 172.21.15.70:0/4126662093 conn(0x564433e439d0 msgr2=0x564433e49840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1e8effd640 0 client.16074 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 -- 172.21.15.70:0/4126662093 shutdown_connections 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 1 -- 172.21.15.70:0/4126662093 wait complete. 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb7d26740 20 client.16074 trim_cache size 0 max 16384 2024-09-19T04:36:01.035 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:01.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:00 smithi134 ceph-mon[34525]: pgmap v160: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb594d640 1 -- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e980a33b0 msgr2=0x7f1e980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb594d640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e980a33b0 0x7f1e980a5870 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f1ea8006e10 tx=0x7f1ea8006da0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb594d640 1 -- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 msgr2=0x7f1eb0198580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb594d640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 0x7f1eb0198580 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f1ea0009430 tx=0x7f1ea002f6c0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.023+0000 7f1eb594d640 1 -- 172.21.15.70:0/531927005 shutdown_connections 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.024+0000 7f1eb594d640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e980a33b0 0x7f1e980a5870 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.024+0000 7f1eb594d640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1eb010c170 0x7f1eb019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.024+0000 7f1eb594d640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1eb0103660 0x7f1eb0198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.024+0000 7f1eb594d640 1 --2- 172.21.15.70:0/531927005 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1eb0102d40 0x7f1eb0198580 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:01.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.024+0000 7f1eb594d640 1 -- 172.21.15.70:0/531927005 >> 172.21.15.70:0/531927005 conn(0x7f1eb00fc7a0 msgr2=0x7f1eb00fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.024+0000 7f1eb594d640 1 -- 172.21.15.70:0/531927005 shutdown_connections 2024-09-19T04:36:01.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:01.024+0000 7f1eb594d640 1 -- 172.21.15.70:0/531927005 wait complete. 2024-09-19T04:36:01.696 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:36:01.940 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:02.314 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:02 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:36:02.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 -- 172.21.15.70:0/1161106519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c100e20 msgr2=0x7fd81c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 --2- 172.21.15.70:0/1161106519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c100e20 0x7fd81c101200 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009900 tx=0x7fd80c02a480 comp rx=0 tx=0).stop 2024-09-19T04:36:02.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 -- 172.21.15.70:0/1161106519 shutdown_connections 2024-09-19T04:36:02.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 --2- 172.21.15.70:0/1161106519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81c102ef0 0x7fd81c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 --2- 172.21.15.70:0/1161106519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd81c102570 0x7fd81c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 --2- 172.21.15.70:0/1161106519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c100e20 0x7fd81c101200 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 -- 172.21.15.70:0/1161106519 >> 172.21.15.70:0/1161106519 conn(0x7fd81c0fc7d0 msgr2=0x7fd81c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 -- 172.21.15.70:0/1161106519 shutdown_connections 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.397+0000 7fd821240640 1 -- 172.21.15.70:0/1161106519 wait complete. 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.398+0000 7fd821240640 1 Processor -- start 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.398+0000 7fd821240640 1 -- start start 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.398+0000 7fd821240640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81c100e20 0x7fd81c197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd821240640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c102570 0x7fd81c197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd821240640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd81c102ef0 0x7fd81c19bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd821240640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c110f50 con 0x7fd81c102570 2024-09-19T04:36:02.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd821240640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c110dd0 con 0x7fd81c100e20 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd821240640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1110d0 con 0x7fd81c102ef0 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c102570 0x7fd81c197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c102570 0x7fd81c197980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53548/0 (socket says 172.21.15.70:53548) 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 -- 172.21.15.70:0/3876324356 learned_addr learned my addr 172.21.15.70:0/3876324356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81c100e20 0x7fd81c197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81b59e640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd81c102ef0 0x7fd81c19bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 -- 172.21.15.70:0/3876324356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd81c102ef0 msgr2=0x7fd81c19bd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd81c102ef0 0x7fd81c19bd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 -- 172.21.15.70:0/3876324356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81c100e20 msgr2=0x7fd81c197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81c100e20 0x7fd81c197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 -- 172.21.15.70:0/3876324356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd81c19c3f0 con 0x7fd81c102570 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81c100e20 0x7fd81c197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:36:02.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd81a59c640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c102570 0x7fd81c197980 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd81000d950 tx=0x7fd81000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd803fff640 1 -- 172.21.15.70:0/3876324356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd810017030 con 0x7fd81c102570 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.399+0000 7fd821240640 1 -- 172.21.15.70:0/3876324356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd81c19c6e0 con 0x7fd81c102570 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.400+0000 7fd803fff640 1 -- 172.21.15.70:0/3876324356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd810004020 con 0x7fd81c102570 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.400+0000 7fd821240640 1 -- 172.21.15.70:0/3876324356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd81c1a3fc0 con 0x7fd81c102570 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.400+0000 7fd803fff640 1 -- 172.21.15.70:0/3876324356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8100047a0 con 0x7fd81c102570 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.402+0000 7fd803fff640 1 -- 172.21.15.70:0/3876324356 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd810004940 con 0x7fd81c102570 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.402+0000 7fd823619740 1 Processor -- start 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.402+0000 7fd823619740 1 -- start start 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.402+0000 7fd823619740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07d4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd823619740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07d4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd823619740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07e3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd823619740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5a073a2f0 con 0x55f5a07d5b40 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd823619740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f5a06e1cf0 con 0x55f5a07d45d0 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd823619740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5a07362b0 con 0x55f5a07e1580 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81b59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07d4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81b59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07d4090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53554/0 (socket says 172.21.15.70:53554) 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81b59e640 1 -- 172.21.15.70:0/910839970 learned_addr learned my addr 172.21.15.70:0/910839970 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07d4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81a59c640 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07e3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd803fff640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8040a3430 0x7fd8040a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81ad9d640 1 -- 172.21.15.70:0/910839970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 msgr2=0x55f5a07e3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07e3970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81ad9d640 1 -- 172.21.15.70:0/910839970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 msgr2=0x55f5a07d4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07d4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81ad9d640 1 -- 172.21.15.70:0/910839970 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5a06c63a0 con 0x55f5a07d45d0 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81b59e640 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81b59e640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8040a3430 0x7fd8040a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd803fff640 1 -- 172.21.15.70:0/3876324356 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd8100cf6a0 con 0x7fd81c102570 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.403+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07d4a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd80c031440 tx=0x7fd80c031550 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3075606f9247a3bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd8017fa640 1 -- 172.21.15.70:0/910839970 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c035070 con 0x55f5a07d45d0 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd81b59e640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8040a3430 0x7fd8040a58f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd814009fd0 tx=0x7fd814004a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd8017fa640 1 -- 172.21.15.70:0/910839970 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd80c0318c0 con 0x55f5a07d45d0 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd8017fa640 1 -- 172.21.15.70:0/910839970 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c0049b0 con 0x55f5a07d45d0 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 -- 172.21.15.70:0/910839970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 msgr2=0x55f5a07d4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07d4a10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7fd80c031440 tx=0x7fd80c031550 comp rx=0 tx=0).stop 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 -- 172.21.15.70:0/910839970 shutdown_connections 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07e3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07d4a10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 --2- 172.21.15.70:0/910839970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07d4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 -- 172.21.15.70:0/910839970 >> 172.21.15.70:0/910839970 conn(0x55f5a079d310 msgr2=0x55f5a07d0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 -- 172.21.15.70:0/910839970 shutdown_connections 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.404+0000 7fd823619740 1 -- 172.21.15.70:0/910839970 wait complete. 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 1 -- start start 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 1 Processor -- start 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07e0f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07de200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07de7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5a07e4220 con 0x55f5a07d5b40 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f5a06f5060 con 0x55f5a07d45d0 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5a07e43a0 con 0x55f5a07e1580 2024-09-19T04:36:02.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd823619740 10 client.0 _ll_register_callbacks cb 0x55f5a04488c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07de200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07de200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53558/0 (socket says 172.21.15.70:53558) 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81a59c640 1 -- 172.21.15.70:0/524757130 learned_addr learned my addr 172.21.15.70:0/524757130 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07e0f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81b59e640 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07de7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81a59c640 1 -- 172.21.15.70:0/524757130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 msgr2=0x55f5a07de7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81a59c640 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07de7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81a59c640 1 -- 172.21.15.70:0/524757130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 msgr2=0x55f5a07e0f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.405+0000 7fd81a59c640 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07e0f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd81a59c640 1 -- 172.21.15.70:0/524757130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5a04ab3c0 con 0x55f5a07d5b40 2024-09-19T04:36:02.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd81a59c640 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07de200 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd8100cce70 tx=0x7fd81009b800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10ca289ccd386742 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd7feff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd7feff5640 1 -- 172.21.15.70:0/524757130 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81009b300 con 0x55f5a07d5b40 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd7feff5640 1 -- 172.21.15.70:0/524757130 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd8100cc650 con 0x55f5a07d5b40 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 1 -- 172.21.15.70:0/524757130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80c0318c0 con 0x55f5a07d5b40 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd7feff5640 1 -- 172.21.15.70:0/524757130 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd81009c0a0 con 0x55f5a07d5b40 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 10 client.16086 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 1 -- 172.21.15.70:0/524757130 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f5a07efc90 con 0x55f5a07d5b40 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd7feff5640 1 -- 172.21.15.70:0/524757130 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd80c0318c0 con 0x55f5a07d5b40 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd7feff5640 1 -- 172.21.15.70:0/524757130 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd8100cc9d0 con 0x55f5a07d5b40 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 10 client.16086 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 10 client.16086 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 20 client.16086 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:02.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5a07f1150 0x55f5a07f3580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 4 client.16086 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.406+0000 7fd823619740 1 -- 172.21.15.70:0/524757130 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5a0747860 con 0x55f5a07f1150 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.407+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5a07f1150 0x55f5a07f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.407+0000 7fd7feff5640 10 client.16086 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.407+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5a07f1150 0x55f5a07f3580 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2561b6b0cebbca29 server_cookie=65b3c627e45f2e7b in_seq=0 out_seq=0 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd7feff5640 1 -- 172.21.15.70:0/524757130 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5a0747860 con 0x55f5a07f1150 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd7feff5640 10 client.16086 handle_command_reply: tid=0 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 client.16086 shutdown 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 -- 172.21.15.70:0/524757130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 msgr2=0x55f5a07de200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07de200 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fd8100cce70 tx=0x7fd81009b800 comp rx=0 tx=0).stop 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 -- 172.21.15.70:0/524757130 shutdown_connections 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5a07f1150 0x55f5a07f3580 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07de7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07de200 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd7feff5640 0 client.16086 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:02.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 --2- 172.21.15.70:0/524757130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07e0f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 -- 172.21.15.70:0/524757130 >> 172.21.15.70:0/524757130 conn(0x55f5a079d310 msgr2=0x55f5a07d6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:02.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 -- 172.21.15.70:0/524757130 shutdown_connections 2024-09-19T04:36:02.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 1 -- 172.21.15.70:0/524757130 wait complete. 2024-09-19T04:36:02.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.408+0000 7fd823619740 20 client.16086 trim_cache size 0 max 16384 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd823619740 1 Processor -- start 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd823619740 1 -- start start 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd823619740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07ed4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd823619740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07ddac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd823619740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07dd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd823619740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1ae010 con 0x55f5a07d5b40 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd823619740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1ab820 con 0x55f5a07d45d0 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd823619740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1a9690 con 0x55f5a07e1580 2024-09-19T04:36:02.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07ddac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81ad9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07ed4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81b59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07dd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07ddac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:53564/0 (socket says 172.21.15.70:53564) 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81a59c640 1 -- 172.21.15.70:0/3194044861 learned_addr learned my addr 172.21.15.70:0/3194044861 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81ad9d640 1 -- 172.21.15.70:0/3194044861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 msgr2=0x55f5a07dd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/3194044861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07dd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81ad9d640 1 -- 172.21.15.70:0/3194044861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 msgr2=0x55f5a07ddac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/3194044861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07ddac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81ad9d640 1 -- 172.21.15.70:0/3194044861 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5a07d5300 con 0x55f5a07d45d0 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.422+0000 7fd81a59c640 1 --2- 172.21.15.70:0/3194044861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07ddac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.423+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/3194044861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07ed4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd80c031a90 tx=0x7fd80c02a480 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2442421b62fb954b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.423+0000 7fd800ff9640 1 -- 172.21.15.70:0/3194044861 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c035040 con 0x55f5a07d45d0 2024-09-19T04:36:02.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.423+0000 7fd800ff9640 1 -- 172.21.15.70:0/3194044861 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd80c055070 con 0x55f5a07d45d0 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.423+0000 7fd800ff9640 1 -- 172.21.15.70:0/3194044861 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd80c003e40 con 0x55f5a07d45d0 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.423+0000 7fd823619740 1 -- 172.21.15.70:0/3194044861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 msgr2=0x55f5a07ed4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.423+0000 7fd823619740 1 --2- 172.21.15.70:0/3194044861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07ed4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fd80c031a90 tx=0x7fd80c02a480 comp rx=0 tx=0).stop 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 -- 172.21.15.70:0/3194044861 shutdown_connections 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 --2- 172.21.15.70:0/3194044861 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07dd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 --2- 172.21.15.70:0/3194044861 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d5b40 0x55f5a07ddac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 --2- 172.21.15.70:0/3194044861 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d45d0 0x55f5a07ed4c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 -- 172.21.15.70:0/3194044861 >> 172.21.15.70:0/3194044861 conn(0x55f5a079d310 msgr2=0x55f5a07dcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 -- 172.21.15.70:0/3194044861 shutdown_connections 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 -- 172.21.15.70:0/3194044861 wait complete. 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 -- start start 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 Processor -- start 2024-09-19T04:36:02.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d45d0 0x55f5a07e9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d5b40 0x55f5a07e9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07daa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1a9ce0 con 0x55f5a07d45d0 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1ab150 con 0x55f5a07d5b40 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd81c1aa3b0 con 0x55f5a07e1580 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd823619740 10 client.0 _ll_register_callbacks cb 0x7fd810005130 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd81a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d5b40 0x55f5a07e9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.424+0000 7fd81ad9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d45d0 0x55f5a07e9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81b59e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07daa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81a59c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d5b40 0x55f5a07e9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:40960/0 (socket says 172.21.15.70:40960) 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81a59c640 1 -- 172.21.15.70:0/2650061941 learned_addr learned my addr 172.21.15.70:0/2650061941 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81a59c640 1 -- 172.21.15.70:0/2650061941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 msgr2=0x55f5a07daa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:02.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81a59c640 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07daa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81a59c640 1 -- 172.21.15.70:0/2650061941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d45d0 msgr2=0x55f5a07e9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81a59c640 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d45d0 0x55f5a07e9810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81a59c640 1 -- 172.21.15.70:0/2650061941 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5a07db250 con 0x55f5a07d5b40 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d45d0 0x55f5a07e9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd81a59c640 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d5b40 0x55f5a07e9d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd8100051e0 tx=0x7fd810009c60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4445c4fbeff93179 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd7feff5640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd7feff5640 1 -- 172.21.15.70:0/2650061941 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81009b300 con 0x55f5a07d5b40 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd7feff5640 1 -- 172.21.15.70:0/2650061941 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd8100cd090 con 0x55f5a07d5b40 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd823619740 1 -- 172.21.15.70:0/2650061941 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd80c055070 con 0x55f5a07d5b40 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd7feff5640 1 -- 172.21.15.70:0/2650061941 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fd81009b9a0 con 0x55f5a07d5b40 2024-09-19T04:36:02.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd823619740 10 client.25427 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.425+0000 7fd823619740 1 -- 172.21.15.70:0/2650061941 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55f5a07d7340 con 0x55f5a07d5b40 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd7feff5640 1 -- 172.21.15.70:0/2650061941 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd80c055070 con 0x55f5a07d5b40 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd7feff5640 1 -- 172.21.15.70:0/2650061941 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fd810082020 con 0x55f5a07d5b40 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd823619740 10 client.25427 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd823619740 10 client.25427 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd823619740 20 client.25427 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd823619740 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5a07d79d0 0x55f5a07d7de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd823619740 4 client.25427 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd823619740 1 -- 172.21.15.70:0/2650061941 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5a0741d70 con 0x55f5a07d79d0 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5a07d79d0 0x55f5a07d7de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd7feff5640 10 client.25427 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:02.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.426+0000 7fd81ad9d640 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5a07d79d0 0x55f5a07d7de0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e4a7ed63870845f1 server_cookie=7365f69208a7bad1 in_seq=0 out_seq=0 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd7feff5640 1 -- 172.21.15.70:0/2650061941 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f5a0741d70 con 0x55f5a07d79d0 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd7feff5640 10 client.25427 handle_command_reply: tid=0 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 client.25427 shutdown 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 -- 172.21.15.70:0/2650061941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d5b40 msgr2=0x55f5a07e9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d5b40 0x55f5a07e9d50 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fd8100051e0 tx=0x7fd810009c60 comp rx=0 tx=0).stop 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 -- 172.21.15.70:0/2650061941 shutdown_connections 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5a07d79d0 0x55f5a07d7de0 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5a07e1580 0x55f5a07daa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd7feff5640 0 client.25427 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5a07d5b40 0x55f5a07e9d50 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 --2- 172.21.15.70:0/2650061941 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5a07d45d0 0x55f5a07e9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 -- 172.21.15.70:0/2650061941 >> 172.21.15.70:0/2650061941 conn(0x55f5a079d310 msgr2=0x55f5a07e0280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:02.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 -- 172.21.15.70:0/2650061941 shutdown_connections 2024-09-19T04:36:02.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 1 -- 172.21.15.70:0/2650061941 wait complete. 2024-09-19T04:36:02.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.427+0000 7fd823619740 20 client.25427 trim_cache size 0 max 16384 2024-09-19T04:36:02.443 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 -- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8040a3430 msgr2=0x7fd8040a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8040a3430 0x7fd8040a58f0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd814009fd0 tx=0x7fd814004a40 comp rx=0 tx=0).stop 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 -- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c102570 msgr2=0x7fd81c197980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c102570 0x7fd81c197980 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd81000d950 tx=0x7fd81000de10 comp rx=0 tx=0).stop 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 -- 172.21.15.70:0/3876324356 shutdown_connections 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8040a3430 0x7fd8040a58f0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd81c102ef0 0x7fd81c19bd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd81c102570 0x7fd81c197980 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 --2- 172.21.15.70:0/3876324356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd81c100e20 0x7fd81c197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 -- 172.21.15.70:0/3876324356 >> 172.21.15.70:0/3876324356 conn(0x7fd81c0fc7d0 msgr2=0x7fd81c0fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 -- 172.21.15.70:0/3876324356 shutdown_connections 2024-09-19T04:36:02.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:02.428+0000 7fd821240640 1 -- 172.21.15.70:0/3876324356 wait complete. 2024-09-19T04:36:02.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:02 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:36:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:02 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:36:03.139 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:36:03.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:03 smithi070 ceph-mon[30942]: pgmap v161: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:03.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:03 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:36:03.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:03 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:36:03.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:03 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:36:03.404 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:03.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:03 smithi167 ceph-mon[34339]: pgmap v161: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:03 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:36:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:03 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:36:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:03 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:36:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:03 smithi134 ceph-mon[34525]: pgmap v161: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:03 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:36:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:03 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:36:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:03 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.909+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2881828241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 msgr2=0x7f9b18107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.909+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2881828241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 0x7f9b18107b80 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f9b08009930 tx=0x7f9b0802a420 comp rx=0 tx=0).stop 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.909+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2881828241 shutdown_connections 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.909+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2881828241 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b18108290 0x7f9b1810ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.909+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2881828241 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 0x7f9b18107b80 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2881828241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b18102d90 0x7f9b18103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2881828241 >> 172.21.15.70:0/2881828241 conn(0x7f9b180fc7d0 msgr2=0x7f9b180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2881828241 shutdown_connections 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2881828241 wait complete. 2024-09-19T04:36:03.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 Processor -- start 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 -- start start 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b18102d90 0x7f9b18198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 0x7f9b18198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b18108290 0x7f9b1819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18112120 con 0x7f9b18103740 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b18111fa0 con 0x7f9b18108290 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.910+0000 7f9b1fd7e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181122a0 con 0x7f9b18102d90 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 0x7f9b18198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 0x7f9b18198c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56034/0 (socket says 172.21.15.70:56034) 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 -- 172.21.15.70:0/2089665562 learned_addr learned my addr 172.21.15.70:0/2089665562 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b18108290 0x7f9b1819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b18102d90 0x7f9b18198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 -- 172.21.15.70:0/2089665562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b18102d90 msgr2=0x7f9b18198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b18102d90 0x7f9b18198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 -- 172.21.15.70:0/2089665562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b18108290 msgr2=0x7f9b1819cff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b18108290 0x7f9b1819cff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 -- 172.21.15.70:0/2089665562 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b1819d6d0 con 0x7f9b18103740 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 0x7f9b18198c60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005940 tx=0x7f9b080042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b0effd640 1 -- 172.21.15.70:0/2089665562 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b0803f030 con 0x7f9b18103740 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b0effd640 1 -- 172.21.15.70:0/2089665562 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b08003ac0 con 0x7f9b18103740 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2089665562 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b1819d960 con 0x7f9b18103740 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b0effd640 1 -- 172.21.15.70:0/2089665562 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08035070 con 0x7f9b18103740 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.911+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2089665562 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b181a52a0 con 0x7f9b18103740 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.913+0000 7f9b0effd640 1 -- 172.21.15.70:0/2089665562 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9b08042030 con 0x7f9b18103740 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b22157740 1 Processor -- start 2024-09-19T04:36:03.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b22157740 1 -- start start 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b22157740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd145c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b22157740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145c5d0 0x562bd145ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b22157740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1469760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b22157740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562bd13c22f0 con 0x562bd145c5d0 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b22157740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562bd1369cf0 con 0x562bd145db40 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b22157740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562bd13be2b0 con 0x562bd1467370 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b0effd640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9b040a3430 0x7f9b040a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b1db1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145c5d0 0x562bd145ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9b040a3430 0x7f9b040a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b1db1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145c5d0 0x562bd145ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56048/0 (socket says 172.21.15.70:56048) 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b1db1a640 1 -- 172.21.15.70:0/2245547294 learned_addr learned my addr 172.21.15.70:0/2245547294 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1469760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b0effd640 1 -- 172.21.15.70:0/2089665562 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f9b080f0300 con 0x7f9b18103740 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.914+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd145c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b1db1a640 1 -- 172.21.15.70:0/2245547294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 msgr2=0x562bd1469760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1469760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b1db1a640 1 -- 172.21.15.70:0/2245547294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 msgr2=0x562bd145c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd145c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b1db1a640 1 -- 172.21.15.70:0/2245547294 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd134e3a0 con 0x562bd145c5d0 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9b040a3430 0x7f9b040a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009440 tx=0x7f9b1000bbf0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145c5d0 0x562bd145ca10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400b820 tx=0x7f9b1400bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a517ecf5f72f17a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b03fff640 1 -- 172.21.15.70:0/2245547294 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400d950 con 0x562bd145c5d0 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b03fff640 1 -- 172.21.15.70:0/2245547294 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b14019070 con 0x562bd145c5d0 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.915+0000 7f9b03fff640 1 -- 172.21.15.70:0/2245547294 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14014e50 con 0x562bd145c5d0 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 -- 172.21.15.70:0/2245547294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145c5d0 msgr2=0x562bd145ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145c5d0 0x562bd145ca10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400b820 tx=0x7f9b1400bce0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 -- 172.21.15.70:0/2245547294 shutdown_connections 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1469760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145c5d0 0x562bd145ca10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 --2- 172.21.15.70:0/2245547294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd145c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 -- 172.21.15.70:0/2245547294 >> 172.21.15.70:0/2245547294 conn(0x562bd1425310 msgr2=0x562bd1458c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 -- 172.21.15.70:0/2245547294 shutdown_connections 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 -- 172.21.15.70:0/2245547294 wait complete. 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 -- start start 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.916+0000 7f9b22157740 1 Processor -- start 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b22157740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145c5d0 0x562bd1466c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b22157740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145db40 0x562bd1463f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b22157740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1464480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b22157740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562bd146a070 con 0x562bd145db40 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b22157740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562bd137d060 con 0x562bd145c5d0 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b22157740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562bd146a1f0 con 0x562bd1467370 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b22157740 10 client.0 _ll_register_callbacks cb 0x562bd10d08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145db40 0x562bd1463f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145db40 0x562bd1463f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56064/0 (socket says 172.21.15.70:56064) 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 -- 172.21.15.70:0/2835191746 learned_addr learned my addr 172.21.15.70:0/2835191746 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1464480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 -- 172.21.15.70:0/2835191746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 msgr2=0x562bd1464480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1464480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 -- 172.21.15.70:0/2835191746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145c5d0 msgr2=0x562bd1466c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145c5d0 0x562bd1466c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 -- 172.21.15.70:0/2835191746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bd11333c0 con 0x562bd145db40 2024-09-19T04:36:03.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1464480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145db40 0x562bd1463f40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9b080edb20 tx=0x7f9b08042d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf1c1bbfe07f3f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b017fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b017fa640 1 -- 172.21.15.70:0/2835191746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b08049040 con 0x562bd145db40 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.917+0000 7f9b017fa640 1 -- 172.21.15.70:0/2835191746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f9b080b85e0 con 0x562bd145db40 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 1 -- 172.21.15.70:0/2835191746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b14019070 con 0x562bd145db40 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b017fa640 1 -- 172.21.15.70:0/2835191746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b080044e0 con 0x562bd145db40 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 10 client.16104 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 1 -- 172.21.15.70:0/2835191746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562bd1475a30 con 0x562bd145db40 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b017fa640 1 -- 172.21.15.70:0/2835191746 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b14019070 con 0x562bd145db40 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b017fa640 1 -- 172.21.15.70:0/2835191746 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9b08003c70 con 0x562bd145db40 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 10 client.16104 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 10 client.16104 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 20 client.16104 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562bd1476f20 0x562bd14793c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 4 client.16104 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b22157740 1 -- 172.21.15.70:0/2835191746 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562bd13cf860 con 0x562bd1476f20 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.918+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562bd1476f20 0x562bd14793c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.919+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562bd1476f20 0x562bd14793c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a7f4b0c6433324b4 server_cookie=659527ef308e8887 in_seq=0 out_seq=0 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.919+0000 7f9b017fa640 10 client.16104 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b017fa640 1 -- 172.21.15.70:0/2835191746 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562bd13cf860 con 0x562bd1476f20 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b017fa640 10 client.16104 handle_command_reply: tid=0 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 client.16104 shutdown 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 -- 172.21.15.70:0/2835191746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145db40 msgr2=0x562bd1463f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145db40 0x562bd1463f40 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f9b080edb20 tx=0x7f9b08042d70 comp rx=0 tx=0).stop 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 -- 172.21.15.70:0/2835191746 shutdown_connections 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562bd1476f20 0x562bd14793c0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd1467370 0x562bd1464480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd145db40 0x562bd1463f40 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 --2- 172.21.15.70:0/2835191746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145c5d0 0x562bd1466c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b017fa640 0 client.16104 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:03.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 -- 172.21.15.70:0/2835191746 >> 172.21.15.70:0/2835191746 conn(0x562bd1425310 msgr2=0x562bd145e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:03.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 -- 172.21.15.70:0/2835191746 shutdown_connections 2024-09-19T04:36:03.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 1 -- 172.21.15.70:0/2835191746 wait complete. 2024-09-19T04:36:03.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.920+0000 7f9b22157740 20 client.16104 trim_cache size 0 max 16384 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b22157740 1 Processor -- start 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b22157740 1 -- start start 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b22157740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1458e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b22157740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 0x562bd1473310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b22157740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd1463800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b22157740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181b0240 con 0x562bd1425310 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b22157740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181ada50 con 0x562bd145db40 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b22157740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181ab8a0 con 0x562bd145c5d0 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.933+0000 7f9b1db1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1458e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1db1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1458e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56078/0 (socket says 172.21.15.70:56078) 2024-09-19T04:36:03.945 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1db1a640 1 -- 172.21.15.70:0/4121312381 learned_addr learned my addr 172.21.15.70:0/4121312381 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd1463800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1d319640 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 0x562bd1473310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1db1a640 1 -- 172.21.15.70:0/4121312381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 msgr2=0x562bd1473310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 0x562bd1473310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1db1a640 1 -- 172.21.15.70:0/4121312381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 msgr2=0x562bd1463800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd1463800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1db1a640 1 -- 172.21.15.70:0/4121312381 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd1462490 con 0x562bd1425310 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd1463800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1458e10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400b740 tx=0x7f9b14014a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3738a70673d95752 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b037fe640 1 -- 172.21.15.70:0/4121312381 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1400d950 con 0x562bd1425310 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b037fe640 1 -- 172.21.15.70:0/4121312381 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b14019040 con 0x562bd1425310 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.934+0000 7f9b037fe640 1 -- 172.21.15.70:0/4121312381 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b1401f8a0 con 0x562bd1425310 2024-09-19T04:36:03.946 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 -- 172.21.15.70:0/4121312381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 msgr2=0x562bd1458e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1458e10 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f9b1400b740 tx=0x7f9b14014a30 comp rx=0 tx=0).stop 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 -- 172.21.15.70:0/4121312381 shutdown_connections 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd1463800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 0x562bd1473310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 --2- 172.21.15.70:0/4121312381 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1458e10 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 -- 172.21.15.70:0/4121312381 >> 172.21.15.70:0/4121312381 conn(0x562bd14645e0 msgr2=0x562bd1458700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 -- 172.21.15.70:0/4121312381 shutdown_connections 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 -- 172.21.15.70:0/4121312381 wait complete. 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 -- start start 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.935+0000 7f9b22157740 1 Processor -- start 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b22157740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1461430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b22157740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 0x562bd1461970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b22157740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd14601b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b22157740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181abf10 con 0x562bd1425310 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b22157740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181ad380 con 0x562bd145db40 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b22157740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b181ac5e0 con 0x562bd145c5d0 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b22157740 10 client.0 _ll_register_callbacks cb 0x7f9b080f0600 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1461430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1461430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56094/0 (socket says 172.21.15.70:56094) 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 -- 172.21.15.70:0/2577465700 learned_addr learned my addr 172.21.15.70:0/2577465700 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd14601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 -- 172.21.15.70:0/2577465700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 msgr2=0x562bd1461970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 0x562bd1461970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 -- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 msgr2=0x562bd14601b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd14601b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 -- 172.21.15.70:0/2577465700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bd14608f0 con 0x562bd1425310 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1e31b640 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd14601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b1db1a640 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1461430 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9b14004810 tx=0x7f9b1400bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac33a6b43566047 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b017fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b017fa640 1 -- 172.21.15.70:0/2577465700 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b14038060 con 0x562bd1425310 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b017fa640 1 -- 172.21.15.70:0/2577465700 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f9b14005dd0 con 0x562bd1425310 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.936+0000 7f9b22157740 1 -- 172.21.15.70:0/2577465700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9b14019040 con 0x562bd1425310 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b017fa640 1 -- 172.21.15.70:0/2577465700 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f9b14014430 con 0x562bd1425310 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b22157740 10 client.16110 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b22157740 1 -- 172.21.15.70:0/2577465700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x562bd14e66e0 con 0x562bd1425310 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b017fa640 1 -- 172.21.15.70:0/2577465700 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9b14019040 con 0x562bd1425310 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b017fa640 1 -- 172.21.15.70:0/2577465700 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f9b14013070 con 0x562bd1425310 2024-09-19T04:36:03.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b22157740 10 client.16110 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b22157740 10 client.16110 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b22157740 20 client.16110 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b22157740 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562bd1467370 0x562bd14e8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b22157740 4 client.16110 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b22157740 1 -- 172.21.15.70:0/2577465700 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562bd13c9d70 con 0x562bd1467370 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.937+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562bd1467370 0x562bd14e8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b017fa640 10 client.16110 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b1d319640 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562bd1467370 0x562bd14e8cc0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=63c92794c7681d06 server_cookie=36a41d15c65365b5 in_seq=0 out_seq=0 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b017fa640 1 -- 172.21.15.70:0/2577465700 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562bd13c9d70 con 0x562bd1467370 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b017fa640 10 client.16110 handle_command_reply: tid=0 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 client.16110 shutdown 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 -- 172.21.15.70:0/2577465700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 msgr2=0x562bd1461430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1461430 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f9b14004810 tx=0x7f9b1400bf30 comp rx=0 tx=0).stop 2024-09-19T04:36:03.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 -- 172.21.15.70:0/2577465700 shutdown_connections 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562bd1467370 0x562bd14e8cc0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562bd145db40 0x562bd14601b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562bd145c5d0 0x562bd1461970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b017fa640 0 client.16110 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 --2- 172.21.15.70:0/2577465700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562bd1425310 0x562bd1461430 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 -- 172.21.15.70:0/2577465700 >> 172.21.15.70:0/2577465700 conn(0x562bd14645e0 msgr2=0x562bd145e110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 -- 172.21.15.70:0/2577465700 shutdown_connections 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 1 -- 172.21.15.70:0/2577465700 wait complete. 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.938+0000 7f9b22157740 20 client.16110 trim_cache size 0 max 16384 2024-09-19T04:36:03.951 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:03.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9b040a3430 msgr2=0x7f9b040a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9b040a3430 0x7f9b040a58f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f9b10009440 tx=0x7f9b1000bbf0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 msgr2=0x7f9b18198c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:03.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 0x7f9b18198c60 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f9b08005940 tx=0x7f9b080042f0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2089665562 shutdown_connections 2024-09-19T04:36:03.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9b040a3430 0x7f9b040a58f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b18108290 0x7f9b1819cff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b18103740 0x7f9b18198c60 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 --2- 172.21.15.70:0/2089665562 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b18102d90 0x7f9b18198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:03.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2089665562 >> 172.21.15.70:0/2089665562 conn(0x7f9b180fc7d0 msgr2=0x7f9b18105e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:03.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2089665562 shutdown_connections 2024-09-19T04:36:03.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:03.939+0000 7f9b1fd7e640 1 -- 172.21.15.70:0/2089665562 wait complete. 2024-09-19T04:36:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:04 smithi070 ceph-mon[30942]: pgmap v162: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:36:04.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:04 smithi167 ceph-mon[34339]: pgmap v162: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:36:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:04 smithi134 ceph-mon[34525]: pgmap v162: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:36:05.642 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:36:05.642 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:36:05.900 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 -- 172.21.15.70:0/3695688870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c102790 msgr2=0x7f0f9c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 --2- 172.21.15.70:0/3695688870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c102790 0x7f0f9c1067e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c009900 tx=0x7f0f8c02a410 comp rx=0 tx=0).stop 2024-09-19T04:36:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 -- 172.21.15.70:0/3695688870 shutdown_connections 2024-09-19T04:36:06.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 --2- 172.21.15.70:0/3695688870 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f9c106f10 0x7f0f9c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 --2- 172.21.15.70:0/3695688870 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c102790 0x7f0f9c1067e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 --2- 172.21.15.70:0/3695688870 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f9c101de0 0x7f0f9c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 -- 172.21.15.70:0/3695688870 >> 172.21.15.70:0/3695688870 conn(0x7f0f9c0fd8c0 msgr2=0x7f0f9c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 -- 172.21.15.70:0/3695688870 shutdown_connections 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.393+0000 7f0fa381c640 1 -- 172.21.15.70:0/3695688870 wait complete. 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa381c640 1 Processor -- start 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa381c640 1 -- start start 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa381c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c101de0 0x7f0f9c198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa381c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f9c102790 0x7f0f9c1989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa381c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f9c106f10 0x7f0f9c19cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa381c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c111f40 con 0x7f0f9c101de0 2024-09-19T04:36:06.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa381c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c111dc0 con 0x7f0f9c106f10 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa381c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1120c0 con 0x7f0f9c102790 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c101de0 0x7f0f9c198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c101de0 0x7f0f9c198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56110/0 (socket says 172.21.15.70:56110) 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 -- 172.21.15.70:0/2323861421 learned_addr learned my addr 172.21.15.70:0/2323861421 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 -- 172.21.15.70:0/2323861421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f9c102790 msgr2=0x7f0f9c1989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f9c102790 0x7f0f9c1989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 -- 172.21.15.70:0/2323861421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f9c106f10 msgr2=0x7f0f9c19cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f9c106f10 0x7f0f9c19cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 -- 172.21.15.70:0/2323861421 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f9c19d440 con 0x7f0f9c101de0 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c101de0 0x7f0f9c198490 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800c890 tx=0x7f0f9800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.394+0000 7f0f927fc640 1 -- 172.21.15.70:0/2323861421 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004220 con 0x7f0f9c101de0 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.395+0000 7f0f927fc640 1 -- 172.21.15.70:0/2323861421 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f980043c0 con 0x7f0f9c101de0 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.395+0000 7f0fa381c640 1 -- 172.21.15.70:0/2323861421 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f9c19d730 con 0x7f0f9c101de0 2024-09-19T04:36:06.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.395+0000 7f0f927fc640 1 -- 172.21.15.70:0/2323861421 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f98004a00 con 0x7f0f9c101de0 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.395+0000 7f0fa381c640 1 -- 172.21.15.70:0/2323861421 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f9c1a5010 con 0x7f0f9c101de0 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.397+0000 7f0f927fc640 1 -- 172.21.15.70:0/2323861421 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0f98004ba0 con 0x7f0f9c101de0 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.397+0000 7f0fa5bf5740 1 Processor -- start 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.397+0000 7f0fa5bf5740 1 -- start start 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f00b80 0x5644c3f00f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f0b820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f0e150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5644c3e66280 con 0x5644c3f0bd60 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5644c3e0db10 con 0x5644c3f014a0 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5644c3e62240 con 0x5644c3f00b80 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f0e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f0e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56120/0 (socket says 172.21.15.70:56120) 2024-09-19T04:36:06.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 -- 172.21.15.70:0/694573175 learned_addr learned my addr 172.21.15.70:0/694573175 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0f927fc640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f880a33b0 0x7f0f880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f0b820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f880a33b0 0x7f0f880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f00b80 0x5644c3f00f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 -- 172.21.15.70:0/694573175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f00b80 msgr2=0x5644c3f00f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f00b80 0x5644c3f00f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 -- 172.21.15.70:0/694573175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 msgr2=0x5644c3f0b820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f0b820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 -- 172.21.15.70:0/694573175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c3e1a1f0 con 0x5644c3f0bd60 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f0b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:06.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0f927fc640 1 -- 172.21.15.70:0/2323861421 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f0f980cfb30 con 0x7f0f9c101de0 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0fa0db7640 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f0e150 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c005e80 tx=0x7f0f8c032b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=547b39ba7a2a7caa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f880a33b0 0x7f0f880a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0f94005fd0 tx=0x7f0f94009290 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.398+0000 7f0f877fe640 1 -- 172.21.15.70:0/694573175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c03f070 con 0x5644c3f0bd60 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0f877fe640 1 -- 172.21.15.70:0/694573175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f8c004040 con 0x5644c3f0bd60 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0f877fe640 1 -- 172.21.15.70:0/694573175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c035070 con 0x5644c3f0bd60 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/694573175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 msgr2=0x5644c3f0e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f0e150 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c005e80 tx=0x7f0f8c032b90 comp rx=0 tx=0).stop 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/694573175 shutdown_connections 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f0e150 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f0b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/694573175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f00b80 0x5644c3f00f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/694573175 >> 172.21.15.70:0/694573175 conn(0x5644c3efd110 msgr2=0x5644c3efd4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:06.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/694573175 shutdown_connections 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.399+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/694573175 wait complete. 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 1 -- start start 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 1 Processor -- start 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f08ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f014a0 0x5644c3f090e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f09620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5644c3f0e930 con 0x5644c3f0bd60 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5644c3e20f10 con 0x5644c3f00b80 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5644c3f0eab0 con 0x5644c3f014a0 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa5bf5740 10 client.0 _ll_register_callbacks cb 0x5644c3de9a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa1db9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f09620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa1db9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f09620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56124/0 (socket says 172.21.15.70:56124) 2024-09-19T04:36:06.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa1db9640 1 -- 172.21.15.70:0/4140986014 learned_addr learned my addr 172.21.15.70:0/4140986014 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa0db7640 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f014a0 0x5644c3f090e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.400+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f08ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa1db9640 1 -- 172.21.15.70:0/4140986014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f014a0 msgr2=0x5644c3f090e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f014a0 0x5644c3f090e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa1db9640 1 -- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 msgr2=0x5644c3f08ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f08ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa1db9640 1 -- 172.21.15.70:0/4140986014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c3bd76a0 con 0x5644c3f0bd60 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f08ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f09620 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400fc20 tx=0x7f0f94004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4ec9edce1b4d040 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0f84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0f84ff9640 1 -- 172.21.15.70:0/4140986014 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94022070 con 0x5644c3f0bd60 2024-09-19T04:36:06.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0f84ff9640 1 -- 172.21.15.70:0/4140986014 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f0f9401e640 con 0x5644c3f0bd60 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/4140986014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f8c004040 con 0x5644c3f0bd60 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0f84ff9640 1 -- 172.21.15.70:0/4140986014 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f9402e050 con 0x5644c3f0bd60 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 10 client.16122 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/4140986014 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5644c3f1a500 con 0x5644c3f0bd60 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0f84ff9640 1 -- 172.21.15.70:0/4140986014 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f8c004040 con 0x5644c3f0bd60 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0f84ff9640 1 -- 172.21.15.70:0/4140986014 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0f940267c0 con 0x5644c3f0bd60 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 10 client.16122 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 10 client.16122 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 20 client.16122 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5644c3f1b960 0x5644c3f1de00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 4 client.16122 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.401+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/4140986014 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5644c3e737f0 con 0x5644c3f1b960 2024-09-19T04:36:06.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.402+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5644c3f1b960 0x5644c3f1de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.402+0000 7f0f84ff9640 10 client.16122 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.402+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5644c3f1b960 0x5644c3f1de00 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f9b20cc64a27f76 server_cookie=e9629ab3ebae9590 in_seq=0 out_seq=0 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0f84ff9640 1 -- 172.21.15.70:0/4140986014 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5644c3e737f0 con 0x5644c3f1b960 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0f84ff9640 10 client.16122 handle_command_reply: tid=0 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 client.16122 shutdown 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/4140986014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 msgr2=0x5644c3f09620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f09620 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f0f9400fc20 tx=0x7f0f94004a40 comp rx=0 tx=0).stop 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/4140986014 shutdown_connections 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5644c3f1b960 0x5644c3f1de00 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f0bd60 0x5644c3f09620 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0f84ff9640 0 client.16122 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f014a0 0x5644c3f090e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/4140986014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f08ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/4140986014 >> 172.21.15.70:0/4140986014 conn(0x5644c3efd110 msgr2=0x5644c3f02df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/4140986014 shutdown_connections 2024-09-19T04:36:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/4140986014 wait complete. 2024-09-19T04:36:06.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.403+0000 7f0fa5bf5740 20 client.16122 trim_cache size 0 max 16384 2024-09-19T04:36:06.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.421+0000 7f0fa5bf5740 1 Processor -- start 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.421+0000 7f0fa5bf5740 1 -- start start 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f0aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f014a0 0x5644c3f236d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f23c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1b0100 con 0x5644c3f014a0 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1ad910 con 0x5644c3f00b80 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1ab760 con 0x5644c3f0bd60 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa1db9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f23c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa15b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f0aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa15b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f0aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:35958/0 (socket says 172.21.15.70:35958) 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa15b8640 1 -- 172.21.15.70:0/52310823 learned_addr learned my addr 172.21.15.70:0/52310823 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:06.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.422+0000 7f0fa0db7640 1 --2- 172.21.15.70:0/52310823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f014a0 0x5644c3f236d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.423+0000 7f0fa1db9640 1 -- 172.21.15.70:0/52310823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 msgr2=0x5644c3f0aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:06.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.423+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/52310823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f0aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.423+0000 7f0fa1db9640 1 -- 172.21.15.70:0/52310823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f014a0 msgr2=0x5644c3f236d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:06.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.423+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/52310823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f014a0 0x5644c3f236d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.423+0000 7f0fa1db9640 1 -- 172.21.15.70:0/52310823 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644c3f012d0 con 0x5644c3f0bd60 2024-09-19T04:36:06.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.423+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/52310823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f23c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f94026d00 tx=0x7f0f94005c60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8d18e26a85104e8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:06.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.423+0000 7f0f86ffd640 1 -- 172.21.15.70:0/52310823 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94022070 con 0x5644c3f0bd60 2024-09-19T04:36:06.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.424+0000 7f0f86ffd640 1 -- 172.21.15.70:0/52310823 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f94026d30 con 0x5644c3f0bd60 2024-09-19T04:36:06.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.424+0000 7f0f86ffd640 1 -- 172.21.15.70:0/52310823 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f94005020 con 0x5644c3f0bd60 2024-09-19T04:36:06.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.424+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/52310823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 msgr2=0x5644c3f23c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.424+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/52310823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f23c10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f0f94026d00 tx=0x7f0f94005c60 comp rx=0 tx=0).stop 2024-09-19T04:36:06.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/52310823 shutdown_connections 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/52310823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f23c10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/52310823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f014a0 0x5644c3f236d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/52310823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f00b80 0x5644c3f0aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/52310823 >> 172.21.15.70:0/52310823 conn(0x5644c3efd110 msgr2=0x5644c3f0a2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/52310823 shutdown_connections 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/52310823 wait complete. 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 -- start start 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 Processor -- start 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f00b80 0x5644c3f05da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f062e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f06820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1abdd0 con 0x5644c3f00b80 2024-09-19T04:36:06.430 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1ad240 con 0x5644c3f014a0 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.425+0000 7f0fa5bf5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0f9c1ac4a0 con 0x5644c3f0bd60 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa5bf5740 10 client.0 _ll_register_callbacks cb 0x7f0f94009920 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f00b80 0x5644c3f05da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f00b80 0x5644c3f05da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56140/0 (socket says 172.21.15.70:56140) 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 -- 172.21.15.70:0/2572096228 learned_addr learned my addr 172.21.15.70:0/2572096228 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa1db9640 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f06820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa0db7640 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f062e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 -- 172.21.15.70:0/2572096228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 msgr2=0x5644c3f06820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f06820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 -- 172.21.15.70:0/2572096228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 msgr2=0x5644c3f062e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f062e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 -- 172.21.15.70:0/2572096228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644c3f85800 con 0x5644c3f00b80 2024-09-19T04:36:06.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa15b8640 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f00b80 0x5644c3f05da0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0f9809ba80 tx=0x7f0f9809be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=379cd60154d95d47 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0f84ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0f84ff9640 1 -- 172.21.15.70:0/2572096228 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f9801d040 con 0x5644c3f00b80 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0f84ff9640 1 -- 172.21.15.70:0/2572096228 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f0f98004e90 con 0x5644c3f00b80 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.426+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/2572096228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f94026d30 con 0x5644c3f00b80 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0f84ff9640 1 -- 172.21.15.70:0/2572096228 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f0f980a4aa0 con 0x5644c3f00b80 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa5bf5740 10 client.16128 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/2572096228 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5644c3f86b80 con 0x5644c3f00b80 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0f84ff9640 1 -- 172.21.15.70:0/2572096228 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f94026d30 con 0x5644c3f00b80 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0f84ff9640 1 -- 172.21.15.70:0/2572096228 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f0f98097b80 con 0x5644c3f00b80 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa5bf5740 10 client.16128 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa5bf5740 10 client.16128 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:06.432 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa5bf5740 20 client.16128 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:06.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5644c3f87330 0x5644c3f89750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:06.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa5bf5740 4 client.16128 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:36:06.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/2572096228 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5644c3e6dd00 con 0x5644c3f87330 2024-09-19T04:36:06.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.427+0000 7f0fa0db7640 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5644c3f87330 0x5644c3f89750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:06.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.428+0000 7f0fa0db7640 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5644c3f87330 0x5644c3f89750 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cf9eecc8d71eb28f server_cookie=af7d2365c34c2eaf in_seq=0 out_seq=0 2024-09-19T04:36:06.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.428+0000 7f0f84ff9640 10 client.16128 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0f84ff9640 1 -- 172.21.15.70:0/2572096228 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5644c3e6dd00 con 0x5644c3f87330 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0f84ff9640 10 client.16128 handle_command_reply: tid=0 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 client.16128 shutdown 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/2572096228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f00b80 msgr2=0x5644c3f05da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f00b80 0x5644c3f05da0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f0f9809ba80 tx=0x7f0f9809be30 comp rx=0 tx=0).stop 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/2572096228 shutdown_connections 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5644c3f87330 0x5644c3f89750 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5644c3f0bd60 0x5644c3f06820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5644c3f014a0 0x5644c3f062e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 --2- 172.21.15.70:0/2572096228 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5644c3f00b80 0x5644c3f05da0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0f84ff9640 0 client.16128 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/2572096228 >> 172.21.15.70:0/2572096228 conn(0x5644c3efd110 msgr2=0x5644c3f09380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/2572096228 shutdown_connections 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 1 -- 172.21.15.70:0/2572096228 wait complete. 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.429+0000 7f0fa5bf5740 20 client.16128 trim_cache size 0 max 16384 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "fe49845d-947c-401f-a935-b6e706b92df3", 2024-09-19T04:36:06.435 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:36:06.436 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:06.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 -- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f880a33b0 msgr2=0x7f0f880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f880a33b0 0x7f0f880a5870 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f0f94005fd0 tx=0x7f0f94009290 comp rx=0 tx=0).stop 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 -- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c101de0 msgr2=0x7f0f9c198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c101de0 0x7f0f9c198490 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f0f9800c890 tx=0x7f0f9800cd50 comp rx=0 tx=0).stop 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 -- 172.21.15.70:0/2323861421 shutdown_connections 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f880a33b0 0x7f0f880a5870 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f9c106f10 0x7f0f9c19cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f9c102790 0x7f0f9c1989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 --2- 172.21.15.70:0/2323861421 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f9c101de0 0x7f0f9c198490 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 -- 172.21.15.70:0/2323861421 >> 172.21.15.70:0/2323861421 conn(0x7f0f9c0fd8c0 msgr2=0x7f0f9c0fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 -- 172.21.15.70:0/2323861421 shutdown_connections 2024-09-19T04:36:06.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:06.430+0000 7f0fa381c640 1 -- 172.21.15.70:0/2323861421 wait complete. 2024-09-19T04:36:06.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:06 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:36:06.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:06 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:06.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:06 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:36:06.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:06 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:06.962 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:06 smithi167 ceph-mon[34339]: pgmap v163: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:36:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:06 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:36:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:06 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:06 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:36:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:06 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:06 smithi134 ceph-mon[34525]: pgmap v163: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:36:07.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:06 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:36:07.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:06 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:07.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:06 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:36:07.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:06 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:07.046 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:06 smithi070 ceph-mon[30942]: pgmap v163: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 19 op/s 2024-09-19T04:36:07.145 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:36:07.392 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:07.766 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:07 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:36:07.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.841+0000 7f2a7a77d640 1 -- 172.21.15.70:0/2407177984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74106a80 msgr2=0x7f2a74106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.841+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/2407177984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74106a80 0x7f2a74106e60 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f2a64009930 tx=0x7f2a6402a420 comp rx=0 tx=0).stop 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 -- 172.21.15.70:0/2407177984 shutdown_connections 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/2407177984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a74101420 0x7f2a7410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/2407177984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a74100a80 0x7f2a74100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/2407177984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74106a80 0x7f2a74106e60 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 -- 172.21.15.70:0/2407177984 >> 172.21.15.70:0/2407177984 conn(0x7f2a740fc7a0 msgr2=0x7f2a740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 -- 172.21.15.70:0/2407177984 shutdown_connections 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 -- 172.21.15.70:0/2407177984 wait complete. 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 Processor -- start 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 -- start start 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74100a80 0x7f2a74197310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a74101420 0x7f2a74197850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a74106a80 0x7f2a7419bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74110e50 con 0x7f2a74100a80 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74110cd0 con 0x7f2a74106a80 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a7a77d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a74110fd0 con 0x7f2a74101420 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a73fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74100a80 0x7f2a74197310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a73fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74100a80 0x7f2a74197310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56164/0 (socket says 172.21.15.70:56164) 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.842+0000 7f2a73fff640 1 -- 172.21.15.70:0/3489784021 learned_addr learned my addr 172.21.15.70:0/3489784021 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a74101420 0x7f2a74197850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a74106a80 0x7f2a7419bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a73fff640 1 -- 172.21.15.70:0/3489784021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a74101420 msgr2=0x7f2a74197850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a73fff640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a74101420 0x7f2a74197850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a73fff640 1 -- 172.21.15.70:0/3489784021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a74106a80 msgr2=0x7f2a7419bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a73fff640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a74106a80 0x7f2a7419bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a73fff640 1 -- 172.21.15.70:0/3489784021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a7419c2c0 con 0x7f2a74100a80 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a74101420 0x7f2a74197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a73fff640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74100a80 0x7f2a74197310 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2a64005940 tx=0x7f2a640042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a71ffb640 1 -- 172.21.15.70:0/3489784021 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6403f030 con 0x7f2a74100a80 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a7a77d640 1 -- 172.21.15.70:0/3489784021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a7419c550 con 0x7f2a74100a80 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a71ffb640 1 -- 172.21.15.70:0/3489784021 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a64003ac0 con 0x7f2a74100a80 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a71ffb640 1 -- 172.21.15.70:0/3489784021 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a64035070 con 0x7f2a74100a80 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.843+0000 7f2a7a77d640 1 -- 172.21.15.70:0/3489784021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a741a3e90 con 0x7f2a74100a80 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a71ffb640 1 -- 172.21.15.70:0/3489784021 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2a64042030 con 0x7f2a74100a80 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a7cb56740 1 Processor -- start 2024-09-19T04:36:07.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a7cb56740 1 -- start start 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb07880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 0x559eabb12140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb14a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559eaba6d2e0 con 0x559eabb12680 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559eaba14ce0 con 0x559eabb07dc0 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559eaba692a0 con 0x559eabb074a0 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb14a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb14a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56170/0 (socket says 172.21.15.70:56170) 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a6bfff640 1 -- 172.21.15.70:0/3500658783 learned_addr learned my addr 172.21.15.70:0/3500658783 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.846+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb07880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a73fff640 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 0x559eabb12140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6bfff640 1 -- 172.21.15.70:0/3500658783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 msgr2=0x559eabb07880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:07.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb07880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a71ffb640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a600a33b0 0x7f2a600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6bfff640 1 -- 172.21.15.70:0/3500658783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 msgr2=0x559eabb12140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 0x559eabb12140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6bfff640 1 -- 172.21.15.70:0/3500658783 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eab9f9440 con 0x559eabb12680 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a600a33b0 0x7f2a600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb14a70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00bd30 tx=0x7f2a5c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65714130c71a59d1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a71ffb640 1 -- 172.21.15.70:0/3489784021 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2a640f0280 con 0x7f2a74100a80 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6a7fc640 1 -- 172.21.15.70:0/3500658783 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c015070 con 0x559eabb12680 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6a7fc640 1 -- 172.21.15.70:0/3500658783 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a5c00be20 con 0x559eabb12680 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.847+0000 7f2a6a7fc640 1 -- 172.21.15.70:0/3500658783 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c011970 con 0x559eabb12680 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 -- 172.21.15.70:0/3500658783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 msgr2=0x559eabb14a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a600a33b0 0x7f2a600a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c007e70 tx=0x7f2a6c007600 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:07.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb14a70 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c00bd30 tx=0x7f2a5c00f730 comp rx=0 tx=0).stop 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 -- 172.21.15.70:0/3500658783 shutdown_connections 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb14a70 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 0x559eabb12140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/3500658783 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb07880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 -- 172.21.15.70:0/3500658783 >> 172.21.15.70:0/3500658783 conn(0x559eabb03a30 msgr2=0x559eabb03e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 -- 172.21.15.70:0/3500658783 shutdown_connections 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 -- 172.21.15.70:0/3500658783 wait complete. 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 -- start start 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.848+0000 7f2a7cb56740 1 Processor -- start 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb074a0 0x559eabb0d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb07dc0 0x559eabb0dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb0e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559eabb151f0 con 0x559eabb12680 2024-09-19T04:36:07.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559eaba28050 con 0x559eabb074a0 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559eabb15370 con 0x559eabb07dc0 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a7cb56740 10 client.0 _ll_register_callbacks cb 0x559eaba68160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb0e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb0e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56182/0 (socket says 172.21.15.70:56182) 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 -- 172.21.15.70:0/1242846135 learned_addr learned my addr 172.21.15.70:0/1242846135 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a73fff640 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb074a0 0x559eabb0d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb07dc0 0x559eabb0dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 -- 172.21.15.70:0/1242846135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb07dc0 msgr2=0x559eabb0dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb07dc0 0x559eabb0dc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 -- 172.21.15.70:0/1242846135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb074a0 msgr2=0x559eabb0d6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb074a0 0x559eabb0d6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 -- 172.21.15.70:0/1242846135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eab7de3c0 con 0x559eabb12680 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb0e140 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c01cda0 tx=0x7f2a6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77719067a3e58c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:07.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a537fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a537fe640 1 -- 172.21.15.70:0/1242846135 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c003970 con 0x559eabb12680 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a537fe640 1 -- 172.21.15.70:0/1242846135 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2a6c003b10 con 0x559eabb12680 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1242846135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a5c00be20 con 0x559eabb12680 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.849+0000 7f2a537fe640 1 -- 172.21.15.70:0/1242846135 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a6c01a460 con 0x559eabb12680 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a7cb56740 10 client.16140 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1242846135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559eabb25030 con 0x559eabb12680 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a537fe640 1 -- 172.21.15.70:0/1242846135 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a5c00be20 con 0x559eabb12680 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a537fe640 1 -- 172.21.15.70:0/1242846135 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2a6c02b020 con 0x559eabb12680 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a7cb56740 10 client.16140 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a7cb56740 10 client.16140 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a7cb56740 20 client.16140 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559eabb265b0 0x559eabb28a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a7cb56740 4 client.16140 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1242846135 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559eaba7a850 con 0x559eabb265b0 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.850+0000 7f2a73fff640 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559eabb265b0 0x559eabb28a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.851+0000 7f2a537fe640 10 client.16140 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.851+0000 7f2a73fff640 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559eabb265b0 0x559eabb28a50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1aade16c309e0be2 server_cookie=aa3de9476447c0fc in_seq=0 out_seq=0 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.851+0000 7f2a537fe640 1 -- 172.21.15.70:0/1242846135 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559eaba7a850 con 0x559eabb265b0 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.851+0000 7f2a537fe640 10 client.16140 handle_command_reply: tid=0 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.851+0000 7f2a7cb56740 1 client.16140 shutdown 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1242846135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 msgr2=0x559eabb0e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb0e140 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c01cda0 tx=0x7f2a6c004a40 comp rx=0 tx=0).stop 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1242846135 shutdown_connections 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559eabb265b0 0x559eabb28a50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb0e140 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb07dc0 0x559eabb0dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1242846135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb074a0 0x559eabb0d6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a537fe640 0 client.16140 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:07.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1242846135 >> 172.21.15.70:0/1242846135 conn(0x559eabb03a30 msgr2=0x559eabb09710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:07.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1242846135 shutdown_connections 2024-09-19T04:36:07.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1242846135 wait complete. 2024-09-19T04:36:07.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.852+0000 7f2a7cb56740 20 client.16140 trim_cache size 0 max 16384 2024-09-19T04:36:07.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a7cb56740 1 Processor -- start 2024-09-19T04:36:07.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a7cb56740 1 -- start start 2024-09-19T04:36:07.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb14790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb07dc0 0x559eabb0b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb12680 0x559eabb21660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a741adea0 con 0x559eabb07dc0 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a741ab6b0 con 0x559eabb12680 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a741a9520 con 0x559eabb074a0 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb07dc0 0x559eabb0b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a6bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb07dc0 0x559eabb0b0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56186/0 (socket says 172.21.15.70:56186) 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a6bfff640 1 -- 172.21.15.70:0/2118040603 learned_addr learned my addr 172.21.15.70:0/2118040603 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a73fff640 1 --2- 172.21.15.70:0/2118040603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb14790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a6bfff640 1 -- 172.21.15.70:0/2118040603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 msgr2=0x559eabb14790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:07.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/2118040603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb14790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.869+0000 7f2a6bfff640 1 -- 172.21.15.70:0/2118040603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb12680 msgr2=0x559eabb21660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:07.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.870+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/2118040603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb12680 0x559eabb21660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.870+0000 7f2a6bfff640 1 -- 172.21.15.70:0/2118040603 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559eabb07bf0 con 0x559eabb07dc0 2024-09-19T04:36:07.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.870+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/2118040603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb07dc0 0x559eabb0b0f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c019000 tx=0x7f2a5c00bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db2617ebd7441f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:07.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.870+0000 7f2a69ffb640 1 -- 172.21.15.70:0/2118040603 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c028070 con 0x559eabb07dc0 2024-09-19T04:36:07.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.870+0000 7f2a69ffb640 1 -- 172.21.15.70:0/2118040603 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a5c00b840 con 0x559eabb07dc0 2024-09-19T04:36:07.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.870+0000 7f2a69ffb640 1 -- 172.21.15.70:0/2118040603 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a5c015040 con 0x559eabb07dc0 2024-09-19T04:36:07.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 -- 172.21.15.70:0/2118040603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb07dc0 msgr2=0x559eabb0b0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/2118040603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb07dc0 0x559eabb0b0f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f2a5c019000 tx=0x7f2a5c00bc30 comp rx=0 tx=0).stop 2024-09-19T04:36:07.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 -- 172.21.15.70:0/2118040603 shutdown_connections 2024-09-19T04:36:07.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/2118040603 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb12680 0x559eabb21660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/2118040603 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb07dc0 0x559eabb0b0f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/2118040603 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb14790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 -- 172.21.15.70:0/2118040603 >> 172.21.15.70:0/2118040603 conn(0x559eabb03a30 msgr2=0x559eabb0c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 -- 172.21.15.70:0/2118040603 shutdown_connections 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 -- 172.21.15.70:0/2118040603 wait complete. 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 -- start start 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.871+0000 7f2a7cb56740 1 Processor -- start 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb2e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 0x559eabb21680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a7cb56740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb21bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a741a9b70 con 0x559eabb12680 2024-09-19T04:36:07.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a741aafe0 con 0x559eabb07dc0 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a7cb56740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a741aa240 con 0x559eabb074a0 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb21bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a7cb56740 10 client.0 _ll_register_callbacks cb 0x7f2a6c007bd0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb21bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56188/0 (socket says 172.21.15.70:56188) 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 -- 172.21.15.70:0/1971170146 learned_addr learned my addr 172.21.15.70:0/1971170146 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a73fff640 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb2e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a6bfff640 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 0x559eabb21680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 -- 172.21.15.70:0/1971170146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 msgr2=0x559eabb2e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb2e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 -- 172.21.15.70:0/1971170146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 msgr2=0x559eabb21680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 0x559eabb21680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 -- 172.21.15.70:0/1971170146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559eabb22130 con 0x559eabb12680 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a78d1a640 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb21bc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0073f0 tx=0x7f2a6c004c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24c961d82f487978 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:07.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.872+0000 7f2a537fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a537fe640 1 -- 172.21.15.70:0/1971170146 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a6c00ec10 con 0x559eabb12680 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a537fe640 1 -- 172.21.15.70:0/1971170146 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f2a6c01a810 con 0x559eabb12680 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1971170146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a5c00b840 con 0x559eabb12680 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a537fe640 1 -- 172.21.15.70:0/1971170146 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f2a6c03e050 con 0x559eabb12680 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 10 client.16146 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1971170146 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x559eabb2e100 con 0x559eabb12680 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a537fe640 1 -- 172.21.15.70:0/1971170146 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a5c00b840 con 0x559eabb12680 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a537fe640 1 -- 172.21.15.70:0/1971170146 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f2a6c035070 con 0x559eabb12680 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 10 client.16146 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:07.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 10 client.16146 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:07.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 20 client.16146 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:07.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559eabb91820 0x559eabb93c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:07.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 4 client.16146 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:36:07.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.873+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1971170146 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559eaba74d60 con 0x559eabb91820 2024-09-19T04:36:07.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a73fff640 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559eabb91820 0x559eabb93c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:07.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a537fe640 10 client.16146 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:07.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a73fff640 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559eabb91820 0x559eabb93c40 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2434663747745955 server_cookie=bcd4b45aedc98230 in_seq=0 out_seq=0 2024-09-19T04:36:07.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a537fe640 1 -- 172.21.15.70:0/1971170146 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559eaba74d60 con 0x559eabb91820 2024-09-19T04:36:07.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a537fe640 10 client.16146 handle_command_reply: tid=0 2024-09-19T04:36:07.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a7cb56740 1 client.16146 shutdown 2024-09-19T04:36:07.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1971170146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 msgr2=0x559eabb21bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb21bc0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0073f0 tx=0x7f2a6c004c90 comp rx=0 tx=0).stop 2024-09-19T04:36:07.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1971170146 shutdown_connections 2024-09-19T04:36:07.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559eabb91820 0x559eabb93c40 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559eabb12680 0x559eabb21bc0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559eabb07dc0 0x559eabb21680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.874+0000 7f2a7cb56740 1 --2- 172.21.15.70:0/1971170146 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559eabb074a0 0x559eabb2e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1971170146 >> 172.21.15.70:0/1971170146 conn(0x559eabb03a30 msgr2=0x559eabb10ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:07.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a537fe640 0 client.16146 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:07.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1971170146 shutdown_connections 2024-09-19T04:36:07.884 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7cb56740 1 -- 172.21.15.70:0/1971170146 wait complete. 2024-09-19T04:36:07.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7cb56740 20 client.16146 trim_cache size 0 max 16384 2024-09-19T04:36:07.885 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:36:07.885 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:36:07.885 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:07.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 -- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a600a33b0 msgr2=0x7f2a600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a600a33b0 0x7f2a600a5870 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c007e70 tx=0x7f2a6c007600 comp rx=0 tx=0).stop 2024-09-19T04:36:07.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 -- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74100a80 msgr2=0x7f2a74197310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:07.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74100a80 0x7f2a74197310 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7f2a64005940 tx=0x7f2a640042f0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 -- 172.21.15.70:0/3489784021 shutdown_connections 2024-09-19T04:36:07.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a600a33b0 0x7f2a600a5870 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.886 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a74106a80 0x7f2a7419bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a74101420 0x7f2a74197850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 --2- 172.21.15.70:0/3489784021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a74100a80 0x7f2a74197310 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:07.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 -- 172.21.15.70:0/3489784021 >> 172.21.15.70:0/3489784021 conn(0x7f2a740fc7a0 msgr2=0x7f2a740fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:07.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.875+0000 7f2a7a77d640 1 -- 172.21.15.70:0/3489784021 shutdown_connections 2024-09-19T04:36:07.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:07.876+0000 7f2a7a77d640 1 -- 172.21.15.70:0/3489784021 wait complete. 2024-09-19T04:36:07.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:07 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:36:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:07 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:36:08.462 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:36:08.463 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:36:08.715 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:08.836 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:08 smithi070 ceph-mon[30942]: pgmap v164: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:08.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:08 smithi167 ceph-mon[34339]: pgmap v164: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:08 smithi134 ceph-mon[34525]: pgmap v164: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 -- 172.21.15.70:0/1858802679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac106f20 msgr2=0x7f5cac10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1858802679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac106f20 0x7f5cac10eaa0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4009ca0 tx=0x7f5ca402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 -- 172.21.15.70:0/1858802679 shutdown_connections 2024-09-19T04:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1858802679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac106f20 0x7f5cac10eaa0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1858802679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cac1027a0 0x7f5cac1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1858802679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cac101df0 0x7f5cac1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 -- 172.21.15.70:0/1858802679 >> 172.21.15.70:0/1858802679 conn(0x7f5cac0fd8b0 msgr2=0x7f5cac0ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 -- 172.21.15.70:0/1858802679 shutdown_connections 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 -- 172.21.15.70:0/1858802679 wait complete. 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 Processor -- start 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.236+0000 7f5cb2660640 1 -- start start 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cb2660640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cac101df0 0x7f5cac1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cb2660640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac1027a0 0x7f5cac198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cb2660640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cac106f20 0x7f5cac19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:09.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cb2660640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac111f50 con 0x7f5cac1027a0 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cb2660640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac111dd0 con 0x7f5cac106f20 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cb2660640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5cac1120d0 con 0x7f5cac101df0 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac1027a0 0x7f5cac198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac1027a0 0x7f5cac198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56206/0 (socket says 172.21.15.70:56206) 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 -- 172.21.15.70:0/1302948559 learned_addr learned my addr 172.21.15.70:0/1302948559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cabfff640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cac101df0 0x7f5cac1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cb0bfd640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cac106f20 0x7f5cac19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 -- 172.21.15.70:0/1302948559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cac101df0 msgr2=0x7f5cac1983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cac101df0 0x7f5cac1983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 -- 172.21.15.70:0/1302948559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cac106f20 msgr2=0x7f5cac19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:09.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cac106f20 0x7f5cac19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 -- 172.21.15.70:0/1302948559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cac19d370 con 0x7f5cac1027a0 2024-09-19T04:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5cb0bfd640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cac106f20 0x7f5cac19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca3fff640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac1027a0 0x7f5cac198900 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400d950 tx=0x7f5c9400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.237+0000 7f5ca9ffb640 1 -- 172.21.15.70:0/1302948559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c94017070 con 0x7f5cac1027a0 2024-09-19T04:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.238+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cac19d660 con 0x7f5cac1027a0 2024-09-19T04:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.238+0000 7f5ca9ffb640 1 -- 172.21.15.70:0/1302948559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5c94009c30 con 0x7f5cac1027a0 2024-09-19T04:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.238+0000 7f5ca9ffb640 1 -- 172.21.15.70:0/1302948559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c9400f6b0 con 0x7f5cac1027a0 2024-09-19T04:36:09.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.238+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cac1a4f40 con 0x7f5cac1027a0 2024-09-19T04:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.238+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cac1021d0 con 0x7f5cac1027a0 2024-09-19T04:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.240+0000 7f5ca9ffb640 1 -- 172.21.15.70:0/1302948559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5c94010a50 con 0x7f5cac1027a0 2024-09-19T04:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.240+0000 7f5ca9ffb640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5c980a33b0 0x7f5c980a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.240+0000 7f5cabfff640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5c980a33b0 0x7f5c980a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.240+0000 7f5ca9ffb640 1 -- 172.21.15.70:0/1302948559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f5c940cf900 con 0x7f5cac1027a0 2024-09-19T04:36:09.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.241+0000 7f5cabfff640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5c980a33b0 0x7f5c980a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00bbe0 tx=0x7f5c9c00b390 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:09.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.244+0000 7f5ca9ffb640 1 -- 172.21.15.70:0/1302948559 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5c94009de0 con 0x7f5cac1027a0 2024-09-19T04:36:09.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.447+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5cac10a160 con 0x7f5cac1027a0 2024-09-19T04:36:09.449 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.448+0000 7f5ca9ffb640 1 -- 172.21.15.70:0/1302948559 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7f5c9409c300 con 0x7f5cac1027a0 2024-09-19T04:36:09.449 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:36:09.450 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-19T04:34:07:652724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:34:07.594198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:36:09.450 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5c980a33b0 msgr2=0x7f5c980a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5c980a33b0 0x7f5c980a5870 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00bbe0 tx=0x7f5c9c00b390 comp rx=0 tx=0).stop 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac1027a0 msgr2=0x7f5cac198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac1027a0 0x7f5cac198900 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f5c9400d950 tx=0x7f5c9400de10 comp rx=0 tx=0).stop 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 shutdown_connections 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5c980a33b0 0x7f5c980a5870 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cac106f20 0x7f5cac19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5cac1027a0 0x7f5cac198900 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 --2- 172.21.15.70:0/1302948559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5cac101df0 0x7f5cac1983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:09.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 >> 172.21.15.70:0/1302948559 conn(0x7f5cac0fd8b0 msgr2=0x7f5cac0feb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:09.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 shutdown_connections 2024-09-19T04:36:09.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:09.450+0000 7f5cb2660640 1 -- 172.21.15.70:0/1302948559 wait complete. 2024-09-19T04:36:09.774 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:09 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1302948559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:09.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:09 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1302948559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:10.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:09 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1302948559' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:10.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:36:10.324 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:10.752 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:10 smithi070 ceph-mon[30942]: pgmap v165: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T04:36:10.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.830+0000 7fefd07df640 1 -- 172.21.15.70:0/2483171742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc8102d30 msgr2=0x7fefc8103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.830+0000 7fefd07df640 1 --2- 172.21.15.70:0/2483171742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc8102d30 0x7fefc8103110 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009930 tx=0x7fefc402a420 comp rx=0 tx=0).stop 2024-09-19T04:36:10.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 -- 172.21.15.70:0/2483171742 shutdown_connections 2024-09-19T04:36:10.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 --2- 172.21.15.70:0/2483171742 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc81082a0 0x7fefc810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 --2- 172.21.15.70:0/2483171742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc81036e0 0x7fefc8107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 --2- 172.21.15.70:0/2483171742 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc8102d30 0x7fefc8103110 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 -- 172.21.15.70:0/2483171742 >> 172.21.15.70:0/2483171742 conn(0x7fefc80fc7d0 msgr2=0x7fefc80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:10.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 -- 172.21.15.70:0/2483171742 shutdown_connections 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 -- 172.21.15.70:0/2483171742 wait complete. 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 Processor -- start 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 -- start start 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8102d30 0x7fefc8100990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc81036e0 0x7fefc8100ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc81082a0 0x7fefc8101410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8112070 con 0x7fefc81082a0 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fefc8111ef0 con 0x7fefc8102d30 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.831+0000 7fefd07df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81121f0 con 0x7fefc81036e0 2024-09-19T04:36:10.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc81082a0 0x7fefc8101410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc81082a0 0x7fefc8101410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56224/0 (socket says 172.21.15.70:56224) 2024-09-19T04:36:10.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 -- 172.21.15.70:0/1815551593 learned_addr learned my addr 172.21.15.70:0/1815551593 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:10.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefce57b640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8102d30 0x7fefc8100990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 -- 172.21.15.70:0/1815551593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc81036e0 msgr2=0x7fefc8100ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc81036e0 0x7fefc8100ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 -- 172.21.15.70:0/1815551593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8102d30 msgr2=0x7fefc8100990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8102d30 0x7fefc8100990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 -- 172.21.15.70:0/1815551593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefc81a6aa0 con 0x7fefc81082a0 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefce57b640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8102d30 0x7fefc8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefced7c640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc81082a0 0x7fefc8101410 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fefc000eb10 tx=0x7fefc000c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefbf7fe640 1 -- 172.21.15.70:0/1815551593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0004b20 con 0x7fefc81082a0 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefd07df640 1 -- 172.21.15.70:0/1815551593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefc81a6d90 con 0x7fefc81082a0 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefbf7fe640 1 -- 172.21.15.70:0/1815551593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fefc0004cc0 con 0x7fefc81082a0 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefbf7fe640 1 -- 172.21.15.70:0/1815551593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc0010700 con 0x7fefc81082a0 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.832+0000 7fefd07df640 1 -- 172.21.15.70:0/1815551593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefc81a7280 con 0x7fefc81082a0 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.834+0000 7fefbf7fe640 1 -- 172.21.15.70:0/1815551593 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fefc0004e70 con 0x7fefc81082a0 2024-09-19T04:36:10.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefd2bb8740 1 Processor -- start 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefd2bb8740 1 -- start start 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf26090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 0x56439cf26a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 0x56439cf33760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56439ce8c2f0 con 0x56439cf27b40 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56439ce33cf0 con 0x56439cf31370 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56439ce882b0 con 0x56439cf265d0 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefcdd7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf26090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefcdd7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf26090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56238/0 (socket says 172.21.15.70:56238) 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefcdd7a640 1 -- 172.21.15.70:0/1937649275 learned_addr learned my addr 172.21.15.70:0/1937649275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefce57b640 1 --2- 172.21.15.70:0/1937649275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 0x56439cf26a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefbf7fe640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefb40a33b0 0x7fefb40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefcdd7a640 1 -- 172.21.15.70:0/1937649275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 msgr2=0x56439cf26a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/1937649275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 0x56439cf26a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefcdd7a640 1 -- 172.21.15.70:0/1937649275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 msgr2=0x56439cf33760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/1937649275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 0x56439cf33760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.835+0000 7fefcdd7a640 1 -- 172.21.15.70:0/1937649275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439ce183a0 con 0x56439cf27b40 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.836+0000 7fefced7c640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefb40a33b0 0x7fefb40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.836+0000 7fefbf7fe640 1 -- 172.21.15.70:0/1815551593 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fefc00d0380 con 0x7fefc81082a0 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.836+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/1937649275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf26090 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009c80 tx=0x7fefb8010740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557d3737c978105 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.836+0000 7fefbcff9640 1 -- 172.21.15.70:0/1937649275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8005020 con 0x56439cf27b40 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.836+0000 7fefbcff9640 1 -- 172.21.15.70:0/1937649275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fefb80047a0 con 0x56439cf27b40 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.836+0000 7fefbcff9640 1 -- 172.21.15.70:0/1937649275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb80126a0 con 0x56439cf27b40 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- 172.21.15.70:0/1937649275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 msgr2=0x56439cf26090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/1937649275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf26090 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fefb8009c80 tx=0x7fefb8010740 comp rx=0 tx=0).stop 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefced7c640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefb40a33b0 0x7fefb40a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fefc009c380 tx=0x7fefc006e400 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- 172.21.15.70:0/1937649275 shutdown_connections 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/1937649275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 0x56439cf33760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/1937649275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 0x56439cf26a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/1937649275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf26090 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- 172.21.15.70:0/1937649275 >> 172.21.15.70:0/1937649275 conn(0x56439ceef310 msgr2=0x56439cf22c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- 172.21.15.70:0/1937649275 shutdown_connections 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- 172.21.15.70:0/1937649275 wait complete. 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- start start 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 Processor -- start 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 0x56439cf30ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2df90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 0x56439cf2e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56439cf34070 con 0x56439cf27b40 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56439ce47060 con 0x56439cf31370 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56439cf341f0 con 0x56439cf265d0 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefd2bb8740 10 client.0 _ll_register_callbacks cb 0x56439cb9a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefce57b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefce57b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56250/0 (socket says 172.21.15.70:56250) 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.837+0000 7fefce57b640 1 -- 172.21.15.70:0/437475946 learned_addr learned my addr 172.21.15.70:0/437475946 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 0x56439cf2e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 0x56439cf30ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefce57b640 1 -- 172.21.15.70:0/437475946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 msgr2=0x56439cf30ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefce57b640 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 0x56439cf30ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefce57b640 1 -- 172.21.15.70:0/437475946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 msgr2=0x56439cf2e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefce57b640 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 0x56439cf2e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefce57b640 1 -- 172.21.15.70:0/437475946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56439cbfd3c0 con 0x56439cf27b40 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefce57b640 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2df90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009930 tx=0x7fefc4031db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd6e2ddc2354ed55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437475946 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc4035070 con 0x56439cf27b40 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437475946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb80047a0 con 0x56439cf27b40 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437475946 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fefc4031710 con 0x56439cf27b40 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437475946 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fefc4031910 con 0x56439cf27b40 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefd2bb8740 10 client.16164 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437475946 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56439cf3fa80 con 0x56439cf27b40 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437475946 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fefb80047a0 con 0x56439cf27b40 2024-09-19T04:36:10.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.838+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437475946 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fefc4003cd0 con 0x56439cf27b40 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefd2bb8740 10 client.16164 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefd2bb8740 10 client.16164 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefd2bb8740 20 client.16164 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56439cf40fe0 0x56439cf433d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefd2bb8740 4 client.16164 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437475946 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56439ce99860 con 0x56439cf40fe0 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56439cf40fe0 0x56439cf433d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56439cf40fe0 0x56439cf433d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=f579b6aabdac1c5d server_cookie=b7f8985863d41cfb in_seq=0 out_seq=0 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.839+0000 7fefb1ffb640 10 client.16164 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437475946 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56439ce99860 con 0x56439cf40fe0 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefb1ffb640 10 client.16164 handle_command_reply: tid=0 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 client.16164 shutdown 2024-09-19T04:36:10.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437475946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 msgr2=0x56439cf2df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2df90 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fefc4009930 tx=0x7fefc4031db0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437475946 shutdown_connections 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56439cf40fe0 0x56439cf433d0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf31370 0x56439cf2e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2df90 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefb1ffb640 0 client.16164 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437475946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf265d0 0x56439cf30ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437475946 >> 172.21.15.70:0/437475946 conn(0x56439ceef310 msgr2=0x56439cf28960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437475946 shutdown_connections 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437475946 wait complete. 2024-09-19T04:36:10.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.840+0000 7fefd2bb8740 20 client.16164 trim_cache size 0 max 16384 2024-09-19T04:36:10.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.853+0000 7fefd2bb8740 1 Processor -- start 2024-09-19T04:36:10.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.853+0000 7fefd2bb8740 1 -- start start 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 0x56439cf2df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf27b40 0x56439cf3d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf31370 0x56439cf27300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81b23f0 con 0x56439cf31370 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81afc00 con 0x56439cf265d0 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81ada50 con 0x56439cf27b40 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf31370 0x56439cf27300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf31370 0x56439cf27300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56266/0 (socket says 172.21.15.70:56266) 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 -- 172.21.15.70:0/707507945 learned_addr learned my addr 172.21.15.70:0/707507945 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefce57b640 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf27b40 0x56439cf3d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 0x56439cf2df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 -- 172.21.15.70:0/707507945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf27b40 msgr2=0x56439cf3d310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf27b40 0x56439cf3d310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 -- 172.21.15.70:0/707507945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 msgr2=0x56439cf2df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 0x56439cf2df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 -- 172.21.15.70:0/707507945 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56439cf2e860 con 0x56439cf31370 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf31370 0x56439cf27300 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fefb8010c40 tx=0x7fefb8009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=388bcc20e1dea1d7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefb3fff640 1 -- 172.21.15.70:0/707507945 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb8004440 con 0x56439cf31370 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefb3fff640 1 -- 172.21.15.70:0/707507945 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fefb8003ac0 con 0x56439cf31370 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.854+0000 7fefb3fff640 1 -- 172.21.15.70:0/707507945 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefb80298b0 con 0x56439cf31370 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 -- 172.21.15.70:0/707507945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf31370 msgr2=0x56439cf27300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf31370 0x56439cf27300 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fefb8010c40 tx=0x7fefb8009680 comp rx=0 tx=0).stop 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 -- 172.21.15.70:0/707507945 shutdown_connections 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf31370 0x56439cf27300 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf27b40 0x56439cf3d310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/707507945 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 0x56439cf2df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 -- 172.21.15.70:0/707507945 >> 172.21.15.70:0/707507945 conn(0x56439ceef310 msgr2=0x56439cf2d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 -- 172.21.15.70:0/707507945 shutdown_connections 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 -- 172.21.15.70:0/707507945 wait complete. 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 -- start start 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.855+0000 7fefd2bb8740 1 Processor -- start 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 0x56439cf2ae70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefd2bb8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf31370 0x56439cf2b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81ae0c0 con 0x56439cf27b40 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81af530 con 0x56439cf265d0 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefd2bb8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fefc81ae790 con 0x56439cf31370 2024-09-19T04:36:10.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefd2bb8740 10 client.0 _ll_register_callbacks cb 0x7fefc00093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56270/0 (socket says 172.21.15.70:56270) 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 -- 172.21.15.70:0/437311248 learned_addr learned my addr 172.21.15.70:0/437311248 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf31370 0x56439cf2b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 -- 172.21.15.70:0/437311248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf31370 msgr2=0x56439cf2b8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf31370 0x56439cf2b8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 -- 172.21.15.70:0/437311248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 msgr2=0x56439cf2ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 0x56439cf2ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 0x56439cf2ae70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 -- 172.21.15.70:0/437311248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56439cfaac60 con 0x56439cf27b40 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefce57b640 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2b3b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fefc40456e0 tx=0x7fefc4045990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=794658cd8dc8988b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:10.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefb1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437311248 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefc405b060 con 0x56439cf27b40 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437311248 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fefc4004250 con 0x56439cf27b40 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.856+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437311248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fefb8003ac0 con 0x56439cf27b40 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437311248 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fefc4052030 con 0x56439cf27b40 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefd2bb8740 10 client.16170 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437311248 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x56439cfabe40 con 0x56439cf27b40 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437311248 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fefb8003ac0 con 0x56439cf27b40 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437311248 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fefc403c440 con 0x56439cf27b40 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefd2bb8740 10 client.16170 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefd2bb8740 10 client.16170 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefd2bb8740 20 client.16170 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56439cfac620 0x56439cfaea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:10.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefd2bb8740 4 client.16170 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437311248 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56439ce93d70 con 0x56439cfac620 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.857+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56439cfac620 0x56439cfaea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefb1ffb640 10 client.16170 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefcdd7a640 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56439cfac620 0x56439cfaea40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=c821ad1b155438a server_cookie=1d393c85bc84705d in_seq=0 out_seq=0 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefb1ffb640 1 -- 172.21.15.70:0/437311248 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56439ce93d70 con 0x56439cfac620 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefb1ffb640 10 client.16170 handle_command_reply: tid=0 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 client.16170 shutdown 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437311248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 msgr2=0x56439cf2b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2b3b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fefc40456e0 tx=0x7fefc4045990 comp rx=0 tx=0).stop 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437311248 shutdown_connections 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56439cfac620 0x56439cfaea40 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56439cf31370 0x56439cf2b8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefb1ffb640 0 client.16170 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:10.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56439cf27b40 0x56439cf2b3b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 --2- 172.21.15.70:0/437311248 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56439cf265d0 0x56439cf2ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437311248 >> 172.21.15.70:0/437311248 conn(0x56439ceef310 msgr2=0x56439cf30010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:10.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437311248 shutdown_connections 2024-09-19T04:36:10.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 1 -- 172.21.15.70:0/437311248 wait complete. 2024-09-19T04:36:10.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.858+0000 7fefd2bb8740 20 client.16170 trim_cache size 0 max 16384 2024-09-19T04:36:10.867 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:10.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 -- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefb40a33b0 msgr2=0x7fefb40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefb40a33b0 0x7fefb40a5870 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fefc009c380 tx=0x7fefc006e400 comp rx=0 tx=0).stop 2024-09-19T04:36:10.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 -- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc81082a0 msgr2=0x7fefc8101410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:10.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc81082a0 0x7fefc8101410 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fefc000eb10 tx=0x7fefc000c2d0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 -- 172.21.15.70:0/1815551593 shutdown_connections 2024-09-19T04:36:10.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fefb40a33b0 0x7fefb40a5870 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fefc81082a0 0x7fefc8101410 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fefc81036e0 0x7fefc8100ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 --2- 172.21.15.70:0/1815551593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefc8102d30 0x7fefc8100990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:10.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 -- 172.21.15.70:0/1815551593 >> 172.21.15.70:0/1815551593 conn(0x7fefc80fc7d0 msgr2=0x7fefc8105de0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:10.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 -- 172.21.15.70:0/1815551593 shutdown_connections 2024-09-19T04:36:10.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:10.859+0000 7fefd07df640 1 -- 172.21.15.70:0/1815551593 wait complete. 2024-09-19T04:36:10.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:10 smithi167 ceph-mon[34339]: pgmap v165: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T04:36:11.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:10 smithi134 ceph-mon[34525]: pgmap v165: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-09-19T04:36:11.585 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:36:11.829 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:12.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.273+0000 7fb6243e4640 1 -- 172.21.15.70:0/2527450915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c100e20 msgr2=0x7fb61c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.273+0000 7fb6243e4640 1 --2- 172.21.15.70:0/2527450915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c100e20 0x7fb61c101200 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fb618009900 tx=0x7fb61802a480 comp rx=0 tx=0).stop 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.273+0000 7fb6243e4640 1 -- 172.21.15.70:0/2527450915 shutdown_connections 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.273+0000 7fb6243e4640 1 --2- 172.21.15.70:0/2527450915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c102ef0 0x7fb61c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.273+0000 7fb6243e4640 1 --2- 172.21.15.70:0/2527450915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb61c102570 0x7fb61c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.273+0000 7fb6243e4640 1 --2- 172.21.15.70:0/2527450915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c100e20 0x7fb61c101200 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 -- 172.21.15.70:0/2527450915 >> 172.21.15.70:0/2527450915 conn(0x7fb61c0fc7d0 msgr2=0x7fb61c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 -- 172.21.15.70:0/2527450915 shutdown_connections 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 -- 172.21.15.70:0/2527450915 wait complete. 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 Processor -- start 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 -- start start 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c100e20 0x7fb61c199330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb61c102570 0x7fb61c199870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c102ef0 0x7fb61c1a43b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c110f50 con 0x7fb61c102ef0 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c110dd0 con 0x7fb61c102570 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb6243e4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c1110d0 con 0x7fb61c100e20 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.274+0000 7fb622981640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c102ef0 0x7fb61c1a43b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622981640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c102ef0 0x7fb61c1a43b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56282/0 (socket says 172.21.15.70:56282) 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622981640 1 -- 172.21.15.70:0/1393819967 learned_addr learned my addr 172.21.15.70:0/1393819967 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb62197f640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb61c102570 0x7fb61c199870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622180640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c100e20 0x7fb61c199330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622981640 1 -- 172.21.15.70:0/1393819967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c100e20 msgr2=0x7fb61c199330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622981640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c100e20 0x7fb61c199330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622981640 1 -- 172.21.15.70:0/1393819967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb61c102570 msgr2=0x7fb61c199870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622981640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb61c102570 0x7fb61c199870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622981640 1 -- 172.21.15.70:0/1393819967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c1a48f0 con 0x7fb61c102ef0 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb622981640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c102ef0 0x7fb61c1a43b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb61400cad0 tx=0x7fb61400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb6137fe640 1 -- 172.21.15.70:0/1393819967 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61400ae20 con 0x7fb61c102ef0 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb6137fe640 1 -- 172.21.15.70:0/1393819967 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb614005020 con 0x7fb61c102ef0 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb6243e4640 1 -- 172.21.15.70:0/1393819967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61c1a4ac0 con 0x7fb61c102ef0 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb6137fe640 1 -- 172.21.15.70:0/1393819967 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb61400f690 con 0x7fb61c102ef0 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.275+0000 7fb6243e4640 1 -- 172.21.15.70:0/1393819967 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61c1a4fd0 con 0x7fb61c102ef0 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6137fe640 1 -- 172.21.15.70:0/1393819967 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb6140051d0 con 0x7fb61c102ef0 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6267bd740 1 Processor -- start 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6267bd740 1 -- start start 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94af090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 0x55daf94afa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 0x55daf94bc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6267bd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55daf94152f0 con 0x55daf94b0b40 2024-09-19T04:36:12.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6267bd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55daf93bccf0 con 0x55daf94af5d0 2024-09-19T04:36:12.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.278+0000 7fb6267bd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55daf94112b0 con 0x55daf94ba370 2024-09-19T04:36:12.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56290/0 (socket says 172.21.15.70:56290) 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 -- 172.21.15.70:0/3868555537 learned_addr learned my addr 172.21.15.70:0/3868555537 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb622180640 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 0x55daf94afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb6137fe640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb6080a33b0 0x7fb6080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 0x55daf94bc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 -- 172.21.15.70:0/3868555537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 msgr2=0x55daf94bc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 0x55daf94bc760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 -- 172.21.15.70:0/3868555537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 msgr2=0x55daf94afa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 0x55daf94afa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 -- 172.21.15.70:0/3868555537 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf93a13a0 con 0x55daf94b0b40 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb622981640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb6080a33b0 0x7fb6080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb6137fe640 1 -- 172.21.15.70:0/1393819967 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fb6140cfc80 con 0x7fb61c102ef0 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb62197f640 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94af090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00ae40 tx=0x7fb60c00a760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdaf9d24b2302b75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb610dea640 1 -- 172.21.15.70:0/3868555537 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c005220 con 0x55daf94b0b40 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb610dea640 1 -- 172.21.15.70:0/3868555537 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb60c017030 con 0x55daf94b0b40 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.279+0000 7fb610dea640 1 -- 172.21.15.70:0/3868555537 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c012450 con 0x55daf94b0b40 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 -- 172.21.15.70:0/3868555537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 msgr2=0x55daf94af090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94af090 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00ae40 tx=0x7fb60c00a760 comp rx=0 tx=0).stop 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb622981640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb6080a33b0 0x7fb6080a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb6140cd3f0 tx=0x7fb614000f40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 -- 172.21.15.70:0/3868555537 shutdown_connections 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 0x55daf94bc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 0x55daf94afa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3868555537 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94af090 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 -- 172.21.15.70:0/3868555537 >> 172.21.15.70:0/3868555537 conn(0x55daf9478310 msgr2=0x55daf94abc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:12.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 -- 172.21.15.70:0/3868555537 shutdown_connections 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.280+0000 7fb6267bd740 1 -- 172.21.15.70:0/3868555537 wait complete. 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 1 -- start start 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 1 Processor -- start 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 0x55daf94b9ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94ba370 0x55daf94b7490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55daf94bd070 con 0x55daf94b0b40 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55daf93d0060 con 0x55daf94ba370 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55daf94bd1f0 con 0x55daf94af5d0 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb6267bd740 10 client.0 _ll_register_callbacks cb 0x55daf91238c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb622180640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb62197f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 0x55daf94b9ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb622180640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56302/0 (socket says 172.21.15.70:56302) 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb622180640 1 -- 172.21.15.70:0/3500795533 learned_addr learned my addr 172.21.15.70:0/3500795533 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb62197f640 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94ba370 0x55daf94b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb622180640 1 -- 172.21.15.70:0/3500795533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 msgr2=0x55daf94b9ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb622180640 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 0x55daf94b9ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb622180640 1 -- 172.21.15.70:0/3500795533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94ba370 msgr2=0x55daf94b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb622180640 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94ba370 0x55daf94b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.281+0000 7fb622180640 1 -- 172.21.15.70:0/3500795533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf91863c0 con 0x55daf94b0b40 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb622180640 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b6f50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb618009900 tx=0x7fb6180316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4677c4e2a8601fda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb605ffb640 1 -- 172.21.15.70:0/3500795533 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618035040 con 0x55daf94b0b40 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb605ffb640 1 -- 172.21.15.70:0/3500795533 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fb618004240 con 0x55daf94b0b40 2024-09-19T04:36:12.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 1 -- 172.21.15.70:0/3500795533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb60c017030 con 0x55daf94b0b40 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb605ffb640 1 -- 172.21.15.70:0/3500795533 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb618004440 con 0x55daf94b0b40 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 10 client.16182 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 1 -- 172.21.15.70:0/3500795533 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55daf94c8a60 con 0x55daf94b0b40 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb605ffb640 1 -- 172.21.15.70:0/3500795533 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb60c017030 con 0x55daf94b0b40 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb605ffb640 1 -- 172.21.15.70:0/3500795533 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb61804e020 con 0x55daf94b0b40 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 10 client.16182 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 10 client.16182 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 20 client.16182 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55daf94c9ec0 0x55daf94cc2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 4 client.16182 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.282+0000 7fb6267bd740 1 -- 172.21.15.70:0/3500795533 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daf9422860 con 0x55daf94c9ec0 2024-09-19T04:36:12.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.283+0000 7fb62197f640 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55daf94c9ec0 0x55daf94cc2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.283+0000 7fb62197f640 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55daf94c9ec0 0x55daf94cc2e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cd83eb30697f30d1 server_cookie=def2dc5ab8f9b87c in_seq=0 out_seq=0 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.283+0000 7fb605ffb640 10 client.16182 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb605ffb640 1 -- 172.21.15.70:0/3500795533 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55daf9422860 con 0x55daf94c9ec0 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb605ffb640 10 client.16182 handle_command_reply: tid=0 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 client.16182 shutdown 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 -- 172.21.15.70:0/3500795533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 msgr2=0x55daf94b6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b6f50 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fb618009900 tx=0x7fb6180316d0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 -- 172.21.15.70:0/3500795533 shutdown_connections 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55daf94c9ec0 0x55daf94cc2e0 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94ba370 0x55daf94b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b6f50 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb605ffb640 0 client.16182 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 --2- 172.21.15.70:0/3500795533 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 0x55daf94b9ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 -- 172.21.15.70:0/3500795533 >> 172.21.15.70:0/3500795533 conn(0x55daf9478310 msgr2=0x55daf94b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 -- 172.21.15.70:0/3500795533 shutdown_connections 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 1 -- 172.21.15.70:0/3500795533 wait complete. 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.284+0000 7fb6267bd740 20 client.16182 trim_cache size 0 max 16384 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb6267bd740 1 Processor -- start 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb6267bd740 1 -- start start 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 0x55daf94c6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 0x55daf94d1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb6267bd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c1b0140 con 0x55daf94b0b40 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb6267bd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c1ad950 con 0x55daf94af5d0 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb6267bd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c1ab7a0 con 0x55daf94ba370 2024-09-19T04:36:12.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b8ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56316/0 (socket says 172.21.15.70:56316) 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 -- 172.21.15.70:0/283257023 learned_addr learned my addr 172.21.15.70:0/283257023 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 -- 172.21.15.70:0/283257023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 msgr2=0x55daf94d1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 --2- 172.21.15.70:0/283257023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 0x55daf94d1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 -- 172.21.15.70:0/283257023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 msgr2=0x55daf94c6310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 --2- 172.21.15.70:0/283257023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 0x55daf94c6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 -- 172.21.15.70:0/283257023 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daf94b2120 con 0x55daf94b0b40 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.297+0000 7fb622180640 1 --2- 172.21.15.70:0/283257023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b8ec0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb618031440 tx=0x7fb618003780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f605609dde02962a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb607fff640 1 -- 172.21.15.70:0/283257023 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618035030 con 0x55daf94b0b40 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb607fff640 1 -- 172.21.15.70:0/283257023 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb618005850 con 0x55daf94b0b40 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb607fff640 1 -- 172.21.15.70:0/283257023 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb618003b70 con 0x55daf94b0b40 2024-09-19T04:36:12.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 -- 172.21.15.70:0/283257023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 msgr2=0x55daf94b8ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 --2- 172.21.15.70:0/283257023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b8ec0 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fb618031440 tx=0x7fb618003780 comp rx=0 tx=0).stop 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 -- 172.21.15.70:0/283257023 shutdown_connections 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 --2- 172.21.15.70:0/283257023 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94ba370 0x55daf94d1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 --2- 172.21.15.70:0/283257023 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94b0b40 0x55daf94b8ec0 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 --2- 172.21.15.70:0/283257023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94af5d0 0x55daf94c6310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 -- 172.21.15.70:0/283257023 >> 172.21.15.70:0/283257023 conn(0x55daf9478310 msgr2=0x55daf94b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 -- 172.21.15.70:0/283257023 shutdown_connections 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.298+0000 7fb6267bd740 1 -- 172.21.15.70:0/283257023 wait complete. 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 1 -- start start 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 1 Processor -- start 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 0x55daf94c2990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94b0b40 0x55daf94b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94ba370 0x55daf94b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c1abe10 con 0x55daf94ba370 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c1ad280 con 0x55daf94b0b40 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c1ac4e0 con 0x55daf94af5d0 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb6267bd740 10 client.0 _ll_register_callbacks cb 0x7fb618032b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94ba370 0x55daf94b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94ba370 0x55daf94b3f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56328/0 (socket says 172.21.15.70:56328) 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 -- 172.21.15.70:0/630571863 learned_addr learned my addr 172.21.15.70:0/630571863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb622180640 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94b0b40 0x55daf94b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 0x55daf94c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 -- 172.21.15.70:0/630571863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 msgr2=0x55daf94c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 0x55daf94c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 -- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94b0b40 msgr2=0x55daf94b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:12.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94b0b40 0x55daf94b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 -- 172.21.15.70:0/630571863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daf94b44a0 con 0x55daf94ba370 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb622180640 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94b0b40 0x55daf94b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb62197f640 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94ba370 0x55daf94b3f30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0056a0 tx=0x7fb60c00a2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f9c2db1ae88c489 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.299+0000 7fb605ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb605ffb640 1 -- 172.21.15.70:0/630571863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c025040 con 0x55daf94ba370 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb605ffb640 1 -- 172.21.15.70:0/630571863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fb60c005190 con 0x55daf94ba370 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 1 -- 172.21.15.70:0/630571863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb618005850 con 0x55daf94ba370 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb605ffb640 1 -- 172.21.15.70:0/630571863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fb60c00a590 con 0x55daf94ba370 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 10 client.16188 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 1 -- 172.21.15.70:0/630571863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55daf9534890 con 0x55daf94ba370 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb605ffb640 1 -- 172.21.15.70:0/630571863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb618005850 con 0x55daf94ba370 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb605ffb640 1 -- 172.21.15.70:0/630571863 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fb60c003680 con 0x55daf94ba370 2024-09-19T04:36:12.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 10 client.16188 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 10 client.16188 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 20 client.16188 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55daf9534e50 0x55daf9537270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 4 client.16188 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb6267bd740 1 -- 172.21.15.70:0/630571863 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55daf941cd70 con 0x55daf9534e50 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.300+0000 7fb622180640 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55daf9534e50 0x55daf9537270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb622180640 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55daf9534e50 0x55daf9537270 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f72ddd9bebacb2c6 server_cookie=f804266650dd5dab in_seq=0 out_seq=0 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb605ffb640 10 client.16188 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb605ffb640 1 -- 172.21.15.70:0/630571863 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55daf941cd70 con 0x55daf9534e50 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb605ffb640 10 client.16188 handle_command_reply: tid=0 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 client.16188 shutdown 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 -- 172.21.15.70:0/630571863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94ba370 msgr2=0x55daf94b3f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94ba370 0x55daf94b3f30 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fb60c0056a0 tx=0x7fb60c00a2d0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 -- 172.21.15.70:0/630571863 shutdown_connections 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55daf9534e50 0x55daf9537270 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daf94ba370 0x55daf94b3f30 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daf94b0b40 0x55daf94b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb605ffb640 0 client.16188 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 --2- 172.21.15.70:0/630571863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daf94af5d0 0x55daf94c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 -- 172.21.15.70:0/630571863 >> 172.21.15.70:0/630571863 conn(0x55daf9478310 msgr2=0x55daf94b87b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 -- 172.21.15.70:0/630571863 shutdown_connections 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 1 -- 172.21.15.70:0/630571863 wait complete. 2024-09-19T04:36:12.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.301+0000 7fb6267bd740 20 client.16188 trim_cache size 0 max 16384 2024-09-19T04:36:12.321 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:12.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 -- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb6080a33b0 msgr2=0x7fb6080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb6080a33b0 0x7fb6080a5870 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fb6140cd3f0 tx=0x7fb614000f40 comp rx=0 tx=0).stop 2024-09-19T04:36:12.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 -- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c102ef0 msgr2=0x7fb61c1a43b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c102ef0 0x7fb61c1a43b0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7fb61400cad0 tx=0x7fb61400cf90 comp rx=0 tx=0).stop 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 -- 172.21.15.70:0/1393819967 shutdown_connections 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb6080a33b0 0x7fb6080a5870 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb61c102ef0 0x7fb61c1a43b0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb61c102570 0x7fb61c199870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 --2- 172.21.15.70:0/1393819967 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb61c100e20 0x7fb61c199330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 -- 172.21.15.70:0/1393819967 >> 172.21.15.70:0/1393819967 conn(0x7fb61c0fc7d0 msgr2=0x7fb61c0fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 -- 172.21.15.70:0/1393819967 shutdown_connections 2024-09-19T04:36:12.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:12.302+0000 7fb6243e4640 1 -- 172.21.15.70:0/1393819967 wait complete. 2024-09-19T04:36:12.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:12 smithi167 ceph-mon[34339]: pgmap v166: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:12 smithi134 ceph-mon[34525]: pgmap v166: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:13.082 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:12 smithi070 ceph-mon[30942]: pgmap v166: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-09-19T04:36:13.115 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:36:13.364 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:13.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.838+0000 7f7191ddc640 1 -- 172.21.15.70:0/672306984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102570 msgr2=0x7f718c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.838+0000 7f7191ddc640 1 --2- 172.21.15.70:0/672306984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102570 0x7f718c1029b0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f7180009900 tx=0x7f718002a480 comp rx=0 tx=0).stop 2024-09-19T04:36:13.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.838+0000 7f7191ddc640 1 -- 172.21.15.70:0/672306984 shutdown_connections 2024-09-19T04:36:13.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.838+0000 7f7191ddc640 1 --2- 172.21.15.70:0/672306984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c102ef0 0x7f718c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.838+0000 7f7191ddc640 1 --2- 172.21.15.70:0/672306984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102570 0x7f718c1029b0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.838+0000 7f7191ddc640 1 --2- 172.21.15.70:0/672306984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f718c100e20 0x7f718c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.838+0000 7f7191ddc640 1 -- 172.21.15.70:0/672306984 >> 172.21.15.70:0/672306984 conn(0x7f718c0fc7d0 msgr2=0x7f718c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:13.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.838+0000 7f7191ddc640 1 -- 172.21.15.70:0/672306984 shutdown_connections 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 -- 172.21.15.70:0/672306984 wait complete. 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 Processor -- start 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 -- start start 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c100e20 0x7f718c197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f718c102570 0x7f718c1978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102ef0 0x7f718c19bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f718c110f20 con 0x7f718c102ef0 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f718c110da0 con 0x7f718c100e20 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.839+0000 7f7191ddc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1110a0 con 0x7f718c102570 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102ef0 0x7f718c19bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102ef0 0x7f718c19bc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37794/0 (socket says 172.21.15.70:37794) 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 -- 172.21.15.70:0/3657675395 learned_addr learned my addr 172.21.15.70:0/3657675395 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:13.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718b7fe640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c100e20 0x7f718c197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718affd640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f718c102570 0x7f718c1978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 -- 172.21.15.70:0/3657675395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f718c102570 msgr2=0x7f718c1978c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f718c102570 0x7f718c1978c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 -- 172.21.15.70:0/3657675395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c100e20 msgr2=0x7f718c197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c100e20 0x7f718c197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 -- 172.21.15.70:0/3657675395 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f718c19c330 con 0x7f718c102ef0 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f718bfff640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102ef0 0x7f718c19bc50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f718400c970 tx=0x7f718400ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f7188ff9640 1 -- 172.21.15.70:0/3657675395 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184007bb0 con 0x7f718c102ef0 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f7191ddc640 1 -- 172.21.15.70:0/3657675395 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f718c19c620 con 0x7f718c102ef0 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f7188ff9640 1 -- 172.21.15.70:0/3657675395 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7184007d50 con 0x7f718c102ef0 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f7188ff9640 1 -- 172.21.15.70:0/3657675395 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7184018790 con 0x7f718c102ef0 2024-09-19T04:36:13.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.840+0000 7f7191ddc640 1 -- 172.21.15.70:0/3657675395 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f718c069f70 con 0x7f718c102ef0 2024-09-19T04:36:13.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f7188ff9640 1 -- 172.21.15.70:0/3657675395 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f718400fab0 con 0x7f718c102ef0 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f71941b5740 1 Processor -- start 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f71941b5740 1 -- start start 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f71941b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x55828fff0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f71941b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 0x55828fff0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f71941b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828ffff780 0x558290001b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f71941b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55828ff562f0 con 0x55828ffff780 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f71941b5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55828fefdcf0 con 0x55828fff05d0 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f71941b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55828ff522b0 con 0x55828fff1b40 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f718affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828ffff780 0x558290001b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f718affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828ffff780 0x558290001b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37804/0 (socket says 172.21.15.70:37804) 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f718affd640 1 -- 172.21.15.70:0/2713774943 learned_addr learned my addr 172.21.15.70:0/2713774943 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:13.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f7188ff9640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71740a33b0 0x7f71740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.843+0000 7f718b7fe640 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 0x55828fff0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718affd640 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x55828fff0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718bfff640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71740a33b0 0x7f71740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718affd640 1 -- 172.21.15.70:0/2713774943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 msgr2=0x55828fff0090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718affd640 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x55828fff0090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718affd640 1 -- 172.21.15.70:0/2713774943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 msgr2=0x55828fff0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718affd640 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 0x55828fff0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718affd640 1 -- 172.21.15.70:0/2713774943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828fee23a0 con 0x55828ffff780 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f7188ff9640 1 -- 172.21.15.70:0/3657675395 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f71840cfc90 con 0x7f718c102ef0 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718affd640 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828ffff780 0x558290001b70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f718002a9a0 tx=0x7f7180009610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5dc63aed8bcf78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:13.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f7171ffb640 1 -- 172.21.15.70:0/2713774943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180035070 con 0x55828ffff780 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f718bfff640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71740a33b0 0x7f71740a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f718401f000 tx=0x7f7184016f60 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f7171ffb640 1 -- 172.21.15.70:0/2713774943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7180031780 con 0x55828ffff780 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.844+0000 7f7171ffb640 1 -- 172.21.15.70:0/2713774943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180004a00 con 0x55828ffff780 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 -- 172.21.15.70:0/2713774943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828ffff780 msgr2=0x558290001b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828ffff780 0x558290001b70 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f718002a9a0 tx=0x7f7180009610 comp rx=0 tx=0).stop 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 -- 172.21.15.70:0/2713774943 shutdown_connections 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828ffff780 0x558290001b70 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 0x55828fff0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 --2- 172.21.15.70:0/2713774943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x55828fff0090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 -- 172.21.15.70:0/2713774943 >> 172.21.15.70:0/2713774943 conn(0x55828ffb9310 msgr2=0x55828ffecc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 -- 172.21.15.70:0/2713774943 shutdown_connections 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 -- 172.21.15.70:0/2713774943 wait complete. 2024-09-19T04:36:13.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.845+0000 7f71941b5740 1 -- start start 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f71941b5740 1 Processor -- start 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f71941b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff05d0 0x55828ffff180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f71941b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffc430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f71941b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 0x55828fffca20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f71941b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558290002420 con 0x55828fff1b40 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f71941b5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55828ff11060 con 0x55828ffff780 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f71941b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5582900025a0 con 0x55828fff05d0 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f71941b5740 10 client.0 _ll_register_callbacks cb 0x55828fc648c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffc430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffc430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37818/0 (socket says 172.21.15.70:37818) 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 -- 172.21.15.70:0/1795818388 learned_addr learned my addr 172.21.15.70:0/1795818388 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:13.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718affd640 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff05d0 0x55828ffff180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718affd640 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 0x55828fffca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 -- 172.21.15.70:0/1795818388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff05d0 msgr2=0x55828ffff180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff05d0 0x55828ffff180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 -- 172.21.15.70:0/1795818388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 msgr2=0x55828fffca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 0x55828fffca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 -- 172.21.15.70:0/1795818388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828fcc73c0 con 0x55828fff1b40 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718affd640 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff05d0 0x55828ffff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f718b7fe640 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffc430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f717c010c00 tx=0x7f717c00f7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c207ed46a4b90165 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.846+0000 7f716affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f716affd640 1 -- 172.21.15.70:0/1795818388 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c00e5c0 con 0x55828fff1b40 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f716affd640 1 -- 172.21.15.70:0/1795818388 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f717c00e760 con 0x55828fff1b40 2024-09-19T04:36:13.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 1 -- 172.21.15.70:0/1795818388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7180031780 con 0x55828fff1b40 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f716affd640 1 -- 172.21.15.70:0/1795818388 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f717c00e960 con 0x55828fff1b40 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 10 client.16200 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 1 -- 172.21.15.70:0/1795818388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55829000df20 con 0x55828fff1b40 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f716affd640 1 -- 172.21.15.70:0/1795818388 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7180031780 con 0x55828fff1b40 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f716affd640 1 -- 172.21.15.70:0/1795818388 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f717c021070 con 0x55828fff1b40 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 10 client.16200 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 10 client.16200 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 20 client.16200 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55829000f4a0 0x558290011890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 4 client.16200 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.847+0000 7f71941b5740 1 -- 172.21.15.70:0/1795818388 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55828ff63860 con 0x55829000f4a0 2024-09-19T04:36:13.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.848+0000 7f718affd640 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55829000f4a0 0x558290011890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.848+0000 7f718affd640 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55829000f4a0 0x558290011890 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=97d1e3e8ca4e83a0 server_cookie=181436e64df02c7b in_seq=0 out_seq=0 2024-09-19T04:36:13.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.848+0000 7f716affd640 10 client.16200 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f716affd640 1 -- 172.21.15.70:0/1795818388 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55828ff63860 con 0x55829000f4a0 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f716affd640 10 client.16200 handle_command_reply: tid=0 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 client.16200 shutdown 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 -- 172.21.15.70:0/1795818388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 msgr2=0x55828fffc430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffc430 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f717c010c00 tx=0x7f717c00f7f0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 -- 172.21.15.70:0/1795818388 shutdown_connections 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55829000f4a0 0x558290011890 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 0x55828fffca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffc430 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f716affd640 0 client.16200 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 --2- 172.21.15.70:0/1795818388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff05d0 0x55828ffff180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 -- 172.21.15.70:0/1795818388 >> 172.21.15.70:0/1795818388 conn(0x55828ffb9310 msgr2=0x55828fff2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:13.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 -- 172.21.15.70:0/1795818388 shutdown_connections 2024-09-19T04:36:13.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 1 -- 172.21.15.70:0/1795818388 wait complete. 2024-09-19T04:36:13.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.849+0000 7f71941b5740 20 client.16200 trim_cache size 0 max 16384 2024-09-19T04:36:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f71941b5740 1 Processor -- start 2024-09-19T04:36:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f71941b5740 1 -- start start 2024-09-19T04:36:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f71941b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 0x55829000b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f71941b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffb430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f71941b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828ffff780 0x5582900171a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f71941b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1adde0 con 0x55828fff1b40 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f71941b5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1ab5f0 con 0x55828fff05d0 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f71941b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1a9440 con 0x55828ffff780 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffb430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37834/0 (socket says 172.21.15.70:37834) 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718b7fe640 1 -- 172.21.15.70:0/2388972420 learned_addr learned my addr 172.21.15.70:0/2388972420 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718affd640 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828ffff780 0x5582900171a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718b7fe640 1 -- 172.21.15.70:0/2388972420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828ffff780 msgr2=0x5582900171a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718b7fe640 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828ffff780 0x5582900171a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718b7fe640 1 -- 172.21.15.70:0/2388972420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 msgr2=0x55829000b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:13.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718b7fe640 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 0x55829000b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718b7fe640 1 -- 172.21.15.70:0/2388972420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55828fffcd90 con 0x55828fff1b40 2024-09-19T04:36:13.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.862+0000 7f718affd640 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828ffff780 0x5582900171a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:13.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f718b7fe640 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffb430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f717c01bff0 tx=0x7f717c007a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5284cde5cfc191ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:13.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71717fa640 1 -- 172.21.15.70:0/2388972420 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c027070 con 0x55828fff1b40 2024-09-19T04:36:13.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71717fa640 1 -- 172.21.15.70:0/2388972420 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f717c00e5c0 con 0x55828fff1b40 2024-09-19T04:36:13.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71717fa640 1 -- 172.21.15.70:0/2388972420 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f717c023460 con 0x55828fff1b40 2024-09-19T04:36:13.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 -- 172.21.15.70:0/2388972420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 msgr2=0x55828fffb430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffb430 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f717c01bff0 tx=0x7f717c007a70 comp rx=0 tx=0).stop 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 -- 172.21.15.70:0/2388972420 shutdown_connections 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828ffff780 0x5582900171a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff1b40 0x55828fffb430 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 --2- 172.21.15.70:0/2388972420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828fff05d0 0x55829000b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 -- 172.21.15.70:0/2388972420 >> 172.21.15.70:0/2388972420 conn(0x55828ffb9310 msgr2=0x55828fffad20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 -- 172.21.15.70:0/2388972420 shutdown_connections 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.863+0000 7f71941b5740 1 -- 172.21.15.70:0/2388972420 wait complete. 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 1 -- start start 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 1 Processor -- start 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff05d0 0x558290007a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x558290007f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 0x55828fff8c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1a9ab0 con 0x55828fff05d0 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1aaf20 con 0x55828ffff780 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f718c1aa180 con 0x55828fff1b40 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f71941b5740 10 client.0 _ll_register_callbacks cb 0x7f717c007b00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f718affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff05d0 0x558290007a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f718affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff05d0 0x558290007a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37840/0 (socket says 172.21.15.70:37840) 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f718affd640 1 -- 172.21.15.70:0/3951178764 learned_addr learned my addr 172.21.15.70:0/3951178764 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.864+0000 7f718affd640 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 0x55828fff8c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f718b7fe640 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x558290007f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f718affd640 1 -- 172.21.15.70:0/3951178764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 msgr2=0x558290007f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f718affd640 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x558290007f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f718affd640 1 -- 172.21.15.70:0/3951178764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 msgr2=0x55828fff8c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f718affd640 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 0x55828fff8c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f718affd640 1 -- 172.21.15.70:0/3951178764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55828fff9450 con 0x55828fff05d0 2024-09-19T04:36:13.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f718b7fe640 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x558290007f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f718affd640 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff05d0 0x558290007a10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7180009900 tx=0x7f7180031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aeda80efdb26d5ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f716affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f716affd640 1 -- 172.21.15.70:0/3951178764 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7180035040 con 0x55828fff05d0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f71941b5740 1 -- 172.21.15.70:0/3951178764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f717c00e5c0 con 0x55828fff05d0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f716affd640 1 -- 172.21.15.70:0/3951178764 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f7180031a30 con 0x55828fff05d0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f716affd640 1 -- 172.21.15.70:0/3951178764 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f7180005d50 con 0x55828fff05d0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f71941b5740 10 client.16206 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f71941b5740 1 -- 172.21.15.70:0/3951178764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x558290079c00 con 0x55828fff05d0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f716affd640 1 -- 172.21.15.70:0/3951178764 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f717c00e5c0 con 0x55828fff05d0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.865+0000 7f716affd640 1 -- 172.21.15.70:0/3951178764 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f718005b070 con 0x55828fff05d0 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f71941b5740 10 client.16206 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f71941b5740 10 client.16206 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:13.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f71941b5740 20 client.16206 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f71941b5740 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558290079ed0 0x55829007c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f71941b5740 4 client.16206 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f71941b5740 1 -- 172.21.15.70:0/3951178764 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55828ff5dd70 con 0x558290079ed0 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f718b7fe640 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558290079ed0 0x55829007c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f716affd640 10 client.16206 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.866+0000 7f718b7fe640 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558290079ed0 0x55829007c2e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dc1c6d5c2c316482 server_cookie=6f587463732249b8 in_seq=0 out_seq=0 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f716affd640 1 -- 172.21.15.70:0/3951178764 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55828ff5dd70 con 0x558290079ed0 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f716affd640 10 client.16206 handle_command_reply: tid=0 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 client.16206 shutdown 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 -- 172.21.15.70:0/3951178764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff05d0 msgr2=0x558290007a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff05d0 0x558290007a10 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f7180009900 tx=0x7f7180031400 comp rx=0 tx=0).stop 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 -- 172.21.15.70:0/3951178764 shutdown_connections 2024-09-19T04:36:13.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558290079ed0 0x55829007c2e0 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55828ffff780 0x55828fff8c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55828fff1b40 0x558290007f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 --2- 172.21.15.70:0/3951178764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55828fff05d0 0x558290007a10 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f716affd640 0 client.16206 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 -- 172.21.15.70:0/3951178764 >> 172.21.15.70:0/3951178764 conn(0x55828ffb9310 msgr2=0x55828fff2110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 -- 172.21.15.70:0/3951178764 shutdown_connections 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 1 -- 172.21.15.70:0/3951178764 wait complete. 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f71941b5740 20 client.16206 trim_cache size 0 max 16384 2024-09-19T04:36:13.874 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f7191ddc640 1 -- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71740a33b0 msgr2=0x7f71740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f7191ddc640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71740a33b0 0x7f71740a5870 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f718401f000 tx=0x7f7184016f60 comp rx=0 tx=0).stop 2024-09-19T04:36:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f7191ddc640 1 -- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102ef0 msgr2=0x7f718c19bc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f7191ddc640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102ef0 0x7f718c19bc50 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f718400c970 tx=0x7f718400ce30 comp rx=0 tx=0).stop 2024-09-19T04:36:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.867+0000 7f7191ddc640 1 -- 172.21.15.70:0/3657675395 shutdown_connections 2024-09-19T04:36:13.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.868+0000 7f7191ddc640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f71740a33b0 0x7f71740a5870 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.868+0000 7f7191ddc640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f718c102ef0 0x7f718c19bc50 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.868+0000 7f7191ddc640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f718c102570 0x7f718c1978c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.868+0000 7f7191ddc640 1 --2- 172.21.15.70:0/3657675395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f718c100e20 0x7f718c197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.868+0000 7f7191ddc640 1 -- 172.21.15.70:0/3657675395 >> 172.21.15.70:0/3657675395 conn(0x7f718c0fc7d0 msgr2=0x7f718c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.868+0000 7f7191ddc640 1 -- 172.21.15.70:0/3657675395 shutdown_connections 2024-09-19T04:36:13.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:13.868+0000 7f7191ddc640 1 -- 172.21.15.70:0/3657675395 wait complete. 2024-09-19T04:36:14.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:14 smithi070 ceph-mon[30942]: pgmap v167: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:36:14.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:14 smithi167 ceph-mon[34339]: pgmap v167: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:36:15.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:14 smithi134 ceph-mon[34525]: pgmap v167: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:36:15.551 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:36:15.552 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:36:15.811 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.298+0000 7f18e7e76640 1 -- 172.21.15.70:0/2018323458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0101de0 msgr2=0x7f18e01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.298+0000 7f18e7e76640 1 --2- 172.21.15.70:0/2018323458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0101de0 0x7f18e01021c0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f18d4009900 tx=0x7f18d402a410 comp rx=0 tx=0).stop 2024-09-19T04:36:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.298+0000 7f18e7e76640 1 -- 172.21.15.70:0/2018323458 shutdown_connections 2024-09-19T04:36:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.298+0000 7f18e7e76640 1 --2- 172.21.15.70:0/2018323458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0106f10 0x7f18e010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.298+0000 7f18e7e76640 1 --2- 172.21.15.70:0/2018323458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e0102790 0x7f18e01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.298+0000 7f18e7e76640 1 --2- 172.21.15.70:0/2018323458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0101de0 0x7f18e01021c0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.298+0000 7f18e7e76640 1 -- 172.21.15.70:0/2018323458 >> 172.21.15.70:0/2018323458 conn(0x7f18e00fd8c0 msgr2=0x7f18e00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:16.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 -- 172.21.15.70:0/2018323458 shutdown_connections 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 -- 172.21.15.70:0/2018323458 wait complete. 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 Processor -- start 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 -- start start 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0101de0 0x7f18e00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0102790 0x7f18e0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e0106f10 0x7f18e0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0111f40 con 0x7f18e0102790 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18e0111dc0 con 0x7f18e0101de0 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e7e76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01120c0 con 0x7f18e0106f10 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e5411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0102790 0x7f18e0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e5411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0102790 0x7f18e0074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37860/0 (socket says 172.21.15.70:37860) 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.299+0000 7f18e5411640 1 -- 172.21.15.70:0/423932823 learned_addr learned my addr 172.21.15.70:0/423932823 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:16.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18e5c12640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0101de0 0x7f18e00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18e6413640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e0106f10 0x7f18e0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18e5411640 1 -- 172.21.15.70:0/423932823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e0106f10 msgr2=0x7f18e0074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18e5411640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e0106f10 0x7f18e0074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18e5411640 1 -- 172.21.15.70:0/423932823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0101de0 msgr2=0x7f18e00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18e5411640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0101de0 0x7f18e00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18e5411640 1 -- 172.21.15.70:0/423932823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18e01a6920 con 0x7f18e0102790 2024-09-19T04:36:16.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18e5411640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0102790 0x7f18e0074a30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00e9f0 tx=0x7f18dc00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:16.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18d2ffd640 1 -- 172.21.15.70:0/423932823 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc00cd80 con 0x7f18e0102790 2024-09-19T04:36:16.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.300+0000 7f18d2ffd640 1 -- 172.21.15.70:0/423932823 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f18dc0054f0 con 0x7f18e0102790 2024-09-19T04:36:16.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.301+0000 7f18e7e76640 1 -- 172.21.15.70:0/423932823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18e01a6c10 con 0x7f18e0102790 2024-09-19T04:36:16.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.301+0000 7f18d2ffd640 1 -- 172.21.15.70:0/423932823 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc010690 con 0x7f18e0102790 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.301+0000 7f18e7e76640 1 -- 172.21.15.70:0/423932823 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18e01a7150 con 0x7f18e0102790 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.303+0000 7f18d2ffd640 1 -- 172.21.15.70:0/423932823 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f18dc004f20 con 0x7f18e0102790 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.303+0000 7f18ea24f740 1 Processor -- start 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.303+0000 7f18ea24f740 1 -- start start 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f79ff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aa800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7aad40 0x55ea0f7ad130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18ea24f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ea0f705280 con 0x55ea0f7a0480 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18ea24f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ea0f6acb10 con 0x55ea0f7aad40 2024-09-19T04:36:16.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18ea24f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea0f701240 con 0x55ea0f79fb60 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18d2ffd640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f18cc0a3430 0x7f18cc0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aa800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aa800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37868/0 (socket says 172.21.15.70:37868) 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5c12640 1 -- 172.21.15.70:0/684067139 learned_addr learned my addr 172.21.15.70:0/684067139 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e6413640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f18cc0a3430 0x7f18cc0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e6413640 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f79ff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5411640 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7aad40 0x55ea0f7ad130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18d2ffd640 1 -- 172.21.15.70:0/423932823 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f18dc0d00c0 con 0x7f18e0102790 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5c12640 1 -- 172.21.15.70:0/684067139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 msgr2=0x55ea0f79ff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5c12640 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f79ff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5c12640 1 -- 172.21.15.70:0/684067139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7aad40 msgr2=0x55ea0f7ad130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:16.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5c12640 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7aad40 0x55ea0f7ad130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.304+0000 7f18e5c12640 1 -- 172.21.15.70:0/684067139 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea0f6b91f0 con 0x55ea0f7a0480 2024-09-19T04:36:16.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.305+0000 7f18e6413640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f18cc0a3430 0x7f18cc0a58f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009270 tx=0x7f18d8009db0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:16.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.305+0000 7f18e5c12640 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aa800 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f18d402a930 tx=0x7f18d4005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8569ae62a4cb245d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:16.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.305+0000 7f18cbfff640 1 -- 172.21.15.70:0/684067139 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4040070 con 0x55ea0f7a0480 2024-09-19T04:36:16.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.305+0000 7f18cbfff640 1 -- 172.21.15.70:0/684067139 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f18d4004030 con 0x55ea0f7a0480 2024-09-19T04:36:16.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.305+0000 7f18cbfff640 1 -- 172.21.15.70:0/684067139 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d4035040 con 0x55ea0f7a0480 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.305+0000 7f18ea24f740 1 -- 172.21.15.70:0/684067139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 msgr2=0x55ea0f7aa800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.305+0000 7f18ea24f740 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aa800 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7f18d402a930 tx=0x7f18d4005dd0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 -- 172.21.15.70:0/684067139 shutdown_connections 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7aad40 0x55ea0f7ad130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aa800 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 --2- 172.21.15.70:0/684067139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f79ff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 -- 172.21.15.70:0/684067139 >> 172.21.15.70:0/684067139 conn(0x55ea0f79c0f0 msgr2=0x55ea0f79c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 -- 172.21.15.70:0/684067139 shutdown_connections 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 -- 172.21.15.70:0/684067139 wait complete. 2024-09-19T04:36:16.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 -- start start 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 Processor -- start 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f79fb60 0x55ea0f7a7c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.306+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f7aad40 0x55ea0f7a8680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18ea24f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ea0f7ad910 con 0x55ea0f7a0480 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18ea24f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ea0f6bff10 con 0x55ea0f79fb60 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18ea24f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea0f7ada90 con 0x55ea0f7aad40 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18ea24f740 10 client.0 _ll_register_callbacks cb 0x55ea0f688a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a8140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37884/0 (socket says 172.21.15.70:37884) 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 -- 172.21.15.70:0/454244886 learned_addr learned my addr 172.21.15.70:0/454244886 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5c12640 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f79fb60 0x55ea0f7a7c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 -- 172.21.15.70:0/454244886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f7aad40 msgr2=0x55ea0f7a8680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f7aad40 0x55ea0f7a8680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 -- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f79fb60 msgr2=0x55ea0f7a7c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f79fb60 0x55ea0f7a7c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 -- 172.21.15.70:0/454244886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea0f4766a0 con 0x55ea0f7a0480 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5c12640 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f79fb60 0x55ea0f7a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18e5411640 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a8140 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f18dc09c160 tx=0x7f18dc00a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50fab54d334028eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18c97fa640 1 -- 172.21.15.70:0/454244886 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18dc09cb60 con 0x55ea0f7a0480 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18c97fa640 1 -- 172.21.15.70:0/454244886 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f18dc005210 con 0x55ea0f7a0480 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18ea24f740 1 -- 172.21.15.70:0/454244886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18d4004030 con 0x55ea0f7a0480 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18c97fa640 1 -- 172.21.15.70:0/454244886 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18dc09c460 con 0x55ea0f7a0480 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18ea24f740 10 client.16218 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:16.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.307+0000 7f18ea24f740 1 -- 172.21.15.70:0/454244886 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea0f7b9550 con 0x55ea0f7a0480 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18c97fa640 1 -- 172.21.15.70:0/454244886 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f18d4004030 con 0x55ea0f7a0480 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18c97fa640 1 -- 172.21.15.70:0/454244886 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f18dc098ad0 con 0x55ea0f7a0480 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18ea24f740 10 client.16218 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18ea24f740 10 client.16218 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18ea24f740 20 client.16218 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18ea24f740 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ea0f7ba9b0 0x55ea0f7bce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18ea24f740 4 client.16218 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18ea24f740 1 -- 172.21.15.70:0/454244886 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea0f7127f0 con 0x55ea0f7ba9b0 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.308+0000 7f18e5c12640 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ea0f7ba9b0 0x55ea0f7bce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18e5c12640 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ea0f7ba9b0 0x55ea0f7bce40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=277a1081dfbbb5b9 server_cookie=593b50922561a3fa in_seq=0 out_seq=0 2024-09-19T04:36:16.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18c97fa640 10 client.16218 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18c97fa640 1 -- 172.21.15.70:0/454244886 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea0f7127f0 con 0x55ea0f7ba9b0 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18c97fa640 10 client.16218 handle_command_reply: tid=0 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 client.16218 shutdown 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 -- 172.21.15.70:0/454244886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 msgr2=0x55ea0f7a8140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a8140 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f18dc09c160 tx=0x7f18dc00a440 comp rx=0 tx=0).stop 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 -- 172.21.15.70:0/454244886 shutdown_connections 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ea0f7ba9b0 0x55ea0f7bce40 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f7aad40 0x55ea0f7a8680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a8140 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18c97fa640 0 client.16218 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:16.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 --2- 172.21.15.70:0/454244886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f79fb60 0x55ea0f7a7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.309+0000 7f18ea24f740 1 -- 172.21.15.70:0/454244886 >> 172.21.15.70:0/454244886 conn(0x55ea0f79c0f0 msgr2=0x55ea0f7a1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:16.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.310+0000 7f18ea24f740 1 -- 172.21.15.70:0/454244886 shutdown_connections 2024-09-19T04:36:16.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.310+0000 7f18ea24f740 1 -- 172.21.15.70:0/454244886 wait complete. 2024-09-19T04:36:16.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.310+0000 7f18ea24f740 20 client.16218 trim_cache size 0 max 16384 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.326+0000 7f18ea24f740 1 Processor -- start 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.326+0000 7f18ea24f740 1 -- start start 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f7a25c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a6ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7c2710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18ea24f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01b2270 con 0x55ea0f7aad40 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18ea24f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01afa80 con 0x55ea0f7a0480 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18ea24f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01ad8f0 con 0x55ea0f79fb60 2024-09-19T04:36:16.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7c2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7c2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37896/0 (socket says 172.21.15.70:37896) 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 -- 172.21.15.70:0/4145213598 learned_addr learned my addr 172.21.15.70:0/4145213598 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e5411640 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a6ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 -- 172.21.15.70:0/4145213598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 msgr2=0x55ea0f7a25c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f7a25c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 -- 172.21.15.70:0/4145213598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 msgr2=0x55ea0f7a6ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a6ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 -- 172.21.15.70:0/4145213598 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea0f79b8e0 con 0x55ea0f7aad40 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e5411640 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18e6413640 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7c2710 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f18d80099a0 tx=0x7f18d801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b0dce7942b06a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18cb7fe640 1 -- 172.21.15.70:0/4145213598 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d80124d0 con 0x55ea0f7aad40 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18cb7fe640 1 -- 172.21.15.70:0/4145213598 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f18d8003d70 con 0x55ea0f7aad40 2024-09-19T04:36:16.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.327+0000 7f18cb7fe640 1 -- 172.21.15.70:0/4145213598 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8020990 con 0x55ea0f7aad40 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 -- 172.21.15.70:0/4145213598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 msgr2=0x55ea0f7c2710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7c2710 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f18d80099a0 tx=0x7f18d801c000 comp rx=0 tx=0).stop 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 -- 172.21.15.70:0/4145213598 shutdown_connections 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7c2710 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 0x55ea0f7a6ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 --2- 172.21.15.70:0/4145213598 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f7a25c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 -- 172.21.15.70:0/4145213598 >> 172.21.15.70:0/4145213598 conn(0x55ea0f79c0f0 msgr2=0x55ea0f7a63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 -- 172.21.15.70:0/4145213598 shutdown_connections 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 -- 172.21.15.70:0/4145213598 wait complete. 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.328+0000 7f18ea24f740 1 -- start start 2024-09-19T04:36:16.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18ea24f740 1 Processor -- start 2024-09-19T04:36:16.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f7aeaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18ea24f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7af520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18ea24f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01adf40 con 0x55ea0f7aad40 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18ea24f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01af3b0 con 0x55ea0f7a0480 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18ea24f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18e01ae610 con 0x55ea0f79fb60 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18ea24f740 10 client.0 _ll_register_callbacks cb 0x7f18dc00e940 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e6413640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7af520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e6413640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7af520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37900/0 (socket says 172.21.15.70:37900) 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e6413640 1 -- 172.21.15.70:0/417337224 learned_addr learned my addr 172.21.15.70:0/417337224 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e5c12640 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f7aeaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e6413640 1 -- 172.21.15.70:0/417337224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 msgr2=0x55ea0f7aeaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e6413640 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f7aeaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e6413640 1 -- 172.21.15.70:0/417337224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 msgr2=0x55ea0f7aefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e6413640 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.329+0000 7f18e6413640 1 -- 172.21.15.70:0/417337224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea0f824760 con 0x55ea0f7aad40 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18e6413640 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7af520 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009ca0 tx=0x7f18d8012560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c66de7a39950ba3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18c97fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18c97fa640 1 -- 172.21.15.70:0/417337224 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18d8004e50 con 0x55ea0f7aad40 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 1 -- 172.21.15.70:0/417337224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f18d8003d70 con 0x55ea0f7aad40 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18c97fa640 1 -- 172.21.15.70:0/417337224 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f18d8020710 con 0x55ea0f7aad40 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18c97fa640 1 -- 172.21.15.70:0/417337224 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f18d8020910 con 0x55ea0f7aad40 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 10 client.16224 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 1 -- 172.21.15.70:0/417337224 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x55ea0f8259d0 con 0x55ea0f7aad40 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18c97fa640 1 -- 172.21.15.70:0/417337224 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f18d8003d70 con 0x55ea0f7aad40 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18c97fa640 1 -- 172.21.15.70:0/417337224 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f18d8030030 con 0x55ea0f7aad40 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 10 client.16224 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:16.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 10 client.16224 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 20 client.16224 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ea0f8260f0 0x55ea0f828510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 4 client.16224 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18ea24f740 1 -- 172.21.15.70:0/417337224 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55ea0f70cd00 con 0x55ea0f8260f0 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.330+0000 7f18e5c12640 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ea0f8260f0 0x55ea0f828510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.331+0000 7f18c97fa640 10 client.16224 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.331+0000 7f18e5c12640 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ea0f8260f0 0x55ea0f828510 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ec3a1e82066d1c06 server_cookie=8aff1b9838df1c0e in_seq=0 out_seq=0 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18c97fa640 1 -- 172.21.15.70:0/417337224 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55ea0f70cd00 con 0x55ea0f8260f0 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18c97fa640 10 client.16224 handle_command_reply: tid=0 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 client.16224 shutdown 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 -- 172.21.15.70:0/417337224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 msgr2=0x55ea0f7af520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7af520 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009ca0 tx=0x7f18d8012560 comp rx=0 tx=0).stop 2024-09-19T04:36:16.338 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 -- 172.21.15.70:0/417337224 shutdown_connections 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ea0f8260f0 0x55ea0f828510 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea0f7aad40 0x55ea0f7af520 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea0f7a0480 0x55ea0f7aefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 --2- 172.21.15.70:0/417337224 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea0f79fb60 0x55ea0f7aeaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18c97fa640 0 client.16224 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 -- 172.21.15.70:0/417337224 >> 172.21.15.70:0/417337224 conn(0x55ea0f79c0f0 msgr2=0x55ea0f7a6bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 -- 172.21.15.70:0/417337224 shutdown_connections 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 1 -- 172.21.15.70:0/417337224 wait complete. 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.332+0000 7f18ea24f740 20 client.16224 trim_cache size 0 max 16384 2024-09-19T04:36:16.339 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:16.340 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:36:16.340 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "5e704afc-953b-4e52-9c9d-04248d69e2d5", 2024-09-19T04:36:16.340 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:36:16.340 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 -- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f18cc0a3430 msgr2=0x7f18cc0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f18cc0a3430 0x7f18cc0a58f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f18d8009270 tx=0x7f18d8009db0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 -- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0102790 msgr2=0x7f18e0074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0102790 0x7f18e0074a30 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f18dc00e9f0 tx=0x7f18dc00edf0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 -- 172.21.15.70:0/423932823 shutdown_connections 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f18cc0a3430 0x7f18cc0a58f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18e0106f10 0x7f18e0074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18e0102790 0x7f18e0074a30 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 --2- 172.21.15.70:0/423932823 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18e0101de0 0x7f18e00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:16.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 -- 172.21.15.70:0/423932823 >> 172.21.15.70:0/423932823 conn(0x7f18e00fd8c0 msgr2=0x7f18e00fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:16.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 -- 172.21.15.70:0/423932823 shutdown_connections 2024-09-19T04:36:16.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:16.333+0000 7f18e7e76640 1 -- 172.21.15.70:0/423932823 wait complete. 2024-09-19T04:36:16.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:16 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:36:16.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:16 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:16.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:16 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:36:16.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:16 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:16.961 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:16 smithi070 ceph-mon[30942]: pgmap v168: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:36:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:16 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:36:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:16 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:16 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:36:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:16 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:16.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:16 smithi167 ceph-mon[34339]: pgmap v168: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:36:17.017 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:36:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:16 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:36:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:16 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:16 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:36:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:16 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:16 smithi134 ceph-mon[34525]: pgmap v168: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 170 B/s wr, 5 op/s 2024-09-19T04:36:17.259 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 -- 172.21.15.70:0/3513843270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4101420 msgr2=0x7fdec410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 --2- 172.21.15.70:0/3513843270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4101420 0x7fdec410d950 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fdebc009cd0 tx=0x7fdebc02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 -- 172.21.15.70:0/3513843270 shutdown_connections 2024-09-19T04:36:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 --2- 172.21.15.70:0/3513843270 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4101420 0x7fdec410d950 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 --2- 172.21.15.70:0/3513843270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4100a80 0x7fdec4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 --2- 172.21.15.70:0/3513843270 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec4106a80 0x7fdec4106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 -- 172.21.15.70:0/3513843270 >> 172.21.15.70:0/3513843270 conn(0x7fdec40fc7a0 msgr2=0x7fdec40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 -- 172.21.15.70:0/3513843270 shutdown_connections 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.681+0000 7fdec9640640 1 -- 172.21.15.70:0/3513843270 wait complete. 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec9640640 1 Processor -- start 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec9640640 1 -- start start 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec9640640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4100a80 0x7fdec4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec9640640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4101420 0x7fdec41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec9640640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec4106a80 0x7fdec419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec9640640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdec406ad60 con 0x7fdec4100a80 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec9640640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdec406abe0 con 0x7fdec4101420 2024-09-19T04:36:17.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec9640640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdec406aee0 con 0x7fdec4106a80 2024-09-19T04:36:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.682+0000 7fdec2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4100a80 0x7fdec4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4100a80 0x7fdec4198490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37920/0 (socket says 172.21.15.70:37920) 2024-09-19T04:36:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec2ffd640 1 -- 172.21.15.70:0/1429653891 learned_addr learned my addr 172.21.15.70:0/1429653891 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec27fc640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4101420 0x7fdec41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec37fe640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec4106a80 0x7fdec419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec2ffd640 1 -- 172.21.15.70:0/1429653891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec4106a80 msgr2=0x7fdec419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec4106a80 0x7fdec419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec2ffd640 1 -- 172.21.15.70:0/1429653891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4101420 msgr2=0x7fdec41989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4101420 0x7fdec41989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec2ffd640 1 -- 172.21.15.70:0/1429653891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdec419d440 con 0x7fdec4100a80 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec37fe640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec4106a80 0x7fdec419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4100a80 0x7fdec4198490 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400d770 tx=0x7fdeb400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdeabfff640 1 -- 172.21.15.70:0/1429653891 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4017070 con 0x7fdec4100a80 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec9640640 1 -- 172.21.15.70:0/1429653891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdec419d730 con 0x7fdec4100a80 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdeabfff640 1 -- 172.21.15.70:0/1429653891 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdeb40054f0 con 0x7fdec4100a80 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdeabfff640 1 -- 172.21.15.70:0/1429653891 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4004d60 con 0x7fdec4100a80 2024-09-19T04:36:17.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.683+0000 7fdec9640640 1 -- 172.21.15.70:0/1429653891 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdec41a5010 con 0x7fdec4100a80 2024-09-19T04:36:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.685+0000 7fdeabfff640 1 -- 172.21.15.70:0/1429653891 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdeb4004f00 con 0x7fdec4100a80 2024-09-19T04:36:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdecba19740 1 Processor -- start 2024-09-19T04:36:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdecba19740 1 -- start start 2024-09-19T04:36:17.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdecba19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f177a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdecba19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f17ce0 0x5556e8f26550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdecba19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f26a90 0x5556e8f28e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdecba19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5556e8e7d2e0 con 0x5556e8f173c0 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdecba19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5556e8e24ce0 con 0x5556e8f17ce0 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdecba19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5556e8e792a0 con 0x5556e8f26a90 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdec37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f177a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdec37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f177a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37936/0 (socket says 172.21.15.70:37936) 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdec37fe640 1 -- 172.21.15.70:0/2656948644 learned_addr learned my addr 172.21.15.70:0/2656948644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdec27fc640 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f26a90 0x5556e8f28e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.686+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f17ce0 0x5556e8f26550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdeabfff640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdeac0a33b0 0x7fdeac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdec37fe640 1 -- 172.21.15.70:0/2656948644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f26a90 msgr2=0x5556e8f28e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdec37fe640 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f26a90 0x5556e8f28e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdec37fe640 1 -- 172.21.15.70:0/2656948644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f17ce0 msgr2=0x5556e8f26550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdec37fe640 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f17ce0 0x5556e8f26550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdec37fe640 1 -- 172.21.15.70:0/2656948644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e8e09440 con 0x5556e8f173c0 2024-09-19T04:36:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdeabfff640 1 -- 172.21.15.70:0/1429653891 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fdeb40cf7a0 con 0x7fdec4100a80 2024-09-19T04:36:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdec37fe640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdeac0a33b0 0x7fdeac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdec37fe640 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f177a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdebc005fd0 tx=0x7fdebc031430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7350f6f1c3f0c33 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:17.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdea97fa640 1 -- 172.21.15.70:0/2656948644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc003ab0 con 0x5556e8f173c0 2024-09-19T04:36:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdea97fa640 1 -- 172.21.15.70:0/2656948644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdebc036040 con 0x5556e8f173c0 2024-09-19T04:36:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.687+0000 7fdea97fa640 1 -- 172.21.15.70:0/2656948644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc0307a0 con 0x5556e8f173c0 2024-09-19T04:36:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 -- 172.21.15.70:0/2656948644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 msgr2=0x5556e8f177a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdec37fe640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdeac0a33b0 0x7fdeac0a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdebc04b000 tx=0x7fdebc048000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f177a0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7fdebc005fd0 tx=0x7fdebc031430 comp rx=0 tx=0).stop 2024-09-19T04:36:17.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 -- 172.21.15.70:0/2656948644 shutdown_connections 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f26a90 0x5556e8f28e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f17ce0 0x5556e8f26550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 --2- 172.21.15.70:0/2656948644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f177a0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 -- 172.21.15.70:0/2656948644 >> 172.21.15.70:0/2656948644 conn(0x5556e8f13a30 msgr2=0x5556e8f13e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 -- 172.21.15.70:0/2656948644 shutdown_connections 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 -- 172.21.15.70:0/2656948644 wait complete. 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 -- start start 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.688+0000 7fdecba19740 1 Processor -- start 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdecba19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f173c0 0x5556e8f264b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdecba19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 0x5556e8f23760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdecba19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f26a90 0x5556e8f23d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdecba19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5556e8f29600 con 0x5556e8f26a90 2024-09-19T04:36:17.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdecba19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5556e8e38050 con 0x5556e8f173c0 2024-09-19T04:36:17.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdecba19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5556e8f29780 con 0x5556e8f17ce0 2024-09-19T04:36:17.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdecba19740 10 client.0 _ll_register_callbacks cb 0x5556e8e78160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:17.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f26a90 0x5556e8f23d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f26a90 0x5556e8f23d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37952/0 (socket says 172.21.15.70:37952) 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 -- 172.21.15.70:0/2186955520 learned_addr learned my addr 172.21.15.70:0/2186955520 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec27fc640 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 0x5556e8f23760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f173c0 0x5556e8f264b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 -- 172.21.15.70:0/2186955520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 msgr2=0x5556e8f23760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 0x5556e8f23760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 -- 172.21.15.70:0/2186955520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f173c0 msgr2=0x5556e8f264b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f173c0 0x5556e8f264b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 -- 172.21.15.70:0/2186955520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e8bee3c0 con 0x5556e8f26a90 2024-09-19T04:36:17.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdec37fe640 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f26a90 0x5556e8f23d70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdebc031880 tx=0x7fdebc009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a96b6ad570badd30 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdea6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.689+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2186955520 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdebc05f060 con 0x5556e8f26a90 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2186955520 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fdebc004040 con 0x5556e8f26a90 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 1 -- 172.21.15.70:0/2186955520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdebc036040 con 0x5556e8f26a90 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2186955520 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdebc056040 con 0x5556e8f26a90 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 10 client.16236 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 1 -- 172.21.15.70:0/2186955520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556e8f29600 con 0x5556e8f26a90 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2186955520 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdebc036040 con 0x5556e8f26a90 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2186955520 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fdebc030070 con 0x5556e8f26a90 2024-09-19T04:36:17.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 10 client.16236 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 10 client.16236 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 20 client.16236 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5556e8f36250 0x5556e8f38640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 4 client.16236 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdecba19740 1 -- 172.21.15.70:0/2186955520 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5556e8e8a850 con 0x5556e8f36250 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.690+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5556e8f36250 0x5556e8f38640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.691+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5556e8f36250 0x5556e8f38640 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34af45bceb5a98f9 server_cookie=2dfa29ef4dc66031 in_seq=0 out_seq=0 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.691+0000 7fdea6ff5640 10 client.16236 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.691+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2186955520 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5556e8e8a850 con 0x5556e8f36250 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.691+0000 7fdea6ff5640 10 client.16236 handle_command_reply: tid=0 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.691+0000 7fdecba19740 1 client.16236 shutdown 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 -- 172.21.15.70:0/2186955520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f26a90 msgr2=0x5556e8f23d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f26a90 0x5556e8f23d70 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fdebc031880 tx=0x7fdebc009560 comp rx=0 tx=0).stop 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 -- 172.21.15.70:0/2186955520 shutdown_connections 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5556e8f36250 0x5556e8f38640 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f26a90 0x5556e8f23d70 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 0x5556e8f23760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 --2- 172.21.15.70:0/2186955520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f173c0 0x5556e8f264b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdea6ff5640 0 client.16236 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 -- 172.21.15.70:0/2186955520 >> 172.21.15.70:0/2186955520 conn(0x5556e8f13a30 msgr2=0x5556e8f196a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 -- 172.21.15.70:0/2186955520 shutdown_connections 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 1 -- 172.21.15.70:0/2186955520 wait complete. 2024-09-19T04:36:17.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.692+0000 7fdecba19740 20 client.16236 trim_cache size 0 max 16384 2024-09-19T04:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.708+0000 7fdecba19740 1 Processor -- start 2024-09-19T04:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.708+0000 7fdecba19740 1 -- start start 2024-09-19T04:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdecba19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f328a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdecba19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 0x5556e8f3dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdecba19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f3e400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdecba19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdec41adea0 con 0x5556e8f173c0 2024-09-19T04:36:17.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdecba19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdec41ab6b0 con 0x5556e8f26a90 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdecba19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdec41a9520 con 0x5556e8f17ce0 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f328a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f328a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37960/0 (socket says 172.21.15.70:37960) 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 -- 172.21.15.70:0/3779041250 learned_addr learned my addr 172.21.15.70:0/3779041250 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec27fc640 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 0x5556e8f3dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 -- 172.21.15.70:0/3779041250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 msgr2=0x5556e8f3dec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 0x5556e8f3dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec37fe640 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f3e400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 -- 172.21.15.70:0/3779041250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 msgr2=0x5556e8f3e400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f3e400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 -- 172.21.15.70:0/3779041250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556e8f17b10 con 0x5556e8f173c0 2024-09-19T04:36:17.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec37fe640 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f3e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:17.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f328a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40ccf10 tx=0x7fdeb40d1bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86c5674ef8ef9f9f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:17.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdea8ff9640 1 -- 172.21.15.70:0/3779041250 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb40d5020 con 0x5556e8f173c0 2024-09-19T04:36:17.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdea8ff9640 1 -- 172.21.15.70:0/3779041250 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdeb40046c0 con 0x5556e8f173c0 2024-09-19T04:36:17.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.709+0000 7fdea8ff9640 1 -- 172.21.15.70:0/3779041250 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb4020040 con 0x5556e8f173c0 2024-09-19T04:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 -- 172.21.15.70:0/3779041250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 msgr2=0x5556e8f328a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f328a0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fdeb40ccf10 tx=0x7fdeb40d1bf0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 -- 172.21.15.70:0/3779041250 shutdown_connections 2024-09-19T04:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f3e400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f17ce0 0x5556e8f3dec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 --2- 172.21.15.70:0/3779041250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f173c0 0x5556e8f328a0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 -- 172.21.15.70:0/3779041250 >> 172.21.15.70:0/3779041250 conn(0x5556e8f13a30 msgr2=0x5556e8f1ed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 -- 172.21.15.70:0/3779041250 shutdown_connections 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 -- 172.21.15.70:0/3779041250 wait complete. 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 -- start start 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.710+0000 7fdecba19740 1 Processor -- start 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdecba19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f173c0 0x5556e8f2f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdecba19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f17ce0 0x5556e8f2a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdecba19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f2aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdecba19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdec41a9b70 con 0x5556e8f17ce0 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdecba19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdec41aafe0 con 0x5556e8f26a90 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdecba19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdec41aa240 con 0x5556e8f173c0 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdecba19740 10 client.0 _ll_register_callbacks cb 0x7fdebc053040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:17.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f17ce0 0x5556e8f2a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f17ce0 0x5556e8f2a4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37972/0 (socket says 172.21.15.70:37972) 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 -- 172.21.15.70:0/2158938017 learned_addr learned my addr 172.21.15.70:0/2158938017 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f173c0 0x5556e8f2f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec37fe640 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f2aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 -- 172.21.15.70:0/2158938017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f173c0 msgr2=0x5556e8f2f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f173c0 0x5556e8f2f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 -- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 msgr2=0x5556e8f2aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f2aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 -- 172.21.15.70:0/2158938017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556e8f2b210 con 0x5556e8f17ce0 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec37fe640 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f2aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdec27fc640 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f17ce0 0x5556e8f2a4d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x5556e8f22ff0 tx=0x7fdeb800bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b771956e264f86cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdea6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:17.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2158938017 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdeb8011440 con 0x5556e8f17ce0 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2158938017 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fdeb80115e0 con 0x5556e8f17ce0 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.711+0000 7fdecba19740 1 -- 172.21.15.70:0/2158938017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5556e8e84d60 con 0x5556e8f17ce0 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2158938017 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7fdeb802a050 con 0x5556e8f17ce0 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdecba19740 10 client.16242 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdecba19740 1 -- 172.21.15.70:0/2158938017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5556e8fa0ed0 con 0x5556e8f17ce0 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2158938017 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x5556e8e84d60 con 0x5556e8f17ce0 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2158938017 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7fdeb801ca00 con 0x5556e8f17ce0 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdecba19740 10 client.16242 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdecba19740 10 client.16242 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdecba19740 20 client.16242 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdecba19740 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5556e8fa1710 0x5556e8fa3b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdecba19740 4 client.16242 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:36:17.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdecba19740 1 -- 172.21.15.70:0/2158938017 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5556e8e01210 con 0x5556e8fa1710 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.712+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5556e8fa1710 0x5556e8fa3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdea6ff5640 10 client.16242 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdec2ffd640 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5556e8fa1710 0x5556e8fa3b30 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=33a65fa8910b987c server_cookie=5ae43c0c90b524f1 in_seq=0 out_seq=0 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdea6ff5640 1 -- 172.21.15.70:0/2158938017 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5556e8e01210 con 0x5556e8fa1710 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdea6ff5640 10 client.16242 handle_command_reply: tid=0 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 client.16242 shutdown 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 -- 172.21.15.70:0/2158938017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f17ce0 msgr2=0x5556e8f2a4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f17ce0 0x5556e8f2a4d0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x5556e8f22ff0 tx=0x7fdeb800bf30 comp rx=0 tx=0).stop 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 -- 172.21.15.70:0/2158938017 shutdown_connections 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5556e8fa1710 0x5556e8fa3b30 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5556e8f26a90 0x5556e8f2aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5556e8f17ce0 0x5556e8f2a4d0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 --2- 172.21.15.70:0/2158938017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5556e8f173c0 0x5556e8f2f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 -- 172.21.15.70:0/2158938017 >> 172.21.15.70:0/2158938017 conn(0x5556e8f13a30 msgr2=0x5556e8f1e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdea6ff5640 0 client.16242 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 -- 172.21.15.70:0/2158938017 shutdown_connections 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 1 -- 172.21.15.70:0/2158938017 wait complete. 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.713+0000 7fdecba19740 20 client.16242 trim_cache size 0 max 16384 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:36:17.722 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 -- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdeac0a33b0 msgr2=0x7fdeac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdeac0a33b0 0x7fdeac0a5870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fdebc04b000 tx=0x7fdebc048000 comp rx=0 tx=0).stop 2024-09-19T04:36:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 -- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4100a80 msgr2=0x7fdec4198490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:17.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4100a80 0x7fdec4198490 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fdeb400d770 tx=0x7fdeb400dc30 comp rx=0 tx=0).stop 2024-09-19T04:36:17.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 -- 172.21.15.70:0/1429653891 shutdown_connections 2024-09-19T04:36:17.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdeac0a33b0 0x7fdeac0a5870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdec4106a80 0x7fdec419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdec4101420 0x7fdec41989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 --2- 172.21.15.70:0/1429653891 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdec4100a80 0x7fdec4198490 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:17.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 -- 172.21.15.70:0/1429653891 >> 172.21.15.70:0/1429653891 conn(0x7fdec40fc7a0 msgr2=0x7fdec40fcb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:17.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 -- 172.21.15.70:0/1429653891 shutdown_connections 2024-09-19T04:36:17.725 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:17.714+0000 7fdec9640640 1 -- 172.21.15.70:0/1429653891 wait complete. 2024-09-19T04:36:17.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:17 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:36:18.021 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:17 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:36:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:17 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:36:18.458 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:36:18.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:36:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:18.823 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:18 smithi070 ceph-mon[30942]: pgmap v169: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:36:18.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:18 smithi167 ceph-mon[34339]: pgmap v169: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:36:19.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:18 smithi134 ceph-mon[34525]: pgmap v169: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 170 B/s wr, 8 op/s 2024-09-19T04:36:19.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 -- 172.21.15.70:0/555985750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c106f10 msgr2=0x7f3f1c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:19.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 --2- 172.21.15.70:0/555985750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c106f10 0x7f3f1c10ea90 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f3f14009ca0 tx=0x7f3f1402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 -- 172.21.15.70:0/555985750 shutdown_connections 2024-09-19T04:36:19.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 --2- 172.21.15.70:0/555985750 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c106f10 0x7f3f1c10ea90 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 --2- 172.21.15.70:0/555985750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f1c102790 0x7f3f1c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 --2- 172.21.15.70:0/555985750 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1c101de0 0x7f3f1c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 -- 172.21.15.70:0/555985750 >> 172.21.15.70:0/555985750 conn(0x7f3f1c0fd8c0 msgr2=0x7f3f1c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:19.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 -- 172.21.15.70:0/555985750 shutdown_connections 2024-09-19T04:36:19.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.187+0000 7f3f242ca640 1 -- 172.21.15.70:0/555985750 wait complete. 2024-09-19T04:36:19.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f242ca640 1 Processor -- start 2024-09-19T04:36:19.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f242ca640 1 -- start start 2024-09-19T04:36:19.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f242ca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c101de0 0x7f3f1c198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:19.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f242ca640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1c102790 0x7f3f1c198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:19.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f242ca640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f1c106f10 0x7f3f1c19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:19.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f242ca640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c112000 con 0x7f3f1c101de0 2024-09-19T04:36:19.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f242ca640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c111e80 con 0x7f3f1c106f10 2024-09-19T04:36:19.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f242ca640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1c112180 con 0x7f3f1c102790 2024-09-19T04:36:19.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22066640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c101de0 0x7f3f1c198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:19.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22066640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c101de0 0x7f3f1c198520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37998/0 (socket says 172.21.15.70:37998) 2024-09-19T04:36:19.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22066640 1 -- 172.21.15.70:0/3216460706 learned_addr learned my addr 172.21.15.70:0/3216460706 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:19.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f21865640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1c102790 0x7f3f1c198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22867640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f1c106f10 0x7f3f1c19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22066640 1 -- 172.21.15.70:0/3216460706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1c102790 msgr2=0x7f3f1c198a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22066640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1c102790 0x7f3f1c198a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22066640 1 -- 172.21.15.70:0/3216460706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f1c106f10 msgr2=0x7f3f1c19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22066640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f1c106f10 0x7f3f1c19cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.188+0000 7f3f22066640 1 -- 172.21.15.70:0/3216460706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f1c19d4d0 con 0x7f3f1c101de0 2024-09-19T04:36:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.189+0000 7f3f21865640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1c102790 0x7f3f1c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.189+0000 7f3f22066640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c101de0 0x7f3f1c198520 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b4a0 tx=0x7f3f1800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.189+0000 7f3f137fe640 1 -- 172.21.15.70:0/3216460706 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18014070 con 0x7f3f1c101de0 2024-09-19T04:36:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.189+0000 7f3f137fe640 1 -- 172.21.15.70:0/3216460706 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3f18010ae0 con 0x7f3f1c101de0 2024-09-19T04:36:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.189+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f1c19d7c0 con 0x7f3f1c101de0 2024-09-19T04:36:19.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.189+0000 7f3f137fe640 1 -- 172.21.15.70:0/3216460706 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f18017c70 con 0x7f3f1c101de0 2024-09-19T04:36:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.189+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f1c1a50a0 con 0x7f3f1c101de0 2024-09-19T04:36:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.190+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f1c102240 con 0x7f3f1c101de0 2024-09-19T04:36:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.191+0000 7f3f137fe640 1 -- 172.21.15.70:0/3216460706 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3f18017070 con 0x7f3f1c101de0 2024-09-19T04:36:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.192+0000 7f3f137fe640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3f080a33b0 0x7f3f080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:19.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.192+0000 7f3f21865640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3f080a33b0 0x7f3f080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.192+0000 7f3f137fe640 1 -- 172.21.15.70:0/3216460706 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f3f180cf0b0 con 0x7f3f1c101de0 2024-09-19T04:36:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.192+0000 7f3f21865640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3f080a33b0 0x7f3f080a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0ffe90 tx=0x7f3f0c008040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:19.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.196+0000 7f3f137fe640 1 -- 172.21.15.70:0/3216460706 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f3f1809bbc0 con 0x7f3f1c101de0 2024-09-19T04:36:19.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.399+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f1c02d7c0 con 0x7f3f1c101de0 2024-09-19T04:36:19.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.400+0000 7f3f137fe640 1 -- 172.21.15.70:0/3216460706 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) ==== 94+0+11923 (secure 0 0 0) 0x7f3f1809b4c0 con 0x7f3f1c101de0 2024-09-19T04:36:19.402 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:36:19.402 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":28,"btime":"2024-09-19T04:34:07:652724+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":28,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:34:07.594198+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:36:19.402 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 28 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3f080a33b0 msgr2=0x7f3f080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3f080a33b0 0x7f3f080a5870 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c0ffe90 tx=0x7f3f0c008040 comp rx=0 tx=0).stop 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c101de0 msgr2=0x7f3f1c198520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c101de0 0x7f3f1c198520 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f3f1800b4a0 tx=0x7f3f1800b960 comp rx=0 tx=0).stop 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 shutdown_connections 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3f080a33b0 0x7f3f080a5870 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f1c106f10 0x7f3f1c19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3f1c102790 0x7f3f1c198a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 --2- 172.21.15.70:0/3216460706 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3f1c101de0 0x7f3f1c198520 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 >> 172.21.15.70:0/3216460706 conn(0x7f3f1c0fd8c0 msgr2=0x7f3f1c0fecf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 shutdown_connections 2024-09-19T04:36:19.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:19.402+0000 7f3f242ca640 1 -- 172.21.15.70:0/3216460706 wait complete. 2024-09-19T04:36:19.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:19 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3216460706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:20.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:19 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3216460706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:20.072 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:19 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3216460706' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:20.102 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:36:20.348 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:20.742 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:20 smithi070 ceph-mon[30942]: pgmap v170: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:36:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 -- 172.21.15.70:0/3606921299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580106a80 msgr2=0x7f1580106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 --2- 172.21.15.70:0/3606921299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580106a80 0x7f1580106e60 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f1570009930 tx=0x7f157002a420 comp rx=0 tx=0).stop 2024-09-19T04:36:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 -- 172.21.15.70:0/3606921299 shutdown_connections 2024-09-19T04:36:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 --2- 172.21.15.70:0/3606921299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580101420 0x7f158010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 --2- 172.21.15.70:0/3606921299 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1580100a80 0x7f1580100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 --2- 172.21.15.70:0/3606921299 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580106a80 0x7f1580106e60 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 -- 172.21.15.70:0/3606921299 >> 172.21.15.70:0/3606921299 conn(0x7f15800fc7a0 msgr2=0x7f15800febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 -- 172.21.15.70:0/3606921299 shutdown_connections 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.822+0000 7f15861ff640 1 -- 172.21.15.70:0/3606921299 wait complete. 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f15861ff640 1 Processor -- start 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f15861ff640 1 -- start start 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f15861ff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580100a80 0x7f1580198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f15861ff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580101420 0x7f15801989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f15861ff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1580106a80 0x7f158019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f15861ff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1580111f30 con 0x7f1580101420 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f15861ff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1580111db0 con 0x7f1580100a80 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f15861ff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15801120b0 con 0x7f1580106a80 2024-09-19T04:36:20.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f157effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580101420 0x7f15801989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f157effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580101420 0x7f15801989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38014/0 (socket says 172.21.15.70:38014) 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f157effd640 1 -- 172.21.15.70:0/1698980679 learned_addr learned my addr 172.21.15.70:0/1698980679 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f157f7fe640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580100a80 0x7f1580198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.823+0000 7f157ffff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1580106a80 0x7f158019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157effd640 1 -- 172.21.15.70:0/1698980679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1580106a80 msgr2=0x7f158019cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157effd640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1580106a80 0x7f158019cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157effd640 1 -- 172.21.15.70:0/1698980679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580100a80 msgr2=0x7f1580198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157effd640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580100a80 0x7f1580198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157effd640 1 -- 172.21.15.70:0/1698980679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f158019d440 con 0x7f1580101420 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157ffff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1580106a80 0x7f158019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157effd640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580101420 0x7f15801989d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f157400d950 tx=0x7f157400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:20.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157cff9640 1 -- 172.21.15.70:0/1698980679 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574017070 con 0x7f1580101420 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157cff9640 1 -- 172.21.15.70:0/1698980679 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1574009c30 con 0x7f1580101420 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f15861ff640 1 -- 172.21.15.70:0/1698980679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f158019d730 con 0x7f1580101420 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f157cff9640 1 -- 172.21.15.70:0/1698980679 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157400f6b0 con 0x7f1580101420 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.824+0000 7f15861ff640 1 -- 172.21.15.70:0/1698980679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15801a5010 con 0x7f1580101420 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.826+0000 7f157cff9640 1 -- 172.21.15.70:0/1698980679 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1574010a50 con 0x7f1580101420 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f15885d8740 1 Processor -- start 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f15885d8740 1 -- start start 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f15885d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a990c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f15885d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a990ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f15885d8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a9919760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f15885d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613a98722f0 con 0x5613a990db40 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f15885d8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5613a9819cf0 con 0x5613a9917370 2024-09-19T04:36:20.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f15885d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5613a986e2b0 con 0x5613a990c5d0 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a990c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a990c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38016/0 (socket says 172.21.15.70:38016) 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 -- 172.21.15.70:0/3096275596 learned_addr learned my addr 172.21.15.70:0/3096275596 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157cff9640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15680a33b0 0x7f15680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157f7fe640 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a990ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157effd640 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a9919760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 -- 172.21.15.70:0/3096275596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 msgr2=0x5613a990ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a990ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 -- 172.21.15.70:0/3096275596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 msgr2=0x5613a9919760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a9919760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 -- 172.21.15.70:0/3096275596 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613a97fe3a0 con 0x5613a990db40 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157effd640 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a9919760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:20.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157ffff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15680a33b0 0x7f15680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.827+0000 7f157cff9640 1 -- 172.21.15.70:0/1698980679 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f15740cf960 con 0x7f1580101420 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.828+0000 7f157ffff640 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a990c090 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1578009fd0 tx=0x7f1578010a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cca47720d083b4f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.828+0000 7f1565ffb640 1 -- 172.21.15.70:0/3096275596 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578017040 con 0x5613a990db40 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.828+0000 7f1565ffb640 1 -- 172.21.15.70:0/3096275596 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f157802a070 con 0x5613a990db40 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.828+0000 7f1565ffb640 1 -- 172.21.15.70:0/3096275596 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157801d070 con 0x5613a990db40 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.828+0000 7f15885d8740 1 -- 172.21.15.70:0/3096275596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 msgr2=0x5613a990c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.828+0000 7f15885d8740 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a990c090 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f1578009fd0 tx=0x7f1578010a00 comp rx=0 tx=0).stop 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.828+0000 7f157ffff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15680a33b0 0x7f15680a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1578029000 tx=0x7f1578027000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 -- 172.21.15.70:0/3096275596 shutdown_connections 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a9919760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a990ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 --2- 172.21.15.70:0/3096275596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a990c090 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 -- 172.21.15.70:0/3096275596 >> 172.21.15.70:0/3096275596 conn(0x5613a98d5310 msgr2=0x5613a9908c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 -- 172.21.15.70:0/3096275596 shutdown_connections 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 -- 172.21.15.70:0/3096275596 wait complete. 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 -- start start 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 Processor -- start 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990c5d0 0x5613a9916d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990db40 0x5613a9914000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a9917370 0x5613a99145d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5613a991a070 con 0x5613a990c5d0 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5613a982d060 con 0x5613a990db40 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5613a991a1f0 con 0x5613a9917370 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.829+0000 7f15885d8740 10 client.0 _ll_register_callbacks cb 0x5613a95808c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:20.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990c5d0 0x5613a9916d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990c5d0 0x5613a9916d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38028/0 (socket says 172.21.15.70:38028) 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 -- 172.21.15.70:0/1194278344 learned_addr learned my addr 172.21.15.70:0/1194278344 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157effd640 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990db40 0x5613a9914000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157ffff640 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a9917370 0x5613a99145d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 -- 172.21.15.70:0/1194278344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a9917370 msgr2=0x5613a99145d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a9917370 0x5613a99145d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 -- 172.21.15.70:0/1194278344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990db40 msgr2=0x5613a9914000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990db40 0x5613a9914000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 -- 172.21.15.70:0/1194278344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613a95e33c0 con 0x5613a990c5d0 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f157f7fe640 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990c5d0 0x5613a9916d50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1570009230 tx=0x7f1570032e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da983be516ab318e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f155effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f155effd640 1 -- 172.21.15.70:0/1194278344 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1570035040 con 0x5613a990c5d0 2024-09-19T04:36:20.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f155effd640 1 -- 172.21.15.70:0/1194278344 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f1570031850 con 0x5613a990c5d0 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f15885d8740 1 -- 172.21.15.70:0/1194278344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f157802a070 con 0x5613a990c5d0 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f155effd640 1 -- 172.21.15.70:0/1194278344 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f1570004040 con 0x5613a990c5d0 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f15885d8740 10 client.16260 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.830+0000 7f15885d8740 1 -- 172.21.15.70:0/1194278344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613a9925a60 con 0x5613a990c5d0 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f155effd640 1 -- 172.21.15.70:0/1194278344 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f157802a070 con 0x5613a990c5d0 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f155effd640 1 -- 172.21.15.70:0/1194278344 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f1570004860 con 0x5613a990c5d0 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f15885d8740 10 client.16260 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f15885d8740 10 client.16260 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f15885d8740 20 client.16260 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f15885d8740 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5613a9926f20 0x5613a9929370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f15885d8740 4 client.16260 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f15885d8740 1 -- 172.21.15.70:0/1194278344 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5613a987f860 con 0x5613a9926f20 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.831+0000 7f157effd640 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5613a9926f20 0x5613a9929370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.832+0000 7f155effd640 10 client.16260 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.832+0000 7f157effd640 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5613a9926f20 0x5613a9929370 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=124576a253c9c6de server_cookie=20a523c2710940dc in_seq=0 out_seq=0 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.832+0000 7f155effd640 1 -- 172.21.15.70:0/1194278344 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5613a987f860 con 0x5613a9926f20 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.832+0000 7f155effd640 10 client.16260 handle_command_reply: tid=0 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.832+0000 7f15885d8740 1 client.16260 shutdown 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 -- 172.21.15.70:0/1194278344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990c5d0 msgr2=0x5613a9916d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990c5d0 0x5613a9916d50 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f1570009230 tx=0x7f1570032e30 comp rx=0 tx=0).stop 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 -- 172.21.15.70:0/1194278344 shutdown_connections 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5613a9926f20 0x5613a9929370 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a9917370 0x5613a99145d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990db40 0x5613a9914000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f155effd640 0 client.16260 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 --2- 172.21.15.70:0/1194278344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990c5d0 0x5613a9916d50 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 -- 172.21.15.70:0/1194278344 >> 172.21.15.70:0/1194278344 conn(0x5613a98d5310 msgr2=0x5613a990e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 -- 172.21.15.70:0/1194278344 shutdown_connections 2024-09-19T04:36:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 1 -- 172.21.15.70:0/1194278344 wait complete. 2024-09-19T04:36:20.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.833+0000 7f15885d8740 20 client.16260 trim_cache size 0 max 16384 2024-09-19T04:36:20.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f15885d8740 1 Processor -- start 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f15885d8740 1 -- start start 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f15885d8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990c5d0 0x5613a99138c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f15885d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990db40 0x5613a990f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f15885d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a9917370 0x5613a990f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f15885d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15801adfe0 con 0x5613a9917370 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f15885d8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15801ab7f0 con 0x5613a990c5d0 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f15885d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15801a9640 con 0x5613a990db40 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f157ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a9917370 0x5613a990f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f157ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a9917370 0x5613a990f660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38032/0 (socket says 172.21.15.70:38032) 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f157ffff640 1 -- 172.21.15.70:0/3525856261 learned_addr learned my addr 172.21.15.70:0/3525856261 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.846+0000 7f157f7fe640 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990c5d0 0x5613a99138c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f157effd640 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990db40 0x5613a990f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f157ffff640 1 -- 172.21.15.70:0/3525856261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990db40 msgr2=0x5613a990f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f157ffff640 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990db40 0x5613a990f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f157ffff640 1 -- 172.21.15.70:0/3525856261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990c5d0 msgr2=0x5613a99138c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f157ffff640 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990c5d0 0x5613a99138c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f157ffff640 1 -- 172.21.15.70:0/3525856261 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5613a9912fb0 con 0x5613a9917370 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f157ffff640 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a9917370 0x5613a990f660 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1578011010 tx=0x7f1578013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7493bf3f4dbf9ba server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f15657fa640 1 -- 172.21.15.70:0/3525856261 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f157801d040 con 0x5613a9917370 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f15657fa640 1 -- 172.21.15.70:0/3525856261 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f157802a050 con 0x5613a9917370 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.847+0000 7f15657fa640 1 -- 172.21.15.70:0/3525856261 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1578017040 con 0x5613a9917370 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 -- 172.21.15.70:0/3525856261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a9917370 msgr2=0x5613a990f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a9917370 0x5613a990f660 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f1578011010 tx=0x7f1578013000 comp rx=0 tx=0).stop 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 -- 172.21.15.70:0/3525856261 shutdown_connections 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a9917370 0x5613a990f660 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990db40 0x5613a990f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 --2- 172.21.15.70:0/3525856261 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a990c5d0 0x5613a99138c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 -- 172.21.15.70:0/3525856261 >> 172.21.15.70:0/3525856261 conn(0x5613a98d5310 msgr2=0x5613a9907d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 -- 172.21.15.70:0/3525856261 shutdown_connections 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 -- 172.21.15.70:0/3525856261 wait complete. 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 -- start start 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.848+0000 7f15885d8740 1 Processor -- start 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f15885d8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a991b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f15885d8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a991b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f15885d8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a991bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f15885d8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f15801a9cb0 con 0x5613a990db40 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f15885d8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f15801ab120 con 0x5613a9917370 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f15885d8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15801aa380 con 0x5613a990c5d0 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f15885d8740 10 client.0 _ll_register_callbacks cb 0x7f1570009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:20.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a991b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a991b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38036/0 (socket says 172.21.15.70:38036) 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 -- 172.21.15.70:0/1771525131 learned_addr learned my addr 172.21.15.70:0/1771525131 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157f7fe640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a991b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157ffff640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a991bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 -- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 msgr2=0x5613a991b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a991b140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 -- 172.21.15.70:0/1771525131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 msgr2=0x5613a991bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a991bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 -- 172.21.15.70:0/1771525131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5613a9990c10 con 0x5613a990db40 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157ffff640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a991bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157f7fe640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a991b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f157effd640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a991b680 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f157409bbf0 tx=0x7f157400b530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=404dce20e6f97f73 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:20.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f155effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f155effd640 1 -- 172.21.15.70:0/1771525131 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1574020040 con 0x5613a990db40 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f155effd640 1 -- 172.21.15.70:0/1771525131 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f15740982d0 con 0x5613a990db40 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.849+0000 7f15885d8740 1 -- 172.21.15.70:0/1771525131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f157802a050 con 0x5613a990db40 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f155effd640 1 -- 172.21.15.70:0/1771525131 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f15740b9050 con 0x5613a990db40 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f15885d8740 10 client.16266 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f15885d8740 1 -- 172.21.15.70:0/1771525131 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5613a9991e50 con 0x5613a990db40 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f155effd640 1 -- 172.21.15.70:0/1771525131 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f157802a050 con 0x5613a990db40 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f155effd640 1 -- 172.21.15.70:0/1771525131 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f15740979b0 con 0x5613a990db40 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f15885d8740 10 client.16266 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f15885d8740 10 client.16266 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f15885d8740 20 client.16266 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f15885d8740 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5613a99925e0 0x5613a9994a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:20.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f15885d8740 4 client.16266 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f15885d8740 1 -- 172.21.15.70:0/1771525131 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5613a9879d70 con 0x5613a99925e0 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.850+0000 7f157f7fe640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5613a99925e0 0x5613a9994a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f155effd640 10 client.16266 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f157f7fe640 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5613a99925e0 0x5613a9994a00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=275082120fd57ad4 server_cookie=9623f705cdcfdf49 in_seq=0 out_seq=0 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f155effd640 1 -- 172.21.15.70:0/1771525131 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5613a9879d70 con 0x5613a99925e0 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f155effd640 10 client.16266 handle_command_reply: tid=0 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 client.16266 shutdown 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 -- 172.21.15.70:0/1771525131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 msgr2=0x5613a991b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a991b680 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f157409bbf0 tx=0x7f157400b530 comp rx=0 tx=0).stop 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 -- 172.21.15.70:0/1771525131 shutdown_connections 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5613a99925e0 0x5613a9994a00 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5613a9917370 0x5613a991bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5613a990db40 0x5613a991b680 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 --2- 172.21.15.70:0/1771525131 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5613a990c5d0 0x5613a991b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 -- 172.21.15.70:0/1771525131 >> 172.21.15.70:0/1771525131 conn(0x5613a98d5310 msgr2=0x5613a9915860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f155effd640 0 client.16266 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 -- 172.21.15.70:0/1771525131 shutdown_connections 2024-09-19T04:36:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 1 -- 172.21.15.70:0/1771525131 wait complete. 2024-09-19T04:36:20.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.851+0000 7f15885d8740 20 client.16266 trim_cache size 0 max 16384 2024-09-19T04:36:20.864 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 -- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15680a33b0 msgr2=0x7f15680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15680a33b0 0x7f15680a5870 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1578029000 tx=0x7f1578027000 comp rx=0 tx=0).stop 2024-09-19T04:36:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 -- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580101420 msgr2=0x7f15801989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580101420 0x7f15801989d0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f157400d950 tx=0x7f157400de10 comp rx=0 tx=0).stop 2024-09-19T04:36:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 -- 172.21.15.70:0/1698980679 shutdown_connections 2024-09-19T04:36:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15680a33b0 0x7f15680a5870 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1580106a80 0x7f158019cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1580101420 0x7f15801989d0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 --2- 172.21.15.70:0/1698980679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1580100a80 0x7f1580198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 -- 172.21.15.70:0/1698980679 >> 172.21.15.70:0/1698980679 conn(0x7f15800fc7a0 msgr2=0x7f15800fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 -- 172.21.15.70:0/1698980679 shutdown_connections 2024-09-19T04:36:20.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:20.852+0000 7f15861ff640 1 -- 172.21.15.70:0/1698980679 wait complete. 2024-09-19T04:36:20.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:20 smithi167 ceph-mon[34339]: pgmap v170: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:36:21.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:20 smithi134 ceph-mon[34525]: pgmap v170: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:36:21.558 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:36:21.804 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:22.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 -- 172.21.15.70:0/224916071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56241008d0 msgr2=0x7f5624100d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 --2- 172.21.15.70:0/224916071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56241008d0 0x7f5624100d30 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f5618009cd0 tx=0x7f561802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 -- 172.21.15.70:0/224916071 shutdown_connections 2024-09-19T04:36:22.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 --2- 172.21.15.70:0/224916071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5624101270 0x7f562410d7a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 --2- 172.21.15.70:0/224916071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f56241008d0 0x7f5624100d30 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 --2- 172.21.15.70:0/224916071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56241068d0 0x7f5624106cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 -- 172.21.15.70:0/224916071 >> 172.21.15.70:0/224916071 conn(0x7f56240fc610 msgr2=0x7f56240fea30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 -- 172.21.15.70:0/224916071 shutdown_connections 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 -- 172.21.15.70:0/224916071 wait complete. 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 Processor -- start 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 -- start start 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56241008d0 0x7f5624196eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5624101270 0x7f56241973f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.281+0000 7f5629fa2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56241068d0 0x7f5624197930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5629fa2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5624110c70 con 0x7f5624101270 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5629fa2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5624110af0 con 0x7f56241068d0 2024-09-19T04:36:22.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5629fa2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5624110df0 con 0x7f56241008d0 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5624101270 0x7f56241973f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5624101270 0x7f56241973f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38050/0 (socket says 172.21.15.70:38050) 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 -- 172.21.15.70:0/1538288628 learned_addr learned my addr 172.21.15.70:0/1538288628 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5628fa0640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56241008d0 0x7f5624196eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f56297a1640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56241068d0 0x7f5624197930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 -- 172.21.15.70:0/1538288628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56241008d0 msgr2=0x7f5624196eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56241008d0 0x7f5624196eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 -- 172.21.15.70:0/1538288628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56241068d0 msgr2=0x7f5624197930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56241068d0 0x7f5624197930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 -- 172.21.15.70:0/1538288628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f56241a6720 con 0x7f5624101270 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5623fff640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5624101270 0x7f56241973f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5618006010 tx=0x7f5618003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:22.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5621ffb640 1 -- 172.21.15.70:0/1538288628 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618004040 con 0x7f5624101270 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5621ffb640 1 -- 172.21.15.70:0/1538288628 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f56180046b0 con 0x7f5624101270 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5629fa2640 1 -- 172.21.15.70:0/1538288628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f56241a69b0 con 0x7f5624101270 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.282+0000 7f5621ffb640 1 -- 172.21.15.70:0/1538288628 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618046480 con 0x7f5624101270 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.283+0000 7f5629fa2640 1 -- 172.21.15.70:0/1538288628 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f56241a6ef0 con 0x7f5624101270 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.285+0000 7f5621ffb640 1 -- 172.21.15.70:0/1538288628 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f56180305a0 con 0x7f5624101270 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.285+0000 7f562d5dd740 1 Processor -- start 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.285+0000 7f562d5dd740 1 -- start start 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.285+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c6c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c6cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c79940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f562d5dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5628f2bd22f0 con 0x5628f2c6dd20 2024-09-19T04:36:22.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f562d5dd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5628f2b79cf0 con 0x5628f2c6c7b0 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f562d5dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628f2bce2b0 con 0x5628f2c77550 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f5621ffb640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f560c0a33b0 0x7f560c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c6c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c6c270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38054/0 (socket says 172.21.15.70:38054) 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 -- 172.21.15.70:0/1553343715 learned_addr learned my addr 172.21.15.70:0/1553343715 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f560c0a33b0 0x7f560c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f5628fa0640 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c6cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f5621ffb640 1 -- 172.21.15.70:0/1538288628 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f561802e030 con 0x7f5624101270 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f5623fff640 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c79940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 -- 172.21.15.70:0/1553343715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 msgr2=0x5628f2c79940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:22.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c79940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 -- 172.21.15.70:0/1553343715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 msgr2=0x5628f2c6cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c6cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 -- 172.21.15.70:0/1553343715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f2b5e3a0 con 0x5628f2c6dd20 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.286+0000 7f56297a1640 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c6c270 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f561c014be0 tx=0x7f561c011750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=add9ff6dcebbdf51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f56297a1640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f560c0a33b0 0x7f560c0a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f561c0058c0 tx=0x7f561c01c000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f560affd640 1 -- 172.21.15.70:0/1553343715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c022070 con 0x5628f2c6dd20 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f560affd640 1 -- 172.21.15.70:0/1553343715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f561c00b9b0 con 0x5628f2c6dd20 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f560affd640 1 -- 172.21.15.70:0/1553343715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f561c004a00 con 0x5628f2c6dd20 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 -- 172.21.15.70:0/1553343715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 msgr2=0x5628f2c6c270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c6c270 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f561c014be0 tx=0x7f561c011750 comp rx=0 tx=0).stop 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 -- 172.21.15.70:0/1553343715 shutdown_connections 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c79940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c6cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1553343715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c6c270 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 -- 172.21.15.70:0/1553343715 >> 172.21.15.70:0/1553343715 conn(0x5628f2c35310 msgr2=0x5628f2c68e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 -- 172.21.15.70:0/1553343715 shutdown_connections 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.287+0000 7f562d5dd740 1 -- 172.21.15.70:0/1553343715 wait complete. 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 1 -- start start 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 1 Processor -- start 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c76f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c741c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c747b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5628f2c7a1f0 con 0x5628f2c6dd20 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5628f2b8d060 con 0x5628f2c6c7b0 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5628f2c7a370 con 0x5628f2c77550 2024-09-19T04:36:22.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f562d5dd740 10 client.0 _ll_register_callbacks cb 0x5628f28e08c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f5623fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c741c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f5623fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c741c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38056/0 (socket says 172.21.15.70:38056) 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.288+0000 7f5623fff640 1 -- 172.21.15.70:0/2019807856 learned_addr learned my addr 172.21.15.70:0/2019807856 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f56297a1640 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c747b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5628fa0640 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c76f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5623fff640 1 -- 172.21.15.70:0/2019807856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 msgr2=0x5628f2c747b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5623fff640 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c747b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5623fff640 1 -- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 msgr2=0x5628f2c76f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5623fff640 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c76f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5623fff640 1 -- 172.21.15.70:0/2019807856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f29433c0 con 0x5628f2c6dd20 2024-09-19T04:36:22.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5628fa0640 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c76f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5623fff640 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c741c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f56180ba270 tx=0x7f56180095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3248e04dd44eeb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5603fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5603fff640 1 -- 172.21.15.70:0/2019807856 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618004860 con 0x5628f2c6dd20 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5603fff640 1 -- 172.21.15.70:0/2019807856 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f56180bebd0 con 0x5628f2c6dd20 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f562d5dd740 1 -- 172.21.15.70:0/2019807856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f561c00b9b0 con 0x5628f2c6dd20 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5603fff640 1 -- 172.21.15.70:0/2019807856 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f56180bdfa0 con 0x5628f2c6dd20 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f562d5dd740 10 client.16278 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f562d5dd740 1 -- 172.21.15.70:0/2019807856 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5628f2c85cb0 con 0x5628f2c6dd20 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5603fff640 1 -- 172.21.15.70:0/2019807856 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f561c00b9b0 con 0x5628f2c6dd20 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.289+0000 7f5603fff640 1 -- 172.21.15.70:0/2019807856 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f561804e070 con 0x5628f2c6dd20 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f562d5dd740 10 client.16278 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:22.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f562d5dd740 10 client.16278 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f562d5dd740 20 client.16278 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f562d5dd740 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5628f2c87290 0x5628f2c896f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f562d5dd740 4 client.16278 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f562d5dd740 1 -- 172.21.15.70:0/2019807856 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5628f2bdf860 con 0x5628f2c87290 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f5628fa0640 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5628f2c87290 0x5628f2c896f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f5603fff640 10 client.16278 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.290+0000 7f5628fa0640 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5628f2c87290 0x5628f2c896f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e17db61d828b7676 server_cookie=f7f023300d6f8c55 in_seq=0 out_seq=0 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f5603fff640 1 -- 172.21.15.70:0/2019807856 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5628f2bdf860 con 0x5628f2c87290 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f5603fff640 10 client.16278 handle_command_reply: tid=0 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 client.16278 shutdown 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 -- 172.21.15.70:0/2019807856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 msgr2=0x5628f2c741c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c741c0 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f56180ba270 tx=0x7f56180095c0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 -- 172.21.15.70:0/2019807856 shutdown_connections 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5628f2c87290 0x5628f2c896f0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c747b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c741c0 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 --2- 172.21.15.70:0/2019807856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c76f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 -- 172.21.15.70:0/2019807856 >> 172.21.15.70:0/2019807856 conn(0x5628f2c35310 msgr2=0x5628f2c6eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f5603fff640 0 client.16278 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 -- 172.21.15.70:0/2019807856 shutdown_connections 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 1 -- 172.21.15.70:0/2019807856 wait complete. 2024-09-19T04:36:22.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.291+0000 7f562d5dd740 20 client.16278 trim_cache size 0 max 16384 2024-09-19T04:36:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f562d5dd740 1 Processor -- start 2024-09-19T04:36:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f562d5dd740 1 -- start start 2024-09-19T04:36:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c73160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c76130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c6f300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f562d5dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56241b1fc0 con 0x5628f2c6dd20 2024-09-19T04:36:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f562d5dd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56241af7d0 con 0x5628f2c6c7b0 2024-09-19T04:36:22.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f562d5dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56241ad620 con 0x5628f2c77550 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f5623fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c76130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f5623fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c76130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38060/0 (socket says 172.21.15.70:38060) 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.304+0000 7f5623fff640 1 -- 172.21.15.70:0/1750512376 learned_addr learned my addr 172.21.15.70:0/1750512376 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f5628fa0640 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c73160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f5623fff640 1 -- 172.21.15.70:0/1750512376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 msgr2=0x5628f2c6f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f56297a1640 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c6f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f5623fff640 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c6f300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f5623fff640 1 -- 172.21.15.70:0/1750512376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 msgr2=0x5628f2c73160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f5623fff640 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c73160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f5623fff640 1 -- 172.21.15.70:0/1750512376 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5628f2c69910 con 0x5628f2c6dd20 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f5628fa0640 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c73160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:22.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f5623fff640 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c76130 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f56180c5fe0 tx=0x7f561802a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=205af0da6389d180 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:22.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f560a7fc640 1 -- 172.21.15.70:0/1750512376 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618004860 con 0x5628f2c6dd20 2024-09-19T04:36:22.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f560a7fc640 1 -- 172.21.15.70:0/1750512376 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5618036040 con 0x5628f2c6dd20 2024-09-19T04:36:22.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.305+0000 7f560a7fc640 1 -- 172.21.15.70:0/1750512376 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f56180a6ba0 con 0x5628f2c6dd20 2024-09-19T04:36:22.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 -- 172.21.15.70:0/1750512376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 msgr2=0x5628f2c76130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c76130 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f56180c5fe0 tx=0x7f561802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 -- 172.21.15.70:0/1750512376 shutdown_connections 2024-09-19T04:36:22.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c6f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c76130 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1750512376 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c73160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 -- 172.21.15.70:0/1750512376 >> 172.21.15.70:0/1750512376 conn(0x5628f2c35310 msgr2=0x5628f2c75a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:22.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 -- 172.21.15.70:0/1750512376 shutdown_connections 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 -- 172.21.15.70:0/1750512376 wait complete. 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 -- start start 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 Processor -- start 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c7f940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c7fe80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.306+0000 7f562d5dd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c70c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f562d5dd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f56241adc90 con 0x5628f2c6dd20 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f562d5dd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f56241af100 con 0x5628f2c6c7b0 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f562d5dd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f56241ae360 con 0x5628f2c77550 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f562d5dd740 10 client.0 _ll_register_callbacks cb 0x7f5618009960 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c7fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c7fe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:38066/0 (socket says 172.21.15.70:38066) 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 -- 172.21.15.70:0/1159197335 learned_addr learned my addr 172.21.15.70:0/1159197335 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5628fa0640 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c7f940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f56297a1640 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c70c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 -- 172.21.15.70:0/1159197335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 msgr2=0x5628f2c70c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c70c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 -- 172.21.15.70:0/1159197335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 msgr2=0x5628f2c7f940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c7f940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 -- 172.21.15.70:0/1159197335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5628f2c71490 con 0x5628f2c6dd20 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f56297a1640 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c70c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5623fff640 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c7fe80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5618005e30 tx=0x7f5618003f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=185e4957cac99616 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5603fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:22.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5603fff640 1 -- 172.21.15.70:0/1159197335 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5618004860 con 0x5628f2c6dd20 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5603fff640 1 -- 172.21.15.70:0/1159197335 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f5618082d70 con 0x5628f2c6dd20 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f562d5dd740 1 -- 172.21.15.70:0/1159197335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5618036040 con 0x5628f2c6dd20 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f5603fff640 1 -- 172.21.15.70:0/1159197335 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=28) ==== 24+0+0 (secure 0 0 0) 0x7f5618030890 con 0x5628f2c6dd20 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f562d5dd740 10 client.16284 fetch_fsmap learned FSMap version 28 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.307+0000 7f562d5dd740 1 -- 172.21.15.70:0/1159197335 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=28,monmap=4+}) -- 0x5628f2c71490 con 0x5628f2c6dd20 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f5603fff640 1 -- 172.21.15.70:0/1159197335 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5618036040 con 0x5628f2c6dd20 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f5603fff640 1 -- 172.21.15.70:0/1159197335 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 28) ==== 8370+0+0 (secure 0 0 0) 0x7f56180a3070 con 0x5628f2c6dd20 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f562d5dd740 10 client.16284 fetch_fsmap finished waiting for FSMap version 28 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f562d5dd740 10 client.16284 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f562d5dd740 20 client.16284 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:22.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5628f2cf1f10 0x5628f2cf4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f562d5dd740 4 client.16284 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f562d5dd740 1 -- 172.21.15.70:0/1159197335 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5628f2bd9d70 con 0x5628f2cf1f10 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f5628fa0640 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5628f2cf1f10 0x5628f2cf4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f5628fa0640 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5628f2cf1f10 0x5628f2cf4330 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=5755c27da151d0f5 server_cookie=88727fbe8879c012 in_seq=0 out_seq=0 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.308+0000 7f5603fff640 10 client.16284 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f5603fff640 1 -- 172.21.15.70:0/1159197335 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5628f2bd9d70 con 0x5628f2cf1f10 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f5603fff640 10 client.16284 handle_command_reply: tid=0 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 client.16284 shutdown 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 -- 172.21.15.70:0/1159197335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 msgr2=0x5628f2c7fe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c7fe80 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f5618005e30 tx=0x7f5618003f70 comp rx=0 tx=0).stop 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 -- 172.21.15.70:0/1159197335 shutdown_connections 2024-09-19T04:36:22.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5628f2cf1f10 0x5628f2cf4330 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5628f2c77550 0x5628f2c70c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5628f2c6dd20 0x5628f2c7fe80 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f5603fff640 0 client.16284 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 --2- 172.21.15.70:0/1159197335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5628f2c6c7b0 0x5628f2c7f940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 -- 172.21.15.70:0/1159197335 >> 172.21.15.70:0/1159197335 conn(0x5628f2c35310 msgr2=0x5628f2c76240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 -- 172.21.15.70:0/1159197335 shutdown_connections 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 1 -- 172.21.15.70:0/1159197335 wait complete. 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.309+0000 7f562d5dd740 20 client.16284 trim_cache size 0 max 16384 2024-09-19T04:36:22.318 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 -- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f560c0a33b0 msgr2=0x7f560c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f560c0a33b0 0x7f560c0a5870 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f561c0058c0 tx=0x7f561c01c000 comp rx=0 tx=0).stop 2024-09-19T04:36:22.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 -- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5624101270 msgr2=0x7f56241973f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5624101270 0x7f56241973f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5618006010 tx=0x7f5618003970 comp rx=0 tx=0).stop 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 -- 172.21.15.70:0/1538288628 shutdown_connections 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f560c0a33b0 0x7f560c0a5870 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56241068d0 0x7f5624197930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5624101270 0x7f56241973f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 --2- 172.21.15.70:0/1538288628 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f56241008d0 0x7f5624196eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 -- 172.21.15.70:0/1538288628 >> 172.21.15.70:0/1538288628 conn(0x7f56240fc610 msgr2=0x7f56240fcd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 -- 172.21.15.70:0/1538288628 shutdown_connections 2024-09-19T04:36:22.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:22.310+0000 7f5629fa2640 1 -- 172.21.15.70:0/1538288628 wait complete. 2024-09-19T04:36:22.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:22 smithi070 ceph-mon[30942]: pgmap v171: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:36:22.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:22 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:22.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:22 smithi167 ceph-mon[34339]: pgmap v171: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:36:22.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:22 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:22 smithi134 ceph-mon[34525]: pgmap v171: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:36:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:22 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:23.058 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:36:23.300 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:23.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 -- 172.21.15.70:0/4250117976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40100e20 msgr2=0x7f6d40101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 --2- 172.21.15.70:0/4250117976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40100e20 0x7f6d40101200 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f6d30009ca0 tx=0x7f6d3002a950 comp rx=0 tx=0).stop 2024-09-19T04:36:23.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 -- 172.21.15.70:0/4250117976 shutdown_connections 2024-09-19T04:36:23.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 --2- 172.21.15.70:0/4250117976 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d40102ef0 0x7f6d4010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 --2- 172.21.15.70:0/4250117976 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d40102570 0x7f6d401029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 --2- 172.21.15.70:0/4250117976 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40100e20 0x7f6d40101200 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 -- 172.21.15.70:0/4250117976 >> 172.21.15.70:0/4250117976 conn(0x7f6d400fc7d0 msgr2=0x7f6d400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 -- 172.21.15.70:0/4250117976 shutdown_connections 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 -- 172.21.15.70:0/4250117976 wait complete. 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 Processor -- start 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.746+0000 7f6d460fd640 1 -- start start 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d460fd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d40100e20 0x7f6d40198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d460fd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d40102570 0x7f6d40198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d460fd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40102ef0 0x7f6d4019ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d460fd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d40112090 con 0x7f6d40102ef0 2024-09-19T04:36:23.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d460fd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d40111f10 con 0x7f6d40100e20 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d460fd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d40112210 con 0x7f6d40102570 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40102ef0 0x7f6d4019ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40102ef0 0x7f6d4019ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51288/0 (socket says 172.21.15.70:51288) 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 -- 172.21.15.70:0/2241984698 learned_addr learned my addr 172.21.15.70:0/2241984698 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d40100e20 0x7f6d40198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3effd640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d40102570 0x7f6d40198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 -- 172.21.15.70:0/2241984698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d40102570 msgr2=0x7f6d40198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d40102570 0x7f6d40198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 -- 172.21.15.70:0/2241984698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d40100e20 msgr2=0x7f6d40198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d40100e20 0x7f6d40198530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 -- 172.21.15.70:0/2241984698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d4019d4e0 con 0x7f6d40102ef0 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d40100e20 0x7f6d40198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:23.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3ffff640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40102ef0 0x7f6d4019ce00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009fd0 tx=0x7f6d3800b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.747+0000 7f6d3cff9640 1 -- 172.21.15.70:0/2241984698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d38011830 con 0x7f6d40102ef0 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.748+0000 7f6d460fd640 1 -- 172.21.15.70:0/2241984698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d4019d7d0 con 0x7f6d40102ef0 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.748+0000 7f6d3cff9640 1 -- 172.21.15.70:0/2241984698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6d38016070 con 0x7f6d40102ef0 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.748+0000 7f6d3cff9640 1 -- 172.21.15.70:0/2241984698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3800f2e0 con 0x7f6d40102ef0 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.748+0000 7f6d460fd640 1 -- 172.21.15.70:0/2241984698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d401a50b0 con 0x7f6d40102ef0 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.750+0000 7f6d3cff9640 1 -- 172.21.15.70:0/2241984698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6d380119d0 con 0x7f6d40102ef0 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d484d6740 1 Processor -- start 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d484d6740 1 -- start start 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd8e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd8ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 0x55bd5bd9b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d484d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bd5bcf42f0 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d484d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bd5bc9bcf0 con 0x55bd5bd99370 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d484d6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bd5bcf02b0 con 0x55bd5bd8fb40 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd8ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd8ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51300/0 (socket says 172.21.15.70:51300) 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3f7fe640 1 -- 172.21.15.70:0/1819807128 learned_addr learned my addr 172.21.15.70:0/1819807128 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3effd640 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 0x55bd5bd9b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3cff9640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6d280a33b0 0x7f6d280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3effd640 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd8e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3ffff640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6d280a33b0 0x7f6d280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3f7fe640 1 -- 172.21.15.70:0/1819807128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 msgr2=0x55bd5bd8e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd8e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3f7fe640 1 -- 172.21.15.70:0/1819807128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 msgr2=0x55bd5bd9b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 0x55bd5bd9b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3f7fe640 1 -- 172.21.15.70:0/1819807128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd5bc803a0 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.751+0000 7f6d3cff9640 1 -- 172.21.15.70:0/2241984698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f6d380cf360 con 0x7f6d40102ef0 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.752+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd8ea10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6d300099e0 tx=0x7f6d30009a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7012427fbd7b478 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.752+0000 7f6d25ffb640 1 -- 172.21.15.70:0/1819807128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d30034030 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.752+0000 7f6d3ffff640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6d280a33b0 0x7f6d280a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d3809b700 tx=0x7f6d3809f040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.752+0000 7f6d25ffb640 1 -- 172.21.15.70:0/1819807128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6d3002f920 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.752+0000 7f6d25ffb640 1 -- 172.21.15.70:0/1819807128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d300042a0 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.752+0000 7f6d484d6740 1 -- 172.21.15.70:0/1819807128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 msgr2=0x55bd5bd8ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.752+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd8ea10 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f6d300099e0 tx=0x7f6d30009a10 comp rx=0 tx=0).stop 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 -- 172.21.15.70:0/1819807128 shutdown_connections 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 0x55bd5bd9b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd8ea10 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1819807128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd8e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 -- 172.21.15.70:0/1819807128 >> 172.21.15.70:0/1819807128 conn(0x55bd5bd57310 msgr2=0x55bd5bd8ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 -- 172.21.15.70:0/1819807128 shutdown_connections 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 -- 172.21.15.70:0/1819807128 wait complete. 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 -- start start 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 Processor -- start 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd98d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd95fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd99370 0x55bd5bd96570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55bd5bd9bfb0 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55bd5bcaf060 con 0x55bd5bd8fb40 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55bd5bd9c130 con 0x55bd5bd99370 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d484d6740 10 client.0 _ll_register_callbacks cb 0x55bd5ba028c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.753+0000 7f6d3effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd98d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd98d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51310/0 (socket says 172.21.15.70:51310) 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3effd640 1 -- 172.21.15.70:0/1662254197 learned_addr learned my addr 172.21.15.70:0/1662254197 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd95fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3effd640 1 -- 172.21.15.70:0/1662254197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd99370 msgr2=0x55bd5bd96570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3effd640 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd99370 0x55bd5bd96570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3effd640 1 -- 172.21.15.70:0/1662254197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8fb40 msgr2=0x55bd5bd95fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3effd640 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd95fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3effd640 1 -- 172.21.15.70:0/1662254197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd5ba653c0 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d3effd640 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd98d20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005890 tx=0x7f6d34011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cfacce9375c1df8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d1effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d1effd640 1 -- 172.21.15.70:0/1662254197 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34012450 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d1effd640 1 -- 172.21.15.70:0/1662254197 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f6d340125f0 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d484d6740 1 -- 172.21.15.70:0/1662254197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d3002f920 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d1effd640 1 -- 172.21.15.70:0/1662254197 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d34027050 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d484d6740 10 client.16296 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d484d6740 1 -- 172.21.15.70:0/1662254197 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bd5bda7a60 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.754+0000 7f6d1effd640 1 -- 172.21.15.70:0/1662254197 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6d3002f920 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d1effd640 1 -- 172.21.15.70:0/1662254197 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6d3401e070 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d484d6740 10 client.16296 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d484d6740 10 client.16296 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d484d6740 20 client.16296 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bd5bda8e70 0x55bd5bdab2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d484d6740 4 client.16296 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d484d6740 1 -- 172.21.15.70:0/1662254197 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bd5bd01860 con 0x55bd5bda8e70 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bd5bda8e70 0x55bd5bdab2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d1effd640 10 client.16296 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.755+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bd5bda8e70 0x55bd5bdab2c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7cffaa46f60b55fc server_cookie=c6dbc059eef7047c in_seq=0 out_seq=0 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d1effd640 1 -- 172.21.15.70:0/1662254197 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55bd5bd01860 con 0x55bd5bda8e70 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d1effd640 10 client.16296 handle_command_reply: tid=0 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 client.16296 shutdown 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 -- 172.21.15.70:0/1662254197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 msgr2=0x55bd5bd98d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd98d20 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f6d34005890 tx=0x7f6d34011810 comp rx=0 tx=0).stop 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 -- 172.21.15.70:0/1662254197 shutdown_connections 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bd5bda8e70 0x55bd5bdab2c0 crc :-1 s=READY pgs=102 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd99370 0x55bd5bd96570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd95fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1662254197 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd98d20 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d1effd640 0 client.16296 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:23.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 -- 172.21.15.70:0/1662254197 >> 172.21.15.70:0/1662254197 conn(0x55bd5bd57310 msgr2=0x55bd5bd90960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:23.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 -- 172.21.15.70:0/1662254197 shutdown_connections 2024-09-19T04:36:23.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.756+0000 7f6d484d6740 1 -- 172.21.15.70:0/1662254197 wait complete. 2024-09-19T04:36:23.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.757+0000 7f6d484d6740 20 client.16296 trim_cache size 0 max 16384 2024-09-19T04:36:23.782 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.769+0000 7f6d484d6740 1 Processor -- start 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.769+0000 7f6d484d6740 1 -- start start 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bda5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bda17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd99370 0x55bd5bda1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d484d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d401b0220 con 0x55bd5bd99370 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d484d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d401ada30 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d484d6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d401ab880 con 0x55bd5bd8fb40 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd99370 0x55bd5bda1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd99370 0x55bd5bda1ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51320/0 (socket says 172.21.15.70:51320) 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 -- 172.21.15.70:0/1252027184 learned_addr learned my addr 172.21.15.70:0/1252027184 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 -- 172.21.15.70:0/1252027184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 msgr2=0x55bd5bda17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:23.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 --2- 172.21.15.70:0/1252027184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bda17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 -- 172.21.15.70:0/1252027184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8e5d0 msgr2=0x55bd5bda5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 --2- 172.21.15.70:0/1252027184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bda5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 -- 172.21.15.70:0/1252027184 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bd5bd99050 con 0x55bd5bd99370 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d3effd640 1 --2- 172.21.15.70:0/1252027184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd99370 0x55bd5bda1ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6d34004630 tx=0x7f6d34000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bcd3fac68e9d2168 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d257fa640 1 -- 172.21.15.70:0/1252027184 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34030070 con 0x55bd5bd99370 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d257fa640 1 -- 172.21.15.70:0/1252027184 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6d3401f500 con 0x55bd5bd99370 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.770+0000 7f6d257fa640 1 -- 172.21.15.70:0/1252027184 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d34012b80 con 0x55bd5bd99370 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 -- 172.21.15.70:0/1252027184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd99370 msgr2=0x55bd5bda1ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1252027184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd99370 0x55bd5bda1ce0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7f6d34004630 tx=0x7f6d34000bc0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 -- 172.21.15.70:0/1252027184 shutdown_connections 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1252027184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd99370 0x55bd5bda1ce0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1252027184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bda17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 --2- 172.21.15.70:0/1252027184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bda5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 -- 172.21.15.70:0/1252027184 >> 172.21.15.70:0/1252027184 conn(0x55bd5bd57310 msgr2=0x55bd5bd95860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 -- 172.21.15.70:0/1252027184 shutdown_connections 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 -- 172.21.15.70:0/1252027184 wait complete. 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.771+0000 7f6d484d6740 1 -- start start 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d484d6740 1 Processor -- start 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd90ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd90ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d484d6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 0x55bd5bd91530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d484d6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6d401abef0 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d484d6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6d401ad360 con 0x55bd5bd99370 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d484d6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6d401ac5c0 con 0x55bd5bd8fb40 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d484d6740 10 client.0 _ll_register_callbacks cb 0x7f6d3400cd50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:23.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd90ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd90ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51328/0 (socket says 172.21.15.70:51328) 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 -- 172.21.15.70:0/16438632 learned_addr learned my addr 172.21.15.70:0/16438632 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 -- 172.21.15.70:0/16438632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 msgr2=0x55bd5bd90ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd90ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd90ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 -- 172.21.15.70:0/16438632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 msgr2=0x55bd5bd91530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 0x55bd5bd91530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 -- 172.21.15.70:0/16438632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bd5be16b90 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd90ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d3effd640 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd90ab0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6d3401f9b0 tx=0x7f6d34014a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57eb46e4cf4b0dfa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.772+0000 7f6d1effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d1effd640 1 -- 172.21.15.70:0/16438632 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d3403c060 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d1effd640 1 -- 172.21.15.70:0/16438632 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f6d34012650 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 1 -- 172.21.15.70:0/16438632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6d3401f500 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d1effd640 1 -- 172.21.15.70:0/16438632 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f6d34030050 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 10 client.16302 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 1 -- 172.21.15.70:0/16438632 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55bd5be17e10 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d1effd640 1 -- 172.21.15.70:0/16438632 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6d3401f500 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d1effd640 1 -- 172.21.15.70:0/16438632 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f6d3401e040 con 0x55bd5bd8e5d0 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 10 client.16302 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 10 client.16302 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 20 client.16302 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bd5be184d0 0x55bd5be1a8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 4 client.16302 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.773+0000 7f6d484d6740 1 -- 172.21.15.70:0/16438632 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55bd5bcfbd70 con 0x55bd5be184d0 2024-09-19T04:36:23.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bd5be184d0 0x55bd5be1a8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d3f7fe640 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bd5be184d0 0x55bd5be1a8f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a41e5850f7f9aff3 server_cookie=6fb10f81641f7abf in_seq=0 out_seq=0 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d1effd640 10 client.16302 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d1effd640 1 -- 172.21.15.70:0/16438632 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55bd5bcfbd70 con 0x55bd5be184d0 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d1effd640 10 client.16302 handle_command_reply: tid=0 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 client.16302 shutdown 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 -- 172.21.15.70:0/16438632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 msgr2=0x55bd5bd90ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd90ab0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f6d3401f9b0 tx=0x7f6d34014a40 comp rx=0 tx=0).stop 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 -- 172.21.15.70:0/16438632 shutdown_connections 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55bd5be184d0 0x55bd5be1a8f0 crc :-1 s=READY pgs=103 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d1effd640 0 client.16302 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55bd5bd99370 0x55bd5bd91530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55bd5bd8fb40 0x55bd5bd90ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 --2- 172.21.15.70:0/16438632 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55bd5bd8e5d0 0x55bd5bd90ab0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.774+0000 7f6d484d6740 1 -- 172.21.15.70:0/16438632 >> 172.21.15.70:0/16438632 conn(0x55bd5bd57310 msgr2=0x55bd5bd94730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d484d6740 1 -- 172.21.15.70:0/16438632 shutdown_connections 2024-09-19T04:36:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d484d6740 1 -- 172.21.15.70:0/16438632 wait complete. 2024-09-19T04:36:23.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d484d6740 20 client.16302 trim_cache size 0 max 16384 2024-09-19T04:36:23.789 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 -- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6d280a33b0 msgr2=0x7f6d280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6d280a33b0 0x7f6d280a5870 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6d3809b700 tx=0x7f6d3809f040 comp rx=0 tx=0).stop 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 -- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40102ef0 msgr2=0x7f6d4019ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40102ef0 0x7f6d4019ce00 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f6d38009fd0 tx=0x7f6d3800b8e0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 -- 172.21.15.70:0/2241984698 shutdown_connections 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6d280a33b0 0x7f6d280a5870 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6d40102ef0 0x7f6d4019ce00 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6d40102570 0x7f6d40198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 --2- 172.21.15.70:0/2241984698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6d40100e20 0x7f6d40198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:23.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 -- 172.21.15.70:0/2241984698 >> 172.21.15.70:0/2241984698 conn(0x7f6d400fc7d0 msgr2=0x7f6d400febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 -- 172.21.15.70:0/2241984698 shutdown_connections 2024-09-19T04:36:23.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:23.775+0000 7f6d460fd640 1 -- 172.21.15.70:0/2241984698 wait complete. 2024-09-19T04:36:24.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:24 smithi070 ceph-mon[30942]: pgmap v172: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:24.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:24 smithi167 ceph-mon[34339]: pgmap v172: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:24 smithi134 ceph-mon[34525]: pgmap v172: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:25.459 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:36:25.459 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:36:25.719 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 -- 172.21.15.70:0/1237273292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130102570 msgr2=0x7fc1301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 --2- 172.21.15.70:0/1237273292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130102570 0x7fc1301029b0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fc120009900 tx=0x7fc12002a480 comp rx=0 tx=0).stop 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 -- 172.21.15.70:0/1237273292 shutdown_connections 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 --2- 172.21.15.70:0/1237273292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc130102ef0 0x7fc13010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 --2- 172.21.15.70:0/1237273292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130102570 0x7fc1301029b0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 --2- 172.21.15.70:0/1237273292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130100e20 0x7fc130101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 -- 172.21.15.70:0/1237273292 >> 172.21.15.70:0/1237273292 conn(0x7fc1300fc7d0 msgr2=0x7fc1300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 -- 172.21.15.70:0/1237273292 shutdown_connections 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.176+0000 7fc138218640 1 -- 172.21.15.70:0/1237273292 wait complete. 2024-09-19T04:36:26.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc138218640 1 Processor -- start 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc138218640 1 -- start start 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc138218640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130100e20 0x7fc1301974b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc138218640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130102570 0x7fc1301979f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc138218640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc130102ef0 0x7fc13019bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc138218640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc130110fb0 con 0x7fc130100e20 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc138218640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc130110e30 con 0x7fc130102ef0 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc138218640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc130111130 con 0x7fc130102570 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc135fb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130100e20 0x7fc1301974b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc135fb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130100e20 0x7fc1301974b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51354/0 (socket says 172.21.15.70:51354) 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc135fb4640 1 -- 172.21.15.70:0/2005231719 learned_addr learned my addr 172.21.15.70:0/2005231719 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc1357b3640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130102570 0x7fc1301979f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc135fb4640 1 -- 172.21.15.70:0/2005231719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130102570 msgr2=0x7fc1301979f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.195 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130102570 0x7fc1301979f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc135fb4640 1 -- 172.21.15.70:0/2005231719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc130102ef0 msgr2=0x7fc13019bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc1367b5640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc130102ef0 0x7fc13019bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.177+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc130102ef0 0x7fc13019bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.178+0000 7fc135fb4640 1 -- 172.21.15.70:0/2005231719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc13019c460 con 0x7fc130100e20 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.178+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130100e20 0x7fc1301974b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00d770 tx=0x7fc12c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.178+0000 7fc126ffd640 1 -- 172.21.15.70:0/2005231719 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c017070 con 0x7fc130100e20 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.178+0000 7fc126ffd640 1 -- 172.21.15.70:0/2005231719 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc12c0054f0 con 0x7fc130100e20 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.178+0000 7fc126ffd640 1 -- 172.21.15.70:0/2005231719 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c004d60 con 0x7fc130100e20 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.178+0000 7fc138218640 1 -- 172.21.15.70:0/2005231719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc13019c750 con 0x7fc130100e20 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.178+0000 7fc138218640 1 -- 172.21.15.70:0/2005231719 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc1301a4030 con 0x7fc130100e20 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.181+0000 7fc126ffd640 1 -- 172.21.15.70:0/2005231719 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc12c004f00 con 0x7fc130100e20 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.181+0000 7fc13a5f1740 1 Processor -- start 2024-09-19T04:36:26.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.181+0000 7fc13a5f1740 1 -- start start 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df780a00 0x5596df780de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 0x5596df78da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df790340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5596df6e6280 con 0x5596df78df50 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5596df68db10 con 0x5596df781320 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5596df6e2240 con 0x5596df780a00 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df790340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df790340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51356/0 (socket says 172.21.15.70:51356) 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 -- 172.21.15.70:0/382960622 learned_addr learned my addr 172.21.15.70:0/382960622 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc126ffd640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc11c0a33b0 0x7fc11c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1367b5640 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df780a00 0x5596df780de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 -- 172.21.15.70:0/382960622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df780a00 msgr2=0x5596df780de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:26.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df780a00 0x5596df780de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 -- 172.21.15.70:0/382960622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 msgr2=0x5596df78da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:26.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 0x5596df78da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 -- 172.21.15.70:0/382960622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596df69a1f0 con 0x5596df78df50 2024-09-19T04:36:26.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1367b5640 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df780a00 0x5596df780de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:26.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc126ffd640 1 -- 172.21.15.70:0/2005231719 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc12c0cf7a0 con 0x7fc130100e20 2024-09-19T04:36:26.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1367b5640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc11c0a33b0 0x7fc11c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc1357b3640 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df790340 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc120009900 tx=0x7fc120031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92fba263c0d87f38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.182+0000 7fc11bfff640 1 -- 172.21.15.70:0/382960622 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120040070 con 0x5596df78df50 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc1367b5640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc11c0a33b0 0x7fc11c0a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc128006a50 tx=0x7fc128004b50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc11bfff640 1 -- 172.21.15.70:0/382960622 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc1200316a0 con 0x5596df78df50 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc11bfff640 1 -- 172.21.15.70:0/382960622 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc120035040 con 0x5596df78df50 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 -- 172.21.15.70:0/382960622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 msgr2=0x5596df790340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df790340 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fc120009900 tx=0x7fc120031de0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 -- 172.21.15.70:0/382960622 shutdown_connections 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df790340 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 0x5596df78da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/382960622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df780a00 0x5596df780de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 -- 172.21.15.70:0/382960622 >> 172.21.15.70:0/382960622 conn(0x5596df77d0f0 msgr2=0x5596df77d4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 -- 172.21.15.70:0/382960622 shutdown_connections 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.183+0000 7fc13a5f1740 1 -- 172.21.15.70:0/382960622 wait complete. 2024-09-19T04:36:26.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 1 -- start start 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 1 Processor -- start 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df780a00 0x5596df78aef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 0x5596df78b430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df78b970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5596df790b20 con 0x5596df78df50 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5596df6a0f10 con 0x5596df780a00 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5596df790ca0 con 0x5596df781320 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc13a5f1740 10 client.0 _ll_register_callbacks cb 0x5596df669a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc1367b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df78b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc1367b5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df78b970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51366/0 (socket says 172.21.15.70:51366) 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc1367b5640 1 -- 172.21.15.70:0/2054604570 learned_addr learned my addr 172.21.15.70:0/2054604570 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:26.200 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.184+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df780a00 0x5596df78aef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1357b3640 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 0x5596df78b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1367b5640 1 -- 172.21.15.70:0/2054604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 msgr2=0x5596df78b430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1367b5640 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 0x5596df78b430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1367b5640 1 -- 172.21.15.70:0/2054604570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df780a00 msgr2=0x5596df78aef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1367b5640 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df780a00 0x5596df78aef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1367b5640 1 -- 172.21.15.70:0/2054604570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596df4576a0 con 0x5596df78df50 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1367b5640 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df78b970 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc128015a40 tx=0x7fc128004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94fa942f4a458897 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1197fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1197fa640 1 -- 172.21.15.70:0/2054604570 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc128012b50 con 0x5596df78df50 2024-09-19T04:36:26.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1197fa640 1 -- 172.21.15.70:0/2054604570 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc128012cf0 con 0x5596df78df50 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2054604570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc1200316a0 con 0x5596df78df50 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1197fa640 1 -- 172.21.15.70:0/2054604570 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc128013470 con 0x5596df78df50 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc13a5f1740 10 client.16314 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2054604570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596df79c7f0 con 0x5596df78df50 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.185+0000 7fc1197fa640 1 -- 172.21.15.70:0/2054604570 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc1200316a0 con 0x5596df78df50 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc1197fa640 1 -- 172.21.15.70:0/2054604570 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc128029070 con 0x5596df78df50 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc13a5f1740 10 client.16314 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc13a5f1740 10 client.16314 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc13a5f1740 20 client.16314 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5596df79dcb0 0x5596df7a00e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc13a5f1740 4 client.16314 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2054604570 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5596df6f37f0 con 0x5596df79dcb0 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5596df79dcb0 0x5596df7a00e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc1197fa640 10 client.16314 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.186+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5596df79dcb0 0x5596df7a00e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2ac25251cc6dc8 server_cookie=f43e87ea99a4160 in_seq=0 out_seq=0 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc1197fa640 1 -- 172.21.15.70:0/2054604570 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5596df6f37f0 con 0x5596df79dcb0 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc1197fa640 10 client.16314 handle_command_reply: tid=0 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 client.16314 shutdown 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2054604570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 msgr2=0x5596df78b970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df78b970 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fc128015a40 tx=0x7fc128004a40 comp rx=0 tx=0).stop 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2054604570 shutdown_connections 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5596df79dcb0 0x5596df7a00e0 crc :-1 s=READY pgs=104 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df78df50 0x5596df78b970 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 0x5596df78b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc1197fa640 0 client.16314 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2054604570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df780a00 0x5596df78aef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2054604570 >> 172.21.15.70:0/2054604570 conn(0x5596df77d0f0 msgr2=0x5596df77c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:26.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2054604570 shutdown_connections 2024-09-19T04:36:26.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.187+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2054604570 wait complete. 2024-09-19T04:36:26.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.188+0000 7fc13a5f1740 20 client.16314 trim_cache size 0 max 16384 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.205+0000 7fc13a5f1740 1 Processor -- start 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.205+0000 7fc13a5f1740 1 -- start start 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.205+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df78cd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 0x5596df7a59b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df78df50 0x5596df7a5ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301ae070 con 0x5596df780a00 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301ab880 con 0x5596df78df50 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301a96f0 con 0x5596df781320 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df78cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df78cd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51382/0 (socket says 172.21.15.70:51382) 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 -- 172.21.15.70:0/1785464586 learned_addr learned my addr 172.21.15.70:0/1785464586 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc1357b3640 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 0x5596df7a59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc1367b5640 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df78df50 0x5596df7a5ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 -- 172.21.15.70:0/1785464586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 msgr2=0x5596df7a59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 0x5596df7a59b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 -- 172.21.15.70:0/1785464586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df78df50 msgr2=0x5596df7a5ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df78df50 0x5596df7a5ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 -- 172.21.15.70:0/1785464586 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5596df789440 con 0x5596df780a00 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc1367b5640 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df78df50 0x5596df7a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc135fb4640 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df78cd50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc12c09b750 tx=0x7fc12c0cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b10af75249bd7824 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.206+0000 7fc11b7fe640 1 -- 172.21.15.70:0/1785464586 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c0b3070 con 0x5596df780a00 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc11b7fe640 1 -- 172.21.15.70:0/1785464586 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc12c09baa0 con 0x5596df780a00 2024-09-19T04:36:26.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc11b7fe640 1 -- 172.21.15.70:0/1785464586 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c020040 con 0x5596df780a00 2024-09-19T04:36:26.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 -- 172.21.15.70:0/1785464586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 msgr2=0x5596df78cd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df78cd50 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fc12c09b750 tx=0x7fc12c0cf040 comp rx=0 tx=0).stop 2024-09-19T04:36:26.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 -- 172.21.15.70:0/1785464586 shutdown_connections 2024-09-19T04:36:26.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df78df50 0x5596df7a5ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df781320 0x5596df7a59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/1785464586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df78cd50 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 -- 172.21.15.70:0/1785464586 >> 172.21.15.70:0/1785464586 conn(0x5596df77d0f0 msgr2=0x5596df78c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 -- 172.21.15.70:0/1785464586 shutdown_connections 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.207+0000 7fc13a5f1740 1 -- 172.21.15.70:0/1785464586 wait complete. 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 1 -- start start 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 1 Processor -- start 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df795f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 0x5596df796480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df78df50 0x5596df790ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301a9d40 con 0x5596df780a00 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301ab1b0 con 0x5596df781320 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc1301aa410 con 0x5596df78df50 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc13a5f1740 10 client.0 _ll_register_callbacks cb 0x7fc128008030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:26.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc135fb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df795f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc135fb4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df795f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51396/0 (socket says 172.21.15.70:51396) 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.208+0000 7fc135fb4640 1 -- 172.21.15.70:0/2611980913 learned_addr learned my addr 172.21.15.70:0/2611980913 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc1357b3640 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 0x5596df796480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc1367b5640 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df78df50 0x5596df790ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc135fb4640 1 -- 172.21.15.70:0/2611980913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df78df50 msgr2=0x5596df790ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df78df50 0x5596df790ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc135fb4640 1 -- 172.21.15.70:0/2611980913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 msgr2=0x5596df796480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 0x5596df796480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc135fb4640 1 -- 172.21.15.70:0/2611980913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5596df7856d0 con 0x5596df780a00 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc135fb4640 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df795f40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009f60 tx=0x7fc12c0ccf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cffbc5c774ffa7ff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc1197fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc1197fa640 1 -- 172.21.15.70:0/2611980913 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc12c014070 con 0x5596df780a00 2024-09-19T04:36:26.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc1197fa640 1 -- 172.21.15.70:0/2611980913 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc12c0cd190 con 0x5596df780a00 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2611980913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc12c09baa0 con 0x5596df780a00 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc1197fa640 1 -- 172.21.15.70:0/2611980913 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fc12c020070 con 0x5596df780a00 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc13a5f1740 10 client.16320 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.209+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2611980913 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5596df80b330 con 0x5596df780a00 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc1197fa640 1 -- 172.21.15.70:0/2611980913 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc12c09baa0 con 0x5596df780a00 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc1197fa640 1 -- 172.21.15.70:0/2611980913 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fc12c0ba2f0 con 0x5596df780a00 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc13a5f1740 10 client.16320 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc13a5f1740 10 client.16320 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc13a5f1740 20 client.16320 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5596df80b9d0 0x5596df80ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc13a5f1740 4 client.16320 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2611980913 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5596df6edd00 con 0x5596df80b9d0 2024-09-19T04:36:26.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc1357b3640 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5596df80b9d0 0x5596df80ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:26.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc1197fa640 10 client.16320 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:26.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.210+0000 7fc1357b3640 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5596df80b9d0 0x5596df80ddf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed1797211b2b57df server_cookie=6f173db6814df473 in_seq=0 out_seq=0 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc1197fa640 1 -- 172.21.15.70:0/2611980913 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5596df6edd00 con 0x5596df80b9d0 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc1197fa640 10 client.16320 handle_command_reply: tid=0 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 client.16320 shutdown 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2611980913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 msgr2=0x5596df795f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df795f40 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fc12c009f60 tx=0x7fc12c0ccf00 comp rx=0 tx=0).stop 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2611980913 shutdown_connections 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5596df80b9d0 0x5596df80ddf0 crc :-1 s=READY pgs=105 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5596df78df50 0x5596df790ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5596df781320 0x5596df796480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc1197fa640 0 client.16320 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 --2- 172.21.15.70:0/2611980913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5596df780a00 0x5596df795f40 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2611980913 >> 172.21.15.70:0/2611980913 conn(0x5596df77d0f0 msgr2=0x5596df77c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:26.217 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2611980913 shutdown_connections 2024-09-19T04:36:26.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 1 -- 172.21.15.70:0/2611980913 wait complete. 2024-09-19T04:36:26.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.212+0000 7fc13a5f1740 20 client.16320 trim_cache size 0 max 16384 2024-09-19T04:36:26.218 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:26.218 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:36:26.218 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "d792881a-0fdd-4da6-8380-e9895fa8528e", 2024-09-19T04:36:26.218 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:36:26.218 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 -- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc11c0a33b0 msgr2=0x7fc11c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc11c0a33b0 0x7fc11c0a5870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7fc128006a50 tx=0x7fc128004b50 comp rx=0 tx=0).stop 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 -- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130100e20 msgr2=0x7fc1301974b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130100e20 0x7fc1301974b0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc12c00d770 tx=0x7fc12c00dc30 comp rx=0 tx=0).stop 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 -- 172.21.15.70:0/2005231719 shutdown_connections 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc11c0a33b0 0x7fc11c0a5870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc130102ef0 0x7fc13019bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc130102570 0x7fc1301979f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 --2- 172.21.15.70:0/2005231719 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc130100e20 0x7fc1301974b0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:26.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 -- 172.21.15.70:0/2005231719 >> 172.21.15.70:0/2005231719 conn(0x7fc1300fc7d0 msgr2=0x7fc1300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:26.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 -- 172.21.15.70:0/2005231719 shutdown_connections 2024-09-19T04:36:26.220 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:26.213+0000 7fc138218640 1 -- 172.21.15.70:0/2005231719 wait complete. 2024-09-19T04:36:26.918 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:36:26.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:26 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:36:26.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:26 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:26.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:26 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:36:26.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:26 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:26.940 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:26 smithi070 ceph-mon[30942]: pgmap v173: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:26.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:26 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:36:26.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:26 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:26.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:26 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:36:26.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:26 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:26.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:26 smithi167 ceph-mon[34339]: pgmap v173: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:26 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:36:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:26 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:26 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:36:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:26 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:26 smithi134 ceph-mon[34525]: pgmap v173: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:27.169 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 -- 172.21.15.70:0/1537685812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5434102360 msgr2=0x7f543410e890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 --2- 172.21.15.70:0/1537685812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5434102360 0x7f543410e890 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f542c009cd0 tx=0x7f542c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 -- 172.21.15.70:0/1537685812 shutdown_connections 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 --2- 172.21.15.70:0/1537685812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5434102360 0x7f543410e890 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 --2- 172.21.15.70:0/1537685812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f54341019c0 0x7f5434101e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 --2- 172.21.15.70:0/1537685812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54341079c0 0x7f5434107da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 -- 172.21.15.70:0/1537685812 >> 172.21.15.70:0/1537685812 conn(0x7f54340fd6e0 msgr2=0x7f54340ffb00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 -- 172.21.15.70:0/1537685812 shutdown_connections 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 -- 172.21.15.70:0/1537685812 wait complete. 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 Processor -- start 2024-09-19T04:36:27.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.666+0000 7f543ada1640 1 -- start start 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543ada1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341019c0 0x7f54341981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543ada1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5434102360 0x7f5434198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543ada1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54341079c0 0x7f543419caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543ada1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5434111dd0 con 0x7f54341019c0 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543ada1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5434111c50 con 0x7f5434102360 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543ada1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5434111f50 con 0x7f54341079c0 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341019c0 0x7f54341981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341019c0 0x7f54341981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51412/0 (socket says 172.21.15.70:51412) 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 -- 172.21.15.70:0/213315454 learned_addr learned my addr 172.21.15.70:0/213315454 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543959e640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5434102360 0x7f5434198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543a5a0640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54341079c0 0x7f543419caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 -- 172.21.15.70:0/213315454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54341079c0 msgr2=0x7f543419caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54341079c0 0x7f543419caa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 -- 172.21.15.70:0/213315454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5434102360 msgr2=0x7f5434198710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5434102360 0x7f5434198710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 -- 172.21.15.70:0/213315454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f543419d180 con 0x7f54341019c0 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f5439d9f640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341019c0 0x7f54341981d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f543000b4a0 tx=0x7f543000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f542affd640 1 -- 172.21.15.70:0/213315454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430015020 con 0x7f54341019c0 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f543ada1640 1 -- 172.21.15.70:0/213315454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f543419d470 con 0x7f54341019c0 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f542affd640 1 -- 172.21.15.70:0/213315454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5430011d00 con 0x7f54341019c0 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.667+0000 7f542affd640 1 -- 172.21.15.70:0/213315454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430010e50 con 0x7f54341019c0 2024-09-19T04:36:27.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.668+0000 7f543ada1640 1 -- 172.21.15.70:0/213315454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f54341a4d50 con 0x7f54341019c0 2024-09-19T04:36:27.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.670+0000 7f542affd640 1 -- 172.21.15.70:0/213315454 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5430018020 con 0x7f54341019c0 2024-09-19T04:36:27.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.670+0000 7f543e3dc740 1 Processor -- start 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.670+0000 7f543e3dc740 1 -- start start 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.670+0000 7f542affd640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f54200a3550 0x7f54200a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1dd7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de6720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1de9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543e3dc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ffe1d3d2e0 con 0x55ffe1dd7530 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543e3dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ffe1ce4ce0 con 0x55ffe1dd7e50 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543e3dc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ffe1d392a0 con 0x55ffe1de6c60 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f542affd640 1 -- 172.21.15.70:0/213315454 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f54300cf4e0 con 0x7f54341019c0 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1dd7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543a5a0640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f54200a3550 0x7f54200a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1dd7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51416/0 (socket says 172.21.15.70:51416) 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 -- 172.21.15.70:0/3723663234 learned_addr learned my addr 172.21.15.70:0/3723663234 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543959e640 1 --2- 172.21.15.70:0/3723663234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de6720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 -- 172.21.15.70:0/3723663234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 msgr2=0x55ffe1de9050 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 --2- 172.21.15.70:0/3723663234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1de9050 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 -- 172.21.15.70:0/3723663234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7e50 msgr2=0x55ffe1de6720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 --2- 172.21.15.70:0/3723663234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de6720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 -- 172.21.15.70:0/3723663234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffe1cc9440 con 0x55ffe1dd7530 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f5439d9f640 1 --2- 172.21.15.70:0/3723663234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1dd7910 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f543000b470 tx=0x7f54300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a132008faec04a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f543a5a0640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f54200a3550 0x7f54200a5a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f542c006010 tx=0x7f542c0093f0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f541ffff640 1 -- 172.21.15.70:0/3723663234 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5430012500 con 0x55ffe1dd7530 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f541ffff640 1 -- 172.21.15.70:0/3723663234 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5430010510 con 0x55ffe1dd7530 2024-09-19T04:36:27.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.671+0000 7f541ffff640 1 -- 172.21.15.70:0/3723663234 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300092b0 con 0x55ffe1dd7530 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 -- 172.21.15.70:0/3723663234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 msgr2=0x55ffe1dd7910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 --2- 172.21.15.70:0/3723663234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1dd7910 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f543000b470 tx=0x7f54300046c0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 -- 172.21.15.70:0/3723663234 shutdown_connections 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 --2- 172.21.15.70:0/3723663234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1de9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 --2- 172.21.15.70:0/3723663234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de6720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 --2- 172.21.15.70:0/3723663234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1dd7910 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 -- 172.21.15.70:0/3723663234 >> 172.21.15.70:0/3723663234 conn(0x55ffe1dd3c00 msgr2=0x55ffe1dd3fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 -- 172.21.15.70:0/3723663234 shutdown_connections 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.672+0000 7f543e3dc740 1 -- 172.21.15.70:0/3723663234 wait complete. 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 1 -- start start 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 1 Processor -- start 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1de6620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de38d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1de3ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ffe1de9830 con 0x55ffe1dd7e50 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ffe1cf8050 con 0x55ffe1dd7530 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ffe1de99b0 con 0x55ffe1de6c60 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543e3dc740 10 client.0 _ll_register_callbacks cb 0x55ffe1d38160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f543959e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de38d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.673+0000 7f5439d9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1de6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f5439d9f640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1de6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:49040/0 (socket says 172.21.15.70:49040) 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f5439d9f640 1 -- 172.21.15.70:0/201637764 learned_addr learned my addr 172.21.15.70:0/201637764 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f543959e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de38d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51426/0 (socket says 172.21.15.70:51426) 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f543a5a0640 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1de3ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f5439d9f640 1 -- 172.21.15.70:0/201637764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 msgr2=0x55ffe1de3ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:27.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f5439d9f640 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1de3ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f5439d9f640 1 -- 172.21.15.70:0/201637764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 msgr2=0x55ffe1de38d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:27.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f5439d9f640 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de38d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f5439d9f640 1 -- 172.21.15.70:0/201637764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffe1aae3c0 con 0x55ffe1dd7530 2024-09-19T04:36:27.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f5439d9f640 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1de6620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54300a4030 tx=0x7f5430007e30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89b5845eb136f79d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:27.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.674+0000 7f541d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:36:27.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.679+0000 7f541d7fa640 1 -- 172.21.15.70:0/201637764 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54300b8020 con 0x55ffe1dd7530 2024-09-19T04:36:27.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f541d7fa640 1 -- 172.21.15.70:0/201637764 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f5430097f60 con 0x55ffe1dd7530 2024-09-19T04:36:27.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 1 -- 172.21.15.70:0/201637764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55ffe1d4a850 con 0x55ffe1dd7530 2024-09-19T04:36:27.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f541d7fa640 1 -- 172.21.15.70:0/201637764 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f5430011eb0 con 0x55ffe1dd7530 2024-09-19T04:36:27.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 10 client.25577 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:27.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 1 -- 172.21.15.70:0/201637764 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ffe1de9830 con 0x55ffe1dd7530 2024-09-19T04:36:27.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f541d7fa640 1 -- 172.21.15.70:0/201637764 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55ffe1d4a850 con 0x55ffe1dd7530 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f541d7fa640 1 -- 172.21.15.70:0/201637764 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f5430012090 con 0x55ffe1dd7530 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 10 client.25577 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 10 client.25577 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 20 client.25577 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ffe1df6410 0x55ffe1df8800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 4 client.25577 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.680+0000 7f543e3dc740 1 -- 172.21.15.70:0/201637764 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ffe1d44d60 con 0x55ffe1df6410 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.681+0000 7f543959e640 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ffe1df6410 0x55ffe1df8800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.681+0000 7f541d7fa640 10 client.25577 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:27.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.681+0000 7f543959e640 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ffe1df6410 0x55ffe1df8800 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=49efd4f919504d6a server_cookie=5b5b7557357d161a in_seq=0 out_seq=0 2024-09-19T04:36:27.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f541d7fa640 1 -- 172.21.15.70:0/201637764 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ffe1d44d60 con 0x55ffe1df6410 2024-09-19T04:36:27.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f541d7fa640 10 client.25577 handle_command_reply: tid=0 2024-09-19T04:36:27.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 client.25577 shutdown 2024-09-19T04:36:27.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 -- 172.21.15.70:0/201637764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 msgr2=0x55ffe1de6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1de6620 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f54300a4030 tx=0x7f5430007e30 comp rx=0 tx=0).stop 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 -- 172.21.15.70:0/201637764 shutdown_connections 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ffe1df6410 0x55ffe1df8800 crc :-1 s=READY pgs=106 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1de3ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1de38d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 --2- 172.21.15.70:0/201637764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1de6620 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 -- 172.21.15.70:0/201637764 >> 172.21.15.70:0/201637764 conn(0x55ffe1dd3c00 msgr2=0x55ffe1dd9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f541d7fa640 0 client.25577 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 -- 172.21.15.70:0/201637764 shutdown_connections 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 1 -- 172.21.15.70:0/201637764 wait complete. 2024-09-19T04:36:27.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.682+0000 7f543e3dc740 20 client.25577 trim_cache size 0 max 16384 2024-09-19T04:36:27.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543e3dc740 1 Processor -- start 2024-09-19T04:36:27.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543e3dc740 1 -- start start 2024-09-19T04:36:27.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1df2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1dfdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1dfe3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543e3dc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54341add30 con 0x55ffe1dd7e50 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543e3dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f54341ab540 con 0x55ffe1dd7530 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543e3dc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54341a9390 con 0x55ffe1de6c60 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1dfdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1dfdeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51434/0 (socket says 172.21.15.70:51434) 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 -- 172.21.15.70:0/1741688458 learned_addr learned my addr 172.21.15.70:0/1741688458 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 -- 172.21.15.70:0/1741688458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 msgr2=0x55ffe1dfe3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 --2- 172.21.15.70:0/1741688458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1dfe3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 -- 172.21.15.70:0/1741688458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 msgr2=0x55ffe1df2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f5439d9f640 1 --2- 172.21.15.70:0/1741688458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1df2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 --2- 172.21.15.70:0/1741688458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1df2ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 -- 172.21.15.70:0/1741688458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ffe1dd38d0 con 0x55ffe1dd7e50 2024-09-19T04:36:27.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.699+0000 7f543959e640 1 --2- 172.21.15.70:0/1741688458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1dfdeb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5434106f20 tx=0x7f5424013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f5eb1428615eecb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:27.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f541f7fe640 1 -- 172.21.15.70:0/1741688458 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f54240130d0 con 0x55ffe1dd7e50 2024-09-19T04:36:27.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f541f7fe640 1 -- 172.21.15.70:0/1741688458 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5424013270 con 0x55ffe1dd7e50 2024-09-19T04:36:27.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f541f7fe640 1 -- 172.21.15.70:0/1741688458 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5424011900 con 0x55ffe1dd7e50 2024-09-19T04:36:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 -- 172.21.15.70:0/1741688458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 msgr2=0x55ffe1dfdeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 --2- 172.21.15.70:0/1741688458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1dfdeb0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f5434106f20 tx=0x7f5424013830 comp rx=0 tx=0).stop 2024-09-19T04:36:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 -- 172.21.15.70:0/1741688458 shutdown_connections 2024-09-19T04:36:27.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 --2- 172.21.15.70:0/1741688458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1de6c60 0x55ffe1dfe3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 --2- 172.21.15.70:0/1741688458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7e50 0x55ffe1dfdeb0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 --2- 172.21.15.70:0/1741688458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1dd7530 0x55ffe1df2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 -- 172.21.15.70:0/1741688458 >> 172.21.15.70:0/1741688458 conn(0x55ffe1dd3c00 msgr2=0x55ffe1ddeee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 -- 172.21.15.70:0/1741688458 shutdown_connections 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.700+0000 7f543e3dc740 1 -- 172.21.15.70:0/1741688458 wait complete. 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 1 -- start start 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 1 Processor -- start 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1deec40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1dd7e50 0x55ffe1def180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1de6c60 0x55ffe1ddfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f54341a9a00 con 0x55ffe1dd7530 2024-09-19T04:36:27.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f54341aae70 con 0x55ffe1de6c60 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f54341aa0d0 con 0x55ffe1dd7e50 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543e3dc740 10 client.0 _ll_register_callbacks cb 0x7f543009b430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f5439d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1deec40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f5439d9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1deec40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51444/0 (socket says 172.21.15.70:51444) 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f5439d9f640 1 -- 172.21.15.70:0/4063009196 learned_addr learned my addr 172.21.15.70:0/4063009196 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543959e640 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1dd7e50 0x55ffe1def180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543a5a0640 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1de6c60 0x55ffe1ddfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f5439d9f640 1 -- 172.21.15.70:0/4063009196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1dd7e50 msgr2=0x55ffe1def180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f5439d9f640 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1dd7e50 0x55ffe1def180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f5439d9f640 1 -- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1de6c60 msgr2=0x55ffe1ddfc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f5439d9f640 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1de6c60 0x55ffe1ddfc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f5439d9f640 1 -- 172.21.15.70:0/4063009196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ffe1def840 con 0x55ffe1dd7530 2024-09-19T04:36:27.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.701+0000 7f543a5a0640 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1de6c60 0x55ffe1ddfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f5439d9f640 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1deec40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f54300cd250 tx=0x7f54300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58fdf5652dfd41b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f541d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f541d7fa640 1 -- 172.21.15.70:0/4063009196 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f543007e060 con 0x55ffe1dd7530 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f541d7fa640 1 -- 172.21.15.70:0/4063009196 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f54300cce10 con 0x55ffe1dd7530 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 1 -- 172.21.15.70:0/4063009196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5424013270 con 0x55ffe1dd7530 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f541d7fa640 1 -- 172.21.15.70:0/4063009196 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f54300b8070 con 0x55ffe1dd7530 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 10 client.16338 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 1 -- 172.21.15.70:0/4063009196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55ffe1e60450 con 0x55ffe1dd7530 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f541d7fa640 1 -- 172.21.15.70:0/4063009196 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5424013270 con 0x55ffe1dd7530 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f541d7fa640 1 -- 172.21.15.70:0/4063009196 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f5430060bb0 con 0x55ffe1dd7530 2024-09-19T04:36:27.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 10 client.16338 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 10 client.16338 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 20 client.16338 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ffe1e60a10 0x55ffe1e62e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 4 client.16338 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.702+0000 7f543e3dc740 1 -- 172.21.15.70:0/4063009196 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ffe1cc1210 con 0x55ffe1e60a10 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f543959e640 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ffe1e60a10 0x55ffe1e62e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f543959e640 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ffe1e60a10 0x55ffe1e62e30 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=16c17e9b17b842cc server_cookie=f222243ff66f0501 in_seq=0 out_seq=0 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f541d7fa640 10 client.16338 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f541d7fa640 1 -- 172.21.15.70:0/4063009196 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ffe1cc1210 con 0x55ffe1e60a10 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f541d7fa640 10 client.16338 handle_command_reply: tid=0 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f543e3dc740 1 client.16338 shutdown 2024-09-19T04:36:27.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f543e3dc740 1 -- 172.21.15.70:0/4063009196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 msgr2=0x55ffe1deec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f543e3dc740 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1deec40 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f54300cd250 tx=0x7f54300046c0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f543e3dc740 1 -- 172.21.15.70:0/4063009196 shutdown_connections 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f543e3dc740 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ffe1e60a10 0x55ffe1e62e30 crc :-1 s=READY pgs=107 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.703+0000 7f543e3dc740 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ffe1de6c60 0x55ffe1ddfc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543e3dc740 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ffe1dd7e50 0x55ffe1def180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f541d7fa640 0 client.16338 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543e3dc740 1 --2- 172.21.15.70:0/4063009196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ffe1dd7530 0x55ffe1deec40 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543e3dc740 1 -- 172.21.15.70:0/4063009196 >> 172.21.15.70:0/4063009196 conn(0x55ffe1dd3c00 msgr2=0x55ffe1de5130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543e3dc740 1 -- 172.21.15.70:0/4063009196 shutdown_connections 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543e3dc740 1 -- 172.21.15.70:0/4063009196 wait complete. 2024-09-19T04:36:27.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543e3dc740 20 client.16338 trim_cache size 0 max 16384 2024-09-19T04:36:27.712 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:36:27.712 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:36:27.712 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:27.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 -- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f54200a3550 msgr2=0x7f54200a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f54200a3550 0x7f54200a5a10 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f542c006010 tx=0x7f542c0093f0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 -- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341019c0 msgr2=0x7f54341981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341019c0 0x7f54341981d0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f543000b4a0 tx=0x7f543000b8a0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 -- 172.21.15.70:0/213315454 shutdown_connections 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f54200a3550 0x7f54200a5a10 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f54341079c0 0x7f543419caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5434102360 0x7f5434198710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 --2- 172.21.15.70:0/213315454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f54341019c0 0x7f54341981d0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 -- 172.21.15.70:0/213315454 >> 172.21.15.70:0/213315454 conn(0x7f54340fd6e0 msgr2=0x7f54340fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 -- 172.21.15.70:0/213315454 shutdown_connections 2024-09-19T04:36:27.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:27.704+0000 7f543ada1640 1 -- 172.21.15.70:0/213315454 wait complete. 2024-09-19T04:36:27.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:27 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:36:27.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:27 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:36:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:27 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:36:28.334 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:36:28.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:36:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:28.936 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:28 smithi134 ceph-mon[34525]: pgmap v174: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:28.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:28 smithi167 ceph-mon[34339]: pgmap v174: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:29.052 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:28 smithi070 ceph-mon[30942]: pgmap v174: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 -- 172.21.15.70:0/1918715272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880112b90 msgr2=0x7fc880114f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 --2- 172.21.15.70:0/1918715272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880112b90 0x7fc880114f80 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fc878009ca0 tx=0x7fc87802a950 comp rx=0 tx=0).stop 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 -- 172.21.15.70:0/1918715272 shutdown_connections 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 --2- 172.21.15.70:0/1918715272 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880112b90 0x7fc880114f80 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 --2- 172.21.15.70:0/1918715272 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc880074eb0 0x7fc880112650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 --2- 172.21.15.70:0/1918715272 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc880074590 0x7fc880074970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 -- 172.21.15.70:0/1918715272 >> 172.21.15.70:0/1918715272 conn(0x7fc8800fd8c0 msgr2=0x7fc8800ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 -- 172.21.15.70:0/1918715272 shutdown_connections 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.130+0000 7fc886a76640 1 -- 172.21.15.70:0/1918715272 wait complete. 2024-09-19T04:36:29.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc886a76640 1 Processor -- start 2024-09-19T04:36:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc886a76640 1 -- start start 2024-09-19T04:36:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc886a76640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc880074590 0x7fc8801a4700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc886a76640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880074eb0 0x7fc8801a4c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc886a76640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc880112b90 0x7fc88019e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc886a76640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc8801185a0 con 0x7fc880074eb0 2024-09-19T04:36:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc886a76640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc880118420 con 0x7fc880112b90 2024-09-19T04:36:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc886a76640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc880118720 con 0x7fc880074590 2024-09-19T04:36:29.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc877fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880074eb0 0x7fc8801a4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:29.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc877fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880074eb0 0x7fc8801a4c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51456/0 (socket says 172.21.15.70:51456) 2024-09-19T04:36:29.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc877fff640 1 -- 172.21.15.70:0/3841590918 learned_addr learned my addr 172.21.15.70:0/3841590918 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:29.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc885013640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc880112b90 0x7fc88019e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:29.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.131+0000 7fc884812640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc880074590 0x7fc8801a4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:29.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc877fff640 1 -- 172.21.15.70:0/3841590918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc880074590 msgr2=0x7fc8801a4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc877fff640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc880074590 0x7fc8801a4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc877fff640 1 -- 172.21.15.70:0/3841590918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc880112b90 msgr2=0x7fc88019e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc877fff640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc880112b90 0x7fc88019e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc877fff640 1 -- 172.21.15.70:0/3841590918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc88019eff0 con 0x7fc880074eb0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc877fff640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880074eb0 0x7fc8801a4c40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc87000b4a0 tx=0x7fc87000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc875ffb640 1 -- 172.21.15.70:0/3841590918 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870014070 con 0x7fc880074eb0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc88019f2e0 con 0x7fc880074eb0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc875ffb640 1 -- 172.21.15.70:0/3841590918 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc870010ae0 con 0x7fc880074eb0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc875ffb640 1 -- 172.21.15.70:0/3841590918 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc870017c70 con 0x7fc880074eb0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.132+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc8801ab5d0 con 0x7fc880074eb0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.133+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc880074970 con 0x7fc880074eb0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.135+0000 7fc875ffb640 1 -- 172.21.15.70:0/3841590918 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc870017070 con 0x7fc880074eb0 2024-09-19T04:36:29.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.135+0000 7fc875ffb640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8680a3430 0x7fc8680a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.136+0000 7fc875ffb640 1 -- 172.21.15.70:0/3841590918 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fc8700cf730 con 0x7fc880074eb0 2024-09-19T04:36:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.136+0000 7fc884812640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8680a3430 0x7fc8680a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.136+0000 7fc884812640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8680a3430 0x7fc8680a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc87c005fd0 tx=0x7fc87c005850 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:29.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.139+0000 7fc875ffb640 1 -- 172.21.15.70:0/3841590918 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc87009c1e0 con 0x7fc880074eb0 2024-09-19T04:36:29.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.338+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc88019fdf0 con 0x7fc880074eb0 2024-09-19T04:36:29.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.339+0000 7fc875ffb640 1 -- 172.21.15.70:0/3841590918 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7fc88019fdf0 con 0x7fc880074eb0 2024-09-19T04:36:29.341 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:36:29.341 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"btime":"2024-09-19T04:36:22:647262+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:36:22.597170+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:36:29.341 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2024-09-19T04:36:29.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8680a3430 msgr2=0x7fc8680a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:29.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8680a3430 0x7fc8680a58f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fc87c005fd0 tx=0x7fc87c005850 comp rx=0 tx=0).stop 2024-09-19T04:36:29.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880074eb0 msgr2=0x7fc8801a4c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:29.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880074eb0 0x7fc8801a4c40 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fc87000b4a0 tx=0x7fc87000b960 comp rx=0 tx=0).stop 2024-09-19T04:36:29.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 shutdown_connections 2024-09-19T04:36:29.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8680a3430 0x7fc8680a58f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc880112b90 0x7fc88019e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc880074eb0 0x7fc8801a4c40 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 --2- 172.21.15.70:0/3841590918 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc880074590 0x7fc8801a4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:29.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.341+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 >> 172.21.15.70:0/3841590918 conn(0x7fc8800fd8c0 msgr2=0x7fc8800ff0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:29.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.342+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 shutdown_connections 2024-09-19T04:36:29.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:29.342+0000 7fc886a76640 1 -- 172.21.15.70:0/3841590918 wait complete. 2024-09-19T04:36:29.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:29 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3841590918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:30.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:29 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3841590918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:30.048 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:29 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3841590918' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:30.076 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:36:30.320 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:30.694 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:30 smithi070 ceph-mon[30942]: pgmap v175: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:30.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.772+0000 7fd9072cc640 1 -- 172.21.15.70:0/3998659212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 msgr2=0x7fd900107b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.772+0000 7fd9072cc640 1 --2- 172.21.15.70:0/3998659212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 0x7fd900107b80 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc009930 tx=0x7fd8fc02a420 comp rx=0 tx=0).stop 2024-09-19T04:36:30.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 -- 172.21.15.70:0/3998659212 shutdown_connections 2024-09-19T04:36:30.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 --2- 172.21.15.70:0/3998659212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd900108290 0x7fd90010ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 --2- 172.21.15.70:0/3998659212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 0x7fd900107b80 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 --2- 172.21.15.70:0/3998659212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900102d90 0x7fd900103170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 -- 172.21.15.70:0/3998659212 >> 172.21.15.70:0/3998659212 conn(0x7fd9000fc7d0 msgr2=0x7fd9000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:30.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 -- 172.21.15.70:0/3998659212 shutdown_connections 2024-09-19T04:36:30.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 -- 172.21.15.70:0/3998659212 wait complete. 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 Processor -- start 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 -- start start 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900102d90 0x7fd900198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 0x7fd900198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd900108290 0x7fd90019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd900112060 con 0x7fd900103740 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd900111ee0 con 0x7fd900108290 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.773+0000 7fd9072cc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001121e0 con 0x7fd900102d90 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 0x7fd900198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 0x7fd900198b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51478/0 (socket says 172.21.15.70:51478) 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 -- 172.21.15.70:0/2548107677 learned_addr learned my addr 172.21.15.70:0/2548107677 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd905068640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900102d90 0x7fd900198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd905869640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd900108290 0x7fd90019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 -- 172.21.15.70:0/2548107677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900102d90 msgr2=0x7fd900198600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900102d90 0x7fd900198600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 -- 172.21.15.70:0/2548107677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd900108290 msgr2=0x7fd90019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd900108290 0x7fd90019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 -- 172.21.15.70:0/2548107677 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd90019d5b0 con 0x7fd900103740 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd905869640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd900108290 0x7fd90019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:30.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd904867640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 0x7fd900198b40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc005940 tx=0x7fd8fc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:30.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd8f27fc640 1 -- 172.21.15.70:0/2548107677 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc03f030 con 0x7fd900103740 2024-09-19T04:36:30.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd8f27fc640 1 -- 172.21.15.70:0/2548107677 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8fc003ac0 con 0x7fd900103740 2024-09-19T04:36:30.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd9072cc640 1 -- 172.21.15.70:0/2548107677 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd90019d840 con 0x7fd900103740 2024-09-19T04:36:30.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd8f27fc640 1 -- 172.21.15.70:0/2548107677 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc035070 con 0x7fd900103740 2024-09-19T04:36:30.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.774+0000 7fd9072cc640 1 -- 172.21.15.70:0/2548107677 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd900100920 con 0x7fd900103740 2024-09-19T04:36:30.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.777+0000 7fd8f27fc640 1 -- 172.21.15.70:0/2548107677 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd8fc042030 con 0x7fd900103740 2024-09-19T04:36:30.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.777+0000 7fd9096a5740 1 Processor -- start 2024-09-19T04:36:30.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.777+0000 7fd9096a5740 1 -- start start 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90ab40 0x55b7ca909090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca909a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 0x55b7ca916760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd9096a5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b7ca86f2f0 con 0x55b7ca9095d0 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd9096a5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b7ca816cf0 con 0x55b7ca90ab40 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd9096a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b7ca86b2b0 con 0x55b7ca914370 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd8f27fc640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8ec0a33b0 0x7fd8ec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca909a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca909a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51494/0 (socket says 172.21.15.70:51494) 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 -- 172.21.15.70:0/2279188857 learned_addr learned my addr 172.21.15.70:0/2279188857 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:30.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905869640 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90ab40 0x55b7ca909090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905869640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8ec0a33b0 0x7fd8ec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd8f27fc640 1 -- 172.21.15.70:0/2548107677 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd8fc0f03e0 con 0x7fd900103740 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd904867640 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 0x55b7ca916760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 -- 172.21.15.70:0/2279188857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 msgr2=0x55b7ca916760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 0x55b7ca916760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 -- 172.21.15.70:0/2279188857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90ab40 msgr2=0x55b7ca909090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90ab40 0x55b7ca909090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 -- 172.21.15.70:0/2279188857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ca7fb3a0 con 0x55b7ca9095d0 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905068640 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca909a10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400ac10 tx=0x7fd8f400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e9f929bc226f8a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd905869640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8ec0a33b0 0x7fd8ec0a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8005fd0 tx=0x7fd8f8005c80 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.778+0000 7fd8eb7fe640 1 -- 172.21.15.70:0/2279188857 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f401d070 con 0x55b7ca9095d0 2024-09-19T04:36:30.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd8eb7fe640 1 -- 172.21.15.70:0/2279188857 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8f4018b10 con 0x55b7ca9095d0 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd8eb7fe640 1 -- 172.21.15.70:0/2279188857 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4010b20 con 0x55b7ca9095d0 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 -- 172.21.15.70:0/2279188857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 msgr2=0x55b7ca909a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca909a10 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400ac10 tx=0x7fd8f400f790 comp rx=0 tx=0).stop 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 -- 172.21.15.70:0/2279188857 shutdown_connections 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 0x55b7ca916760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca909a10 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 --2- 172.21.15.70:0/2279188857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90ab40 0x55b7ca909090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 -- 172.21.15.70:0/2279188857 >> 172.21.15.70:0/2279188857 conn(0x55b7ca8d2310 msgr2=0x55b7ca905c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 -- 172.21.15.70:0/2279188857 shutdown_connections 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.779+0000 7fd9096a5740 1 -- 172.21.15.70:0/2279188857 wait complete. 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 1 -- start start 2024-09-19T04:36:30.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 1 Processor -- start 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca9095d0 0x55b7ca913d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca90ab40 0x55b7ca910ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 0x55b7ca9115e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b7ca917070 con 0x55b7ca90ab40 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b7ca82a060 con 0x55b7ca9095d0 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b7ca9171f0 con 0x55b7ca914370 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd9096a5740 10 client.0 _ll_register_callbacks cb 0x55b7ca57d8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd904867640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca90ab40 0x55b7ca910ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd904867640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca90ab40 0x55b7ca910ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51508/0 (socket says 172.21.15.70:51508) 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd904867640 1 -- 172.21.15.70:0/794565831 learned_addr learned my addr 172.21.15.70:0/794565831 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:30.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd905869640 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 0x55b7ca9115e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.780+0000 7fd905068640 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca9095d0 0x55b7ca913d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd904867640 1 -- 172.21.15.70:0/794565831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 msgr2=0x55b7ca9115e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd904867640 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 0x55b7ca9115e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd904867640 1 -- 172.21.15.70:0/794565831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca9095d0 msgr2=0x55b7ca913d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd904867640 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca9095d0 0x55b7ca913d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd904867640 1 -- 172.21.15.70:0/794565831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7ca5e03c0 con 0x55b7ca90ab40 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd904867640 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca90ab40 0x55b7ca910ff0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc006010 tx=0x7fd8fc0bc060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c1ddb3267f59a6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd8e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/794565831 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc049040 con 0x55b7ca90ab40 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/794565831 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd8fc0b8cf0 con 0x55b7ca90ab40 2024-09-19T04:36:30.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd9096a5740 1 -- 172.21.15.70:0/794565831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8f4018b10 con 0x55b7ca90ab40 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/794565831 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8fc0bc680 con 0x55b7ca90ab40 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd9096a5740 10 client.16356 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd9096a5740 1 -- 172.21.15.70:0/794565831 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7ca922ae0 con 0x55b7ca90ab40 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/794565831 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8f4018b10 con 0x55b7ca90ab40 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/794565831 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fd8fc0c4e60 con 0x55b7ca90ab40 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd9096a5740 10 client.16356 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd9096a5740 10 client.16356 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd9096a5740 20 client.16356 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.781+0000 7fd9096a5740 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b7ca923ef0 0x55b7ca926350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.782+0000 7fd9096a5740 4 client.16356 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.782+0000 7fd9096a5740 1 -- 172.21.15.70:0/794565831 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7ca87c860 con 0x55b7ca923ef0 2024-09-19T04:36:30.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.782+0000 7fd905068640 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b7ca923ef0 0x55b7ca926350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.782+0000 7fd905068640 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b7ca923ef0 0x55b7ca926350 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29514dbe0c49609a server_cookie=c7b3b4792f4f734f in_seq=0 out_seq=0 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.782+0000 7fd8e8ff9640 10 client.16356 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.783+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/794565831 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7ca87c860 con 0x55b7ca923ef0 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.783+0000 7fd8e8ff9640 10 client.16356 handle_command_reply: tid=0 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.783+0000 7fd9096a5740 1 client.16356 shutdown 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.783+0000 7fd9096a5740 1 -- 172.21.15.70:0/794565831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca90ab40 msgr2=0x55b7ca910ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.783+0000 7fd9096a5740 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca90ab40 0x55b7ca910ff0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc006010 tx=0x7fd8fc0bc060 comp rx=0 tx=0).stop 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.783+0000 7fd9096a5740 1 -- 172.21.15.70:0/794565831 shutdown_connections 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.783+0000 7fd9096a5740 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b7ca923ef0 0x55b7ca926350 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.783+0000 7fd9096a5740 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca914370 0x55b7ca9115e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.784+0000 7fd9096a5740 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca90ab40 0x55b7ca910ff0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.784+0000 7fd9096a5740 1 --2- 172.21.15.70:0/794565831 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca9095d0 0x55b7ca913d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.784+0000 7fd9096a5740 1 -- 172.21.15.70:0/794565831 >> 172.21.15.70:0/794565831 conn(0x55b7ca8d2310 msgr2=0x55b7ca90b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:30.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.784+0000 7fd8e8ff9640 0 client.16356 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:30.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.784+0000 7fd9096a5740 1 -- 172.21.15.70:0/794565831 shutdown_connections 2024-09-19T04:36:30.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.784+0000 7fd9096a5740 1 -- 172.21.15.70:0/794565831 wait complete. 2024-09-19T04:36:30.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.784+0000 7fd9096a5740 20 client.16356 trim_cache size 0 max 16384 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.796+0000 7fd9096a5740 1 Processor -- start 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.796+0000 7fd9096a5740 1 -- start start 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.796+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca920310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.796+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca90a300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.796+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca914370 0x55b7ca905700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.796+0000 7fd9096a5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001b2360 con 0x55b7ca9095d0 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd9096a5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001afb70 con 0x55b7ca914370 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd9096a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001ad9c0 con 0x55b7ca90ab40 2024-09-19T04:36:30.799 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca920310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca920310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51516/0 (socket says 172.21.15.70:51516) 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 -- 172.21.15.70:0/2061353906 learned_addr learned my addr 172.21.15.70:0/2061353906 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 -- 172.21.15.70:0/2061353906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 msgr2=0x55b7ca90a300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd904867640 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca90a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca90a300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 -- 172.21.15.70:0/2061353906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca914370 msgr2=0x55b7ca905700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca914370 0x55b7ca905700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 -- 172.21.15.70:0/2061353906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7ca910100 con 0x55b7ca9095d0 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd904867640 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca90a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:30.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd905068640 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca920310 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400ab30 tx=0x7fd8f40106c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=433f62a65fcec18f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:30.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd8eaffd640 1 -- 172.21.15.70:0/2061353906 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f401d040 con 0x55b7ca9095d0 2024-09-19T04:36:30.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd8eaffd640 1 -- 172.21.15.70:0/2061353906 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8f4005510 con 0x55b7ca9095d0 2024-09-19T04:36:30.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.797+0000 7fd8eaffd640 1 -- 172.21.15.70:0/2061353906 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8f4010a30 con 0x55b7ca9095d0 2024-09-19T04:36:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 -- 172.21.15.70:0/2061353906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 msgr2=0x55b7ca920310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca920310 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fd8f400ab30 tx=0x7fd8f40106c0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 -- 172.21.15.70:0/2061353906 shutdown_connections 2024-09-19T04:36:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca914370 0x55b7ca905700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca90a300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 --2- 172.21.15.70:0/2061353906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca9095d0 0x55b7ca920310 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 -- 172.21.15.70:0/2061353906 >> 172.21.15.70:0/2061353906 conn(0x55b7ca8d2310 msgr2=0x55b7ca900a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 -- 172.21.15.70:0/2061353906 shutdown_connections 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 -- 172.21.15.70:0/2061353906 wait complete. 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 -- start start 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.798+0000 7fd9096a5740 1 Processor -- start 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca91c480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca914370 0x55b7ca91c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd9096a5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90d640 0x55b7ca90dac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd9096a5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001ae030 con 0x55b7ca914370 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd9096a5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001af4a0 con 0x55b7ca90d640 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd9096a5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd9001ae700 con 0x55b7ca90ab40 2024-09-19T04:36:30.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd9096a5740 10 client.0 _ll_register_callbacks cb 0x7fd8fc0b89f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca914370 0x55b7ca91c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca914370 0x55b7ca91c9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51530/0 (socket says 172.21.15.70:51530) 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 -- 172.21.15.70:0/3747502892 learned_addr learned my addr 172.21.15.70:0/3747502892 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd905068640 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca91c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd905869640 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90d640 0x55b7ca90dac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 -- 172.21.15.70:0/3747502892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 msgr2=0x55b7ca91c480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca91c480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 -- 172.21.15.70:0/3747502892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90d640 msgr2=0x55b7ca90dac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90d640 0x55b7ca90dac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 -- 172.21.15.70:0/3747502892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b7ca90e000 con 0x55b7ca914370 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd905869640 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90d640 0x55b7ca90dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:30.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd904867640 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca914370 0x55b7ca91c9c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0ba930 tx=0x7fd8fc003ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e37b15c9bdbea79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd8e8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.799+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/3747502892 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8fc0a4070 con 0x55b7ca914370 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/3747502892 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fd8fc03bb70 con 0x55b7ca914370 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 1 -- 172.21.15.70:0/3747502892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8f4005510 con 0x55b7ca914370 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/3747502892 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fd8fc049030 con 0x55b7ca914370 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 10 client.16362 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 1 -- 172.21.15.70:0/3747502892 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b7ca98e810 con 0x55b7ca914370 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/3747502892 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8f4005510 con 0x55b7ca914370 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/3747502892 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7fd8fc0d0ba0 con 0x55b7ca914370 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 10 client.16362 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 10 client.16362 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:30.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 20 client.16362 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b7ca98ee30 0x55b7ca991250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 4 client.16362 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd9096a5740 1 -- 172.21.15.70:0/3747502892 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7ca876d70 con 0x55b7ca98ee30 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.800+0000 7fd905068640 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b7ca98ee30 0x55b7ca991250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd905068640 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b7ca98ee30 0x55b7ca991250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=82319aba048638db server_cookie=618ffec2e2fed80a in_seq=0 out_seq=0 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd8e8ff9640 10 client.16362 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd8e8ff9640 1 -- 172.21.15.70:0/3747502892 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7ca876d70 con 0x55b7ca98ee30 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd8e8ff9640 10 client.16362 handle_command_reply: tid=0 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 client.16362 shutdown 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 -- 172.21.15.70:0/3747502892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca914370 msgr2=0x55b7ca91c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca914370 0x55b7ca91c9c0 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc0ba930 tx=0x7fd8fc003ea0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 -- 172.21.15.70:0/3747502892 shutdown_connections 2024-09-19T04:36:30.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b7ca98ee30 0x55b7ca991250 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7ca90d640 0x55b7ca90dac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7ca914370 0x55b7ca91c9c0 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd8e8ff9640 0 client.16362 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 --2- 172.21.15.70:0/3747502892 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7ca90ab40 0x55b7ca91c480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 -- 172.21.15.70:0/3747502892 >> 172.21.15.70:0/3747502892 conn(0x55b7ca8d2310 msgr2=0x55b7ca9056e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 -- 172.21.15.70:0/3747502892 shutdown_connections 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 1 -- 172.21.15.70:0/3747502892 wait complete. 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.801+0000 7fd9096a5740 20 client.16362 trim_cache size 0 max 16384 2024-09-19T04:36:30.811 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:30.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 -- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8ec0a33b0 msgr2=0x7fd8ec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8ec0a33b0 0x7fd8ec0a5870 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fd8f8005fd0 tx=0x7fd8f8005c80 comp rx=0 tx=0).stop 2024-09-19T04:36:30.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 -- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 msgr2=0x7fd900198b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:30.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 0x7fd900198b40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fd8fc005940 tx=0x7fd8fc0042f0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 -- 172.21.15.70:0/2548107677 shutdown_connections 2024-09-19T04:36:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8ec0a33b0 0x7fd8ec0a5870 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd900108290 0x7fd90019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd900103740 0x7fd900198b40 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 --2- 172.21.15.70:0/2548107677 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd900102d90 0x7fd900198600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 -- 172.21.15.70:0/2548107677 >> 172.21.15.70:0/2548107677 conn(0x7fd9000fc7d0 msgr2=0x7fd900105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 -- 172.21.15.70:0/2548107677 shutdown_connections 2024-09-19T04:36:30.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:30.802+0000 7fd9072cc640 1 -- 172.21.15.70:0/2548107677 wait complete. 2024-09-19T04:36:30.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:30 smithi167 ceph-mon[34339]: pgmap v175: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:31.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:30 smithi134 ceph-mon[34525]: pgmap v175: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:31.631 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:36:31.877 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:32.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.366+0000 7f45a3818640 1 -- 172.21.15.70:0/840947909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c101b80 msgr2=0x7f459c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.366+0000 7f45a3818640 1 --2- 172.21.15.70:0/840947909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c101b80 0x7f459c10d950 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7f4594009ca0 tx=0x7f459402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.366+0000 7f45a3818640 1 -- 172.21.15.70:0/840947909 shutdown_connections 2024-09-19T04:36:32.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.366+0000 7f45a3818640 1 --2- 172.21.15.70:0/840947909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c101b80 0x7f459c10d950 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.366+0000 7f45a3818640 1 --2- 172.21.15.70:0/840947909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c1011e0 0x7f459c101640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.366+0000 7f45a3818640 1 --2- 172.21.15.70:0/840947909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c105ab0 0x7f459c105e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.366+0000 7f45a3818640 1 -- 172.21.15.70:0/840947909 >> 172.21.15.70:0/840947909 conn(0x7f459c0fbee0 msgr2=0x7f459c0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:32.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.366+0000 7f45a3818640 1 -- 172.21.15.70:0/840947909 shutdown_connections 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 -- 172.21.15.70:0/840947909 wait complete. 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 Processor -- start 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 -- start start 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c1011e0 0x7f459c198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c101b80 0x7f459c198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c105ab0 0x7f459c19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f459c110ea0 con 0x7f459c1011e0 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f459c110d20 con 0x7f459c105ab0 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a3818640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f459c111020 con 0x7f459c101b80 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a15b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c1011e0 0x7f459c198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a15b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c1011e0 0x7f459c198330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51550/0 (socket says 172.21.15.70:51550) 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.367+0000 7f45a15b4640 1 -- 172.21.15.70:0/1194214832 learned_addr learned my addr 172.21.15.70:0/1194214832 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:32.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a0db3640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c101b80 0x7f459c198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a1db5640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c105ab0 0x7f459c19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a15b4640 1 -- 172.21.15.70:0/1194214832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c101b80 msgr2=0x7f459c198870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a15b4640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c101b80 0x7f459c198870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a15b4640 1 -- 172.21.15.70:0/1194214832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c105ab0 msgr2=0x7f459c19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a15b4640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c105ab0 0x7f459c19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a15b4640 1 -- 172.21.15.70:0/1194214832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f459c19d2e0 con 0x7f459c1011e0 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a0db3640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c101b80 0x7f459c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a15b4640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c1011e0 0x7f459c198330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f459800c890 tx=0x7f459800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45927fc640 1 -- 172.21.15.70:0/1194214832 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598004220 con 0x7f459c1011e0 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a3818640 1 -- 172.21.15.70:0/1194214832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f459c19d5d0 con 0x7f459c1011e0 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45927fc640 1 -- 172.21.15.70:0/1194214832 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f45980043c0 con 0x7f459c1011e0 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45927fc640 1 -- 172.21.15.70:0/1194214832 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4598004a00 con 0x7f459c1011e0 2024-09-19T04:36:32.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.368+0000 7f45a3818640 1 -- 172.21.15.70:0/1194214832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f459c1a4eb0 con 0x7f459c1011e0 2024-09-19T04:36:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45927fc640 1 -- 172.21.15.70:0/1194214832 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4598004ba0 con 0x7f459c1011e0 2024-09-19T04:36:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a5bf1740 1 Processor -- start 2024-09-19T04:36:32.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a5bf1740 1 -- start start 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d3b40 0x55f5d00d2090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d25d0 0x55f5d00d2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00df760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5d00382f0 con 0x55f5d00dd370 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f5cffdfcf0 con 0x55f5d00d3b40 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5d00342b0 con 0x55f5d00d25d0 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a0db3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00df760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a0db3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00df760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51562/0 (socket says 172.21.15.70:51562) 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a0db3640 1 -- 172.21.15.70:0/4173601268 learned_addr learned my addr 172.21.15.70:0/4173601268 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45927fc640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45880a33b0 0x7f45880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.371+0000 7f45a15b4640 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d25d0 0x55f5d00d2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a1db5640 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d3b40 0x55f5d00d2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a1db5640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45880a33b0 0x7f45880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45927fc640 1 -- 172.21.15.70:0/1194214832 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f45980cfb00 con 0x7f459c1011e0 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a0db3640 1 -- 172.21.15.70:0/4173601268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d25d0 msgr2=0x55f5d00d2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a0db3640 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d25d0 0x55f5d00d2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a0db3640 1 -- 172.21.15.70:0/4173601268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d3b40 msgr2=0x55f5d00d2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a0db3640 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d3b40 0x55f5d00d2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a0db3640 1 -- 172.21.15.70:0/4173601268 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5cffc43a0 con 0x55f5d00dd370 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a0db3640 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00df760 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f458c00cc60 tx=0x7f458c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c9cfdd19b4640e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45a1db5640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45880a33b0 0x7f45880a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f459402f500 tx=0x7f45940095c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45877fe640 1 -- 172.21.15.70:0/4173601268 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c014070 con 0x55f5d00dd370 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45877fe640 1 -- 172.21.15.70:0/4173601268 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f458c0047a0 con 0x55f5d00dd370 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.372+0000 7f45877fe640 1 -- 172.21.15.70:0/4173601268 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c0106b0 con 0x55f5d00dd370 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 -- 172.21.15.70:0/4173601268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 msgr2=0x55f5d00df760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00df760 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f458c00cc60 tx=0x7f458c00e720 comp rx=0 tx=0).stop 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 -- 172.21.15.70:0/4173601268 shutdown_connections 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00df760 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d25d0 0x55f5d00d2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/4173601268 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d3b40 0x55f5d00d2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 -- 172.21.15.70:0/4173601268 >> 172.21.15.70:0/4173601268 conn(0x55f5d009b310 msgr2=0x55f5d00cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 -- 172.21.15.70:0/4173601268 shutdown_connections 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 -- 172.21.15.70:0/4173601268 wait complete. 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 -- start start 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.373+0000 7f45a5bf1740 1 Processor -- start 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00dcd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00d9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00da5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5d00e4480 con 0x55f5d00dd370 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f5cfff3060 con 0x55f5d00d25d0 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5d00e4600 con 0x55f5d00d3b40 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a5bf1740 10 client.0 _ll_register_callbacks cb 0x55f5cfd468c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a1db5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00da5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a1db5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00da5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51570/0 (socket says 172.21.15.70:51570) 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a1db5640 1 -- 172.21.15.70:0/1189541135 learned_addr learned my addr 172.21.15.70:0/1189541135 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a0db3640 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00d9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a15b4640 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00dcd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a1db5640 1 -- 172.21.15.70:0/1189541135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 msgr2=0x55f5d00d9fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a1db5640 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00d9fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a1db5640 1 -- 172.21.15.70:0/1189541135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 msgr2=0x55f5d00dcd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a1db5640 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00dcd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.374+0000 7f45a1db5640 1 -- 172.21.15.70:0/1189541135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5cfda93c0 con 0x55f5d00dd370 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a1db5640 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00da5d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4594035000 tx=0x7f459402a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca29b6ddc8a59462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f4584ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f4584ff9640 1 -- 172.21.15.70:0/1189541135 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594004250 con 0x55f5d00dd370 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 1 -- 172.21.15.70:0/1189541135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f458c0047a0 con 0x55f5d00dd370 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f4584ff9640 1 -- 172.21.15.70:0/1189541135 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f45940043f0 con 0x55f5d00dd370 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f4584ff9640 1 -- 172.21.15.70:0/1189541135 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f45940045f0 con 0x55f5d00dd370 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 10 client.16374 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 1 -- 172.21.15.70:0/1189541135 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5d00efee0 con 0x55f5d00dd370 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f4584ff9640 1 -- 172.21.15.70:0/1189541135 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f458c0047a0 con 0x55f5d00dd370 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f4584ff9640 1 -- 172.21.15.70:0/1189541135 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f459405c020 con 0x55f5d00dd370 2024-09-19T04:36:32.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 10 client.16374 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 10 client.16374 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 20 client.16374 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5d00f12f0 0x55f5d00f3790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 4 client.16374 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.375+0000 7f45a5bf1740 1 -- 172.21.15.70:0/1189541135 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5d0045860 con 0x55f5d00f12f0 2024-09-19T04:36:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.376+0000 7f45a15b4640 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5d00f12f0 0x55f5d00f3790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.376+0000 7f4584ff9640 10 client.16374 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:32.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.376+0000 7f45a15b4640 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5d00f12f0 0x55f5d00f3790 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=63884eb185ad4226 server_cookie=91ac4f334858a05b in_seq=0 out_seq=0 2024-09-19T04:36:32.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f4584ff9640 1 -- 172.21.15.70:0/1189541135 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5d0045860 con 0x55f5d00f12f0 2024-09-19T04:36:32.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f4584ff9640 10 client.16374 handle_command_reply: tid=0 2024-09-19T04:36:32.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 client.16374 shutdown 2024-09-19T04:36:32.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 -- 172.21.15.70:0/1189541135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 msgr2=0x55f5d00da5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00da5d0 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f4594035000 tx=0x7f459402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 -- 172.21.15.70:0/1189541135 shutdown_connections 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5d00f12f0 0x55f5d00f3790 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00da5d0 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00d9fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/1189541135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00dcd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 -- 172.21.15.70:0/1189541135 >> 172.21.15.70:0/1189541135 conn(0x55f5d009b310 msgr2=0x55f5d00d4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f4584ff9640 0 client.16374 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 -- 172.21.15.70:0/1189541135 shutdown_connections 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 1 -- 172.21.15.70:0/1189541135 wait complete. 2024-09-19T04:36:32.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.377+0000 7f45a5bf1740 20 client.16374 trim_cache size 0 max 16384 2024-09-19T04:36:32.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a5bf1740 1 Processor -- start 2024-09-19T04:36:32.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a5bf1740 1 -- start start 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00cee10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00ed720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00f9060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1aded0 con 0x55f5d00dd370 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1ab6e0 con 0x55f5d00d25d0 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1a9530 con 0x55f5d00d3b40 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a1db5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00f9060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a1db5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00f9060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51576/0 (socket says 172.21.15.70:51576) 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a1db5640 1 -- 172.21.15.70:0/2238297703 learned_addr learned my addr 172.21.15.70:0/2238297703 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a0db3640 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00ed720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a15b4640 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00cee10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a1db5640 1 -- 172.21.15.70:0/2238297703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 msgr2=0x55f5d00ed720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a1db5640 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00ed720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a1db5640 1 -- 172.21.15.70:0/2238297703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 msgr2=0x55f5d00cee10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:32.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a1db5640 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00cee10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a1db5640 1 -- 172.21.15.70:0/2238297703 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5d00dd0a0 con 0x55f5d00dd370 2024-09-19T04:36:32.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.390+0000 7f45a0db3640 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00ed720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:32.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a1db5640 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00f9060 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4594009bf0 tx=0x7f459402f310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71e6b571fb8b8608 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:32.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f4586ffd640 1 -- 172.21.15.70:0/2238297703 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594003970 con 0x55f5d00dd370 2024-09-19T04:36:32.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f4586ffd640 1 -- 172.21.15.70:0/2238297703 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4594036040 con 0x55f5d00dd370 2024-09-19T04:36:32.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f4586ffd640 1 -- 172.21.15.70:0/2238297703 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459402f660 con 0x55f5d00dd370 2024-09-19T04:36:32.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 -- 172.21.15.70:0/2238297703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 msgr2=0x55f5d00f9060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00f9060 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7f4594009bf0 tx=0x7f459402f310 comp rx=0 tx=0).stop 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 -- 172.21.15.70:0/2238297703 shutdown_connections 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00dd370 0x55f5d00f9060 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00d3b40 0x55f5d00ed720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/2238297703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00cee10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 -- 172.21.15.70:0/2238297703 >> 172.21.15.70:0/2238297703 conn(0x55f5d009b310 msgr2=0x55f5d00ce700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 -- 172.21.15.70:0/2238297703 shutdown_connections 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.391+0000 7f45a5bf1740 1 -- 172.21.15.70:0/2238297703 wait complete. 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 1 -- start start 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 1 Processor -- start 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00e5670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00d3b40 0x55f5d00e5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00dd370 0x55f5d00e60f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1a9ba0 con 0x55f5d00d3b40 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1ab010 con 0x55f5d00d25d0 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f459c1aa270 con 0x55f5d00dd370 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a5bf1740 10 client.0 _ll_register_callbacks cb 0x7f4594031f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a0db3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00d3b40 0x55f5d00e5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a0db3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00d3b40 0x55f5d00e5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51578/0 (socket says 172.21.15.70:51578) 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a0db3640 1 -- 172.21.15.70:0/3671419559 learned_addr learned my addr 172.21.15.70:0/3671419559 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.392+0000 7f45a15b4640 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00e5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a1db5640 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00dd370 0x55f5d00e60f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a0db3640 1 -- 172.21.15.70:0/3671419559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00dd370 msgr2=0x55f5d00e60f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a0db3640 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00dd370 0x55f5d00e60f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a0db3640 1 -- 172.21.15.70:0/3671419559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 msgr2=0x55f5d00e5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a0db3640 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00e5670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a0db3640 1 -- 172.21.15.70:0/3671419559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5d015b0b0 con 0x55f5d00d3b40 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a0db3640 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00d3b40 0x55f5d00e5bb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f458c00ec20 tx=0x7f458c0056c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4bc27c566c0041c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f4584ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f4584ff9640 1 -- 172.21.15.70:0/3671419559 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f458c014070 con 0x55f5d00d3b40 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f4584ff9640 1 -- 172.21.15.70:0/3671419559 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f458c004a70 con 0x55f5d00d3b40 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a5bf1740 1 -- 172.21.15.70:0/3671419559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4594036040 con 0x55f5d00d3b40 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f4584ff9640 1 -- 172.21.15.70:0/3671419559 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f458c030050 con 0x55f5d00d3b40 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a5bf1740 10 client.16380 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f45a5bf1740 1 -- 172.21.15.70:0/3671419559 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55f5d015c390 con 0x55f5d00d3b40 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.393+0000 7f4584ff9640 1 -- 172.21.15.70:0/3671419559 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4594036040 con 0x55f5d00d3b40 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f4584ff9640 1 -- 172.21.15.70:0/3671419559 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f458c010cb0 con 0x55f5d00d3b40 2024-09-19T04:36:32.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f45a5bf1740 10 client.16380 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f45a5bf1740 10 client.16380 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f45a5bf1740 20 client.16380 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5d015c880 0x55f5d015eca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f45a5bf1740 4 client.16380 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f45a5bf1740 1 -- 172.21.15.70:0/3671419559 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5d003fd70 con 0x55f5d015c880 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f45a15b4640 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5d015c880 0x55f5d015eca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f4584ff9640 10 client.16380 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f45a15b4640 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5d015c880 0x55f5d015eca0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7385ea576ba24289 server_cookie=eeab5e11aeafec82 in_seq=0 out_seq=0 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f4584ff9640 1 -- 172.21.15.70:0/3671419559 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f5d003fd70 con 0x55f5d015c880 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.394+0000 7f4584ff9640 10 client.16380 handle_command_reply: tid=0 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 client.16380 shutdown 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 -- 172.21.15.70:0/3671419559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00d3b40 msgr2=0x55f5d00e5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00d3b40 0x55f5d00e5bb0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f458c00ec20 tx=0x7f458c0056c0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 -- 172.21.15.70:0/3671419559 shutdown_connections 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5d015c880 0x55f5d015eca0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5d00dd370 0x55f5d00e60f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5d00d3b40 0x55f5d00e5bb0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f4584ff9640 0 client.16380 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 --2- 172.21.15.70:0/3671419559 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5d00d25d0 0x55f5d00e5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 -- 172.21.15.70:0/3671419559 >> 172.21.15.70:0/3671419559 conn(0x55f5d009b310 msgr2=0x55f5d00db840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 -- 172.21.15.70:0/3671419559 shutdown_connections 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 1 -- 172.21.15.70:0/3671419559 wait complete. 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a5bf1740 20 client.16380 trim_cache size 0 max 16384 2024-09-19T04:36:32.402 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:32.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a3818640 1 -- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45880a33b0 msgr2=0x7f45880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a3818640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45880a33b0 0x7f45880a5870 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f459402f500 tx=0x7f45940095c0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a3818640 1 -- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c1011e0 msgr2=0x7f459c198330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a3818640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c1011e0 0x7f459c198330 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7f459800c890 tx=0x7f459800cd50 comp rx=0 tx=0).stop 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a3818640 1 -- 172.21.15.70:0/1194214832 shutdown_connections 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.395+0000 7f45a3818640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45880a33b0 0x7f45880a5870 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.396+0000 7f45a3818640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f459c105ab0 0x7f459c19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.396+0000 7f45a3818640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f459c101b80 0x7f459c198870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.396+0000 7f45a3818640 1 --2- 172.21.15.70:0/1194214832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f459c1011e0 0x7f459c198330 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.396+0000 7f45a3818640 1 -- 172.21.15.70:0/1194214832 >> 172.21.15.70:0/1194214832 conn(0x7f459c0fbee0 msgr2=0x7f459c100250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.396+0000 7f45a3818640 1 -- 172.21.15.70:0/1194214832 shutdown_connections 2024-09-19T04:36:32.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:32.396+0000 7f45a3818640 1 -- 172.21.15.70:0/1194214832 wait complete. 2024-09-19T04:36:32.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:32 smithi167 ceph-mon[34339]: pgmap v176: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:33.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:32 smithi070 ceph-mon[30942]: pgmap v176: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:33.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:32 smithi134 ceph-mon[34525]: pgmap v176: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:33.062 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:36:33.306 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:33.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 -- 172.21.15.70:0/3265778937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 msgr2=0x7f4060100f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 --2- 172.21.15.70:0/3265778937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 0x7f4060100f10 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f405c009900 tx=0x7f405c02a470 comp rx=0 tx=0).stop 2024-09-19T04:36:33.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 -- 172.21.15.70:0/3265778937 shutdown_connections 2024-09-19T04:36:33.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 --2- 172.21.15.70:0/3265778937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4060105f40 0x7f40601063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 --2- 172.21.15.70:0/3265778937 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4060101450 0x7f4060105920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 --2- 172.21.15.70:0/3265778937 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 0x7f4060100f10 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 -- 172.21.15.70:0/3265778937 >> 172.21.15.70:0/3265778937 conn(0x7f40600fc7a0 msgr2=0x7f40600febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:33.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 -- 172.21.15.70:0/3265778937 shutdown_connections 2024-09-19T04:36:33.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.774+0000 7f40679b8640 1 -- 172.21.15.70:0/3265778937 wait complete. 2024-09-19T04:36:33.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f40679b8640 1 Processor -- start 2024-09-19T04:36:33.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f40679b8640 1 -- start start 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f40679b8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 0x7f40601a4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f40679b8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4060101450 0x7f40601a4bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f40679b8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4060105f40 0x7f406019e800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f40679b8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4060118550 con 0x7f4060100b30 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f40679b8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40601183d0 con 0x7f4060105f40 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f40679b8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40601186d0 con 0x7f4060101450 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f4065754640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 0x7f40601a4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f4065754640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 0x7f40601a4680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39700/0 (socket says 172.21.15.70:39700) 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f4065754640 1 -- 172.21.15.70:0/3431635017 learned_addr learned my addr 172.21.15.70:0/3431635017 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f4064f53640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4060101450 0x7f40601a4bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.775+0000 7f4065f55640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4060105f40 0x7f406019e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f4065754640 1 -- 172.21.15.70:0/3431635017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4060101450 msgr2=0x7f40601a4bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f4065754640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4060101450 0x7f40601a4bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f4065754640 1 -- 172.21.15.70:0/3431635017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4060105f40 msgr2=0x7f406019e800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f4065754640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4060105f40 0x7f406019e800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f4065754640 1 -- 172.21.15.70:0/3431635017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f406019efa0 con 0x7f4060100b30 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f4064f53640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4060101450 0x7f40601a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f4065f55640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4060105f40 0x7f406019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f4065754640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 0x7f40601a4680 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f405c009a20 tx=0x7f405c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f40567fc640 1 -- 172.21.15.70:0/3431635017 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c03f030 con 0x7f4060100b30 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f40679b8640 1 -- 172.21.15.70:0/3431635017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f406019f230 con 0x7f4060100b30 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f40567fc640 1 -- 172.21.15.70:0/3431635017 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f405c031b80 con 0x7f4060100b30 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f40567fc640 1 -- 172.21.15.70:0/3431635017 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c035070 con 0x7f4060100b30 2024-09-19T04:36:33.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.776+0000 7f40679b8640 1 -- 172.21.15.70:0/3431635017 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40601ab4e0 con 0x7f4060100b30 2024-09-19T04:36:33.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.778+0000 7f40567fc640 1 -- 172.21.15.70:0/3431635017 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f405c0035f0 con 0x7f4060100b30 2024-09-19T04:36:33.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4069d91740 1 Processor -- start 2024-09-19T04:36:33.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4069d91740 1 -- start start 2024-09-19T04:36:33.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4069d91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b788983090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4069d91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7889835d0 0x55b788983a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4069d91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b78898e370 0x55b788990760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4069d91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b7888e92f0 con 0x55b788984b40 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4069d91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b788890cf0 con 0x55b78898e370 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4069d91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b7888e52b0 con 0x55b7889835d0 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065f55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b788983090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f40567fc640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f404c0a33b0 0x7f404c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065f55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b788983090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39708/0 (socket says 172.21.15.70:39708) 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065f55640 1 -- 172.21.15.70:0/2901187097 learned_addr learned my addr 172.21.15.70:0/2901187097 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065754640 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7889835d0 0x55b788983a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065f55640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f404c0a33b0 0x7f404c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065f55640 1 -- 172.21.15.70:0/2901187097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7889835d0 msgr2=0x55b788983a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:33.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065f55640 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7889835d0 0x55b788983a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065f55640 1 -- 172.21.15.70:0/2901187097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b78898e370 msgr2=0x55b788990760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f40567fc640 1 -- 172.21.15.70:0/3431635017 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f405c0f08c0 con 0x7f4060100b30 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4064f53640 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b78898e370 0x55b788990760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.779+0000 7f4065f55640 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b78898e370 0x55b788990760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.780+0000 7f4065f55640 1 -- 172.21.15.70:0/2901187097 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b7888753a0 con 0x55b788984b40 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.780+0000 7f4064f53640 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b78898e370 0x55b788990760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.780+0000 7f4065754640 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7889835d0 0x55b788983a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.780+0000 7f4065f55640 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b788983090 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4058012940 tx=0x7f4058012e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbbb624227764313 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.780+0000 7f404b7fe640 1 -- 172.21.15.70:0/2901187097 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058022070 con 0x55b788984b40 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.780+0000 7f404b7fe640 1 -- 172.21.15.70:0/2901187097 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4058012250 con 0x55b788984b40 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.780+0000 7f4065f55640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f404c0a33b0 0x7f404c0a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f405801f000 tx=0x7f405801d000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.780+0000 7f404b7fe640 1 -- 172.21.15.70:0/2901187097 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405801dde0 con 0x55b788984b40 2024-09-19T04:36:33.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 -- 172.21.15.70:0/2901187097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 msgr2=0x55b788983090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b788983090 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f4058012940 tx=0x7f4058012e00 comp rx=0 tx=0).stop 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 -- 172.21.15.70:0/2901187097 shutdown_connections 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b78898e370 0x55b788990760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b7889835d0 0x55b788983a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 --2- 172.21.15.70:0/2901187097 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b788983090 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 -- 172.21.15.70:0/2901187097 >> 172.21.15.70:0/2901187097 conn(0x55b78894c310 msgr2=0x55b78897fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 -- 172.21.15.70:0/2901187097 shutdown_connections 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 -- 172.21.15.70:0/2901187097 wait complete. 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 -- start start 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.781+0000 7f4069d91740 1 Processor -- start 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4069d91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 0x55b78898dd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4069d91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b788984b40 0x55b78898b020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4069d91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b78898e370 0x55b78898b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4069d91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b788991070 con 0x55b78898e370 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4069d91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b7888a4060 con 0x55b7889835d0 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4069d91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b7889911f0 con 0x55b788984b40 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4069d91740 10 client.0 _ll_register_callbacks cb 0x55b7885f78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b78898e370 0x55b78898b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b78898e370 0x55b78898b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39720/0 (socket says 172.21.15.70:39720) 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 -- 172.21.15.70:0/4101569549 learned_addr learned my addr 172.21.15.70:0/4101569549 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065754640 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 0x55b78898dd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4064f53640 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b788984b40 0x55b78898b020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 -- 172.21.15.70:0/4101569549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b788984b40 msgr2=0x55b78898b020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b788984b40 0x55b78898b020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 -- 172.21.15.70:0/4101569549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 msgr2=0x55b78898dd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 0x55b78898dd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 -- 172.21.15.70:0/4101569549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b78865a3c0 con 0x55b78898e370 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4065f55640 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b78898e370 0x55b78898b610 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4058007630 tx=0x7f405801d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe50758c2f6cb71d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4048ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.782+0000 7f4048ff9640 1 -- 172.21.15.70:0/4101569549 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4058022040 con 0x55b78898e370 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4048ff9640 1 -- 172.21.15.70:0/4101569549 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4058012050 con 0x55b78898e370 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 1 -- 172.21.15.70:0/4101569549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4058012250 con 0x55b78898e370 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4048ff9640 1 -- 172.21.15.70:0/4101569549 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f405801dd90 con 0x55b78898e370 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 10 client.16392 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 1 -- 172.21.15.70:0/4101569549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b78899ca80 con 0x55b78898e370 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4048ff9640 1 -- 172.21.15.70:0/4101569549 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4058012250 con 0x55b78898e370 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4048ff9640 1 -- 172.21.15.70:0/4101569549 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4058039020 con 0x55b78898e370 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 10 client.16392 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 10 client.16392 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 20 client.16392 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b78899de90 0x55b7889a0280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 4 client.16392 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:33.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4069d91740 1 -- 172.21.15.70:0/4101569549 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b7888f6860 con 0x55b78899de90 2024-09-19T04:36:33.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.783+0000 7f4065754640 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b78899de90 0x55b7889a0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.784+0000 7f4065754640 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b78899de90 0x55b7889a0280 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8b79fbb5bf4ff server_cookie=c591c93f3622c45b in_seq=0 out_seq=0 2024-09-19T04:36:33.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.784+0000 7f4048ff9640 10 client.16392 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:33.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4048ff9640 1 -- 172.21.15.70:0/4101569549 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b7888f6860 con 0x55b78899de90 2024-09-19T04:36:33.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4048ff9640 10 client.16392 handle_command_reply: tid=0 2024-09-19T04:36:33.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 client.16392 shutdown 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 -- 172.21.15.70:0/4101569549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b78898e370 msgr2=0x55b78898b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b78898e370 0x55b78898b610 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4058007630 tx=0x7f405801d690 comp rx=0 tx=0).stop 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 -- 172.21.15.70:0/4101569549 shutdown_connections 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b78899de90 0x55b7889a0280 crc :-1 s=READY pgs=108 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b78898e370 0x55b78898b610 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b788984b40 0x55b78898b020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 --2- 172.21.15.70:0/4101569549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 0x55b78898dd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 -- 172.21.15.70:0/4101569549 >> 172.21.15.70:0/4101569549 conn(0x55b78894c310 msgr2=0x55b788985960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4048ff9640 0 client.16392 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 -- 172.21.15.70:0/4101569549 shutdown_connections 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 1 -- 172.21.15.70:0/4101569549 wait complete. 2024-09-19T04:36:33.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.785+0000 7f4069d91740 20 client.16392 trim_cache size 0 max 16384 2024-09-19T04:36:33.800 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4069d91740 1 Processor -- start 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4069d91740 1 -- start start 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4069d91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 0x55b78899a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4069d91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b7889898f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4069d91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b788989e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4069d91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40601b66e0 con 0x55b788984b40 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4069d91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40601b3ef0 con 0x55b7889835d0 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4069d91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40601b1d40 con 0x55b78898e370 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4064f53640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b7889898f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4064f53640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b7889898f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39734/0 (socket says 172.21.15.70:39734) 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4064f53640 1 -- 172.21.15.70:0/1047536027 learned_addr learned my addr 172.21.15.70:0/1047536027 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4065754640 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 0x55b78899a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4065f55640 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b788989e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.801 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4064f53640 1 -- 172.21.15.70:0/1047536027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 msgr2=0x55b788989e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4064f53640 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b788989e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4064f53640 1 -- 172.21.15.70:0/1047536027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 msgr2=0x55b78899a310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4064f53640 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 0x55b78899a310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4064f53640 1 -- 172.21.15.70:0/1047536027 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b788989570 con 0x55b788984b40 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.798+0000 7f4065f55640 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b788989e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.799+0000 7f4064f53640 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b7889898f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f40600ffe70 tx=0x7f40500117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8b77a6d28bbe51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.799+0000 7f404affd640 1 -- 172.21.15.70:0/1047536027 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050004020 con 0x55b788984b40 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.799+0000 7f404affd640 1 -- 172.21.15.70:0/1047536027 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f40500054f0 con 0x55b788984b40 2024-09-19T04:36:33.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.799+0000 7f404affd640 1 -- 172.21.15.70:0/1047536027 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4050004c00 con 0x55b788984b40 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 -- 172.21.15.70:0/1047536027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 msgr2=0x55b7889898f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b7889898f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f40600ffe70 tx=0x7f40500117b0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 -- 172.21.15.70:0/1047536027 shutdown_connections 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b788989e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b788984b40 0x55b7889898f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 --2- 172.21.15.70:0/1047536027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b7889835d0 0x55b78899a310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 -- 172.21.15.70:0/1047536027 >> 172.21.15.70:0/1047536027 conn(0x55b78894c310 msgr2=0x55b78898afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 -- 172.21.15.70:0/1047536027 shutdown_connections 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 -- 172.21.15.70:0/1047536027 wait complete. 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 -- start start 2024-09-19T04:36:33.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 Processor -- start 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7889835d0 0x55b788996a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.800+0000 7f4069d91740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b788984b40 0x55b788991d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4069d91740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b7889922b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4069d91740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40601b23b0 con 0x55b7889835d0 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4069d91740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40601b3820 con 0x55b788984b40 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4069d91740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40601b2a80 con 0x55b78898e370 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4069d91740 10 client.0 _ll_register_callbacks cb 0x7f4058020070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7889835d0 0x55b788996a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7889835d0 0x55b788996a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39740/0 (socket says 172.21.15.70:39740) 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 -- 172.21.15.70:0/1318051414 learned_addr learned my addr 172.21.15.70:0/1318051414 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4064f53640 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b788984b40 0x55b788991d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065f55640 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b7889922b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 -- 172.21.15.70:0/1318051414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 msgr2=0x55b7889922b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:33.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b7889922b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 -- 172.21.15.70:0/1318051414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b788984b40 msgr2=0x55b788991d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b788984b40 0x55b788991d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 -- 172.21.15.70:0/1318051414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b788992920 con 0x55b7889835d0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4065754640 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7889835d0 0x55b788996a40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f405c0045d0 tx=0x7f405c08c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82badde2e9915c9c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4048ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4048ff9640 1 -- 172.21.15.70:0/1318051414 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405c049040 con 0x55b7889835d0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4048ff9640 1 -- 172.21.15.70:0/1318051414 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f405c0ee2b0 con 0x55b7889835d0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4069d91740 1 -- 172.21.15.70:0/1318051414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40500054f0 con 0x55b7889835d0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4048ff9640 1 -- 172.21.15.70:0/1318051414 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f405c0038e0 con 0x55b7889835d0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4069d91740 10 client.16398 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.801+0000 7f4069d91740 1 -- 172.21.15.70:0/1318051414 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55b788a08740 con 0x55b7889835d0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4048ff9640 1 -- 172.21.15.70:0/1318051414 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f40500054f0 con 0x55b7889835d0 2024-09-19T04:36:33.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4048ff9640 1 -- 172.21.15.70:0/1318051414 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f405c0b9230 con 0x55b7889835d0 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4069d91740 10 client.16398 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4069d91740 10 client.16398 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4069d91740 20 client.16398 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4069d91740 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b788a08ee0 0x55b788a0b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4069d91740 4 client.16398 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4069d91740 1 -- 172.21.15.70:0/1318051414 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b7888f0d70 con 0x55b788a08ee0 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.802+0000 7f4064f53640 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b788a08ee0 0x55b788a0b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4048ff9640 10 client.16398 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4064f53640 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b788a08ee0 0x55b788a0b2d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ee769e3421421dc5 server_cookie=a0b222cb9b4ee359 in_seq=0 out_seq=0 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4048ff9640 1 -- 172.21.15.70:0/1318051414 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b7888f0d70 con 0x55b788a08ee0 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4048ff9640 10 client.16398 handle_command_reply: tid=0 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 client.16398 shutdown 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 -- 172.21.15.70:0/1318051414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7889835d0 msgr2=0x55b788996a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7889835d0 0x55b788996a40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f405c0045d0 tx=0x7f405c08c7e0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 -- 172.21.15.70:0/1318051414 shutdown_connections 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55b788a08ee0 0x55b788a0b2d0 crc :-1 s=READY pgs=109 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b78898e370 0x55b7889922b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b788984b40 0x55b788991d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 --2- 172.21.15.70:0/1318051414 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b7889835d0 0x55b788996a40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 -- 172.21.15.70:0/1318051414 >> 172.21.15.70:0/1318051414 conn(0x55b78894c310 msgr2=0x55b788989780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4048ff9640 0 client.16398 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 -- 172.21.15.70:0/1318051414 shutdown_connections 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 1 -- 172.21.15.70:0/1318051414 wait complete. 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.803+0000 7f4069d91740 20 client.16398 trim_cache size 0 max 16384 2024-09-19T04:36:33.810 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:33.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 -- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f404c0a33b0 msgr2=0x7f404c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f404c0a33b0 0x7f404c0a5870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f405801f000 tx=0x7f405801d000 comp rx=0 tx=0).stop 2024-09-19T04:36:33.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 -- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 msgr2=0x7f40601a4680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:33.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 0x7f40601a4680 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f405c009a20 tx=0x7f405c0043b0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 -- 172.21.15.70:0/3431635017 shutdown_connections 2024-09-19T04:36:33.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f404c0a33b0 0x7f404c0a5870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4060105f40 0x7f406019e800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4060101450 0x7f40601a4bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 --2- 172.21.15.70:0/3431635017 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4060100b30 0x7f40601a4680 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:33.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 -- 172.21.15.70:0/3431635017 >> 172.21.15.70:0/3431635017 conn(0x7f40600fc7a0 msgr2=0x7f406010f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:33.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 -- 172.21.15.70:0/3431635017 shutdown_connections 2024-09-19T04:36:33.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:33.804+0000 7f40679b8640 1 -- 172.21.15.70:0/3431635017 wait complete. 2024-09-19T04:36:34.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:34 smithi070 ceph-mon[30942]: pgmap v177: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:34.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:34 smithi167 ceph-mon[34339]: pgmap v177: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:34 smithi134 ceph-mon[34525]: pgmap v177: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:35.531 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:36:35.531 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:36:35.787 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.268+0000 7f00ebe94640 1 -- 172.21.15.70:0/621671574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4106a80 msgr2=0x7f00e4106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.268+0000 7f00ebe94640 1 --2- 172.21.15.70:0/621671574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4106a80 0x7f00e4106e60 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009930 tx=0x7f00e002a420 comp rx=0 tx=0).stop 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.268+0000 7f00ebe94640 1 -- 172.21.15.70:0/621671574 shutdown_connections 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.268+0000 7f00ebe94640 1 --2- 172.21.15.70:0/621671574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e4101420 0x7f00e410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.268+0000 7f00ebe94640 1 --2- 172.21.15.70:0/621671574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e4100a80 0x7f00e4100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.268+0000 7f00ebe94640 1 --2- 172.21.15.70:0/621671574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4106a80 0x7f00e4106e60 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.268+0000 7f00ebe94640 1 -- 172.21.15.70:0/621671574 >> 172.21.15.70:0/621671574 conn(0x7f00e40fc7a0 msgr2=0x7f00e40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.269+0000 7f00ebe94640 1 -- 172.21.15.70:0/621671574 shutdown_connections 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.269+0000 7f00ebe94640 1 -- 172.21.15.70:0/621671574 wait complete. 2024-09-19T04:36:36.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.269+0000 7f00ebe94640 1 Processor -- start 2024-09-19T04:36:36.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.269+0000 7f00ebe94640 1 -- start start 2024-09-19T04:36:36.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00ebe94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e4100a80 0x7f00e41992a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00ebe94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4101420 0x7f00e41997e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00ebe94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e4106a80 0x7f00e41a4320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00ebe94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4110e50 con 0x7f00e4101420 2024-09-19T04:36:36.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00ebe94640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4110cd0 con 0x7f00e4100a80 2024-09-19T04:36:36.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00ebe94640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00e4110fd0 con 0x7f00e4106a80 2024-09-19T04:36:36.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4101420 0x7f00e41997e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4101420 0x7f00e41997e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39760/0 (socket says 172.21.15.70:39760) 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 -- 172.21.15.70:0/3715109247 learned_addr learned my addr 172.21.15.70:0/3715109247 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e9c30640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e4100a80 0x7f00e41992a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00ea431640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e4106a80 0x7f00e41a4320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 -- 172.21.15.70:0/3715109247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e4106a80 msgr2=0x7f00e41a4320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e4106a80 0x7f00e41a4320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 -- 172.21.15.70:0/3715109247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e4100a80 msgr2=0x7f00e41992a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e4100a80 0x7f00e41992a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 -- 172.21.15.70:0/3715109247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00e41a4860 con 0x7f00e4101420 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00e942f640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4101420 0x7f00e41997e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f00d400d950 tx=0x7f00d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.270+0000 7f00daffd640 1 -- 172.21.15.70:0/3715109247 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4017070 con 0x7f00e4101420 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.271+0000 7f00ebe94640 1 -- 172.21.15.70:0/3715109247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00e41a4a30 con 0x7f00e4101420 2024-09-19T04:36:36.274 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.271+0000 7f00daffd640 1 -- 172.21.15.70:0/3715109247 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f00d4009c30 con 0x7f00e4101420 2024-09-19T04:36:36.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.271+0000 7f00daffd640 1 -- 172.21.15.70:0/3715109247 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d400f6b0 con 0x7f00e4101420 2024-09-19T04:36:36.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.271+0000 7f00ebe94640 1 -- 172.21.15.70:0/3715109247 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00e41a4f40 con 0x7f00e4101420 2024-09-19T04:36:36.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00daffd640 1 -- 172.21.15.70:0/3715109247 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f00d4010a50 con 0x7f00e4101420 2024-09-19T04:36:36.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ee26d740 1 Processor -- start 2024-09-19T04:36:36.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ee26d740 1 -- start start 2024-09-19T04:36:36.279 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b717bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b7186800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b7186d40 0x5569b7189130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ee26d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569b70e1280 con 0x5569b717bb60 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ee26d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5569b7088b10 con 0x5569b7186d40 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ee26d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5569b70dd240 con 0x5569b717c480 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.273+0000 7f00ea431640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b717bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b7186800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b7186800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:44902/0 (socket says 172.21.15.70:44902) 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 -- 172.21.15.70:0/2874141426 learned_addr learned my addr 172.21.15.70:0/2874141426 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e942f640 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b7186d40 0x5569b7189130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 -- 172.21.15.70:0/2874141426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b7186d40 msgr2=0x5569b7189130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b7186d40 0x5569b7189130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.280 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 -- 172.21.15.70:0/2874141426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 msgr2=0x5569b717bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b717bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 -- 172.21.15.70:0/2874141426 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b70951f0 con 0x5569b717c480 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00daffd640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f00d00a33b0 0x7f00d00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00ea431640 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b717bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00ea431640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f00d00a33b0 0x7f00d00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00e9c30640 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b7186800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00e0000c00 tx=0x7f00e0032c10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=39686b1b06fe84fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00daffd640 1 -- 172.21.15.70:0/3715109247 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f00d40cf880 con 0x7f00e4101420 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00cffff640 1 -- 172.21.15.70:0/2874141426 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0040070 con 0x5569b717c480 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.274+0000 7f00ea431640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f00d00a33b0 0x7f00d00a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00dc005fd0 tx=0x7f00dc009600 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00cffff640 1 -- 172.21.15.70:0/2874141426 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f00e0031710 con 0x5569b717c480 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00cffff640 1 -- 172.21.15.70:0/2874141426 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0035040 con 0x5569b717c480 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 -- 172.21.15.70:0/2874141426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 msgr2=0x5569b7186800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.281 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b7186800 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f00e0000c00 tx=0x7f00e0032c10 comp rx=0 tx=0).stop 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 -- 172.21.15.70:0/2874141426 shutdown_connections 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b7186d40 0x5569b7189130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b7186800 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 --2- 172.21.15.70:0/2874141426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b717bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 -- 172.21.15.70:0/2874141426 >> 172.21.15.70:0/2874141426 conn(0x5569b71780f0 msgr2=0x5569b71784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 -- 172.21.15.70:0/2874141426 shutdown_connections 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.275+0000 7f00ee26d740 1 -- 172.21.15.70:0/2874141426 wait complete. 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 1 -- start start 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 1 Processor -- start 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 0x5569b7183ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b71840e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b7186d40 0x5569b7184620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5569b718dd20 con 0x5569b7186d40 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5569b709bf10 con 0x5569b717bb60 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5569b718dea0 con 0x5569b717c480 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ee26d740 10 client.0 _ll_register_callbacks cb 0x5569b7064a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ea431640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b7186d40 0x5569b7184620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ea431640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b7186d40 0x5569b7184620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39774/0 (socket says 172.21.15.70:39774) 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00ea431640 1 -- 172.21.15.70:0/3636098523 learned_addr learned my addr 172.21.15.70:0/3636098523 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00e942f640 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b71840e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.276+0000 7f00e9c30640 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 0x5569b7183ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ea431640 1 -- 172.21.15.70:0/3636098523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 msgr2=0x5569b71840e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:36.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ea431640 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b71840e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ea431640 1 -- 172.21.15.70:0/3636098523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 msgr2=0x5569b7183ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ea431640 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 0x5569b7183ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ea431640 1 -- 172.21.15.70:0/3636098523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b6e526a0 con 0x5569b7186d40 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ea431640 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b7186d40 0x5569b7184620 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f00dc011e70 tx=0x7f00dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ecd668ea2e6ce3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00cd7fa640 1 -- 172.21.15.70:0/3636098523 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00dc020620 con 0x5569b7186d40 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ee26d740 1 -- 172.21.15.70:0/3636098523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00e0031710 con 0x5569b7186d40 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00cd7fa640 1 -- 172.21.15.70:0/3636098523 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f00dc0207c0 con 0x5569b7186d40 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00cd7fa640 1 -- 172.21.15.70:0/3636098523 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f00dc0209c0 con 0x5569b7186d40 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ee26d740 10 client.16410 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00ee26d740 1 -- 172.21.15.70:0/3636098523 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569b7199960 con 0x5569b7186d40 2024-09-19T04:36:36.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.277+0000 7f00cd7fa640 1 -- 172.21.15.70:0/3636098523 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f00e0031710 con 0x5569b7186d40 2024-09-19T04:36:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00cd7fa640 1 -- 172.21.15.70:0/3636098523 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f00dc02f020 con 0x5569b7186d40 2024-09-19T04:36:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00ee26d740 10 client.16410 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00ee26d740 10 client.16410 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00ee26d740 20 client.16410 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5569b719adc0 0x5569b719d210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00ee26d740 4 client.16410 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00ee26d740 1 -- 172.21.15.70:0/3636098523 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569b70ee7f0 con 0x5569b719adc0 2024-09-19T04:36:36.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00e9c30640 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5569b719adc0 0x5569b719d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00cd7fa640 10 client.16410 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.278+0000 7f00e9c30640 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5569b719adc0 0x5569b719d210 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a403704dab78d454 server_cookie=12239dacf7fb6f44 in_seq=0 out_seq=0 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00cd7fa640 1 -- 172.21.15.70:0/3636098523 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5569b70ee7f0 con 0x5569b719adc0 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00cd7fa640 10 client.16410 handle_command_reply: tid=0 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 client.16410 shutdown 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 -- 172.21.15.70:0/3636098523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b7186d40 msgr2=0x5569b7184620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b7186d40 0x5569b7184620 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f00dc011e70 tx=0x7f00dc004a40 comp rx=0 tx=0).stop 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 -- 172.21.15.70:0/3636098523 shutdown_connections 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5569b719adc0 0x5569b719d210 crc :-1 s=READY pgs=110 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b7186d40 0x5569b7184620 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b717c480 0x5569b71840e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00cd7fa640 0 client.16410 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3636098523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 0x5569b7183ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.279+0000 7f00ee26d740 1 -- 172.21.15.70:0/3636098523 >> 172.21.15.70:0/3636098523 conn(0x5569b71780f0 msgr2=0x5569b717de20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.280+0000 7f00ee26d740 1 -- 172.21.15.70:0/3636098523 shutdown_connections 2024-09-19T04:36:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.280+0000 7f00ee26d740 1 -- 172.21.15.70:0/3636098523 wait complete. 2024-09-19T04:36:36.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.280+0000 7f00ee26d740 20 client.16410 trim_cache size 0 max 16384 2024-09-19T04:36:36.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.296+0000 7f00ee26d740 1 Processor -- start 2024-09-19T04:36:36.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.296+0000 7f00ee26d740 1 -- start start 2024-09-19T04:36:36.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 0x5569b717e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717c480 0x5569b7183480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b71a2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00ee26d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41adfc0 con 0x5569b717c480 2024-09-19T04:36:36.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00ee26d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41ab7d0 con 0x5569b717bb60 2024-09-19T04:36:36.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00ee26d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41a9620 con 0x5569b7186d40 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717c480 0x5569b7183480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717c480 0x5569b7183480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39784/0 (socket says 172.21.15.70:39784) 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 -- 172.21.15.70:0/3683067993 learned_addr learned my addr 172.21.15.70:0/3683067993 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00ea431640 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b71a2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e9c30640 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 0x5569b717e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 -- 172.21.15.70:0/3683067993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 msgr2=0x5569b71a2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b71a2ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 -- 172.21.15.70:0/3683067993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 msgr2=0x5569b717e5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 0x5569b717e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 -- 172.21.15.70:0/3683067993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569b71861a0 con 0x5569b717c480 2024-09-19T04:36:36.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00ea431640 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b71a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:36.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00e942f640 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717c480 0x5569b7183480 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f00d40cd050 tx=0x7f00d4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=704150095ed7baa3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:36.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00cf7fe640 1 -- 172.21.15.70:0/3683067993 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4020070 con 0x5569b717c480 2024-09-19T04:36:36.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00cf7fe640 1 -- 172.21.15.70:0/3683067993 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f00d40a47f0 con 0x5569b717c480 2024-09-19T04:36:36.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.297+0000 7f00cf7fe640 1 -- 172.21.15.70:0/3683067993 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00d4086310 con 0x5569b717c480 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 -- 172.21.15.70:0/3683067993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717c480 msgr2=0x5569b7183480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717c480 0x5569b7183480 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f00d40cd050 tx=0x7f00d4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 -- 172.21.15.70:0/3683067993 shutdown_connections 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b71a2ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717c480 0x5569b7183480 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 --2- 172.21.15.70:0/3683067993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717bb60 0x5569b717e5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 -- 172.21.15.70:0/3683067993 >> 172.21.15.70:0/3683067993 conn(0x5569b71780f0 msgr2=0x5569b7177270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 -- 172.21.15.70:0/3683067993 shutdown_connections 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 -- 172.21.15.70:0/3683067993 wait complete. 2024-09-19T04:36:36.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 -- start start 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.298+0000 7f00ee26d740 1 Processor -- start 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b718ef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717c480 0x5569b718f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ee26d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b718f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ee26d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41a9c90 con 0x5569b717bb60 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ee26d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41ab100 con 0x5569b717c480 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ee26d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f00e41aa360 con 0x5569b7186d40 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ee26d740 10 client.0 _ll_register_callbacks cb 0x7f00dc009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b718ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b718ef70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39790/0 (socket says 172.21.15.70:39790) 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 -- 172.21.15.70:0/1013906078 learned_addr learned my addr 172.21.15.70:0/1013906078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ea431640 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b718f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 -- 172.21.15.70:0/1013906078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 msgr2=0x5569b718f9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b718f9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 -- 172.21.15.70:0/1013906078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717c480 msgr2=0x5569b718f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717c480 0x5569b718f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 -- 172.21.15.70:0/1013906078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569b7204c10 con 0x5569b717bb60 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00ea431640 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b718f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00e9c30640 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b718ef70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009230 tx=0x7f00e002aae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39b98c26a2929ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00cd7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.299+0000 7f00cd7fa640 1 -- 172.21.15.70:0/1013906078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00e0035040 con 0x5569b717bb60 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00cd7fa640 1 -- 172.21.15.70:0/1013906078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f00e0005590 con 0x5569b717bb60 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 1 -- 172.21.15.70:0/1013906078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00d40a47f0 con 0x5569b717bb60 2024-09-19T04:36:36.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00cd7fa640 1 -- 172.21.15.70:0/1013906078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f00e0040040 con 0x5569b717bb60 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 10 client.16416 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 1 -- 172.21.15.70:0/1013906078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x5569b7205ef0 con 0x5569b717bb60 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00cd7fa640 1 -- 172.21.15.70:0/1013906078 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f00d40a47f0 con 0x5569b717bb60 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00cd7fa640 1 -- 172.21.15.70:0/1013906078 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f00e0052b10 con 0x5569b717bb60 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 10 client.16416 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 10 client.16416 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 20 client.16416 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5569b7206230 0x5569b7208620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 4 client.16416 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00ee26d740 1 -- 172.21.15.70:0/1013906078 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5569b70e8d00 con 0x5569b7206230 2024-09-19T04:36:36.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.300+0000 7f00e942f640 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5569b7206230 0x5569b7208620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.301+0000 7f00e942f640 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5569b7206230 0x5569b7208620 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d68afb25a2b435e5 server_cookie=62dc77bae500b90f in_seq=0 out_seq=0 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.301+0000 7f00cd7fa640 10 client.16416 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00cd7fa640 1 -- 172.21.15.70:0/1013906078 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5569b70e8d00 con 0x5569b7206230 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00cd7fa640 10 client.16416 handle_command_reply: tid=0 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 client.16416 shutdown 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 -- 172.21.15.70:0/1013906078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 msgr2=0x5569b718ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b718ef70 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7f00e0009230 tx=0x7f00e002aae0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 -- 172.21.15.70:0/1013906078 shutdown_connections 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5569b7206230 0x5569b7208620 crc :-1 s=READY pgs=111 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5569b7186d40 0x5569b718f9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5569b717c480 0x5569b718f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00cd7fa640 0 client.16416 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 --2- 172.21.15.70:0/1013906078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5569b717bb60 0x5569b718ef70 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 -- 172.21.15.70:0/1013906078 >> 172.21.15.70:0/1013906078 conn(0x5569b71780f0 msgr2=0x5569b7176a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 -- 172.21.15.70:0/1013906078 shutdown_connections 2024-09-19T04:36:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 1 -- 172.21.15.70:0/1013906078 wait complete. 2024-09-19T04:36:36.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.302+0000 7f00ee26d740 20 client.16416 trim_cache size 0 max 16384 2024-09-19T04:36:36.310 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:36.310 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:36:36.310 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "0dde0ad4-27f3-441e-a5ee-399016bb5dda", 2024-09-19T04:36:36.310 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:36:36.310 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 -- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f00d00a33b0 msgr2=0x7f00d00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f00d00a33b0 0x7f00d00a5870 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f00dc005fd0 tx=0x7f00dc009600 comp rx=0 tx=0).stop 2024-09-19T04:36:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 -- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4101420 msgr2=0x7f00e41997e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4101420 0x7f00e41997e0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f00d400d950 tx=0x7f00d400de10 comp rx=0 tx=0).stop 2024-09-19T04:36:36.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 -- 172.21.15.70:0/3715109247 shutdown_connections 2024-09-19T04:36:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f00d00a33b0 0x7f00d00a5870 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f00e4106a80 0x7f00e41a4320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f00e4101420 0x7f00e41997e0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 --2- 172.21.15.70:0/3715109247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f00e4100a80 0x7f00e41992a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 -- 172.21.15.70:0/3715109247 >> 172.21.15.70:0/3715109247 conn(0x7f00e40fc7a0 msgr2=0x7f00e40fcff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 -- 172.21.15.70:0/3715109247 shutdown_connections 2024-09-19T04:36:36.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:36.303+0000 7f00ebe94640 1 -- 172.21.15.70:0/3715109247 wait complete. 2024-09-19T04:36:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:36 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:36:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:36 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:36 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:36:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:36 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:36.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:36 smithi167 ceph-mon[34339]: pgmap v178: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:36 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:36:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:36 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:36 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:36:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:36 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:36 smithi134 ceph-mon[34525]: pgmap v178: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:37.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:36 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:36:37.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:36 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:37.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:36 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:36:37.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:36 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:37.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:36 smithi070 ceph-mon[30942]: pgmap v178: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:37.164 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:36:37.411 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:37.782 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:37 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 -- 172.21.15.70:0/3947978358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4204102d40 msgr2=0x7f4204103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 --2- 172.21.15.70:0/3947978358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4204102d40 0x7f4204103120 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f4200009900 tx=0x7f420002a480 comp rx=0 tx=0).stop 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 -- 172.21.15.70:0/3947978358 shutdown_connections 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 --2- 172.21.15.70:0/3947978358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f420410c170 0x7f420410e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 --2- 172.21.15.70:0/3947978358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4204103660 0x7f420410bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 --2- 172.21.15.70:0/3947978358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4204102d40 0x7f4204103120 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 -- 172.21.15.70:0/3947978358 >> 172.21.15.70:0/3947978358 conn(0x7f42040fc7a0 msgr2=0x7f42040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 -- 172.21.15.70:0/3947978358 shutdown_connections 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.857+0000 7f420b92d640 1 -- 172.21.15.70:0/3947978358 wait complete. 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f420b92d640 1 Processor -- start 2024-09-19T04:36:37.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f420b92d640 1 -- start start 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f420b92d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4204102d40 0x7f42041984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f420b92d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4204103660 0x7f42041989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f420b92d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f420410c170 0x7f420419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f420b92d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4204111fc0 con 0x7f420410c170 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f420b92d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4204111e40 con 0x7f4204102d40 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f420b92d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4204112140 con 0x7f4204103660 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f4209eca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f420410c170 0x7f420419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f4209eca640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f420410c170 0x7f420419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39802/0 (socket says 172.21.15.70:39802) 2024-09-19T04:36:37.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f4209eca640 1 -- 172.21.15.70:0/2562349472 learned_addr learned my addr 172.21.15.70:0/2562349472 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f4208ec8640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4204103660 0x7f42041989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.858+0000 7f42096c9640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4204102d40 0x7f42041984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f4209eca640 1 -- 172.21.15.70:0/2562349472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4204103660 msgr2=0x7f42041989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f4209eca640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4204103660 0x7f42041989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f4209eca640 1 -- 172.21.15.70:0/2562349472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4204102d40 msgr2=0x7f42041984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f4209eca640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4204102d40 0x7f42041984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f4209eca640 1 -- 172.21.15.70:0/2562349472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f420419d450 con 0x7f420410c170 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f4209eca640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f420410c170 0x7f420419cd70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00b970 tx=0x7f41fc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f41fa7fc640 1 -- 172.21.15.70:0/2562349472 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc019070 con 0x7f420410c170 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f41fa7fc640 1 -- 172.21.15.70:0/2562349472 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f41fc00cb40 con 0x7f420410c170 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f420b92d640 1 -- 172.21.15.70:0/2562349472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f420419d740 con 0x7f420410c170 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f41fa7fc640 1 -- 172.21.15.70:0/2562349472 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41fc007650 con 0x7f420410c170 2024-09-19T04:36:37.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.859+0000 7f420b92d640 1 -- 172.21.15.70:0/2562349472 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42041a5020 con 0x7f420410c170 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.861+0000 7f41fa7fc640 1 -- 172.21.15.70:0/2562349472 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f41fc01c070 con 0x7f420410c170 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.861+0000 7f420dd06740 1 Processor -- start 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f420dd06740 1 -- start start 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f420dd06740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a228880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f420dd06740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a228dc0 0x55648a233140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f420dd06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a233680 0x55648a235a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f420dd06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55648a18e2e0 con 0x55648a233680 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f420dd06740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55648a135ce0 con 0x55648a2284a0 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f420dd06740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55648a18a2a0 con 0x55648a228dc0 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f41fa7fc640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41f00a33b0 0x7f41f00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a233680 0x55648a235a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a233680 0x55648a235a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39814/0 (socket says 172.21.15.70:39814) 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 -- 172.21.15.70:0/4136824434 learned_addr learned my addr 172.21.15.70:0/4136824434 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f42096c9640 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a228dc0 0x55648a233140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4209eca640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41f00a33b0 0x7f41f00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a228880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f41fa7fc640 1 -- 172.21.15.70:0/2562349472 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f41fc0cf270 con 0x7f420410c170 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 -- 172.21.15.70:0/4136824434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a228dc0 msgr2=0x55648a233140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a228dc0 0x55648a233140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 -- 172.21.15.70:0/4136824434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 msgr2=0x55648a228880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a228880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 -- 172.21.15.70:0/4136824434 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55648a11a440 con 0x55648a233680 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.862+0000 7f4208ec8640 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a233680 0x55648a235a70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f41f400bc00 tx=0x7f41f40041f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d453b0ccb3ad6c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:37.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f4209eca640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41f00a33b0 0x7f41f00a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0ccfe0 tx=0x7f41fc07c040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f41ef7fe640 1 -- 172.21.15.70:0/4136824434 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f4005020 con 0x55648a233680 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f41ef7fe640 1 -- 172.21.15.70:0/4136824434 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f41f40047a0 con 0x55648a233680 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f41ef7fe640 1 -- 172.21.15.70:0/4136824434 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41f40106c0 con 0x55648a233680 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 -- 172.21.15.70:0/4136824434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a233680 msgr2=0x55648a235a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a233680 0x55648a235a70 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7f41f400bc00 tx=0x7f41f40041f0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 -- 172.21.15.70:0/4136824434 shutdown_connections 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a233680 0x55648a235a70 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a228dc0 0x55648a233140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 --2- 172.21.15.70:0/4136824434 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a228880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 -- 172.21.15.70:0/4136824434 >> 172.21.15.70:0/4136824434 conn(0x55648a224a30 msgr2=0x55648a224e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 -- 172.21.15.70:0/4136824434 shutdown_connections 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.863+0000 7f420dd06740 1 -- 172.21.15.70:0/4136824434 wait complete. 2024-09-19T04:36:37.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 1 -- start start 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 1 Processor -- start 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a233010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a2302c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a230840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55648a236250 con 0x55648a228dc0 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55648a149050 con 0x55648a2284a0 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55648a2363d0 con 0x55648a233680 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.864+0000 7f420dd06740 10 client.0 _ll_register_callbacks cb 0x55648a189160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a2302c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a2302c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39818/0 (socket says 172.21.15.70:39818) 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 -- 172.21.15.70:0/1509906375 learned_addr learned my addr 172.21.15.70:0/1509906375 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a233010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.897 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a230840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 -- 172.21.15.70:0/1509906375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 msgr2=0x55648a230840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a230840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 -- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 msgr2=0x55648a233010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a233010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 -- 172.21.15.70:0/1509906375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556489eff3c0 con 0x55648a228dc0 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a233010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f42096c9640 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a2302c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4200009900 tx=0x7f4200031510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91d93eb0540bd97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f41ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f41ecff9640 1 -- 172.21.15.70:0/1509906375 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200035040 con 0x55648a228dc0 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f41ecff9640 1 -- 172.21.15.70:0/1509906375 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4200004040 con 0x55648a228dc0 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f420dd06740 1 -- 172.21.15.70:0/1509906375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f41f40047a0 con 0x55648a228dc0 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f41ecff9640 1 -- 172.21.15.70:0/1509906375 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4200004240 con 0x55648a228dc0 2024-09-19T04:36:37.898 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f420dd06740 10 client.16428 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.865+0000 7f420dd06740 1 -- 172.21.15.70:0/1509906375 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55648a241c40 con 0x55648a228dc0 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f41ecff9640 1 -- 172.21.15.70:0/1509906375 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f41f40047a0 con 0x55648a228dc0 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f41ecff9640 1 -- 172.21.15.70:0/1509906375 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f420004d020 con 0x55648a228dc0 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f420dd06740 10 client.16428 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f420dd06740 10 client.16428 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f420dd06740 20 client.16428 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f420dd06740 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55648a2430a0 0x55648a2454e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f420dd06740 4 client.16428 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f420dd06740 1 -- 172.21.15.70:0/1509906375 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55648a19b850 con 0x55648a2430a0 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.866+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55648a2430a0 0x55648a2454e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.867+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55648a2430a0 0x55648a2454e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc4b6cfa86947e3e server_cookie=3dc77e037126fa2e in_seq=0 out_seq=0 2024-09-19T04:36:37.899 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.867+0000 7f41ecff9640 10 client.16428 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.867+0000 7f41ecff9640 1 -- 172.21.15.70:0/1509906375 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55648a19b850 con 0x55648a2430a0 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.867+0000 7f41ecff9640 10 client.16428 handle_command_reply: tid=0 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 client.16428 shutdown 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 -- 172.21.15.70:0/1509906375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 msgr2=0x55648a2302c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a2302c0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7f4200009900 tx=0x7f4200031510 comp rx=0 tx=0).stop 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 -- 172.21.15.70:0/1509906375 shutdown_connections 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55648a2430a0 0x55648a2454e0 crc :-1 s=READY pgs=112 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a230840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a2302c0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 --2- 172.21.15.70:0/1509906375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a233010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 -- 172.21.15.70:0/1509906375 >> 172.21.15.70:0/1509906375 conn(0x55648a224a30 msgr2=0x55648a22a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f41ecff9640 0 client.16428 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:37.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 -- 172.21.15.70:0/1509906375 shutdown_connections 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 1 -- 172.21.15.70:0/1509906375 wait complete. 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.868+0000 7f420dd06740 20 client.16428 trim_cache size 0 max 16384 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f420dd06740 1 Processor -- start 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f420dd06740 1 -- start start 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f420dd06740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a23f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f420dd06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a22b700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f420dd06740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a24adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f420dd06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42041b0160 con 0x55648a228dc0 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f420dd06740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f42041ad970 con 0x55648a2284a0 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f420dd06740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42041ab7c0 con 0x55648a233680 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a22b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a22b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39820/0 (socket says 172.21.15.70:39820) 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 -- 172.21.15.70:0/3137977862 learned_addr learned my addr 172.21.15.70:0/3137977862 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:37.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 -- 172.21.15.70:0/3137977862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 msgr2=0x55648a24adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 --2- 172.21.15.70:0/3137977862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a24adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 -- 172.21.15.70:0/3137977862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 msgr2=0x55648a23f4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 --2- 172.21.15.70:0/3137977862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a23f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 -- 172.21.15.70:0/3137977862 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55648a233380 con 0x55648a228dc0 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f42096c9640 1 --2- 172.21.15.70:0/3137977862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a22b700 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4200006010 tx=0x7f4200000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cfb69f7f7e6bbee8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.885+0000 7f41eeffd640 1 -- 172.21.15.70:0/3137977862 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f42000043e0 con 0x55648a228dc0 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.886+0000 7f41eeffd640 1 -- 172.21.15.70:0/3137977862 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f42000317c0 con 0x55648a228dc0 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.886+0000 7f41eeffd640 1 -- 172.21.15.70:0/3137977862 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200003df0 con 0x55648a228dc0 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.886+0000 7f420dd06740 1 -- 172.21.15.70:0/3137977862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 msgr2=0x55648a22b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.886+0000 7f420dd06740 1 --2- 172.21.15.70:0/3137977862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a22b700 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4200006010 tx=0x7f4200000bc0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.886+0000 7f420dd06740 1 -- 172.21.15.70:0/3137977862 shutdown_connections 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.886+0000 7f420dd06740 1 --2- 172.21.15.70:0/3137977862 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a24adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.886+0000 7f420dd06740 1 --2- 172.21.15.70:0/3137977862 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a22b700 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.886+0000 7f420dd06740 1 --2- 172.21.15.70:0/3137977862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a23f4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 -- 172.21.15.70:0/3137977862 >> 172.21.15.70:0/3137977862 conn(0x55648a224a30 msgr2=0x55648a232340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 -- 172.21.15.70:0/3137977862 shutdown_connections 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 -- 172.21.15.70:0/3137977862 wait complete. 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 -- start start 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 Processor -- start 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a23bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a237270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a237a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f42041abe30 con 0x55648a228dc0 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f42041ad2a0 con 0x55648a2284a0 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.887+0000 7f420dd06740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f42041ac500 con 0x55648a233680 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f420dd06740 10 client.0 _ll_register_callbacks cb 0x7f4200005d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a237270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a237270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39822/0 (socket says 172.21.15.70:39822) 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 -- 172.21.15.70:0/1935609244 learned_addr learned my addr 172.21.15.70:0/1935609244 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a23bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a237a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 -- 172.21.15.70:0/1935609244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 msgr2=0x55648a237a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a237a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 -- 172.21.15.70:0/1935609244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 msgr2=0x55648a23bf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a23bf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 -- 172.21.15.70:0/1935609244 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55648a2acd80 con 0x55648a228dc0 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f42096c9640 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a237270 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4200033000 tx=0x7f4200004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f31986f8d5763a79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f41ecff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f41ecff9640 1 -- 172.21.15.70:0/1935609244 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4200035070 con 0x55648a228dc0 2024-09-19T04:36:37.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f41ecff9640 1 -- 172.21.15.70:0/1935609244 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4200046680 con 0x55648a228dc0 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f420dd06740 1 -- 172.21.15.70:0/1935609244 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f42000317c0 con 0x55648a228dc0 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f41ecff9640 1 -- 172.21.15.70:0/1935609244 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f4200046880 con 0x55648a228dc0 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f420dd06740 10 client.16434 fetch_fsmap learned FSMap version 29 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.888+0000 7f420dd06740 1 -- 172.21.15.70:0/1935609244 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55648a2adf70 con 0x55648a228dc0 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f41ecff9640 1 -- 172.21.15.70:0/1935609244 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f42000317c0 con 0x55648a228dc0 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f41ecff9640 1 -- 172.21.15.70:0/1935609244 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 29) ==== 8366+0+0 (secure 0 0 0) 0x7f4200061070 con 0x55648a228dc0 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f420dd06740 10 client.16434 fetch_fsmap finished waiting for FSMap version 29 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f420dd06740 10 client.16434 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f420dd06740 20 client.16434 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f420dd06740 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55648a2ae5d0 0x55648a2b09f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f420dd06740 4 client.16434 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f420dd06740 1 -- 172.21.15.70:0/1935609244 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55648a195d60 con 0x55648a2ae5d0 2024-09-19T04:36:37.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.889+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55648a2ae5d0 0x55648a2b09f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:37.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f41ecff9640 10 client.16434 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:37.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f4208ec8640 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55648a2ae5d0 0x55648a2b09f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=60ed28d6e0753d2b server_cookie=1aaa9cf683a3dfc2 in_seq=0 out_seq=0 2024-09-19T04:36:37.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f41ecff9640 1 -- 172.21.15.70:0/1935609244 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55648a195d60 con 0x55648a2ae5d0 2024-09-19T04:36:37.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f41ecff9640 10 client.16434 handle_command_reply: tid=0 2024-09-19T04:36:37.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 client.16434 shutdown 2024-09-19T04:36:37.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 -- 172.21.15.70:0/1935609244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 msgr2=0x55648a237270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.907 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a237270 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f4200033000 tx=0x7f4200004610 comp rx=0 tx=0).stop 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 -- 172.21.15.70:0/1935609244 shutdown_connections 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55648a2ae5d0 0x55648a2b09f0 crc :-1 s=READY pgs=113 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55648a233680 0x55648a237a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55648a228dc0 0x55648a237270 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 --2- 172.21.15.70:0/1935609244 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55648a2284a0 0x55648a23bf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 -- 172.21.15.70:0/1935609244 >> 172.21.15.70:0/1935609244 conn(0x55648a224a30 msgr2=0x55648a231b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f41ecff9640 0 client.16434 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 -- 172.21.15.70:0/1935609244 shutdown_connections 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 1 -- 172.21.15.70:0/1935609244 wait complete. 2024-09-19T04:36:37.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.890+0000 7f420dd06740 20 client.16434 trim_cache size 0 max 16384 2024-09-19T04:36:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:36:37.909 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:36:37.909 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:37.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 -- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41f00a33b0 msgr2=0x7f41f00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41f00a33b0 0x7f41f00a5870 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f41fc0ccfe0 tx=0x7f41fc07c040 comp rx=0 tx=0).stop 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 -- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f420410c170 msgr2=0x7f420419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f420410c170 0x7f420419cd70 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f41fc00b970 tx=0x7f41fc00be30 comp rx=0 tx=0).stop 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 -- 172.21.15.70:0/2562349472 shutdown_connections 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41f00a33b0 0x7f41f00a5870 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f420410c170 0x7f420419cd70 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4204103660 0x7f42041989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 --2- 172.21.15.70:0/2562349472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4204102d40 0x7f42041984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 -- 172.21.15.70:0/2562349472 >> 172.21.15.70:0/2562349472 conn(0x7f42040fc7a0 msgr2=0x7f42040fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 -- 172.21.15.70:0/2562349472 shutdown_connections 2024-09-19T04:36:37.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:37.891+0000 7f420b92d640 1 -- 172.21.15.70:0/2562349472 wait complete. 2024-09-19T04:36:37.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:37 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:36:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:37 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:36:38.722 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:36:38.804 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:36:38.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:38 smithi167 ceph-mon[34339]: pgmap v179: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:38 smithi134 ceph-mon[34525]: pgmap v179: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:39.050 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:39.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:38 smithi070 ceph-mon[30942]: pgmap v179: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:39.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 -- 172.21.15.70:0/3547865345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac48102e00 msgr2=0x7fac481031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:39.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 --2- 172.21.15.70:0/3547865345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac48102e00 0x7fac481031e0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7fac44009900 tx=0x7fac4402a480 comp rx=0 tx=0).stop 2024-09-19T04:36:39.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 -- 172.21.15.70:0/3547865345 shutdown_connections 2024-09-19T04:36:39.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 --2- 172.21.15.70:0/3547865345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac4810c1a0 0x7fac4810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 --2- 172.21.15.70:0/3547865345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48103720 0x7fac4810bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 --2- 172.21.15.70:0/3547865345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac48102e00 0x7fac481031e0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 -- 172.21.15.70:0/3547865345 >> 172.21.15.70:0/3547865345 conn(0x7fac480fc7a0 msgr2=0x7fac480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 -- 172.21.15.70:0/3547865345 shutdown_connections 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.458+0000 7fac4ff68640 1 -- 172.21.15.70:0/3547865345 wait complete. 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4ff68640 1 Processor -- start 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4ff68640 1 -- start start 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4ff68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac48102e00 0x7fac48100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4ff68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48103720 0x7fac48100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4ff68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac4810c1a0 0x7fac481014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:39.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4ff68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fac48112020 con 0x7fac4810c1a0 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4ff68640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fac48111ea0 con 0x7fac48102e00 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4ff68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fac481121a0 con 0x7fac48103720 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4e505640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac4810c1a0 0x7fac481014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4e505640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac4810c1a0 0x7fac481014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39854/0 (socket says 172.21.15.70:39854) 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4e505640 1 -- 172.21.15.70:0/2490744930 learned_addr learned my addr 172.21.15.70:0/2490744930 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4d503640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48103720 0x7fac48100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4dd04640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac48102e00 0x7fac48100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4e505640 1 -- 172.21.15.70:0/2490744930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48103720 msgr2=0x7fac48100fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4e505640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48103720 0x7fac48100fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4e505640 1 -- 172.21.15.70:0/2490744930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac48102e00 msgr2=0x7fac48100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:39.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4e505640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac48102e00 0x7fac48100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4e505640 1 -- 172.21.15.70:0/2490744930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fac481a6a60 con 0x7fac4810c1a0 2024-09-19T04:36:39.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.459+0000 7fac4dd04640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac48102e00 0x7fac48100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:39.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.460+0000 7fac4e505640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac4810c1a0 0x7fac481014e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fac4000b970 tx=0x7fac4000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:39.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.460+0000 7fac3effd640 1 -- 172.21.15.70:0/2490744930 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac40019070 con 0x7fac4810c1a0 2024-09-19T04:36:39.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.460+0000 7fac3effd640 1 -- 172.21.15.70:0/2490744930 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fac40014440 con 0x7fac4810c1a0 2024-09-19T04:36:39.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.460+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fac481a6d50 con 0x7fac4810c1a0 2024-09-19T04:36:39.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.460+0000 7fac3effd640 1 -- 172.21.15.70:0/2490744930 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fac400075d0 con 0x7fac4810c1a0 2024-09-19T04:36:39.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.460+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fac481a7290 con 0x7fac4810c1a0 2024-09-19T04:36:39.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.461+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fac48103260 con 0x7fac4810c1a0 2024-09-19T04:36:39.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.462+0000 7fac3effd640 1 -- 172.21.15.70:0/2490744930 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fac4001c070 con 0x7fac4810c1a0 2024-09-19T04:36:39.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.463+0000 7fac3effd640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fac340a3430 0x7fac340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:39.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.463+0000 7fac3effd640 1 -- 172.21.15.70:0/2490744930 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fac400cf5e0 con 0x7fac4810c1a0 2024-09-19T04:36:39.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.463+0000 7fac4dd04640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fac340a3430 0x7fac340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:39.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.463+0000 7fac4dd04640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fac340a3430 0x7fac340a58f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac44005ab0 tx=0x7fac44005a20 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:39.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.466+0000 7fac3effd640 1 -- 172.21.15.70:0/2490744930 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fac4009c0f0 con 0x7fac4810c1a0 2024-09-19T04:36:39.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.664+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fac48101f90 con 0x7fac4810c1a0 2024-09-19T04:36:39.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.665+0000 7fac3effd640 1 -- 172.21.15.70:0/2490744930 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 29 v29) ==== 94+0+11921 (secure 0 0 0) 0x7fac48101f90 con 0x7fac4810c1a0 2024-09-19T04:36:39.667 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:36:39.667 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":29,"btime":"2024-09-19T04:36:22:647262+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":29,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:36:22.597170+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:36:39.667 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 29 2024-09-19T04:36:39.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fac340a3430 msgr2=0x7fac340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:39.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fac340a3430 0x7fac340a58f0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fac44005ab0 tx=0x7fac44005a20 comp rx=0 tx=0).stop 2024-09-19T04:36:39.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac4810c1a0 msgr2=0x7fac481014e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:39.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac4810c1a0 0x7fac481014e0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fac4000b970 tx=0x7fac4000bd70 comp rx=0 tx=0).stop 2024-09-19T04:36:39.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 shutdown_connections 2024-09-19T04:36:39.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fac340a3430 0x7fac340a58f0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fac4810c1a0 0x7fac481014e0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fac48103720 0x7fac48100fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 --2- 172.21.15.70:0/2490744930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fac48102e00 0x7fac48100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:39.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 >> 172.21.15.70:0/2490744930 conn(0x7fac480fc7a0 msgr2=0x7fac480fe100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:39.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 shutdown_connections 2024-09-19T04:36:39.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:39.667+0000 7fac4ff68640 1 -- 172.21.15.70:0/2490744930 wait complete. 2024-09-19T04:36:39.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:39 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2490744930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:39.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:39 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2490744930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:40.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:39 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2490744930' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:40.440 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:36:40.686 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:40.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:40 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:40.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:40 smithi167 ceph-mon[34339]: pgmap v180: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:40.973 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:40 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:40.973 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:40 smithi070 ceph-mon[30942]: pgmap v180: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:40 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:40 smithi134 ceph-mon[34525]: pgmap v180: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:41.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 -- 172.21.15.70:0/736217263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 msgr2=0x7f6b7c10ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 --2- 172.21.15.70:0/736217263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 0x7f6b7c10ea90 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f6b74009ca0 tx=0x7f6b7402a8c0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 -- 172.21.15.70:0/736217263 shutdown_connections 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 --2- 172.21.15.70:0/736217263 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 0x7f6b7c10ea90 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 --2- 172.21.15.70:0/736217263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b7c102790 0x7f6b7c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 --2- 172.21.15.70:0/736217263 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c101de0 0x7f6b7c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 -- 172.21.15.70:0/736217263 >> 172.21.15.70:0/736217263 conn(0x7f6b7c0fd8c0 msgr2=0x7f6b7c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 -- 172.21.15.70:0/736217263 shutdown_connections 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.168+0000 7f6b820bf640 1 -- 172.21.15.70:0/736217263 wait complete. 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.169+0000 7f6b820bf640 1 Processor -- start 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.169+0000 7f6b820bf640 1 -- start start 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.169+0000 7f6b820bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b7c101de0 0x7f6b7c198300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.169+0000 7f6b820bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c102790 0x7f6b7c198840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.169+0000 7f6b820bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 0x7f6b7c19cbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.169+0000 7f6b820bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c111f40 con 0x7f6b7c106f10 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.169+0000 7f6b820bf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c111dc0 con 0x7f6b7c101de0 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b820bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1120c0 con 0x7f6b7c102790 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 0x7f6b7c19cbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 0x7f6b7c19cbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39874/0 (socket says 172.21.15.70:39874) 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 -- 172.21.15.70:0/3609981400 learned_addr learned my addr 172.21.15.70:0/3609981400 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7affd640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c102790 0x7f6b7c198840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7b7fe640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b7c101de0 0x7f6b7c198300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 -- 172.21.15.70:0/3609981400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c102790 msgr2=0x7f6b7c198840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c102790 0x7f6b7c198840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 -- 172.21.15.70:0/3609981400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b7c101de0 msgr2=0x7f6b7c198300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b7c101de0 0x7f6b7c198300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 -- 172.21.15.70:0/3609981400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b7c19d2b0 con 0x7f6b7c106f10 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b7bfff640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 0x7f6b7c19cbd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6b740097b0 tx=0x7f6b74003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b78ff9640 1 -- 172.21.15.70:0/3609981400 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b740317d0 con 0x7f6b7c106f10 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b820bf640 1 -- 172.21.15.70:0/3609981400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b7c19d540 con 0x7f6b7c106f10 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b78ff9640 1 -- 172.21.15.70:0/3609981400 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6b74031970 con 0x7f6b7c106f10 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b78ff9640 1 -- 172.21.15.70:0/3609981400 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7402fc70 con 0x7f6b7c106f10 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.170+0000 7f6b820bf640 1 -- 172.21.15.70:0/3609981400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b7c1a4e80 con 0x7f6b7c106f10 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.173+0000 7f6b78ff9640 1 -- 172.21.15.70:0/3609981400 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6b74004040 con 0x7f6b7c106f10 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.173+0000 7f6b84498740 1 Processor -- start 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.173+0000 7f6b84498740 1 -- start start 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b84498740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c2b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b84498740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c2ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b84498740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c3cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b84498740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d429b912f0 con 0x55d429c3a780 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b84498740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d429b38cf0 con 0x55d429c2b5d0 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b84498740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d429b8d2b0 con 0x55d429c2cb40 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c3cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c3cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39890/0 (socket says 172.21.15.70:39890) 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 -- 172.21.15.70:0/2616376182 learned_addr learned my addr 172.21.15.70:0/2616376182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c2b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7b7fe640 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c2ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b78ff9640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6b640a33b0 0x7f6b640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 -- 172.21.15.70:0/2616376182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 msgr2=0x55d429c2b090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c2b090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 -- 172.21.15.70:0/2616376182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 msgr2=0x55d429c2ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:41.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c2ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 -- 172.21.15.70:0/2616376182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d429b1d3a0 con 0x55d429c3a780 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7bfff640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6b640a33b0 0x7f6b640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b7affd640 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c3cb70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6b70011770 tx=0x7f6b7000a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3f5aa03fb0617d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b61ffb640 1 -- 172.21.15.70:0/2616376182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70005020 con 0x55d429c3a780 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.174+0000 7f6b78ff9640 1 -- 172.21.15.70:0/3609981400 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f6b740f1290 con 0x7f6b7c106f10 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b61ffb640 1 -- 172.21.15.70:0/2616376182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6b700047a0 con 0x55d429c3a780 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b61ffb640 1 -- 172.21.15.70:0/2616376182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7000f9c0 con 0x55d429c3a780 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 -- 172.21.15.70:0/2616376182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 msgr2=0x55d429c3cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b7bfff640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6b640a33b0 0x7f6b640a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b740eebc0 tx=0x7f6b740c1040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c3cb70 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f6b70011770 tx=0x7f6b7000a6e0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 -- 172.21.15.70:0/2616376182 shutdown_connections 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c3cb70 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c2ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 --2- 172.21.15.70:0/2616376182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c2b090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 -- 172.21.15.70:0/2616376182 >> 172.21.15.70:0/2616376182 conn(0x55d429bf4310 msgr2=0x55d429c27c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 -- 172.21.15.70:0/2616376182 shutdown_connections 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.175+0000 7f6b84498740 1 -- 172.21.15.70:0/2616376182 wait complete. 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 1 -- start start 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 1 Processor -- start 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c3a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c37480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c37c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d429c3d480 con 0x55d429c3a780 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d429b4c060 con 0x55d429c2b5d0 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d429c3d600 con 0x55d429c2cb40 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b84498740 10 client.0 _ll_register_callbacks cb 0x55d42989f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:41.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c37c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c37c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39906/0 (socket says 172.21.15.70:39906) 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b7affd640 1 -- 172.21.15.70:0/1490962767 learned_addr learned my addr 172.21.15.70:0/1490962767 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b7b7fe640 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c37480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.176+0000 7f6b7affd640 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c3a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b7affd640 1 -- 172.21.15.70:0/1490962767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 msgr2=0x55d429c37480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b7affd640 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c37480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b7affd640 1 -- 172.21.15.70:0/1490962767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 msgr2=0x55d429c3a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b7affd640 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c3a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b7affd640 1 -- 172.21.15.70:0/1490962767 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4299023c0 con 0x55d429c3a780 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b7affd640 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c37c10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6b70011fb0 tx=0x7f6b70004700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d550bd23fa2e48f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:41.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b5affd640 1 -- 172.21.15.70:0/1490962767 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70022020 con 0x55d429c3a780 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 1 -- 172.21.15.70:0/1490962767 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b700047a0 con 0x55d429c3a780 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b5affd640 1 -- 172.21.15.70:0/1490962767 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f6b7000f7c0 con 0x55d429c3a780 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b5affd640 1 -- 172.21.15.70:0/1490962767 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6b7000f9c0 con 0x55d429c3a780 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 10 client.16452 fetch_fsmap learned FSMap version 30 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 1 -- 172.21.15.70:0/1490962767 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d429c48f90 con 0x55d429c3a780 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b5affd640 1 -- 172.21.15.70:0/1490962767 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6b700047a0 con 0x55d429c3a780 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b5affd640 1 -- 172.21.15.70:0/1490962767 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6b7002e020 con 0x55d429c3a780 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 10 client.16452 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 10 client.16452 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 20 client.16452 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55d429c4a2e0 0x55d429c4c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 4 client.16452 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.177+0000 7f6b84498740 1 -- 172.21.15.70:0/1490962767 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d429b9e860 con 0x55d429c4a2e0 2024-09-19T04:36:41.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.178+0000 7f6b7b7fe640 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55d429c4a2e0 0x55d429c4c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.178+0000 7f6b7b7fe640 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55d429c4a2e0 0x55d429c4c6d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9ce33ce421daf406 server_cookie=7ac64faaf8194e9c in_seq=0 out_seq=0 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.178+0000 7f6b5affd640 10 client.16452 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b5affd640 1 -- 172.21.15.70:0/1490962767 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d429b9e860 con 0x55d429c4a2e0 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b5affd640 10 client.16452 handle_command_reply: tid=0 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 client.16452 shutdown 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 -- 172.21.15.70:0/1490962767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 msgr2=0x55d429c37c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c37c10 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7f6b70011fb0 tx=0x7f6b70004700 comp rx=0 tx=0).stop 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 -- 172.21.15.70:0/1490962767 shutdown_connections 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55d429c4a2e0 0x55d429c4c6d0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c37c10 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c37480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 --2- 172.21.15.70:0/1490962767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c3a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b5affd640 0 client.16452 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 -- 172.21.15.70:0/1490962767 >> 172.21.15.70:0/1490962767 conn(0x55d429bf4310 msgr2=0x55d429c2d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 -- 172.21.15.70:0/1490962767 shutdown_connections 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 1 -- 172.21.15.70:0/1490962767 wait complete. 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.179+0000 7f6b84498740 20 client.16452 trim_cache size 0 max 16384 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b84498740 1 Processor -- start 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b84498740 1 -- start start 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b84498740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c37b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b84498740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c51e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b84498740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c523a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b84498740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1ade10 con 0x55d429c3a780 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b84498740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1ab650 con 0x55d429c2b5d0 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b84498740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1a94a0 con 0x55d429c2cb40 2024-09-19T04:36:41.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c523a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c523a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39910/0 (socket says 172.21.15.70:39910) 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 -- 172.21.15.70:0/872310695 learned_addr learned my addr 172.21.15.70:0/872310695 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 -- 172.21.15.70:0/872310695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 msgr2=0x55d429c51e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 --2- 172.21.15.70:0/872310695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c51e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 -- 172.21.15.70:0/872310695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 msgr2=0x55d429c37b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 --2- 172.21.15.70:0/872310695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c37b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 -- 172.21.15.70:0/872310695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d429c359d0 con 0x55d429c3a780 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b7affd640 1 --2- 172.21.15.70:0/872310695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c523a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6b70005700 tx=0x7f6b7000a550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce63ba30b11f500 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.192+0000 7f6b617fa640 1 -- 172.21.15.70:0/872310695 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70022070 con 0x55d429c3a780 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b617fa640 1 -- 172.21.15.70:0/872310695 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6b70004770 con 0x55d429c3a780 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b617fa640 1 -- 172.21.15.70:0/872310695 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b7001e470 con 0x55d429c3a780 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 -- 172.21.15.70:0/872310695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 msgr2=0x55d429c523a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.243 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 --2- 172.21.15.70:0/872310695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c523a0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f6b70005700 tx=0x7f6b7000a550 comp rx=0 tx=0).stop 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 -- 172.21.15.70:0/872310695 shutdown_connections 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 --2- 172.21.15.70:0/872310695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c523a0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 --2- 172.21.15.70:0/872310695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2cb40 0x55d429c51e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 --2- 172.21.15.70:0/872310695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2b5d0 0x55d429c37b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 -- 172.21.15.70:0/872310695 >> 172.21.15.70:0/872310695 conn(0x55d429bf4310 msgr2=0x55d429c22a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 -- 172.21.15.70:0/872310695 shutdown_connections 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 -- 172.21.15.70:0/872310695 wait complete. 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.193+0000 7f6b84498740 1 -- start start 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b84498740 1 Processor -- start 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b84498740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2b5d0 0x55d429c42b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b84498740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2cb40 0x55d429c430b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b84498740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c33e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.244 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b84498740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1a9b10 con 0x55d429c3a780 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b84498740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1aaf80 con 0x55d429c2cb40 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b84498740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6b7c1aa1e0 con 0x55d429c2b5d0 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b84498740 10 client.0 _ll_register_callbacks cb 0x7f6b7000adf0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c33e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c33e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39918/0 (socket says 172.21.15.70:39918) 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 -- 172.21.15.70:0/2134691175 learned_addr learned my addr 172.21.15.70:0/2134691175 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7b7fe640 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2cb40 0x55d429c430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2b5d0 0x55d429c42b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 -- 172.21.15.70:0/2134691175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2b5d0 msgr2=0x55d429c42b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2b5d0 0x55d429c42b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 -- 172.21.15.70:0/2134691175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2cb40 msgr2=0x55d429c430b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2cb40 0x55d429c430b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 -- 172.21.15.70:0/2134691175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d429c34610 con 0x55d429c3a780 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b7affd640 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c33e40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6b7001ee40 tx=0x7f6b70016040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4fe09d790837ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.194+0000 7f6b5affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b5affd640 1 -- 172.21.15.70:0/2134691175 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b70022070 con 0x55d429c3a780 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b5affd640 1 -- 172.21.15.70:0/2134691175 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f6b7001e670 con 0x55d429c3a780 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 1 -- 172.21.15.70:0/2134691175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6b70004770 con 0x55d429c3a780 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b5affd640 1 -- 172.21.15.70:0/2134691175 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=30) ==== 24+0+0 (secure 0 0 0) 0x7f6b7001e870 con 0x55d429c3a780 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 10 client.16458 fetch_fsmap learned FSMap version 30 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 1 -- 172.21.15.70:0/2134691175 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=30,monmap=4+}) -- 0x55d429cb49f0 con 0x55d429c3a780 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b5affd640 1 -- 172.21.15.70:0/2134691175 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6b70004770 con 0x55d429c3a780 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b5affd640 1 -- 172.21.15.70:0/2134691175 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 30) ==== 8362+0+0 (secure 0 0 0) 0x7f6b7001ca70 con 0x55d429c3a780 2024-09-19T04:36:41.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 10 client.16458 fetch_fsmap finished waiting for FSMap version 30 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 10 client.16458 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 20 client.16458 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55d429cb4fa0 0x55d429cb7390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 4 client.16458 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b84498740 1 -- 172.21.15.70:0/2134691175 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d429b98d70 con 0x55d429cb4fa0 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.195+0000 7f6b7b7fe640 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55d429cb4fa0 0x55d429cb7390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b7b7fe640 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55d429cb4fa0 0x55d429cb7390 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ca3fde37254965b server_cookie=316d852354ca5cc3 in_seq=0 out_seq=0 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b5affd640 10 client.16458 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b5affd640 1 -- 172.21.15.70:0/2134691175 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d429b98d70 con 0x55d429cb4fa0 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b5affd640 10 client.16458 handle_command_reply: tid=0 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 client.16458 shutdown 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 -- 172.21.15.70:0/2134691175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 msgr2=0x55d429c33e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c33e40 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f6b7001ee40 tx=0x7f6b70016040 comp rx=0 tx=0).stop 2024-09-19T04:36:41.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 -- 172.21.15.70:0/2134691175 shutdown_connections 2024-09-19T04:36:41.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55d429cb4fa0 0x55d429cb7390 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d429c3a780 0x55d429c33e40 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d429c2cb40 0x55d429c430b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b5affd640 0 client.16458 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:41.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 --2- 172.21.15.70:0/2134691175 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d429c2b5d0 0x55d429c42b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 -- 172.21.15.70:0/2134691175 >> 172.21.15.70:0/2134691175 conn(0x55d429bf4310 msgr2=0x55d429c38ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:41.248 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 -- 172.21.15.70:0/2134691175 shutdown_connections 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 1 -- 172.21.15.70:0/2134691175 wait complete. 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.196+0000 7f6b84498740 20 client.16458 trim_cache size 0 max 16384 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 -- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6b640a33b0 msgr2=0x7f6b640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6b640a33b0 0x7f6b640a5870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f6b740eebc0 tx=0x7f6b740c1040 comp rx=0 tx=0).stop 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 -- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 msgr2=0x7f6b7c19cbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 0x7f6b7c19cbd0 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f6b740097b0 tx=0x7f6b74003f30 comp rx=0 tx=0).stop 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 -- 172.21.15.70:0/3609981400 shutdown_connections 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6b640a33b0 0x7f6b640a5870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6b7c106f10 0x7f6b7c19cbd0 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6b7c102790 0x7f6b7c198840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 --2- 172.21.15.70:0/3609981400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b7c101de0 0x7f6b7c198300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:41.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 -- 172.21.15.70:0/3609981400 >> 172.21.15.70:0/3609981400 conn(0x7f6b7c0fd8c0 msgr2=0x7f6b7c0fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:41.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 -- 172.21.15.70:0/3609981400 shutdown_connections 2024-09-19T04:36:41.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:41.197+0000 7f6b820bf640 1 -- 172.21.15.70:0/3609981400 wait complete. 2024-09-19T04:36:42.057 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:36:42.301 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:42.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 -- 172.21.15.70:0/2294275844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00100e20 msgr2=0x7f0e00101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 --2- 172.21.15.70:0/2294275844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00100e20 0x7f0e00101200 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc009900 tx=0x7f0dfc02a480 comp rx=0 tx=0).stop 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 -- 172.21.15.70:0/2294275844 shutdown_connections 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 --2- 172.21.15.70:0/2294275844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e00102ef0 0x7f0e0010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 --2- 172.21.15.70:0/2294275844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e00102570 0x7f0e001029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 --2- 172.21.15.70:0/2294275844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00100e20 0x7f0e00101200 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 -- 172.21.15.70:0/2294275844 >> 172.21.15.70:0/2294275844 conn(0x7f0e000fc7d0 msgr2=0x7f0e000febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 -- 172.21.15.70:0/2294275844 shutdown_connections 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.720+0000 7f0e07375640 1 -- 172.21.15.70:0/2294275844 wait complete. 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e07375640 1 Processor -- start 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e07375640 1 -- start start 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e07375640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e00100e20 0x7f0e00197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e07375640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e00102570 0x7f0e001979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e07375640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00102ef0 0x7f0e0019bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e07375640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e00110f50 con 0x7f0e00102ef0 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e07375640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e00110dd0 con 0x7f0e00100e20 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e07375640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001110d0 con 0x7f0e00102570 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e05912640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00102ef0 0x7f0e0019bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e05912640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00102ef0 0x7f0e0019bd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39936/0 (socket says 172.21.15.70:39936) 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e05912640 1 -- 172.21.15.70:0/4169727216 learned_addr learned my addr 172.21.15.70:0/4169727216 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e04910640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e00102570 0x7f0e001979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e05111640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e00100e20 0x7f0e00197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e05912640 1 -- 172.21.15.70:0/4169727216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e00102570 msgr2=0x7f0e001979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e05912640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e00102570 0x7f0e001979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e05912640 1 -- 172.21.15.70:0/4169727216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e00100e20 msgr2=0x7f0e00197490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.721+0000 7f0e05912640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e00100e20 0x7f0e00197490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.722+0000 7f0e05912640 1 -- 172.21.15.70:0/4169727216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e0019c440 con 0x7f0e00102ef0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.722+0000 7f0e05912640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00102ef0 0x7f0e0019bd60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0df800eca0 tx=0x7f0df800b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.722+0000 7f0df67fc640 1 -- 172.21.15.70:0/4169727216 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8004b20 con 0x7f0e00102ef0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.722+0000 7f0df67fc640 1 -- 172.21.15.70:0/4169727216 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0df8004cc0 con 0x7f0e00102ef0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.722+0000 7f0e07375640 1 -- 172.21.15.70:0/4169727216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e0019c730 con 0x7f0e00102ef0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.722+0000 7f0df67fc640 1 -- 172.21.15.70:0/4169727216 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df8017670 con 0x7f0e00102ef0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.722+0000 7f0e07375640 1 -- 172.21.15.70:0/4169727216 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e00069f70 con 0x7f0e00102ef0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.724+0000 7f0df67fc640 1 -- 172.21.15.70:0/4169727216 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0df8005000 con 0x7f0e00102ef0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e0974e740 1 Processor -- start 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e0974e740 1 -- start start 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d96007e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d96007ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d96008b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e0974e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d95ffe42f0 con 0x55d96007e5d0 2024-09-19T04:36:42.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e0974e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d95ff8bcf0 con 0x55d96007fb40 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e0974e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d95ffe02b0 con 0x55d960089370 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0df67fc640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0dec0a33b0 0x7f0dec0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05111640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d96007ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05111640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d96007ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39940/0 (socket says 172.21.15.70:39940) 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05111640 1 -- 172.21.15.70:0/2113116311 learned_addr learned my addr 172.21.15.70:0/2113116311 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e04910640 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d96008b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0df67fc640 1 -- 172.21.15.70:0/4169727216 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f0df80d16b0 con 0x7f0e00102ef0 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e04910640 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d96007e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05912640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0dec0a33b0 0x7f0dec0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05111640 1 -- 172.21.15.70:0/2113116311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 msgr2=0x55d96008b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05111640 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d96008b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05111640 1 -- 172.21.15.70:0/2113116311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 msgr2=0x55d96007e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05111640 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d96007e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e05111640 1 -- 172.21.15.70:0/2113116311 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d95ff703a0 con 0x55d96007e5d0 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.725+0000 7f0e04910640 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d96008b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.726+0000 7f0e05111640 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d96007ea10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc031440 tx=0x7f0dfc032ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32ee449ca5fca247 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.726+0000 7f0deb7fe640 1 -- 172.21.15.70:0/2113116311 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc03f070 con 0x55d96007e5d0 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.726+0000 7f0e05912640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0dec0a33b0 0x7f0dec0a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0df809d940 tx=0x7f0df8010040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.726+0000 7f0deb7fe640 1 -- 172.21.15.70:0/2113116311 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0dfc004030 con 0x55d96007e5d0 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.726+0000 7f0deb7fe640 1 -- 172.21.15.70:0/2113116311 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0dfc035070 con 0x55d96007e5d0 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.726+0000 7f0e0974e740 1 -- 172.21.15.70:0/2113116311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 msgr2=0x55d96007ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.726+0000 7f0e0974e740 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d96007ea10 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f0dfc031440 tx=0x7f0dfc032ba0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 -- 172.21.15.70:0/2113116311 shutdown_connections 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d96008b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d96007ea10 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 --2- 172.21.15.70:0/2113116311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d96007e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 -- 172.21.15.70:0/2113116311 >> 172.21.15.70:0/2113116311 conn(0x55d960047310 msgr2=0x55d96007ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 -- 172.21.15.70:0/2113116311 shutdown_connections 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 -- 172.21.15.70:0/2113116311 wait complete. 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 -- start start 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 Processor -- start 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d960088d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d960085ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d9600865e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d96008c010 con 0x55d96007e5d0 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d95ff9f060 con 0x55d96007fb40 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d96008c190 con 0x55d960089370 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e0974e740 10 client.0 _ll_register_callbacks cb 0x55d95fcf28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e04910640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d960088d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e04910640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d960088d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39954/0 (socket says 172.21.15.70:39954) 2024-09-19T04:36:42.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.727+0000 7f0e04910640 1 -- 172.21.15.70:0/3692593371 learned_addr learned my addr 172.21.15.70:0/3692593371 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e05111640 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d960085ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e04910640 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d9600865e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e04910640 1 -- 172.21.15.70:0/3692593371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 msgr2=0x55d9600865e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e04910640 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d9600865e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e04910640 1 -- 172.21.15.70:0/3692593371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 msgr2=0x55d960085ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e04910640 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d960085ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e04910640 1 -- 172.21.15.70:0/3692593371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d95fd553c0 con 0x55d96007e5d0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e04910640 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d960088d40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0df0010770 tx=0x7f0df0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92415d11b988c71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0de8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0de8ff9640 1 -- 172.21.15.70:0/3692593371 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df000fa00 con 0x55d96007e5d0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0de8ff9640 1 -- 172.21.15.70:0/3692593371 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f0df000fba0 con 0x55d96007e5d0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e0974e740 1 -- 172.21.15.70:0/3692593371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0dfc004030 con 0x55d96007e5d0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0de8ff9640 1 -- 172.21.15.70:0/3692593371 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0df000fda0 con 0x55d96007e5d0 2024-09-19T04:36:42.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e0974e740 10 client.16470 fetch_fsmap learned FSMap version 32 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.728+0000 7f0e0974e740 1 -- 172.21.15.70:0/3692593371 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d960097ae0 con 0x55d96007e5d0 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0de8ff9640 1 -- 172.21.15.70:0/3692593371 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0dfc004030 con 0x55d96007e5d0 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0de8ff9640 1 -- 172.21.15.70:0/3692593371 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f0df0026020 con 0x55d96007e5d0 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0e0974e740 10 client.16470 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0e0974e740 10 client.16470 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0e0974e740 20 client.16470 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55d960098ef0 0x55d96009b2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0e0974e740 4 client.16470 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0e0974e740 1 -- 172.21.15.70:0/3692593371 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d95fff1860 con 0x55d960098ef0 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.729+0000 7f0e05111640 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55d960098ef0 0x55d96009b2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.730+0000 7f0de8ff9640 10 client.16470 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.730+0000 7f0e05111640 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55d960098ef0 0x55d96009b2e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=116b93469575f966 server_cookie=90d6f66bde3edf55 in_seq=0 out_seq=0 2024-09-19T04:36:42.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.730+0000 7f0de8ff9640 1 -- 172.21.15.70:0/3692593371 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d95fff1860 con 0x55d960098ef0 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.730+0000 7f0de8ff9640 10 client.16470 handle_command_reply: tid=0 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.730+0000 7f0e0974e740 1 client.16470 shutdown 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 -- 172.21.15.70:0/3692593371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 msgr2=0x55d960088d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d960088d40 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f0df0010770 tx=0x7f0df0004730 comp rx=0 tx=0).stop 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 -- 172.21.15.70:0/3692593371 shutdown_connections 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55d960098ef0 0x55d96009b2e0 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d960089370 0x55d9600865e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d960085ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3692593371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d96007e5d0 0x55d960088d40 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0de8ff9640 0 client.16470 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 -- 172.21.15.70:0/3692593371 >> 172.21.15.70:0/3692593371 conn(0x55d960047310 msgr2=0x55d960080930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:42.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 -- 172.21.15.70:0/3692593371 shutdown_connections 2024-09-19T04:36:42.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 1 -- 172.21.15.70:0/3692593371 wait complete. 2024-09-19T04:36:42.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.731+0000 7f0e0974e740 20 client.16470 trim_cache size 0 max 16384 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e0974e740 1 Processor -- start 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e0974e740 1 -- start start 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007e5d0 0x55d960079c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007fb40 0x55d960081120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960081660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e0974e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001adf90 con 0x55d960089370 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e0974e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001ab800 con 0x55d96007e5d0 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e0974e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001a9670 con 0x55d96007fb40 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960081660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960081660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39958/0 (socket says 172.21.15.70:39958) 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 -- 172.21.15.70:0/3059710215 learned_addr learned my addr 172.21.15.70:0/3059710215 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 -- 172.21.15.70:0/3059710215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007fb40 msgr2=0x55d960081120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:42.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 --2- 172.21.15.70:0/3059710215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007fb40 0x55d960081120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 -- 172.21.15.70:0/3059710215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007e5d0 msgr2=0x55d960079c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 --2- 172.21.15.70:0/3059710215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007e5d0 0x55d960079c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 -- 172.21.15.70:0/3059710215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96009b910 con 0x55d960089370 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.744+0000 7f0e04910640 1 --2- 172.21.15.70:0/3059710215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960081660 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0df0001eb0 tx=0x7f0df0010430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daed4c1eb6915c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0deaffd640 1 -- 172.21.15.70:0/3059710215 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df0005d30 con 0x55d960089370 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0deaffd640 1 -- 172.21.15.70:0/3059710215 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0df0014040 con 0x55d960089370 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0deaffd640 1 -- 172.21.15.70:0/3059710215 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df001f810 con 0x55d960089370 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 -- 172.21.15.70:0/3059710215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 msgr2=0x55d960081660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3059710215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960081660 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7f0df0001eb0 tx=0x7f0df0010430 comp rx=0 tx=0).stop 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 -- 172.21.15.70:0/3059710215 shutdown_connections 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3059710215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960081660 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3059710215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007fb40 0x55d960081120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 --2- 172.21.15.70:0/3059710215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007e5d0 0x55d960079c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 -- 172.21.15.70:0/3059710215 >> 172.21.15.70:0/3059710215 conn(0x55d960047310 msgr2=0x55d960079500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 -- 172.21.15.70:0/3059710215 shutdown_connections 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.745+0000 7f0e0974e740 1 -- 172.21.15.70:0/3059710215 wait complete. 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 1 -- start start 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 1 Processor -- start 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007e5d0 0x55d960091c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d960082e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960083490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001a9cc0 con 0x55d960089370 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001ab130 con 0x55d96007fb40 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0e001aa390 con 0x55d96007e5d0 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e0974e740 10 client.0 _ll_register_callbacks cb 0x7f0df0009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e04910640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960083490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e04910640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960083490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39964/0 (socket says 172.21.15.70:39964) 2024-09-19T04:36:42.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e04910640 1 -- 172.21.15.70:0/1206227439 learned_addr learned my addr 172.21.15.70:0/1206227439 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e04910640 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007e5d0 0x55d960091c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e05111640 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d960082e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.746+0000 7f0e04910640 1 -- 172.21.15.70:0/1206227439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007e5d0 msgr2=0x55d960091c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e04910640 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007e5d0 0x55d960091c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e04910640 1 -- 172.21.15.70:0/1206227439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 msgr2=0x55d960082e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e04910640 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d960082e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e04910640 1 -- 172.21.15.70:0/1206227439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d960083c90 con 0x55d960089370 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e04910640 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960083490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0df000faf0 tx=0x7f0df0012040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2bc5a492ca8cc57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0de8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0de8ff9640 1 -- 172.21.15.70:0/1206227439 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0df00052c0 con 0x55d960089370 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0de8ff9640 1 -- 172.21.15.70:0/1206227439 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f0df0005460 con 0x55d960089370 2024-09-19T04:36:42.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e0974e740 1 -- 172.21.15.70:0/1206227439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0df0014040 con 0x55d960089370 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0de8ff9640 1 -- 172.21.15.70:0/1206227439 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7f0df0028460 con 0x55d960089370 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e0974e740 10 client.16476 fetch_fsmap learned FSMap version 32 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e0974e740 1 -- 172.21.15.70:0/1206227439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x55d960103c10 con 0x55d960089370 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0de8ff9640 1 -- 172.21.15.70:0/1206227439 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0df0014040 con 0x55d960089370 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0de8ff9640 1 -- 172.21.15.70:0/1206227439 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7f0df0026070 con 0x55d960089370 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e0974e740 10 client.16476 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e0974e740 10 client.16476 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e0974e740 20 client.16476 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e0974e740 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55d960104240 0x55d960106660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.747+0000 7f0e0974e740 4 client.16476 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0e0974e740 1 -- 172.21.15.70:0/1206227439 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d95ffebd70 con 0x55d960104240 2024-09-19T04:36:42.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0e05111640 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55d960104240 0x55d960106660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0de8ff9640 10 client.16476 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0e05111640 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55d960104240 0x55d960106660 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=72effc7d8794f2eb server_cookie=9aef5e3dc66d6264 in_seq=0 out_seq=0 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0de8ff9640 1 -- 172.21.15.70:0/1206227439 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d95ffebd70 con 0x55d960104240 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0de8ff9640 10 client.16476 handle_command_reply: tid=0 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0e0974e740 1 client.16476 shutdown 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0e0974e740 1 -- 172.21.15.70:0/1206227439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 msgr2=0x55d960083490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0e0974e740 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960083490 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f0df000faf0 tx=0x7f0df0012040 comp rx=0 tx=0).stop 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.748+0000 7f0e0974e740 1 -- 172.21.15.70:0/1206227439 shutdown_connections 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e0974e740 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55d960104240 0x55d960106660 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e0974e740 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d960089370 0x55d960083490 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e0974e740 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d96007fb40 0x55d960082e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e0974e740 1 --2- 172.21.15.70:0/1206227439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d96007e5d0 0x55d960091c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e0974e740 1 -- 172.21.15.70:0/1206227439 >> 172.21.15.70:0/1206227439 conn(0x55d960047310 msgr2=0x55d960079d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:42.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0de8ff9640 0 client.16476 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:42.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e0974e740 1 -- 172.21.15.70:0/1206227439 shutdown_connections 2024-09-19T04:36:42.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e0974e740 1 -- 172.21.15.70:0/1206227439 wait complete. 2024-09-19T04:36:42.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e0974e740 20 client.16476 trim_cache size 0 max 16384 2024-09-19T04:36:42.760 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 -- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0dec0a33b0 msgr2=0x7f0dec0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0dec0a33b0 0x7f0dec0a5870 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f0df809d940 tx=0x7f0df8010040 comp rx=0 tx=0).stop 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 -- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00102ef0 msgr2=0x7f0e0019bd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00102ef0 0x7f0e0019bd60 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f0df800eca0 tx=0x7f0df800b690 comp rx=0 tx=0).stop 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 -- 172.21.15.70:0/4169727216 shutdown_connections 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0dec0a33b0 0x7f0dec0a5870 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0e00102ef0 0x7f0e0019bd60 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0e00102570 0x7f0e001979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 --2- 172.21.15.70:0/4169727216 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0e00100e20 0x7f0e00197490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 -- 172.21.15.70:0/4169727216 >> 172.21.15.70:0/4169727216 conn(0x7f0e000fc7d0 msgr2=0x7f0e000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 -- 172.21.15.70:0/4169727216 shutdown_connections 2024-09-19T04:36:42.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:42.749+0000 7f0e07375640 1 -- 172.21.15.70:0/4169727216 wait complete. 2024-09-19T04:36:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:42 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:42 smithi134 ceph-mon[34525]: pgmap v181: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:43.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:42 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:43.127 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:42 smithi070 ceph-mon[30942]: pgmap v181: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:43.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:42 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:43.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:42 smithi167 ceph-mon[34339]: pgmap v181: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:43.609 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:36:43.853 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:43.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:43 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:43 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:44.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:43 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 -- 172.21.15.70:0/216198014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0100e20 msgr2=0x7ff2a0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/216198014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0100e20 0x7ff2a0101200 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7ff294009900 tx=0x7ff29402a480 comp rx=0 tx=0).stop 2024-09-19T04:36:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 -- 172.21.15.70:0/216198014 shutdown_connections 2024-09-19T04:36:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/216198014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2a0102ef0 0x7ff2a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/216198014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2a0102570 0x7ff2a01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/216198014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0100e20 0x7ff2a0101200 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 -- 172.21.15.70:0/216198014 >> 172.21.15.70:0/216198014 conn(0x7ff2a00fc7d0 msgr2=0x7ff2a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 -- 172.21.15.70:0/216198014 shutdown_connections 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 -- 172.21.15.70:0/216198014 wait complete. 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 Processor -- start 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 -- start start 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.363+0000 7ff2a6b41640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2a0100e20 0x7ff2a0197290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a6b41640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2a0102570 0x7ff2a01977d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a6b41640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0102ef0 0x7ff2a0197d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a6b41640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a0111010 con 0x7ff2a0102ef0 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a6b41640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a0110e90 con 0x7ff2a0100e20 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a6b41640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a0111190 con 0x7ff2a0102570 2024-09-19T04:36:44.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0102ef0 0x7ff2a0197d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0102ef0 0x7ff2a0197d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56908/0 (socket says 172.21.15.70:56908) 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 -- 172.21.15.70:0/1560798426 learned_addr learned my addr 172.21.15.70:0/1560798426 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2a0100e20 0x7ff2a0197290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff29ffff640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2a0102570 0x7ff2a01977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 -- 172.21.15.70:0/1560798426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2a0102570 msgr2=0x7ff2a01977d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2a0102570 0x7ff2a01977d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 -- 172.21.15.70:0/1560798426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2a0100e20 msgr2=0x7ff2a0197290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2a0100e20 0x7ff2a0197290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 -- 172.21.15.70:0/1560798426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2a01a6b00 con 0x7ff2a0102ef0 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a50de640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0102ef0 0x7ff2a0197d10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff29800b970 tx=0x7ff29800bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff29dffb640 1 -- 172.21.15.70:0/1560798426 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff298019070 con 0x7ff2a0102ef0 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff29dffb640 1 -- 172.21.15.70:0/1560798426 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff298014440 con 0x7ff2a0102ef0 2024-09-19T04:36:44.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff29dffb640 1 -- 172.21.15.70:0/1560798426 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2980075d0 con 0x7ff2a0102ef0 2024-09-19T04:36:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.364+0000 7ff2a6b41640 1 -- 172.21.15.70:0/1560798426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2a01a6df0 con 0x7ff2a0102ef0 2024-09-19T04:36:44.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.365+0000 7ff2a6b41640 1 -- 172.21.15.70:0/1560798426 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2a01a7380 con 0x7ff2a0102ef0 2024-09-19T04:36:44.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.367+0000 7ff29dffb640 1 -- 172.21.15.70:0/1560798426 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff29801c070 con 0x7ff2a0102ef0 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a8f1a740 1 Processor -- start 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a8f1a740 1 -- start start 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e3884b40 0x5605e3883090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e38835d0 0x5605e3883a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e388e370 0x5605e3890760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605e37e92f0 con 0x5605e38835d0 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5605e3790cf0 con 0x5605e3884b40 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5605e37e52b0 con 0x5605e388e370 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff29dffb640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff2900a3430 0x7ff2900a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a48dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e38835d0 0x5605e3883a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a48dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e38835d0 0x5605e3883a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56918/0 (socket says 172.21.15.70:56918) 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a48dd640 1 -- 172.21.15.70:0/4042106050 learned_addr learned my addr 172.21.15.70:0/4042106050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:44.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff29ffff640 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e388e370 0x5605e3890760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff2a50de640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff2900a3430 0x7ff2900a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.368+0000 7ff29ffff640 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e3884b40 0x5605e3883090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff29dffb640 1 -- 172.21.15.70:0/1560798426 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7ff2980cf050 con 0x7ff2a0102ef0 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff29ffff640 1 -- 172.21.15.70:0/4042106050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e3884b40 msgr2=0x5605e3883090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff29ffff640 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e3884b40 0x5605e3883090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff29ffff640 1 -- 172.21.15.70:0/4042106050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e38835d0 msgr2=0x5605e3883a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff29ffff640 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e38835d0 0x5605e3883a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff29ffff640 1 -- 172.21.15.70:0/4042106050 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e37753a0 con 0x5605e388e370 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e38835d0 0x5605e3883a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff2a50de640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff2900a3430 0x7ff2900a58f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff298097ee0 tx=0x7ff29807c0d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff29ffff640 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e388e370 0x5605e3890760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009f90 tx=0x7ff28c009470 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8ca8811362c4a5f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff28affd640 1 -- 172.21.15.70:0/4042106050 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c017e60 con 0x5605e388e370 2024-09-19T04:36:44.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff28affd640 1 -- 172.21.15.70:0/4042106050 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff28c01d070 con 0x5605e388e370 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.369+0000 7ff28affd640 1 -- 172.21.15.70:0/4042106050 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c0189f0 con 0x5605e388e370 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/4042106050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e388e370 msgr2=0x5605e3890760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e388e370 0x5605e3890760 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009f90 tx=0x7ff28c009470 comp rx=0 tx=0).stop 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/4042106050 shutdown_connections 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e388e370 0x5605e3890760 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e38835d0 0x5605e3883a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/4042106050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e3884b40 0x5605e3883090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/4042106050 >> 172.21.15.70:0/4042106050 conn(0x5605e384c310 msgr2=0x5605e387fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/4042106050 shutdown_connections 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/4042106050 wait complete. 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 -- start start 2024-09-19T04:36:44.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.370+0000 7ff2a8f1a740 1 Processor -- start 2024-09-19T04:36:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 0x5605e388dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e388b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e388b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5605e3891010 con 0x5605e388e370 2024-09-19T04:36:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5605e37a4060 con 0x5605e38835d0 2024-09-19T04:36:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5605e3891190 con 0x5605e3884b40 2024-09-19T04:36:44.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a8f1a740 10 client.0 _ll_register_callbacks cb 0x5605e34f78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e388b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e388b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56928/0 (socket says 172.21.15.70:56928) 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e388b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff29ffff640 1 -- 172.21.15.70:0/2029553616 learned_addr learned my addr 172.21.15.70:0/2029553616 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff29ffff640 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 0x5605e388dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a48dd640 1 -- 172.21.15.70:0/2029553616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 msgr2=0x5605e388dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 0x5605e388dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a48dd640 1 -- 172.21.15.70:0/2029553616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 msgr2=0x5605e388b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e388b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff2a48dd640 1 -- 172.21.15.70:0/2029553616 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605e355a3c0 con 0x5605e3884b40 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.371+0000 7ff29ffff640 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e388b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e388b000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff294009230 tx=0x7ff2940316d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c519181050947f49 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:44.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff27ffff640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff27ffff640 1 -- 172.21.15.70:0/2029553616 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294035040 con 0x5605e3884b40 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff27ffff640 1 -- 172.21.15.70:0/2029553616 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7ff294004240 con 0x5605e3884b40 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/2029553616 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff28c01d070 con 0x5605e3884b40 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff27ffff640 1 -- 172.21.15.70:0/2029553616 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff294004440 con 0x5605e3884b40 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 10 client.25744 fetch_fsmap learned FSMap version 32 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/2029553616 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5605e389cac0 con 0x5605e3884b40 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff27ffff640 1 -- 172.21.15.70:0/2029553616 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff28c01d070 con 0x5605e3884b40 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff27ffff640 1 -- 172.21.15.70:0/2029553616 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7ff294048770 con 0x5605e3884b40 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 10 client.25744 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 10 client.25744 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 20 client.25744 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5605e389df80 0x5605e38a0370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 4 client.25744 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.372+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/2029553616 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5605e37f6860 con 0x5605e389df80 2024-09-19T04:36:44.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.373+0000 7ff29ffff640 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5605e389df80 0x5605e38a0370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.373+0000 7ff29ffff640 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5605e389df80 0x5605e38a0370 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e57708443da6ed2a server_cookie=e4cc3b00253dcad3 in_seq=0 out_seq=0 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.373+0000 7ff27ffff640 10 client.25744 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff27ffff640 1 -- 172.21.15.70:0/2029553616 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5605e37f6860 con 0x5605e389df80 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff27ffff640 10 client.25744 handle_command_reply: tid=0 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 client.25744 shutdown 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/2029553616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 msgr2=0x5605e388b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e388b000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff294009230 tx=0x7ff2940316d0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/2029553616 shutdown_connections 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5605e389df80 0x5605e38a0370 crc :-1 s=READY pgs=114 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e388b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e388b000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/2029553616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 0x5605e388dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff27ffff640 0 client.25744 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:44.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/2029553616 >> 172.21.15.70:0/2029553616 conn(0x5605e384c310 msgr2=0x5605e3885930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/2029553616 shutdown_connections 2024-09-19T04:36:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/2029553616 wait complete. 2024-09-19T04:36:44.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.374+0000 7ff2a8f1a740 20 client.25744 trim_cache size 0 max 16384 2024-09-19T04:36:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a8f1a740 1 Processor -- start 2024-09-19T04:36:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a8f1a740 1 -- start start 2024-09-19T04:36:44.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e38835d0 0x5605e389a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e3884b40 0x5605e38a5c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e388e370 0x5605e38a6180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01b2340 con 0x5605e3884b40 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01afbb0 con 0x5605e388e370 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ada00 con 0x5605e38835d0 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a48dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e3884b40 0x5605e38a5c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a48dd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e3884b40 0x5605e38a5c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56938/0 (socket says 172.21.15.70:56938) 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a48dd640 1 -- 172.21.15.70:0/754411515 learned_addr learned my addr 172.21.15.70:0/754411515 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff29ffff640 1 --2- 172.21.15.70:0/754411515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e38835d0 0x5605e389a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a48dd640 1 -- 172.21.15.70:0/754411515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e38835d0 msgr2=0x5605e389a2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/754411515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e38835d0 0x5605e389a2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a48dd640 1 -- 172.21.15.70:0/754411515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e388e370 msgr2=0x5605e38a6180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:44.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/754411515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e388e370 0x5605e38a6180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.387+0000 7ff2a48dd640 1 -- 172.21.15.70:0/754411515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5605e388e080 con 0x5605e3884b40 2024-09-19T04:36:44.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/754411515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e3884b40 0x5605e38a5c40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff294048bc0 tx=0x7ff294000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1c2bdb7e96270a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:44.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff28a7fc640 1 -- 172.21.15.70:0/754411515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294035070 con 0x5605e3884b40 2024-09-19T04:36:44.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff28a7fc640 1 -- 172.21.15.70:0/754411515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff294031c50 con 0x5605e3884b40 2024-09-19T04:36:44.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff28a7fc640 1 -- 172.21.15.70:0/754411515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff294055070 con 0x5605e3884b40 2024-09-19T04:36:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/754411515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e3884b40 msgr2=0x5605e38a5c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/754411515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e3884b40 0x5605e38a5c40 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7ff294048bc0 tx=0x7ff294000bc0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/754411515 shutdown_connections 2024-09-19T04:36:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/754411515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e388e370 0x5605e38a6180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/754411515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e3884b40 0x5605e38a5c40 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/754411515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e38835d0 0x5605e389a2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.388+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/754411515 >> 172.21.15.70:0/754411515 conn(0x5605e384c310 msgr2=0x5605e388a0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/754411515 shutdown_connections 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/754411515 wait complete. 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 -- start start 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 Processor -- start 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 0x5605e3896ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e3892010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e3892620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ae070 con 0x5605e388e370 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01af4e0 con 0x5605e38835d0 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2a01ae740 con 0x5605e3884b40 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff2a8f1a740 10 client.0 _ll_register_callbacks cb 0x7ff294032b60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e3892620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff29ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e3892620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56940/0 (socket says 172.21.15.70:56940) 2024-09-19T04:36:44.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.389+0000 7ff29ffff640 1 -- 172.21.15.70:0/651041715 learned_addr learned my addr 172.21.15.70:0/651041715 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff29ffff640 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 0x5605e3896ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e3892010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff29ffff640 1 -- 172.21.15.70:0/651041715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 msgr2=0x5605e3892010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff29ffff640 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e3892010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff29ffff640 1 -- 172.21.15.70:0/651041715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 msgr2=0x5605e3896ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff29ffff640 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 0x5605e3896ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff29ffff640 1 -- 172.21.15.70:0/651041715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5605e3892e50 con 0x5605e388e370 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff29ffff640 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e3892620 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009840 tx=0x7ff28c018670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51eae0db5ef6ac93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff27ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff27ffff640 1 -- 172.21.15.70:0/651041715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff28c034070 con 0x5605e388e370 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff27ffff640 1 -- 172.21.15.70:0/651041715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7ff28c015930 con 0x5605e388e370 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/651041715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff294031c50 con 0x5605e388e370 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff27ffff640 1 -- 172.21.15.70:0/651041715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) ==== 24+0+0 (secure 0 0 0) 0x7ff28c02d040 con 0x5605e388e370 2024-09-19T04:36:44.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff2a8f1a740 10 client.16494 fetch_fsmap learned FSMap version 32 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/651041715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=4+}) -- 0x5605e3908d40 con 0x5605e388e370 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.390+0000 7ff27ffff640 1 -- 172.21.15.70:0/651041715 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff294031c50 con 0x5605e388e370 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff27ffff640 1 -- 172.21.15.70:0/651041715 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 32) ==== 8354+0+0 (secure 0 0 0) 0x7ff28c037020 con 0x5605e388e370 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff2a8f1a740 10 client.16494 fetch_fsmap finished waiting for FSMap version 32 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff2a8f1a740 10 client.16494 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff2a8f1a740 20 client.16494 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5605e39090d0 0x5605e390b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff2a8f1a740 4 client.16494 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/651041715 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5605e37f0d70 con 0x5605e39090d0 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5605e39090d0 0x5605e390b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff2a48dd640 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5605e39090d0 0x5605e390b4c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d8628980f8eda0e server_cookie=67eddbb4423050e1 in_seq=0 out_seq=0 2024-09-19T04:36:44.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.391+0000 7ff27ffff640 10 client.16494 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff27ffff640 1 -- 172.21.15.70:0/651041715 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5605e37f0d70 con 0x5605e39090d0 2024-09-19T04:36:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff27ffff640 10 client.16494 handle_command_reply: tid=0 2024-09-19T04:36:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 client.16494 shutdown 2024-09-19T04:36:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/651041715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 msgr2=0x5605e3892620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e3892620 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7ff28c009840 tx=0x7ff28c018670 comp rx=0 tx=0).stop 2024-09-19T04:36:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/651041715 shutdown_connections 2024-09-19T04:36:44.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5605e39090d0 0x5605e390b4c0 crc :-1 s=READY pgs=115 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5605e388e370 0x5605e3892620 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5605e3884b40 0x5605e3892010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 --2- 172.21.15.70:0/651041715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5605e38835d0 0x5605e3896ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/651041715 >> 172.21.15.70:0/651041715 conn(0x5605e384c310 msgr2=0x5605e387e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:44.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff27ffff640 0 client.16494 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:44.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/651041715 shutdown_connections 2024-09-19T04:36:44.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 1 -- 172.21.15.70:0/651041715 wait complete. 2024-09-19T04:36:44.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.392+0000 7ff2a8f1a740 20 client.16494 trim_cache size 0 max 16384 2024-09-19T04:36:44.400 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 -- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff2900a3430 msgr2=0x7ff2900a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff2900a3430 0x7ff2900a58f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7ff298097ee0 tx=0x7ff29807c0d0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 -- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0102ef0 msgr2=0x7ff2a0197d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0102ef0 0x7ff2a0197d10 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7ff29800b970 tx=0x7ff29800bd70 comp rx=0 tx=0).stop 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 -- 172.21.15.70:0/1560798426 shutdown_connections 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff2900a3430 0x7ff2900a58f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2a0102ef0 0x7ff2a0197d10 unknown :-1 s=CLOSED pgs=748 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2a0102570 0x7ff2a01977d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 --2- 172.21.15.70:0/1560798426 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2a0100e20 0x7ff2a0197290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 -- 172.21.15.70:0/1560798426 >> 172.21.15.70:0/1560798426 conn(0x7ff2a00fc7d0 msgr2=0x7ff2a00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 -- 172.21.15.70:0/1560798426 shutdown_connections 2024-09-19T04:36:44.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:44.393+0000 7ff2a6b41640 1 -- 172.21.15.70:0/1560798426 wait complete. 2024-09-19T04:36:44.992 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:44 smithi070 ceph-mon[30942]: pgmap v182: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:44 smithi134 ceph-mon[34525]: pgmap v182: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:45.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:44 smithi167 ceph-mon[34339]: pgmap v182: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:46.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:45 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:46.059 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:36:46.060 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:36:46.087 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:45 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:46.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:45 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:36:46.317 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:46.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 -- 172.21.15.70:0/521496981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec101420 msgr2=0x7efeec10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 --2- 172.21.15.70:0/521496981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec101420 0x7efeec10d950 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7efee4009cd0 tx=0x7efee402a8e0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 -- 172.21.15.70:0/521496981 shutdown_connections 2024-09-19T04:36:46.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 --2- 172.21.15.70:0/521496981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec101420 0x7efeec10d950 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 --2- 172.21.15.70:0/521496981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeec100a80 0x7efeec100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 --2- 172.21.15.70:0/521496981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeec106a80 0x7efeec106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.783 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 -- 172.21.15.70:0/521496981 >> 172.21.15.70:0/521496981 conn(0x7efeec0fc7a0 msgr2=0x7efeec0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 -- 172.21.15.70:0/521496981 shutdown_connections 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 -- 172.21.15.70:0/521496981 wait complete. 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 Processor -- start 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 -- start start 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.767+0000 7efef1e39640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec100a80 0x7efeec0fcdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efef1e39640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeec101420 0x7efeec0fd310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efef1e39640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeec106a80 0x7efeec0fd850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efef1e39640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efeec110e50 con 0x7efeec100a80 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efef1e39640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efeec110cd0 con 0x7efeec106a80 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efef1e39640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efeec110fd0 con 0x7efeec101420 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec100a80 0x7efeec0fcdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec100a80 0x7efeec0fcdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56962/0 (socket says 172.21.15.70:56962) 2024-09-19T04:36:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 -- 172.21.15.70:0/3380602069 learned_addr learned my addr 172.21.15.70:0/3380602069 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efee3fff640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeec101420 0x7efeec0fd310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeebfff640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeec106a80 0x7efeec0fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 -- 172.21.15.70:0/3380602069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeec101420 msgr2=0x7efeec0fd310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeec101420 0x7efeec0fd310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 -- 172.21.15.70:0/3380602069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeec106a80 msgr2=0x7efeec0fd850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeec106a80 0x7efeec0fd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 -- 172.21.15.70:0/3380602069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeec1a68a0 con 0x7efeec100a80 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efee3fff640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeec101420 0x7efeec0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec100a80 0x7efeec0fcdd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efedc00d950 tx=0x7efedc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efee97fa640 1 -- 172.21.15.70:0/3380602069 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc017030 con 0x7efeec100a80 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efef1e39640 1 -- 172.21.15.70:0/3380602069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeec1a6b90 con 0x7efeec100a80 2024-09-19T04:36:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efee97fa640 1 -- 172.21.15.70:0/3380602069 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efedc004020 con 0x7efeec100a80 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efee97fa640 1 -- 172.21.15.70:0/3380602069 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efedc0047a0 con 0x7efeec100a80 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.768+0000 7efef1e39640 1 -- 172.21.15.70:0/3380602069 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeec1a70d0 con 0x7efeec100a80 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efee97fa640 1 -- 172.21.15.70:0/3380602069 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7efedc0041d0 con 0x7efeec100a80 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efef4212740 1 Processor -- start 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efef4212740 1 -- start start 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efef4212740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d2b60 0x56450b7d2f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efef4212740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7dd800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efef4212740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7ddd40 0x56450b7e0130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efef4212740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56450b738280 con 0x56450b7d2b60 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efef4212740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56450b6dfb10 con 0x56450b7d3480 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efef4212740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56450b734240 con 0x56450b7ddd40 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efeebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d2b60 0x56450b7d2f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efeebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d2b60 0x56450b7d2f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56976/0 (socket says 172.21.15.70:56976) 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efeebfff640 1 -- 172.21.15.70:0/281615182 learned_addr learned my addr 172.21.15.70:0/281615182 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efee97fa640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efed80a33b0 0x7efed80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.771+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7dd800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efee3fff640 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7ddd40 0x56450b7e0130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efee97fa640 1 -- 172.21.15.70:0/3380602069 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7efedc0cf7d0 con 0x7efeec100a80 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeebfff640 1 -- 172.21.15.70:0/281615182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7ddd40 msgr2=0x56450b7e0130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeebfff640 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7ddd40 0x56450b7e0130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeebfff640 1 -- 172.21.15.70:0/281615182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 msgr2=0x56450b7dd800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeebfff640 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7dd800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeebfff640 1 -- 172.21.15.70:0/281615182 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56450b6ec1f0 con 0x56450b7d2b60 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:36:46.787 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeebfff640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efed80a33b0 0x7efed80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeebfff640 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d2b60 0x56450b7d2f40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7efee4004af0 tx=0x7efee4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3e1dbfaf2dec371 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efee1ffb640 1 -- 172.21.15.70:0/281615182 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee404d070 con 0x56450b7d2b60 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efee1ffb640 1 -- 172.21.15.70:0/281615182 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efee4043070 con 0x56450b7d2b60 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efee1ffb640 1 -- 172.21.15.70:0/281615182 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee4030b70 con 0x56450b7d2b60 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.772+0000 7efeebfff640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efed80a33b0 0x7efed80a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efee4005cc0 tx=0x7efee404b000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 -- 172.21.15.70:0/281615182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d2b60 msgr2=0x56450b7d2f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d2b60 0x56450b7d2f40 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7efee4004af0 tx=0x7efee4005f90 comp rx=0 tx=0).stop 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 -- 172.21.15.70:0/281615182 shutdown_connections 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7ddd40 0x56450b7e0130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7dd800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 --2- 172.21.15.70:0/281615182 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d2b60 0x56450b7d2f40 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 -- 172.21.15.70:0/281615182 >> 172.21.15.70:0/281615182 conn(0x56450b7cf0f0 msgr2=0x56450b7cf4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:46.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 -- 172.21.15.70:0/281615182 shutdown_connections 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 -- 172.21.15.70:0/281615182 wait complete. 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.773+0000 7efef4212740 1 -- start start 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efef4212740 1 Processor -- start 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efef4212740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 0x56450b7dab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efef4212740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7db0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efef4212740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7db5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efef4212740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56450b7e0910 con 0x56450b7ddd40 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efef4212740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56450b6f2f10 con 0x56450b7d3480 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efef4212740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56450b7e0a90 con 0x56450b7d2b60 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efef4212740 10 client.0 _ll_register_callbacks cb 0x56450b6bba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7db5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7db5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56978/0 (socket says 172.21.15.70:56978) 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeebfff640 1 -- 172.21.15.70:0/1089319107 learned_addr learned my addr 172.21.15.70:0/1089319107 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 0x56450b7dab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efee3fff640 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7db0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeebfff640 1 -- 172.21.15.70:0/1089319107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 msgr2=0x56450b7dab70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeebfff640 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 0x56450b7dab70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeebfff640 1 -- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 msgr2=0x56450b7db0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeebfff640 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7db0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efeebfff640 1 -- 172.21.15.70:0/1089319107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56450b4a96a0 con 0x56450b7ddd40 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.774+0000 7efee3fff640 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7db0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efeebfff640 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7db5f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efee4009cd0 tx=0x7efee4031e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b4e99739d61f57 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efecaffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efecaffd640 1 -- 172.21.15.70:0/1089319107 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee404d030 con 0x56450b7ddd40 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efecaffd640 1 -- 172.21.15.70:0/1089319107 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7efee4004250 con 0x56450b7ddd40 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 1 -- 172.21.15.70:0/1089319107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efee4043070 con 0x56450b7ddd40 2024-09-19T04:36:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efecaffd640 1 -- 172.21.15.70:0/1089319107 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7efee4063050 con 0x56450b7ddd40 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 10 client.16506 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 1 -- 172.21.15.70:0/1089319107 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56450b7ec490 con 0x56450b7ddd40 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efecaffd640 1 -- 172.21.15.70:0/1089319107 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efee4043070 con 0x56450b7ddd40 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efecaffd640 1 -- 172.21.15.70:0/1089319107 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7efee4030070 con 0x56450b7ddd40 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 10 client.16506 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 10 client.16506 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 20 client.16506 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56450b7ed7e0 0x56450b7efbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 4 client.16506 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.775+0000 7efef4212740 1 -- 172.21.15.70:0/1089319107 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56450b7457f0 con 0x56450b7ed7e0 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.776+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56450b7ed7e0 0x56450b7efbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.776+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56450b7ed7e0 0x56450b7efbd0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=44282360bdb5e7e7 server_cookie=b63ae2de4f2037ee in_seq=0 out_seq=0 2024-09-19T04:36:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.776+0000 7efecaffd640 10 client.16506 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efecaffd640 1 -- 172.21.15.70:0/1089319107 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56450b7457f0 con 0x56450b7ed7e0 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efecaffd640 10 client.16506 handle_command_reply: tid=0 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 client.16506 shutdown 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 -- 172.21.15.70:0/1089319107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 msgr2=0x56450b7db5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7db5f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7efee4009cd0 tx=0x7efee4031e50 comp rx=0 tx=0).stop 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 -- 172.21.15.70:0/1089319107 shutdown_connections 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56450b7ed7e0 0x56450b7efbd0 crc :-1 s=READY pgs=116 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7db5f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d3480 0x56450b7db0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efecaffd640 0 client.16506 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 --2- 172.21.15.70:0/1089319107 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 0x56450b7dab70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 -- 172.21.15.70:0/1089319107 >> 172.21.15.70:0/1089319107 conn(0x56450b7cf0f0 msgr2=0x56450b7ce270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 -- 172.21.15.70:0/1089319107 shutdown_connections 2024-09-19T04:36:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 1 -- 172.21.15.70:0/1089319107 wait complete. 2024-09-19T04:36:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.777+0000 7efef4212740 20 client.16506 trim_cache size 0 max 16384 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.794+0000 7efef4212740 1 Processor -- start 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.794+0000 7efef4212740 1 -- start start 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.794+0000 7efef4212740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d2b60 0x56450b7d55c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.794+0000 7efef4212740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d3480 0x56450b7dc9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efef4212740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7f5170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efef4212740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1b2330 con 0x56450b7ddd40 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efef4212740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1afbd0 con 0x56450b7d2b60 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efef4212740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1ada20 con 0x56450b7d3480 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7f5170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7f5170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56980/0 (socket says 172.21.15.70:56980) 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 -- 172.21.15.70:0/2080930541 learned_addr learned my addr 172.21.15.70:0/2080930541 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efee3fff640 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d3480 0x56450b7dc9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 -- 172.21.15.70:0/2080930541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d3480 msgr2=0x56450b7dc9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d3480 0x56450b7dc9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 -- 172.21.15.70:0/2080930541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d2b60 msgr2=0x56450b7d55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d2b60 0x56450b7d55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d2b60 0x56450b7d55c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 -- 172.21.15.70:0/2080930541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56450b7ca830 con 0x56450b7ddd40 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efeebfff640 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7f5170 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efee402ae00 tx=0x7efee4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=129cdd1ba67f5e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efee17fa640 1 -- 172.21.15.70:0/2080930541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee404d070 con 0x56450b7ddd40 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efee17fa640 1 -- 172.21.15.70:0/2080930541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efee4043040 con 0x56450b7ddd40 2024-09-19T04:36:46.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.795+0000 7efee17fa640 1 -- 172.21.15.70:0/2080930541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efee403d420 con 0x56450b7ddd40 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 -- 172.21.15.70:0/2080930541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 msgr2=0x56450b7f5170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7f5170 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7efee402ae00 tx=0x7efee4005f90 comp rx=0 tx=0).stop 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 -- 172.21.15.70:0/2080930541 shutdown_connections 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7ddd40 0x56450b7f5170 unknown :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d3480 0x56450b7dc9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 --2- 172.21.15.70:0/2080930541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7d2b60 0x56450b7d55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 -- 172.21.15.70:0/2080930541 >> 172.21.15.70:0/2080930541 conn(0x56450b7cf0f0 msgr2=0x56450b7dc2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 -- 172.21.15.70:0/2080930541 shutdown_connections 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 -- 172.21.15.70:0/2080930541 wait complete. 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.796+0000 7efef4212740 1 -- start start 2024-09-19T04:36:46.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efef4212740 1 Processor -- start 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efef4212740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 0x56450b7e6060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efef4212740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d3480 0x56450b7e65a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efef4212740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7ddd40 0x56450b7e1460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efef4212740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1ae090 con 0x56450b7d3480 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efef4212740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1af500 con 0x56450b7ddd40 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efef4212740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efeec1ae760 con 0x56450b7d2b60 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efef4212740 10 client.0 _ll_register_callbacks cb 0x7efee404b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d3480 0x56450b7e65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d3480 0x56450b7e65a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:56994/0 (socket says 172.21.15.70:56994) 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 -- 172.21.15.70:0/2929506727 learned_addr learned my addr 172.21.15.70:0/2929506727 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 0x56450b7e6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efeebfff640 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7ddd40 0x56450b7e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 -- 172.21.15.70:0/2929506727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 msgr2=0x56450b7e6060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 0x56450b7e6060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 -- 172.21.15.70:0/2929506727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7ddd40 msgr2=0x56450b7e1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7ddd40 0x56450b7e1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 -- 172.21.15.70:0/2929506727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56450b7e1c90 con 0x56450b7d3480 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efee3fff640 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d3480 0x56450b7e65a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efed4005fd0 tx=0x7efed4010eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=611144dd653caab1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.797+0000 7efecaffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efecaffd640 1 -- 172.21.15.70:0/2929506727 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efed4020060 con 0x56450b7d3480 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efecaffd640 1 -- 172.21.15.70:0/2929506727 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7efed400f930 con 0x56450b7d3480 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 1 -- 172.21.15.70:0/2929506727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efee4043040 con 0x56450b7d3480 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efecaffd640 1 -- 172.21.15.70:0/2929506727 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7efed400fb70 con 0x56450b7d3480 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 10 client.16512 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 1 -- 172.21.15.70:0/2929506727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x56450b860620 con 0x56450b7d3480 2024-09-19T04:36:46.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efecaffd640 1 -- 172.21.15.70:0/2929506727 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efee4043040 con 0x56450b7d3480 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efecaffd640 1 -- 172.21.15.70:0/2929506727 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7efed401a030 con 0x56450b7d3480 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 10 client.16512 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 10 client.16512 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 20 client.16512 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56450b860e00 0x56450b863220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 4 client.16512 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efef4212740 1 -- 172.21.15.70:0/2929506727 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56450b73fd00 con 0x56450b860e00 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.798+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56450b860e00 0x56450b863220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.799+0000 7efecaffd640 10 client.16512 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.799+0000 7efeeb7fe640 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56450b860e00 0x56450b863220 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=96b8f40d365bda8d server_cookie=71f5a86aa632eb6c in_seq=0 out_seq=0 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efecaffd640 1 -- 172.21.15.70:0/2929506727 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56450b73fd00 con 0x56450b860e00 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efecaffd640 10 client.16512 handle_command_reply: tid=0 2024-09-19T04:36:46.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 client.16512 shutdown 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 -- 172.21.15.70:0/2929506727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d3480 msgr2=0x56450b7e65a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d3480 0x56450b7e65a0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7efed4005fd0 tx=0x7efed4010eb0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 -- 172.21.15.70:0/2929506727 shutdown_connections 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56450b860e00 0x56450b863220 crc :-1 s=READY pgs=117 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56450b7ddd40 0x56450b7e1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56450b7d3480 0x56450b7e65a0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 --2- 172.21.15.70:0/2929506727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56450b7d2b60 0x56450b7e6060 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 -- 172.21.15.70:0/2929506727 >> 172.21.15.70:0/2929506727 conn(0x56450b7cf0f0 msgr2=0x56450b7d9010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efecaffd640 0 client.16512 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 -- 172.21.15.70:0/2929506727 shutdown_connections 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 1 -- 172.21.15.70:0/2929506727 wait complete. 2024-09-19T04:36:46.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.800+0000 7efef4212740 20 client.16512 trim_cache size 0 max 16384 2024-09-19T04:36:46.807 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:46.807 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:36:46.807 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "b6dd3a28-a743-4a92-a194-d5109b94d55e", 2024-09-19T04:36:46.807 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:36:46.807 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 -- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efed80a33b0 msgr2=0x7efed80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efed80a33b0 0x7efed80a5870 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7efee4005cc0 tx=0x7efee404b000 comp rx=0 tx=0).stop 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 -- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec100a80 msgr2=0x7efeec0fcdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec100a80 0x7efeec0fcdd0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7efedc00d950 tx=0x7efedc00de10 comp rx=0 tx=0).stop 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 -- 172.21.15.70:0/3380602069 shutdown_connections 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efed80a33b0 0x7efed80a5870 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efeec106a80 0x7efeec0fd850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efeec101420 0x7efeec0fd310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 --2- 172.21.15.70:0/3380602069 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efeec100a80 0x7efeec0fcdd0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 -- 172.21.15.70:0/3380602069 >> 172.21.15.70:0/3380602069 conn(0x7efeec0fc7a0 msgr2=0x7efeec06aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:46.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 -- 172.21.15.70:0/3380602069 shutdown_connections 2024-09-19T04:36:46.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:46.801+0000 7efef1e39640 1 -- 172.21.15.70:0/3380602069 wait complete. 2024-09-19T04:36:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:46 smithi134 ceph-mon[34525]: pgmap v183: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:47.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:46 smithi070 ceph-mon[30942]: pgmap v183: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:47.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:46 smithi167 ceph-mon[34339]: pgmap v183: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:47.625 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:36:47.912 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:48.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:47 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:36:48.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:47 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:48.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:47 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:36:48.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:47 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:48.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:47 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:36:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:47 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:36:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:47 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:47 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:36:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:47 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:47 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:36:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:47 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:36:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:47 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:47 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:36:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:47 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:47 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 -- 172.21.15.70:0/1435549653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76681027a0 msgr2=0x7f76681067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 --2- 172.21.15.70:0/1435549653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76681027a0 0x7f76681067f0 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f7650009900 tx=0x7f765002a410 comp rx=0 tx=0).stop 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 -- 172.21.15.70:0/1435549653 shutdown_connections 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 --2- 172.21.15.70:0/1435549653 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7668106f20 0x7f766810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 --2- 172.21.15.70:0/1435549653 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f76681027a0 0x7f76681067f0 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 --2- 172.21.15.70:0/1435549653 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668101df0 0x7f76681021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 -- 172.21.15.70:0/1435549653 >> 172.21.15.70:0/1435549653 conn(0x7f76680fd8b0 msgr2=0x7f76680ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 -- 172.21.15.70:0/1435549653 shutdown_connections 2024-09-19T04:36:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.340+0000 7f766e85d640 1 -- 172.21.15.70:0/1435549653 wait complete. 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766e85d640 1 Processor -- start 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766e85d640 1 -- start start 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766e85d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668101df0 0x7f76681984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766e85d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76681027a0 0x7f76681989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766e85d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7668106f20 0x7f766819cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766e85d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7668111fa0 con 0x7f7668106f20 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766e85d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7668111e20 con 0x7f7668101df0 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766e85d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7668112120 con 0x7f76681027a0 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766cdfa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7668106f20 0x7f766819cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766cdfa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7668106f20 0x7f766819cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57014/0 (socket says 172.21.15.70:57014) 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f766cdfa640 1 -- 172.21.15.70:0/3849999864 learned_addr learned my addr 172.21.15.70:0/3849999864 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f7667fff640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668101df0 0x7f76681984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.341+0000 7f76677fe640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76681027a0 0x7f76681989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f766cdfa640 1 -- 172.21.15.70:0/3849999864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76681027a0 msgr2=0x7f76681989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f766cdfa640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76681027a0 0x7f76681989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f766cdfa640 1 -- 172.21.15.70:0/3849999864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668101df0 msgr2=0x7f76681984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f766cdfa640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668101df0 0x7f76681984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f766cdfa640 1 -- 172.21.15.70:0/3849999864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f766819d450 con 0x7f7668106f20 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f76677fe640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76681027a0 0x7f76681989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f766cdfa640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7668106f20 0x7f766819cd70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f766000cad0 tx=0x7f766000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f76657fa640 1 -- 172.21.15.70:0/3849999864 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766000ae20 con 0x7f7668106f20 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f766e85d640 1 -- 172.21.15.70:0/3849999864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f766819d740 con 0x7f7668106f20 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f76657fa640 1 -- 172.21.15.70:0/3849999864 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7660005020 con 0x7f7668106f20 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f766e85d640 1 -- 172.21.15.70:0/3849999864 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76681a5020 con 0x7f7668106f20 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.342+0000 7f76657fa640 1 -- 172.21.15.70:0/3849999864 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f766001d060 con 0x7f7668106f20 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.344+0000 7f76657fa640 1 -- 172.21.15.70:0/3849999864 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f76600051d0 con 0x7f7668106f20 2024-09-19T04:36:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.344+0000 7f7670c36740 1 Processor -- start 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.344+0000 7f7670c36740 1 -- start start 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.344+0000 7f7670c36740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d334a0 0x562561d33880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7670c36740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d33dc0 0x562561d3e140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7670c36740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 0x562561d40a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7670c36740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562561c992e0 con 0x562561d33dc0 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7670c36740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562561c40ce0 con 0x562561d3e680 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7670c36740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562561c952a0 con 0x562561d334a0 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d33dc0 0x562561d3e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d33dc0 0x562561d3e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57016/0 (socket says 172.21.15.70:57016) 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 -- 172.21.15.70:0/1987721541 learned_addr learned my addr 172.21.15.70:0/1987721541 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f76677fe640 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 0x562561d40a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f76657fa640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f76540a33b0 0x7f76540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 -- 172.21.15.70:0/1987721541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d334a0 msgr2=0x562561d33880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f76677fe640 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d334a0 0x562561d33880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d334a0 0x562561d33880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 -- 172.21.15.70:0/1987721541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 msgr2=0x562561d40a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 0x562561d40a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 -- 172.21.15.70:0/1987721541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562561c25440 con 0x562561d33dc0 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f76677fe640 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d334a0 0x562561d33880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f766cdfa640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f76540a33b0 0x7f76540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f76657fa640 1 -- 172.21.15.70:0/3849999864 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f76600cfc30 con 0x7f7668106f20 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f7667fff640 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d33dc0 0x562561d3e140 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f765800ac20 tx=0x7f765800f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e566e4c6f6d3b3f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f765e7fc640 1 -- 172.21.15.70:0/1987721541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765801d070 con 0x562561d33dc0 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f765e7fc640 1 -- 172.21.15.70:0/1987721541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7658018b10 con 0x562561d33dc0 2024-09-19T04:36:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.345+0000 7f765e7fc640 1 -- 172.21.15.70:0/1987721541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7658010b20 con 0x562561d33dc0 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 -- 172.21.15.70:0/1987721541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d33dc0 msgr2=0x562561d3e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f766cdfa640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f76540a33b0 0x7f76540a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7660098390 tx=0x7f76600913c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d33dc0 0x562561d3e140 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f765800ac20 tx=0x7f765800f790 comp rx=0 tx=0).stop 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 -- 172.21.15.70:0/1987721541 shutdown_connections 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 0x562561d40a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d33dc0 0x562561d3e140 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 --2- 172.21.15.70:0/1987721541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d334a0 0x562561d33880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 -- 172.21.15.70:0/1987721541 >> 172.21.15.70:0/1987721541 conn(0x562561d2fa30 msgr2=0x562561d2fe10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 -- 172.21.15.70:0/1987721541 shutdown_connections 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.346+0000 7f7670c36740 1 -- 172.21.15.70:0/1987721541 wait complete. 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 1 -- start start 2024-09-19T04:36:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 1 Processor -- start 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 0x562561d3df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d3b220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d3b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562561d41250 con 0x562561d3e680 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562561c54050 con 0x562561d334a0 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562561d413d0 con 0x562561d33dc0 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7670c36740 10 client.0 _ll_register_callbacks cb 0x562561c94160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f76677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d3b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f76677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d3b760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57028/0 (socket says 172.21.15.70:57028) 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f76677fe640 1 -- 172.21.15.70:0/2382964698 learned_addr learned my addr 172.21.15.70:0/2382964698 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f7667fff640 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d3b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f76677fe640 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 0x562561d3df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f76677fe640 1 -- 172.21.15.70:0/2382964698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 msgr2=0x562561d3b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.347+0000 7f76677fe640 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d3b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76677fe640 1 -- 172.21.15.70:0/2382964698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 msgr2=0x562561d3df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76677fe640 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 0x562561d3df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76677fe640 1 -- 172.21.15.70:0/2382964698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562561a0a3c0 con 0x562561d3e680 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76677fe640 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d3b760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7650005ab0 tx=0x7f765002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d07cbebf19ae468e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76477fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76477fe640 1 -- 172.21.15.70:0/2382964698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650035070 con 0x562561d3e680 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 1 -- 172.21.15.70:0/2382964698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7658018b10 con 0x562561d3e680 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76477fe640 1 -- 172.21.15.70:0/2382964698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f7650005220 con 0x562561d3e680 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76477fe640 1 -- 172.21.15.70:0/2382964698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f7650050050 con 0x562561d3e680 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 10 client.16524 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 1 -- 172.21.15.70:0/2382964698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562561d4cb30 con 0x562561d3e680 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76477fe640 1 -- 172.21.15.70:0/2382964698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7658018b10 con 0x562561d3e680 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f76477fe640 1 -- 172.21.15.70:0/2382964698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f7650048020 con 0x562561d3e680 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 10 client.16524 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 10 client.16524 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 20 client.16524 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562561d4dff0 0x562561d503e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 4 client.16524 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.348+0000 7f7670c36740 1 -- 172.21.15.70:0/2382964698 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562561ca6850 con 0x562561d4dff0 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.349+0000 7f7667fff640 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562561d4dff0 0x562561d503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.349+0000 7f76477fe640 10 client.16524 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.349+0000 7f7667fff640 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562561d4dff0 0x562561d503e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=843eafb94e0cc9ab server_cookie=826bc5cd59616594 in_seq=0 out_seq=0 2024-09-19T04:36:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f76477fe640 1 -- 172.21.15.70:0/2382964698 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562561ca6850 con 0x562561d4dff0 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f76477fe640 10 client.16524 handle_command_reply: tid=0 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 client.16524 shutdown 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 -- 172.21.15.70:0/2382964698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 msgr2=0x562561d3b760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d3b760 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f7650005ab0 tx=0x7f765002a410 comp rx=0 tx=0).stop 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 -- 172.21.15.70:0/2382964698 shutdown_connections 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562561d4dff0 0x562561d503e0 crc :-1 s=READY pgs=118 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d3b760 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d3b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 --2- 172.21.15.70:0/2382964698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 0x562561d3df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f76477fe640 0 client.16524 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 -- 172.21.15.70:0/2382964698 >> 172.21.15.70:0/2382964698 conn(0x562561d2fa30 msgr2=0x562561d35710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 -- 172.21.15.70:0/2382964698 shutdown_connections 2024-09-19T04:36:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 1 -- 172.21.15.70:0/2382964698 wait complete. 2024-09-19T04:36:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.350+0000 7f7670c36740 20 client.16524 trim_cache size 0 max 16384 2024-09-19T04:36:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.367+0000 7f7670c36740 1 Processor -- start 2024-09-19T04:36:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.367+0000 7f7670c36740 1 -- start start 2024-09-19T04:36:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.367+0000 7f7670c36740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 0x562561d3d190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.367+0000 7f7670c36740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d55c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.367+0000 7f7670c36740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d561d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.367+0000 7f7670c36740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76681b0140 con 0x562561d3e680 2024-09-19T04:36:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.367+0000 7f7670c36740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76681ad9e0 con 0x562561d334a0 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.367+0000 7f7670c36740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76681ab830 con 0x562561d33dc0 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d561d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57040/0 (socket says 172.21.15.70:57040) 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 -- 172.21.15.70:0/1837444639 learned_addr learned my addr 172.21.15.70:0/1837444639 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f7667fff640 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d55c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 0x562561d3d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 -- 172.21.15.70:0/1837444639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 msgr2=0x562561d55c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d55c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 -- 172.21.15.70:0/1837444639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 msgr2=0x562561d3d190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 0x562561d3d190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 -- 172.21.15.70:0/1837444639 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562561d34330 con 0x562561d3e680 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f76677fe640 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d561d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f765002aa00 tx=0x7f7650005a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7226650b24cf9383 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f765dffb640 1 -- 172.21.15.70:0/1837444639 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650035070 con 0x562561d3e680 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f765dffb640 1 -- 172.21.15.70:0/1837444639 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7650003e90 con 0x562561d3e680 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.368+0000 7f765dffb640 1 -- 172.21.15.70:0/1837444639 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f765004a420 con 0x562561d3e680 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 -- 172.21.15.70:0/1837444639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 msgr2=0x562561d561d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d561d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f765002aa00 tx=0x7f7650005a20 comp rx=0 tx=0).stop 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 -- 172.21.15.70:0/1837444639 shutdown_connections 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d3e680 0x562561d561d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d55c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 --2- 172.21.15.70:0/1837444639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d334a0 0x562561d3d190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 -- 172.21.15.70:0/1837444639 >> 172.21.15.70:0/1837444639 conn(0x562561d2fa30 msgr2=0x562561d3ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 -- 172.21.15.70:0/1837444639 shutdown_connections 2024-09-19T04:36:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 -- 172.21.15.70:0/1837444639 wait complete. 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.369+0000 7f7670c36740 1 -- start start 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7670c36740 1 Processor -- start 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7670c36740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d334a0 0x562561d46c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7670c36740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d43fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7670c36740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 0x562561d444e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7670c36740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f76681abea0 con 0x562561d334a0 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7670c36740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f76681ad310 con 0x562561d3e680 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7670c36740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f76681ac570 con 0x562561d33dc0 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7670c36740 10 client.0 _ll_register_callbacks cb 0x7f7650009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:48.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d334a0 0x562561d46c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d334a0 0x562561d46c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57052/0 (socket says 172.21.15.70:57052) 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 -- 172.21.15.70:0/285726326 learned_addr learned my addr 172.21.15.70:0/285726326 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f7667fff640 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d43fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 -- 172.21.15.70:0/285726326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 msgr2=0x562561d43fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d43fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 -- 172.21.15.70:0/285726326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 msgr2=0x562561d444e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 0x562561d444e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 -- 172.21.15.70:0/285726326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562561d306c0 con 0x562561d334a0 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76677fe640 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d334a0 0x562561d46c50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f765002a9d0 tx=0x7f765003db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=515bf48d12ba31cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.370+0000 7f76477fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:48.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f76477fe640 1 -- 172.21.15.70:0/285726326 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7650035040 con 0x562561d334a0 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f76477fe640 1 -- 172.21.15.70:0/285726326 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f765003d890 con 0x562561d334a0 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 1 -- 172.21.15.70:0/285726326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7650003e90 con 0x562561d334a0 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f76477fe640 1 -- 172.21.15.70:0/285726326 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f76500577a0 con 0x562561d334a0 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 10 client.16530 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 1 -- 172.21.15.70:0/285726326 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x562561db8990 con 0x562561d334a0 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f76477fe640 1 -- 172.21.15.70:0/285726326 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7650003e90 con 0x562561d334a0 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f76477fe640 1 -- 172.21.15.70:0/285726326 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f7650048040 con 0x562561d334a0 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 10 client.16530 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 10 client.16530 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 20 client.16530 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562561db8f90 0x562561dbb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 4 client.16530 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:36:48.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.371+0000 7f7670c36740 1 -- 172.21.15.70:0/285726326 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562561d3baf0 con 0x562561db8f90 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.372+0000 7f7667fff640 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562561db8f90 0x562561dbb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.372+0000 7f76477fe640 10 client.16530 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.372+0000 7f7667fff640 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562561db8f90 0x562561dbb380 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b17789d1f8170fee server_cookie=f0da3e44ccf71823 in_seq=0 out_seq=0 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.372+0000 7f76477fe640 1 -- 172.21.15.70:0/285726326 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562561d3baf0 con 0x562561db8f90 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.372+0000 7f76477fe640 10 client.16530 handle_command_reply: tid=0 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.372+0000 7f7670c36740 1 client.16530 shutdown 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.372+0000 7f7670c36740 1 -- 172.21.15.70:0/285726326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d334a0 msgr2=0x562561d46c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.372+0000 7f7670c36740 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d334a0 0x562561d46c50 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f765002a9d0 tx=0x7f765003db30 comp rx=0 tx=0).stop 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 1 -- 172.21.15.70:0/285726326 shutdown_connections 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562561db8f90 0x562561dbb380 crc :-1 s=READY pgs=119 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562561d3e680 0x562561d444e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562561d33dc0 0x562561d43fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 1 --2- 172.21.15.70:0/285726326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562561d334a0 0x562561d46c50 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 1 -- 172.21.15.70:0/285726326 >> 172.21.15.70:0/285726326 conn(0x562561d2fa30 msgr2=0x562561d3d2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f76477fe640 0 client.16530 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 1 -- 172.21.15.70:0/285726326 shutdown_connections 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 1 -- 172.21.15.70:0/285726326 wait complete. 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f7670c36740 20 client.16530 trim_cache size 0 max 16384 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:36:48.386 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:48.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 -- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f76540a33b0 msgr2=0x7f76540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f76540a33b0 0x7f76540a5870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f7660098390 tx=0x7f76600913c0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 -- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7668106f20 msgr2=0x7f766819cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:48.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7668106f20 0x7f766819cd70 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f766000cad0 tx=0x7f766000cf90 comp rx=0 tx=0).stop 2024-09-19T04:36:48.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 -- 172.21.15.70:0/3849999864 shutdown_connections 2024-09-19T04:36:48.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f76540a33b0 0x7f76540a5870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7668106f20 0x7f766819cd70 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f76681027a0 0x7f76681989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 --2- 172.21.15.70:0/3849999864 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7668101df0 0x7f76681984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:48.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 -- 172.21.15.70:0/3849999864 >> 172.21.15.70:0/3849999864 conn(0x7f76680fd8b0 msgr2=0x7f76680feba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:48.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 -- 172.21.15.70:0/3849999864 shutdown_connections 2024-09-19T04:36:48.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:48.373+0000 7f766e85d640 1 -- 172.21.15.70:0/3849999864 wait complete. 2024-09-19T04:36:48.939 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:48 smithi070 ceph-mon[30942]: pgmap v184: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:48.965 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:36:48.966 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:36:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:48 smithi134 ceph-mon[34525]: pgmap v184: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:49.210 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:49.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:48 smithi167 ceph-mon[34339]: pgmap v184: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:49.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3478072014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc100a80 msgr2=0x7f81dc100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3478072014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc100a80 0x7f81dc100ee0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f81cc009930 tx=0x7f81cc02a420 comp rx=0 tx=0).stop 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3478072014 shutdown_connections 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3478072014 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81dc101420 0x7f81dc10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3478072014 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc100a80 0x7f81dc100ee0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3478072014 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81dc106a80 0x7f81dc106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3478072014 >> 172.21.15.70:0/3478072014 conn(0x7f81dc0fc7a0 msgr2=0x7f81dc0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3478072014 shutdown_connections 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.653+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3478072014 wait complete. 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e3fd3640 1 Processor -- start 2024-09-19T04:36:49.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e3fd3640 1 -- start start 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e3fd3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81dc100a80 0x7f81dc197390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e3fd3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc101420 0x7f81dc1978d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e3fd3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81dc106a80 0x7f81dc19bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e3fd3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc110e50 con 0x7f81dc101420 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e3fd3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc110cd0 con 0x7f81dc100a80 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e3fd3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f81dc110fd0 con 0x7f81dc106a80 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e156e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc101420 0x7f81dc1978d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e156e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc101420 0x7f81dc1978d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57070/0 (socket says 172.21.15.70:57070) 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.654+0000 7f81e156e640 1 -- 172.21.15.70:0/3197994331 learned_addr learned my addr 172.21.15.70:0/3197994331 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e1d6f640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81dc100a80 0x7f81dc197390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e2570640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81dc106a80 0x7f81dc19bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:49.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e156e640 1 -- 172.21.15.70:0/3197994331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81dc106a80 msgr2=0x7f81dc19bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e156e640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81dc106a80 0x7f81dc19bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e156e640 1 -- 172.21.15.70:0/3197994331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81dc100a80 msgr2=0x7f81dc197390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e156e640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81dc100a80 0x7f81dc197390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e156e640 1 -- 172.21.15.70:0/3197994331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f81dc19c340 con 0x7f81dc101420 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e2570640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81dc106a80 0x7f81dc19bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e156e640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc101420 0x7f81dc1978d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f81cc005940 tx=0x7f81cc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81d2ffd640 1 -- 172.21.15.70:0/3197994331 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc03f030 con 0x7f81dc101420 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81d2ffd640 1 -- 172.21.15.70:0/3197994331 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f81cc003ac0 con 0x7f81dc101420 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f81dc19c5d0 con 0x7f81dc101420 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81d2ffd640 1 -- 172.21.15.70:0/3197994331 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f81cc035070 con 0x7f81dc101420 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.655+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f81dc1a3f10 con 0x7f81dc101420 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.656+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f81dc100ee0 con 0x7f81dc101420 2024-09-19T04:36:49.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.657+0000 7f81d2ffd640 1 -- 172.21.15.70:0/3197994331 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f81cc042030 con 0x7f81dc101420 2024-09-19T04:36:49.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.658+0000 7f81d2ffd640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81c80a33b0 0x7f81c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:49.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.658+0000 7f81e1d6f640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81c80a33b0 0x7f81c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:49.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.658+0000 7f81d2ffd640 1 -- 172.21.15.70:0/3197994331 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f81cc0f0770 con 0x7f81dc101420 2024-09-19T04:36:49.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.659+0000 7f81e1d6f640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81c80a33b0 0x7f81c80a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81d80058c0 tx=0x7f81d800a250 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:49.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.662+0000 7f81d2ffd640 1 -- 172.21.15.70:0/3197994331 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f81cc0bd230 con 0x7f81dc101420 2024-09-19T04:36:49.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.862+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f81dc109010 con 0x7f81dc101420 2024-09-19T04:36:49.864 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.862+0000 7f81d2ffd640 1 -- 172.21.15.70:0/3197994331 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11915 (secure 0 0 0) 0x7f81cc0bcb30 con 0x7f81dc101420 2024-09-19T04:36:49.864 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:36:49.864 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"btime":"2024-09-19T04:36:44:716583+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:36:44.223175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:36:49.865 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 33 2024-09-19T04:36:49.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81c80a33b0 msgr2=0x7f81c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:49.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81c80a33b0 0x7f81c80a5870 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f81d80058c0 tx=0x7f81d800a250 comp rx=0 tx=0).stop 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc101420 msgr2=0x7f81dc1978d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc101420 0x7f81dc1978d0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f81cc005940 tx=0x7f81cc0042f0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 shutdown_connections 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f81c80a33b0 0x7f81c80a5870 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f81dc106a80 0x7f81dc19bc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f81dc101420 0x7f81dc1978d0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 --2- 172.21.15.70:0/3197994331 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81dc100a80 0x7f81dc197390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 >> 172.21.15.70:0/3197994331 conn(0x7f81dc0fc7a0 msgr2=0x7f81dc0fcfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 shutdown_connections 2024-09-19T04:36:49.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:49.865+0000 7f81e3fd3640 1 -- 172.21.15.70:0/3197994331 wait complete. 2024-09-19T04:36:50.204 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:49 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3197994331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:50.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:49 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3197994331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:50.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:49 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3197994331' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:36:50.527 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:36:50.775 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:51.192 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:50 smithi070 ceph-mon[30942]: pgmap v185: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:51.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:50 smithi167 ceph-mon[34339]: pgmap v185: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 -- 172.21.15.70:0/1260555325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c102790 msgr2=0x7f453c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 --2- 172.21.15.70:0/1260555325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c102790 0x7f453c1067e0 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f4524009900 tx=0x7f452402a410 comp rx=0 tx=0).stop 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 -- 172.21.15.70:0/1260555325 shutdown_connections 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 --2- 172.21.15.70:0/1260555325 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f453c106f10 0x7f453c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 --2- 172.21.15.70:0/1260555325 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c102790 0x7f453c1067e0 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 --2- 172.21.15.70:0/1260555325 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c101de0 0x7f453c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 -- 172.21.15.70:0/1260555325 >> 172.21.15.70:0/1260555325 conn(0x7f453c0fd8c0 msgr2=0x7f453c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 -- 172.21.15.70:0/1260555325 shutdown_connections 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 -- 172.21.15.70:0/1260555325 wait complete. 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.271+0000 7f4541aaa640 1 Processor -- start 2024-09-19T04:36:51.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f4541aaa640 1 -- start start 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f4541aaa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c101de0 0x7f453c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f4541aaa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f453c102790 0x7f453c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f4541aaa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c106f10 0x7f453c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f4541aaa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f453c111f00 con 0x7f453c106f10 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f4541aaa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f453c111d80 con 0x7f453c101de0 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f4541aaa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f453c112080 con 0x7f453c102790 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c106f10 0x7f453c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c106f10 0x7f453c19cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57084/0 (socket says 172.21.15.70:57084) 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 -- 172.21.15.70:0/433904590 learned_addr learned my addr 172.21.15.70:0/433904590 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453affd640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f453c102790 0x7f453c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453b7fe640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c101de0 0x7f453c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 -- 172.21.15.70:0/433904590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f453c102790 msgr2=0x7f453c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f453c102790 0x7f453c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 -- 172.21.15.70:0/433904590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c101de0 msgr2=0x7f453c198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c101de0 0x7f453c198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 -- 172.21.15.70:0/433904590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f453c19d2f0 con 0x7f453c106f10 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453affd640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f453c102790 0x7f453c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.272+0000 7f453bfff640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c106f10 0x7f453c19cbf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f453400cce0 tx=0x7f453400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.273+0000 7f4538ff9640 1 -- 172.21.15.70:0/433904590 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f453400f450 con 0x7f453c106f10 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.273+0000 7f4538ff9640 1 -- 172.21.15.70:0/433904590 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f453400fac0 con 0x7f453c106f10 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.273+0000 7f4538ff9640 1 -- 172.21.15.70:0/433904590 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4534018be0 con 0x7f453c106f10 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.273+0000 7f4541aaa640 1 -- 172.21.15.70:0/433904590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f453c19d5e0 con 0x7f453c106f10 2024-09-19T04:36:51.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.273+0000 7f4541aaa640 1 -- 172.21.15.70:0/433904590 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f453c074420 con 0x7f453c106f10 2024-09-19T04:36:51.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.275+0000 7f4538ff9640 1 -- 172.21.15.70:0/433904590 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f453400fc70 con 0x7f453c106f10 2024-09-19T04:36:51.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.275+0000 7f4543e83740 1 Processor -- start 2024-09-19T04:36:51.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.275+0000 7f4543e83740 1 -- start start 2024-09-19T04:36:51.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f4543e83740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668be8f090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f4543e83740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 0x55668be8fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f4543e83740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be9a370 0x55668be9c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f4543e83740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55668bdf52f0 con 0x55668be90b40 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f4543e83740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55668bd9ccf0 con 0x55668be8f5d0 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f4543e83740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55668bdf12b0 con 0x55668be9a370 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f4538ff9640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45280a33b0 0x7f45280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668be8f090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668be8f090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57098/0 (socket says 172.21.15.70:57098) 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 -- 172.21.15.70:0/3508276377 learned_addr learned my addr 172.21.15.70:0/3508276377 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453bfff640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45280a33b0 0x7f45280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453b7fe640 1 --2- 172.21.15.70:0/3508276377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 0x55668be8fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f4538ff9640 1 -- 172.21.15.70:0/433904590 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f45340d0420 con 0x7f453c106f10 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 -- 172.21.15.70:0/3508276377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be9a370 msgr2=0x55668be9c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 --2- 172.21.15.70:0/3508276377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be9a370 0x55668be9c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 -- 172.21.15.70:0/3508276377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 msgr2=0x55668be8fa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 --2- 172.21.15.70:0/3508276377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 0x55668be8fa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 -- 172.21.15.70:0/3508276377 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668bd813a0 con 0x55668be90b40 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453affd640 1 --2- 172.21.15.70:0/3508276377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668be8f090 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4524005c40 tx=0x7f4524031db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc9bd9b7057906ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.276+0000 7f453bfff640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45280a33b0 0x7f45280a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f453409c420 tx=0x7f453406e4a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4531ffb640 1 -- 172.21.15.70:0/3508276377 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4524035030 con 0x55668be90b40 2024-09-19T04:36:51.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4531ffb640 1 -- 172.21.15.70:0/3508276377 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4524031710 con 0x55668be90b40 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4531ffb640 1 -- 172.21.15.70:0/3508276377 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45240047a0 con 0x55668be90b40 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 -- 172.21.15.70:0/3508276377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 msgr2=0x55668be8f090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 --2- 172.21.15.70:0/3508276377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668be8f090 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f4524005c40 tx=0x7f4524031db0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 -- 172.21.15.70:0/3508276377 shutdown_connections 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 --2- 172.21.15.70:0/3508276377 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be9a370 0x55668be9c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 --2- 172.21.15.70:0/3508276377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 0x55668be8fa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 --2- 172.21.15.70:0/3508276377 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668be8f090 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 -- 172.21.15.70:0/3508276377 >> 172.21.15.70:0/3508276377 conn(0x55668be58310 msgr2=0x55668be8bc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 -- 172.21.15.70:0/3508276377 shutdown_connections 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.277+0000 7f4543e83740 1 -- 172.21.15.70:0/3508276377 wait complete. 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 1 -- start start 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 1 Processor -- start 2024-09-19T04:36:51.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 0x55668be99de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be90b40 0x55668be97090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be977d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55668be9d010 con 0x55668be9a370 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55668bdb0060 con 0x55668be90b40 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55668be9d190 con 0x55668be8f5d0 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f4543e83740 10 client.0 _ll_register_callbacks cb 0x55668bb038c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f453affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be977d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f453affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be977d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57102/0 (socket says 172.21.15.70:57102) 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f453affd640 1 -- 172.21.15.70:0/1939331500 learned_addr learned my addr 172.21.15.70:0/1939331500 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f453affd640 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 0x55668be99de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.278+0000 7f453b7fe640 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be90b40 0x55668be97090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f453affd640 1 -- 172.21.15.70:0/1939331500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 msgr2=0x55668be99de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f453affd640 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 0x55668be99de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f453affd640 1 -- 172.21.15.70:0/1939331500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be90b40 msgr2=0x55668be97090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f453affd640 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be90b40 0x55668be97090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f453affd640 1 -- 172.21.15.70:0/1939331500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55668bb663c0 con 0x55668be9a370 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f453b7fe640 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be90b40 0x55668be97090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f453affd640 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be977d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4524006010 tx=0x7f452402a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=851357cf5d88a2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f451affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f451affd640 1 -- 172.21.15.70:0/1939331500 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4524035040 con 0x55668be9a370 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f451affd640 1 -- 172.21.15.70:0/1939331500 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f4524004bd0 con 0x55668be9a370 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f4543e83740 1 -- 172.21.15.70:0/1939331500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4524031710 con 0x55668be9a370 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f451affd640 1 -- 172.21.15.70:0/1939331500 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f452405b050 con 0x55668be9a370 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f4543e83740 10 client.16548 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f4543e83740 1 -- 172.21.15.70:0/1939331500 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55668bea8b40 con 0x55668be9a370 2024-09-19T04:36:51.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.279+0000 7f451affd640 1 -- 172.21.15.70:0/1939331500 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4524031710 con 0x55668be9a370 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.280+0000 7f451affd640 1 -- 172.21.15.70:0/1939331500 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f4524044900 con 0x55668be9a370 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.280+0000 7f4543e83740 10 client.16548 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.280+0000 7f4543e83740 10 client.16548 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.280+0000 7f4543e83740 20 client.16548 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.280+0000 7f4543e83740 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55668bea9e90 0x55668beac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.280+0000 7f4543e83740 4 client.16548 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.280+0000 7f4543e83740 1 -- 172.21.15.70:0/1939331500 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55668be02860 con 0x55668bea9e90 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.280+0000 7f453b7fe640 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55668bea9e90 0x55668beac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.281+0000 7f453b7fe640 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55668bea9e90 0x55668beac280 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9962c977e3a90d91 server_cookie=2b4c5d7897e85e0b in_seq=0 out_seq=0 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.281+0000 7f451affd640 10 client.16548 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.281+0000 7f451affd640 1 -- 172.21.15.70:0/1939331500 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55668be02860 con 0x55668bea9e90 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.281+0000 7f451affd640 10 client.16548 handle_command_reply: tid=0 2024-09-19T04:36:51.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.281+0000 7f4543e83740 1 client.16548 shutdown 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.281+0000 7f4543e83740 1 -- 172.21.15.70:0/1939331500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 msgr2=0x55668be977d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.281+0000 7f4543e83740 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be977d0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f4524006010 tx=0x7f452402a410 comp rx=0 tx=0).stop 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 1 -- 172.21.15.70:0/1939331500 shutdown_connections 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55668bea9e90 0x55668beac280 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be977d0 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be90b40 0x55668be97090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 1 --2- 172.21.15.70:0/1939331500 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 0x55668be99de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 1 -- 172.21.15.70:0/1939331500 >> 172.21.15.70:0/1939331500 conn(0x55668be58310 msgr2=0x55668be91930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f451affd640 0 client.16548 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 1 -- 172.21.15.70:0/1939331500 shutdown_connections 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 1 -- 172.21.15.70:0/1939331500 wait complete. 2024-09-19T04:36:51.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.282+0000 7f4543e83740 20 client.16548 trim_cache size 0 max 16384 2024-09-19T04:36:51.291 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:50 smithi134 ceph-mon[34525]: pgmap v185: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.294+0000 7f4543e83740 1 Processor -- start 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.294+0000 7f4543e83740 1 -- start start 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f4543e83740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 0x55668bea6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f4543e83740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be90b40 0x55668be92120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f4543e83740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be92660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f4543e83740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f453c1b20c0 con 0x55668be9a370 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f4543e83740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f453c1af960 con 0x55668be8f5d0 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f4543e83740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f453c1ad7d0 con 0x55668be90b40 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be92660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be92660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57114/0 (socket says 172.21.15.70:57114) 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 -- 172.21.15.70:0/2983426960 learned_addr learned my addr 172.21.15.70:0/2983426960 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453b7fe640 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be90b40 0x55668be92120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 0x55668bea6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 -- 172.21.15.70:0/2983426960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be90b40 msgr2=0x55668be92120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be90b40 0x55668be92120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 -- 172.21.15.70:0/2983426960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 msgr2=0x55668bea6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 0x55668bea6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 -- 172.21.15.70:0/2983426960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55668be92ba0 con 0x55668be9a370 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f453affd640 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be92660 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4524005c40 tx=0x7f4524004920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1f8390056ef33ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.295+0000 7f45317fa640 1 -- 172.21.15.70:0/2983426960 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4524035040 con 0x55668be9a370 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f45317fa640 1 -- 172.21.15.70:0/2983426960 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4524031d90 con 0x55668be9a370 2024-09-19T04:36:51.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f45317fa640 1 -- 172.21.15.70:0/2983426960 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45240446a0 con 0x55668be9a370 2024-09-19T04:36:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 -- 172.21.15.70:0/2983426960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 msgr2=0x55668be92660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be92660 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7f4524005c40 tx=0x7f4524004920 comp rx=0 tx=0).stop 2024-09-19T04:36:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 -- 172.21.15.70:0/2983426960 shutdown_connections 2024-09-19T04:36:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be9a370 0x55668be92660 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be90b40 0x55668be92120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 --2- 172.21.15.70:0/2983426960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be8f5d0 0x55668bea6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 -- 172.21.15.70:0/2983426960 >> 172.21.15.70:0/2983426960 conn(0x55668be58310 msgr2=0x55668be96180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 -- 172.21.15.70:0/2983426960 shutdown_connections 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 -- 172.21.15.70:0/2983426960 wait complete. 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.296+0000 7f4543e83740 1 -- start start 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f4543e83740 1 Processor -- start 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f4543e83740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 0x55668beac450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f4543e83740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668beac990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f4543e83740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be9a370 0x55668bf127c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f4543e83740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f453c1ade20 con 0x55668be90b40 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f4543e83740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f453c1af290 con 0x55668be9a370 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f4543e83740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f453c1ae4f0 con 0x55668be8f5d0 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f4543e83740 10 client.0 _ll_register_callbacks cb 0x7f4524031ce0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:51.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668beac990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668beac990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57122/0 (socket says 172.21.15.70:57122) 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453b7fe640 1 -- 172.21.15.70:0/3913824548 learned_addr learned my addr 172.21.15.70:0/3913824548 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453affd640 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 0x55668beac450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453affd640 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be9a370 0x55668bf127c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453b7fe640 1 -- 172.21.15.70:0/3913824548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 msgr2=0x55668beac450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453b7fe640 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 0x55668beac450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453b7fe640 1 -- 172.21.15.70:0/3913824548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be9a370 msgr2=0x55668bf127c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453b7fe640 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be9a370 0x55668bf127c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.297+0000 7f453b7fe640 1 -- 172.21.15.70:0/3913824548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55668bf12e00 con 0x55668be90b40 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f453b7fe640 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668beac990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55668be96920 tx=0x7f452c011810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d13b6655e08cfdf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f451affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f451affd640 1 -- 172.21.15.70:0/3913824548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f452c004460 con 0x55668be90b40 2024-09-19T04:36:51.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f451affd640 1 -- 172.21.15.70:0/3913824548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f452c0035f0 con 0x55668be90b40 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 1 -- 172.21.15.70:0/3913824548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4524031d90 con 0x55668be90b40 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f451affd640 1 -- 172.21.15.70:0/3913824548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f452c0037f0 con 0x55668be90b40 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 10 client.16554 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 1 -- 172.21.15.70:0/3913824548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55668bf14170 con 0x55668be90b40 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f451affd640 1 -- 172.21.15.70:0/3913824548 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4524031d90 con 0x55668be90b40 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f451affd640 1 -- 172.21.15.70:0/3913824548 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f452c02a020 con 0x55668be90b40 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 10 client.16554 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 10 client.16554 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 20 client.16554 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55668bf14900 0x55668bf16d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 4 client.16554 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:51.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.298+0000 7f4543e83740 1 -- 172.21.15.70:0/3913824548 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55668bdfcd70 con 0x55668bf14900 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f453affd640 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55668bf14900 0x55668bf16d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f453affd640 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55668bf14900 0x55668bf16d20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=892785e85ef506f0 server_cookie=451ac5bc2ceda9d3 in_seq=0 out_seq=0 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f451affd640 10 client.16554 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f451affd640 1 -- 172.21.15.70:0/3913824548 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55668bdfcd70 con 0x55668bf14900 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f451affd640 10 client.16554 handle_command_reply: tid=0 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 client.16554 shutdown 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 -- 172.21.15.70:0/3913824548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 msgr2=0x55668beac990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668beac990 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x55668be96920 tx=0x7f452c011810 comp rx=0 tx=0).stop 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 -- 172.21.15.70:0/3913824548 shutdown_connections 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55668bf14900 0x55668bf16d20 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55668be9a370 0x55668bf127c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f451affd640 0 client.16554 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55668be90b40 0x55668beac990 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 --2- 172.21.15.70:0/3913824548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55668be8f5d0 0x55668beac450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 -- 172.21.15.70:0/3913824548 >> 172.21.15.70:0/3913824548 conn(0x55668be58310 msgr2=0x55668be988f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:51.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.299+0000 7f4543e83740 1 -- 172.21.15.70:0/3913824548 shutdown_connections 2024-09-19T04:36:51.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4543e83740 1 -- 172.21.15.70:0/3913824548 wait complete. 2024-09-19T04:36:51.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4543e83740 20 client.16554 trim_cache size 0 max 16384 2024-09-19T04:36:51.307 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 -- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45280a33b0 msgr2=0x7f45280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45280a33b0 0x7f45280a5870 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f453409c420 tx=0x7f453406e4a0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 -- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c106f10 msgr2=0x7f453c19cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c106f10 0x7f453c19cbf0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f453400cce0 tx=0x7f453400a620 comp rx=0 tx=0).stop 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 -- 172.21.15.70:0/433904590 shutdown_connections 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45280a33b0 0x7f45280a5870 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f453c106f10 0x7f453c19cbf0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f453c102790 0x7f453c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 --2- 172.21.15.70:0/433904590 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c101de0 0x7f453c198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:51.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 -- 172.21.15.70:0/433904590 >> 172.21.15.70:0/433904590 conn(0x7f453c0fd8c0 msgr2=0x7f453c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:51.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 -- 172.21.15.70:0/433904590 shutdown_connections 2024-09-19T04:36:51.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:51.300+0000 7f4541aaa640 1 -- 172.21.15.70:0/433904590 wait complete. 2024-09-19T04:36:52.034 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:36:52.280 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 -- 172.21.15.70:0/1975617647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8106f10 msgr2=0x7f73f810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 --2- 172.21.15.70:0/1975617647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8106f10 0x7f73f810ea90 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f73f0009900 tx=0x7f73f002a410 comp rx=0 tx=0).stop 2024-09-19T04:36:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 -- 172.21.15.70:0/1975617647 shutdown_connections 2024-09-19T04:36:52.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 --2- 172.21.15.70:0/1975617647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8106f10 0x7f73f810ea90 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 --2- 172.21.15.70:0/1975617647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73f8102790 0x7f73f81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 --2- 172.21.15.70:0/1975617647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8101de0 0x7f73f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 -- 172.21.15.70:0/1975617647 >> 172.21.15.70:0/1975617647 conn(0x7f73f80fd8c0 msgr2=0x7f73f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 -- 172.21.15.70:0/1975617647 shutdown_connections 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.781+0000 7f73fcd05640 1 -- 172.21.15.70:0/1975617647 wait complete. 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.782+0000 7f73fcd05640 1 Processor -- start 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.782+0000 7f73fcd05640 1 -- start start 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73fcd05640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73f8101de0 0x7f73f81983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73fcd05640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8102790 0x7f73f8198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73fcd05640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8106f10 0x7f73f819cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73fcd05640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73f8111f40 con 0x7f73f8102790 2024-09-19T04:36:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73fcd05640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73f8111dc0 con 0x7f73f8106f10 2024-09-19T04:36:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73fcd05640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81120c0 con 0x7f73f8101de0 2024-09-19T04:36:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8102790 0x7f73f8198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8102790 0x7f73f8198900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57142/0 (socket says 172.21.15.70:57142) 2024-09-19T04:36:52.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 -- 172.21.15.70:0/2543517818 learned_addr learned my addr 172.21.15.70:0/2543517818 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f659c640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73f8101de0 0x7f73f81983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f6d9d640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8106f10 0x7f73f819cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 -- 172.21.15.70:0/2543517818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73f8101de0 msgr2=0x7f73f81983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73f8101de0 0x7f73f81983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 -- 172.21.15.70:0/2543517818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8106f10 msgr2=0x7f73f819cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8106f10 0x7f73f819cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 -- 172.21.15.70:0/2543517818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f73f819d370 con 0x7f73f8102790 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8102790 0x7f73f8198900 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00d950 tx=0x7f73ec00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73e77fe640 1 -- 172.21.15.70:0/2543517818 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec017070 con 0x7f73f8102790 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73e77fe640 1 -- 172.21.15.70:0/2543517818 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73ec009c30 con 0x7f73f8102790 2024-09-19T04:36:52.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.783+0000 7f73fcd05640 1 -- 172.21.15.70:0/2543517818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f73f819d660 con 0x7f73f8102790 2024-09-19T04:36:52.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.784+0000 7f73e77fe640 1 -- 172.21.15.70:0/2543517818 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73ec00f6b0 con 0x7f73f8102790 2024-09-19T04:36:52.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.784+0000 7f73fcd05640 1 -- 172.21.15.70:0/2543517818 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73f81a4f40 con 0x7f73f8102790 2024-09-19T04:36:52.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.786+0000 7f73e77fe640 1 -- 172.21.15.70:0/2543517818 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f73ec010a50 con 0x7f73f8102790 2024-09-19T04:36:52.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.786+0000 7f73ff0de740 1 Processor -- start 2024-09-19T04:36:52.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.786+0000 7f73ff0de740 1 -- start start 2024-09-19T04:36:52.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.786+0000 7f73e77fe640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e00a33b0 0x7f73e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.786+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300e0b40 0x55cb300df090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 0x55cb300dfa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300f0b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73ff0de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cb300452f0 con 0x55cb300e0b40 2024-09-19T04:36:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73ff0de740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cb2ffeccf0 con 0x55cb300ee780 2024-09-19T04:36:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73ff0de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cb300412b0 con 0x55cb300df5d0 2024-09-19T04:36:52.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300e0b40 0x55cb300df090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300e0b40 0x55cb300df090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57150/0 (socket says 172.21.15.70:57150) 2024-09-19T04:36:52.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f6d9d640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e00a33b0 0x7f73e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 -- 172.21.15.70:0/2826823798 learned_addr learned my addr 172.21.15.70:0/2826823798 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:52.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73e77fe640 1 -- 172.21.15.70:0/2543517818 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f73ec0cf900 con 0x7f73f8102790 2024-09-19T04:36:52.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f6d9d640 1 --2- 172.21.15.70:0/2826823798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300f0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 -- 172.21.15.70:0/2826823798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 msgr2=0x55cb300dfa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 --2- 172.21.15.70:0/2826823798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 0x55cb300dfa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 -- 172.21.15.70:0/2826823798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 msgr2=0x55cb300f0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 --2- 172.21.15.70:0/2826823798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300f0b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 -- 172.21.15.70:0/2826823798 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb2ffd13a0 con 0x55cb300e0b40 2024-09-19T04:36:52.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f659c640 1 --2- 172.21.15.70:0/2826823798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300e0b40 0x55cb300df090 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f73e800af40 tx=0x7f73e800f850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7098322eedae4a53 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73f6d9d640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e00a33b0 0x7f73e00a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55cb300e0070 tx=0x7f73f0032b90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73e4ff9640 1 -- 172.21.15.70:0/2826823798 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e801d070 con 0x55cb300e0b40 2024-09-19T04:36:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73e4ff9640 1 -- 172.21.15.70:0/2826823798 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73e8010dd0 con 0x55cb300e0b40 2024-09-19T04:36:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.787+0000 7f73e4ff9640 1 -- 172.21.15.70:0/2826823798 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e8016340 con 0x55cb300e0b40 2024-09-19T04:36:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 -- 172.21.15.70:0/2826823798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300e0b40 msgr2=0x55cb300df090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2826823798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300e0b40 0x55cb300df090 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f73e800af40 tx=0x7f73e800f850 comp rx=0 tx=0).stop 2024-09-19T04:36:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 -- 172.21.15.70:0/2826823798 shutdown_connections 2024-09-19T04:36:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2826823798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300f0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2826823798 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 0x55cb300dfa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2826823798 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300e0b40 0x55cb300df090 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 -- 172.21.15.70:0/2826823798 >> 172.21.15.70:0/2826823798 conn(0x55cb300a8310 msgr2=0x55cb300dbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:52.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 -- 172.21.15.70:0/2826823798 shutdown_connections 2024-09-19T04:36:52.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 -- 172.21.15.70:0/2826823798 wait complete. 2024-09-19T04:36:52.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.788+0000 7f73ff0de740 1 -- start start 2024-09-19T04:36:52.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ff0de740 1 Processor -- start 2024-09-19T04:36:52.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300ee1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 0x55cb300eb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300ebbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ff0de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cb300f1480 con 0x55cb300df5d0 2024-09-19T04:36:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ff0de740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cb30000060 con 0x55cb300ee780 2024-09-19T04:36:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ff0de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cb300f1600 con 0x55cb300e0b40 2024-09-19T04:36:52.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ff0de740 10 client.0 _ll_register_callbacks cb 0x55cb2fd538c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300ee1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300ee1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57162/0 (socket says 172.21.15.70:57162) 2024-09-19T04:36:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 -- 172.21.15.70:0/2930711698 learned_addr learned my addr 172.21.15.70:0/2930711698 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 -- 172.21.15.70:0/2930711698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 msgr2=0x55cb300eb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:52.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 0x55cb300eb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 -- 172.21.15.70:0/2930711698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 msgr2=0x55cb300ebbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:52.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300ebbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 -- 172.21.15.70:0/2930711698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb2fdb63c0 con 0x55cb300df5d0 2024-09-19T04:36:52.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73f659c640 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300ee1f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f73e80189e0 tx=0x7f73e800ac70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=647cc567e516b5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:52.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.789+0000 7f73ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:52.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ddffb640 1 -- 172.21.15.70:0/2930711698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e8027030 con 0x55cb300df5d0 2024-09-19T04:36:52.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ddffb640 1 -- 172.21.15.70:0/2930711698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f73e8018540 con 0x55cb300df5d0 2024-09-19T04:36:52.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 1 -- 172.21.15.70:0/2930711698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73e8010dd0 con 0x55cb300df5d0 2024-09-19T04:36:52.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ddffb640 1 -- 172.21.15.70:0/2930711698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f73e8031050 con 0x55cb300df5d0 2024-09-19T04:36:52.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 10 client.16566 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:52.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 1 -- 172.21.15.70:0/2930711698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cb300fcfb0 con 0x55cb300df5d0 2024-09-19T04:36:52.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ddffb640 1 -- 172.21.15.70:0/2930711698 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73e8010dd0 con 0x55cb300df5d0 2024-09-19T04:36:52.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ddffb640 1 -- 172.21.15.70:0/2930711698 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f73e8005180 con 0x55cb300df5d0 2024-09-19T04:36:52.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 10 client.16566 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:52.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 10 client.16566 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:52.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 20 client.16566 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:52.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55cb300fe3b0 0x55cb301007a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 4 client.16566 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:52.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73ff0de740 1 -- 172.21.15.70:0/2930711698 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cb30052860 con 0x55cb300fe3b0 2024-09-19T04:36:52.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.790+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55cb300fe3b0 0x55cb301007a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.791+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55cb300fe3b0 0x55cb301007a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ac683b2eac6ca4fa server_cookie=4e1f41a613a242b7 in_seq=0 out_seq=0 2024-09-19T04:36:52.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.791+0000 7f73ddffb640 10 client.16566 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:52.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ddffb640 1 -- 172.21.15.70:0/2930711698 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cb30052860 con 0x55cb300fe3b0 2024-09-19T04:36:52.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ddffb640 10 client.16566 handle_command_reply: tid=0 2024-09-19T04:36:52.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 client.16566 shutdown 2024-09-19T04:36:52.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 -- 172.21.15.70:0/2930711698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 msgr2=0x55cb300ee1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300ee1f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f73e80189e0 tx=0x7f73e800ac70 comp rx=0 tx=0).stop 2024-09-19T04:36:52.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 -- 172.21.15.70:0/2930711698 shutdown_connections 2024-09-19T04:36:52.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55cb300fe3b0 0x55cb301007a0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300ebbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ddffb640 0 client.16566 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:52.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 0x55cb300eb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2930711698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300ee1f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 -- 172.21.15.70:0/2930711698 >> 172.21.15.70:0/2930711698 conn(0x55cb300a8310 msgr2=0x55cb300e1960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:52.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 -- 172.21.15.70:0/2930711698 shutdown_connections 2024-09-19T04:36:52.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 1 -- 172.21.15.70:0/2930711698 wait complete. 2024-09-19T04:36:52.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.792+0000 7f73ff0de740 20 client.16566 trim_cache size 0 max 16384 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73ff0de740 1 Processor -- start 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73ff0de740 1 -- start start 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 0x55cb300fa720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300e0b40 0x55cb300ea350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300ee780 0x55cb30105e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73ff0de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81adf50 con 0x55cb300ee780 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73ff0de740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81ab7f0 con 0x55cb300e0b40 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73ff0de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81a9640 con 0x55cb300df5d0 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73f6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300ee780 0x55cb30105e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73f6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300ee780 0x55cb30105e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57172/0 (socket says 172.21.15.70:57172) 2024-09-19T04:36:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73f6d9d640 1 -- 172.21.15.70:0/3862000581 learned_addr learned my addr 172.21.15.70:0/3862000581 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73f659c640 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 0x55cb300fa720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.805+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300e0b40 0x55cb300ea350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73f6d9d640 1 -- 172.21.15.70:0/3862000581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 msgr2=0x55cb300fa720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73f6d9d640 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 0x55cb300fa720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73f6d9d640 1 -- 172.21.15.70:0/3862000581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300e0b40 msgr2=0x55cb300ea350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73f6d9d640 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300e0b40 0x55cb300ea350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73f6d9d640 1 -- 172.21.15.70:0/3862000581 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cb300dc960 con 0x55cb300ee780 2024-09-19T04:36:52.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73f659c640 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 0x55cb300fa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:52.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300e0b40 0x55cb300ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:52.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73f6d9d640 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300ee780 0x55cb30105e30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f73f0033000 tx=0x7f73f002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864bf6f231558d40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:52.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73dffff640 1 -- 172.21.15.70:0/3862000581 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0035070 con 0x55cb300ee780 2024-09-19T04:36:52.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73dffff640 1 -- 172.21.15.70:0/3862000581 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73f004d070 con 0x55cb300ee780 2024-09-19T04:36:52.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.806+0000 7f73dffff640 1 -- 172.21.15.70:0/3862000581 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f0004920 con 0x55cb300ee780 2024-09-19T04:36:52.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- 172.21.15.70:0/3862000581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300ee780 msgr2=0x55cb30105e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300ee780 0x55cb30105e30 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f73f0033000 tx=0x7f73f002a410 comp rx=0 tx=0).stop 2024-09-19T04:36:52.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- 172.21.15.70:0/3862000581 shutdown_connections 2024-09-19T04:36:52.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300ee780 0x55cb30105e30 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300e0b40 0x55cb300ea350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 --2- 172.21.15.70:0/3862000581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300df5d0 0x55cb300fa720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- 172.21.15.70:0/3862000581 >> 172.21.15.70:0/3862000581 conn(0x55cb300a8310 msgr2=0x55cb300e9c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- 172.21.15.70:0/3862000581 shutdown_connections 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- 172.21.15.70:0/3862000581 wait complete. 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- start start 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 Processor -- start 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300f6dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 0x55cb300f2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300f2680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81a9cb0 con 0x55cb300df5d0 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81ab120 con 0x55cb300ee780 2024-09-19T04:36:52.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73f81aa380 con 0x55cb300e0b40 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73ff0de740 10 client.0 _ll_register_callbacks cb 0x7f73e801b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73f659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300f6dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73f659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300f6dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:57174/0 (socket says 172.21.15.70:57174) 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.807+0000 7f73f659c640 1 -- 172.21.15.70:0/2173794576 learned_addr learned my addr 172.21.15.70:0/2173794576 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73f6d9d640 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300f2680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 0x55cb300f2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73f659c640 1 -- 172.21.15.70:0/2173794576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 msgr2=0x55cb300f2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73f659c640 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 0x55cb300f2140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73f659c640 1 -- 172.21.15.70:0/2173794576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 msgr2=0x55cb300f2680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73f659c640 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300f2680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73f659c640 1 -- 172.21.15.70:0/2173794576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cb300dcdd0 con 0x55cb300df5d0 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73f659c640 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300f6dc0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f73e8005520 tx=0x7f73e800a590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90132b9574da790b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:52.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73ddffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73ddffb640 1 -- 172.21.15.70:0/2173794576 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73e8027040 con 0x55cb300df5d0 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73ddffb640 1 -- 172.21.15.70:0/2173794576 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f73e8002030 con 0x55cb300df5d0 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73ff0de740 1 -- 172.21.15.70:0/2173794576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f004d070 con 0x55cb300df5d0 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73ddffb640 1 -- 172.21.15.70:0/2173794576 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f73e8042050 con 0x55cb300df5d0 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73ff0de740 10 client.16572 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73ff0de740 1 -- 172.21.15.70:0/2173794576 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55cb30168a20 con 0x55cb300df5d0 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.808+0000 7f73ddffb640 1 -- 172.21.15.70:0/2173794576 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73f004d070 con 0x55cb300df5d0 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73ddffb640 1 -- 172.21.15.70:0/2173794576 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f73e8004e60 con 0x55cb300df5d0 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73ff0de740 10 client.16572 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73ff0de740 10 client.16572 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73ff0de740 20 client.16572 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55cb30169130 0x55cb3016b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:52.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73ff0de740 4 client.16572 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73ff0de740 1 -- 172.21.15.70:0/2173794576 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cb3004cd70 con 0x55cb30169130 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55cb30169130 0x55cb3016b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73ddffb640 10 client.16572 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.809+0000 7f73f5d9b640 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55cb30169130 0x55cb3016b550 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef7f2e02cf529dab server_cookie=62bb12d1c4b65293 in_seq=0 out_seq=0 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ddffb640 1 -- 172.21.15.70:0/2173794576 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cb3004cd70 con 0x55cb30169130 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ddffb640 10 client.16572 handle_command_reply: tid=0 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 client.16572 shutdown 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 -- 172.21.15.70:0/2173794576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 msgr2=0x55cb300f6dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300f6dc0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f73e8005520 tx=0x7f73e800a590 comp rx=0 tx=0).stop 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 -- 172.21.15.70:0/2173794576 shutdown_connections 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55cb30169130 0x55cb3016b550 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cb300ee780 0x55cb300f2680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cb300e0b40 0x55cb300f2140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ddffb640 0 client.16572 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 --2- 172.21.15.70:0/2173794576 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cb300df5d0 0x55cb300f6dc0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 -- 172.21.15.70:0/2173794576 >> 172.21.15.70:0/2173794576 conn(0x55cb300a8310 msgr2=0x55cb300e1930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 -- 172.21.15.70:0/2173794576 shutdown_connections 2024-09-19T04:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 1 -- 172.21.15.70:0/2173794576 wait complete. 2024-09-19T04:36:52.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73ff0de740 20 client.16572 trim_cache size 0 max 16384 2024-09-19T04:36:52.837 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73fcd05640 1 -- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e00a33b0 msgr2=0x7f73e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73fcd05640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e00a33b0 0x7f73e00a5870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55cb300e0070 tx=0x7f73f0032b90 comp rx=0 tx=0).stop 2024-09-19T04:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73fcd05640 1 -- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8102790 msgr2=0x7f73f8198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:52.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.810+0000 7f73fcd05640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8102790 0x7f73f8198900 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f73ec00d950 tx=0x7f73ec00de10 comp rx=0 tx=0).stop 2024-09-19T04:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.811+0000 7f73fcd05640 1 -- 172.21.15.70:0/2543517818 shutdown_connections 2024-09-19T04:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.811+0000 7f73fcd05640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e00a33b0 0x7f73e00a5870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.811+0000 7f73fcd05640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f8106f10 0x7f73f819cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.811+0000 7f73fcd05640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f73f8102790 0x7f73f8198900 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.811+0000 7f73fcd05640 1 --2- 172.21.15.70:0/2543517818 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f73f8101de0 0x7f73f81983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.811+0000 7f73fcd05640 1 -- 172.21.15.70:0/2543517818 >> 172.21.15.70:0/2543517818 conn(0x7f73f80fd8c0 msgr2=0x7f73f80febd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.811+0000 7f73fcd05640 1 -- 172.21.15.70:0/2543517818 shutdown_connections 2024-09-19T04:36:52.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:52.811+0000 7f73fcd05640 1 -- 172.21.15.70:0/2543517818 wait complete. 2024-09-19T04:36:52.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:52 smithi167 ceph-mon[34339]: pgmap v186: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:52 smithi134 ceph-mon[34525]: pgmap v186: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:53.122 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:52 smithi070 ceph-mon[30942]: pgmap v186: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:36:53.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:36:53.760 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 -- 172.21.15.70:0/2497070540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574102570 msgr2=0x7f55741029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 --2- 172.21.15.70:0/2497070540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574102570 0x7f55741029b0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f5560009900 tx=0x7f556002a480 comp rx=0 tx=0).stop 2024-09-19T04:36:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 -- 172.21.15.70:0/2497070540 shutdown_connections 2024-09-19T04:36:54.224 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 --2- 172.21.15.70:0/2497070540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5574102ef0 0x7f557410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 --2- 172.21.15.70:0/2497070540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574102570 0x7f55741029b0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 --2- 172.21.15.70:0/2497070540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5574100e20 0x7f5574101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 -- 172.21.15.70:0/2497070540 >> 172.21.15.70:0/2497070540 conn(0x7f55740fc7d0 msgr2=0x7f55740febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 -- 172.21.15.70:0/2497070540 shutdown_connections 2024-09-19T04:36:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.222+0000 7f557b20d640 1 -- 172.21.15.70:0/2497070540 wait complete. 2024-09-19T04:36:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f557b20d640 1 Processor -- start 2024-09-19T04:36:54.225 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f557b20d640 1 -- start start 2024-09-19T04:36:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f557b20d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574100e20 0x7f5574199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.226 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f557b20d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5574102570 0x7f5574199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f557b20d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5574102ef0 0x7f55741a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f557b20d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5574110f50 con 0x7f5574100e20 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f557b20d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5574110dd0 con 0x7f5574102570 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f557b20d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55741110d0 con 0x7f5574102ef0 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f5578fa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574100e20 0x7f5574199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f5578fa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574100e20 0x7f5574199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52318/0 (socket says 172.21.15.70:52318) 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f5578fa9640 1 -- 172.21.15.70:0/2978116744 learned_addr learned my addr 172.21.15.70:0/2978116744 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f5573fff640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5574102570 0x7f5574199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.223+0000 7f55797aa640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5574102ef0 0x7f55741a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5578fa9640 1 -- 172.21.15.70:0/2978116744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5574102ef0 msgr2=0x7f55741a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5578fa9640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5574102ef0 0x7f55741a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.227 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5578fa9640 1 -- 172.21.15.70:0/2978116744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5574102570 msgr2=0x7f5574199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5578fa9640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5574102570 0x7f5574199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5578fa9640 1 -- 172.21.15.70:0/2978116744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55741a48e0 con 0x7f5574100e20 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5573fff640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5574102570 0x7f5574199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5578fa9640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574100e20 0x7f5574199320 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f556800d770 tx=0x7f556800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5571ffb640 1 -- 172.21.15.70:0/2978116744 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568017070 con 0x7f5574100e20 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5571ffb640 1 -- 172.21.15.70:0/2978116744 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f55680054f0 con 0x7f5574100e20 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f5571ffb640 1 -- 172.21.15.70:0/2978116744 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568004d60 con 0x7f5574100e20 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f557b20d640 1 -- 172.21.15.70:0/2978116744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55741a4ab0 con 0x7f5574100e20 2024-09-19T04:36:54.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.224+0000 7f557b20d640 1 -- 172.21.15.70:0/2978116744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55741a4fc0 con 0x7f5574100e20 2024-09-19T04:36:54.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.226+0000 7f5571ffb640 1 -- 172.21.15.70:0/2978116744 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5568004f00 con 0x7f5574100e20 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f557d5e6740 1 Processor -- start 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f557d5e6740 1 -- start start 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f5571ffb640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55640a3430 0x7f55640a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc42090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc42a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 0x5604cdc4f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f557d5e6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604cdba82f0 con 0x5604cdc43b40 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f557d5e6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5604cdb4fcf0 con 0x5604cdc425d0 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f557d5e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5604cdba42b0 con 0x5604cdc4d370 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f55797aa640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55640a3430 0x7f55640a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f5571ffb640 1 -- 172.21.15.70:0/2978116744 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f55680cf7c0 con 0x7f5574100e20 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f5578fa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc42090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f5578fa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc42090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52332/0 (socket says 172.21.15.70:52332) 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f5578fa9640 1 -- 172.21.15.70:0/1350934901 learned_addr learned my addr 172.21.15.70:0/1350934901 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f55797aa640 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 0x5604cdc4f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.227+0000 7f5573fff640 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc42a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f5578fa9640 1 -- 172.21.15.70:0/1350934901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 msgr2=0x5604cdc4f760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f5578fa9640 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 0x5604cdc4f760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f5578fa9640 1 -- 172.21.15.70:0/1350934901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 msgr2=0x5604cdc42a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f5578fa9640 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc42a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f5578fa9640 1 -- 172.21.15.70:0/1350934901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604cdb343a0 con 0x5604cdc43b40 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f5573fff640 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc42a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f55797aa640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55640a3430 0x7f55640a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f556c012590 tx=0x7f556c012990 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f5578fa9640 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc42090 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f55680ccf90 tx=0x7f55680ae7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d352dcabfce336f9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f555effd640 1 -- 172.21.15.70:0/1350934901 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568020070 con 0x5604cdc43b40 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f555effd640 1 -- 172.21.15.70:0/1350934901 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5568009cc0 con 0x5604cdc43b40 2024-09-19T04:36:54.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.228+0000 7f555effd640 1 -- 172.21.15.70:0/1350934901 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f556809fe70 con 0x5604cdc43b40 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 -- 172.21.15.70:0/1350934901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 msgr2=0x5604cdc42090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc42090 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f55680ccf90 tx=0x7f55680ae7e0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 -- 172.21.15.70:0/1350934901 shutdown_connections 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 0x5604cdc4f760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc42a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1350934901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc42090 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 -- 172.21.15.70:0/1350934901 >> 172.21.15.70:0/1350934901 conn(0x5604cdc0b310 msgr2=0x5604cdc3ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 -- 172.21.15.70:0/1350934901 shutdown_connections 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 -- 172.21.15.70:0/1350934901 wait complete. 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 -- start start 2024-09-19T04:36:54.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.229+0000 7f557d5e6740 1 Processor -- start 2024-09-19T04:36:54.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc425d0 0x5604cdc4cd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc43b40 0x5604cdc4a020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 0x5604cdc4a610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5604cdc50010 con 0x5604cdc425d0 2024-09-19T04:36:54.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5604cdb63060 con 0x5604cdc4d370 2024-09-19T04:36:54.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5604cdc50190 con 0x5604cdc43b40 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 10 client.0 _ll_register_callbacks cb 0x5604cd8b68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc425d0 0x5604cdc4cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc425d0 0x5604cdc4cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52344/0 (socket says 172.21.15.70:52344) 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 -- 172.21.15.70:0/1194314030 learned_addr learned my addr 172.21.15.70:0/1194314030 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5573fff640 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc43b40 0x5604cdc4a020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 -- 172.21.15.70:0/1194314030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc43b40 msgr2=0x5604cdc4a020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc43b40 0x5604cdc4a020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 -- 172.21.15.70:0/1194314030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 msgr2=0x5604cdc4a610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 0x5604cdc4a610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 -- 172.21.15.70:0/1194314030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604cd9193c0 con 0x5604cdc425d0 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5578fa9640 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc425d0 0x5604cdc4cd70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5568097f20 tx=0x7f556809bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c3ffa37678d754 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5553fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:54.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5553fff640 1 -- 172.21.15.70:0/1194314030 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5568020070 con 0x5604cdc425d0 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5553fff640 1 -- 172.21.15.70:0/1194314030 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f5568098130 con 0x5604cdc425d0 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 1 -- 172.21.15.70:0/1194314030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5604cdbb5860 con 0x5604cdc425d0 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f5553fff640 1 -- 172.21.15.70:0/1194314030 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f556809c1c0 con 0x5604cdc425d0 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 10 client.16584 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.230+0000 7f557d5e6740 1 -- 172.21.15.70:0/1194314030 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5604cdc5bab0 con 0x5604cdc425d0 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f5553fff640 1 -- 172.21.15.70:0/1194314030 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x5604cdbb5860 con 0x5604cdc425d0 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f5553fff640 1 -- 172.21.15.70:0/1194314030 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f55680860b0 con 0x5604cdc425d0 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f557d5e6740 10 client.16584 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f557d5e6740 10 client.16584 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f557d5e6740 20 client.16584 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5604cdc5ce00 0x5604cdc5f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f557d5e6740 4 client.16584 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f557d5e6740 1 -- 172.21.15.70:0/1194314030 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5604cdbafd70 con 0x5604cdc5ce00 2024-09-19T04:36:54.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.231+0000 7f5573fff640 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5604cdc5ce00 0x5604cdc5f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.232+0000 7f5553fff640 10 client.16584 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.232+0000 7f5573fff640 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5604cdc5ce00 0x5604cdc5f1f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=554a7dc3c5e504be server_cookie=3817a720d15cef60 in_seq=0 out_seq=0 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.232+0000 7f5553fff640 1 -- 172.21.15.70:0/1194314030 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5604cdbafd70 con 0x5604cdc5ce00 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.232+0000 7f5553fff640 10 client.16584 handle_command_reply: tid=0 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.232+0000 7f557d5e6740 1 client.16584 shutdown 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 -- 172.21.15.70:0/1194314030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc425d0 msgr2=0x5604cdc4cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc425d0 0x5604cdc4cd70 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f5568097f20 tx=0x7f556809bb30 comp rx=0 tx=0).stop 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 -- 172.21.15.70:0/1194314030 shutdown_connections 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5604cdc5ce00 0x5604cdc5f1f0 crc :-1 s=READY pgs=120 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 0x5604cdc4a610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc43b40 0x5604cdc4a020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1194314030 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc425d0 0x5604cdc4cd70 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 -- 172.21.15.70:0/1194314030 >> 172.21.15.70:0/1194314030 conn(0x5604cdc0b310 msgr2=0x5604cdc44990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:54.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f5553fff640 0 client.16584 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:54.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 -- 172.21.15.70:0/1194314030 shutdown_connections 2024-09-19T04:36:54.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 1 -- 172.21.15.70:0/1194314030 wait complete. 2024-09-19T04:36:54.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.233+0000 7f557d5e6740 20 client.16584 trim_cache size 0 max 16384 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.245+0000 7f557d5e6740 1 Processor -- start 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.245+0000 7f557d5e6740 1 -- start start 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc498e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc3dc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 0x5604cdc62220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f557d5e6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55741b0090 con 0x5604cdc43b40 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f557d5e6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55741ad930 con 0x5604cdc425d0 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f557d5e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55741ab780 con 0x5604cdc4d370 2024-09-19T04:36:54.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc3dc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc3dc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52356/0 (socket says 172.21.15.70:52356) 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 -- 172.21.15.70:0/1373854133 learned_addr learned my addr 172.21.15.70:0/1373854133 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5578fa9640 1 --2- 172.21.15.70:0/1373854133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc498e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 -- 172.21.15.70:0/1373854133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 msgr2=0x5604cdc62220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 --2- 172.21.15.70:0/1373854133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 0x5604cdc62220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 -- 172.21.15.70:0/1373854133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 msgr2=0x5604cdc498e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 --2- 172.21.15.70:0/1373854133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc498e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 -- 172.21.15.70:0/1373854133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5604cdc48fd0 con 0x5604cdc43b40 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f5573fff640 1 --2- 172.21.15.70:0/1373854133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc3dc10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5560009900 tx=0x7f5560005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be596add478b0cf8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f555e7fc640 1 -- 172.21.15.70:0/1373854133 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560035040 con 0x5604cdc43b40 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f555e7fc640 1 -- 172.21.15.70:0/1373854133 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5560048070 con 0x5604cdc43b40 2024-09-19T04:36:54.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.246+0000 7f555e7fc640 1 -- 172.21.15.70:0/1373854133 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560004b00 con 0x5604cdc43b40 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 -- 172.21.15.70:0/1373854133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 msgr2=0x5604cdc3dc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1373854133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc3dc10 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f5560009900 tx=0x7f5560005e20 comp rx=0 tx=0).stop 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 -- 172.21.15.70:0/1373854133 shutdown_connections 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1373854133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc4d370 0x5604cdc62220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1373854133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdc3dc10 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 --2- 172.21.15.70:0/1373854133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc425d0 0x5604cdc498e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 -- 172.21.15.70:0/1373854133 >> 172.21.15.70:0/1373854133 conn(0x5604cdc0b310 msgr2=0x5604cdc3d500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 -- 172.21.15.70:0/1373854133 shutdown_connections 2024-09-19T04:36:54.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 -- 172.21.15.70:0/1373854133 wait complete. 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 -- start start 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.247+0000 7f557d5e6740 1 Processor -- start 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc425d0 0x5604cdcbe320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdcbe860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f557d5e6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 0x5604cdcc2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f557d5e6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55741abdf0 con 0x5604cdc43b40 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f557d5e6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55741ad260 con 0x5604cdc4d370 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f557d5e6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55741ac4c0 con 0x5604cdc425d0 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5573fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdcbe860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5573fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdcbe860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52372/0 (socket says 172.21.15.70:52372) 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5573fff640 1 -- 172.21.15.70:0/2702371540 learned_addr learned my addr 172.21.15.70:0/2702371540 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5578fa9640 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc425d0 0x5604cdcbe320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f557d5e6740 10 client.0 _ll_register_callbacks cb 0x7f556809b4f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f55797aa640 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 0x5604cdcc2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5573fff640 1 -- 172.21.15.70:0/2702371540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc425d0 msgr2=0x5604cdcbe320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5573fff640 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc425d0 0x5604cdcbe320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5573fff640 1 -- 172.21.15.70:0/2702371540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 msgr2=0x5604cdcc2930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5573fff640 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 0x5604cdcc2930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.248+0000 7f5573fff640 1 -- 172.21.15.70:0/2702371540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5604cdcc2fd0 con 0x5604cdc43b40 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f5573fff640 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdcbe860 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5560009850 tx=0x7f5560004490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6a27dde7188f3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f5553fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f5553fff640 1 -- 172.21.15.70:0/2702371540 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5560035070 con 0x5604cdc43b40 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f5553fff640 1 -- 172.21.15.70:0/2702371540 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f5560042050 con 0x5604cdc43b40 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 1 -- 172.21.15.70:0/2702371540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5560048070 con 0x5604cdc43b40 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f5553fff640 1 -- 172.21.15.70:0/2702371540 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f5560005250 con 0x5604cdc43b40 2024-09-19T04:36:54.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 10 client.16590 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 1 -- 172.21.15.70:0/2702371540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5604cdccb560 con 0x5604cdc43b40 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f5553fff640 1 -- 172.21.15.70:0/2702371540 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5560048070 con 0x5604cdc43b40 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f5553fff640 1 -- 172.21.15.70:0/2702371540 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f5560031700 con 0x5604cdc43b40 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 10 client.16590 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 10 client.16590 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 20 client.16590 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5604cdccbc10 0x5604cdcce030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 4 client.16590 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.249+0000 7f557d5e6740 1 -- 172.21.15.70:0/2702371540 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5604cdb2c170 con 0x5604cdccbc10 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f5578fa9640 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5604cdccbc10 0x5604cdcce030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f5553fff640 10 client.16590 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f5578fa9640 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5604cdccbc10 0x5604cdcce030 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=17ec8f15f799f88d server_cookie=1407bebac0d72941 in_seq=0 out_seq=0 2024-09-19T04:36:54.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f5553fff640 1 -- 172.21.15.70:0/2702371540 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5604cdb2c170 con 0x5604cdccbc10 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f5553fff640 10 client.16590 handle_command_reply: tid=0 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f557d5e6740 1 client.16590 shutdown 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f557d5e6740 1 -- 172.21.15.70:0/2702371540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 msgr2=0x5604cdcbe860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f557d5e6740 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdcbe860 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5560009850 tx=0x7f5560004490 comp rx=0 tx=0).stop 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f557d5e6740 1 -- 172.21.15.70:0/2702371540 shutdown_connections 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f557d5e6740 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5604cdccbc10 0x5604cdcce030 crc :-1 s=READY pgs=121 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f557d5e6740 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5604cdc4d370 0x5604cdcc2930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f5553fff640 0 client.16590 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f557d5e6740 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5604cdc43b40 0x5604cdcbe860 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.250+0000 7f557d5e6740 1 --2- 172.21.15.70:0/2702371540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5604cdc425d0 0x5604cdcbe320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557d5e6740 1 -- 172.21.15.70:0/2702371540 >> 172.21.15.70:0/2702371540 conn(0x5604cdc0b310 msgr2=0x5604cdc3d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557d5e6740 1 -- 172.21.15.70:0/2702371540 shutdown_connections 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557d5e6740 1 -- 172.21.15.70:0/2702371540 wait complete. 2024-09-19T04:36:54.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557d5e6740 20 client.16590 trim_cache size 0 max 16384 2024-09-19T04:36:54.260 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557b20d640 1 -- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55640a3430 msgr2=0x7f55640a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557b20d640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55640a3430 0x7f55640a58f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f556c012590 tx=0x7f556c012990 comp rx=0 tx=0).stop 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557b20d640 1 -- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574100e20 msgr2=0x7f5574199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557b20d640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574100e20 0x7f5574199320 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f556800d770 tx=0x7f556800dc30 comp rx=0 tx=0).stop 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557b20d640 1 -- 172.21.15.70:0/2978116744 shutdown_connections 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.251+0000 7f557b20d640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55640a3430 0x7f55640a58f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.252+0000 7f557b20d640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5574102ef0 0x7f55741a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.252+0000 7f557b20d640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5574102570 0x7f5574199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.252+0000 7f557b20d640 1 --2- 172.21.15.70:0/2978116744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5574100e20 0x7f5574199320 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:54.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.252+0000 7f557b20d640 1 -- 172.21.15.70:0/2978116744 >> 172.21.15.70:0/2978116744 conn(0x7f55740fc7d0 msgr2=0x7f55740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:54.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.252+0000 7f557b20d640 1 -- 172.21.15.70:0/2978116744 shutdown_connections 2024-09-19T04:36:54.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:54.252+0000 7f557b20d640 1 -- 172.21.15.70:0/2978116744 wait complete. 2024-09-19T04:36:54.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:54 smithi167 ceph-mon[34339]: pgmap v187: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:55.032 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:54 smithi070 ceph-mon[30942]: pgmap v187: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:54 smithi134 ceph-mon[34525]: pgmap v187: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:56.061 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:36:56.062 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:36:56.321 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:56.719 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:56 smithi070 ceph-mon[30942]: pgmap v188: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 -- 172.21.15.70:0/774426814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941082a0 msgr2=0x7f409410ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 --2- 172.21.15.70:0/774426814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941082a0 0x7f409410ec40 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f408c009930 tx=0x7f408c02a420 comp rx=0 tx=0).stop 2024-09-19T04:36:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 -- 172.21.15.70:0/774426814 shutdown_connections 2024-09-19T04:36:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 --2- 172.21.15.70:0/774426814 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941082a0 0x7f409410ec40 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 --2- 172.21.15.70:0/774426814 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40941036e0 0x7f4094107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 --2- 172.21.15.70:0/774426814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4094102d30 0x7f4094103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 -- 172.21.15.70:0/774426814 >> 172.21.15.70:0/774426814 conn(0x7f40940fc7d0 msgr2=0x7f40940febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 -- 172.21.15.70:0/774426814 shutdown_connections 2024-09-19T04:36:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 -- 172.21.15.70:0/774426814 wait complete. 2024-09-19T04:36:56.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.805+0000 7f4099e34640 1 Processor -- start 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4099e34640 1 -- start start 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4099e34640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4094102d30 0x7f4094198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4099e34640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941036e0 0x7f4094198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4099e34640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40941082a0 0x7f409419cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4099e34640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40941120f0 con 0x7f40941036e0 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4099e34640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4094111f70 con 0x7f4094102d30 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4099e34640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4094112270 con 0x7f40941082a0 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941036e0 0x7f4094198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941036e0 0x7f4094198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52390/0 (socket says 172.21.15.70:52390) 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 -- 172.21.15.70:0/1616818648 learned_addr learned my addr 172.21.15.70:0/1616818648 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4093fff640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40941082a0 0x7f409419cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f40937fe640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4094102d30 0x7f4094198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 -- 172.21.15.70:0/1616818648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40941082a0 msgr2=0x7f409419cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40941082a0 0x7f409419cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 -- 172.21.15.70:0/1616818648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4094102d30 msgr2=0x7f4094198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4094102d30 0x7f4094198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 -- 172.21.15.70:0/1616818648 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f409419d4c0 con 0x7f40941036e0 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4093fff640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40941082a0 0x7f409419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f40937fe640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4094102d30 0x7f4094198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.806+0000 7f4092ffd640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941036e0 0x7f4094198a50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f407c00c8c0 tx=0x7f407c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.807+0000 7f4090ff9640 1 -- 172.21.15.70:0/1616818648 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c007bb0 con 0x7f40941036e0 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.807+0000 7f4099e34640 1 -- 172.21.15.70:0/1616818648 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f409419d7b0 con 0x7f40941036e0 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.807+0000 7f4090ff9640 1 -- 172.21.15.70:0/1616818648 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f407c007d50 con 0x7f40941036e0 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.807+0000 7f4099e34640 1 -- 172.21.15.70:0/1616818648 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40941a5090 con 0x7f40941036e0 2024-09-19T04:36:56.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.807+0000 7f4090ff9640 1 -- 172.21.15.70:0/1616818648 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c005260 con 0x7f40941036e0 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.809+0000 7f4090ff9640 1 -- 172.21.15.70:0/1616818648 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f407c005400 con 0x7f40941036e0 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.809+0000 7f409c20d740 1 Processor -- start 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.809+0000 7f409c20d740 1 -- start start 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f409c20d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a513cf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f409c20d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a5147800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f409c20d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a514a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f409c20d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589a50a2280 con 0x5589a513d480 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f409c20d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5589a5049b10 con 0x5589a513cb60 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f409c20d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5589a509e240 con 0x5589a5147d40 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f40937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a5147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f40937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a5147800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52402/0 (socket says 172.21.15.70:52402) 2024-09-19T04:36:56.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f40937fe640 1 -- 172.21.15.70:0/580460398 learned_addr learned my addr 172.21.15.70:0/580460398 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f4093fff640 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a513cf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f4092ffd640 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a514a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f4090ff9640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40800a33b0 0x7f40800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f40937fe640 1 -- 172.21.15.70:0/580460398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 msgr2=0x5589a514a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f40937fe640 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a514a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f40937fe640 1 -- 172.21.15.70:0/580460398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 msgr2=0x5589a513cf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f40937fe640 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a513cf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f40937fe640 1 -- 172.21.15.70:0/580460398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a50561f0 con 0x5589a513d480 2024-09-19T04:36:56.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f4090ff9640 1 -- 172.21.15.70:0/1616818648 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f407c0cfeb0 con 0x7f40941036e0 2024-09-19T04:36:56.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.810+0000 7f4093fff640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40800a33b0 0x7f40800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.811+0000 7f40937fe640 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a5147800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4084007fb0 tx=0x7f408400c750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7de95c594fb847c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.811+0000 7f4089ffb640 1 -- 172.21.15.70:0/580460398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084014070 con 0x5589a513d480 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.811+0000 7f4089ffb640 1 -- 172.21.15.70:0/580460398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f408400fd20 con 0x5589a513d480 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.811+0000 7f4089ffb640 1 -- 172.21.15.70:0/580460398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f408400ed80 con 0x5589a513d480 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 -- 172.21.15.70:0/580460398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 msgr2=0x5589a5147800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f4093fff640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40800a33b0 0x7f40800a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f408c005c40 tx=0x7f408c009260 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a5147800 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f4084007fb0 tx=0x7f408400c750 comp rx=0 tx=0).stop 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 -- 172.21.15.70:0/580460398 shutdown_connections 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a514a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a5147800 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 --2- 172.21.15.70:0/580460398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a513cf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 -- 172.21.15.70:0/580460398 >> 172.21.15.70:0/580460398 conn(0x5589a51390f0 msgr2=0x5589a51394d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:56.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 -- 172.21.15.70:0/580460398 shutdown_connections 2024-09-19T04:36:56.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 -- 172.21.15.70:0/580460398 wait complete. 2024-09-19T04:36:56.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 -- start start 2024-09-19T04:36:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.812+0000 7f409c20d740 1 Processor -- start 2024-09-19T04:36:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f409c20d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a5144ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f409c20d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a51450e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f409c20d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a5145620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f409c20d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5589a514a910 con 0x5589a513d480 2024-09-19T04:36:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f409c20d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5589a505cf10 con 0x5589a513cb60 2024-09-19T04:36:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f409c20d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5589a514aa90 con 0x5589a5147d40 2024-09-19T04:36:56.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a51450e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f409c20d740 10 client.0 _ll_register_callbacks cb 0x5589a5025a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a51450e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52414/0 (socket says 172.21.15.70:52414) 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 -- 172.21.15.70:0/2736367929 learned_addr learned my addr 172.21.15.70:0/2736367929 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f40937fe640 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a5144ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4093fff640 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a5145620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 -- 172.21.15.70:0/2736367929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 msgr2=0x5589a5145620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a5145620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 -- 172.21.15.70:0/2736367929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 msgr2=0x5589a5144ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a5144ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 -- 172.21.15.70:0/2736367929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a4e136a0 con 0x5589a513d480 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4092ffd640 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a51450e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f407c0cd680 tx=0x7f407c09bb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c77419b010c0920 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:56.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4072ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4072ffd640 1 -- 172.21.15.70:0/2736367929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c0b5060 con 0x5589a513d480 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f4072ffd640 1 -- 172.21.15.70:0/2736367929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f407c0a0170 con 0x5589a513d480 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.813+0000 7f409c20d740 1 -- 172.21.15.70:0/2736367929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f408400fd20 con 0x5589a513d480 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f4072ffd640 1 -- 172.21.15.70:0/2736367929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f407c09c8b0 con 0x5589a513d480 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f409c20d740 10 client.16602 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f409c20d740 1 -- 172.21.15.70:0/2736367929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5589a5156500 con 0x5589a513d480 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f4072ffd640 1 -- 172.21.15.70:0/2736367929 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f408400fd20 con 0x5589a513d480 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f4072ffd640 1 -- 172.21.15.70:0/2736367929 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f407c0bc0b0 con 0x5589a513d480 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f409c20d740 10 client.16602 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f409c20d740 10 client.16602 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f409c20d740 20 client.16602 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:56.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f409c20d740 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5589a51579c0 0x5589a5159db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f409c20d740 4 client.16602 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f409c20d740 1 -- 172.21.15.70:0/2736367929 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5589a50af7f0 con 0x5589a51579c0 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.814+0000 7f40937fe640 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5589a51579c0 0x5589a5159db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.815+0000 7f40937fe640 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5589a51579c0 0x5589a5159db0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9c4cce3c7bf662f server_cookie=25e1b419f26807ac in_seq=0 out_seq=0 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.815+0000 7f4072ffd640 10 client.16602 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f4072ffd640 1 -- 172.21.15.70:0/2736367929 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5589a50af7f0 con 0x5589a51579c0 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f4072ffd640 10 client.16602 handle_command_reply: tid=0 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 client.16602 shutdown 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 -- 172.21.15.70:0/2736367929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 msgr2=0x5589a51450e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a51450e0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f407c0cd680 tx=0x7f407c09bb10 comp rx=0 tx=0).stop 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 -- 172.21.15.70:0/2736367929 shutdown_connections 2024-09-19T04:36:56.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5589a51579c0 0x5589a5159db0 crc :-1 s=READY pgs=122 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a5145620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f4072ffd640 0 client.16602 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a51450e0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 --2- 172.21.15.70:0/2736367929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a5144ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 -- 172.21.15.70:0/2736367929 >> 172.21.15.70:0/2736367929 conn(0x5589a51390f0 msgr2=0x5589a513ee20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 -- 172.21.15.70:0/2736367929 shutdown_connections 2024-09-19T04:36:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 1 -- 172.21.15.70:0/2736367929 wait complete. 2024-09-19T04:36:56.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.816+0000 7f409c20d740 20 client.16602 trim_cache size 0 max 16384 2024-09-19T04:36:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f409c20d740 1 Processor -- start 2024-09-19T04:36:56.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f409c20d740 1 -- start start 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f409c20d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a515f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f409c20d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a515fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f409c20d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a5137a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f409c20d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40941b00a0 con 0x5589a513d480 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f409c20d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40941ad940 con 0x5589a513cb60 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f409c20d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40941ab790 con 0x5589a5147d40 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f4092ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a515fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.833+0000 7f4092ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a515fb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52422/0 (socket says 172.21.15.70:52422) 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f4092ffd640 1 -- 172.21.15.70:0/745098557 learned_addr learned my addr 172.21.15.70:0/745098557 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f40937fe640 1 --2- 172.21.15.70:0/745098557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a515f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f4092ffd640 1 -- 172.21.15.70:0/745098557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 msgr2=0x5589a5137a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:56.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f4092ffd640 1 --2- 172.21.15.70:0/745098557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a5137a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f4092ffd640 1 -- 172.21.15.70:0/745098557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 msgr2=0x5589a515f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f4092ffd640 1 --2- 172.21.15.70:0/745098557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a515f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f4092ffd640 1 -- 172.21.15.70:0/745098557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5589a5134830 con 0x5589a513d480 2024-09-19T04:36:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f4092ffd640 1 --2- 172.21.15.70:0/745098557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a515fb70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f407c09beb0 tx=0x7f407c09a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ef6d2774128108 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f40897fa640 1 -- 172.21.15.70:0/745098557 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c09c1b0 con 0x5589a513d480 2024-09-19T04:36:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f40897fa640 1 -- 172.21.15.70:0/745098557 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f407c09c500 con 0x5589a513d480 2024-09-19T04:36:56.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.834+0000 7f40897fa640 1 -- 172.21.15.70:0/745098557 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f407c0a0170 con 0x5589a513d480 2024-09-19T04:36:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 -- 172.21.15.70:0/745098557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 msgr2=0x5589a515fb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 --2- 172.21.15.70:0/745098557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a515fb70 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f407c09beb0 tx=0x7f407c09a6c0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 -- 172.21.15.70:0/745098557 shutdown_connections 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 --2- 172.21.15.70:0/745098557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a5137a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 --2- 172.21.15.70:0/745098557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513d480 0x5589a515fb70 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 --2- 172.21.15.70:0/745098557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513cb60 0x5589a515f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 -- 172.21.15.70:0/745098557 >> 172.21.15.70:0/745098557 conn(0x5589a51390f0 msgr2=0x5589a5143c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 -- 172.21.15.70:0/745098557 shutdown_connections 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 -- 172.21.15.70:0/745098557 wait complete. 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.835+0000 7f409c20d740 1 -- start start 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f409c20d740 1 Processor -- start 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f409c20d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513cb60 0x5589a514ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f409c20d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513d480 0x5589a514bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f409c20d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a514c500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f409c20d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40941abe00 con 0x5589a513cb60 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f409c20d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40941ad270 con 0x5589a513d480 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f409c20d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40941ac4d0 con 0x5589a5147d40 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f409c20d740 10 client.0 _ll_register_callbacks cb 0x7f407c00c810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513cb60 0x5589a514ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513cb60 0x5589a514ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52438/0 (socket says 172.21.15.70:52438) 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 -- 172.21.15.70:0/3470505979 learned_addr learned my addr 172.21.15.70:0/3470505979 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f4092ffd640 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513d480 0x5589a514bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f4093fff640 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a514c500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 -- 172.21.15.70:0/3470505979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 msgr2=0x5589a514c500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a514c500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 -- 172.21.15.70:0/3470505979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513d480 msgr2=0x5589a514bfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:56.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513d480 0x5589a514bfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 -- 172.21.15.70:0/3470505979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589a51c1650 con 0x5589a513cb60 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f40937fe640 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513cb60 0x5589a514ba80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x5589a5139f50 tx=0x7f4084007760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd97062bb5d36e72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.836+0000 7f4072ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f4072ffd640 1 -- 172.21.15.70:0/3470505979 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4084014040 con 0x5589a513cb60 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f4072ffd640 1 -- 172.21.15.70:0/3470505979 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f408400e980 con 0x5589a513cb60 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 1 -- 172.21.15.70:0/3470505979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f407c09c500 con 0x5589a513cb60 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f4072ffd640 1 -- 172.21.15.70:0/3470505979 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f4084035050 con 0x5589a513cb60 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 10 client.16608 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 1 -- 172.21.15.70:0/3470505979 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5589a51c29d0 con 0x5589a513cb60 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f4072ffd640 1 -- 172.21.15.70:0/3470505979 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f407c09c500 con 0x5589a513cb60 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f4072ffd640 1 -- 172.21.15.70:0/3470505979 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f4084019450 con 0x5589a513cb60 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 10 client.16608 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:56.842 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 10 client.16608 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 20 client.16608 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5589a51579c0 0x5589a51c4e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 4 client.16608 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:36:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.837+0000 7f409c20d740 1 -- 172.21.15.70:0/3470505979 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5589a50a9d00 con 0x5589a51579c0 2024-09-19T04:36:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.838+0000 7f4092ffd640 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5589a51579c0 0x5589a51c4e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.838+0000 7f4092ffd640 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5589a51579c0 0x5589a51c4e60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=25f186a70fb90b7e server_cookie=7d4071caaedd8e67 in_seq=0 out_seq=0 2024-09-19T04:36:56.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.838+0000 7f4072ffd640 10 client.16608 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f4072ffd640 1 -- 172.21.15.70:0/3470505979 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5589a50a9d00 con 0x5589a51579c0 2024-09-19T04:36:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f4072ffd640 10 client.16608 handle_command_reply: tid=0 2024-09-19T04:36:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 client.16608 shutdown 2024-09-19T04:36:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 -- 172.21.15.70:0/3470505979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513cb60 msgr2=0x5589a514ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513cb60 0x5589a514ba80 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x5589a5139f50 tx=0x7f4084007760 comp rx=0 tx=0).stop 2024-09-19T04:36:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 -- 172.21.15.70:0/3470505979 shutdown_connections 2024-09-19T04:36:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5589a51579c0 0x5589a51c4e60 crc :-1 s=READY pgs=123 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5589a5147d40 0x5589a514c500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5589a513d480 0x5589a514bfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 --2- 172.21.15.70:0/3470505979 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5589a513cb60 0x5589a514ba80 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 -- 172.21.15.70:0/3470505979 >> 172.21.15.70:0/3470505979 conn(0x5589a51390f0 msgr2=0x5589a5137a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f4072ffd640 0 client.16608 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 -- 172.21.15.70:0/3470505979 shutdown_connections 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 1 -- 172.21.15.70:0/3470505979 wait complete. 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.839+0000 7f409c20d740 20 client.16608 trim_cache size 0 max 16384 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:56.845 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:36:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "41dea661-b2bf-42f8-857c-4689d8f9e2a7", 2024-09-19T04:36:56.846 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:36:56.846 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 -- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40800a33b0 msgr2=0x7f40800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40800a33b0 0x7f40800a5870 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f408c005c40 tx=0x7f408c009260 comp rx=0 tx=0).stop 2024-09-19T04:36:56.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 -- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941036e0 msgr2=0x7f4094198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941036e0 0x7f4094198a50 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f407c00c8c0 tx=0x7f407c00cd80 comp rx=0 tx=0).stop 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 -- 172.21.15.70:0/1616818648 shutdown_connections 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40800a33b0 0x7f40800a5870 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40941082a0 0x7f409419cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40941036e0 0x7f4094198a50 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 --2- 172.21.15.70:0/1616818648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4094102d30 0x7f4094198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 -- 172.21.15.70:0/1616818648 >> 172.21.15.70:0/1616818648 conn(0x7f40940fc7d0 msgr2=0x7f40940fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 -- 172.21.15.70:0/1616818648 shutdown_connections 2024-09-19T04:36:56.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:56.840+0000 7f4099e34640 1 -- 172.21.15.70:0/1616818648 wait complete. 2024-09-19T04:36:56.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:56 smithi167 ceph-mon[34339]: pgmap v188: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:56 smithi134 ceph-mon[34525]: pgmap v188: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:36:57.511 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:36:57.763 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:57.883 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:57 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:36:57.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:57 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:57.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:57 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:36:57.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:57 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:57.884 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:57 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:36:57.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:57 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:36:57.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:57 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:57.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:57 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:36:57.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:57 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:57.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:57 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:36:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:57 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:36:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:57 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:57 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:36:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:57 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:36:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:57 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:36:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 -- 172.21.15.70:0/3645847775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8101de0 msgr2=0x7f28e81021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 --2- 172.21.15.70:0/3645847775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8101de0 0x7f28e81021c0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009900 tx=0x7f28d802a410 comp rx=0 tx=0).stop 2024-09-19T04:36:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 -- 172.21.15.70:0/3645847775 shutdown_connections 2024-09-19T04:36:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 --2- 172.21.15.70:0/3645847775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e8106f10 0x7f28e810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 --2- 172.21.15.70:0/3645847775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e8102790 0x7f28e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.245 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 --2- 172.21.15.70:0/3645847775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8101de0 0x7f28e81021c0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 -- 172.21.15.70:0/3645847775 >> 172.21.15.70:0/3645847775 conn(0x7f28e80fd8c0 msgr2=0x7f28e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 -- 172.21.15.70:0/3645847775 shutdown_connections 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 -- 172.21.15.70:0/3645847775 wait complete. 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.210+0000 7f28ee734640 1 Processor -- start 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28ee734640 1 -- start start 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28ee734640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e8101de0 0x7f28e8198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28ee734640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8102790 0x7f28e8198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28ee734640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e8106f10 0x7f28e819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28ee734640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28e8111f40 con 0x7f28e8102790 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28ee734640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28e8111dc0 con 0x7f28e8106f10 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28ee734640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81120c0 con 0x7f28e8101de0 2024-09-19T04:36:58.246 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8102790 0x7f28e8198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8102790 0x7f28e8198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52458/0 (socket says 172.21.15.70:52458) 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 -- 172.21.15.70:0/4254132819 learned_addr learned my addr 172.21.15.70:0/4254132819 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28eccd1640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e8106f10 0x7f28e819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28e7fff640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e8101de0 0x7f28e8198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 -- 172.21.15.70:0/4254132819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e8101de0 msgr2=0x7f28e8198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e8101de0 0x7f28e8198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 -- 172.21.15.70:0/4254132819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e8106f10 msgr2=0x7f28e819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e8106f10 0x7f28e819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 -- 172.21.15.70:0/4254132819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f28e819d3f0 con 0x7f28e8102790 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28eccd1640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e8106f10 0x7f28e819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28dffff640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8102790 0x7f28e8198980 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f28d000c890 tx=0x7f28d000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.211+0000 7f28e5ffb640 1 -- 172.21.15.70:0/4254132819 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0004220 con 0x7f28e8102790 2024-09-19T04:36:58.247 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.212+0000 7f28e5ffb640 1 -- 172.21.15.70:0/4254132819 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f28d00043c0 con 0x7f28e8102790 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.212+0000 7f28ee734640 1 -- 172.21.15.70:0/4254132819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f28e819d6e0 con 0x7f28e8102790 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.212+0000 7f28e5ffb640 1 -- 172.21.15.70:0/4254132819 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d0004a00 con 0x7f28e8102790 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.212+0000 7f28ee734640 1 -- 172.21.15.70:0/4254132819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f28e81a4fc0 con 0x7f28e8102790 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28e5ffb640 1 -- 172.21.15.70:0/4254132819 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f28d0004ba0 con 0x7f28e8102790 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28f0b0d740 1 Processor -- start 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28f0b0d740 1 -- start start 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3cdd880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce8140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ceaa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5651a3c432e0 con 0x5651a3cdd4a0 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5651a3beace0 con 0x5651a3cdddc0 2024-09-19T04:36:58.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5651a3c3f2a0 con 0x5651a3ce8680 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.214+0000 7f28eccd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3cdd880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3cdd880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52472/0 (socket says 172.21.15.70:52472) 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 -- 172.21.15.70:0/3415206369 learned_addr learned my addr 172.21.15.70:0/3415206369 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28e5ffb640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28d40a34b0 0x7f28d40a5970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28e7fff640 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce8140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28dffff640 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ceaa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 -- 172.21.15.70:0/3415206369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 msgr2=0x5651a3ceaa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ceaa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 -- 172.21.15.70:0/3415206369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 msgr2=0x5651a3ce8140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce8140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 -- 172.21.15.70:0/3415206369 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a3bcf440 con 0x5651a3cdd4a0 2024-09-19T04:36:58.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28e7fff640 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28d40a34b0 0x7f28d40a5970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28e5ffb640 1 -- 172.21.15.70:0/4254132819 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f28d00cfaf0 con 0x7f28e8102790 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3cdd880 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f28e0010420 tx=0x7f28e00108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99237a88ebf7ef3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28de7fc640 1 -- 172.21.15.70:0/3415206369 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0023070 con 0x5651a3cdd4a0 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28de7fc640 1 -- 172.21.15.70:0/3415206369 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f28e001c470 con 0x5651a3cdd4a0 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28de7fc640 1 -- 172.21.15.70:0/3415206369 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e001d6a0 con 0x5651a3cdd4a0 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.215+0000 7f28eccd1640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28d40a34b0 0x7f28d40a5970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28e0020000 tx=0x7f28e001a000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3415206369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 msgr2=0x5651a3cdd880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3cdd880 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f28e0010420 tx=0x7f28e00108e0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3415206369 shutdown_connections 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ceaa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce8140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3415206369 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3cdd880 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3415206369 >> 172.21.15.70:0/3415206369 conn(0x5651a3cd9a30 msgr2=0x5651a3cd9e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3415206369 shutdown_connections 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3415206369 wait complete. 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.216+0000 7f28f0b0d740 1 -- start start 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28f0b0d740 1 Processor -- start 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3ce80a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce5350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ce5960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5651a3ceb250 con 0x5651a3cdd4a0 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5651a3bfe050 con 0x5651a3cdddc0 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5651a3ceb3d0 con 0x5651a3ce8680 2024-09-19T04:36:58.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28f0b0d740 10 client.0 _ll_register_callbacks cb 0x5651a3c3e160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3ce80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3ce80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52476/0 (socket says 172.21.15.70:52476) 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 -- 172.21.15.70:0/3219327089 learned_addr learned my addr 172.21.15.70:0/3219327089 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28eccd1640 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ce5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28dffff640 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 -- 172.21.15.70:0/3219327089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 msgr2=0x5651a3ce5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ce5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 -- 172.21.15.70:0/3219327089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 msgr2=0x5651a3ce5350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce5350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 -- 172.21.15.70:0/3219327089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a39b43c0 con 0x5651a3cdd4a0 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28eccd1640 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ce5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:58.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28e7fff640 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3ce80a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009900 tx=0x7f28d8031880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fa864b9725369c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.217+0000 7f28c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28c77fe640 1 -- 172.21.15.70:0/3219327089 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28d8035070 con 0x5651a3cdd4a0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28c77fe640 1 -- 172.21.15.70:0/3219327089 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f28d8004240 con 0x5651a3cdd4a0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3219327089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e001c470 con 0x5651a3cdd4a0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28c77fe640 1 -- 172.21.15.70:0/3219327089 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f28d8004440 con 0x5651a3cdd4a0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 10 client.16620 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3219327089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5651a3cf6ce0 con 0x5651a3cdd4a0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28c77fe640 1 -- 172.21.15.70:0/3219327089 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f28e001c470 con 0x5651a3cdd4a0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28c77fe640 1 -- 172.21.15.70:0/3219327089 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f28d804b020 con 0x5651a3cdd4a0 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 10 client.16620 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 10 client.16620 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 20 client.16620 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:58.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a3cf80f0 0x5651a3cfa500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 4 client.16620 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.218+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3219327089 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5651a3c50850 con 0x5651a3cf80f0 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.219+0000 7f28dffff640 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a3cf80f0 0x5651a3cfa500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.219+0000 7f28c77fe640 10 client.16620 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.219+0000 7f28dffff640 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a3cf80f0 0x5651a3cfa500 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8f729bec1ced34e7 server_cookie=40a119cf9ec7ed5f in_seq=0 out_seq=0 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28c77fe640 1 -- 172.21.15.70:0/3219327089 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5651a3c50850 con 0x5651a3cf80f0 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28c77fe640 10 client.16620 handle_command_reply: tid=0 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 client.16620 shutdown 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3219327089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 msgr2=0x5651a3ce80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3ce80a0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f28d8009900 tx=0x7f28d8031880 comp rx=0 tx=0).stop 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3219327089 shutdown_connections 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a3cf80f0 0x5651a3cfa500 crc :-1 s=READY pgs=124 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3ce8680 0x5651a3ce5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ce5350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28c77fe640 0 client.16620 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/3219327089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3cdd4a0 0x5651a3ce80a0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3219327089 >> 172.21.15.70:0/3219327089 conn(0x5651a3cd9a30 msgr2=0x5651a3cd8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3219327089 shutdown_connections 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 1 -- 172.21.15.70:0/3219327089 wait complete. 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.220+0000 7f28f0b0d740 20 client.16620 trim_cache size 0 max 16384 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28f0b0d740 1 Processor -- start 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28f0b0d740 1 -- start start 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 0x5651a3cffdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3d00310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3ce25b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81b0060 con 0x5651a3ce8680 2024-09-19T04:36:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81ad900 con 0x5651a3cdddc0 2024-09-19T04:36:58.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81ab750 con 0x5651a3cdd4a0 2024-09-19T04:36:58.257 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:36:58.257 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:36:58.257 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:36:58.257 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3ce25b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3ce25b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52480/0 (socket says 172.21.15.70:52480) 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 -- 172.21.15.70:0/581007570 learned_addr learned my addr 172.21.15.70:0/581007570 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 -- 172.21.15.70:0/581007570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 msgr2=0x5651a3cffdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28e7fff640 1 --2- 172.21.15.70:0/581007570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 0x5651a3cffdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 --2- 172.21.15.70:0/581007570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 0x5651a3cffdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 -- 172.21.15.70:0/581007570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 msgr2=0x5651a3d00310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 --2- 172.21.15.70:0/581007570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3d00310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 -- 172.21.15.70:0/581007570 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651a3cd92e0 con 0x5651a3ce8680 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28eccd1640 1 --2- 172.21.15.70:0/581007570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3ce25b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f28e0005c40 tx=0x7f28e0009fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab26e3a65fbebe61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:58.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.237+0000 7f28ddffb640 1 -- 172.21.15.70:0/581007570 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e0023040 con 0x5651a3ce8680 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28ddffb640 1 -- 172.21.15.70:0/581007570 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f28e00097a0 con 0x5651a3ce8680 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28ddffb640 1 -- 172.21.15.70:0/581007570 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e000cb70 con 0x5651a3ce8680 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 -- 172.21.15.70:0/581007570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 msgr2=0x5651a3ce25b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/581007570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3ce25b0 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f28e0005c40 tx=0x7f28e0009fb0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 -- 172.21.15.70:0/581007570 shutdown_connections 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/581007570 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3ce25b0 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/581007570 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3d00310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/581007570 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 0x5651a3cffdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 -- 172.21.15.70:0/581007570 >> 172.21.15.70:0/581007570 conn(0x5651a3cd9a30 msgr2=0x5651a3cd8b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 -- 172.21.15.70:0/581007570 shutdown_connections 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 -- 172.21.15.70:0/581007570 wait complete. 2024-09-19T04:36:58.259 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.238+0000 7f28f0b0d740 1 -- start start 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28f0b0d740 1 Processor -- start 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 0x5651a3ceea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ceef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28f0b0d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3d61db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81abdc0 con 0x5651a3ce8680 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81ad230 con 0x5651a3cdddc0 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28f0b0d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f28e81ac490 con 0x5651a3cdd4a0 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28f0b0d740 10 client.0 _ll_register_callbacks cb 0x7f28d8009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3d61db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3d61db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52486/0 (socket says 172.21.15.70:52486) 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 -- 172.21.15.70:0/750710283 learned_addr learned my addr 172.21.15.70:0/750710283 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:58.260 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28e7fff640 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 0x5651a3ceea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28dffff640 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ceef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 -- 172.21.15.70:0/750710283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 msgr2=0x5651a3ceea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 0x5651a3ceea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 -- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 msgr2=0x5651a3ceef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ceef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 -- 172.21.15.70:0/750710283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651a3ce4300 con 0x5651a3ce8680 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28dffff640 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ceef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28eccd1640 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3d61db0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f28e001d6f0 tx=0x7f28e001d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10f49b85924a9822 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.239+0000 7f28c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28c77fe640 1 -- 172.21.15.70:0/750710283 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f28e001db80 con 0x5651a3ce8680 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28c77fe640 1 -- 172.21.15.70:0/750710283 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f28e001dd20 con 0x5651a3ce8680 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 1 -- 172.21.15.70:0/750710283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f28e00097a0 con 0x5651a3ce8680 2024-09-19T04:36:58.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28c77fe640 1 -- 172.21.15.70:0/750710283 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f28e000c7b0 con 0x5651a3ce8680 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 10 client.16626 fetch_fsmap learned FSMap version 33 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 1 -- 172.21.15.70:0/750710283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5651a3d63390 con 0x5651a3ce8680 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28c77fe640 1 -- 172.21.15.70:0/750710283 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f28e00097a0 con 0x5651a3ce8680 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28c77fe640 1 -- 172.21.15.70:0/750710283 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f28e0042020 con 0x5651a3ce8680 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 10 client.16626 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 10 client.16626 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 20 client.16626 populate_metadata read hostname 'smithi070' 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a3d63860 0x5651a3d65c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 4 client.16626 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28f0b0d740 1 -- 172.21.15.70:0/750710283 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5651a3c4ad60 con 0x5651a3d63860 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.240+0000 7f28e7fff640 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a3d63860 0x5651a3d65c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28c77fe640 10 client.16626 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28e7fff640 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a3d63860 0x5651a3d65c50 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=43d5371cb6d6cfea server_cookie=7b7fb5888cd119e1 in_seq=0 out_seq=0 2024-09-19T04:36:58.262 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28c77fe640 1 -- 172.21.15.70:0/750710283 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5651a3c4ad60 con 0x5651a3d63860 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28c77fe640 10 client.16626 handle_command_reply: tid=0 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 client.16626 shutdown 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 -- 172.21.15.70:0/750710283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 msgr2=0x5651a3d61db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3d61db0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f28e001d6f0 tx=0x7f28e001d720 comp rx=0 tx=0).stop 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 -- 172.21.15.70:0/750710283 shutdown_connections 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5651a3d63860 0x5651a3d65c50 crc :-1 s=READY pgs=125 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651a3ce8680 0x5651a3d61db0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651a3cdddc0 0x5651a3ceef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 --2- 172.21.15.70:0/750710283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651a3cdd4a0 0x5651a3ceea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 -- 172.21.15.70:0/750710283 >> 172.21.15.70:0/750710283 conn(0x5651a3cd9a30 msgr2=0x5651a3ce6bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28c77fe640 0 client.16626 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 -- 172.21.15.70:0/750710283 shutdown_connections 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 1 -- 172.21.15.70:0/750710283 wait complete. 2024-09-19T04:36:58.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.241+0000 7f28f0b0d740 20 client.16626 trim_cache size 0 max 16384 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 -- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28d40a34b0 msgr2=0x7f28d40a5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28d40a34b0 0x7f28d40a5970 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f28e0020000 tx=0x7f28e001a000 comp rx=0 tx=0).stop 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 -- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8102790 msgr2=0x7f28e8198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8102790 0x7f28e8198980 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f28d000c890 tx=0x7f28d000cd50 comp rx=0 tx=0).stop 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 -- 172.21.15.70:0/4254132819 shutdown_connections 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f28d40a34b0 0x7f28d40a5970 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28e8106f10 0x7f28e819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f28e8102790 0x7f28e8198980 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 --2- 172.21.15.70:0/4254132819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f28e8101de0 0x7f28e8198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 -- 172.21.15.70:0/4254132819 >> 172.21.15.70:0/4254132819 conn(0x7f28e80fd8c0 msgr2=0x7f28e80fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 -- 172.21.15.70:0/4254132819 shutdown_connections 2024-09-19T04:36:58.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:58.242+0000 7f28ee734640 1 -- 172.21.15.70:0/4254132819 wait complete. 2024-09-19T04:36:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:58 smithi070 ceph-mon[30942]: pgmap v189: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:58.946 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:36:58.947 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:36:58.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:58 smithi167 ceph-mon[34339]: pgmap v189: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:58 smithi134 ceph-mon[34525]: pgmap v189: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:36:59.195 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:36:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 -- 172.21.15.70:0/243911700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9401036e0 msgr2=0x7fa940107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 --2- 172.21.15.70:0/243911700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9401036e0 0x7fa940107b90 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7fa934009930 tx=0x7fa93402a420 comp rx=0 tx=0).stop 2024-09-19T04:36:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 -- 172.21.15.70:0/243911700 shutdown_connections 2024-09-19T04:36:59.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 --2- 172.21.15.70:0/243911700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9401082a0 0x7fa94010ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 --2- 172.21.15.70:0/243911700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa9401036e0 0x7fa940107b90 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 --2- 172.21.15.70:0/243911700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa940102d30 0x7fa940103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 -- 172.21.15.70:0/243911700 >> 172.21.15.70:0/243911700 conn(0x7fa9400fc7d0 msgr2=0x7fa9400febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 -- 172.21.15.70:0/243911700 shutdown_connections 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.690+0000 7fa94627e640 1 -- 172.21.15.70:0/243911700 wait complete. 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa94627e640 1 Processor -- start 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa94627e640 1 -- start start 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa94627e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa940102d30 0x7fa9401985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa94627e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9401036e0 0x7fa940198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa94627e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9401082a0 0x7fa94019cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:59.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa94627e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa940112030 con 0x7fa940102d30 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa94627e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa940111eb0 con 0x7fa9401036e0 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa94627e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa9401121b0 con 0x7fa9401082a0 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa93ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa940102d30 0x7fa9401985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa93ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa940102d30 0x7fa9401985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52512/0 (socket says 172.21.15.70:52512) 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa93ffff640 1 -- 172.21.15.70:0/3957316509 learned_addr learned my addr 172.21.15.70:0/3957316509 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.691+0000 7fa93f7fe640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9401036e0 0x7fa940198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa94481b640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9401082a0 0x7fa94019cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93ffff640 1 -- 172.21.15.70:0/3957316509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9401082a0 msgr2=0x7fa94019cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93ffff640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9401082a0 0x7fa94019cec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93ffff640 1 -- 172.21.15.70:0/3957316509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9401036e0 msgr2=0x7fa940198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93ffff640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9401036e0 0x7fa940198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93ffff640 1 -- 172.21.15.70:0/3957316509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa94019d5a0 con 0x7fa940102d30 2024-09-19T04:36:59.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93f7fe640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9401036e0 0x7fa940198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93ffff640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa940102d30 0x7fa9401985f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa93000d950 tx=0x7fa93000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93d7fa640 1 -- 172.21.15.70:0/3957316509 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa930017030 con 0x7fa940102d30 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa94019d890 con 0x7fa940102d30 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93d7fa640 1 -- 172.21.15.70:0/3957316509 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa930004020 con 0x7fa940102d30 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa93d7fa640 1 -- 172.21.15.70:0/3957316509 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9300047a0 con 0x7fa940102d30 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.692+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9401a5170 con 0x7fa940102d30 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.693+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa940103110 con 0x7fa940102d30 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.694+0000 7fa93d7fa640 1 -- 172.21.15.70:0/3957316509 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa9300041d0 con 0x7fa940102d30 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.695+0000 7fa93d7fa640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9280a33b0 0x7fa9280a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.695+0000 7fa93f7fe640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9280a33b0 0x7fa9280a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:36:59.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.695+0000 7fa93d7fa640 1 -- 172.21.15.70:0/3957316509 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7fa9300cf7d0 con 0x7fa940102d30 2024-09-19T04:36:59.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.696+0000 7fa93f7fe640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9280a33b0 0x7fa9280a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa934009900 tx=0x7fa934009560 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:36:59.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.699+0000 7fa93d7fa640 1 -- 172.21.15.70:0/3957316509 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa93009c1d0 con 0x7fa940102d30 2024-09-19T04:36:59.900 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.899+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa940199950 con 0x7fa940102d30 2024-09-19T04:36:59.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.899+0000 7fa93d7fa640 1 -- 172.21.15.70:0/3957316509 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11915 (secure 0 0 0) 0x7fa93009bad0 con 0x7fa940102d30 2024-09-19T04:36:59.901 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:36:59.901 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":33,"btime":"2024-09-19T04:36:44:716583+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:36:44.223175+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24433,24452,24470]},"id":1}]} 2024-09-19T04:36:59.901 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 33 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9280a33b0 msgr2=0x7fa9280a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9280a33b0 0x7fa9280a5870 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa934009900 tx=0x7fa934009560 comp rx=0 tx=0).stop 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa940102d30 msgr2=0x7fa9401985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa940102d30 0x7fa9401985f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fa93000d950 tx=0x7fa93000de10 comp rx=0 tx=0).stop 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 shutdown_connections 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9280a33b0 0x7fa9280a5870 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa9401082a0 0x7fa94019cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9401036e0 0x7fa940198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 --2- 172.21.15.70:0/3957316509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa940102d30 0x7fa9401985f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:36:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 >> 172.21.15.70:0/3957316509 conn(0x7fa9400fc7d0 msgr2=0x7fa940105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:36:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 shutdown_connections 2024-09-19T04:36:59.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:36:59.901+0000 7fa94627e640 1 -- 172.21.15.70:0/3957316509 wait complete. 2024-09-19T04:37:00.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:36:59 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3957316509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:00.266 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:36:59 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3957316509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:00.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:36:59 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3957316509' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:00.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:37:00.928 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:01.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:00 smithi167 ceph-mon[34339]: pgmap v190: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:01.278 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:00 smithi070 ceph-mon[30942]: pgmap v190: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:01.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:00 smithi134 ceph-mon[34525]: pgmap v190: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:01.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 -- 172.21.15.70:0/3277436908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4101de0 msgr2=0x7f64d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3277436908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4101de0 0x7f64d41021c0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009900 tx=0x7f64c402a410 comp rx=0 tx=0).stop 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 -- 172.21.15.70:0/3277436908 shutdown_connections 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3277436908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d4106f10 0x7f64d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3277436908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d4102790 0x7f64d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3277436908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4101de0 0x7f64d41021c0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 -- 172.21.15.70:0/3277436908 >> 172.21.15.70:0/3277436908 conn(0x7f64d40fd8c0 msgr2=0x7f64d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 -- 172.21.15.70:0/3277436908 shutdown_connections 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.358+0000 7f64d9d72640 1 -- 172.21.15.70:0/3277436908 wait complete. 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d9d72640 1 Processor -- start 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d9d72640 1 -- start start 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d9d72640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d4101de0 0x7f64d41984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d9d72640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d4102790 0x7f64d41989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d9d72640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4106f10 0x7f64d419cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d9d72640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64d4111fa0 con 0x7f64d4106f10 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d9d72640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64d4111e20 con 0x7f64d4102790 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d9d72640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64d4112120 con 0x7f64d4101de0 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4106f10 0x7f64d419cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4106f10 0x7f64d419cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52532/0 (socket says 172.21.15.70:52532) 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.359+0000 7f64d3fff640 1 -- 172.21.15.70:0/3765716353 learned_addr learned my addr 172.21.15.70:0/3765716353 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d4102790 0x7f64d41989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d37fe640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d4101de0 0x7f64d41984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d3fff640 1 -- 172.21.15.70:0/3765716353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d4101de0 msgr2=0x7f64d41984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d3fff640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d4101de0 0x7f64d41984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d3fff640 1 -- 172.21.15.70:0/3765716353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d4102790 msgr2=0x7f64d41989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d3fff640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d4102790 0x7f64d41989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d3fff640 1 -- 172.21.15.70:0/3765716353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64d419d450 con 0x7f64d4106f10 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d4102790 0x7f64d41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d3fff640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4106f10 0x7f64d419cd70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00b970 tx=0x7f64cc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d0ff9640 1 -- 172.21.15.70:0/3765716353 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc019070 con 0x7f64d4106f10 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d0ff9640 1 -- 172.21.15.70:0/3765716353 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64cc00cb40 con 0x7f64d4106f10 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d0ff9640 1 -- 172.21.15.70:0/3765716353 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64cc007650 con 0x7f64d4106f10 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d9d72640 1 -- 172.21.15.70:0/3765716353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64d419d740 con 0x7f64d4106f10 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.360+0000 7f64d9d72640 1 -- 172.21.15.70:0/3765716353 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64d41a5020 con 0x7f64d4106f10 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.362+0000 7f64d0ff9640 1 -- 172.21.15.70:0/3765716353 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f64cc01c070 con 0x7f64d4106f10 2024-09-19T04:37:01.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64dc14b740 1 Processor -- start 2024-09-19T04:37:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64dc14b740 1 -- start start 2024-09-19T04:37:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 0x5630e8663090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e86635d0 0x5630e8663a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e8670760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64dc14b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5630e85c92f0 con 0x5630e86635d0 2024-09-19T04:37:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64dc14b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5630e8570cf0 con 0x5630e866e370 2024-09-19T04:37:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64dc14b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5630e85c52b0 con 0x5630e8664b40 2024-09-19T04:37:01.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d0ff9640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f64bc0a33b0 0x7f64bc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e86635d0 0x5630e8663a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e86635d0 0x5630e8663a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52548/0 (socket says 172.21.15.70:52548) 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d37fe640 1 -- 172.21.15.70:0/2014824057 learned_addr learned my addr 172.21.15.70:0/2014824057 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d3fff640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f64bc0a33b0 0x7f64bc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 0x5630e8663090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e8670760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d37fe640 1 -- 172.21.15.70:0/2014824057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 msgr2=0x5630e8663090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d0ff9640 1 -- 172.21.15.70:0/3765716353 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f64cc0cf320 con 0x7f64d4106f10 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d37fe640 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 0x5630e8663090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d37fe640 1 -- 172.21.15.70:0/2014824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 msgr2=0x5630e8670760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:01.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d37fe640 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e8670760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d37fe640 1 -- 172.21.15.70:0/2014824057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e85553a0 con 0x5630e86635d0 2024-09-19T04:37:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.363+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e8670760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.364+0000 7f64d37fe640 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e86635d0 0x5630e8663a10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009900 tx=0x7f64c4032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30288c222b6e9c86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.364+0000 7f64d3fff640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f64bc0a33b0 0x7f64bc0a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64cc09b6c0 tx=0x7f64cc097a50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.364+0000 7f64b9ffb640 1 -- 172.21.15.70:0/2014824057 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c403f070 con 0x5630e86635d0 2024-09-19T04:37:01.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.364+0000 7f64b9ffb640 1 -- 172.21.15.70:0/2014824057 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64c4031710 con 0x5630e86635d0 2024-09-19T04:37:01.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.364+0000 7f64b9ffb640 1 -- 172.21.15.70:0/2014824057 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c4035070 con 0x5630e86635d0 2024-09-19T04:37:01.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.364+0000 7f64dc14b740 1 -- 172.21.15.70:0/2014824057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e86635d0 msgr2=0x5630e8663a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.364+0000 7f64dc14b740 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e86635d0 0x5630e8663a10 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009900 tx=0x7f64c4032cc0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 -- 172.21.15.70:0/2014824057 shutdown_connections 2024-09-19T04:37:01.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e8670760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e86635d0 0x5630e8663a10 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 --2- 172.21.15.70:0/2014824057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 0x5630e8663090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 -- 172.21.15.70:0/2014824057 >> 172.21.15.70:0/2014824057 conn(0x5630e862c310 msgr2=0x5630e865fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 -- 172.21.15.70:0/2014824057 shutdown_connections 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 -- 172.21.15.70:0/2014824057 wait complete. 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 -- start start 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 Processor -- start 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e86635d0 0x5630e866dd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e866b030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e866b640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.365+0000 7f64dc14b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5630e8671010 con 0x5630e8664b40 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64dc14b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5630e8584060 con 0x5630e866e370 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64dc14b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5630e8671190 con 0x5630e86635d0 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64dc14b740 10 client.0 _ll_register_callbacks cb 0x5630e82d78c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e866b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e866b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52554/0 (socket says 172.21.15.70:52554) 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 -- 172.21.15.70:0/3149395882 learned_addr learned my addr 172.21.15.70:0/3149395882 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e86635d0 0x5630e866dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e866b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 -- 172.21.15.70:0/3149395882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e86635d0 msgr2=0x5630e866dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e86635d0 0x5630e866dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 -- 172.21.15.70:0/3149395882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 msgr2=0x5630e866b640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e866b640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 -- 172.21.15.70:0/3149395882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e833a3c0 con 0x5630e8664b40 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64d37fe640 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e866b030 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009a20 tx=0x7f64c403c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce60bc3028465a0e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:01.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3149395882 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c404a070 con 0x5630e8664b40 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3149395882 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f64c403cac0 con 0x5630e8664b40 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64dc14b740 1 -- 172.21.15.70:0/3149395882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64c4031710 con 0x5630e8664b40 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.366+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3149395882 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f64c4056050 con 0x5630e8664b40 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64dc14b740 10 client.16644 fetch_fsmap learned FSMap version 33 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64dc14b740 1 -- 172.21.15.70:0/3149395882 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5630e867ca50 con 0x5630e8664b40 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3149395882 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64c4031710 con 0x5630e8664b40 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3149395882 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f64c403a3c0 con 0x5630e8664b40 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64dc14b740 10 client.16644 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64dc14b740 10 client.16644 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:01.388 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64dc14b740 20 client.16644 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5630e867dda0 0x5630e8680190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64dc14b740 4 client.16644 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64dc14b740 1 -- 172.21.15.70:0/3149395882 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5630e85d6860 con 0x5630e867dda0 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.367+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5630e867dda0 0x5630e8680190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5630e867dda0 0x5630e8680190 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=123411f1683c18a2 server_cookie=5f9683f1a708629a in_seq=0 out_seq=0 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64b2ffd640 10 client.16644 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3149395882 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5630e85d6860 con 0x5630e867dda0 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64b2ffd640 10 client.16644 handle_command_reply: tid=0 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64dc14b740 1 client.16644 shutdown 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64dc14b740 1 -- 172.21.15.70:0/3149395882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 msgr2=0x5630e866b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e866b030 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f64c4009a20 tx=0x7f64c403c4c0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64dc14b740 1 -- 172.21.15.70:0/3149395882 shutdown_connections 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.368+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5630e867dda0 0x5630e8680190 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.389 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.369+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e866e370 0x5630e866b640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.369+0000 7f64b2ffd640 0 client.16644 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:01.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.369+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e866b030 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.369+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3149395882 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e86635d0 0x5630e866dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.369+0000 7f64dc14b740 1 -- 172.21.15.70:0/3149395882 >> 172.21.15.70:0/3149395882 conn(0x5630e862c310 msgr2=0x5630e8665960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:01.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.369+0000 7f64dc14b740 1 -- 172.21.15.70:0/3149395882 shutdown_connections 2024-09-19T04:37:01.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.369+0000 7f64dc14b740 1 -- 172.21.15.70:0/3149395882 wait complete. 2024-09-19T04:37:01.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.369+0000 7f64dc14b740 20 client.16644 trim_cache size 0 max 16384 2024-09-19T04:37:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.381+0000 7f64dc14b740 1 Processor -- start 2024-09-19T04:37:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.381+0000 7f64dc14b740 1 -- start start 2024-09-19T04:37:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e867a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 0x5630e866a030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e866e370 0x5630e8685790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64dc14b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64d41b0020 con 0x5630e866e370 2024-09-19T04:37:01.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64dc14b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64d41ad8c0 con 0x5630e86635d0 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64dc14b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64d41ab710 con 0x5630e8664b40 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e866e370 0x5630e8685790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e866e370 0x5630e8685790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52558/0 (socket says 172.21.15.70:52558) 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 -- 172.21.15.70:0/1250410203 learned_addr learned my addr 172.21.15.70:0/1250410203 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e867a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d37fe640 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 0x5630e866a030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 -- 172.21.15.70:0/1250410203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 msgr2=0x5630e866a030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 0x5630e866a030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 -- 172.21.15.70:0/1250410203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 msgr2=0x5630e867a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:01.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e867a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 -- 172.21.15.70:0/1250410203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5630e8660960 con 0x5630e866e370 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e866e370 0x5630e8685790 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f64c8000c00 tx=0x7f64c8005c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a20debe3f7be8f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64b97fa640 1 -- 172.21.15.70:0/1250410203 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c80051c0 con 0x5630e866e370 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64b97fa640 1 -- 172.21.15.70:0/1250410203 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64c8026030 con 0x5630e866e370 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.382+0000 7f64b97fa640 1 -- 172.21.15.70:0/1250410203 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c801f640 con 0x5630e866e370 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 -- 172.21.15.70:0/1250410203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e866e370 msgr2=0x5630e8685790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e866e370 0x5630e8685790 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f64c8000c00 tx=0x7f64c8005c90 comp rx=0 tx=0).stop 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 -- 172.21.15.70:0/1250410203 shutdown_connections 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e866e370 0x5630e8685790 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e8664b40 0x5630e866a030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 --2- 172.21.15.70:0/1250410203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e867a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 -- 172.21.15.70:0/1250410203 >> 172.21.15.70:0/1250410203 conn(0x5630e862c310 msgr2=0x5630e8669920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 -- 172.21.15.70:0/1250410203 shutdown_connections 2024-09-19T04:37:01.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 -- 172.21.15.70:0/1250410203 wait complete. 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.383+0000 7f64dc14b740 1 -- start start 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64dc14b740 1 Processor -- start 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e86767e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e8676d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64dc14b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e866e370 0x5630e8667c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64dc14b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f64d41abd80 con 0x5630e8664b40 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64dc14b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f64d41ad1f0 con 0x5630e86635d0 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64dc14b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f64d41ac450 con 0x5630e866e370 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64dc14b740 10 client.0 _ll_register_callbacks cb 0x7f64c4032b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e8676d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e8676d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52570/0 (socket says 172.21.15.70:52570) 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 -- 172.21.15.70:0/3346137267 learned_addr learned my addr 172.21.15.70:0/3346137267 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:01.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e866e370 0x5630e8667c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 -- 172.21.15.70:0/3346137267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e866e370 msgr2=0x5630e8667c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e866e370 0x5630e8667c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 -- 172.21.15.70:0/3346137267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 msgr2=0x5630e86767e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e86767e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e86767e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 -- 172.21.15.70:0/3346137267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5630e8668430 con 0x5630e8664b40 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e86767e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64d37fe640 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e8676d20 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f64c4005c40 tx=0x7f64c403c5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be3d1cb8436152c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.384+0000 7f64b2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3346137267 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64c4053020 con 0x5630e8664b40 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3346137267 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f64c4031510 con 0x5630e8664b40 2024-09-19T04:37:01.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 1 -- 172.21.15.70:0/3346137267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f64c8026030 con 0x5630e8664b40 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3346137267 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f64c404a040 con 0x5630e8664b40 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 10 client.16650 fetch_fsmap learned FSMap version 33 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 1 -- 172.21.15.70:0/3346137267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5630e86f0c40 con 0x5630e8664b40 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3346137267 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f64c8026030 con 0x5630e8664b40 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3346137267 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 33) ==== 8350+0+0 (secure 0 0 0) 0x7f64c4061070 con 0x5630e8664b40 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 10 client.16650 fetch_fsmap finished waiting for FSMap version 33 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 10 client.16650 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 20 client.16650 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5630e86f1410 0x5630e86f3830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 4 client.16650 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64dc14b740 1 -- 172.21.15.70:0/3346137267 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5630e85d0d70 con 0x5630e86f1410 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.385+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5630e86f1410 0x5630e86f3830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:01.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64b2ffd640 10 client.16650 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64d2ffd640 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5630e86f1410 0x5630e86f3830 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5d597d3246f06e73 server_cookie=c2e3d70a6ce99f49 in_seq=0 out_seq=0 2024-09-19T04:37:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64b2ffd640 1 -- 172.21.15.70:0/3346137267 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5630e85d0d70 con 0x5630e86f1410 2024-09-19T04:37:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64b2ffd640 10 client.16650 handle_command_reply: tid=0 2024-09-19T04:37:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 client.16650 shutdown 2024-09-19T04:37:01.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 -- 172.21.15.70:0/3346137267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 msgr2=0x5630e8676d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e8676d20 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f64c4005c40 tx=0x7f64c403c5a0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 -- 172.21.15.70:0/3346137267 shutdown_connections 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5630e86f1410 0x5630e86f3830 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5630e866e370 0x5630e8667c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5630e8664b40 0x5630e8676d20 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 --2- 172.21.15.70:0/3346137267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5630e86635d0 0x5630e86767e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64b2ffd640 0 client.16650 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 -- 172.21.15.70:0/3346137267 >> 172.21.15.70:0/3346137267 conn(0x5630e862c310 msgr2=0x5630e866a140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 -- 172.21.15.70:0/3346137267 shutdown_connections 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 1 -- 172.21.15.70:0/3346137267 wait complete. 2024-09-19T04:37:01.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.386+0000 7f64dc14b740 20 client.16650 trim_cache size 0 max 16384 2024-09-19T04:37:01.403 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:01.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 -- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f64bc0a33b0 msgr2=0x7f64bc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f64bc0a33b0 0x7f64bc0a5870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f64cc09b6c0 tx=0x7f64cc097a50 comp rx=0 tx=0).stop 2024-09-19T04:37:01.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 -- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4106f10 msgr2=0x7f64d419cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4106f10 0x7f64d419cd70 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f64cc00b970 tx=0x7f64cc00be30 comp rx=0 tx=0).stop 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 -- 172.21.15.70:0/3765716353 shutdown_connections 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f64bc0a33b0 0x7f64bc0a5870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f64d4106f10 0x7f64d419cd70 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64d4102790 0x7f64d41989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 --2- 172.21.15.70:0/3765716353 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f64d4101de0 0x7f64d41984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 -- 172.21.15.70:0/3765716353 >> 172.21.15.70:0/3765716353 conn(0x7f64d40fd8c0 msgr2=0x7f64d40fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 -- 172.21.15.70:0/3765716353 shutdown_connections 2024-09-19T04:37:01.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:01.387+0000 7f64d9d72640 1 -- 172.21.15.70:0/3765716353 wait complete. 2024-09-19T04:37:02.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:37:02.337 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 -- 172.21.15.70:0/3269165008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc100e20 msgr2=0x7f65fc101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 --2- 172.21.15.70:0/3269165008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc100e20 0x7f65fc101200 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f65f4009900 tx=0x7f65f402a480 comp rx=0 tx=0).stop 2024-09-19T04:37:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 -- 172.21.15.70:0/3269165008 shutdown_connections 2024-09-19T04:37:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 --2- 172.21.15.70:0/3269165008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65fc102ef0 0x7f65fc10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 --2- 172.21.15.70:0/3269165008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65fc102570 0x7f65fc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 --2- 172.21.15.70:0/3269165008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc100e20 0x7f65fc101200 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 -- 172.21.15.70:0/3269165008 >> 172.21.15.70:0/3269165008 conn(0x7f65fc0fc7d0 msgr2=0x7f65fc0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 -- 172.21.15.70:0/3269165008 shutdown_connections 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 -- 172.21.15.70:0/3269165008 wait complete. 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.841+0000 7f6603034640 1 Processor -- start 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f6603034640 1 -- start start 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f6603034640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65fc100e20 0x7f65fc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f6603034640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc102570 0x7f65fc19abe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f6603034640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65fc102ef0 0x7f65fc19ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f6603034640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc110f90 con 0x7f65fc102570 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f6603034640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc110e10 con 0x7f65fc102ef0 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f6603034640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc111110 con 0x7f65fc100e20 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc102570 0x7f65fc19abe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc102570 0x7f65fc19abe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52592/0 (socket says 172.21.15.70:52592) 2024-09-19T04:37:02.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 -- 172.21.15.70:0/1909824057 learned_addr learned my addr 172.21.15.70:0/1909824057 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f6600dd0640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65fc100e20 0x7f65fc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f66015d1640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65fc102ef0 0x7f65fc19ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 -- 172.21.15.70:0/1909824057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65fc100e20 msgr2=0x7f65fc19a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65fc100e20 0x7f65fc19a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 -- 172.21.15.70:0/1909824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65fc102ef0 msgr2=0x7f65fc19ef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65fc102ef0 0x7f65fc19ef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 -- 172.21.15.70:0/1909824057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65fc19f650 con 0x7f65fc102570 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.842+0000 7f65fbfff640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc102570 0x7f65fc19abe0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00ba50 tx=0x7f65ec00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.843+0000 7f65f9ffb640 1 -- 172.21.15.70:0/1909824057 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec019070 con 0x7f65fc102570 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.843+0000 7f65f9ffb640 1 -- 172.21.15.70:0/1909824057 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f65ec00cbe0 con 0x7f65fc102570 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.843+0000 7f6603034640 1 -- 172.21.15.70:0/1909824057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65fc19f940 con 0x7f65fc102570 2024-09-19T04:37:02.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.843+0000 7f65f9ffb640 1 -- 172.21.15.70:0/1909824057 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec007630 con 0x7f65fc102570 2024-09-19T04:37:02.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.843+0000 7f6603034640 1 -- 172.21.15.70:0/1909824057 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65fc1a7220 con 0x7f65fc102570 2024-09-19T04:37:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.846+0000 7f65f9ffb640 1 -- 172.21.15.70:0/1909824057 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f65ec01c070 con 0x7f65fc102570 2024-09-19T04:37:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.846+0000 7f660540d740 1 Processor -- start 2024-09-19T04:37:02.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.846+0000 7f65f9ffb640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65e80a33b0 0x7f65e80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.846+0000 7f660540d740 1 -- start start 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.846+0000 7f66015d1640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65e80a33b0 0x7f65e80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.846+0000 7f660540d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 0x55deb4d34090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.846+0000 7f65f9ffb640 1 -- 172.21.15.70:0/1909824057 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f65ec0cf2a0 con 0x7f65fc102570 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.846+0000 7f660540d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d345d0 0x55deb4d34a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f660540d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 0x55deb4d41760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f660540d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55deb4c9a2f0 con 0x55deb4d345d0 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f660540d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55deb4c41cf0 con 0x55deb4d35b40 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f660540d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55deb4c962b0 con 0x55deb4d3f370 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d345d0 0x55deb4d34a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d345d0 0x55deb4d34a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52600/0 (socket says 172.21.15.70:52600) 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 -- 172.21.15.70:0/2179802405 learned_addr learned my addr 172.21.15.70:0/2179802405 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f6600dd0640 1 --2- 172.21.15.70:0/2179802405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 0x55deb4d34090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f66015d1640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65e80a33b0 0x7f65e80a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f65e4005fd0 tx=0x7f65e4005da0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 -- 172.21.15.70:0/2179802405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 msgr2=0x55deb4d41760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 --2- 172.21.15.70:0/2179802405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 0x55deb4d41760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 -- 172.21.15.70:0/2179802405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 msgr2=0x55deb4d34090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 --2- 172.21.15.70:0/2179802405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 0x55deb4d34090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 -- 172.21.15.70:0/2179802405 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb4c263a0 con 0x55deb4d345d0 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65fbfff640 1 --2- 172.21.15.70:0/2179802405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d345d0 0x55deb4d34a10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f65ec098080 tx=0x7f65ec09b0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=188bcde422c5cc62 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65f2ffd640 1 -- 172.21.15.70:0/2179802405 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec09fa60 con 0x55deb4d345d0 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65f2ffd640 1 -- 172.21.15.70:0/2179802405 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f65ec0a4320 con 0x55deb4d345d0 2024-09-19T04:37:02.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.847+0000 7f65f2ffd640 1 -- 172.21.15.70:0/2179802405 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0a4090 con 0x55deb4d345d0 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 -- 172.21.15.70:0/2179802405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d345d0 msgr2=0x55deb4d34a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 --2- 172.21.15.70:0/2179802405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d345d0 0x55deb4d34a10 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f65ec098080 tx=0x7f65ec09b0d0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 -- 172.21.15.70:0/2179802405 shutdown_connections 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 --2- 172.21.15.70:0/2179802405 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 0x55deb4d41760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 --2- 172.21.15.70:0/2179802405 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d345d0 0x55deb4d34a10 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 --2- 172.21.15.70:0/2179802405 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 0x55deb4d34090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 -- 172.21.15.70:0/2179802405 >> 172.21.15.70:0/2179802405 conn(0x55deb4cfd310 msgr2=0x55deb4d30c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 -- 172.21.15.70:0/2179802405 shutdown_connections 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 -- 172.21.15.70:0/2179802405 wait complete. 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.848+0000 7f660540d740 1 -- start start 2024-09-19T04:37:02.857 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f660540d740 1 Processor -- start 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f660540d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 0x55deb4d3ed90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f660540d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d3c040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f660540d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d3f370 0x55deb4d3c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f660540d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55deb4d42070 con 0x55deb4d35b40 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f660540d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55deb4c55060 con 0x55deb4d3f370 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f660540d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55deb4d421f0 con 0x55deb4d345d0 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f660540d740 10 client.0 _ll_register_callbacks cb 0x55deb49a88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d3c040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d3c040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52612/0 (socket says 172.21.15.70:52612) 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f65fbfff640 1 -- 172.21.15.70:0/4517145 learned_addr learned my addr 172.21.15.70:0/4517145 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f6600dd0640 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 0x55deb4d3ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.858 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f66015d1640 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d3f370 0x55deb4d3c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f65fbfff640 1 -- 172.21.15.70:0/4517145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 msgr2=0x55deb4d3ed90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f65fbfff640 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 0x55deb4d3ed90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f65fbfff640 1 -- 172.21.15.70:0/4517145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d3f370 msgr2=0x55deb4d3c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f65fbfff640 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d3f370 0x55deb4d3c650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.849+0000 7f65fbfff640 1 -- 172.21.15.70:0/4517145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb4a0b3c0 con 0x55deb4d35b40 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f65fbfff640 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d3c040 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0cd010 tx=0x7f65ec097a80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f176308d47063b38 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f65dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f65dbfff640 1 -- 172.21.15.70:0/4517145 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0afdd0 con 0x55deb4d35b40 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f65dbfff640 1 -- 172.21.15.70:0/4517145 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f65ec09ab00 con 0x55deb4d35b40 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 1 -- 172.21.15.70:0/4517145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65ec0a4320 con 0x55deb4d35b40 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f65dbfff640 1 -- 172.21.15.70:0/4517145 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f65ec09fa60 con 0x55deb4d35b40 2024-09-19T04:37:02.859 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 10 client.16662 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 1 -- 172.21.15.70:0/4517145 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55deb4d4db40 con 0x55deb4d35b40 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f65dbfff640 1 -- 172.21.15.70:0/4517145 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f65ec0a4320 con 0x55deb4d35b40 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f65dbfff640 1 -- 172.21.15.70:0/4517145 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f65ec0bb070 con 0x55deb4d35b40 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 10 client.16662 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 10 client.16662 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 20 client.16662 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55deb4d4ee90 0x55deb4d51280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 4 client.16662 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.850+0000 7f660540d740 1 -- 172.21.15.70:0/4517145 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55deb4ca7860 con 0x55deb4d4ee90 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.851+0000 7f6600dd0640 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55deb4d4ee90 0x55deb4d51280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.851+0000 7f65dbfff640 10 client.16662 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.851+0000 7f6600dd0640 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55deb4d4ee90 0x55deb4d51280 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d6f17632314b6f11 server_cookie=a15f609674016013 in_seq=0 out_seq=0 2024-09-19T04:37:02.860 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f65dbfff640 1 -- 172.21.15.70:0/4517145 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55deb4ca7860 con 0x55deb4d4ee90 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f65dbfff640 10 client.16662 handle_command_reply: tid=0 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 client.16662 shutdown 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 -- 172.21.15.70:0/4517145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 msgr2=0x55deb4d3c040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d3c040 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f65ec0cd010 tx=0x7f65ec097a80 comp rx=0 tx=0).stop 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 -- 172.21.15.70:0/4517145 shutdown_connections 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55deb4d4ee90 0x55deb4d51280 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d3f370 0x55deb4d3c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f65dbfff640 0 client.16662 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d3c040 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 --2- 172.21.15.70:0/4517145 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 0x55deb4d3ed90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 -- 172.21.15.70:0/4517145 >> 172.21.15.70:0/4517145 conn(0x55deb4cfd310 msgr2=0x55deb4d36990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 -- 172.21.15.70:0/4517145 shutdown_connections 2024-09-19T04:37:02.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 1 -- 172.21.15.70:0/4517145 wait complete. 2024-09-19T04:37:02.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.852+0000 7f660540d740 20 client.16662 trim_cache size 0 max 16384 2024-09-19T04:37:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f660540d740 1 Processor -- start 2024-09-19T04:37:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f660540d740 1 -- start start 2024-09-19T04:37:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f660540d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 0x55deb4d4b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f660540d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 0x55deb4d30d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f660540d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d3f370 0x55deb4d2fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f660540d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1b21d0 con 0x55deb4d3f370 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f660540d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1afaa0 con 0x55deb4d35b40 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f660540d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1ad8f0 con 0x55deb4d345d0 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f66015d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d3f370 0x55deb4d2fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f66015d1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d3f370 0x55deb4d2fbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52628/0 (socket says 172.21.15.70:52628) 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.865+0000 7f66015d1640 1 -- 172.21.15.70:0/2774368582 learned_addr learned my addr 172.21.15.70:0/2774368582 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f65fbfff640 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 0x55deb4d30d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f6600dd0640 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 0x55deb4d4b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f66015d1640 1 -- 172.21.15.70:0/2774368582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 msgr2=0x55deb4d4b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:02.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f66015d1640 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 0x55deb4d4b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f66015d1640 1 -- 172.21.15.70:0/2774368582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 msgr2=0x55deb4d30d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f66015d1640 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 0x55deb4d30d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f66015d1640 1 -- 172.21.15.70:0/2774368582 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55deb4d3cfe0 con 0x55deb4d3f370 2024-09-19T04:37:02.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f66015d1640 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d3f370 0x55deb4d2fbf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f65e400eed0 tx=0x7f65e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a35804cf41fe063 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f65f27fc640 1 -- 172.21.15.70:0/2774368582 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e4026430 con 0x55deb4d3f370 2024-09-19T04:37:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f65f27fc640 1 -- 172.21.15.70:0/2774368582 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f65e401d900 con 0x55deb4d3f370 2024-09-19T04:37:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.866+0000 7f65f27fc640 1 -- 172.21.15.70:0/2774368582 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65e401c9d0 con 0x55deb4d3f370 2024-09-19T04:37:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 -- 172.21.15.70:0/2774368582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d3f370 msgr2=0x55deb4d2fbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d3f370 0x55deb4d2fbf0 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f65e400eed0 tx=0x7f65e4004730 comp rx=0 tx=0).stop 2024-09-19T04:37:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 -- 172.21.15.70:0/2774368582 shutdown_connections 2024-09-19T04:37:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d3f370 0x55deb4d2fbf0 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d35b40 0x55deb4d30d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 --2- 172.21.15.70:0/2774368582 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d345d0 0x55deb4d4b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 -- 172.21.15.70:0/2774368582 >> 172.21.15.70:0/2774368582 conn(0x55deb4cfd310 msgr2=0x55deb4d2f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 -- 172.21.15.70:0/2774368582 shutdown_connections 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 -- 172.21.15.70:0/2774368582 wait complete. 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 -- start start 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 Processor -- start 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d345d0 0x55deb4d519e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d51f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.867+0000 7f660540d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 0x55deb4db77c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f660540d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1adf60 con 0x55deb4d35b40 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f660540d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1af3d0 con 0x55deb4d345d0 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f660540d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65fc1ae630 con 0x55deb4d3f370 2024-09-19T04:37:02.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f660540d740 10 client.0 _ll_register_callbacks cb 0x7f65f4009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d51f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d51f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52644/0 (socket says 172.21.15.70:52644) 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 -- 172.21.15.70:0/8050292 learned_addr learned my addr 172.21.15.70:0/8050292 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f6600dd0640 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d345d0 0x55deb4d519e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f66015d1640 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 0x55deb4db77c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 -- 172.21.15.70:0/8050292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 msgr2=0x55deb4db77c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 0x55deb4db77c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 -- 172.21.15.70:0/8050292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d345d0 msgr2=0x55deb4d519e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d345d0 0x55deb4d519e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 -- 172.21.15.70:0/8050292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55deb4db7e00 con 0x55deb4d35b40 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65fbfff640 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d51f20 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f65ec09a880 tx=0x7f65ec004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2c30ec35cf3868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:02.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65dbfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65dbfff640 1 -- 172.21.15.70:0/8050292 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65ec0a4320 con 0x55deb4d35b40 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65dbfff640 1 -- 172.21.15.70:0/8050292 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f65ec09a570 con 0x55deb4d35b40 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f660540d740 1 -- 172.21.15.70:0/8050292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f65e401d900 con 0x55deb4d35b40 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f65dbfff640 1 -- 172.21.15.70:0/8050292 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f65ec0090a0 con 0x55deb4d35b40 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f660540d740 10 client.16668 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.868+0000 7f660540d740 1 -- 172.21.15.70:0/8050292 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55deb4db90c0 con 0x55deb4d35b40 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f65dbfff640 1 -- 172.21.15.70:0/8050292 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f65e401d900 con 0x55deb4d35b40 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f65dbfff640 1 -- 172.21.15.70:0/8050292 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f65ec0bb040 con 0x55deb4d35b40 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f660540d740 10 client.16668 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f660540d740 10 client.16668 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f660540d740 20 client.16668 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:02.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f660540d740 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55deb4db95f0 0x55deb4dbb9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f660540d740 4 client.16668 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f660540d740 1 -- 172.21.15.70:0/8050292 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55deb4ca1d70 con 0x55deb4db95f0 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.869+0000 7f6600dd0640 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55deb4db95f0 0x55deb4dbb9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f65dbfff640 10 client.16668 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f6600dd0640 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55deb4db95f0 0x55deb4dbb9e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9342f80f564e0594 server_cookie=dbf07d5ca3ae45fa in_seq=0 out_seq=0 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f65dbfff640 1 -- 172.21.15.70:0/8050292 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55deb4ca1d70 con 0x55deb4db95f0 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f65dbfff640 10 client.16668 handle_command_reply: tid=0 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 client.16668 shutdown 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 -- 172.21.15.70:0/8050292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 msgr2=0x55deb4d51f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d51f20 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f65ec09a880 tx=0x7f65ec004a40 comp rx=0 tx=0).stop 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 -- 172.21.15.70:0/8050292 shutdown_connections 2024-09-19T04:37:02.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55deb4db95f0 0x55deb4dbb9e0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55deb4d3f370 0x55deb4db77c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55deb4d35b40 0x55deb4d51f20 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 --2- 172.21.15.70:0/8050292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55deb4d345d0 0x55deb4d519e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 -- 172.21.15.70:0/8050292 >> 172.21.15.70:0/8050292 conn(0x55deb4cfd310 msgr2=0x55deb4d2fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f65dbfff640 0 client.16668 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 -- 172.21.15.70:0/8050292 shutdown_connections 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 1 -- 172.21.15.70:0/8050292 wait complete. 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.870+0000 7f660540d740 20 client.16668 trim_cache size 0 max 16384 2024-09-19T04:37:02.878 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 -- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65e80a33b0 msgr2=0x7f65e80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65e80a33b0 0x7f65e80a5870 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f65e4005fd0 tx=0x7f65e4005da0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 -- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc102570 msgr2=0x7f65fc19abe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc102570 0x7f65fc19abe0 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f65ec00ba50 tx=0x7f65ec00bf10 comp rx=0 tx=0).stop 2024-09-19T04:37:02.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 -- 172.21.15.70:0/1909824057 shutdown_connections 2024-09-19T04:37:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65e80a33b0 0x7f65e80a5870 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65fc102ef0 0x7f65fc19ef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f65fc102570 0x7f65fc19abe0 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 --2- 172.21.15.70:0/1909824057 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f65fc100e20 0x7f65fc19a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 -- 172.21.15.70:0/1909824057 >> 172.21.15.70:0/1909824057 conn(0x7f65fc0fc7d0 msgr2=0x7f65fc06a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 -- 172.21.15.70:0/1909824057 shutdown_connections 2024-09-19T04:37:02.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:02.871+0000 7f6603034640 1 -- 172.21.15.70:0/1909824057 wait complete. 2024-09-19T04:37:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:02 smithi070 ceph-mon[30942]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:37:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:02 smithi070 ceph-mon[30942]: pgmap v191: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T04:37:03.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:02 smithi134 ceph-mon[34525]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:37:03.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:02 smithi134 ceph-mon[34525]: pgmap v191: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T04:37:03.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:02 smithi167 ceph-mon[34339]: fsmap cephfs:3 {0=b=up:active,1=h=up:active,2=i=up:active} 3 up:standby-replay 6 up:standby 2024-09-19T04:37:03.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:02 smithi167 ceph-mon[34339]: pgmap v191: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 45 KiB/s wr, 24 op/s 2024-09-19T04:37:03.605 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:37:03.865 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:04.281 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:03 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:37:04.281 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:03 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:37:04.281 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:03 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:37:04.281 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:03 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:37:04.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:03 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:37:04.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:03 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:37:04.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:03 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:37:04.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:03 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:37:04.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 -- 172.21.15.70:0/643864991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8102790 msgr2=0x7f60f81067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/643864991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8102790 0x7f60f81067e0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f60ec009900 tx=0x7f60ec02a410 comp rx=0 tx=0).stop 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 -- 172.21.15.70:0/643864991 shutdown_connections 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/643864991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60f8106f10 0x7f60f810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/643864991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8102790 0x7f60f81067e0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/643864991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f8101de0 0x7f60f81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 -- 172.21.15.70:0/643864991 >> 172.21.15.70:0/643864991 conn(0x7f60f80fd8c0 msgr2=0x7f60f80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 -- 172.21.15.70:0/643864991 shutdown_connections 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.360+0000 7f60fd4b2640 1 -- 172.21.15.70:0/643864991 wait complete. 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.361+0000 7f60fd4b2640 1 Processor -- start 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.361+0000 7f60fd4b2640 1 -- start start 2024-09-19T04:37:04.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.361+0000 7f60fd4b2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f8101de0 0x7f60f8198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.361+0000 7f60fd4b2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60f8102790 0x7f60f81989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.361+0000 7f60fd4b2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8106f10 0x7f60f819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.361+0000 7f60fd4b2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f60f8111f40 con 0x7f60f8106f10 2024-09-19T04:37:04.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.361+0000 7f60fd4b2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f60f8111dc0 con 0x7f60f8101de0 2024-09-19T04:37:04.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.361+0000 7f60fd4b2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f60f81120c0 con 0x7f60f8102790 2024-09-19T04:37:04.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f8101de0 0x7f60f8198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8106f10 0x7f60f819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f6ffd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f8101de0 0x7f60f8198470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:37700/0 (socket says 172.21.15.70:37700) 2024-09-19T04:37:04.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f6ffd640 1 -- 172.21.15.70:0/1423778712 learned_addr learned my addr 172.21.15.70:0/1423778712 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:04.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f67fc640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60f8102790 0x7f60f81989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f77fe640 1 -- 172.21.15.70:0/1423778712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60f8102790 msgr2=0x7f60f81989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f77fe640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60f8102790 0x7f60f81989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f77fe640 1 -- 172.21.15.70:0/1423778712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f8101de0 msgr2=0x7f60f8198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f77fe640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f8101de0 0x7f60f8198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f77fe640 1 -- 172.21.15.70:0/1423778712 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60f819d420 con 0x7f60f8106f10 2024-09-19T04:37:04.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f8101de0 0x7f60f8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:37:04.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60f77fe640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8106f10 0x7f60f819cd40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e940 tx=0x7f60f000ee00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:04.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60dffff640 1 -- 172.21.15.70:0/1423778712 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f0004d20 con 0x7f60f8106f10 2024-09-19T04:37:04.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60dffff640 1 -- 172.21.15.70:0/1423778712 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f60f0005020 con 0x7f60f8106f10 2024-09-19T04:37:04.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60dffff640 1 -- 172.21.15.70:0/1423778712 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f00116b0 con 0x7f60f8106f10 2024-09-19T04:37:04.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60fd4b2640 1 -- 172.21.15.70:0/1423778712 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60f819d710 con 0x7f60f8106f10 2024-09-19T04:37:04.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.362+0000 7f60fd4b2640 1 -- 172.21.15.70:0/1423778712 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60f81a4ff0 con 0x7f60f8106f10 2024-09-19T04:37:04.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60dffff640 1 -- 172.21.15.70:0/1423778712 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f60f000cb20 con 0x7f60f8106f10 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60ff88b740 1 Processor -- start 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60ff88b740 1 -- start start 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a53f50 0x562109a524a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a529e0 0x562109a52e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a5d780 0x562109a5fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60ff88b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5621099b42f0 con 0x562109a529e0 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60ff88b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56210995bcf0 con 0x562109a53f50 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60ff88b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5621099b02b0 con 0x562109a5d780 2024-09-19T04:37:04.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60f6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a529e0 0x562109a52e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a53f50 0x562109a524a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60f6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a529e0 0x562109a52e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54940/0 (socket says 172.21.15.70:54940) 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.365+0000 7f60f6ffd640 1 -- 172.21.15.70:0/2700474666 learned_addr learned my addr 172.21.15.70:0/2700474666 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f67fc640 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a5d780 0x562109a5fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f6ffd640 1 -- 172.21.15.70:0/2700474666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a5d780 msgr2=0x562109a5fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a5d780 0x562109a5fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f6ffd640 1 -- 172.21.15.70:0/2700474666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a53f50 msgr2=0x562109a524a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a53f50 0x562109a524a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f6ffd640 1 -- 172.21.15.70:0/2700474666 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5621099403a0 con 0x562109a529e0 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60dffff640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60e00a33b0 0x7f60e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f67fc640 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a53f50 0x562109a524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f67fc640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60e00a33b0 0x7f60e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a529e0 0x562109a52e20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f60e8010580 tx=0x7f60e8010a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d37c341db0b937a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60dffff640 1 -- 172.21.15.70:0/1423778712 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f60f00cfca0 con 0x7f60f8106f10 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60dd7fa640 1 -- 172.21.15.70:0/2700474666 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e800e890 con 0x562109a529e0 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60dd7fa640 1 -- 172.21.15.70:0/2700474666 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f60e801c480 con 0x562109a529e0 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.366+0000 7f60dd7fa640 1 -- 172.21.15.70:0/2700474666 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60e8011660 con 0x562109a529e0 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 -- 172.21.15.70:0/2700474666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a529e0 msgr2=0x562109a52e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60f67fc640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60e00a33b0 0x7f60e00a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f60ec006010 tx=0x7f60ec000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a529e0 0x562109a52e20 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f60e8010580 tx=0x7f60e8010a40 comp rx=0 tx=0).stop 2024-09-19T04:37:04.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 -- 172.21.15.70:0/2700474666 shutdown_connections 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a5d780 0x562109a5fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a529e0 0x562109a52e20 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 --2- 172.21.15.70:0/2700474666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a53f50 0x562109a524a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 -- 172.21.15.70:0/2700474666 >> 172.21.15.70:0/2700474666 conn(0x562109a17310 msgr2=0x562109a4f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 -- 172.21.15.70:0/2700474666 shutdown_connections 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 -- 172.21.15.70:0/2700474666 wait complete. 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 -- start start 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.367+0000 7f60ff88b740 1 Processor -- start 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 0x562109a5d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a5a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 0x562109a5a980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60ff88b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562109a60480 con 0x562109a53f50 2024-09-19T04:37:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60ff88b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56210996f060 con 0x562109a5d780 2024-09-19T04:37:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60ff88b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562109a60600 con 0x562109a529e0 2024-09-19T04:37:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60ff88b740 10 client.0 _ll_register_callbacks cb 0x5621096c28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a5a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a5a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54946/0 (socket says 172.21.15.70:54946) 2024-09-19T04:37:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 -- 172.21.15.70:0/252927968 learned_addr learned my addr 172.21.15.70:0/252927968 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 0x562109a5d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f77fe640 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 0x562109a5a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 -- 172.21.15.70:0/252927968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 msgr2=0x562109a5d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 0x562109a5d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 -- 172.21.15.70:0/252927968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 msgr2=0x562109a5a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 0x562109a5a980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.382 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 -- 172.21.15.70:0/252927968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5621097253c0 con 0x562109a53f50 2024-09-19T04:37:04.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60f67fc640 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a5a3e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f60ec033000 tx=0x7f60ec02a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a34101aa74a76f6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:04.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.368+0000 7f60daff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:04.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60daff5640 1 -- 172.21.15.70:0/252927968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec044070 con 0x562109a53f50 2024-09-19T04:37:04.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60daff5640 1 -- 172.21.15.70:0/252927968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f60ec005050 con 0x562109a53f50 2024-09-19T04:37:04.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 1 -- 172.21.15.70:0/252927968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60e801c480 con 0x562109a53f50 2024-09-19T04:37:04.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60daff5640 1 -- 172.21.15.70:0/252927968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f60ec05a050 con 0x562109a53f50 2024-09-19T04:37:04.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 10 client.16680 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:04.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 1 -- 172.21.15.70:0/252927968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562109a6bed0 con 0x562109a53f50 2024-09-19T04:37:04.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60daff5640 1 -- 172.21.15.70:0/252927968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f60e801c480 con 0x562109a53f50 2024-09-19T04:37:04.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60daff5640 1 -- 172.21.15.70:0/252927968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f60ec0035f0 con 0x562109a53f50 2024-09-19T04:37:04.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 10 client.16680 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:04.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 10 client.16680 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:04.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 20 client.16680 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:04.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562109a6d430 0x562109a6f850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 4 client.16680 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:04.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60ff88b740 1 -- 172.21.15.70:0/252927968 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5621099c1860 con 0x562109a6d430 2024-09-19T04:37:04.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.369+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562109a6d430 0x562109a6f850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.370+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562109a6d430 0x562109a6f850 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=793ad86e27c4e00a server_cookie=6f075df65d3806e3 in_seq=0 out_seq=0 2024-09-19T04:37:04.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.370+0000 7f60daff5640 10 client.16680 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:04.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.370+0000 7f60daff5640 1 -- 172.21.15.70:0/252927968 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5621099c1860 con 0x562109a6d430 2024-09-19T04:37:04.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.370+0000 7f60daff5640 10 client.16680 handle_command_reply: tid=0 2024-09-19T04:37:04.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.370+0000 7f60ff88b740 1 client.16680 shutdown 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 -- 172.21.15.70:0/252927968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 msgr2=0x562109a5a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a5a3e0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f60ec033000 tx=0x7f60ec02a410 comp rx=0 tx=0).stop 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 -- 172.21.15.70:0/252927968 shutdown_connections 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562109a6d430 0x562109a6f850 crc :-1 s=READY pgs=126 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 0x562109a5a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a5a3e0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 --2- 172.21.15.70:0/252927968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 0x562109a5d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 -- 172.21.15.70:0/252927968 >> 172.21.15.70:0/252927968 conn(0x562109a17310 msgr2=0x562109a54d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:04.386 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60daff5640 0 client.16680 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:04.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 -- 172.21.15.70:0/252927968 shutdown_connections 2024-09-19T04:37:04.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 1 -- 172.21.15.70:0/252927968 wait complete. 2024-09-19T04:37:04.387 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.371+0000 7f60ff88b740 20 client.16680 trim_cache size 0 max 16384 2024-09-19T04:37:04.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.383+0000 7f60ff88b740 1 Processor -- start 2024-09-19T04:37:04.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.383+0000 7f60ff88b740 1 -- start start 2024-09-19T04:37:04.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 0x562109a4f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a69720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 0x562109a58d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60ff88b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f60f81adfd0 con 0x562109a53f50 2024-09-19T04:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60ff88b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f60f81ab8a0 con 0x562109a5d780 2024-09-19T04:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60ff88b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f60f81a96f0 con 0x562109a529e0 2024-09-19T04:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a69720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a69720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54952/0 (socket says 172.21.15.70:54952) 2024-09-19T04:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 -- 172.21.15.70:0/374307579 learned_addr learned my addr 172.21.15.70:0/374307579 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 0x562109a4f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f77fe640 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 0x562109a58d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 -- 172.21.15.70:0/374307579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 msgr2=0x562109a4f220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 0x562109a4f220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 -- 172.21.15.70:0/374307579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 msgr2=0x562109a58d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 0x562109a58d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 -- 172.21.15.70:0/374307579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562109a59410 con 0x562109a53f50 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60f67fc640 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a69720 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f60ec02a930 tx=0x7f60ec0058f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa0ddfc3418632fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60dcff9640 1 -- 172.21.15.70:0/374307579 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec044040 con 0x562109a53f50 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60dcff9640 1 -- 172.21.15.70:0/374307579 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f60ec063070 con 0x562109a53f50 2024-09-19T04:37:04.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.384+0000 7f60dcff9640 1 -- 172.21.15.70:0/374307579 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60ec035040 con 0x562109a53f50 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 -- 172.21.15.70:0/374307579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 msgr2=0x562109a69720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a69720 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f60ec02a930 tx=0x7f60ec0058f0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 -- 172.21.15.70:0/374307579 shutdown_connections 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a5d780 0x562109a58d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a53f50 0x562109a69720 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 --2- 172.21.15.70:0/374307579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a529e0 0x562109a4f220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 -- 172.21.15.70:0/374307579 >> 172.21.15.70:0/374307579 conn(0x562109a17310 msgr2=0x562109a4eb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 -- 172.21.15.70:0/374307579 shutdown_connections 2024-09-19T04:37:04.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 -- 172.21.15.70:0/374307579 wait complete. 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 -- start start 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.385+0000 7f60ff88b740 1 Processor -- start 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a529e0 0x562109a66000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a53f50 0x562109a571f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60ff88b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a5d780 0x562109a57730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60ff88b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f60f81a9d60 con 0x562109a5d780 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60ff88b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f60f81ab1d0 con 0x562109a529e0 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60ff88b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f60f81aa430 con 0x562109a53f50 2024-09-19T04:37:04.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60ff88b740 10 client.0 _ll_register_callbacks cb 0x7f60ec032c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a5d780 0x562109a57730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a5d780 0x562109a57730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54968/0 (socket says 172.21.15.70:54968) 2024-09-19T04:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 -- 172.21.15.70:0/4037898902 learned_addr learned my addr 172.21.15.70:0/4037898902 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f67fc640 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a53f50 0x562109a571f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a529e0 0x562109a66000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 -- 172.21.15.70:0/4037898902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a53f50 msgr2=0x562109a571f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:04.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a53f50 0x562109a571f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 -- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a529e0 msgr2=0x562109a66000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a529e0 0x562109a66000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 -- 172.21.15.70:0/4037898902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562109a57f80 con 0x562109a5d780 2024-09-19T04:37:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a529e0 0x562109a66000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60f77fe640 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a5d780 0x562109a57730 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f60f0004ff0 tx=0x7f60f00bc1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f44769bfa7c55c8f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:04.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60daff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:04.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60daff5640 1 -- 172.21.15.70:0/4037898902 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f60f001f040 con 0x562109a5d780 2024-09-19T04:37:04.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60daff5640 1 -- 172.21.15.70:0/4037898902 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f60f00986c0 con 0x562109a5d780 2024-09-19T04:37:04.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.386+0000 7f60ff88b740 1 -- 172.21.15.70:0/4037898902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f60ec063070 con 0x562109a5d780 2024-09-19T04:37:04.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60daff5640 1 -- 172.21.15.70:0/4037898902 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f60f00a4c10 con 0x562109a5d780 2024-09-19T04:37:04.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60ff88b740 10 client.16686 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:04.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60ff88b740 1 -- 172.21.15.70:0/4037898902 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562109ad8120 con 0x562109a5d780 2024-09-19T04:37:04.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60daff5640 1 -- 172.21.15.70:0/4037898902 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f60ec063070 con 0x562109a5d780 2024-09-19T04:37:04.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60daff5640 1 -- 172.21.15.70:0/4037898902 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f60f000f040 con 0x562109a5d780 2024-09-19T04:37:04.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60ff88b740 10 client.16686 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:04.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60ff88b740 10 client.16686 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:04.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60ff88b740 20 client.16686 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:04.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60ff88b740 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562109ad8840 0x562109adac30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:04.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60ff88b740 4 client.16686 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:04.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60ff88b740 1 -- 172.21.15.70:0/4037898902 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5621099bbd70 con 0x562109ad8840 2024-09-19T04:37:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.387+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562109ad8840 0x562109adac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60daff5640 10 client.16686 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60f6ffd640 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562109ad8840 0x562109adac30 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ae7bf47bddf2e1 server_cookie=b145ccfd7615bcce in_seq=0 out_seq=0 2024-09-19T04:37:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60daff5640 1 -- 172.21.15.70:0/4037898902 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5621099bbd70 con 0x562109ad8840 2024-09-19T04:37:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60daff5640 10 client.16686 handle_command_reply: tid=0 2024-09-19T04:37:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 client.16686 shutdown 2024-09-19T04:37:04.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 -- 172.21.15.70:0/4037898902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a5d780 msgr2=0x562109a57730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a5d780 0x562109a57730 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f60f0004ff0 tx=0x7f60f00bc1a0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 -- 172.21.15.70:0/4037898902 shutdown_connections 2024-09-19T04:37:04.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562109ad8840 0x562109adac30 crc :-1 s=READY pgs=127 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60daff5640 0 client.16686 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:04.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562109a5d780 0x562109a57730 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562109a53f50 0x562109a571f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 --2- 172.21.15.70:0/4037898902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562109a529e0 0x562109a66000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 -- 172.21.15.70:0/4037898902 >> 172.21.15.70:0/4037898902 conn(0x562109a17310 msgr2=0x562109a5bc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:04.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 -- 172.21.15.70:0/4037898902 shutdown_connections 2024-09-19T04:37:04.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 1 -- 172.21.15.70:0/4037898902 wait complete. 2024-09-19T04:37:04.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60ff88b740 20 client.16686 trim_cache size 0 max 16384 2024-09-19T04:37:04.406 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60fd4b2640 1 -- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60e00a33b0 msgr2=0x7f60e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.388+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60e00a33b0 0x7f60e00a5870 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f60ec006010 tx=0x7f60ec000bc0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 -- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8106f10 msgr2=0x7f60f819cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8106f10 0x7f60f819cd40 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f60f000e940 tx=0x7f60f000ee00 comp rx=0 tx=0).stop 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 -- 172.21.15.70:0/1423778712 shutdown_connections 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f60e00a33b0 0x7f60e00a5870 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f60f8106f10 0x7f60f819cd40 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f60f8102790 0x7f60f81989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 --2- 172.21.15.70:0/1423778712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60f8101de0 0x7f60f8198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:04.408 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 -- 172.21.15.70:0/1423778712 >> 172.21.15.70:0/1423778712 conn(0x7f60f80fd8c0 msgr2=0x7f60f80fec50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:04.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 -- 172.21.15.70:0/1423778712 shutdown_connections 2024-09-19T04:37:04.409 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:04.389+0000 7f60fd4b2640 1 -- 172.21.15.70:0/1423778712 wait complete. 2024-09-19T04:37:04.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:03 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:37:04.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:03 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:37:04.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:03 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:37:04.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:03 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:37:05.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:04 smithi134 ceph-mon[34525]: pgmap v192: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T04:37:05.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:04 smithi070 ceph-mon[30942]: pgmap v192: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T04:37:05.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:04 smithi167 ceph-mon[34339]: pgmap v192: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T04:37:06.087 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:37:06.087 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:37:06.346 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:06.754 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:06 smithi070 ceph-mon[30942]: pgmap v193: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T04:37:06.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 -- 172.21.15.70:0/1312300988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 msgr2=0x7f38501067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 --2- 172.21.15.70:0/1312300988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 0x7f38501067f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f3838009900 tx=0x7f383802a410 comp rx=0 tx=0).stop 2024-09-19T04:37:06.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 -- 172.21.15.70:0/1312300988 shutdown_connections 2024-09-19T04:37:06.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 --2- 172.21.15.70:0/1312300988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3850106f20 0x7f385010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 --2- 172.21.15.70:0/1312300988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 0x7f38501067f0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 --2- 172.21.15.70:0/1312300988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3850101df0 0x7f38501021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 -- 172.21.15.70:0/1312300988 >> 172.21.15.70:0/1312300988 conn(0x7f38500fd8f0 msgr2=0x7f38500ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:06.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 -- 172.21.15.70:0/1312300988 shutdown_connections 2024-09-19T04:37:06.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.835+0000 7f3854980640 1 -- 172.21.15.70:0/1312300988 wait complete. 2024-09-19T04:37:06.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f3854980640 1 Processor -- start 2024-09-19T04:37:06.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f3854980640 1 -- start start 2024-09-19T04:37:06.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f3854980640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3850101df0 0x7f3850198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f3854980640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 0x7f38501989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f3854980640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3850106f20 0x7f385019cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f3854980640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3850111f90 con 0x7f38501027a0 2024-09-19T04:37:06.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f3854980640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3850111e10 con 0x7f3850106f20 2024-09-19T04:37:06.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f3854980640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3850112110 con 0x7f3850101df0 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f384dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 0x7f38501989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f384dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 0x7f38501989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54972/0 (socket says 172.21.15.70:54972) 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f384dd9b640 1 -- 172.21.15.70:0/2311924680 learned_addr learned my addr 172.21.15.70:0/2311924680 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f384e59c640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3850101df0 0x7f3850198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.836+0000 7f384ed9d640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3850106f20 0x7f385019cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f384dd9b640 1 -- 172.21.15.70:0/2311924680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3850101df0 msgr2=0x7f3850198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f384dd9b640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3850101df0 0x7f3850198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f384dd9b640 1 -- 172.21.15.70:0/2311924680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3850106f20 msgr2=0x7f385019cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f384dd9b640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3850106f20 0x7f385019cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f384dd9b640 1 -- 172.21.15.70:0/2311924680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385019d420 con 0x7f38501027a0 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f384dd9b640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 0x7f38501989b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3838009a20 tx=0x7f38380043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:06.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f38477fe640 1 -- 172.21.15.70:0/2311924680 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f383803f030 con 0x7f38501027a0 2024-09-19T04:37:06.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f38477fe640 1 -- 172.21.15.70:0/2311924680 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3838031b80 con 0x7f38501027a0 2024-09-19T04:37:06.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f3854980640 1 -- 172.21.15.70:0/2311924680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385019d6b0 con 0x7f38501027a0 2024-09-19T04:37:06.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f38477fe640 1 -- 172.21.15.70:0/2311924680 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838035070 con 0x7f38501027a0 2024-09-19T04:37:06.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.837+0000 7f3854980640 1 -- 172.21.15.70:0/2311924680 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38501a4ff0 con 0x7f38501027a0 2024-09-19T04:37:06.843 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.839+0000 7f38477fe640 1 -- 172.21.15.70:0/2311924680 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f38380035f0 con 0x7f38501027a0 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.839+0000 7f3856d59740 1 Processor -- start 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f3856d59740 1 -- start start 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f3856d59740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c4fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f3856d59740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5ec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f3856d59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c61540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f3856d59740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f190bb5280 con 0x55f190c50340 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f3856d59740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f190b5cb10 con 0x55f190c4fa20 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f3856d59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f190bb1240 con 0x55f190c5f150 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f38477fe640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f383c0a33b0 0x7f383c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5ec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5ec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54974/0 (socket says 172.21.15.70:54974) 2024-09-19T04:37:06.844 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384e59c640 1 -- 172.21.15.70:0/3495278926 learned_addr learned my addr 172.21.15.70:0/3495278926 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384dd9b640 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c61540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384ed9d640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f383c0a33b0 0x7f383c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384ed9d640 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c4fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384e59c640 1 -- 172.21.15.70:0/3495278926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 msgr2=0x55f190c61540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384e59c640 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c61540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384e59c640 1 -- 172.21.15.70:0/3495278926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 msgr2=0x55f190c4fe00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384e59c640 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c4fe00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.840+0000 7f384e59c640 1 -- 172.21.15.70:0/3495278926 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f190b691f0 con 0x55f190c50340 2024-09-19T04:37:06.845 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.841+0000 7f384dd9b640 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c61540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.841+0000 7f38477fe640 1 -- 172.21.15.70:0/2311924680 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f38380f0740 con 0x7f38501027a0 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.841+0000 7f384e59c640 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5ec10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3840009a70 tx=0x7f3840009f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384234f0243b1c07 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.841+0000 7f384ed9d640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f383c0a33b0 0x7f383c0a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3848007310 tx=0x7f38480072a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.841+0000 7f3844ff9640 1 -- 172.21.15.70:0/3495278926 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840017070 con 0x55f190c50340 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.841+0000 7f3844ff9640 1 -- 172.21.15.70:0/3495278926 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3840013470 con 0x55f190c50340 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.841+0000 7f3844ff9640 1 -- 172.21.15.70:0/3495278926 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840012630 con 0x55f190c50340 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 -- 172.21.15.70:0/3495278926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 msgr2=0x55f190c5ec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5ec10 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f3840009a70 tx=0x7f3840009f30 comp rx=0 tx=0).stop 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 -- 172.21.15.70:0/3495278926 shutdown_connections 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c61540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5ec10 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 --2- 172.21.15.70:0/3495278926 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c4fe00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 -- 172.21.15.70:0/3495278926 >> 172.21.15.70:0/3495278926 conn(0x55f190c4c0f0 msgr2=0x55f190c4c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 -- 172.21.15.70:0/3495278926 shutdown_connections 2024-09-19T04:37:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 -- 172.21.15.70:0/3495278926 wait complete. 2024-09-19T04:37:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 -- start start 2024-09-19T04:37:06.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.842+0000 7f3856d59740 1 Processor -- start 2024-09-19T04:37:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3856d59740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c5c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3856d59740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3856d59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c5cb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3856d59740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f190c61d20 con 0x55f190c50340 2024-09-19T04:37:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3856d59740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f190b6ff10 con 0x55f190c4fa20 2024-09-19T04:37:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3856d59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f190c61ea0 con 0x55f190c5f150 2024-09-19T04:37:06.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3856d59740 10 client.0 _ll_register_callbacks cb 0x55f190b38a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54978/0 (socket says 172.21.15.70:54978) 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 -- 172.21.15.70:0/4288303932 learned_addr learned my addr 172.21.15.70:0/4288303932 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384e59c640 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c5c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384ed9d640 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c5cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 -- 172.21.15.70:0/4288303932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 msgr2=0x55f190c5cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c5cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 -- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 msgr2=0x55f190c5c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c5c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 -- 172.21.15.70:0/4288303932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f1909266a0 con 0x55f190c50340 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384e59c640 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c5c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f384dd9b640 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5c5d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f38380edf10 tx=0x7f3838009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2344ce67e78347e4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:06.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3835ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3835ffb640 1 -- 172.21.15.70:0/4288303932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838049030 con 0x55f190c50340 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3835ffb640 1 -- 172.21.15.70:0/4288303932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f38380a70d0 con 0x55f190c50340 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3856d59740 1 -- 172.21.15.70:0/4288303932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3840013470 con 0x55f190c50340 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.843+0000 7f3835ffb640 1 -- 172.21.15.70:0/4288303932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f38380bd140 con 0x55f190c50340 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3856d59740 10 client.16698 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3856d59740 1 -- 172.21.15.70:0/4288303932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f190c6d9c0 con 0x55f190c50340 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3835ffb640 1 -- 172.21.15.70:0/4288303932 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3840013470 con 0x55f190c50340 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3835ffb640 1 -- 172.21.15.70:0/4288303932 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f38380b90b0 con 0x55f190c50340 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3856d59740 10 client.16698 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3856d59740 10 client.16698 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3856d59740 20 client.16698 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3856d59740 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f190c6ed60 0x55f190c711e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3856d59740 4 client.16698 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:06.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f3856d59740 1 -- 172.21.15.70:0/4288303932 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f190bc27f0 con 0x55f190c6ed60 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.844+0000 7f384e59c640 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f190c6ed60 0x55f190c711e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.845+0000 7f384e59c640 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f190c6ed60 0x55f190c711e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ed605072e721504 server_cookie=bed0334bb27188f in_seq=0 out_seq=0 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.845+0000 7f3835ffb640 10 client.16698 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.845+0000 7f3835ffb640 1 -- 172.21.15.70:0/4288303932 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f190bc27f0 con 0x55f190c6ed60 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.845+0000 7f3835ffb640 10 client.16698 handle_command_reply: tid=0 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.845+0000 7f3856d59740 1 client.16698 shutdown 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.845+0000 7f3856d59740 1 -- 172.21.15.70:0/4288303932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 msgr2=0x55f190c5c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.845+0000 7f3856d59740 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5c5d0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f38380edf10 tx=0x7f3838009620 comp rx=0 tx=0).stop 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 1 -- 172.21.15.70:0/4288303932 shutdown_connections 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f190c6ed60 0x55f190c711e0 crc :-1 s=READY pgs=128 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c5cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c5c5d0 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 1 --2- 172.21.15.70:0/4288303932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c5c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3835ffb640 0 client.16698 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 1 -- 172.21.15.70:0/4288303932 >> 172.21.15.70:0/4288303932 conn(0x55f190c4c0f0 msgr2=0x55f190c51e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 1 -- 172.21.15.70:0/4288303932 shutdown_connections 2024-09-19T04:37:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 1 -- 172.21.15.70:0/4288303932 wait complete. 2024-09-19T04:37:06.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.846+0000 7f3856d59740 20 client.16698 trim_cache size 0 max 16384 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.862+0000 7f3856d59740 1 Processor -- start 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.862+0000 7f3856d59740 1 -- start start 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3856d59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c4fa20 0x55f190c5def0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3856d59740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c76af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3856d59740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c5f150 0x55f190c77030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3856d59740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f38501ade60 con 0x55f190c50340 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3856d59740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38501ab730 con 0x55f190c5f150 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3856d59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f38501a9580 con 0x55f190c4fa20 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c76af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.865 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c76af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54994/0 (socket says 172.21.15.70:54994) 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 -- 172.21.15.70:0/1879065438 learned_addr learned my addr 172.21.15.70:0/1879065438 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384e59c640 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c4fa20 0x55f190c5def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384ed9d640 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c5f150 0x55f190c77030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 -- 172.21.15.70:0/1879065438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c4fa20 msgr2=0x55f190c5def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c4fa20 0x55f190c5def0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 -- 172.21.15.70:0/1879065438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c5f150 msgr2=0x55f190c77030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c5f150 0x55f190c77030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 -- 172.21.15.70:0/1879065438 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f190c5b040 con 0x55f190c50340 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f384dd9b640 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c76af0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f38380b8ea0 tx=0x7f38380bcd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1b22f458bb604a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3837fff640 1 -- 172.21.15.70:0/1879065438 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838049040 con 0x55f190c50340 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3837fff640 1 -- 172.21.15.70:0/1879065438 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f38380f0a40 con 0x55f190c50340 2024-09-19T04:37:06.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.863+0000 7f3837fff640 1 -- 172.21.15.70:0/1879065438 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38380a7160 con 0x55f190c50340 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 -- 172.21.15.70:0/1879065438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 msgr2=0x55f190c76af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c76af0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f38380b8ea0 tx=0x7f38380bcd40 comp rx=0 tx=0).stop 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 -- 172.21.15.70:0/1879065438 shutdown_connections 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c5f150 0x55f190c77030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c76af0 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 --2- 172.21.15.70:0/1879065438 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c4fa20 0x55f190c5def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 -- 172.21.15.70:0/1879065438 >> 172.21.15.70:0/1879065438 conn(0x55f190c4c0f0 msgr2=0x55f190c5d7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 -- 172.21.15.70:0/1879065438 shutdown_connections 2024-09-19T04:37:06.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 -- 172.21.15.70:0/1879065438 wait complete. 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 -- start start 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.864+0000 7f3856d59740 1 Processor -- start 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3856d59740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c63150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3856d59740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c63690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3856d59740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c63bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3856d59740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f38501a9bf0 con 0x55f190c50340 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3856d59740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f38501ab060 con 0x55f190c4fa20 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3856d59740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f38501aa2c0 con 0x55f190c5f150 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3856d59740 10 client.0 _ll_register_callbacks cb 0x7f3838005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c63690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c63690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:54998/0 (socket says 172.21.15.70:54998) 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 -- 172.21.15.70:0/1836365885 learned_addr learned my addr 172.21.15.70:0/1836365885 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:06.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384e59c640 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c63150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384ed9d640 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c63bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 -- 172.21.15.70:0/1836365885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 msgr2=0x55f190c63bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c63bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 -- 172.21.15.70:0/1836365885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 msgr2=0x55f190c63150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c63150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 -- 172.21.15.70:0/1836365885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f190cd8d60 con 0x55f190c50340 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f384dd9b640 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c63690 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f38380045d0 tx=0x7f38380c56b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c64ac1ed92dbf30a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3835ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3835ffb640 1 -- 172.21.15.70:0/1836365885 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3838049070 con 0x55f190c50340 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3835ffb640 1 -- 172.21.15.70:0/1836365885 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(84..84 src has 1..84) ==== 8483+0+0 (secure 0 0 0) 0x7f38380db340 con 0x55f190c50340 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.865+0000 7f3856d59740 1 -- 172.21.15.70:0/1836365885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f38380f0a40 con 0x55f190c50340 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3835ffb640 1 -- 172.21.15.70:0/1836365885 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f38380b90b0 con 0x55f190c50340 2024-09-19T04:37:06.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3856d59740 10 client.16704 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3856d59740 1 -- 172.21.15.70:0/1836365885 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f190cd8d60 con 0x55f190c50340 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3835ffb640 1 -- 172.21.15.70:0/1836365885 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f38380f0a40 con 0x55f190c50340 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3835ffb640 1 -- 172.21.15.70:0/1836365885 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f38380b8820 con 0x55f190c50340 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3856d59740 10 client.16704 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3856d59740 10 client.16704 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3856d59740 20 client.16704 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3856d59740 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f190cda2a0 0x55f190cdc690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3856d59740 4 client.16704 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f3856d59740 1 -- 172.21.15.70:0/1836365885 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f190bbcd00 con 0x55f190cda2a0 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.866+0000 7f384e59c640 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f190cda2a0 0x55f190cdc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.867+0000 7f3835ffb640 10 client.16704 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:06.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.867+0000 7f384e59c640 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f190cda2a0 0x55f190cdc690 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=29800fbc07126e36 server_cookie=cdf53343821fbfc3 in_seq=0 out_seq=0 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3835ffb640 1 -- 172.21.15.70:0/1836365885 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f190bbcd00 con 0x55f190cda2a0 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3835ffb640 10 client.16704 handle_command_reply: tid=0 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 client.16704 shutdown 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 -- 172.21.15.70:0/1836365885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 msgr2=0x55f190c63690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c63690 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f38380045d0 tx=0x7f38380c56b0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 -- 172.21.15.70:0/1836365885 shutdown_connections 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f190cda2a0 0x55f190cdc690 crc :-1 s=READY pgs=129 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f190c5f150 0x55f190c63bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f190c50340 0x55f190c63690 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 --2- 172.21.15.70:0/1836365885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f190c4fa20 0x55f190c63150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 -- 172.21.15.70:0/1836365885 >> 172.21.15.70:0/1836365885 conn(0x55f190c4c0f0 msgr2=0x55f190c4b270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:06.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3835ffb640 0 client.16704 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:06.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 -- 172.21.15.70:0/1836365885 shutdown_connections 2024-09-19T04:37:06.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 1 -- 172.21.15.70:0/1836365885 wait complete. 2024-09-19T04:37:06.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.868+0000 7f3856d59740 20 client.16704 trim_cache size 0 max 16384 2024-09-19T04:37:06.875 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:37:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "fd696e4f-e6c3-4d0b-81d4-04efbfd20104", 2024-09-19T04:37:06.875 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:37:06.875 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 -- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f383c0a33b0 msgr2=0x7f383c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f383c0a33b0 0x7f383c0a5870 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f3848007310 tx=0x7f38480072a0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 -- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 msgr2=0x7f38501989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 0x7f38501989b0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f3838009a20 tx=0x7f38380043b0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 -- 172.21.15.70:0/2311924680 shutdown_connections 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f383c0a33b0 0x7f383c0a5870 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3850106f20 0x7f385019cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f38501027a0 0x7f38501989b0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 --2- 172.21.15.70:0/2311924680 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3850101df0 0x7f3850198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 -- 172.21.15.70:0/2311924680 >> 172.21.15.70:0/2311924680 conn(0x7f38500fd8f0 msgr2=0x7f38500fec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 -- 172.21.15.70:0/2311924680 shutdown_connections 2024-09-19T04:37:06.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:06.869+0000 7f3854980640 1 -- 172.21.15.70:0/2311924680 wait complete. 2024-09-19T04:37:06.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:06 smithi167 ceph-mon[34339]: pgmap v193: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T04:37:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:06 smithi134 ceph-mon[34525]: pgmap v193: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 45 KiB/s wr, 22 op/s 2024-09-19T04:37:07.549 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:37:07.801 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:07 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:37:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:07 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:07 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:37:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:07 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:07.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:07 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:37:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:07 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:37:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:07 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:07 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:37:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:07 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:07.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:07 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:37:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:07 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:37:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:07 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:07 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:37:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:07 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:07 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:37:08.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3810154973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 msgr2=0x7f6c381067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3810154973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 0x7f6c381067e0 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f6c28009900 tx=0x7f6c2802a410 comp rx=0 tx=0).stop 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3810154973 shutdown_connections 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3810154973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c38106f10 0x7f6c3810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3810154973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 0x7f6c381067e0 unknown :-1 s=CLOSED pgs=821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3810154973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c38101de0 0x7f6c381021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3810154973 >> 172.21.15.70:0/3810154973 conn(0x7f6c380fd8c0 msgr2=0x7f6c380ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3810154973 shutdown_connections 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.271+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3810154973 wait complete. 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3f9f5640 1 Processor -- start 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3f9f5640 1 -- start start 2024-09-19T04:37:08.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3f9f5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c38101de0 0x7f6c38198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3f9f5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 0x7f6c38198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3f9f5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c38106f10 0x7f6c3819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3f9f5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38111f40 con 0x7f6c38102790 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3f9f5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c38111dc0 con 0x7f6c38101de0 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3f9f5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381120c0 con 0x7f6c38106f10 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3cf90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 0x7f6c38198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3cf90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 0x7f6c38198980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55016/0 (socket says 172.21.15.70:55016) 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3cf90640 1 -- 172.21.15.70:0/3597066435 learned_addr learned my addr 172.21.15.70:0/3597066435 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3d791640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c38101de0 0x7f6c38198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3df92640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c38106f10 0x7f6c3819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3cf90640 1 -- 172.21.15.70:0/3597066435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c38106f10 msgr2=0x7f6c3819cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c38106f10 0x7f6c3819cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3cf90640 1 -- 172.21.15.70:0/3597066435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c38101de0 msgr2=0x7f6c38198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c38101de0 0x7f6c38198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3cf90640 1 -- 172.21.15.70:0/3597066435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c3819d3f0 con 0x7f6c38102790 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.272+0000 7f6c3df92640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c38106f10 0x7f6c3819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.273+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 0x7f6c38198980 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6c280314b0 tx=0x7f6c28004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.273+0000 7f6c2e7fc640 1 -- 172.21.15.70:0/3597066435 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c2803f030 con 0x7f6c38102790 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.273+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3597066435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c3819d680 con 0x7f6c38102790 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.273+0000 7f6c2e7fc640 1 -- 172.21.15.70:0/3597066435 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c28003ac0 con 0x7f6c38102790 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.273+0000 7f6c2e7fc640 1 -- 172.21.15.70:0/3597066435 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28035070 con 0x7f6c38102790 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.273+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3597066435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c381a4fc0 con 0x7f6c38102790 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.275+0000 7f6c2e7fc640 1 -- 172.21.15.70:0/3597066435 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6c28042030 con 0x7f6c38102790 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c41dce740 1 Processor -- start 2024-09-19T04:37:08.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c41dce740 1 -- start start 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485ae4a0 0x55c7485ae880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485b9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485b9680 0x55c7485bba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c41dce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c7485142e0 con 0x55c7485aedc0 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c41dce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c7484bbce0 con 0x55c7485b9680 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c41dce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c7485102a0 con 0x55c7485ae4a0 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c2e7fc640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c240a33b0 0x7f6c240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3d791640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485b9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3d791640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485b9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55018/0 (socket says 172.21.15.70:55018) 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3d791640 1 -- 172.21.15.70:0/93451784 learned_addr learned my addr 172.21.15.70:0/93451784 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3df92640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c240a33b0 0x7f6c240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3df92640 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485ae4a0 0x55c7485ae880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c2e7fc640 1 -- 172.21.15.70:0/3597066435 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f6c280f0360 con 0x7f6c38102790 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485b9680 0x55c7485bba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3d791640 1 -- 172.21.15.70:0/93451784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485ae4a0 msgr2=0x55c7485ae880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3d791640 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485ae4a0 0x55c7485ae880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3d791640 1 -- 172.21.15.70:0/93451784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485b9680 msgr2=0x55c7485bba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3d791640 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485b9680 0x55c7485bba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3d791640 1 -- 172.21.15.70:0/93451784 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7484a0440 con 0x55c7485aedc0 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.276+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485b9680 0x55c7485bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.277+0000 7f6c3df92640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c240a33b0 0x7f6c240a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6c30012a10 tx=0x7f6c3000a2f0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.277+0000 7f6c3d791640 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485b9140 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400bcf0 tx=0x7f6c3400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35379cc9574f28a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.277+0000 7f6c237fe640 1 -- 172.21.15.70:0/93451784 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34015070 con 0x55c7485aedc0 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.277+0000 7f6c237fe640 1 -- 172.21.15.70:0/93451784 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c34011910 con 0x55c7485aedc0 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.277+0000 7f6c237fe640 1 -- 172.21.15.70:0/93451784 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c34010920 con 0x55c7485aedc0 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.278+0000 7f6c41dce740 1 -- 172.21.15.70:0/93451784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 msgr2=0x55c7485b9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.278+0000 7f6c41dce740 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485b9140 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f6c3400bcf0 tx=0x7f6c3400f730 comp rx=0 tx=0).stop 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.278+0000 7f6c41dce740 1 -- 172.21.15.70:0/93451784 shutdown_connections 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.278+0000 7f6c41dce740 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485b9680 0x55c7485bba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.278+0000 7f6c41dce740 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485b9140 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.278+0000 7f6c41dce740 1 --2- 172.21.15.70:0/93451784 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485ae4a0 0x55c7485ae880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.278+0000 7f6c41dce740 1 -- 172.21.15.70:0/93451784 >> 172.21.15.70:0/93451784 conn(0x55c7485aaa30 msgr2=0x55c7485aae10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.280+0000 7f6c41dce740 1 -- 172.21.15.70:0/93451784 shutdown_connections 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.281+0000 7f6c41dce740 1 -- 172.21.15.70:0/93451784 wait complete. 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.282+0000 7f6c41dce740 1 -- start start 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.282+0000 7f6c41dce740 1 Processor -- start 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.282+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c7485b8f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.282+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aedc0 0x55c7485b6210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.282+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485b9680 0x55c7485b6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c41dce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55c7485bc250 con 0x55c7485ae4a0 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c41dce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55c7484cf050 con 0x55c7485aedc0 2024-09-19T04:37:08.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c41dce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55c7485bc3d0 con 0x55c7485b9680 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c41dce740 10 client.0 _ll_register_callbacks cb 0x55c74850f160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3df92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485b9680 0x55c7485b6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3df92640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485b9680 0x55c7485b6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:57142/0 (socket says 172.21.15.70:57142) 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3df92640 1 -- 172.21.15.70:0/3146592657 learned_addr learned my addr 172.21.15.70:0/3146592657 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3d791640 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c7485b8f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aedc0 0x55c7485b6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3df92640 1 -- 172.21.15.70:0/3146592657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aedc0 msgr2=0x55c7485b6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3df92640 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aedc0 0x55c7485b6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3df92640 1 -- 172.21.15.70:0/3146592657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 msgr2=0x55c7485b8f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3df92640 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c7485b8f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.283+0000 7f6c3df92640 1 -- 172.21.15.70:0/3146592657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c7482853c0 con 0x55c7485b9680 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c3df92640 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485b9680 0x55c7485b6750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c300124a0 tx=0x7f6c30004ab0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=80554f4140397af8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.167:3300/0 2024-09-19T04:37:08.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c20ff9640 1 -- 172.21.15.70:0/3146592657 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30010e20 con 0x55c7485b9680 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 1 -- 172.21.15.70:0/3146592657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c34011910 con 0x55c7485b9680 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c20ff9640 1 -- 172.21.15.70:0/3146592657 <== mon.1 v2:172.21.15.167:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f6c3001e450 con 0x55c7485b9680 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c20ff9640 1 -- 172.21.15.70:0/3146592657 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6c3001e650 con 0x55c7485b9680 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 10 client.25909 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 1 -- 172.21.15.70:0/3146592657 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c7485c7c20 con 0x55c7485b9680 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c20ff9640 1 -- 172.21.15.70:0/3146592657 <== mon.1 v2:172.21.15.167:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c34011910 con 0x55c7485b9680 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c20ff9640 1 -- 172.21.15.70:0/3146592657 <== mon.1 v2:172.21.15.167:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6c3001b040 con 0x55c7485b9680 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 10 client.25909 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 10 client.25909 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 20 client.25909 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c7485c9030 0x55c7485cb440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 4 client.25909 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.284+0000 7f6c41dce740 1 -- 172.21.15.70:0/3146592657 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c748521850 con 0x55c7485c9030 2024-09-19T04:37:08.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.285+0000 7f6c3d791640 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c7485c9030 0x55c7485cb440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.285+0000 7f6c3d791640 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c7485c9030 0x55c7485cb440 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cd5cf30aed404552 server_cookie=c7c01f938db4f885 in_seq=0 out_seq=0 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.285+0000 7f6c20ff9640 10 client.25909 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c20ff9640 1 -- 172.21.15.70:0/3146592657 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55c748521850 con 0x55c7485c9030 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c20ff9640 10 client.25909 handle_command_reply: tid=0 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 client.25909 shutdown 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 -- 172.21.15.70:0/3146592657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485b9680 msgr2=0x55c7485b6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485b9680 0x55c7485b6750 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6c300124a0 tx=0x7f6c30004ab0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 -- 172.21.15.70:0/3146592657 shutdown_connections 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c7485c9030 0x55c7485cb440 crc :-1 s=READY pgs=130 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485b9680 0x55c7485b6750 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aedc0 0x55c7485b6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 --2- 172.21.15.70:0/3146592657 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c7485b8f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c20ff9640 0 client.25909 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:08.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 -- 172.21.15.70:0/3146592657 >> 172.21.15.70:0/3146592657 conn(0x55c7485aaa30 msgr2=0x55c7485b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:08.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 -- 172.21.15.70:0/3146592657 shutdown_connections 2024-09-19T04:37:08.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 1 -- 172.21.15.70:0/3146592657 wait complete. 2024-09-19T04:37:08.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.286+0000 7f6c41dce740 20 client.25909 trim_cache size 0 max 16384 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.303+0000 7f6c41dce740 1 Processor -- start 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.303+0000 7f6c41dce740 1 -- start start 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.303+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aaa30 0x55c7485b8180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.303+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485ae4a0 0x55c7485c1a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.303+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485c1f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.303+0000 7f6c41dce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381b0180 con 0x55c7485aedc0 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.303+0000 7f6c41dce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381ada50 con 0x55c7485ae4a0 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.303+0000 7f6c41dce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381ab8c0 con 0x55c7485aaa30 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485c1f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485c1f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55042/0 (socket says 172.21.15.70:55042) 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 -- 172.21.15.70:0/2356545769 learned_addr learned my addr 172.21.15.70:0/2356545769 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485ae4a0 0x55c7485c1a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3d791640 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aaa30 0x55c7485b8180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 -- 172.21.15.70:0/2356545769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aaa30 msgr2=0x55c7485b8180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aaa30 0x55c7485b8180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 -- 172.21.15.70:0/2356545769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485ae4a0 msgr2=0x55c7485c1a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485ae4a0 0x55c7485c1a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 -- 172.21.15.70:0/2356545769 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c7485cbac0 con 0x55c7485aedc0 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c3df92640 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485c1f40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6c30000f80 tx=0x7f6c300108e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ddacb33973ab94f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c22ffd640 1 -- 172.21.15.70:0/2356545769 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c30040070 con 0x55c7485aedc0 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c22ffd640 1 -- 172.21.15.70:0/2356545769 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c3000a4a0 con 0x55c7485aedc0 2024-09-19T04:37:08.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.304+0000 7f6c22ffd640 1 -- 172.21.15.70:0/2356545769 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c3001ea50 con 0x55c7485aedc0 2024-09-19T04:37:08.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 -- 172.21.15.70:0/2356545769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 msgr2=0x55c7485c1f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485c1f40 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f6c30000f80 tx=0x7f6c300108e0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 -- 172.21.15.70:0/2356545769 shutdown_connections 2024-09-19T04:37:08.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485aedc0 0x55c7485c1f40 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485ae4a0 0x55c7485c1a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 --2- 172.21.15.70:0/2356545769 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aaa30 0x55c7485b8180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 -- 172.21.15.70:0/2356545769 >> 172.21.15.70:0/2356545769 conn(0x55c7485b68b0 msgr2=0x55c7485b7a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 -- 172.21.15.70:0/2356545769 shutdown_connections 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 -- 172.21.15.70:0/2356545769 wait complete. 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 -- start start 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.305+0000 7f6c41dce740 1 Processor -- start 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aaa30 0x55c74862b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c74862b610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c41dce740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aedc0 0x55c74862f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c41dce740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381abf10 con 0x55c7485ae4a0 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c41dce740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381ad380 con 0x55c7485aaa30 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c41dce740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6c381ac5e0 con 0x55c7485aedc0 2024-09-19T04:37:08.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c41dce740 10 client.0 _ll_register_callbacks cb 0x7f6c3000a990 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c74862b610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c74862b610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55050/0 (socket says 172.21.15.70:55050) 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 -- 172.21.15.70:0/1560629120 learned_addr learned my addr 172.21.15.70:0/1560629120 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3d791640 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aaa30 0x55c74862b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3df92640 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aedc0 0x55c74862f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 -- 172.21.15.70:0/1560629120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aedc0 msgr2=0x55c74862f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aedc0 0x55c74862f6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 -- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aaa30 msgr2=0x55c74862b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aaa30 0x55c74862b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 -- 172.21.15.70:0/1560629120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c74862fd80 con 0x55c7485ae4a0 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3d791640 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aaa30 0x55c74862b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c3cf90640 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c74862b610 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6c280edae0 tx=0x7f6c280bc030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9bdfe72aa23d615 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.306+0000 7f6c20ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:08.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c20ff9640 1 -- 172.21.15.70:0/1560629120 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c28049040 con 0x55c7485ae4a0 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c20ff9640 1 -- 172.21.15.70:0/1560629120 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f6c28003c70 con 0x55c7485ae4a0 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 1 -- 172.21.15.70:0/1560629120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c3000a4a0 con 0x55c7485ae4a0 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c20ff9640 1 -- 172.21.15.70:0/1560629120 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6c280bcd10 con 0x55c7485ae4a0 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 10 client.16722 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 1 -- 172.21.15.70:0/1560629120 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55c748638380 con 0x55c7485ae4a0 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c20ff9640 1 -- 172.21.15.70:0/1560629120 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c3000a4a0 con 0x55c7485ae4a0 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c20ff9640 1 -- 172.21.15.70:0/1560629120 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6c280b8c80 con 0x55c7485ae4a0 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 10 client.16722 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 10 client.16722 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 20 client.16722 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c7485b9680 0x55c74863ab40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:08.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 4 client.16722 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c41dce740 1 -- 172.21.15.70:0/1560629120 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55c74851bd60 con 0x55c7485b9680 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.307+0000 7f6c3d791640 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c7485b9680 0x55c74863ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c3d791640 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c7485b9680 0x55c74863ab40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2b52f0abf75b337 server_cookie=8407785d7cc2f680 in_seq=0 out_seq=0 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c20ff9640 10 client.16722 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c20ff9640 1 -- 172.21.15.70:0/1560629120 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55c74851bd60 con 0x55c7485b9680 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c20ff9640 10 client.16722 handle_command_reply: tid=0 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 client.16722 shutdown 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 -- 172.21.15.70:0/1560629120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 msgr2=0x55c74862b610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c74862b610 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f6c280edae0 tx=0x7f6c280bc030 comp rx=0 tx=0).stop 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 -- 172.21.15.70:0/1560629120 shutdown_connections 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55c7485b9680 0x55c74863ab40 crc :-1 s=READY pgs=131 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55c7485aedc0 0x55c74862f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55c7485ae4a0 0x55c74862b610 unknown :-1 s=CLOSED pgs=825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 --2- 172.21.15.70:0/1560629120 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55c7485aaa30 0x55c74862b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 -- 172.21.15.70:0/1560629120 >> 172.21.15.70:0/1560629120 conn(0x55c7485b68b0 msgr2=0x55c7485b46b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c20ff9640 0 client.16722 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 -- 172.21.15.70:0/1560629120 shutdown_connections 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 1 -- 172.21.15.70:0/1560629120 wait complete. 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.308+0000 7f6c41dce740 20 client.16722 trim_cache size 0 max 16384 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:37:08.317 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c240a33b0 msgr2=0x7f6c240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c240a33b0 0x7f6c240a5870 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6c30012a10 tx=0x7f6c3000a2f0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 msgr2=0x7f6c38198980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 0x7f6c38198980 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f6c280314b0 tx=0x7f6c28004270 comp rx=0 tx=0).stop 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3597066435 shutdown_connections 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c240a33b0 0x7f6c240a5870 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6c38106f10 0x7f6c3819cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6c38102790 0x7f6c38198980 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 --2- 172.21.15.70:0/3597066435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6c38101de0 0x7f6c38198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:08.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3597066435 >> 172.21.15.70:0/3597066435 conn(0x7f6c380fd8c0 msgr2=0x7f6c380feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:08.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3597066435 shutdown_connections 2024-09-19T04:37:08.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:08.309+0000 7f6c3f9f5640 1 -- 172.21.15.70:0/3597066435 wait complete. 2024-09-19T04:37:08.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:08 smithi167 ceph-mon[34339]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:37:08.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:08 smithi167 ceph-mon[34339]: pgmap v195: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T04:37:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:08 smithi134 ceph-mon[34525]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:37:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:08 smithi134 ceph-mon[34525]: pgmap v195: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T04:37:09.085 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:08 smithi070 ceph-mon[30942]: osdmap e85: 12 total, 12 up, 12 in 2024-09-19T04:37:09.085 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:08 smithi070 ceph-mon[30942]: pgmap v195: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T04:37:09.113 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:37:09.113 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:37:09.356 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 -- 172.21.15.70:0/4191996011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14102dd0 msgr2=0x7fdb141031b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:09.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 --2- 172.21.15.70:0/4191996011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14102dd0 0x7fdb141031b0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7fdb04009930 tx=0x7fdb0402a440 comp rx=0 tx=0).stop 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 -- 172.21.15.70:0/4191996011 shutdown_connections 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 --2- 172.21.15.70:0/4191996011 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14108300 0x7fdb1410ec70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 --2- 172.21.15.70:0/4191996011 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb14103780 0x7fdb14107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 --2- 172.21.15.70:0/4191996011 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14102dd0 0x7fdb141031b0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 -- 172.21.15.70:0/4191996011 >> 172.21.15.70:0/4191996011 conn(0x7fdb140fc7d0 msgr2=0x7fdb140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 -- 172.21.15.70:0/4191996011 shutdown_connections 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 -- 172.21.15.70:0/4191996011 wait complete. 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 Processor -- start 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.841+0000 7fdb1a042640 1 -- start start 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb1a042640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102dd0 0x7fdb14100a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb1a042640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb14103780 0x7fdb14100f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:09.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb1a042640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14108300 0x7fdb141014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb1a042640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14112160 con 0x7fdb14108300 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb1a042640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdb14111fe0 con 0x7fdb14102dd0 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb1a042640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdb141122e0 con 0x7fdb14103780 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14108300 0x7fdb141014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14108300 0x7fdb141014b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55060/0 (socket says 172.21.15.70:55060) 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 -- 172.21.15.70:0/473070277 learned_addr learned my addr 172.21.15.70:0/473070277 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb137fe640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102dd0 0x7fdb14100a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb0affd640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb14103780 0x7fdb14100f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 -- 172.21.15.70:0/473070277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb14103780 msgr2=0x7fdb14100f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb14103780 0x7fdb14100f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 -- 172.21.15.70:0/473070277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102dd0 msgr2=0x7fdb14100a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102dd0 0x7fdb14100a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:09.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 -- 172.21.15.70:0/473070277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdb141a6c70 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb13fff640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14108300 0x7fdb141014b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00b970 tx=0x7fdb0c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb117fa640 1 -- 172.21.15.70:0/473070277 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c019070 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb117fa640 1 -- 172.21.15.70:0/473070277 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdb0c00cb40 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb117fa640 1 -- 172.21.15.70:0/473070277 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdb0c007650 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.842+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdb141a6f60 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.843+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdb141a7410 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.843+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdb1406a7b0 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.845+0000 7fdb117fa640 1 -- 172.21.15.70:0/473070277 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdb0c01c070 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.846+0000 7fdb117fa640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdb000a33b0 0x7fdb000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.846+0000 7fdb137fe640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdb000a33b0 0x7fdb000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.846+0000 7fdb117fa640 1 -- 172.21.15.70:0/473070277 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7fdb0c0cf660 con 0x7fdb14108300 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.846+0000 7fdb137fe640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdb000a33b0 0x7fdb000a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb04005ec0 tx=0x7fdb040058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:09.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:09.849+0000 7fdb117fa640 1 -- 172.21.15.70:0/473070277 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fdb0c09bad0 con 0x7fdb14108300 2024-09-19T04:37:10.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.052+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fdb14103230 con 0x7fdb14108300 2024-09-19T04:37:10.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.053+0000 7fdb117fa640 1 -- 172.21.15.70:0/473070277 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7fdb0c09fdd0 con 0x7fdb14108300 2024-09-19T04:37:10.055 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:37:10.055 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:37:10.055 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdb000a33b0 msgr2=0x7fdb000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdb000a33b0 0x7fdb000a5870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fdb04005ec0 tx=0x7fdb040058d0 comp rx=0 tx=0).stop 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14108300 msgr2=0x7fdb141014b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14108300 0x7fdb141014b0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c00b970 tx=0x7fdb0c00be30 comp rx=0 tx=0).stop 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 shutdown_connections 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdb000a33b0 0x7fdb000a5870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdb14108300 0x7fdb141014b0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdb14103780 0x7fdb14100f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 --2- 172.21.15.70:0/473070277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb14102dd0 0x7fdb14100a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:10.057 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 >> 172.21.15.70:0/473070277 conn(0x7fdb140fc7d0 msgr2=0x7fdb14105f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:10.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 shutdown_connections 2024-09-19T04:37:10.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:10.055+0000 7fdb1a042640 1 -- 172.21.15.70:0/473070277 wait complete. 2024-09-19T04:37:10.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:10 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/473070277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:10.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:10 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/473070277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:10.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:10 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/473070277' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:10.713 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:37:10.958 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:11.355 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:11 smithi070 ceph-mon[30942]: pgmap v196: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T04:37:11.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:11 smithi167 ceph-mon[34339]: pgmap v196: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T04:37:11.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.435+0000 7f09de9f4640 1 -- 172.21.15.70:0/706903946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8106f10 msgr2=0x7f09d810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.435+0000 7f09de9f4640 1 --2- 172.21.15.70:0/706903946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8106f10 0x7f09d810ea90 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f09d0009ca0 tx=0x7f09d002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.435+0000 7f09de9f4640 1 -- 172.21.15.70:0/706903946 shutdown_connections 2024-09-19T04:37:11.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.435+0000 7f09de9f4640 1 --2- 172.21.15.70:0/706903946 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8106f10 0x7f09d810ea90 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.435+0000 7f09de9f4640 1 --2- 172.21.15.70:0/706903946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8102790 0x7f09d81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.435+0000 7f09de9f4640 1 --2- 172.21.15.70:0/706903946 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09d8101de0 0x7f09d81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.435+0000 7f09de9f4640 1 -- 172.21.15.70:0/706903946 >> 172.21.15.70:0/706903946 conn(0x7f09d80fd8c0 msgr2=0x7f09d80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 -- 172.21.15.70:0/706903946 shutdown_connections 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 -- 172.21.15.70:0/706903946 wait complete. 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 Processor -- start 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 -- start start 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8101de0 0x7f09d80744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8102790 0x7f09d8074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09d8106f10 0x7f09d8074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09d8111f40 con 0x7f09d8102790 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09d8111dc0 con 0x7f09d8101de0 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.436+0000 7f09de9f4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f09d81120c0 con 0x7f09d8106f10 2024-09-19T04:37:11.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8102790 0x7f09d8074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8102790 0x7f09d8074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55090/0 (socket says 172.21.15.70:55090) 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 -- 172.21.15.70:0/2839439705 learned_addr learned my addr 172.21.15.70:0/2839439705 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d7fff640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8101de0 0x7f09d80744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09dcf91640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09d8106f10 0x7f09d8074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 -- 172.21.15.70:0/2839439705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09d8106f10 msgr2=0x7f09d8074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09d8106f10 0x7f09d8074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 -- 172.21.15.70:0/2839439705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8101de0 msgr2=0x7f09d80744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8101de0 0x7f09d80744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 -- 172.21.15.70:0/2839439705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09d81a68e0 con 0x7f09d8102790 2024-09-19T04:37:11.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d77fe640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8102790 0x7f09d8074a30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00e9f0 tx=0x7f09cc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d57fa640 1 -- 172.21.15.70:0/2839439705 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc00cd80 con 0x7f09d8102790 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09de9f4640 1 -- 172.21.15.70:0/2839439705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09d81a6bd0 con 0x7f09d8102790 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d57fa640 1 -- 172.21.15.70:0/2839439705 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f09cc010900 con 0x7f09d8102790 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09d57fa640 1 -- 172.21.15.70:0/2839439705 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0189e0 con 0x7f09d8102790 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.437+0000 7f09de9f4640 1 -- 172.21.15.70:0/2839439705 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09d81a7160 con 0x7f09d8102790 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.439+0000 7f09d57fa640 1 -- 172.21.15.70:0/2839439705 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f09cc010ab0 con 0x7f09d8102790 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09e0dcd740 1 Processor -- start 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09e0dcd740 1 -- start start 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab0090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab0a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1abb370 0x55a0c1abd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a0c1a162f0 con 0x55a0c1ab1b40 2024-09-19T04:37:11.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0c19bdcf0 con 0x55a0c1abb370 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a0c1a122b0 con 0x55a0c1ab05d0 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09d57fa640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09c00a33b0 0x7f09c00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09dcf91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab0090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09dcf91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab0090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55106/0 (socket says 172.21.15.70:55106) 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09dcf91640 1 -- 172.21.15.70:0/1653393929 learned_addr learned my addr 172.21.15.70:0/1653393929 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09dcf91640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09c00a33b0 0x7f09c00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09d7fff640 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab0a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09d57fa640 1 -- 172.21.15.70:0/2839439705 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f09cc0cfff0 con 0x7f09d8102790 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.440+0000 7f09d77fe640 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1abb370 0x55a0c1abd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09dcf91640 1 -- 172.21.15.70:0/1653393929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1ab05d0 msgr2=0x55a0c1ab0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09dcf91640 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab0a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09dcf91640 1 -- 172.21.15.70:0/1653393929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1abb370 msgr2=0x55a0c1abd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09dcf91640 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1abb370 0x55a0c1abd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09dcf91640 1 -- 172.21.15.70:0/1653393929 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c19a23a0 con 0x55a0c1ab1b40 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09dcf91640 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab0090 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f09d0004ab0 tx=0x7f09d0003bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e92adf4556a89a40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09dcf91640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09c00a33b0 0x7f09c00a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f09d0035000 tx=0x7f09d003b000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09be7fc640 1 -- 172.21.15.70:0/1653393929 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d004e070 con 0x55a0c1ab1b40 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09be7fc640 1 -- 172.21.15.70:0/1653393929 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f09d0036040 con 0x55a0c1ab1b40 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.441+0000 7f09be7fc640 1 -- 172.21.15.70:0/1653393929 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09d0004830 con 0x55a0c1ab1b40 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1653393929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 msgr2=0x55a0c1ab0090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab0090 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f09d0004ab0 tx=0x7f09d0003bb0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1653393929 shutdown_connections 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1abb370 0x55a0c1abd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab0a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1653393929 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab0090 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1653393929 >> 172.21.15.70:0/1653393929 conn(0x55a0c1a79310 msgr2=0x55a0c1aacc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1653393929 shutdown_connections 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1653393929 wait complete. 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 -- start start 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.442+0000 7f09e0dcd740 1 Processor -- start 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1abad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ab8640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a0c1abde90 con 0x55a0c1ab05d0 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a0c19d1060 con 0x55a0c1ab1b40 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a0c1abe010 con 0x55a0c1abb370 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09e0dcd740 10 client.0 _ll_register_callbacks cb 0x55a0c17248c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:11.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1abad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1abad80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55108/0 (socket says 172.21.15.70:55108) 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 -- 172.21.15.70:0/1892585225 learned_addr learned my addr 172.21.15.70:0/1892585225 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d77fe640 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09dcf91640 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ab8640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 -- 172.21.15.70:0/1892585225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 msgr2=0x55a0c1ab8640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ab8640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 -- 172.21.15.70:0/1892585225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 msgr2=0x55a0c1ab8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 -- 172.21.15.70:0/1892585225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c17873c0 con 0x55a0c1ab05d0 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d77fe640 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:11.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09d7fff640 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1abad80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f09c8010820 tx=0x7f09c8010ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91898439706c05f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09b77fe640 1 -- 172.21.15.70:0/1892585225 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c801e060 con 0x55a0c1ab05d0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09b77fe640 1 -- 172.21.15.70:0/1892585225 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f09c800fb10 con 0x55a0c1ab05d0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.443+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1892585225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09d0036040 con 0x55a0c1ab05d0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09b77fe640 1 -- 172.21.15.70:0/1892585225 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f09c800fd50 con 0x55a0c1ab05d0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09e0dcd740 10 client.16740 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1892585225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a0c1ac9a10 con 0x55a0c1ab05d0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09b77fe640 1 -- 172.21.15.70:0/1892585225 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f09d0036040 con 0x55a0c1ab05d0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09b77fe640 1 -- 172.21.15.70:0/1892585225 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f09c800e540 con 0x55a0c1ab05d0 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09e0dcd740 10 client.16740 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09e0dcd740 10 client.16740 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09e0dcd740 20 client.16740 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:11.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a0c1acaed0 0x55a0c1acd300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09e0dcd740 4 client.16740 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1892585225 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a0c1a23860 con 0x55a0c1acaed0 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.444+0000 7f09d77fe640 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a0c1acaed0 0x55a0c1acd300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.445+0000 7f09b77fe640 10 client.16740 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.445+0000 7f09d77fe640 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a0c1acaed0 0x55a0c1acd300 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5b3a3374a72922ff server_cookie=f69ae9e60e7c1d93 in_seq=0 out_seq=0 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.445+0000 7f09b77fe640 1 -- 172.21.15.70:0/1892585225 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a0c1a23860 con 0x55a0c1acaed0 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.445+0000 7f09b77fe640 10 client.16740 handle_command_reply: tid=0 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.445+0000 7f09e0dcd740 1 client.16740 shutdown 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1892585225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 msgr2=0x55a0c1abad80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1abad80 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7f09c8010820 tx=0x7f09c8010ce0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1892585225 shutdown_connections 2024-09-19T04:37:11.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a0c1acaed0 0x55a0c1acd300 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ab8640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09b77fe640 0 client.16740 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:11.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/1892585225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1abad80 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1892585225 >> 172.21.15.70:0/1892585225 conn(0x55a0c1a79310 msgr2=0x55a0c1ab2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:11.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1892585225 shutdown_connections 2024-09-19T04:37:11.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 1 -- 172.21.15.70:0/1892585225 wait complete. 2024-09-19T04:37:11.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.446+0000 7f09e0dcd740 20 client.16740 trim_cache size 0 max 16384 2024-09-19T04:37:11.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.458+0000 7f09e0dcd740 1 Processor -- start 2024-09-19T04:37:11.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.458+0000 7f09e0dcd740 1 -- start start 2024-09-19T04:37:11.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.458+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ad2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09d81b2360 con 0x55a0c1ab05d0 2024-09-19T04:37:11.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09d81afc30 con 0x55a0c1ab1b40 2024-09-19T04:37:11.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f09d81adaa0 con 0x55a0c1abb370 2024-09-19T04:37:11.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55112/0 (socket says 172.21.15.70:55112) 2024-09-19T04:37:11.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 -- 172.21.15.70:0/3637268819 learned_addr learned my addr 172.21.15.70:0/3637268819 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:11.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09dcf91640 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ad2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d77fe640 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 -- 172.21.15.70:0/3637268819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 msgr2=0x55a0c1ad2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ad2bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 -- 172.21.15.70:0/3637268819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 msgr2=0x55a0c1ab3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 -- 172.21.15.70:0/3637268819 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0c1aad960 con 0x55a0c1ab05d0 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09dcf91640 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ad2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09d7fff640 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab3120 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f09c800f010 tx=0x7f09c8005670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=335721c7ed79d3c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:11.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09bdffb640 1 -- 172.21.15.70:0/3637268819 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c8030070 con 0x55a0c1ab05d0 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09bdffb640 1 -- 172.21.15.70:0/3637268819 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f09c800a2c0 con 0x55a0c1ab05d0 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.459+0000 7f09bdffb640 1 -- 172.21.15.70:0/3637268819 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09c802ba80 con 0x55a0c1ab05d0 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 -- 172.21.15.70:0/3637268819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 msgr2=0x55a0c1ab3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab3120 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f09c800f010 tx=0x7f09c8005670 comp rx=0 tx=0).stop 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 -- 172.21.15.70:0/3637268819 shutdown_connections 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ad2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/3637268819 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab3120 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 -- 172.21.15.70:0/3637268819 >> 172.21.15.70:0/3637268819 conn(0x55a0c1a79310 msgr2=0x55a0c1aabd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 -- 172.21.15.70:0/3637268819 shutdown_connections 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 -- 172.21.15.70:0/3637268819 wait complete. 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 -- start start 2024-09-19T04:37:11.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.460+0000 7f09e0dcd740 1 Processor -- start 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab5260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab57a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ab5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09d81ae0f0 con 0x55a0c1ab1b40 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09d81af560 con 0x55a0c1ab05d0 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f09d81ae7c0 con 0x55a0c1abb370 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 10 client.0 _ll_register_callbacks cb 0x7f09c800a6c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab57a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55114/0 (socket says 172.21.15.70:55114) 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 -- 172.21.15.70:0/2753965836 learned_addr learned my addr 172.21.15.70:0/2753965836 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09dcf91640 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ab5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 -- 172.21.15.70:0/2753965836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 msgr2=0x55a0c1ab5ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:11.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ab5ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 -- 172.21.15.70:0/2753965836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab05d0 msgr2=0x55a0c1ab5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 -- 172.21.15.70:0/2753965836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0c1b34da0 con 0x55a0c1ab1b40 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09d77fe640 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab57a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0cd7c0 tx=0x7f09cc0cf040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=620f28df1a4d9a4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09b77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09b77fe640 1 -- 172.21.15.70:0/2753965836 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09cc0cde60 con 0x55a0c1ab1b40 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09b77fe640 1 -- 172.21.15.70:0/2753965836 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f09cc0cd990 con 0x55a0c1ab1b40 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 1 -- 172.21.15.70:0/2753965836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f09c800a2c0 con 0x55a0c1ab1b40 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09b77fe640 1 -- 172.21.15.70:0/2753965836 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f09cc0b5260 con 0x55a0c1ab1b40 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.461+0000 7f09e0dcd740 10 client.16746 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09e0dcd740 1 -- 172.21.15.70:0/2753965836 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a0c1b35ff0 con 0x55a0c1ab1b40 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09b77fe640 1 -- 172.21.15.70:0/2753965836 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f09c800a2c0 con 0x55a0c1ab1b40 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09b77fe640 1 -- 172.21.15.70:0/2753965836 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f09cc018b80 con 0x55a0c1ab1b40 2024-09-19T04:37:11.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09e0dcd740 10 client.16746 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09e0dcd740 10 client.16746 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09e0dcd740 20 client.16746 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a0c1b36750 0x55a0c1b38b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09e0dcd740 4 client.16746 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09e0dcd740 1 -- 172.21.15.70:0/2753965836 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a0c1a1dd70 con 0x55a0c1b36750 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09d7fff640 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a0c1b36750 0x55a0c1b38b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09d7fff640 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a0c1b36750 0x55a0c1b38b40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fd08b49698f14e56 server_cookie=a02910894f579413 in_seq=0 out_seq=0 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.462+0000 7f09b77fe640 10 client.16746 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09b77fe640 1 -- 172.21.15.70:0/2753965836 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a0c1a1dd70 con 0x55a0c1b36750 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09b77fe640 10 client.16746 handle_command_reply: tid=0 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 client.16746 shutdown 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 -- 172.21.15.70:0/2753965836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 msgr2=0x55a0c1ab57a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab57a0 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f09cc0cd7c0 tx=0x7f09cc0cf040 comp rx=0 tx=0).stop 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 -- 172.21.15.70:0/2753965836 shutdown_connections 2024-09-19T04:37:11.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a0c1b36750 0x55a0c1b38b40 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a0c1abb370 0x55a0c1ab5ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a0c1ab1b40 0x55a0c1ab57a0 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 --2- 172.21.15.70:0/2753965836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a0c1ab05d0 0x55a0c1ab5260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 -- 172.21.15.70:0/2753965836 >> 172.21.15.70:0/2753965836 conn(0x55a0c1a79310 msgr2=0x55a0c1ab9890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09b77fe640 0 client.16746 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 -- 172.21.15.70:0/2753965836 shutdown_connections 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 1 -- 172.21.15.70:0/2753965836 wait complete. 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.463+0000 7f09e0dcd740 20 client.16746 trim_cache size 0 max 16384 2024-09-19T04:37:11.484 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:11.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 -- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09c00a33b0 msgr2=0x7f09c00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09c00a33b0 0x7f09c00a5870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f09d0035000 tx=0x7f09d003b000 comp rx=0 tx=0).stop 2024-09-19T04:37:11.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 -- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8102790 msgr2=0x7f09d8074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:11.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8102790 0x7f09d8074a30 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f09cc00e9f0 tx=0x7f09cc00eeb0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 -- 172.21.15.70:0/2839439705 shutdown_connections 2024-09-19T04:37:11.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09c00a33b0 0x7f09c00a5870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09d8106f10 0x7f09d8074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09d8102790 0x7f09d8074a30 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 --2- 172.21.15.70:0/2839439705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f09d8101de0 0x7f09d80744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:11.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 -- 172.21.15.70:0/2839439705 >> 172.21.15.70:0/2839439705 conn(0x7f09d80fd8c0 msgr2=0x7f09d80febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:11.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 -- 172.21.15.70:0/2839439705 shutdown_connections 2024-09-19T04:37:11.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:11.464+0000 7f09de9f4640 1 -- 172.21.15.70:0/2839439705 wait complete. 2024-09-19T04:37:11.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:11 smithi134 ceph-mon[34525]: pgmap v196: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 54 KiB/s wr, 26 op/s 2024-09-19T04:37:12.078 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:37:12.323 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:12.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.792+0000 7f1754070640 1 -- 172.21.15.70:0/2773487573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c106b70 msgr2=0x7f174c106f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.792+0000 7f1754070640 1 --2- 172.21.15.70:0/2773487573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c106b70 0x7f174c106f50 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f1748009900 tx=0x7f174802a410 comp rx=0 tx=0).stop 2024-09-19T04:37:12.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.792+0000 7f1754070640 1 -- 172.21.15.70:0/2773487573 shutdown_connections 2024-09-19T04:37:12.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.792+0000 7f1754070640 1 --2- 172.21.15.70:0/2773487573 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c100a50 0x7f174c1057e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.792+0000 7f1754070640 1 --2- 172.21.15.70:0/2773487573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f174c100090 0x7f174c100510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.792+0000 7f1754070640 1 --2- 172.21.15.70:0/2773487573 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c106b70 0x7f174c106f50 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.792+0000 7f1754070640 1 -- 172.21.15.70:0/2773487573 >> 172.21.15.70:0/2773487573 conn(0x7f174c077210 msgr2=0x7f174c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 -- 172.21.15.70:0/2773487573 shutdown_connections 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 -- 172.21.15.70:0/2773487573 wait complete. 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 Processor -- start 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 -- start start 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c100090 0x7f174c1a4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f174c100a50 0x7f174c1a4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c106b70 0x7f174c19e7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f174c118580 con 0x7f174c100090 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f174c118400 con 0x7f174c100a50 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1754070640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c118700 con 0x7f174c106b70 2024-09-19T04:37:12.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1751e0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c100090 0x7f174c1a4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1751e0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c100090 0x7f174c1a4670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55136/0 (socket says 172.21.15.70:55136) 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.793+0000 7f1751e0c640 1 -- 172.21.15.70:0/4056440275 learned_addr learned my addr 172.21.15.70:0/4056440275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f175260d640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c106b70 0x7f174c19e7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f175160b640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f174c100a50 0x7f174c1a4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1751e0c640 1 -- 172.21.15.70:0/4056440275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c106b70 msgr2=0x7f174c19e7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1751e0c640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c106b70 0x7f174c19e7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1751e0c640 1 -- 172.21.15.70:0/4056440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f174c100a50 msgr2=0x7f174c1a4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1751e0c640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f174c100a50 0x7f174c1a4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1751e0c640 1 -- 172.21.15.70:0/4056440275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f174c19ef90 con 0x7f174c100090 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f175160b640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f174c100a50 0x7f174c1a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1751e0c640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c100090 0x7f174c1a4670 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f17480314b0 tx=0x7f1748004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:12.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1742ffd640 1 -- 172.21.15.70:0/4056440275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f174803f030 con 0x7f174c100090 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1742ffd640 1 -- 172.21.15.70:0/4056440275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1748003ac0 con 0x7f174c100090 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1754070640 1 -- 172.21.15.70:0/4056440275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f174c19f220 con 0x7f174c100090 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1742ffd640 1 -- 172.21.15.70:0/4056440275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1748035070 con 0x7f174c100090 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.794+0000 7f1754070640 1 -- 172.21.15.70:0/4056440275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f174c1ab4d0 con 0x7f174c100090 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.796+0000 7f1742ffd640 1 -- 172.21.15.70:0/4056440275 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1748042030 con 0x7f174c100090 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1756449740 1 Processor -- start 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1756449740 1 -- start start 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1742ffd640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17380a33b0 0x7f17380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1756449740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd5b40 0x562b70dd4090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1756449740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd45d0 0x562b70dd4a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1756449740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70de1760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1756449740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562b70d3a2f0 con 0x562b70ddf370 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1756449740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b70ce1cf0 con 0x562b70dd5b40 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1756449740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562b70d362b0 con 0x562b70dd45d0 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f175260d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70de1760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1751e0c640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17380a33b0 0x7f17380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f175260d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70de1760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55152/0 (socket says 172.21.15.70:55152) 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f175260d640 1 -- 172.21.15.70:0/1453792834 learned_addr learned my addr 172.21.15.70:0/1453792834 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f1742ffd640 1 -- 172.21.15.70:0/4056440275 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f17480f04d0 con 0x7f174c100090 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f175160b640 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd45d0 0x562b70dd4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.797+0000 7f175260d640 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd5b40 0x562b70dd4090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f175260d640 1 -- 172.21.15.70:0/1453792834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd45d0 msgr2=0x562b70dd4a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f175260d640 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd45d0 0x562b70dd4a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f175260d640 1 -- 172.21.15.70:0/1453792834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd5b40 msgr2=0x562b70dd4090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f175260d640 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd5b40 0x562b70dd4090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f175260d640 1 -- 172.21.15.70:0/1453792834 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b70cc63a0 con 0x562b70ddf370 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f1751e0c640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17380a33b0 0x7f17380a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17480b8be0 tx=0x7f174802a410 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f175260d640 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70de1760 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1744009270 tx=0x7f1744009b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8ff05e579beefca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f1737fff640 1 -- 172.21.15.70:0/1453792834 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744012230 con 0x562b70ddf370 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f1737fff640 1 -- 172.21.15.70:0/1453792834 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1744003e40 con 0x562b70ddf370 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.798+0000 7f1737fff640 1 -- 172.21.15.70:0/1453792834 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744004350 con 0x562b70ddf370 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 -- 172.21.15.70:0/1453792834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 msgr2=0x562b70de1760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70de1760 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7f1744009270 tx=0x7f1744009b10 comp rx=0 tx=0).stop 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 -- 172.21.15.70:0/1453792834 shutdown_connections 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70de1760 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd45d0 0x562b70dd4a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 --2- 172.21.15.70:0/1453792834 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd5b40 0x562b70dd4090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 -- 172.21.15.70:0/1453792834 >> 172.21.15.70:0/1453792834 conn(0x562b70d9d310 msgr2=0x562b70dd0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 -- 172.21.15.70:0/1453792834 shutdown_connections 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 -- 172.21.15.70:0/1453792834 wait complete. 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 -- start start 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.799+0000 7f1756449740 1 Processor -- start 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f1756449740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 0x562b70dded70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f1756449740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70ddc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f1756449740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70ddc610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f1756449740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562b70de2070 con 0x562b70ddf370 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f1756449740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562b70cf5060 con 0x562b70dd45d0 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f1756449740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562b70de21f0 con 0x562b70dd5b40 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f1756449740 10 client.0 _ll_register_callbacks cb 0x562b70a488c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70ddc610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70ddc610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55154/0 (socket says 172.21.15.70:55154) 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 -- 172.21.15.70:0/2589368192 learned_addr learned my addr 172.21.15.70:0/2589368192 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175160b640 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70ddc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 0x562b70dded70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 -- 172.21.15.70:0/2589368192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 msgr2=0x562b70ddc020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70ddc020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 -- 172.21.15.70:0/2589368192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 msgr2=0x562b70dded70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 0x562b70dded70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 -- 172.21.15.70:0/2589368192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b70aab3c0 con 0x562b70ddf370 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f175260d640 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70ddc610 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f17440096d0 tx=0x7f1744012670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd716f41cebbbe97 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f17357fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:12.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f17357fa640 1 -- 172.21.15.70:0/2589368192 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744028040 con 0x562b70ddf370 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f17357fa640 1 -- 172.21.15.70:0/2589368192 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f1744003b70 con 0x562b70ddf370 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.800+0000 7f1756449740 1 -- 172.21.15.70:0/2589368192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x562b70d47860 con 0x562b70ddf370 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f17357fa640 1 -- 172.21.15.70:0/2589368192 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1744004810 con 0x562b70ddf370 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f1756449740 10 client.16758 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f1756449740 1 -- 172.21.15.70:0/2589368192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562b70dedb10 con 0x562b70ddf370 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f17357fa640 1 -- 172.21.15.70:0/2589368192 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x562b70d47860 con 0x562b70ddf370 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f17357fa640 1 -- 172.21.15.70:0/2589368192 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f174400f040 con 0x562b70ddf370 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f1756449740 10 client.16758 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f1756449740 10 client.16758 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f1756449740 20 client.16758 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f1756449740 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x562b70deee60 0x562b70df1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f1756449740 4 client.16758 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:12.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f1756449740 1 -- 172.21.15.70:0/2589368192 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562b70d41d70 con 0x562b70deee60 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.801+0000 7f175160b640 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x562b70deee60 0x562b70df1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.802+0000 7f175160b640 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x562b70deee60 0x562b70df1250 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=724ebac4545647cc server_cookie=4a5618ed8ba61000 in_seq=0 out_seq=0 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.802+0000 7f17357fa640 10 client.16758 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.802+0000 7f17357fa640 1 -- 172.21.15.70:0/2589368192 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562b70d41d70 con 0x562b70deee60 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.802+0000 7f17357fa640 10 client.16758 handle_command_reply: tid=0 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.802+0000 7f1756449740 1 client.16758 shutdown 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.802+0000 7f1756449740 1 -- 172.21.15.70:0/2589368192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 msgr2=0x562b70ddc610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.802+0000 7f1756449740 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70ddc610 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7f17440096d0 tx=0x7f1744012670 comp rx=0 tx=0).stop 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 1 -- 172.21.15.70:0/2589368192 shutdown_connections 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x562b70deee60 0x562b70df1250 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70ddc610 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70ddc020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f17357fa640 0 client.16758 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:12.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 1 --2- 172.21.15.70:0/2589368192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 0x562b70dded70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 1 -- 172.21.15.70:0/2589368192 >> 172.21.15.70:0/2589368192 conn(0x562b70d9d310 msgr2=0x562b70dd6960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:12.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 1 -- 172.21.15.70:0/2589368192 shutdown_connections 2024-09-19T04:37:12.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 1 -- 172.21.15.70:0/2589368192 wait complete. 2024-09-19T04:37:12.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.803+0000 7f1756449740 20 client.16758 trim_cache size 0 max 16384 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.815+0000 7f1756449740 1 Processor -- start 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f1756449740 1 -- start start 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f1756449740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70dd45d0 0x562b70dddf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f1756449740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd7120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f1756449740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70ddf370 0x562b70dd7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f1756449740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b6760 con 0x562b70dd45d0 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f1756449740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b4030 con 0x562b70ddf370 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f1756449740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b1ea0 con 0x562b70dd5b40 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70dd45d0 0x562b70dddf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70dd45d0 0x562b70dddf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55166/0 (socket says 172.21.15.70:55166) 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 -- 172.21.15.70:0/1521478009 learned_addr learned my addr 172.21.15.70:0/1521478009 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175160b640 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd7120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 -- 172.21.15.70:0/1521478009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 msgr2=0x562b70dd7120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd7120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 -- 172.21.15.70:0/1521478009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70ddf370 msgr2=0x562b70dd7660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70ddf370 0x562b70dd7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 -- 172.21.15.70:0/1521478009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562b70dde990 con 0x562b70dd45d0 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175160b640 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f175260d640 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70dd45d0 0x562b70dddf90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1744004350 tx=0x7f1744009e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=467f80239f6e83ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.816+0000 7f17377fe640 1 -- 172.21.15.70:0/1521478009 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744009700 con 0x562b70dd45d0 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f17377fe640 1 -- 172.21.15.70:0/1521478009 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1744005bd0 con 0x562b70dd45d0 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f17377fe640 1 -- 172.21.15.70:0/1521478009 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1744003970 con 0x562b70dd45d0 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 -- 172.21.15.70:0/1521478009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70dd45d0 msgr2=0x562b70dddf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70dd45d0 0x562b70dddf90 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f1744004350 tx=0x7f1744009e70 comp rx=0 tx=0).stop 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 -- 172.21.15.70:0/1521478009 shutdown_connections 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70ddf370 0x562b70dd7660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd7120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 --2- 172.21.15.70:0/1521478009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70dd45d0 0x562b70dddf90 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 -- 172.21.15.70:0/1521478009 >> 172.21.15.70:0/1521478009 conn(0x562b70d9d310 msgr2=0x562b70ddd880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 -- 172.21.15.70:0/1521478009 shutdown_connections 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 -- 172.21.15.70:0/1521478009 wait complete. 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.817+0000 7f1756449740 1 -- start start 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f1756449740 1 Processor -- start 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f1756449740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 0x562b70de7b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f1756449740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd8d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f1756449740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70dd9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.831 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f1756449740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b24f0 con 0x562b70ddf370 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f1756449740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b3960 con 0x562b70dd45d0 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f1756449740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f174c1b2bc0 con 0x562b70dd5b40 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f1756449740 10 client.0 _ll_register_callbacks cb 0x7f1744012700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f175260d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70dd9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f175260d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70dd9250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55172/0 (socket says 172.21.15.70:55172) 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f175260d640 1 -- 172.21.15.70:0/1914361681 learned_addr learned my addr 172.21.15.70:0/1914361681 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f175260d640 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 0x562b70de7b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f175160b640 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd8d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.818+0000 7f175260d640 1 -- 172.21.15.70:0/1914361681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 msgr2=0x562b70dd8d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f175260d640 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd8d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f175260d640 1 -- 172.21.15.70:0/1914361681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 msgr2=0x562b70de7b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:12.832 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f175260d640 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 0x562b70de7b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f175260d640 1 -- 172.21.15.70:0/1914361681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562b70dd9a50 con 0x562b70ddf370 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f175260d640 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70dd9250 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1744005560 tx=0x7f1744005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4861867cd403e654 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f17357fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f17357fa640 1 -- 172.21.15.70:0/1914361681 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17440120d0 con 0x562b70ddf370 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f17357fa640 1 -- 172.21.15.70:0/1914361681 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7f17440057a0 con 0x562b70ddf370 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 1 -- 172.21.15.70:0/1914361681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1744005bd0 con 0x562b70ddf370 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f17357fa640 1 -- 172.21.15.70:0/1914361681 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f17440059a0 con 0x562b70ddf370 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 10 client.16764 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 1 -- 172.21.15.70:0/1914361681 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562b70e59850 con 0x562b70ddf370 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f17357fa640 1 -- 172.21.15.70:0/1914361681 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1744005bd0 con 0x562b70ddf370 2024-09-19T04:37:12.833 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f17357fa640 1 -- 172.21.15.70:0/1914361681 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1744047020 con 0x562b70ddf370 2024-09-19T04:37:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 10 client.16764 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 10 client.16764 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 20 client.16764 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x562b70e59e50 0x562b70e5c240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 4 client.16764 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.819+0000 7f1756449740 1 -- 172.21.15.70:0/1914361681 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562b70cbe170 con 0x562b70e59e50 2024-09-19T04:37:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f175160b640 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x562b70e59e50 0x562b70e5c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:12.834 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f175160b640 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x562b70e59e50 0x562b70e5c240 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d640b95e8d945d13 server_cookie=771bcb2d2702c613 in_seq=0 out_seq=0 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f17357fa640 10 client.16764 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f17357fa640 1 -- 172.21.15.70:0/1914361681 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562b70cbe170 con 0x562b70e59e50 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f17357fa640 10 client.16764 handle_command_reply: tid=0 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f1756449740 1 client.16764 shutdown 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f1756449740 1 -- 172.21.15.70:0/1914361681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 msgr2=0x562b70dd9250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f1756449740 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70dd9250 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f1744005560 tx=0x7f1744005f90 comp rx=0 tx=0).stop 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f1756449740 1 -- 172.21.15.70:0/1914361681 shutdown_connections 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f1756449740 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x562b70e59e50 0x562b70e5c240 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.835 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.820+0000 7f1756449740 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562b70ddf370 0x562b70dd9250 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1756449740 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562b70dd5b40 0x562b70dd8d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1756449740 1 --2- 172.21.15.70:0/1914361681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562b70dd45d0 0x562b70de7b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f17357fa640 0 client.16764 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:12.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1756449740 1 -- 172.21.15.70:0/1914361681 >> 172.21.15.70:0/1914361681 conn(0x562b70d9d310 msgr2=0x562b70dde0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:12.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1756449740 1 -- 172.21.15.70:0/1914361681 shutdown_connections 2024-09-19T04:37:12.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1756449740 1 -- 172.21.15.70:0/1914361681 wait complete. 2024-09-19T04:37:12.836 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1756449740 20 client.16764 trim_cache size 0 max 16384 2024-09-19T04:37:12.837 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:12.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 -- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17380a33b0 msgr2=0x7f17380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17380a33b0 0x7f17380a5870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f17480b8be0 tx=0x7f174802a410 comp rx=0 tx=0).stop 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 -- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c100090 msgr2=0x7f174c1a4670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c100090 0x7f174c1a4670 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7f17480314b0 tx=0x7f1748004270 comp rx=0 tx=0).stop 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 -- 172.21.15.70:0/4056440275 shutdown_connections 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f17380a33b0 0x7f17380a5870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f174c106b70 0x7f174c19e7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f174c100a50 0x7f174c1a4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 --2- 172.21.15.70:0/4056440275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f174c100090 0x7f174c1a4670 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:12.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.821+0000 7f1754070640 1 -- 172.21.15.70:0/4056440275 >> 172.21.15.70:0/4056440275 conn(0x7f174c077210 msgr2=0x7f174c1037b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:12.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.822+0000 7f1754070640 1 -- 172.21.15.70:0/4056440275 shutdown_connections 2024-09-19T04:37:12.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:12.822+0000 7f1754070640 1 -- 172.21.15.70:0/4056440275 wait complete. 2024-09-19T04:37:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:12 smithi134 ceph-mon[34525]: pgmap v197: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:13.116 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:12 smithi070 ceph-mon[30942]: pgmap v197: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:13.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:12 smithi167 ceph-mon[34339]: pgmap v197: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:13.564 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:37:13.809 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.309+0000 7fa44cc71640 1 -- 172.21.15.70:0/2915875913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 msgr2=0x7fa4481029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.309+0000 7fa44cc71640 1 --2- 172.21.15.70:0/2915875913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 0x7fa4481029b0 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fa430009900 tx=0x7fa43002a480 comp rx=0 tx=0).stop 2024-09-19T04:37:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.309+0000 7fa44cc71640 1 -- 172.21.15.70:0/2915875913 shutdown_connections 2024-09-19T04:37:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.309+0000 7fa44cc71640 1 --2- 172.21.15.70:0/2915875913 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa448102ef0 0x7fa44810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.309+0000 7fa44cc71640 1 --2- 172.21.15.70:0/2915875913 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 0x7fa4481029b0 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.309+0000 7fa44cc71640 1 --2- 172.21.15.70:0/2915875913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa448100e20 0x7fa448101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.309+0000 7fa44cc71640 1 -- 172.21.15.70:0/2915875913 >> 172.21.15.70:0/2915875913 conn(0x7fa4480fc7d0 msgr2=0x7fa4480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.310+0000 7fa44cc71640 1 -- 172.21.15.70:0/2915875913 shutdown_connections 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.310+0000 7fa44cc71640 1 -- 172.21.15.70:0/2915875913 wait complete. 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.310+0000 7fa44cc71640 1 Processor -- start 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.310+0000 7fa44cc71640 1 -- start start 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa44cc71640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa448100e20 0x7fa448197450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa44cc71640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 0x7fa448197990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa44cc71640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa448102ef0 0x7fa44819bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa44cc71640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa448110fb0 con 0x7fa448102570 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa44cc71640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa448110e30 con 0x7fa448100e20 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa44cc71640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa448111130 con 0x7fa448102ef0 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 0x7fa448197990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 0x7fa448197990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39806/0 (socket says 172.21.15.70:39806) 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 -- 172.21.15.70:0/835418054 learned_addr learned my addr 172.21.15.70:0/835418054 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa44659c640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa448100e20 0x7fa448197450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa446d9d640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa448102ef0 0x7fa44819bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 -- 172.21.15.70:0/835418054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa448102ef0 msgr2=0x7fa44819bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa448102ef0 0x7fa44819bd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 -- 172.21.15.70:0/835418054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa448100e20 msgr2=0x7fa448197450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa448100e20 0x7fa448197450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 -- 172.21.15.70:0/835418054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa44819c400 con 0x7fa448102570 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa446d9d640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa448102ef0 0x7fa44819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa445d9b640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 0x7fa448197990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa430005940 tx=0x7fa430004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa43f7fe640 1 -- 172.21.15.70:0/835418054 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43003f030 con 0x7fa448102570 2024-09-19T04:37:14.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa43f7fe640 1 -- 172.21.15.70:0/835418054 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa430003ac0 con 0x7fa448102570 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa44cc71640 1 -- 172.21.15.70:0/835418054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa44819c690 con 0x7fa448102570 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.311+0000 7fa43f7fe640 1 -- 172.21.15.70:0/835418054 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430035070 con 0x7fa448102570 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.312+0000 7fa44cc71640 1 -- 172.21.15.70:0/835418054 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa4481a3fd0 con 0x7fa448102570 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa43f7fe640 1 -- 172.21.15.70:0/835418054 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa430042030 con 0x7fa448102570 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa44f04a740 1 Processor -- start 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa44f04a740 1 -- start start 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd23090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd235d0 0x56006fd23a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd30760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa44f04a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56006fc892f0 con 0x56006fd2e370 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa44f04a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56006fc30cf0 con 0x56006fd24b40 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa44f04a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56006fc852b0 con 0x56006fd235d0 2024-09-19T04:37:14.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.314+0000 7fa445d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd30760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa445d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd30760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39816/0 (socket says 172.21.15.70:39816) 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa445d9b640 1 -- 172.21.15.70:0/56092912 learned_addr learned my addr 172.21.15.70:0/56092912 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa43f7fe640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa4340a3430 0x7fa4340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa446d9d640 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd23090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa44659c640 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd235d0 0x56006fd23a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa446d9d640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa4340a3430 0x7fa4340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa43f7fe640 1 -- 172.21.15.70:0/835418054 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7fa4300eff80 con 0x7fa448102570 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa445d9b640 1 -- 172.21.15.70:0/56092912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd235d0 msgr2=0x56006fd23a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa445d9b640 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd235d0 0x56006fd23a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa445d9b640 1 -- 172.21.15.70:0/56092912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 msgr2=0x56006fd23090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa445d9b640 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd23090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa445d9b640 1 -- 172.21.15.70:0/56092912 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56006fc153a0 con 0x56006fd2e370 2024-09-19T04:37:14.327 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa446d9d640 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd23090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa445d9b640 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd30760 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa4300bbf30 tx=0x7fa43002a480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50c793d27a56cbce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa43cff9640 1 -- 172.21.15.70:0/56092912 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430049070 con 0x56006fd2e370 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa446d9d640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa4340a3430 0x7fa4340a58f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa440005fd0 tx=0x7fa440004730 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa43cff9640 1 -- 172.21.15.70:0/56092912 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa4300bc230 con 0x56006fd2e370 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.315+0000 7fa43cff9640 1 -- 172.21.15.70:0/56092912 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430003c70 con 0x56006fd2e370 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 -- 172.21.15.70:0/56092912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 msgr2=0x56006fd30760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd30760 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fa4300bbf30 tx=0x7fa43002a480 comp rx=0 tx=0).stop 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 -- 172.21.15.70:0/56092912 shutdown_connections 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd30760 unknown :-1 s=CLOSED pgs=842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd235d0 0x56006fd23a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 --2- 172.21.15.70:0/56092912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd23090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 -- 172.21.15.70:0/56092912 >> 172.21.15.70:0/56092912 conn(0x56006fcec310 msgr2=0x56006fd1fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 -- 172.21.15.70:0/56092912 shutdown_connections 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 -- 172.21.15.70:0/56092912 wait complete. 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.316+0000 7fa44f04a740 1 -- start start 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44f04a740 1 Processor -- start 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2dd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd24b40 0x56006fd2b000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd2b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44f04a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56006fc892f0 con 0x56006fd2e370 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44f04a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56006fc44060 con 0x56006fd235d0 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44f04a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56006fd30e30 con 0x56006fd24b40 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44f04a740 10 client.0 _ll_register_callbacks cb 0x56006f9978c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd2b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd2b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39824/0 (socket says 172.21.15.70:39824) 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 -- 172.21.15.70:0/94853821 learned_addr learned my addr 172.21.15.70:0/94853821 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa44659c640 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa445d9b640 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd24b40 0x56006fd2b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 -- 172.21.15.70:0/94853821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd24b40 msgr2=0x56006fd2b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd24b40 0x56006fd2b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 -- 172.21.15.70:0/94853821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 msgr2=0x56006fd2dd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2dd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 -- 172.21.15.70:0/94853821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56006f9fa3c0 con 0x56006fd2e370 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa446d9d640 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd2b5d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa440010e70 tx=0x7fa4400046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d08b8c33b1286fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.317+0000 7fa42dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa42dffb640 1 -- 172.21.15.70:0/94853821 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa440018070 con 0x56006fd2e370 2024-09-19T04:37:14.330 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa42dffb640 1 -- 172.21.15.70:0/94853821 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7fa440005020 con 0x56006fd2e370 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 1 -- 172.21.15.70:0/94853821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa4300bc230 con 0x56006fd2e370 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa42dffb640 1 -- 172.21.15.70:0/94853821 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa44000fe90 con 0x56006fd2e370 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 10 client.16776 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 1 -- 172.21.15.70:0/94853821 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56006fd3c790 con 0x56006fd2e370 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa42dffb640 1 -- 172.21.15.70:0/94853821 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa4300bc230 con 0x56006fd2e370 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa42dffb640 1 -- 172.21.15.70:0/94853821 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa44001f430 con 0x56006fd2e370 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 10 client.16776 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 10 client.16776 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 20 client.16776 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56006fd3dba0 0x56006fd3fff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 4 client.16776 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44f04a740 1 -- 172.21.15.70:0/94853821 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56006fc96860 con 0x56006fd3dba0 2024-09-19T04:37:14.331 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.318+0000 7fa44659c640 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56006fd3dba0 0x56006fd3fff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.319+0000 7fa44659c640 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56006fd3dba0 0x56006fd3fff0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7a428791e29cabdb server_cookie=77c0b8573c0bd2e0 in_seq=0 out_seq=0 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.319+0000 7fa42dffb640 10 client.16776 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa42dffb640 1 -- 172.21.15.70:0/94853821 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56006fc96860 con 0x56006fd3dba0 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa42dffb640 10 client.16776 handle_command_reply: tid=0 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 client.16776 shutdown 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 -- 172.21.15.70:0/94853821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 msgr2=0x56006fd2b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd2b5d0 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7fa440010e70 tx=0x7fa4400046c0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 -- 172.21.15.70:0/94853821 shutdown_connections 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56006fd3dba0 0x56006fd3fff0 crc :-1 s=READY pgs=132 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa42dffb640 0 client.16776 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd2e370 0x56006fd2b5d0 unknown :-1 s=CLOSED pgs=843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd24b40 0x56006fd2b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.332 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 --2- 172.21.15.70:0/94853821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2dd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 -- 172.21.15.70:0/94853821 >> 172.21.15.70:0/94853821 conn(0x56006fcec310 msgr2=0x56006fd25990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 -- 172.21.15.70:0/94853821 shutdown_connections 2024-09-19T04:37:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 1 -- 172.21.15.70:0/94853821 wait complete. 2024-09-19T04:37:14.333 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.320+0000 7fa44f04a740 20 client.16776 trim_cache size 0 max 16384 2024-09-19T04:37:14.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44f04a740 1 Processor -- start 2024-09-19T04:37:14.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44f04a740 1 -- start start 2024-09-19T04:37:14.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2cf70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.335 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd24b40 0x56006fd26120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 0x56006fd26660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44f04a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481af140 con 0x56006fd24b40 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44f04a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481aca10 con 0x56006fd235d0 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44f04a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481aa880 con 0x56006fd2e370 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa445d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd24b40 0x56006fd26120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa445d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd24b40 0x56006fd26120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39836/0 (socket says 172.21.15.70:39836) 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa445d9b640 1 -- 172.21.15.70:0/3679535160 learned_addr learned my addr 172.21.15.70:0/3679535160 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa446d9d640 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 0x56006fd26660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa44659c640 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa445d9b640 1 -- 172.21.15.70:0/3679535160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 msgr2=0x56006fd26660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.333+0000 7fa445d9b640 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 0x56006fd26660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa445d9b640 1 -- 172.21.15.70:0/3679535160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 msgr2=0x56006fd2cf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:14.336 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa445d9b640 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2cf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa445d9b640 1 -- 172.21.15.70:0/3679535160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56006fd2e0c0 con 0x56006fd24b40 2024-09-19T04:37:14.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa44659c640 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:14.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa445d9b640 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd24b40 0x56006fd26120 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa4300bbf30 tx=0x7fa430009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56796ec522ca333e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:14.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa42ffff640 1 -- 172.21.15.70:0/3679535160 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa430049040 con 0x56006fd24b40 2024-09-19T04:37:14.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa42ffff640 1 -- 172.21.15.70:0/3679535160 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa4300c4ea0 con 0x56006fd24b40 2024-09-19T04:37:14.337 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa42ffff640 1 -- 172.21.15.70:0/3679535160 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa43003bca0 con 0x56006fd24b40 2024-09-19T04:37:14.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa44f04a740 1 -- 172.21.15.70:0/3679535160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd24b40 msgr2=0x56006fd26120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd24b40 0x56006fd26120 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fa4300bbf30 tx=0x7fa430009560 comp rx=0 tx=0).stop 2024-09-19T04:37:14.340 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa44f04a740 1 -- 172.21.15.70:0/3679535160 shutdown_connections 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 0x56006fd26660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd24b40 0x56006fd26120 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.334+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3679535160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd235d0 0x56006fd2cf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 -- 172.21.15.70:0/3679535160 >> 172.21.15.70:0/3679535160 conn(0x56006fcec310 msgr2=0x56006fd2c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 -- 172.21.15.70:0/3679535160 shutdown_connections 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 -- 172.21.15.70:0/3679535160 wait complete. 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 -- start start 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 Processor -- start 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd235d0 0x56006fd36630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd31960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 0x56006fd31ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.341 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481aaed0 con 0x56006fd235d0 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481ac340 con 0x56006fd24b40 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa4481ab5a0 con 0x56006fd2e370 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44f04a740 10 client.0 _ll_register_callbacks cb 0x7fa44000cbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd235d0 0x56006fd36630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd235d0 0x56006fd36630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39848/0 (socket says 172.21.15.70:39848) 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa44659c640 1 -- 172.21.15.70:0/3936202609 learned_addr learned my addr 172.21.15.70:0/3936202609 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa445d9b640 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd31960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.335+0000 7fa446d9d640 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 0x56006fd31ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44659c640 1 -- 172.21.15.70:0/3936202609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 msgr2=0x56006fd31ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44659c640 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 0x56006fd31ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44659c640 1 -- 172.21.15.70:0/3936202609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 msgr2=0x56006fd31960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44659c640 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd31960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.342 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44659c640 1 -- 172.21.15.70:0/3936202609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56006fd324e0 con 0x56006fd235d0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44659c640 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd235d0 0x56006fd36630 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa438009440 tx=0x7fa43800ae80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ae7ac225417856 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa42dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa42dffb640 1 -- 172.21.15.70:0/3936202609 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa438017c10 con 0x56006fd235d0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa42dffb640 1 -- 172.21.15.70:0/3936202609 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(85..85 src has 1..85) ==== 8571+0+0 (secure 0 0 0) 0x7fa438017db0 con 0x56006fd235d0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44f04a740 1 -- 172.21.15.70:0/3936202609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56006fc90d70 con 0x56006fd235d0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa42dffb640 1 -- 172.21.15.70:0/3936202609 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa43802e050 con 0x56006fd235d0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44f04a740 10 client.16782 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44f04a740 1 -- 172.21.15.70:0/3936202609 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56006fdaca50 con 0x56006fd235d0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa42dffb640 1 -- 172.21.15.70:0/3936202609 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x56006fc90d70 con 0x56006fd235d0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa42dffb640 1 -- 172.21.15.70:0/3936202609 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa438029560 con 0x56006fd235d0 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44f04a740 10 client.16782 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44f04a740 10 client.16782 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:14.343 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.336+0000 7fa44f04a740 20 client.16782 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56006fd3dba0 0x56006fdaf1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa44f04a740 4 client.16782 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa44f04a740 1 -- 172.21.15.70:0/3936202609 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56006fc0d170 con 0x56006fd3dba0 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa445d9b640 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56006fd3dba0 0x56006fdaf1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa445d9b640 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56006fd3dba0 0x56006fdaf1e0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe183ad8d921e480 server_cookie=e10b1dc4bd75e146 in_seq=0 out_seq=0 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa42dffb640 10 client.16782 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa42dffb640 1 -- 172.21.15.70:0/3936202609 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56006fc0d170 con 0x56006fd3dba0 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa42dffb640 10 client.16782 handle_command_reply: tid=0 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa44f04a740 1 client.16782 shutdown 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa44f04a740 1 -- 172.21.15.70:0/3936202609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd235d0 msgr2=0x56006fd36630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.337+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd235d0 0x56006fd36630 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fa438009440 tx=0x7fa43800ae80 comp rx=0 tx=0).stop 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 1 -- 172.21.15.70:0/3936202609 shutdown_connections 2024-09-19T04:37:14.344 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56006fd3dba0 0x56006fdaf1e0 crc :-1 s=READY pgs=133 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56006fd2e370 0x56006fd31ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56006fd24b40 0x56006fd31960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 1 --2- 172.21.15.70:0/3936202609 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56006fd235d0 0x56006fd36630 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 1 -- 172.21.15.70:0/3936202609 >> 172.21.15.70:0/3936202609 conn(0x56006fcec310 msgr2=0x56006fd2d080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa42dffb640 0 client.16782 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 1 -- 172.21.15.70:0/3936202609 shutdown_connections 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 1 -- 172.21.15.70:0/3936202609 wait complete. 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44f04a740 20 client.16782 trim_cache size 0 max 16384 2024-09-19T04:37:14.345 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 -- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa4340a3430 msgr2=0x7fa4340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa4340a3430 0x7fa4340a58f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fa440005fd0 tx=0x7fa440004730 comp rx=0 tx=0).stop 2024-09-19T04:37:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 -- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 msgr2=0x7fa448197990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 0x7fa448197990 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fa430005940 tx=0x7fa430004270 comp rx=0 tx=0).stop 2024-09-19T04:37:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 -- 172.21.15.70:0/835418054 shutdown_connections 2024-09-19T04:37:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa4340a3430 0x7fa4340a58f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.346 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa448102ef0 0x7fa44819bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa448102570 0x7fa448197990 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 --2- 172.21.15.70:0/835418054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa448100e20 0x7fa448197450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 -- 172.21.15.70:0/835418054 >> 172.21.15.70:0/835418054 conn(0x7fa4480fc7d0 msgr2=0x7fa4480febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 -- 172.21.15.70:0/835418054 shutdown_connections 2024-09-19T04:37:14.347 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:14.338+0000 7fa44cc71640 1 -- 172.21.15.70:0/835418054 wait complete. 2024-09-19T04:37:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:15 smithi134 ceph-mon[34525]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:37:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:15 smithi134 ceph-mon[34525]: pgmap v199: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:37:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:15 smithi070 ceph-mon[30942]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:37:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:15 smithi070 ceph-mon[30942]: pgmap v199: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:37:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:15 smithi167 ceph-mon[34339]: osdmap e86: 12 total, 12 up, 12 in 2024-09-19T04:37:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:15 smithi167 ceph-mon[34339]: pgmap v199: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:37:16.054 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:37:16.055 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:37:16.305 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3962640009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8101420 msgr2=0x7f4ce810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3962640009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8101420 0x7f4ce810d950 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0009cd0 tx=0x7f4ce002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3962640009 shutdown_connections 2024-09-19T04:37:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3962640009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8101420 0x7f4ce810d950 unknown :-1 s=CLOSED pgs=846 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3962640009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ce8100a80 0x7f4ce8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3962640009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8106a80 0x7f4ce8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3962640009 >> 172.21.15.70:0/3962640009 conn(0x7f4ce80fc7a0 msgr2=0x7f4ce80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:16.802 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3962640009 shutdown_connections 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.782+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3962640009 wait complete. 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cef7cd640 1 Processor -- start 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cef7cd640 1 -- start start 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cef7cd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8100a80 0x7f4ce81983b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cef7cd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8101420 0x7f4ce81988f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cef7cd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ce8106a80 0x7f4ce819cc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cef7cd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8111f90 con 0x7f4ce8100a80 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cef7cd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8111e10 con 0x7f4ce8101420 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cef7cd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce8112110 con 0x7f4ce8106a80 2024-09-19T04:37:16.803 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4ced569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8100a80 0x7f4ce81983b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4ced569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8100a80 0x7f4ce81983b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39856/0 (socket says 172.21.15.70:39856) 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4ced569640 1 -- 172.21.15.70:0/3122735675 learned_addr learned my addr 172.21.15.70:0/3122735675 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cedd6a640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ce8106a80 0x7f4ce819cc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cecd68640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8101420 0x7f4ce81988f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4ced569640 1 -- 172.21.15.70:0/3122735675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ce8106a80 msgr2=0x7f4ce819cc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4ced569640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ce8106a80 0x7f4ce819cc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4ced569640 1 -- 172.21.15.70:0/3122735675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8101420 msgr2=0x7f4ce81988f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4ced569640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8101420 0x7f4ce81988f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4ced569640 1 -- 172.21.15.70:0/3122735675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ce819d360 con 0x7f4ce8100a80 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.783+0000 7f4cecd68640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8101420 0x7f4ce81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:16.804 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.784+0000 7f4ced569640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8100a80 0x7f4ce81983b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400b4a0 tx=0x7f4ce400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.784+0000 7f4cde7fc640 1 -- 172.21.15.70:0/3122735675 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4014070 con 0x7f4ce8100a80 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.784+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3122735675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ce819d650 con 0x7f4ce8100a80 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.784+0000 7f4cde7fc640 1 -- 172.21.15.70:0/3122735675 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4ce4010ae0 con 0x7f4ce8100a80 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.784+0000 7f4cde7fc640 1 -- 172.21.15.70:0/3122735675 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4017c70 con 0x7f4ce8100a80 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.784+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3122735675 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ce81a4f30 con 0x7f4ce8100a80 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.786+0000 7f4cde7fc640 1 -- 172.21.15.70:0/3122735675 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4ce4017070 con 0x7f4ce8100a80 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.786+0000 7f4cf1ba6740 1 Processor -- start 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cf1ba6740 1 -- start start 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b53f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.805 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b61130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fbd5ab9280 con 0x55fbd5b54480 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fbd5a60b10 con 0x55fbd5b5ed40 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fbd5ab5240 con 0x55fbd5b53b60 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cde7fc640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cd40a33b0 0x7f4cd40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4ced569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4ced569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39864/0 (socket says 172.21.15.70:39864) 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4ced569640 1 -- 172.21.15.70:0/855992354 learned_addr learned my addr 172.21.15.70:0/855992354 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cedd6a640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cd40a33b0 0x7f4cd40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cecd68640 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b61130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cedd6a640 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b53f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4cde7fc640 1 -- 172.21.15.70:0/3122735675 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f4ce40cf050 con 0x7f4ce8100a80 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4ced569640 1 -- 172.21.15.70:0/855992354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 msgr2=0x55fbd5b53f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4ced569640 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b53f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4ced569640 1 -- 172.21.15.70:0/855992354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 msgr2=0x55fbd5b61130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4ced569640 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b61130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.787+0000 7f4ced569640 1 -- 172.21.15.70:0/855992354 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbd5a6d1f0 con 0x55fbd5b54480 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4ced569640 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5e800 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40176e0 tx=0x7f4ce4009390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c304fccbee45ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cedd6a640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cd40a33b0 0x7f4cd40a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0006010 tx=0x7f4ce0009980 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cd37fe640 1 -- 172.21.15.70:0/855992354 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce401e070 con 0x55fbd5b54480 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cd37fe640 1 -- 172.21.15.70:0/855992354 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4ce40a40b0 con 0x55fbd5b54480 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cd37fe640 1 -- 172.21.15.70:0/855992354 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce4097ab0 con 0x55fbd5b54480 2024-09-19T04:37:16.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/855992354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 msgr2=0x55fbd5b5e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5e800 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7f4ce40176e0 tx=0x7f4ce4009390 comp rx=0 tx=0).stop 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/855992354 shutdown_connections 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b61130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5e800 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/855992354 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b53f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.788+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/855992354 >> 172.21.15.70:0/855992354 conn(0x55fbd5b500f0 msgr2=0x55fbd5b504d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/855992354 shutdown_connections 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/855992354 wait complete. 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 -- start start 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 Processor -- start 2024-09-19T04:37:16.808 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b5bbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5c120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b5c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fbd5b61910 con 0x55fbd5b54480 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fbd5a73f10 con 0x55fbd5b5ed40 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fbd5b61a90 con 0x55fbd5b53b60 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cf1ba6740 10 client.0 _ll_register_callbacks cb 0x55fbd5a3ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cecd68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5c120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cecd68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5c120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39866/0 (socket says 172.21.15.70:39866) 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.789+0000 7f4cecd68640 1 -- 172.21.15.70:0/1947817075 learned_addr learned my addr 172.21.15.70:0/1947817075 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cedd6a640 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b5c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.809 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4ced569640 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b5bbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cecd68640 1 -- 172.21.15.70:0/1947817075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 msgr2=0x55fbd5b5bbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cecd68640 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b5bbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cecd68640 1 -- 172.21.15.70:0/1947817075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 msgr2=0x55fbd5b5c660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cecd68640 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b5c660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cecd68640 1 -- 172.21.15.70:0/1947817075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbd582a6a0 con 0x55fbd5b54480 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4ced569640 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b5bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cecd68640 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5c120 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8010850 tx=0x7f4cd8010d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e5d657af2113c2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/1947817075 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd801d060 con 0x55fbd5b54480 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/1947817075 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f4cd800eda0 con 0x55fbd5b54480 2024-09-19T04:37:16.810 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/1947817075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce40a40b0 con 0x55fbd5b54480 2024-09-19T04:37:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/1947817075 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4cd8018430 con 0x55fbd5b54480 2024-09-19T04:37:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cf1ba6740 10 client.16794 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/1947817075 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fbd5b6d540 con 0x55fbd5b54480 2024-09-19T04:37:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.790+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/1947817075 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4ce40a40b0 con 0x55fbd5b54480 2024-09-19T04:37:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/1947817075 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4cd800d530 con 0x55fbd5b54480 2024-09-19T04:37:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4cf1ba6740 10 client.16794 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4cf1ba6740 10 client.16794 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:16.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4cf1ba6740 20 client.16794 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fbd5b6ea00 0x55fbd5b70e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4cf1ba6740 4 client.16794 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/1947817075 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fbd5ac67f0 con 0x55fbd5b6ea00 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4ced569640 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fbd5b6ea00 0x55fbd5b70e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4ced569640 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fbd5b6ea00 0x55fbd5b70e50 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=92ff7528b6ce3b2e server_cookie=2fe13c5a98fe7612 in_seq=0 out_seq=0 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.791+0000 7f4cd0ff9640 10 client.16794 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/1947817075 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fbd5ac67f0 con 0x55fbd5b6ea00 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cd0ff9640 10 client.16794 handle_command_reply: tid=0 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 client.16794 shutdown 2024-09-19T04:37:16.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/1947817075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 msgr2=0x55fbd5b5c120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5c120 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7f4cd8010850 tx=0x7f4cd8010d10 comp rx=0 tx=0).stop 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/1947817075 shutdown_connections 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fbd5b6ea00 0x55fbd5b70e50 crc :-1 s=READY pgs=134 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b5c660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cd0ff9640 0 client.16794 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b5c120 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/1947817075 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b53b60 0x55fbd5b5bbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/1947817075 >> 172.21.15.70:0/1947817075 conn(0x55fbd5b500f0 msgr2=0x55fbd5b55dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:16.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/1947817075 shutdown_connections 2024-09-19T04:37:16.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/1947817075 wait complete. 2024-09-19T04:37:16.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.792+0000 7f4cf1ba6740 20 client.16794 trim_cache size 0 max 16384 2024-09-19T04:37:16.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.809+0000 7f4cf1ba6740 1 Processor -- start 2024-09-19T04:37:16.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cf1ba6740 1 -- start start 2024-09-19T04:37:16.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b53b60 0x55fbd5b565c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b54480 0x55fbd5b5da40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b76760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81b01f0 con 0x55fbd5b53b60 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81adac0 con 0x55fbd5b5ed40 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81ab930 con 0x55fbd5b54480 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b53b60 0x55fbd5b565c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b53b60 0x55fbd5b565c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39882/0 (socket says 172.21.15.70:39882) 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 -- 172.21.15.70:0/45422622 learned_addr learned my addr 172.21.15.70:0/45422622 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cedd6a640 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b76760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 -- 172.21.15.70:0/45422622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b54480 msgr2=0x55fbd5b5da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cecd68640 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b54480 0x55fbd5b5da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b54480 0x55fbd5b5da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 -- 172.21.15.70:0/45422622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 msgr2=0x55fbd5b76760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b76760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 -- 172.21.15.70:0/45422622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fbd5b4ff20 con 0x55fbd5b53b60 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cecd68640 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b54480 0x55fbd5b5da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4ced569640 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b53b60 0x55fbd5b565c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4ce409b600 tx=0x7f4ce4017630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e96309d324c0da6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.810+0000 7f4cd2ffd640 1 -- 172.21.15.70:0/45422622 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce401e040 con 0x55fbd5b53b60 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cd2ffd640 1 -- 172.21.15.70:0/45422622 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4ce4097ab0 con 0x55fbd5b53b60 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cd2ffd640 1 -- 172.21.15.70:0/45422622 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ce40a3c20 con 0x55fbd5b53b60 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/45422622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b53b60 msgr2=0x55fbd5b565c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b53b60 0x55fbd5b565c0 secure :-1 s=READY pgs=850 cs=0 l=1 rev1=1 crypto rx=0x7f4ce409b600 tx=0x7f4ce4017630 comp rx=0 tx=0).stop 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/45422622 shutdown_connections 2024-09-19T04:37:16.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b5ed40 0x55fbd5b76760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b54480 0x55fbd5b5da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/45422622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b53b60 0x55fbd5b565c0 unknown :-1 s=CLOSED pgs=850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/45422622 >> 172.21.15.70:0/45422622 conn(0x55fbd5b500f0 msgr2=0x55fbd5b5d330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/45422622 shutdown_connections 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.811+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/45422622 wait complete. 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 1 -- start start 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 1 Processor -- start 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b53b60 0x55fbd5b62d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b632c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b5ed40 0x55fbd5bd8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.823 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81abf80 con 0x55fbd5b54480 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81ad3f0 con 0x55fbd5b53b60 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4ce81ac650 con 0x55fbd5b5ed40 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cf1ba6740 10 client.0 _ll_register_callbacks cb 0x7f4cd8010430 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cecd68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b632c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cecd68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b632c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39892/0 (socket says 172.21.15.70:39892) 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cecd68640 1 -- 172.21.15.70:0/902034543 learned_addr learned my addr 172.21.15.70:0/902034543 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4cedd6a640 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b5ed40 0x55fbd5bd8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.812+0000 7f4ced569640 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b53b60 0x55fbd5b62d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cecd68640 1 -- 172.21.15.70:0/902034543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b5ed40 msgr2=0x55fbd5bd8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cecd68640 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b5ed40 0x55fbd5bd8730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.824 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cecd68640 1 -- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b53b60 msgr2=0x55fbd5b62d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cecd68640 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b53b60 0x55fbd5b62d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cecd68640 1 -- 172.21.15.70:0/902034543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fbd5b63ba0 con 0x55fbd5b54480 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4ced569640 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b53b60 0x55fbd5b62d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cecd68640 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b632c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800db10 tx=0x7f4cd800ee50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=443490bd1d43da31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cd0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/902034543 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4cd802f060 con 0x55fbd5b54480 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/902034543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ce4097ab0 con 0x55fbd5b54480 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/902034543 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f4cd8005040 con 0x55fbd5b54480 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/902034543 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4cd801d020 con 0x55fbd5b54480 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cf1ba6740 10 client.16800 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:16.825 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/902034543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fbd5bd9d60 con 0x55fbd5b54480 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/902034543 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4ce4097ab0 con 0x55fbd5b54480 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/902034543 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f4cd8004960 con 0x55fbd5b54480 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.813+0000 7f4cf1ba6740 10 client.16800 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.814+0000 7f4cf1ba6740 10 client.16800 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.814+0000 7f4cf1ba6740 20 client.16800 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.814+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fbd5bda480 0x55fbd5bdc8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.814+0000 7f4cf1ba6740 4 client.16800 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.814+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/902034543 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fbd5ac0d00 con 0x55fbd5bda480 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.814+0000 7f4ced569640 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fbd5bda480 0x55fbd5bdc8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.814+0000 7f4ced569640 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fbd5bda480 0x55fbd5bdc8a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ef86c3dd33327cb6 server_cookie=440fc57e3e9fdcd5 in_seq=0 out_seq=0 2024-09-19T04:37:16.826 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.814+0000 7f4cd0ff9640 10 client.16800 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cd0ff9640 1 -- 172.21.15.70:0/902034543 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fbd5ac0d00 con 0x55fbd5bda480 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cd0ff9640 10 client.16800 handle_command_reply: tid=0 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 client.16800 shutdown 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/902034543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 msgr2=0x55fbd5b632c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b632c0 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800db10 tx=0x7f4cd800ee50 comp rx=0 tx=0).stop 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/902034543 shutdown_connections 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55fbd5bda480 0x55fbd5bdc8a0 crc :-1 s=READY pgs=135 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cd0ff9640 0 client.16800 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fbd5b5ed40 0x55fbd5bd8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.827 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fbd5b54480 0x55fbd5b632c0 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 --2- 172.21.15.70:0/902034543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fbd5b53b60 0x55fbd5b62d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.815+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/902034543 >> 172.21.15.70:0/902034543 conn(0x55fbd5b500f0 msgr2=0x55fbd5b4f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/902034543 shutdown_connections 2024-09-19T04:37:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cf1ba6740 1 -- 172.21.15.70:0/902034543 wait complete. 2024-09-19T04:37:16.828 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cf1ba6740 20 client.16800 trim_cache size 0 max 16384 2024-09-19T04:37:16.828 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:16.828 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:37:16.828 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "588c1700-1884-4832-872b-72b8394fafcf", 2024-09-19T04:37:16.829 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:37:16.829 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:16.829 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cd40a33b0 msgr2=0x7f4cd40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cd40a33b0 0x7f4cd40a5870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f4ce0006010 tx=0x7f4ce0009980 comp rx=0 tx=0).stop 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8100a80 msgr2=0x7f4ce81983b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8100a80 0x7f4ce81983b0 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7f4ce400b4a0 tx=0x7f4ce400b960 comp rx=0 tx=0).stop 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3122735675 shutdown_connections 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f4cd40a33b0 0x7f4cd40a5870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4ce8106a80 0x7f4ce819cc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ce8101420 0x7f4ce81988f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 --2- 172.21.15.70:0/3122735675 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4ce8100a80 0x7f4ce81983b0 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3122735675 >> 172.21.15.70:0/3122735675 conn(0x7f4ce80fc7a0 msgr2=0x7f4ce80fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3122735675 shutdown_connections 2024-09-19T04:37:16.830 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:16.816+0000 7f4cef7cd640 1 -- 172.21.15.70:0/3122735675 wait complete. 2024-09-19T04:37:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:16 smithi134 ceph-mon[34525]: pgmap v200: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:37:17.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:16 smithi070 ceph-mon[30942]: pgmap v200: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:37:17.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:16 smithi167 ceph-mon[34339]: pgmap v200: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:37:17.648 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:37:17.894 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:18.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:17 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:37:18.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:17 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:18.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:17 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:37:18.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:17 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:18.015 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:17 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:37:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:17 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:37:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:17 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:17 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:37:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:17 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:17 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:37:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:17 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:37:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:17 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:17 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:37:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:17 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:17 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:37:18.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 -- 172.21.15.70:0/2865279828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102ef0 msgr2=0x7f59f410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 --2- 172.21.15.70:0/2865279828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102ef0 0x7f59f410da40 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009ca0 tx=0x7f59ec02a950 comp rx=0 tx=0).stop 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 -- 172.21.15.70:0/2865279828 shutdown_connections 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 --2- 172.21.15.70:0/2865279828 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102ef0 0x7f59f410da40 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 --2- 172.21.15.70:0/2865279828 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59f4102570 0x7f59f41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 --2- 172.21.15.70:0/2865279828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59f4100e20 0x7f59f4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 -- 172.21.15.70:0/2865279828 >> 172.21.15.70:0/2865279828 conn(0x7f59f40fc7d0 msgr2=0x7f59f40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 -- 172.21.15.70:0/2865279828 shutdown_connections 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.389+0000 7f59fb677640 1 -- 172.21.15.70:0/2865279828 wait complete. 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59fb677640 1 Processor -- start 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59fb677640 1 -- start start 2024-09-19T04:37:18.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59fb677640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59f4100e20 0x7f59f41984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59fb677640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102570 0x7f59f41989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59fb677640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59f4102ef0 0x7f59f419cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59fb677640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4112070 con 0x7f59f4102570 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59fb677640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59f4111ef0 con 0x7f59f4102ef0 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59fb677640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41121f0 con 0x7f59f4100e20 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59f8c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102570 0x7f59f41989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59f8c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102570 0x7f59f41989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39908/0 (socket says 172.21.15.70:39908) 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59f8c12640 1 -- 172.21.15.70:0/78157404 learned_addr learned my addr 172.21.15.70:0/78157404 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59f9c14640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59f4102ef0 0x7f59f419cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.390+0000 7f59f9413640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59f4100e20 0x7f59f41984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59f8c12640 1 -- 172.21.15.70:0/78157404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59f4100e20 msgr2=0x7f59f41984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59f8c12640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59f4100e20 0x7f59f41984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59f8c12640 1 -- 172.21.15.70:0/78157404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59f4102ef0 msgr2=0x7f59f419cd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59f8c12640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59f4102ef0 0x7f59f419cd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59f8c12640 1 -- 172.21.15.70:0/78157404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59f419d460 con 0x7f59f4102570 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59f9c14640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59f4102ef0 0x7f59f419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59f8c12640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102570 0x7f59f41989f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f59e400d950 tx=0x7f59e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59ea7fc640 1 -- 172.21.15.70:0/78157404 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e4017030 con 0x7f59f4102570 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59fb677640 1 -- 172.21.15.70:0/78157404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59f419d750 con 0x7f59f4102570 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59ea7fc640 1 -- 172.21.15.70:0/78157404 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f59e4004020 con 0x7f59f4102570 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59ea7fc640 1 -- 172.21.15.70:0/78157404 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e40047a0 con 0x7f59f4102570 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.391+0000 7f59fb677640 1 -- 172.21.15.70:0/78157404 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59f41a5030 con 0x7f59f4102570 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59ea7fc640 1 -- 172.21.15.70:0/78157404 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f59e40041d0 con 0x7f59f4102570 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59fda50740 1 Processor -- start 2024-09-19T04:37:18.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59fda50740 1 -- start start 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59fda50740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d55880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59fda50740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d60140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59fda50740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 0x564e57d62a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59fda50740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564e57cbb2e0 con 0x564e57d55dc0 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59fda50740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e57c62ce0 con 0x564e57d554a0 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59fda50740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564e57cb72a0 con 0x564e57d60680 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59f9413640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d60140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.394+0000 7f59f9413640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d60140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39912/0 (socket says 172.21.15.70:39912) 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9413640 1 -- 172.21.15.70:0/1799092566 learned_addr learned my addr 172.21.15.70:0/1799092566 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9c14640 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d55880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f8c12640 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 0x564e57d62a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59ea7fc640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f59e00a33b0 0x7f59e00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9413640 1 -- 172.21.15.70:0/1799092566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 msgr2=0x564e57d62a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9413640 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 0x564e57d62a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9413640 1 -- 172.21.15.70:0/1799092566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 msgr2=0x564e57d55880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9413640 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d55880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9413640 1 -- 172.21.15.70:0/1799092566 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e57c47440 con 0x564e57d55dc0 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9c14640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f59e00a33b0 0x7f59e00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59ea7fc640 1 -- 172.21.15.70:0/78157404 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f59e40cf7f0 con 0x7f59f4102570 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9413640 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d60140 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f59f000bcb0 tx=0x7f59f000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9393f2365db84a2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59df7fe640 1 -- 172.21.15.70:0/1799092566 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0015070 con 0x564e57d55dc0 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59df7fe640 1 -- 172.21.15.70:0/1799092566 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f59f001a930 con 0x564e57d55dc0 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59df7fe640 1 -- 172.21.15.70:0/1799092566 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59f0011a40 con 0x564e57d55dc0 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.395+0000 7f59f9c14640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f59e00a33b0 0x7f59e00a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f59ec005e30 tx=0x7f59ec03c040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 -- 172.21.15.70:0/1799092566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 msgr2=0x564e57d60140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.423 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d60140 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f59f000bcb0 tx=0x7f59f000f730 comp rx=0 tx=0).stop 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 -- 172.21.15.70:0/1799092566 shutdown_connections 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 0x564e57d62a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d60140 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 --2- 172.21.15.70:0/1799092566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d55880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 -- 172.21.15.70:0/1799092566 >> 172.21.15.70:0/1799092566 conn(0x564e57d51a30 msgr2=0x564e57d51e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 -- 172.21.15.70:0/1799092566 shutdown_connections 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 -- 172.21.15.70:0/1799092566 wait complete. 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.396+0000 7f59fda50740 1 -- start start 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59fda50740 1 Processor -- start 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59fda50740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d5ff80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59fda50740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d5d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59fda50740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 0x564e57d5d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59fda50740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564e57d63250 con 0x564e57d55dc0 2024-09-19T04:37:18.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59fda50740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564e57c76050 con 0x564e57d554a0 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59fda50740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564e57d633d0 con 0x564e57d60680 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59fda50740 10 client.0 _ll_register_callbacks cb 0x564e57cb6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f8c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d5d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f8c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d5d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39924/0 (socket says 172.21.15.70:39924) 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f8c12640 1 -- 172.21.15.70:0/3606614050 learned_addr learned my addr 172.21.15.70:0/3606614050 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f9c14640 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 0x564e57d5d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f9413640 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d5ff80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f8c12640 1 -- 172.21.15.70:0/3606614050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 msgr2=0x564e57d5d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:18.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f8c12640 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 0x564e57d5d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f8c12640 1 -- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 msgr2=0x564e57d5ff80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f8c12640 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d5ff80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f8c12640 1 -- 172.21.15.70:0/3606614050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e57a2c3c0 con 0x564e57d55dc0 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.397+0000 7f59f9413640 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d5ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59f8c12640 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d5d230 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f59e409ba60 tx=0x7f59e4005130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fea75004ba5387cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59dcff9640 1 -- 172.21.15.70:0/3606614050 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e409b610 con 0x564e57d55dc0 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59dcff9640 1 -- 172.21.15.70:0/3606614050 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f59e40cd1c0 con 0x564e57d55dc0 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 1 -- 172.21.15.70:0/3606614050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f59f001a930 con 0x564e57d55dc0 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59dcff9640 1 -- 172.21.15.70:0/3606614050 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f59e409b430 con 0x564e57d55dc0 2024-09-19T04:37:18.426 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 10 client.16812 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 1 -- 172.21.15.70:0/3606614050 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564e57d6ec20 con 0x564e57d55dc0 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59dcff9640 1 -- 172.21.15.70:0/3606614050 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f59f001a930 con 0x564e57d55dc0 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59dcff9640 1 -- 172.21.15.70:0/3606614050 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f59e40a42b0 con 0x564e57d55dc0 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 10 client.16812 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 10 client.16812 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 20 client.16812 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e57d70130 0x564e57d725a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 4 client.16812 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.398+0000 7f59fda50740 1 -- 172.21.15.70:0/3606614050 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564e57cc8850 con 0x564e57d70130 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.399+0000 7f59f9413640 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e57d70130 0x564e57d725a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.399+0000 7f59f9413640 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e57d70130 0x564e57d725a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9620059ec824627f server_cookie=2bfde81425280234 in_seq=0 out_seq=0 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.399+0000 7f59dcff9640 10 client.16812 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:18.427 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59dcff9640 1 -- 172.21.15.70:0/3606614050 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564e57cc8850 con 0x564e57d70130 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59dcff9640 10 client.16812 handle_command_reply: tid=0 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 client.16812 shutdown 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 -- 172.21.15.70:0/3606614050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 msgr2=0x564e57d5d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d5d230 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f59e409ba60 tx=0x7f59e4005130 comp rx=0 tx=0).stop 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 -- 172.21.15.70:0/3606614050 shutdown_connections 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e57d70130 0x564e57d725a0 crc :-1 s=READY pgs=136 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d60680 0x564e57d5d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59dcff9640 0 client.16812 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d5d230 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.428 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 --2- 172.21.15.70:0/3606614050 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d5ff80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 -- 172.21.15.70:0/3606614050 >> 172.21.15.70:0/3606614050 conn(0x564e57d51a30 msgr2=0x564e57d57760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 -- 172.21.15.70:0/3606614050 shutdown_connections 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 1 -- 172.21.15.70:0/3606614050 wait complete. 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.400+0000 7f59fda50740 20 client.16812 trim_cache size 0 max 16384 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59fda50740 1 Processor -- start 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59fda50740 1 -- start start 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59fda50740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d6c4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59fda50740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d55dc0 0x564e57d77e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59fda50740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d60680 0x564e57d783b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.429 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59fda50740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41b01a0 con 0x564e57d60680 2024-09-19T04:37:18.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59f9c14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d60680 0x564e57d783b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.433 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59f9c14640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d60680 0x564e57d783b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39932/0 (socket says 172.21.15.70:39932) 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59f9c14640 1 -- 172.21.15.70:0/2083006625 learned_addr learned my addr 172.21.15.70:0/2083006625 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59f9413640 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d6c4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59fda50740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41ada70 con 0x564e57d554a0 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59fda50740 1 -- 172.21.15.70:0/2083006625 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41ab8e0 con 0x564e57d55dc0 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.417+0000 7f59f8c12640 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d55dc0 0x564e57d77e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59f9c14640 1 -- 172.21.15.70:0/2083006625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d55dc0 msgr2=0x564e57d77e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59f9c14640 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d55dc0 0x564e57d77e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59f9c14640 1 -- 172.21.15.70:0/2083006625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 msgr2=0x564e57d6c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59f9c14640 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d6c4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59f9c14640 1 -- 172.21.15.70:0/2083006625 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e57d602f0 con 0x564e57d60680 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59f9c14640 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d60680 0x564e57d783b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009ca0 tx=0x7f59ec041000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7bfc4aa1f15d8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:18.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59deffd640 1 -- 172.21.15.70:0/2083006625 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec034040 con 0x564e57d60680 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59deffd640 1 -- 172.21.15.70:0/2083006625 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f59ec003e40 con 0x564e57d60680 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.418+0000 7f59deffd640 1 -- 172.21.15.70:0/2083006625 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59ec004860 con 0x564e57d60680 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 -- 172.21.15.70:0/2083006625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d60680 msgr2=0x564e57d783b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d60680 0x564e57d783b0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f59ec009ca0 tx=0x7f59ec041000 comp rx=0 tx=0).stop 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 -- 172.21.15.70:0/2083006625 shutdown_connections 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d60680 0x564e57d783b0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d55dc0 0x564e57d77e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 --2- 172.21.15.70:0/2083006625 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d554a0 0x564e57d6c4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 -- 172.21.15.70:0/2083006625 >> 172.21.15.70:0/2083006625 conn(0x564e57d51a30 msgr2=0x564e57d5c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 -- 172.21.15.70:0/2083006625 shutdown_connections 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 -- 172.21.15.70:0/2083006625 wait complete. 2024-09-19T04:37:18.435 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 -- start start 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.419+0000 7f59fda50740 1 Processor -- start 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59fda50740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d554a0 0x564e57d689f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59fda50740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d68f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59fda50740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d60680 0x564e57dd3710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59fda50740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41abf30 con 0x564e57d55dc0 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59fda50740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41ad3a0 con 0x564e57d60680 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59fda50740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f59f41ac600 con 0x564e57d554a0 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59fda50740 10 client.0 _ll_register_callbacks cb 0x7f59e40044c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d68f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d68f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39938/0 (socket says 172.21.15.70:39938) 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 -- 172.21.15.70:0/942829606 learned_addr learned my addr 172.21.15.70:0/942829606 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f9413640 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d554a0 0x564e57d689f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f9c14640 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d60680 0x564e57dd3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 -- 172.21.15.70:0/942829606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d554a0 msgr2=0x564e57d689f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d554a0 0x564e57d689f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 -- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d60680 msgr2=0x564e57dd3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d60680 0x564e57dd3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 -- 172.21.15.70:0/942829606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e57dd3f10 con 0x564e57d55dc0 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f9c14640 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d60680 0x564e57dd3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:18.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59f8c12640 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d68f30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f59e409b7d0 tx=0x7f59e40a4740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae0b5cde1fead6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.420+0000 7f59dcff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59dcff9640 1 -- 172.21.15.70:0/942829606 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59e409b610 con 0x564e57d55dc0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59dcff9640 1 -- 172.21.15.70:0/942829606 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f59e40d5040 con 0x564e57d55dc0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 1 -- 172.21.15.70:0/942829606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x564e57cc2d60 con 0x564e57d55dc0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59dcff9640 1 -- 172.21.15.70:0/942829606 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f59e409c1d0 con 0x564e57d55dc0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 10 client.16818 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 1 -- 172.21.15.70:0/942829606 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564e57d682a0 con 0x564e57d55dc0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59dcff9640 1 -- 172.21.15.70:0/942829606 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x564e57cc2d60 con 0x564e57d55dc0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59dcff9640 1 -- 172.21.15.70:0/942829606 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f59e40cd1c0 con 0x564e57d55dc0 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 10 client.16818 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 10 client.16818 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:18.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 20 client.16818 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e57ddf640 0x564e57de1a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 4 client.16818 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59fda50740 1 -- 172.21.15.70:0/942829606 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x564e57c3f210 con 0x564e57ddf640 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.421+0000 7f59f9413640 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e57ddf640 0x564e57de1a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59f9413640 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e57ddf640 0x564e57de1a60 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=81a48b062cb69242 server_cookie=a686445ed7d1a90 in_seq=0 out_seq=0 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59dcff9640 10 client.16818 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59dcff9640 1 -- 172.21.15.70:0/942829606 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x564e57c3f210 con 0x564e57ddf640 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59dcff9640 10 client.16818 handle_command_reply: tid=0 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 client.16818 shutdown 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 -- 172.21.15.70:0/942829606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 msgr2=0x564e57d68f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d68f30 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f59e409b7d0 tx=0x7f59e40a4740 comp rx=0 tx=0).stop 2024-09-19T04:37:18.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 -- 172.21.15.70:0/942829606 shutdown_connections 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564e57ddf640 0x564e57de1a60 crc :-1 s=READY pgs=137 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564e57d60680 0x564e57dd3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564e57d55dc0 0x564e57d68f30 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 --2- 172.21.15.70:0/942829606 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564e57d554a0 0x564e57d689f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59dcff9640 0 client.16818 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 -- 172.21.15.70:0/942829606 >> 172.21.15.70:0/942829606 conn(0x564e57d51a30 msgr2=0x564e57d50220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 -- 172.21.15.70:0/942829606 shutdown_connections 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.422+0000 7f59fda50740 1 -- 172.21.15.70:0/942829606 wait complete. 2024-09-19T04:37:18.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.423+0000 7f59fda50740 20 client.16818 trim_cache size 0 max 16384 2024-09-19T04:37:18.441 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:18.441 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:37:18.441 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:37:18.441 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.423+0000 7f59fb677640 1 -- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f59e00a33b0 msgr2=0x7f59e00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.423+0000 7f59fb677640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f59e00a33b0 0x7f59e00a5870 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f59ec005e30 tx=0x7f59ec03c040 comp rx=0 tx=0).stop 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.423+0000 7f59fb677640 1 -- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102570 msgr2=0x7f59f41989f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.423+0000 7f59fb677640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102570 0x7f59f41989f0 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f59e400d950 tx=0x7f59e400de10 comp rx=0 tx=0).stop 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.424+0000 7f59fb677640 1 -- 172.21.15.70:0/78157404 shutdown_connections 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.424+0000 7f59fb677640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f59e00a33b0 0x7f59e00a5870 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.424+0000 7f59fb677640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f59f4102ef0 0x7f59f419cd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.424+0000 7f59fb677640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f59f4102570 0x7f59f41989f0 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.424+0000 7f59fb677640 1 --2- 172.21.15.70:0/78157404 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f59f4100e20 0x7f59f41984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:18.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.424+0000 7f59fb677640 1 -- 172.21.15.70:0/78157404 >> 172.21.15.70:0/78157404 conn(0x7f59f40fc7d0 msgr2=0x7f59f40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:18.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.424+0000 7f59fb677640 1 -- 172.21.15.70:0/78157404 shutdown_connections 2024-09-19T04:37:18.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:18.424+0000 7f59fb677640 1 -- 172.21.15.70:0/78157404 wait complete. 2024-09-19T04:37:19.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:18 smithi134 ceph-mon[34525]: pgmap v201: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:19.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:18 smithi070 ceph-mon[30942]: pgmap v201: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:19.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:18 smithi167 ceph-mon[34339]: pgmap v201: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:19.218 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:37:19.218 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:37:19.462 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 -- 172.21.15.70:0/1541645566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 msgr2=0x7f6a601067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 --2- 172.21.15.70:0/1541645566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 0x7f6a601067e0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009900 tx=0x7f6a5402a410 comp rx=0 tx=0).stop 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 -- 172.21.15.70:0/1541645566 shutdown_connections 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 --2- 172.21.15.70:0/1541645566 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60106f10 0x7f6a6010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 --2- 172.21.15.70:0/1541645566 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 0x7f6a601067e0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 --2- 172.21.15.70:0/1541645566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a60101de0 0x7f6a601021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 -- 172.21.15.70:0/1541645566 >> 172.21.15.70:0/1541645566 conn(0x7f6a600fd8c0 msgr2=0x7f6a600ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 -- 172.21.15.70:0/1541645566 shutdown_connections 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 -- 172.21.15.70:0/1541645566 wait complete. 2024-09-19T04:37:19.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.863+0000 7f6a664b0640 1 Processor -- start 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a664b0640 1 -- start start 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a664b0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60101de0 0x7f6a601985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a664b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 0x7f6a60198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a664b0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a60106f10 0x7f6a6019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a664b0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6a60112000 con 0x7f6a60102790 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a664b0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6a60111e80 con 0x7f6a60106f10 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a664b0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6a60112180 con 0x7f6a60101de0 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 0x7f6a60198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 0x7f6a60198ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39950/0 (socket says 172.21.15.70:39950) 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5f7fe640 1 -- 172.21.15.70:0/2355282154 learned_addr learned my addr 172.21.15.70:0/2355282154 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5ffff640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60101de0 0x7f6a601985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5f7fe640 1 -- 172.21.15.70:0/2355282154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60101de0 msgr2=0x7f6a601985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:19.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5f7fe640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60101de0 0x7f6a601985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5f7fe640 1 -- 172.21.15.70:0/2355282154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a60106f10 msgr2=0x7f6a6019ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5f7fe640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a60106f10 0x7f6a6019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.864+0000 7f6a5f7fe640 1 -- 172.21.15.70:0/2355282154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a6019d550 con 0x7f6a60102790 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.865+0000 7f6a5f7fe640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 0x7f6a60198ae0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009a20 tx=0x7f6a540043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.865+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/2355282154 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a5403f030 con 0x7f6a60102790 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.865+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a6019d7e0 con 0x7f6a60102790 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.865+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/2355282154 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6a54031b80 con 0x7f6a60102790 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.865+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/2355282154 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a54035070 con 0x7f6a60102790 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.865+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a601a5120 con 0x7f6a60102790 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.866+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a60102240 con 0x7f6a60102790 2024-09-19T04:37:19.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.867+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/2355282154 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6a540035f0 con 0x7f6a60102790 2024-09-19T04:37:19.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.868+0000 7f6a5d7fa640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6a480a33b0 0x7f6a480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:19.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.868+0000 7f6a5ffff640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6a480a33b0 0x7f6a480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:19.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.868+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/2355282154 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f6a540f0810 con 0x7f6a60102790 2024-09-19T04:37:19.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.868+0000 7f6a5ffff640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6a480a33b0 0x7f6a480a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009990 tx=0x7f6a50009110 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:19.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:19.872+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/2355282154 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f6a540bd1f0 con 0x7f6a60102790 2024-09-19T04:37:20.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.071+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6a6010a150 con 0x7f6a60102790 2024-09-19T04:37:20.073 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.072+0000 7f6a5d7fa640 1 -- 172.21.15.70:0/2355282154 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f6a540bcaf0 con 0x7f6a60102790 2024-09-19T04:37:20.074 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:37:20.074 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:37:20.074 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:37:20.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6a480a33b0 msgr2=0x7f6a480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:20.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6a480a33b0 0x7f6a480a5870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6a50009990 tx=0x7f6a50009110 comp rx=0 tx=0).stop 2024-09-19T04:37:20.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 msgr2=0x7f6a60198ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:20.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 0x7f6a60198ae0 secure :-1 s=READY pgs=859 cs=0 l=1 rev1=1 crypto rx=0x7f6a54009a20 tx=0x7f6a540043b0 comp rx=0 tx=0).stop 2024-09-19T04:37:20.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 shutdown_connections 2024-09-19T04:37:20.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6a480a33b0 0x7f6a480a5870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:20.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a60106f10 0x7f6a6019ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:20.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6a60102790 0x7f6a60198ae0 unknown :-1 s=CLOSED pgs=859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:20.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 --2- 172.21.15.70:0/2355282154 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6a60101de0 0x7f6a601985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:20.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 >> 172.21.15.70:0/2355282154 conn(0x7f6a600fd8c0 msgr2=0x7f6a600fedd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:20.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 shutdown_connections 2024-09-19T04:37:20.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:20.074+0000 7f6a664b0640 1 -- 172.21.15.70:0/2355282154 wait complete. 2024-09-19T04:37:20.382 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:20 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2355282154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:20.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:20 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2355282154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:20.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:20 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2355282154' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:20.786 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:37:21.029 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:21.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:21 smithi070 ceph-mon[30942]: pgmap v202: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:21.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:21 smithi167 ceph-mon[34339]: pgmap v202: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:21.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 -- 172.21.15.70:0/1198841229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff088103760 msgr2=0x7ff088107ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/1198841229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff088103760 0x7ff088107ba0 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff070009930 tx=0x7ff07002a420 comp rx=0 tx=0).stop 2024-09-19T04:37:21.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 -- 172.21.15.70:0/1198841229 shutdown_connections 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/1198841229 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0881082e0 0x7ff08810ec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/1198841229 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff088103760 0x7ff088107ba0 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/1198841229 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff088102db0 0x7ff088103190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 -- 172.21.15.70:0/1198841229 >> 172.21.15.70:0/1198841229 conn(0x7ff0880fc7d0 msgr2=0x7ff0880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 -- 172.21.15.70:0/1198841229 shutdown_connections 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.523+0000 7ff08dbc4640 1 -- 172.21.15.70:0/1198841229 wait complete. 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff08dbc4640 1 Processor -- start 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff08dbc4640 1 -- start start 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff08dbc4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102db0 0x7ff088198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff08dbc4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff088103760 0x7ff088198c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff08dbc4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0881082e0 0x7ff08819cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff08dbc4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff088112140 con 0x7ff0881082e0 2024-09-19T04:37:21.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff08dbc4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff088111fc0 con 0x7ff088102db0 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff08dbc4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881122c0 con 0x7ff088103760 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff087fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0881082e0 0x7ff08819cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff087fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0881082e0 0x7ff08819cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39966/0 (socket says 172.21.15.70:39966) 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff087fff640 1 -- 172.21.15.70:0/3410255509 learned_addr learned my addr 172.21.15.70:0/3410255509 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.524+0000 7ff07effd640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff088103760 0x7ff088198c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff0877fe640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102db0 0x7ff088198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff087fff640 1 -- 172.21.15.70:0/3410255509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff088103760 msgr2=0x7ff088198c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff087fff640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff088103760 0x7ff088198c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff087fff640 1 -- 172.21.15.70:0/3410255509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102db0 msgr2=0x7ff088198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff087fff640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102db0 0x7ff088198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff087fff640 1 -- 172.21.15.70:0/3410255509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff08819d6d0 con 0x7ff0881082e0 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff0877fe640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102db0 0x7ff088198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:21.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff087fff640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0881082e0 0x7ff08819cff0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff08000b970 tx=0x7ff08000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:21.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff0857fa640 1 -- 172.21.15.70:0/3410255509 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080019070 con 0x7ff0881082e0 2024-09-19T04:37:21.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff08dbc4640 1 -- 172.21.15.70:0/3410255509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff08819d9c0 con 0x7ff0881082e0 2024-09-19T04:37:21.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff0857fa640 1 -- 172.21.15.70:0/3410255509 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff08000cb40 con 0x7ff0881082e0 2024-09-19T04:37:21.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff0857fa640 1 -- 172.21.15.70:0/3410255509 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff080007650 con 0x7ff0881082e0 2024-09-19T04:37:21.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.525+0000 7ff08dbc4640 1 -- 172.21.15.70:0/3410255509 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0881a52a0 con 0x7ff0881082e0 2024-09-19T04:37:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.528+0000 7ff08ff9d740 1 Processor -- start 2024-09-19T04:37:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.528+0000 7ff0857fa640 1 -- 172.21.15.70:0/3410255509 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff08001c070 con 0x7ff0881082e0 2024-09-19T04:37:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.528+0000 7ff08ff9d740 1 -- start start 2024-09-19T04:37:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0efb40 0x55739c0ee090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0ee5d0 0x55739c0eea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0ffb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55739c0542f0 con 0x55739c0fd780 2024-09-19T04:37:21.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55739bffbcf0 con 0x55739c0efb40 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55739c0502b0 con 0x55739c0ee5d0 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0ffb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0ffb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39968/0 (socket says 172.21.15.70:39968) 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 -- 172.21.15.70:0/3450584444 learned_addr learned my addr 172.21.15.70:0/3450584444 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0efb40 0x55739c0ee090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff0877fe640 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0ee5d0 0x55739c0eea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 -- 172.21.15.70:0/3450584444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0ee5d0 msgr2=0x55739c0eea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0ee5d0 0x55739c0eea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 -- 172.21.15.70:0/3450584444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0efb40 msgr2=0x55739c0ee090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0efb40 0x55739c0ee090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 -- 172.21.15.70:0/3450584444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739bfe03a0 con 0x55739c0fd780 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff0857fa640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0740a33b0 0x7ff0740a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff07effd640 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0ffb70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff0880697d0 tx=0x7ff070005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864c396053670b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff0877fe640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0740a33b0 0x7ff0740a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.529+0000 7ff0857fa640 1 -- 172.21.15.70:0/3410255509 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7ff0800cf290 con 0x7ff0881082e0 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff07dffb640 1 -- 172.21.15.70:0/3450584444 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070035070 con 0x55739c0fd780 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff07dffb640 1 -- 172.21.15.70:0/3450584444 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff070031d10 con 0x55739c0fd780 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff07dffb640 1 -- 172.21.15.70:0/3450584444 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff070035070 con 0x55739c0fd780 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 -- 172.21.15.70:0/3450584444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 msgr2=0x55739c0ffb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff0877fe640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0740a33b0 0x7ff0740a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55739c0ebac0 tx=0x7ff078008040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0ffb70 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7ff0880697d0 tx=0x7ff070005e20 comp rx=0 tx=0).stop 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 -- 172.21.15.70:0/3450584444 shutdown_connections 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0ffb70 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0ee5d0 0x55739c0eea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/3450584444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0efb40 0x55739c0ee090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 -- 172.21.15.70:0/3450584444 >> 172.21.15.70:0/3450584444 conn(0x55739c0b7310 msgr2=0x55739c0eac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 -- 172.21.15.70:0/3450584444 shutdown_connections 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.530+0000 7ff08ff9d740 1 -- 172.21.15.70:0/3450584444 wait complete. 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 1 -- start start 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 1 Processor -- start 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c0fd180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c0fa430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 0x55739c0faa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55739c100420 con 0x55739c0efb40 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55739c00f060 con 0x55739c0ee5d0 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55739c1005a0 con 0x55739c0fd780 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff08ff9d740 10 client.0 _ll_register_callbacks cb 0x55739bd628c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff07effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c0fa430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff07effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c0fa430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39974/0 (socket says 172.21.15.70:39974) 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.531+0000 7ff07effd640 1 -- 172.21.15.70:0/382223637 learned_addr learned my addr 172.21.15.70:0/382223637 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff0877fe640 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c0fd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff087fff640 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 0x55739c0faa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff07effd640 1 -- 172.21.15.70:0/382223637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 msgr2=0x55739c0faa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff07effd640 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 0x55739c0faa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff07effd640 1 -- 172.21.15.70:0/382223637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 msgr2=0x55739c0fd180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:21.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff07effd640 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c0fd180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff07effd640 1 -- 172.21.15.70:0/382223637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739bdc53c0 con 0x55739c0efb40 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff0877fe640 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c0fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff07effd640 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c0fa430 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff07002a940 tx=0x7ff0700056e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9797c470fb6702b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff066ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff066ffd640 1 -- 172.21.15.70:0/382223637 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07004e070 con 0x55739c0efb40 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff066ffd640 1 -- 172.21.15.70:0/382223637 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7ff07003d660 con 0x55739c0efb40 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff08ff9d740 1 -- 172.21.15.70:0/382223637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff070031d10 con 0x55739c0efb40 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff066ffd640 1 -- 172.21.15.70:0/382223637 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff07005a050 con 0x55739c0efb40 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff08ff9d740 10 client.16836 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff08ff9d740 1 -- 172.21.15.70:0/382223637 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55739c100420 con 0x55739c0efb40 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.532+0000 7ff066ffd640 1 -- 172.21.15.70:0/382223637 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff070031d10 con 0x55739c0efb40 2024-09-19T04:37:21.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.533+0000 7ff066ffd640 1 -- 172.21.15.70:0/382223637 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff07004a960 con 0x55739c0efb40 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.533+0000 7ff08ff9d740 10 client.16836 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.533+0000 7ff08ff9d740 10 client.16836 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.533+0000 7ff08ff9d740 20 client.16836 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.533+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55739c10d040 0x55739c10f430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.533+0000 7ff08ff9d740 4 client.16836 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.533+0000 7ff08ff9d740 1 -- 172.21.15.70:0/382223637 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55739c061860 con 0x55739c10d040 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.533+0000 7ff0877fe640 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55739c10d040 0x55739c10f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.534+0000 7ff066ffd640 10 client.16836 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:21.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.534+0000 7ff0877fe640 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55739c10d040 0x55739c10f430 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e4ea096dee7dc0be server_cookie=47bd62e9a65d642e in_seq=0 out_seq=0 2024-09-19T04:37:21.542 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:21 smithi134 ceph-mon[34525]: pgmap v202: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.534+0000 7ff066ffd640 1 -- 172.21.15.70:0/382223637 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55739c061860 con 0x55739c10d040 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.534+0000 7ff066ffd640 10 client.16836 handle_command_reply: tid=0 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.534+0000 7ff08ff9d740 1 client.16836 shutdown 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.534+0000 7ff08ff9d740 1 -- 172.21.15.70:0/382223637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 msgr2=0x55739c0fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.534+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c0fa430 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7ff07002a940 tx=0x7ff0700056e0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 1 -- 172.21.15.70:0/382223637 shutdown_connections 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55739c10d040 0x55739c10f430 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 0x55739c0faa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c0fa430 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/382223637 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c0fd180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 1 -- 172.21.15.70:0/382223637 >> 172.21.15.70:0/382223637 conn(0x55739c0b7310 msgr2=0x55739c0f0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff066ffd640 0 client.16836 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:21.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 1 -- 172.21.15.70:0/382223637 shutdown_connections 2024-09-19T04:37:21.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 1 -- 172.21.15.70:0/382223637 wait complete. 2024-09-19T04:37:21.544 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.535+0000 7ff08ff9d740 20 client.16836 trim_cache size 0 max 16384 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.547+0000 7ff08ff9d740 1 Processor -- start 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff08ff9d740 1 -- start start 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c0ead70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0efb40 0x55739c1096c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0f9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881adec0 con 0x55739c0fd780 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881ab790 con 0x55739c0ee5d0 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881a9600 con 0x55739c0efb40 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0f9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.550 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0f9300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39986/0 (socket says 172.21.15.70:39986) 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 -- 172.21.15.70:0/1342938684 learned_addr learned my addr 172.21.15.70:0/1342938684 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 -- 172.21.15.70:0/1342938684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0efb40 msgr2=0x55739c1096c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 --2- 172.21.15.70:0/1342938684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0efb40 0x55739c1096c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 -- 172.21.15.70:0/1342938684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 msgr2=0x55739c0ead70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 --2- 172.21.15.70:0/1342938684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c0ead70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 -- 172.21.15.70:0/1342938684 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55739c0f1120 con 0x55739c0fd780 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff087fff640 1 --2- 172.21.15.70:0/1342938684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0f9300 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff08000b940 tx=0x7ff080009960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf11db6e7e765e55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff07d7fa640 1 -- 172.21.15.70:0/1342938684 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800b3020 con 0x55739c0fd780 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff07d7fa640 1 -- 172.21.15.70:0/1342938684 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff0800a42f0 con 0x55739c0fd780 2024-09-19T04:37:21.551 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.548+0000 7ff07d7fa640 1 -- 172.21.15.70:0/1342938684 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0800a3e60 con 0x55739c0fd780 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 -- 172.21.15.70:0/1342938684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 msgr2=0x55739c0f9300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/1342938684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0f9300 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7ff08000b940 tx=0x7ff080009960 comp rx=0 tx=0).stop 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 -- 172.21.15.70:0/1342938684 shutdown_connections 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/1342938684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0fd780 0x55739c0f9300 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/1342938684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0efb40 0x55739c1096c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/1342938684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c0ead70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 -- 172.21.15.70:0/1342938684 >> 172.21.15.70:0/1342938684 conn(0x55739c0b7310 msgr2=0x55739c0f8bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 -- 172.21.15.70:0/1342938684 shutdown_connections 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 -- 172.21.15.70:0/1342938684 wait complete. 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.549+0000 7ff08ff9d740 1 -- start start 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff08ff9d740 1 Processor -- start 2024-09-19T04:37:21.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c105830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c105d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff08ff9d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 0x55739c0f6aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881a9c50 con 0x55739c0efb40 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881ab0c0 con 0x55739c0ee5d0 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff08ff9d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0881aa320 con 0x55739c0fd780 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff08ff9d740 10 client.0 _ll_register_callbacks cb 0x7ff070032f30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c105d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c105d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39992/0 (socket says 172.21.15.70:39992) 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 -- 172.21.15.70:0/930975837 learned_addr learned my addr 172.21.15.70:0/930975837 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff0877fe640 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c105830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 -- 172.21.15.70:0/930975837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 msgr2=0x55739c0f6aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 0x55739c0f6aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 -- 172.21.15.70:0/930975837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 msgr2=0x55739c105830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c105830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 -- 172.21.15.70:0/930975837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55739c0f6fe0 con 0x55739c0efb40 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff07effd640 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c105d70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff07004ad60 tx=0x7ff0700095a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65c9013347b92264 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff066ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.550+0000 7ff066ffd640 1 -- 172.21.15.70:0/930975837 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff07004e070 con 0x55739c0efb40 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff066ffd640 1 -- 172.21.15.70:0/930975837 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7ff070004230 con 0x55739c0efb40 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 1 -- 172.21.15.70:0/930975837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0800a42f0 con 0x55739c0efb40 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff066ffd640 1 -- 172.21.15.70:0/930975837 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff070035030 con 0x55739c0efb40 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 10 client.16842 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 1 -- 172.21.15.70:0/930975837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55739c1772f0 con 0x55739c0efb40 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff066ffd640 1 -- 172.21.15.70:0/930975837 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff0800a42f0 con 0x55739c0efb40 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff066ffd640 1 -- 172.21.15.70:0/930975837 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff07003c8f0 con 0x55739c0efb40 2024-09-19T04:37:21.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 10 client.16842 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 10 client.16842 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 20 client.16842 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55739c177880 0x55739c179ca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 4 client.16842 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff08ff9d740 1 -- 172.21.15.70:0/930975837 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55739c05bd70 con 0x55739c177880 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.551+0000 7ff0877fe640 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55739c177880 0x55739c179ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff0877fe640 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55739c177880 0x55739c179ca0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7441fb6f5ec1901 server_cookie=8a8c8f6f7a09de64 in_seq=0 out_seq=0 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff066ffd640 10 client.16842 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff066ffd640 1 -- 172.21.15.70:0/930975837 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55739c05bd70 con 0x55739c177880 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff066ffd640 10 client.16842 handle_command_reply: tid=0 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 client.16842 shutdown 2024-09-19T04:37:21.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 -- 172.21.15.70:0/930975837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 msgr2=0x55739c105d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c105d70 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7ff07004ad60 tx=0x7ff0700095a0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 -- 172.21.15.70:0/930975837 shutdown_connections 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55739c177880 0x55739c179ca0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55739c0fd780 0x55739c0f6aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55739c0efb40 0x55739c105d70 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff066ffd640 0 client.16842 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 --2- 172.21.15.70:0/930975837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55739c0ee5d0 0x55739c105830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 -- 172.21.15.70:0/930975837 >> 172.21.15.70:0/930975837 conn(0x55739c0b7310 msgr2=0x55739c0fc4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 -- 172.21.15.70:0/930975837 shutdown_connections 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.552+0000 7ff08ff9d740 1 -- 172.21.15.70:0/930975837 wait complete. 2024-09-19T04:37:21.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08ff9d740 20 client.16842 trim_cache size 0 max 16384 2024-09-19T04:37:21.560 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:21.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 -- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0740a33b0 msgr2=0x7ff0740a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0740a33b0 0x7ff0740a5870 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x55739c0ebac0 tx=0x7ff078008040 comp rx=0 tx=0).stop 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 -- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0881082e0 msgr2=0x7ff08819cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0881082e0 0x7ff08819cff0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff08000b970 tx=0x7ff08000be30 comp rx=0 tx=0).stop 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 -- 172.21.15.70:0/3410255509 shutdown_connections 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0740a33b0 0x7ff0740a5870 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0881082e0 0x7ff08819cff0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff088103760 0x7ff088198c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 --2- 172.21.15.70:0/3410255509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff088102db0 0x7ff088198720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 -- 172.21.15.70:0/3410255509 >> 172.21.15.70:0/3410255509 conn(0x7ff0880fc7d0 msgr2=0x7ff088105e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 -- 172.21.15.70:0/3410255509 shutdown_connections 2024-09-19T04:37:21.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:21.553+0000 7ff08dbc4640 1 -- 172.21.15.70:0/3410255509 wait complete. 2024-09-19T04:37:22.395 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:37:22.643 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:22 smithi134 ceph-mon[34525]: pgmap v203: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:37:23.053 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:22 smithi070 ceph-mon[30942]: pgmap v203: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:37:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 -- 172.21.15.70:0/4028394821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 msgr2=0x7efc50101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 --2- 172.21.15.70:0/4028394821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 0x7efc50101200 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7efc40009900 tx=0x7efc4002a480 comp rx=0 tx=0).stop 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 -- 172.21.15.70:0/4028394821 shutdown_connections 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 --2- 172.21.15.70:0/4028394821 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc50102ef0 0x7efc5010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 --2- 172.21.15.70:0/4028394821 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc50102570 0x7efc501029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 --2- 172.21.15.70:0/4028394821 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 0x7efc50101200 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 -- 172.21.15.70:0/4028394821 >> 172.21.15.70:0/4028394821 conn(0x7efc500fc7d0 msgr2=0x7efc500febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 -- 172.21.15.70:0/4028394821 shutdown_connections 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 -- 172.21.15.70:0/4028394821 wait complete. 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 Processor -- start 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 -- start start 2024-09-19T04:37:23.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 0x7efc50103c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc50102570 0x7efc501041b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc50102ef0 0x7efc501046f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.133+0000 7efc56562640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc50110fb0 con 0x7efc50100e20 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc56562640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc50110e30 con 0x7efc50102ef0 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc56562640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc50111130 con 0x7efc50102570 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 0x7efc50103c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 0x7efc50103c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40006/0 (socket says 172.21.15.70:40006) 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 -- 172.21.15.70:0/999404827 learned_addr learned my addr 172.21.15.70:0/999404827 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc54aff640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc50102ef0 0x7efc501046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc47fff640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc50102570 0x7efc501041b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 -- 172.21.15.70:0/999404827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc50102570 msgr2=0x7efc501041b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc50102570 0x7efc501041b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 -- 172.21.15.70:0/999404827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc50102ef0 msgr2=0x7efc501046f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc50102ef0 0x7efc501046f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 -- 172.21.15.70:0/999404827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc501a6a70 con 0x7efc50100e20 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc47fff640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc50102570 0x7efc501041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4ffff640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 0x7efc50103c70 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efc40005940 tx=0x7efc40004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4dffb640 1 -- 172.21.15.70:0/999404827 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4003f030 con 0x7efc50100e20 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4dffb640 1 -- 172.21.15.70:0/999404827 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efc40003ac0 con 0x7efc50100e20 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc4dffb640 1 -- 172.21.15.70:0/999404827 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc40035070 con 0x7efc50100e20 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc56562640 1 -- 172.21.15.70:0/999404827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc501a6d00 con 0x7efc50100e20 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.134+0000 7efc56562640 1 -- 172.21.15.70:0/999404827 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc501a7190 con 0x7efc50100e20 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.136+0000 7efc4dffb640 1 -- 172.21.15.70:0/999404827 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7efc40042030 con 0x7efc50100e20 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc5893b740 1 Processor -- start 2024-09-19T04:37:23.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc5893b740 1 -- start start 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc5893b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9fb40 0x55f5dcc9e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc4dffb640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efc3c0a33b0 0x7efc3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc5893b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 0x55f5dcc9ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc5893b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcca9370 0x55f5dccab760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc5893b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5dcc042f0 con 0x55f5dcc9fb40 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc5893b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f5dcbabcf0 con 0x55f5dcca9370 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc5893b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5dcc002b0 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc54aff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9fb40 0x55f5dcc9e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc4ffff640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efc3c0a33b0 0x7efc3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc54aff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9fb40 0x55f5dcc9e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40012/0 (socket says 172.21.15.70:40012) 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc54aff640 1 -- 172.21.15.70:0/4070773843 learned_addr learned my addr 172.21.15.70:0/4070773843 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.137+0000 7efc47fff640 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 0x55f5dcc9ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc54aff640 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcca9370 0x55f5dccab760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc4dffb640 1 -- 172.21.15.70:0/999404827 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7efc400f0640 con 0x7efc50100e20 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc54aff640 1 -- 172.21.15.70:0/4070773843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 msgr2=0x55f5dcc9ea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc54aff640 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 0x55f5dcc9ea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc54aff640 1 -- 172.21.15.70:0/4070773843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcca9370 msgr2=0x55f5dccab760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc54aff640 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcca9370 0x55f5dccab760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc54aff640 1 -- 172.21.15.70:0/4070773843 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5dcb903a0 con 0x55f5dcc9fb40 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc54aff640 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9fb40 0x55f5dcc9e090 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x55f5dcc9f070 tx=0x7efc480099c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc022fcdf73f321 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc4ffff640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efc3c0a33b0 0x7efc3c0a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc400b8d20 tx=0x7efc400bf040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc467fc640 1 -- 172.21.15.70:0/4070773843 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4800c2d0 con 0x55f5dcc9fb40 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc467fc640 1 -- 172.21.15.70:0/4070773843 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efc48010030 con 0x55f5dcc9fb40 2024-09-19T04:37:23.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.138+0000 7efc467fc640 1 -- 172.21.15.70:0/4070773843 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4800aae0 con 0x55f5dcc9fb40 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 -- 172.21.15.70:0/4070773843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9fb40 msgr2=0x55f5dcc9e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9fb40 0x55f5dcc9e090 secure :-1 s=READY pgs=868 cs=0 l=1 rev1=1 crypto rx=0x55f5dcc9f070 tx=0x7efc480099c0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 -- 172.21.15.70:0/4070773843 shutdown_connections 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcca9370 0x55f5dccab760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 0x55f5dcc9ea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 --2- 172.21.15.70:0/4070773843 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9fb40 0x55f5dcc9e090 unknown :-1 s=CLOSED pgs=868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 -- 172.21.15.70:0/4070773843 >> 172.21.15.70:0/4070773843 conn(0x55f5dcc67310 msgr2=0x55f5dcc9ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 -- 172.21.15.70:0/4070773843 shutdown_connections 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.139+0000 7efc5893b740 1 -- 172.21.15.70:0/4070773843 wait complete. 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 1 -- start start 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 1 Processor -- start 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9e5d0 0x55f5dcca8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5dccac070 con 0x55f5dcca9370 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f5dcbbf060 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5dccac1f0 con 0x55f5dcc9fb40 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc5893b740 10 client.0 _ll_register_callbacks cb 0x55f5dc9128c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc54aff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc54aff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40016/0 (socket says 172.21.15.70:40016) 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc54aff640 1 -- 172.21.15.70:0/431015684 learned_addr learned my addr 172.21.15.70:0/431015684 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc54aff640 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9e5d0 0x55f5dcca8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.140+0000 7efc47fff640 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc54aff640 1 -- 172.21.15.70:0/431015684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9fb40 msgr2=0x55f5dcca5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc54aff640 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc54aff640 1 -- 172.21.15.70:0/431015684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9e5d0 msgr2=0x55f5dcca8d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:23.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc54aff640 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9e5d0 0x55f5dcca8d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc54aff640 1 -- 172.21.15.70:0/431015684 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5dc9753c0 con 0x55f5dcca9370 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc47fff640 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc54aff640 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca6570 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efc48007080 tx=0x7efc4800e040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb855cabd2fc9171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc2f7fe640 1 -- 172.21.15.70:0/431015684 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4801f030 con 0x55f5dcca9370 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc2f7fe640 1 -- 172.21.15.70:0/431015684 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7efc4800c210 con 0x55f5dcca9370 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 1 -- 172.21.15.70:0/431015684 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc48010030 con 0x55f5dcca9370 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc2f7fe640 1 -- 172.21.15.70:0/431015684 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efc4800a8c0 con 0x55f5dcca9370 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 10 client.16854 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 1 -- 172.21.15.70:0/431015684 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f5dccb7af0 con 0x55f5dcca9370 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc2f7fe640 1 -- 172.21.15.70:0/431015684 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efc48010030 con 0x55f5dcca9370 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc2f7fe640 1 -- 172.21.15.70:0/431015684 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7efc4802c4c0 con 0x55f5dcca9370 2024-09-19T04:37:23.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 10 client.16854 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:23.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 10 client.16854 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:23.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 20 client.16854 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:23.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5dccb8e40 0x55f5dccbb230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 4 client.16854 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:23.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.141+0000 7efc5893b740 1 -- 172.21.15.70:0/431015684 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f5dcc11860 con 0x55f5dccb8e40 2024-09-19T04:37:23.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.142+0000 7efc47fff640 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5dccb8e40 0x55f5dccbb230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.142+0000 7efc2f7fe640 10 client.16854 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:23.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.142+0000 7efc47fff640 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5dccb8e40 0x55f5dccbb230 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2fa1394144e7c597 server_cookie=7c633ea4bdc05288 in_seq=0 out_seq=0 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc2f7fe640 1 -- 172.21.15.70:0/431015684 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f5dcc11860 con 0x55f5dccb8e40 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc2f7fe640 10 client.16854 handle_command_reply: tid=0 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 client.16854 shutdown 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 -- 172.21.15.70:0/431015684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 msgr2=0x55f5dcca6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca6570 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7efc48007080 tx=0x7efc4800e040 comp rx=0 tx=0).stop 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 -- 172.21.15.70:0/431015684 shutdown_connections 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5dccb8e40 0x55f5dccbb230 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca6570 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 --2- 172.21.15.70:0/431015684 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9e5d0 0x55f5dcca8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 -- 172.21.15.70:0/431015684 >> 172.21.15.70:0/431015684 conn(0x55f5dcc67310 msgr2=0x55f5dcca0930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:23.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc2f7fe640 0 client.16854 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 -- 172.21.15.70:0/431015684 shutdown_connections 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.143+0000 7efc5893b740 1 -- 172.21.15.70:0/431015684 wait complete. 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.144+0000 7efc5893b740 20 client.16854 trim_cache size 0 max 16384 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.156+0000 7efc5893b740 1 Processor -- start 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.156+0000 7efc5893b740 1 -- start start 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.156+0000 7efc5893b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb5340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.156+0000 7efc5893b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.156+0000 7efc5893b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.156+0000 7efc5893b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc501b2330 con 0x55f5dcca9370 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.156+0000 7efc5893b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc501afc00 con 0x55f5dcc9fb40 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.156+0000 7efc5893b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc501ada70 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40030/0 (socket says 172.21.15.70:40030) 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 -- 172.21.15.70:0/3249393297 learned_addr learned my addr 172.21.15.70:0/3249393297 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc47fff640 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb5340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 -- 172.21.15.70:0/3249393297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 msgr2=0x55f5dccb5340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb5340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 -- 172.21.15.70:0/3249393297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 msgr2=0x55f5dcca1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 -- 172.21.15.70:0/3249393297 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5dcca1ba0 con 0x55f5dcca9370 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc47fff640 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc54aff640 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca1660 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efc4802dff0 tx=0x7efc4802df40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ada5abfff8fdf4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc45ffb640 1 -- 172.21.15.70:0/3249393297 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48038070 con 0x55f5dcca9370 2024-09-19T04:37:23.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc45ffb640 1 -- 172.21.15.70:0/3249393297 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efc48010040 con 0x55f5dcca9370 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.157+0000 7efc45ffb640 1 -- 172.21.15.70:0/3249393297 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc4801f070 con 0x55f5dcca9370 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 -- 172.21.15.70:0/3249393297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 msgr2=0x55f5dcca1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca1660 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7efc4802dff0 tx=0x7efc4802df40 comp rx=0 tx=0).stop 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 -- 172.21.15.70:0/3249393297 shutdown_connections 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcca9370 0x55f5dcca1660 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dcca1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 --2- 172.21.15.70:0/3249393297 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb5340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 -- 172.21.15.70:0/3249393297 >> 172.21.15.70:0/3249393297 conn(0x55f5dcc67310 msgr2=0x55f5dcca50c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 -- 172.21.15.70:0/3249393297 shutdown_connections 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 -- 172.21.15.70:0/3249393297 wait complete. 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 -- start start 2024-09-19T04:37:23.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.158+0000 7efc5893b740 1 Processor -- start 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dccb1bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcca9370 0x55f5dccaca40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efc501ae0c0 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efc501af530 con 0x55f5dcc9fb40 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efc501ae790 con 0x55f5dcca9370 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 10 client.0 _ll_register_callbacks cb 0x7efc3800b2c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb1680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40044/0 (socket says 172.21.15.70:40044) 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 -- 172.21.15.70:0/3879231121 learned_addr learned my addr 172.21.15.70:0/3879231121 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc47fff640 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dccb1bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 -- 172.21.15.70:0/3879231121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcca9370 msgr2=0x55f5dccaca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:23.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcca9370 0x55f5dccaca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 -- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 msgr2=0x55f5dccb1bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dccb1bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 -- 172.21.15.70:0/3879231121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5dccad270 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc47fff640 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dccb1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc54aff640 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb1680 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efc4800c270 tx=0x7efc4802ce60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5850bcedd805c7fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc2f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc2f7fe640 1 -- 172.21.15.70:0/3879231121 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efc48038070 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc2f7fe640 1 -- 172.21.15.70:0/3879231121 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7efc4800ac60 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 1 -- 172.21.15.70:0/3879231121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7efc48010040 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc2f7fe640 1 -- 172.21.15.70:0/3879231121 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7efc4801f040 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 10 client.16860 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.159+0000 7efc5893b740 1 -- 172.21.15.70:0/3879231121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f5dcd23300 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc2f7fe640 1 -- 172.21.15.70:0/3879231121 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efc48010040 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc2f7fe640 1 -- 172.21.15.70:0/3879231121 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7efc4803b030 con 0x55f5dcc9e5d0 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc5893b740 10 client.16860 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc5893b740 10 client.16860 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc5893b740 20 client.16860 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc5893b740 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5dcd23960 0x55f5dcd25d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc5893b740 4 client.16860 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc5893b740 1 -- 172.21.15.70:0/3879231121 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f5dcc0bd70 con 0x55f5dcd23960 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc47fff640 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5dcd23960 0x55f5dcd25d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc2f7fe640 10 client.16860 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.160+0000 7efc47fff640 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5dcd23960 0x55f5dcd25d50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f4a8fb1a315af242 server_cookie=1a841729c2098cfe in_seq=0 out_seq=0 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc2f7fe640 1 -- 172.21.15.70:0/3879231121 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f5dcc0bd70 con 0x55f5dcd23960 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc2f7fe640 10 client.16860 handle_command_reply: tid=0 2024-09-19T04:37:23.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 client.16860 shutdown 2024-09-19T04:37:23.188 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 -- 172.21.15.70:0/3879231121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9e5d0 msgr2=0x55f5dccb1680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb1680 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7efc4800c270 tx=0x7efc4802ce60 comp rx=0 tx=0).stop 2024-09-19T04:37:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 -- 172.21.15.70:0/3879231121 shutdown_connections 2024-09-19T04:37:23.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55f5dcd23960 0x55f5dcd25d50 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5dcca9370 0x55f5dccaca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5dcc9fb40 0x55f5dccb1bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc2f7fe640 0 client.16860 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 --2- 172.21.15.70:0/3879231121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5dcc9e5d0 0x55f5dccb1680 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 -- 172.21.15.70:0/3879231121 >> 172.21.15.70:0/3879231121 conn(0x55f5dcc67310 msgr2=0x55f5dcc994e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 -- 172.21.15.70:0/3879231121 shutdown_connections 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 1 -- 172.21.15.70:0/3879231121 wait complete. 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.161+0000 7efc5893b740 20 client.16860 trim_cache size 0 max 16384 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 -- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efc3c0a33b0 msgr2=0x7efc3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efc3c0a33b0 0x7efc3c0a5870 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7efc400b8d20 tx=0x7efc400bf040 comp rx=0 tx=0).stop 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 -- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 msgr2=0x7efc50103c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 0x7efc50103c70 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7efc40005940 tx=0x7efc40004270 comp rx=0 tx=0).stop 2024-09-19T04:37:23.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 -- 172.21.15.70:0/999404827 shutdown_connections 2024-09-19T04:37:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efc3c0a33b0 0x7efc3c0a5870 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc50102ef0 0x7efc501046f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efc50102570 0x7efc501041b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 --2- 172.21.15.70:0/999404827 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efc50100e20 0x7efc50103c70 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 -- 172.21.15.70:0/999404827 >> 172.21.15.70:0/999404827 conn(0x7efc500fc7d0 msgr2=0x7efc50105f90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 -- 172.21.15.70:0/999404827 shutdown_connections 2024-09-19T04:37:23.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:23.162+0000 7efc56562640 1 -- 172.21.15.70:0/999404827 wait complete. 2024-09-19T04:37:23.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:22 smithi167 ceph-mon[34339]: pgmap v203: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:37:23.912 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:37:24.157 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 -- 172.21.15.70:0/273895808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a410c180 msgr2=0x7f13a410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/273895808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a410c180 0x7f13a410e610 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f139c009ca0 tx=0x7f139c02a950 comp rx=0 tx=0).stop 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 -- 172.21.15.70:0/273895808 shutdown_connections 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/273895808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a410c180 0x7f13a410e610 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/273895808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13a4103700 0x7f13a410bbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/273895808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a4102de0 0x7f13a41031c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 -- 172.21.15.70:0/273895808 >> 172.21.15.70:0/273895808 conn(0x7f13a40fc7a0 msgr2=0x7f13a40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 -- 172.21.15.70:0/273895808 shutdown_connections 2024-09-19T04:37:24.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.592+0000 7f13ab7b4640 1 -- 172.21.15.70:0/273895808 wait complete. 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13ab7b4640 1 Processor -- start 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13ab7b4640 1 -- start start 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13ab7b4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a4102de0 0x7f13a4100a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13ab7b4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a4103700 0x7f13a4100f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13ab7b4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13a410c180 0x7f13a41014c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13ab7b4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13a4112020 con 0x7f13a4103700 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13ab7b4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13a4111ea0 con 0x7f13a410c180 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13ab7b4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13a41121a0 con 0x7f13a4102de0 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13a8d4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a4103700 0x7f13a4100f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13a8d4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a4103700 0x7f13a4100f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44686/0 (socket says 172.21.15.70:44686) 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.593+0000 7f13a8d4f640 1 -- 172.21.15.70:0/1065374458 learned_addr learned my addr 172.21.15.70:0/1065374458 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a9d51640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13a410c180 0x7f13a41014c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a9550640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a4102de0 0x7f13a4100a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a8d4f640 1 -- 172.21.15.70:0/1065374458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a4102de0 msgr2=0x7f13a4100a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a4102de0 0x7f13a4100a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a8d4f640 1 -- 172.21.15.70:0/1065374458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13a410c180 msgr2=0x7f13a41014c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13a410c180 0x7f13a41014c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a8d4f640 1 -- 172.21.15.70:0/1065374458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13a41a6a00 con 0x7f13a4103700 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a9550640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a4102de0 0x7f13a4100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a4103700 0x7f13a4100f80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f139400b4a0 tx=0x7f139400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f139a7fc640 1 -- 172.21.15.70:0/1065374458 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394014070 con 0x7f13a4103700 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f139a7fc640 1 -- 172.21.15.70:0/1065374458 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1394010ae0 con 0x7f13a4103700 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13ab7b4640 1 -- 172.21.15.70:0/1065374458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13a41a6cf0 con 0x7f13a4103700 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f139a7fc640 1 -- 172.21.15.70:0/1065374458 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1394017c70 con 0x7f13a4103700 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.594+0000 7f13ab7b4640 1 -- 172.21.15.70:0/1065374458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13a41a71d0 con 0x7f13a4103700 2024-09-19T04:37:24.625 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.596+0000 7f139a7fc640 1 -- 172.21.15.70:0/1065374458 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1394017070 con 0x7f13a4103700 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13adb8d740 1 Processor -- start 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13adb8d740 1 -- start start 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df36090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df365d0 0x55ec7df36a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df43760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13adb8d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec7de9c2f0 con 0x55ec7df37b40 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13adb8d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec7de43cf0 con 0x55ec7df365d0 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13adb8d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec7de982b0 con 0x55ec7df41370 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f139a7fc640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f13900a33b0 0x7f13900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13a9d51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df36090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13a9d51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df36090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44700/0 (socket says 172.21.15.70:44700) 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13a9d51640 1 -- 172.21.15.70:0/1184992148 learned_addr learned my addr 172.21.15.70:0/1184992148 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:24.626 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13a9d51640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f13900a33b0 0x7f13900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f139a7fc640 1 -- 172.21.15.70:0/1065374458 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f13940cef90 con 0x7f13a4103700 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.597+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/1184992148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df43760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f13a9d51640 1 -- 172.21.15.70:0/1184992148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 msgr2=0x55ec7df43760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f13a9d51640 1 --2- 172.21.15.70:0/1184992148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df43760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f13a9d51640 1 -- 172.21.15.70:0/1184992148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df365d0 msgr2=0x55ec7df36a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f13a9d51640 1 --2- 172.21.15.70:0/1184992148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df365d0 0x55ec7df36a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f13a9d51640 1 -- 172.21.15.70:0/1184992148 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec7de283a0 con 0x55ec7df37b40 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f13a9d51640 1 --2- 172.21.15.70:0/1184992148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df36090 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f139c009ca0 tx=0x7f139c02f700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56490fded43f1291 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f13a9d51640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f13900a33b0 0x7f13900a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f139c035000 tx=0x7f139c043000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f138f7fe640 1 -- 172.21.15.70:0/1184992148 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c04d020 con 0x55ec7df37b40 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f138f7fe640 1 -- 172.21.15.70:0/1184992148 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f139c0045d0 con 0x55ec7df37b40 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.598+0000 7f138f7fe640 1 -- 172.21.15.70:0/1184992148 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139c034040 con 0x55ec7df37b40 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 -- 172.21.15.70:0/1184992148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 msgr2=0x55ec7df36090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1184992148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df36090 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7f139c009ca0 tx=0x7f139c02f700 comp rx=0 tx=0).stop 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 -- 172.21.15.70:0/1184992148 shutdown_connections 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1184992148 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df43760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1184992148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df365d0 0x55ec7df36a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1184992148 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df36090 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 -- 172.21.15.70:0/1184992148 >> 172.21.15.70:0/1184992148 conn(0x55ec7deff310 msgr2=0x55ec7df32c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 -- 172.21.15.70:0/1184992148 shutdown_connections 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 -- 172.21.15.70:0/1184992148 wait complete. 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 -- start start 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.599+0000 7f13adb8d740 1 Processor -- start 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df40dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df3e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df3e810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13adb8d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ec7df44010 con 0x55ec7df365d0 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13adb8d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ec7de57060 con 0x55ec7df37b40 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13adb8d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ec7df44190 con 0x55ec7df41370 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13adb8d740 10 client.0 _ll_register_callbacks cb 0x55ec7dbaa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df40dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df40dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44708/0 (socket says 172.21.15.70:44708) 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 -- 172.21.15.70:0/1071352199 learned_addr learned my addr 172.21.15.70:0/1071352199 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df3e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9d51640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df3e810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 -- 172.21.15.70:0/1071352199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 msgr2=0x55ec7df3e810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df3e810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 -- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 msgr2=0x55ec7df3e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df3e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 -- 172.21.15.70:0/1071352199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec7dc0d3c0 con 0x55ec7df365d0 2024-09-19T04:37:24.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df3e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9d51640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df3e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13a9550640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df40dd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d160 tx=0x7f13a000d620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d94497d1e787c80e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f138cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f138cff9640 1 -- 172.21.15.70:0/1071352199 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a000de50 con 0x55ec7df365d0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f13adb8d740 1 -- 172.21.15.70:0/1071352199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f139c0045d0 con 0x55ec7df365d0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.600+0000 7f138cff9640 1 -- 172.21.15.70:0/1071352199 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f13a00125f0 con 0x55ec7df365d0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f138cff9640 1 -- 172.21.15.70:0/1071352199 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f13a0021050 con 0x55ec7df365d0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13adb8d740 10 client.16872 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13adb8d740 1 -- 172.21.15.70:0/1071352199 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ec7df4fb90 con 0x55ec7df365d0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f138cff9640 1 -- 172.21.15.70:0/1071352199 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f139c0045d0 con 0x55ec7df365d0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f138cff9640 1 -- 172.21.15.70:0/1071352199 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f13a0013b10 con 0x55ec7df365d0 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13adb8d740 10 client.16872 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:24.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13adb8d740 10 client.16872 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13adb8d740 20 client.16872 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ec7df51050 0x55ec7df534b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13adb8d740 4 client.16872 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13adb8d740 1 -- 172.21.15.70:0/1071352199 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ec7dea9860 con 0x55ec7df51050 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.601+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ec7df51050 0x55ec7df534b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.602+0000 7f138cff9640 10 client.16872 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.602+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ec7df51050 0x55ec7df534b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1cccc7411d62f48 server_cookie=dc1f183e0a682e33 in_seq=0 out_seq=0 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.602+0000 7f138cff9640 1 -- 172.21.15.70:0/1071352199 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ec7dea9860 con 0x55ec7df51050 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.602+0000 7f138cff9640 10 client.16872 handle_command_reply: tid=0 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.602+0000 7f13adb8d740 1 client.16872 shutdown 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 -- 172.21.15.70:0/1071352199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 msgr2=0x55ec7df40dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df40dd0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7f13a000d160 tx=0x7f13a000d620 comp rx=0 tx=0).stop 2024-09-19T04:37:24.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 -- 172.21.15.70:0/1071352199 shutdown_connections 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ec7df51050 0x55ec7df534b0 crc :-1 s=READY pgs=138 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df3e810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df3e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f138cff9640 0 client.16872 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 --2- 172.21.15.70:0/1071352199 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df40dd0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 -- 172.21.15.70:0/1071352199 >> 172.21.15.70:0/1071352199 conn(0x55ec7deff310 msgr2=0x55ec7df38930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 -- 172.21.15.70:0/1071352199 shutdown_connections 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 1 -- 172.21.15.70:0/1071352199 wait complete. 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.603+0000 7f13adb8d740 20 client.16872 trim_cache size 0 max 16384 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.615+0000 7f13adb8d740 1 Processor -- start 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.615+0000 7f13adb8d740 1 -- start start 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df53440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df39120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df39660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13adb8d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13a41b22f0 con 0x55ec7df365d0 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13adb8d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13a41afbc0 con 0x55ec7df37b40 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13adb8d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13a41ada30 con 0x55ec7df41370 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df53440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df53440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44712/0 (socket says 172.21.15.70:44712) 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 -- 172.21.15.70:0/4291835644 learned_addr learned my addr 172.21.15.70:0/4291835644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df39120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 -- 172.21.15.70:0/4291835644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 msgr2=0x55ec7df39660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df39660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 -- 172.21.15.70:0/4291835644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 msgr2=0x55ec7df39120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:24.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df39120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 -- 172.21.15.70:0/4291835644 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ec7df3eb80 con 0x55ec7df365d0 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df39120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f13a9550640 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df53440 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f13a0013eb0 tx=0x7f13a0007f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3711fe5623e171 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f138effd640 1 -- 172.21.15.70:0/4291835644 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a002b070 con 0x55ec7df365d0 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f138effd640 1 -- 172.21.15.70:0/4291835644 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f13a0018070 con 0x55ec7df365d0 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.616+0000 7f138effd640 1 -- 172.21.15.70:0/4291835644 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13a0012850 con 0x55ec7df365d0 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 -- 172.21.15.70:0/4291835644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 msgr2=0x55ec7df53440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df53440 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7f13a0013eb0 tx=0x7f13a0007f30 comp rx=0 tx=0).stop 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 -- 172.21.15.70:0/4291835644 shutdown_connections 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df41370 0x55ec7df39660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df37b40 0x55ec7df39120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 --2- 172.21.15.70:0/4291835644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df365d0 0x55ec7df53440 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 -- 172.21.15.70:0/4291835644 >> 172.21.15.70:0/4291835644 conn(0x55ec7deff310 msgr2=0x55ec7df2da30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:24.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 -- 172.21.15.70:0/4291835644 shutdown_connections 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 -- 172.21.15.70:0/4291835644 wait complete. 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 -- start start 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.617+0000 7f13adb8d740 1 Processor -- start 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df365d0 0x55ec7df49930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df44c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df41370 0x55ec7df451a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f13a41ae080 con 0x55ec7df37b40 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f13a41af4f0 con 0x55ec7df41370 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f13a41ae750 con 0x55ec7df365d0 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 10 client.0 _ll_register_callbacks cb 0x7f13a0007140 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df44c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df44c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44722/0 (socket says 172.21.15.70:44722) 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 -- 172.21.15.70:0/699933551 learned_addr learned my addr 172.21.15.70:0/699933551 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:24.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a9d51640 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df41370 0x55ec7df451a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 -- 172.21.15.70:0/699933551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df365d0 msgr2=0x55ec7df49930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df365d0 0x55ec7df49930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 -- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df41370 msgr2=0x55ec7df451a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df41370 0x55ec7df451a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 -- 172.21.15.70:0/699933551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ec7df45760 con 0x55ec7df37b40 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a9d51640 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df41370 0x55ec7df451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13a8d4f640 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df44c60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f139409b080 tx=0x7f139406e1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4691a2b2ec93d72 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f138cff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f138cff9640 1 -- 172.21.15.70:0/699933551 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f139401e040 con 0x55ec7df37b40 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f138cff9640 1 -- 172.21.15.70:0/699933551 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f1394010610 con 0x55ec7df37b40 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 1 -- 172.21.15.70:0/699933551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f13a0018070 con 0x55ec7df37b40 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f138cff9640 1 -- 172.21.15.70:0/699933551 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f13940a3ff0 con 0x55ec7df37b40 2024-09-19T04:37:24.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 10 client.16878 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.618+0000 7f13adb8d740 1 -- 172.21.15.70:0/699933551 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ec7dfbbb40 con 0x55ec7df37b40 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f138cff9640 1 -- 172.21.15.70:0/699933551 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f13a0018070 con 0x55ec7df37b40 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f138cff9640 1 -- 172.21.15.70:0/699933551 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f13940979f0 con 0x55ec7df37b40 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f13adb8d740 10 client.16878 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f13adb8d740 10 client.16878 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f13adb8d740 20 client.16878 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f13adb8d740 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ec7dfbc240 0x55ec7dfbe660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f13adb8d740 4 client.16878 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f13adb8d740 1 -- 172.21.15.70:0/699933551 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ec7dea3d70 con 0x55ec7dfbc240 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.619+0000 7f13a9550640 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ec7dfbc240 0x55ec7dfbe660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.620+0000 7f138cff9640 10 client.16878 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.620+0000 7f13a9550640 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ec7dfbc240 0x55ec7dfbe660 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c1ae6c903dfc68c8 server_cookie=98e0c4ad35a00b03 in_seq=0 out_seq=0 2024-09-19T04:37:24.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f138cff9640 1 -- 172.21.15.70:0/699933551 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ec7dea3d70 con 0x55ec7dfbc240 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f138cff9640 10 client.16878 handle_command_reply: tid=0 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 client.16878 shutdown 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 -- 172.21.15.70:0/699933551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 msgr2=0x55ec7df44c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df44c60 secure :-1 s=READY pgs=877 cs=0 l=1 rev1=1 crypto rx=0x7f139409b080 tx=0x7f139406e1b0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 -- 172.21.15.70:0/699933551 shutdown_connections 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ec7dfbc240 0x55ec7dfbe660 crc :-1 s=READY pgs=139 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ec7df41370 0x55ec7df451a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ec7df37b40 0x55ec7df44c60 unknown :-1 s=CLOSED pgs=877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 --2- 172.21.15.70:0/699933551 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ec7df365d0 0x55ec7df49930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 -- 172.21.15.70:0/699933551 >> 172.21.15.70:0/699933551 conn(0x55ec7deff310 msgr2=0x55ec7df31500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f138cff9640 0 client.16878 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 -- 172.21.15.70:0/699933551 shutdown_connections 2024-09-19T04:37:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 1 -- 172.21.15.70:0/699933551 wait complete. 2024-09-19T04:37:24.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.621+0000 7f13adb8d740 20 client.16878 trim_cache size 0 max 16384 2024-09-19T04:37:24.639 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 -- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f13900a33b0 msgr2=0x7f13900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f13900a33b0 0x7f13900a5870 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f139c035000 tx=0x7f139c043000 comp rx=0 tx=0).stop 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 -- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a4103700 msgr2=0x7f13a4100f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a4103700 0x7f13a4100f80 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f139400b4a0 tx=0x7f139400b960 comp rx=0 tx=0).stop 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 -- 172.21.15.70:0/1065374458 shutdown_connections 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f13900a33b0 0x7f13900a5870 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13a410c180 0x7f13a41014c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f13a4103700 0x7f13a4100f80 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 --2- 172.21.15.70:0/1065374458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f13a4102de0 0x7f13a4100a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 -- 172.21.15.70:0/1065374458 >> 172.21.15.70:0/1065374458 conn(0x7f13a40fc7a0 msgr2=0x7f13a40fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 -- 172.21.15.70:0/1065374458 shutdown_connections 2024-09-19T04:37:24.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:24.622+0000 7f13ab7b4640 1 -- 172.21.15.70:0/1065374458 wait complete. 2024-09-19T04:37:24.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:24 smithi070 ceph-mon[30942]: pgmap v204: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:37:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:24 smithi134 ceph-mon[34525]: pgmap v204: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:37:25.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:24 smithi167 ceph-mon[34339]: pgmap v204: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:37:26.396 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:37:26.397 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:37:26.659 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:26.996 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:26 smithi070 ceph-mon[30942]: pgmap v205: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:37:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:26 smithi134 ceph-mon[34525]: pgmap v205: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:37:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.080+0000 7f3d2744b640 1 -- 172.21.15.70:0/4256318509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 msgr2=0x7f3d20106810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.080+0000 7f3d2744b640 1 --2- 172.21.15.70:0/4256318509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 0x7f3d20106810 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7f3d10009900 tx=0x7f3d1002a410 comp rx=0 tx=0).stop 2024-09-19T04:37:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.080+0000 7f3d2744b640 1 -- 172.21.15.70:0/4256318509 shutdown_connections 2024-09-19T04:37:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.080+0000 7f3d2744b640 1 --2- 172.21.15.70:0/4256318509 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d20106f40 0x7f3d2010eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.080+0000 7f3d2744b640 1 --2- 172.21.15.70:0/4256318509 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 0x7f3d20106810 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.080+0000 7f3d2744b640 1 --2- 172.21.15.70:0/4256318509 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d20101e10 0x7f3d201021f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.080+0000 7f3d2744b640 1 -- 172.21.15.70:0/4256318509 >> 172.21.15.70:0/4256318509 conn(0x7f3d200fd8d0 msgr2=0x7f3d200ffcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.080+0000 7f3d2744b640 1 -- 172.21.15.70:0/4256318509 shutdown_connections 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 -- 172.21.15.70:0/4256318509 wait complete. 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 Processor -- start 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 -- start start 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d20101e10 0x7f3d200744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 0x7f3d20074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d20106f40 0x7f3d20074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20111f70 con 0x7f3d201027c0 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3d20111df0 con 0x7f3d20106f40 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.081+0000 7f3d2744b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201120f0 con 0x7f3d20101e10 2024-09-19T04:37:27.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 0x7f3d20074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 0x7f3d20074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44738/0 (socket says 172.21.15.70:44738) 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 -- 172.21.15.70:0/3987538812 learned_addr learned my addr 172.21.15.70:0/3987538812 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d259e8640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d20106f40 0x7f3d20074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d251e7640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d20101e10 0x7f3d200744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 -- 172.21.15.70:0/3987538812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d20101e10 msgr2=0x7f3d200744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d20101e10 0x7f3d200744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 -- 172.21.15.70:0/3987538812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d20106f40 msgr2=0x7f3d20074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d20106f40 0x7f3d20074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 -- 172.21.15.70:0/3987538812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3d201a6950 con 0x7f3d201027c0 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d249e6640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 0x7f3d20074a30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3d100314b0 tx=0x7f3d10004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d167fc640 1 -- 172.21.15.70:0/3987538812 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1003f030 con 0x7f3d201027c0 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d167fc640 1 -- 172.21.15.70:0/3987538812 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d10003ac0 con 0x7f3d201027c0 2024-09-19T04:37:27.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d2744b640 1 -- 172.21.15.70:0/3987538812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3d201a6be0 con 0x7f3d201027c0 2024-09-19T04:37:27.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d167fc640 1 -- 172.21.15.70:0/3987538812 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10035070 con 0x7f3d201027c0 2024-09-19T04:37:27.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.082+0000 7f3d2744b640 1 -- 172.21.15.70:0/3987538812 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3d201a7110 con 0x7f3d201027c0 2024-09-19T04:37:27.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.085+0000 7f3d167fc640 1 -- 172.21.15.70:0/3987538812 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3d10042030 con 0x7f3d201027c0 2024-09-19T04:37:27.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.085+0000 7f3d29824740 1 Processor -- start 2024-09-19T04:37:27.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.085+0000 7f3d29824740 1 -- start start 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d167fc640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3d0c0a3430 0x7f3d0c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d29824740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff441b60 0x55daff441f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d29824740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 0x55daff44c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d29824740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff44cd40 0x55daff44f130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d29824740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55daff3a7280 con 0x55daff44cd40 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d29824740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55daff34eb10 con 0x55daff441b60 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d29824740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55daff3a3240 con 0x55daff442480 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3d0c0a3430 0x7f3d0c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d167fc640 1 -- 172.21.15.70:0/3987538812 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f3d100f00f0 con 0x7f3d201027c0 2024-09-19T04:37:27.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff44cd40 0x55daff44f130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff44cd40 0x55daff44f130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44750/0 (socket says 172.21.15.70:44750) 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 -- 172.21.15.70:0/3587419642 learned_addr learned my addr 172.21.15.70:0/3587419642 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d251e7640 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff441b60 0x55daff441f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d249e6640 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 0x55daff44c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 -- 172.21.15.70:0/3587419642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 msgr2=0x55daff44c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 0x55daff44c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 -- 172.21.15.70:0/3587419642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff441b60 msgr2=0x55daff441f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff441b60 0x55daff441f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.086+0000 7f3d259e8640 1 -- 172.21.15.70:0/3587419642 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daff35b1f0 con 0x55daff44cd40 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.087+0000 7f3d259e8640 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff44cd40 0x55daff44f130 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3d18014e80 tx=0x7f3d180117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afb54eec11ce55a4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.087+0000 7f3d259e8640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3d0c0a3430 0x7f3d0c0a58f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d18011cb0 tx=0x7f3d18016000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:27.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.087+0000 7f3d0b7fe640 1 -- 172.21.15.70:0/3587419642 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18022070 con 0x55daff44cd40 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.087+0000 7f3d0b7fe640 1 -- 172.21.15.70:0/3587419642 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d18003e40 con 0x55daff44cd40 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.087+0000 7f3d0b7fe640 1 -- 172.21.15.70:0/3587419642 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d18004350 con 0x55daff44cd40 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 -- 172.21.15.70:0/3587419642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff44cd40 msgr2=0x55daff44f130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff44cd40 0x55daff44f130 secure :-1 s=READY pgs=880 cs=0 l=1 rev1=1 crypto rx=0x7f3d18014e80 tx=0x7f3d180117b0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 -- 172.21.15.70:0/3587419642 shutdown_connections 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff44cd40 0x55daff44f130 unknown :-1 s=CLOSED pgs=880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 0x55daff44c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 --2- 172.21.15.70:0/3587419642 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff441b60 0x55daff441f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 -- 172.21.15.70:0/3587419642 >> 172.21.15.70:0/3587419642 conn(0x55daff43e0f0 msgr2=0x55daff43e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 -- 172.21.15.70:0/3587419642 shutdown_connections 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 -- 172.21.15.70:0/3587419642 wait complete. 2024-09-19T04:37:27.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 -- start start 2024-09-19T04:37:27.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.088+0000 7f3d29824740 1 Processor -- start 2024-09-19T04:37:27.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d29824740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff441b60 0x55daff449c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d29824740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 0x55daff44a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d29824740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff44a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d29824740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55daff44f910 con 0x55daff441b60 2024-09-19T04:37:27.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d29824740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55daff361f10 con 0x55daff44cd40 2024-09-19T04:37:27.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d29824740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55daff44fa90 con 0x55daff442480 2024-09-19T04:37:27.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d29824740 10 client.0 _ll_register_callbacks cb 0x55daff32aa40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:27.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff441b60 0x55daff449c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff441b60 0x55daff449c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44752/0 (socket says 172.21.15.70:44752) 2024-09-19T04:37:27.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 -- 172.21.15.70:0/2427820916 learned_addr learned my addr 172.21.15.70:0/2427820916 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:27.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d249e6640 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 0x55daff44a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d259e8640 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff44a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 -- 172.21.15.70:0/2427820916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 msgr2=0x55daff44a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:27.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 0x55daff44a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 -- 172.21.15.70:0/2427820916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 msgr2=0x55daff44a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:27.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff44a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 -- 172.21.15.70:0/2427820916 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daff1186a0 con 0x55daff441b60 2024-09-19T04:37:27.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d251e7640 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff441b60 0x55daff449c20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00baa0 tx=0x7f3d1c00bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65b343ac21744448 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:27.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:27.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d08ff9640 1 -- 172.21.15.70:0/2427820916 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d1c003eb0 con 0x55daff441b60 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d29824740 1 -- 172.21.15.70:0/2427820916 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55daff3b47f0 con 0x55daff441b60 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.089+0000 7f3d08ff9640 1 -- 172.21.15.70:0/2427820916 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f3d1c011440 con 0x55daff441b60 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d08ff9640 1 -- 172.21.15.70:0/2427820916 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3d1c011640 con 0x55daff441b60 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d29824740 10 client.16890 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d29824740 1 -- 172.21.15.70:0/2427820916 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55daff45b5f0 con 0x55daff441b60 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d08ff9640 1 -- 172.21.15.70:0/2427820916 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55daff3b47f0 con 0x55daff441b60 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d08ff9640 1 -- 172.21.15.70:0/2427820916 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3d1c01ba80 con 0x55daff441b60 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d29824740 10 client.16890 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:27.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d29824740 10 client.16890 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d29824740 20 client.16890 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d29824740 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55daff45ca00 0x55daff45ee60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d29824740 4 client.16890 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d29824740 1 -- 172.21.15.70:0/2427820916 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55daff3aed00 con 0x55daff45ca00 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.090+0000 7f3d249e6640 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55daff45ca00 0x55daff45ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.091+0000 7f3d08ff9640 10 client.16890 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.091+0000 7f3d249e6640 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55daff45ca00 0x55daff45ee60 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f9882b37cf7df848 server_cookie=c8b899527bd4e7ba in_seq=0 out_seq=0 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d08ff9640 1 -- 172.21.15.70:0/2427820916 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55daff3aed00 con 0x55daff45ca00 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d08ff9640 10 client.16890 handle_command_reply: tid=0 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 client.16890 shutdown 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 -- 172.21.15.70:0/2427820916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff441b60 msgr2=0x55daff449c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff441b60 0x55daff449c20 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f3d1c00baa0 tx=0x7f3d1c00bf60 comp rx=0 tx=0).stop 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 -- 172.21.15.70:0/2427820916 shutdown_connections 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55daff45ca00 0x55daff45ee60 crc :-1 s=READY pgs=140 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff44a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff442480 0x55daff44a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 --2- 172.21.15.70:0/2427820916 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff441b60 0x55daff449c20 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d08ff9640 0 client.16890 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 -- 172.21.15.70:0/2427820916 >> 172.21.15.70:0/2427820916 conn(0x55daff43e0f0 msgr2=0x55daff443e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 -- 172.21.15.70:0/2427820916 shutdown_connections 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 1 -- 172.21.15.70:0/2427820916 wait complete. 2024-09-19T04:37:27.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.092+0000 7f3d29824740 20 client.16890 trim_cache size 0 max 16384 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.109+0000 7f3d29824740 1 Processor -- start 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.109+0000 7f3d29824740 1 -- start start 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.109+0000 7f3d29824740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 0x55daff464780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.109+0000 7f3d29824740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff464cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.109+0000 7f3d29824740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff443600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d29824740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201b2400 con 0x55daff442480 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d29824740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201afcd0 con 0x55daff44cd40 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d29824740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201adb40 con 0x55daff441b60 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff464cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff464cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44754/0 (socket says 172.21.15.70:44754) 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 -- 172.21.15.70:0/904473133 learned_addr learned my addr 172.21.15.70:0/904473133 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:27.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d259e8640 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff443600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d251e7640 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 0x55daff464780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 -- 172.21.15.70:0/904473133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 msgr2=0x55daff464780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 0x55daff464780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 -- 172.21.15.70:0/904473133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 msgr2=0x55daff443600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff443600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 -- 172.21.15.70:0/904473133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55daff44c4f0 con 0x55daff442480 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d249e6640 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff464cc0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3d100b8ef0 tx=0x7f3d1002a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db484d5ee2816be1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d0affd640 1 -- 172.21.15.70:0/904473133 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d100a5070 con 0x55daff442480 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d0affd640 1 -- 172.21.15.70:0/904473133 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d100c50e0 con 0x55daff442480 2024-09-19T04:37:27.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.110+0000 7f3d0affd640 1 -- 172.21.15.70:0/904473133 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10049040 con 0x55daff442480 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 -- 172.21.15.70:0/904473133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 msgr2=0x55daff464cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff464cc0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f3d100b8ef0 tx=0x7f3d1002a410 comp rx=0 tx=0).stop 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 -- 172.21.15.70:0/904473133 shutdown_connections 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff443600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff464cc0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 --2- 172.21.15.70:0/904473133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 0x55daff464780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 -- 172.21.15.70:0/904473133 >> 172.21.15.70:0/904473133 conn(0x55daff43e0f0 msgr2=0x55daff448d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 -- 172.21.15.70:0/904473133 shutdown_connections 2024-09-19T04:37:27.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 -- 172.21.15.70:0/904473133 wait complete. 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.111+0000 7f3d29824740 1 -- start start 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d29824740 1 Processor -- start 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d29824740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 0x55daff451280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d29824740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff4517c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d29824740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff4c6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d29824740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201ae190 con 0x55daff442480 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d29824740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201af600 con 0x55daff44cd40 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d29824740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3d201ae860 con 0x55daff441b60 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d249e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff4517c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d29824740 10 client.0 _ll_register_callbacks cb 0x7f3d1c0040a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d249e6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff4517c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44758/0 (socket says 172.21.15.70:44758) 2024-09-19T04:37:27.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d249e6640 1 -- 172.21.15.70:0/1215487548 learned_addr learned my addr 172.21.15.70:0/1215487548 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d259e8640 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff4c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.112+0000 7f3d251e7640 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 0x55daff451280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d249e6640 1 -- 172.21.15.70:0/1215487548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 msgr2=0x55daff451280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d249e6640 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 0x55daff451280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d249e6640 1 -- 172.21.15.70:0/1215487548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 msgr2=0x55daff4c6750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d249e6640 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff4c6750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d249e6640 1 -- 172.21.15.70:0/1215487548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55daff4c6d60 con 0x55daff442480 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d249e6640 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff4517c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3d100f00c0 tx=0x7f3d100c0970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92bf2d3abf6aa620 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d08ff9640 1 -- 172.21.15.70:0/1215487548 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3d10049040 con 0x55daff442480 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d29824740 1 -- 172.21.15.70:0/1215487548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3d100c50e0 con 0x55daff442480 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d08ff9640 1 -- 172.21.15.70:0/1215487548 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f3d100b8b90 con 0x55daff442480 2024-09-19T04:37:27.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d08ff9640 1 -- 172.21.15.70:0/1215487548 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3d100a5040 con 0x55daff442480 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d29824740 10 client.16896 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d29824740 1 -- 172.21.15.70:0/1215487548 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55daff4c8060 con 0x55daff442480 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d08ff9640 1 -- 172.21.15.70:0/1215487548 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3d100c50e0 con 0x55daff442480 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d08ff9640 1 -- 172.21.15.70:0/1215487548 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3d1003bbb0 con 0x55daff442480 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d29824740 10 client.16896 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d29824740 10 client.16896 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.113+0000 7f3d29824740 20 client.16896 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.114+0000 7f3d29824740 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55daff4c8560 0x55daff4ca980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.114+0000 7f3d29824740 4 client.16896 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.114+0000 7f3d29824740 1 -- 172.21.15.70:0/1215487548 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55daff32b110 con 0x55daff4c8560 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.114+0000 7f3d251e7640 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55daff4c8560 0x55daff4ca980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.114+0000 7f3d251e7640 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55daff4c8560 0x55daff4ca980 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa10e97fd06278fd server_cookie=30b7bf249beda352 in_seq=0 out_seq=0 2024-09-19T04:37:27.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.114+0000 7f3d08ff9640 10 client.16896 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d08ff9640 1 -- 172.21.15.70:0/1215487548 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55daff32b110 con 0x55daff4c8560 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d08ff9640 10 client.16896 handle_command_reply: tid=0 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 client.16896 shutdown 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 -- 172.21.15.70:0/1215487548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 msgr2=0x55daff4517c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff4517c0 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f3d100f00c0 tx=0x7f3d100c0970 comp rx=0 tx=0).stop 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 -- 172.21.15.70:0/1215487548 shutdown_connections 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55daff4c8560 0x55daff4ca980 crc :-1 s=READY pgs=141 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55daff44cd40 0x55daff4c6750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55daff442480 0x55daff4517c0 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 --2- 172.21.15.70:0/1215487548 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55daff441b60 0x55daff451280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d29824740 1 -- 172.21.15.70:0/1215487548 >> 172.21.15.70:0/1215487548 conn(0x55daff43e0f0 msgr2=0x55daff443600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:27.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.115+0000 7f3d08ff9640 0 client.16896 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:27.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d29824740 1 -- 172.21.15.70:0/1215487548 shutdown_connections 2024-09-19T04:37:27.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d29824740 1 -- 172.21.15.70:0/1215487548 wait complete. 2024-09-19T04:37:27.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d29824740 20 client.16896 trim_cache size 0 max 16384 2024-09-19T04:37:27.122 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:37:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "f241eb6a-6ee8-467b-a1a8-0c6fb018f234", 2024-09-19T04:37:27.122 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:37:27.122 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 -- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3d0c0a3430 msgr2=0x7f3d0c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3d0c0a3430 0x7f3d0c0a58f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3d18011cb0 tx=0x7f3d18016000 comp rx=0 tx=0).stop 2024-09-19T04:37:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 -- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 msgr2=0x7f3d20074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 0x7f3d20074a30 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7f3d100314b0 tx=0x7f3d10004270 comp rx=0 tx=0).stop 2024-09-19T04:37:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 -- 172.21.15.70:0/3987538812 shutdown_connections 2024-09-19T04:37:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f3d0c0a3430 0x7f3d0c0a58f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3d20106f40 0x7f3d20074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3d201027c0 0x7f3d20074a30 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 --2- 172.21.15.70:0/3987538812 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3d20101e10 0x7f3d200744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:27.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.116+0000 7f3d2744b640 1 -- 172.21.15.70:0/3987538812 >> 172.21.15.70:0/3987538812 conn(0x7f3d200fd8d0 msgr2=0x7f3d200fec70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:27.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.117+0000 7f3d2744b640 1 -- 172.21.15.70:0/3987538812 shutdown_connections 2024-09-19T04:37:27.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:27.117+0000 7f3d2744b640 1 -- 172.21.15.70:0/3987538812 wait complete. 2024-09-19T04:37:27.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:26 smithi167 ceph-mon[34339]: pgmap v205: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:37:27.871 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:37:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:27 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:37:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:27 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:27 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:37:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:27 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:27 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:37:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:27 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:37:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:27 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:27 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:37:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:27 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:27 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:37:28.123 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:27 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:37:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:27 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:27 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:37:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:27 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:27 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:37:28.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 -- 172.21.15.70:0/1356557461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814108300 msgr2=0x7f881410ec70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 --2- 172.21.15.70:0/1356557461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814108300 0x7f881410ec70 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f880c009930 tx=0x7f880c02a420 comp rx=0 tx=0).stop 2024-09-19T04:37:28.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 -- 172.21.15.70:0/1356557461 shutdown_connections 2024-09-19T04:37:28.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 --2- 172.21.15.70:0/1356557461 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814108300 0x7f881410ec70 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 --2- 172.21.15.70:0/1356557461 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8814103780 0x7f8814107bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 --2- 172.21.15.70:0/1356557461 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814102dd0 0x7f88141031b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 -- 172.21.15.70:0/1356557461 >> 172.21.15.70:0/1356557461 conn(0x7f88140fc7d0 msgr2=0x7f88140febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 -- 172.21.15.70:0/1356557461 shutdown_connections 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 -- 172.21.15.70:0/1356557461 wait complete. 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 Processor -- start 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 -- start start 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814102dd0 0x7f88141a03f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8814103780 0x7f88141a0930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.569+0000 7f881b640640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814108300 0x7f881419a5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f881b640640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88141120a0 con 0x7f8814102dd0 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f881b640640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8814111f20 con 0x7f8814103780 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f881b640640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8814112220 con 0x7f8814108300 2024-09-19T04:37:28.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814102dd0 0x7f88141a03f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814102dd0 0x7f88141a03f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44776/0 (socket says 172.21.15.70:44776) 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 -- 172.21.15.70:0/1849733520 learned_addr learned my addr 172.21.15.70:0/1849733520 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f8819bdd640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814108300 0x7f881419a5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f8818bdb640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8814103780 0x7f88141a0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 -- 172.21.15.70:0/1849733520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814108300 msgr2=0x7f881419a5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814108300 0x7f881419a5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 -- 172.21.15.70:0/1849733520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8814103780 msgr2=0x7f88141a0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8814103780 0x7f88141a0930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 -- 172.21.15.70:0/1849733520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f881419ace0 con 0x7f8814102dd0 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88193dc640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814102dd0 0x7f88141a03f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f880400ea80 tx=0x7f880400ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88127fc640 1 -- 172.21.15.70:0/1849733520 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880400ce40 con 0x7f8814102dd0 2024-09-19T04:37:28.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f881b640640 1 -- 172.21.15.70:0/1849733520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f881419afd0 con 0x7f8814102dd0 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88127fc640 1 -- 172.21.15.70:0/1849733520 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8804005020 con 0x7f8814102dd0 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f88127fc640 1 -- 172.21.15.70:0/1849733520 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040116d0 con 0x7f8814102dd0 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.570+0000 7f881b640640 1 -- 172.21.15.70:0/1849733520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88141a72c0 con 0x7f8814102dd0 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.572+0000 7f88127fc640 1 -- 172.21.15.70:0/1849733520 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f88040051d0 con 0x7f8814102dd0 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f881da19740 1 Processor -- start 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f881da19740 1 -- start start 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f881da19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7c4a0 0x556a3bf7c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f881da19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7cdc0 0x556a3bf87140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f881da19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf87680 0x556a3bf89a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f881da19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556a3bee22e0 con 0x556a3bf87680 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f881da19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556a3be89ce0 con 0x556a3bf7c4a0 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f881da19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556a3bede2a0 con 0x556a3bf7cdc0 2024-09-19T04:37:28.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f88127fc640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f87fc0a33b0 0x7f87fc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f8818bdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf87680 0x556a3bf89a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f8818bdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf87680 0x556a3bf89a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44792/0 (socket says 172.21.15.70:44792) 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f8818bdb640 1 -- 172.21.15.70:0/2726102707 learned_addr learned my addr 172.21.15.70:0/2726102707 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f8819bdd640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f87fc0a33b0 0x7f87fc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f88127fc640 1 -- 172.21.15.70:0/1849733520 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f88040d0070 con 0x7f8814102dd0 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f88193dc640 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7cdc0 0x556a3bf87140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.573+0000 7f8819bdd640 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7c4a0 0x556a3bf7c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f8818bdb640 1 -- 172.21.15.70:0/2726102707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7cdc0 msgr2=0x556a3bf87140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f8818bdb640 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7cdc0 0x556a3bf87140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f8818bdb640 1 -- 172.21.15.70:0/2726102707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7c4a0 msgr2=0x556a3bf7c880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f8818bdb640 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7c4a0 0x556a3bf7c880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f8818bdb640 1 -- 172.21.15.70:0/2726102707 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3be6e440 con 0x556a3bf87680 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f8818bdb640 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf87680 0x556a3bf89a70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f880800b960 tx=0x7f880800be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=682b6a3653e808b4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:28.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f8819bdd640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f87fc0a33b0 0x7f87fc0a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f880c0314b0 tx=0x7f880c005fd0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f87fb7fe640 1 -- 172.21.15.70:0/2726102707 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880800ddf0 con 0x556a3bf87680 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f87fb7fe640 1 -- 172.21.15.70:0/2726102707 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f88080178f0 con 0x556a3bf87680 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.574+0000 7f87fb7fe640 1 -- 172.21.15.70:0/2726102707 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880800fa80 con 0x556a3bf87680 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 -- 172.21.15.70:0/2726102707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf87680 msgr2=0x556a3bf89a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf87680 0x556a3bf89a70 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f880800b960 tx=0x7f880800be20 comp rx=0 tx=0).stop 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 -- 172.21.15.70:0/2726102707 shutdown_connections 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf87680 0x556a3bf89a70 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7cdc0 0x556a3bf87140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 --2- 172.21.15.70:0/2726102707 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7c4a0 0x556a3bf7c880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 -- 172.21.15.70:0/2726102707 >> 172.21.15.70:0/2726102707 conn(0x556a3bf78a30 msgr2=0x556a3bf78e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 -- 172.21.15.70:0/2726102707 shutdown_connections 2024-09-19T04:37:28.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 -- 172.21.15.70:0/2726102707 wait complete. 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 -- start start 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.575+0000 7f881da19740 1 Processor -- start 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f881da19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7c4a0 0x556a3bf86f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f881da19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7cdc0 0x556a3bf84220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f881da19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf87680 0x556a3bf84760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f881da19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556a3bf8a250 con 0x556a3bf7cdc0 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f881da19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556a3be9d050 con 0x556a3bf87680 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f881da19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556a3bf8a3d0 con 0x556a3bf7c4a0 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f881da19740 10 client.0 _ll_register_callbacks cb 0x556a3bedd160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7cdc0 0x556a3bf84220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7cdc0 0x556a3bf84220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44802/0 (socket says 172.21.15.70:44802) 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 -- 172.21.15.70:0/3706246104 learned_addr learned my addr 172.21.15.70:0/3706246104 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:28.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8819bdd640 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf87680 0x556a3bf84760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f88193dc640 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7c4a0 0x556a3bf86f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 -- 172.21.15.70:0/3706246104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7c4a0 msgr2=0x556a3bf86f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7c4a0 0x556a3bf86f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 -- 172.21.15.70:0/3706246104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf87680 msgr2=0x556a3bf84760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf87680 0x556a3bf84760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 -- 172.21.15.70:0/3706246104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3bc533c0 con 0x556a3bf7cdc0 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f8818bdb640 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7cdc0 0x556a3bf84220 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f880800bfd0 tx=0x7f88080176d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a81171b6023dba32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f87f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f87f8ff9640 1 -- 172.21.15.70:0/3706246104 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8808025070 con 0x556a3bf7cdc0 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f87f8ff9640 1 -- 172.21.15.70:0/3706246104 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f8808005040 con 0x556a3bf7cdc0 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.576+0000 7f881da19740 1 -- 172.21.15.70:0/3706246104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88080178f0 con 0x556a3bf7cdc0 2024-09-19T04:37:28.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f87f8ff9640 1 -- 172.21.15.70:0/3706246104 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8808031050 con 0x556a3bf7cdc0 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f881da19740 10 client.16908 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f881da19740 1 -- 172.21.15.70:0/3706246104 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556a3bf95bc0 con 0x556a3bf7cdc0 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f87f8ff9640 1 -- 172.21.15.70:0/3706246104 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f88080178f0 con 0x556a3bf7cdc0 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f87f8ff9640 1 -- 172.21.15.70:0/3706246104 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f88080046c0 con 0x556a3bf7cdc0 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f881da19740 10 client.16908 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f881da19740 10 client.16908 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f881da19740 20 client.16908 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f881da19740 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556a3bf96f70 0x556a3bf99360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f881da19740 4 client.16908 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f881da19740 1 -- 172.21.15.70:0/3706246104 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556a3beef850 con 0x556a3bf96f70 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.577+0000 7f88193dc640 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556a3bf96f70 0x556a3bf99360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.578+0000 7f87f8ff9640 10 client.16908 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:28.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.578+0000 7f88193dc640 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556a3bf96f70 0x556a3bf99360 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c2728608d0bc6 server_cookie=98cc709dc8bbcff3 in_seq=0 out_seq=0 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.578+0000 7f87f8ff9640 1 -- 172.21.15.70:0/3706246104 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556a3beef850 con 0x556a3bf96f70 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.578+0000 7f87f8ff9640 10 client.16908 handle_command_reply: tid=0 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.578+0000 7f881da19740 1 client.16908 shutdown 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.578+0000 7f881da19740 1 -- 172.21.15.70:0/3706246104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7cdc0 msgr2=0x556a3bf84220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.578+0000 7f881da19740 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7cdc0 0x556a3bf84220 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f880800bfd0 tx=0x7f88080176d0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 1 -- 172.21.15.70:0/3706246104 shutdown_connections 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556a3bf96f70 0x556a3bf99360 crc :-1 s=READY pgs=142 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf87680 0x556a3bf84760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7cdc0 0x556a3bf84220 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f87f8ff9640 0 client.16908 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 1 --2- 172.21.15.70:0/3706246104 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf7c4a0 0x556a3bf86f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 1 -- 172.21.15.70:0/3706246104 >> 172.21.15.70:0/3706246104 conn(0x556a3bf78a30 msgr2=0x556a3bf7e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 1 -- 172.21.15.70:0/3706246104 shutdown_connections 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 1 -- 172.21.15.70:0/3706246104 wait complete. 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.579+0000 7f881da19740 20 client.16908 trim_cache size 0 max 16384 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f881da19740 1 Processor -- start 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f881da19740 1 -- start start 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f881da19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf934b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f881da19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7cdc0 0x556a3bf9e9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f881da19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 0x556a3bf9ef30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f881da19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88141b2410 con 0x556a3bf7c4a0 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f881da19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88141afce0 con 0x556a3bf7cdc0 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f881da19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f88141adb50 con 0x556a3bf87680 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf934b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf934b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44808/0 (socket says 172.21.15.70:44808) 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 -- 172.21.15.70:0/553555520 learned_addr learned my addr 172.21.15.70:0/553555520 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 -- 172.21.15.70:0/553555520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 msgr2=0x556a3bf9ef30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 --2- 172.21.15.70:0/553555520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 0x556a3bf9ef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 -- 172.21.15.70:0/553555520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7cdc0 msgr2=0x556a3bf9e9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 --2- 172.21.15.70:0/553555520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7cdc0 0x556a3bf9e9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 -- 172.21.15.70:0/553555520 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556a3bf78860 con 0x556a3bf7c4a0 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f88193dc640 1 --2- 172.21.15.70:0/553555520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf934b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f880409c2e0 tx=0x7f88040985f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db08ebc0613b184f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f87faffd640 1 -- 172.21.15.70:0/553555520 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f880401f040 con 0x556a3bf7c4a0 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f87faffd640 1 -- 172.21.15.70:0/553555520 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f88040055b0 con 0x556a3bf7c4a0 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.596+0000 7f87faffd640 1 -- 172.21.15.70:0/553555520 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040bc410 con 0x556a3bf7c4a0 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 -- 172.21.15.70:0/553555520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 msgr2=0x556a3bf934b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 --2- 172.21.15.70:0/553555520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf934b0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7f880409c2e0 tx=0x7f88040985f0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 -- 172.21.15.70:0/553555520 shutdown_connections 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 --2- 172.21.15.70:0/553555520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 0x556a3bf9ef30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 --2- 172.21.15.70:0/553555520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7cdc0 0x556a3bf9e9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 --2- 172.21.15.70:0/553555520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf934b0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 -- 172.21.15.70:0/553555520 >> 172.21.15.70:0/553555520 conn(0x556a3bf78a30 msgr2=0x556a3bf7f870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 -- 172.21.15.70:0/553555520 shutdown_connections 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 -- 172.21.15.70:0/553555520 wait complete. 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 -- start start 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.597+0000 7f881da19740 1 Processor -- start 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f881da19740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf8fe00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f881da19740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7cdc0 0x556a3bf80fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f881da19740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 0x556a3bf81530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f881da19740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f88141ae1a0 con 0x556a3bf7c4a0 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f881da19740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f88141af610 con 0x556a3bf7cdc0 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f881da19740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f88141ae870 con 0x556a3bf87680 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f881da19740 10 client.0 _ll_register_callbacks cb 0x7f8804098660 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf8fe00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf8fe00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44820/0 (socket says 172.21.15.70:44820) 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 -- 172.21.15.70:0/1569339430 learned_addr learned my addr 172.21.15.70:0/1569339430 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f8819bdd640 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 0x556a3bf81530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 -- 172.21.15.70:0/1569339430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 msgr2=0x556a3bf81530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 0x556a3bf81530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 -- 172.21.15.70:0/1569339430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7cdc0 msgr2=0x556a3bf80fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7cdc0 0x556a3bf80fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 -- 172.21.15.70:0/1569339430 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556a3bf796c0 con 0x556a3bf7c4a0 2024-09-19T04:37:28.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f88193dc640 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf8fe00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8804021040 tx=0x7f880409c250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8550fa56f9b9452 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f87f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f87f8ff9640 1 -- 172.21.15.70:0/1569339430 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040b4070 con 0x556a3bf7c4a0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f87f8ff9640 1 -- 172.21.15.70:0/1569339430 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f88040bc1b0 con 0x556a3bf7c4a0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.598+0000 7f881da19740 1 -- 172.21.15.70:0/1569339430 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f88040055b0 con 0x556a3bf7c4a0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f87f8ff9640 1 -- 172.21.15.70:0/1569339430 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f880401f070 con 0x556a3bf7c4a0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f881da19740 10 client.16914 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f881da19740 1 -- 172.21.15.70:0/1569339430 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556a3c001880 con 0x556a3bf7c4a0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f87f8ff9640 1 -- 172.21.15.70:0/1569339430 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f88040055b0 con 0x556a3bf7c4a0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f87f8ff9640 1 -- 172.21.15.70:0/1569339430 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f880400f040 con 0x556a3bf7c4a0 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f881da19740 10 client.16914 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f881da19740 10 client.16914 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f881da19740 20 client.16914 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:28.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f881da19740 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556a3c001f30 0x556a3c004320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f881da19740 4 client.16914 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f881da19740 1 -- 172.21.15.70:0/1569339430 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556a3bee9d60 con 0x556a3c001f30 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.599+0000 7f8818bdb640 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556a3c001f30 0x556a3c004320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f8818bdb640 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556a3c001f30 0x556a3c004320 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58573e7f2e34b092 server_cookie=82a619a7c3267279 in_seq=0 out_seq=0 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f87f8ff9640 10 client.16914 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f87f8ff9640 1 -- 172.21.15.70:0/1569339430 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556a3bee9d60 con 0x556a3c001f30 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f87f8ff9640 10 client.16914 handle_command_reply: tid=0 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 client.16914 shutdown 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 -- 172.21.15.70:0/1569339430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 msgr2=0x556a3bf8fe00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf8fe00 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f8804021040 tx=0x7f880409c250 comp rx=0 tx=0).stop 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 -- 172.21.15.70:0/1569339430 shutdown_connections 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556a3c001f30 0x556a3c004320 crc :-1 s=READY pgs=143 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556a3bf87680 0x556a3bf81530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.621 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556a3bf7cdc0 0x556a3bf80fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f87f8ff9640 0 client.16914 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 --2- 172.21.15.70:0/1569339430 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556a3bf7c4a0 0x556a3bf8fe00 unknown :-1 s=CLOSED pgs=889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.622 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 -- 172.21.15.70:0/1569339430 >> 172.21.15.70:0/1569339430 conn(0x556a3bf78a30 msgr2=0x556a3bf7ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:28.622 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:37:28.622 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:37:28.622 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 -- 172.21.15.70:0/1569339430 shutdown_connections 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 1 -- 172.21.15.70:0/1569339430 wait complete. 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.600+0000 7f881da19740 20 client.16914 trim_cache size 0 max 16384 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 -- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f87fc0a33b0 msgr2=0x7f87fc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f87fc0a33b0 0x7f87fc0a5870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f880c0314b0 tx=0x7f880c005fd0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 -- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814102dd0 msgr2=0x7f88141a03f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814102dd0 0x7f88141a03f0 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f880400ea80 tx=0x7f880400ef40 comp rx=0 tx=0).stop 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 -- 172.21.15.70:0/1849733520 shutdown_connections 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f87fc0a33b0 0x7f87fc0a5870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.623 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8814108300 0x7f881419a5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8814103780 0x7f88141a0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 --2- 172.21.15.70:0/1849733520 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8814102dd0 0x7f88141a03f0 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 -- 172.21.15.70:0/1849733520 >> 172.21.15.70:0/1849733520 conn(0x7f88140fc7d0 msgr2=0x7f88140fe650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 -- 172.21.15.70:0/1849733520 shutdown_connections 2024-09-19T04:37:28.624 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:28.601+0000 7f881b640640 1 -- 172.21.15.70:0/1849733520 wait complete. 2024-09-19T04:37:28.892 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:28 smithi070 ceph-mon[30942]: pgmap v206: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:37:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:28 smithi134 ceph-mon[34525]: pgmap v206: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:37:29.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:28 smithi167 ceph-mon[34339]: pgmap v206: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:37:29.289 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:37:29.290 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:37:29.536 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:30.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 -- 172.21.15.70:0/456123923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570106f10 msgr2=0x7f157010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 --2- 172.21.15.70:0/456123923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570106f10 0x7f157010ea90 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f1568009ca0 tx=0x7f156802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 -- 172.21.15.70:0/456123923 shutdown_connections 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 --2- 172.21.15.70:0/456123923 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570106f10 0x7f157010ea90 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 --2- 172.21.15.70:0/456123923 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570102790 0x7f15701067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 --2- 172.21.15.70:0/456123923 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1570101de0 0x7f15701021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 -- 172.21.15.70:0/456123923 >> 172.21.15.70:0/456123923 conn(0x7f15700fd8c0 msgr2=0x7f15700ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 -- 172.21.15.70:0/456123923 shutdown_connections 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.042+0000 7f1575c0c640 1 -- 172.21.15.70:0/456123923 wait complete. 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f1575c0c640 1 Processor -- start 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f1575c0c640 1 -- start start 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f1575c0c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570101de0 0x7f15701983e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:30.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f1575c0c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1570102790 0x7f1570198920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f1575c0c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570106f10 0x7f157019ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f1575c0c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1570111f40 con 0x7f1570101de0 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f1575c0c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1570111dc0 con 0x7f1570102790 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f1575c0c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f15701120c0 con 0x7f1570106f10 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f156f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570101de0 0x7f15701983e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f156f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570101de0 0x7f15701983e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44834/0 (socket says 172.21.15.70:44834) 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f156f7fe640 1 -- 172.21.15.70:0/2529107751 learned_addr learned my addr 172.21.15.70:0/2529107751 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.043+0000 7f156effd640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1570102790 0x7f1570198920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156ffff640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570106f10 0x7f157019ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156f7fe640 1 -- 172.21.15.70:0/2529107751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570106f10 msgr2=0x7f157019ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:30.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156f7fe640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570106f10 0x7f157019ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156f7fe640 1 -- 172.21.15.70:0/2529107751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1570102790 msgr2=0x7f1570198920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156f7fe640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1570102790 0x7f1570198920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156f7fe640 1 -- 172.21.15.70:0/2529107751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f157019d390 con 0x7f1570101de0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156f7fe640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570101de0 0x7f15701983e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f156000c890 tx=0x7f156000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156cff9640 1 -- 172.21.15.70:0/2529107751 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560004220 con 0x7f1570101de0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156cff9640 1 -- 172.21.15.70:0/2529107751 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f15600043c0 con 0x7f1570101de0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f156cff9640 1 -- 172.21.15.70:0/2529107751 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1560004a00 con 0x7f1570101de0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f157019d680 con 0x7f1570101de0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.044+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f15701a4f60 con 0x7f1570101de0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.045+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f15701021c0 con 0x7f1570101de0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.046+0000 7f156cff9640 1 -- 172.21.15.70:0/2529107751 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1560004ba0 con 0x7f1570101de0 2024-09-19T04:37:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.047+0000 7f156cff9640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15580a33b0 0x7f15580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:30.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.047+0000 7f156effd640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15580a33b0 0x7f15580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:30.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.047+0000 7f156cff9640 1 -- 172.21.15.70:0/2529107751 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f15600cf9f0 con 0x7f1570101de0 2024-09-19T04:37:30.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.048+0000 7f156effd640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15580a33b0 0x7f15580a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f15701088e0 tx=0x7f156400a250 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:30.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.051+0000 7f156cff9640 1 -- 172.21.15.70:0/2529107751 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1560014030 con 0x7f1570101de0 2024-09-19T04:37:30.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.252+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1570109bc0 con 0x7f1570101de0 2024-09-19T04:37:30.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.253+0000 7f156cff9640 1 -- 172.21.15.70:0/2529107751 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f156009bd80 con 0x7f1570101de0 2024-09-19T04:37:30.255 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:37:30.255 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:37:30.255 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15580a33b0 msgr2=0x7f15580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15580a33b0 0x7f15580a5870 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f15701088e0 tx=0x7f156400a250 comp rx=0 tx=0).stop 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570101de0 msgr2=0x7f15701983e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570101de0 0x7f15701983e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f156000c890 tx=0x7f156000cd50 comp rx=0 tx=0).stop 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 shutdown_connections 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f15580a33b0 0x7f15580a5870 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1570106f10 0x7f157019ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1570102790 0x7f1570198920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 --2- 172.21.15.70:0/2529107751 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1570101de0 0x7f15701983e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 >> 172.21.15.70:0/2529107751 conn(0x7f15700fd8c0 msgr2=0x7f15700fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:30.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 shutdown_connections 2024-09-19T04:37:30.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:30.255+0000 7f1575c0c640 1 -- 172.21.15.70:0/2529107751 wait complete. 2024-09-19T04:37:30.576 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:30 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2529107751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:30.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:30 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2529107751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:30 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2529107751' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:30.956 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:37:31.201 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:31.597 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:31 smithi070 ceph-mon[30942]: pgmap v207: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 -- 172.21.15.70:0/1230998563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558100a80 msgr2=0x7f5558100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 --2- 172.21.15.70:0/1230998563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558100a80 0x7f5558100ee0 secure :-1 s=READY pgs=892 cs=0 l=1 rev1=1 crypto rx=0x7f5544009930 tx=0x7f554402a420 comp rx=0 tx=0).stop 2024-09-19T04:37:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 -- 172.21.15.70:0/1230998563 shutdown_connections 2024-09-19T04:37:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 --2- 172.21.15.70:0/1230998563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5558101420 0x7f555810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 --2- 172.21.15.70:0/1230998563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558100a80 0x7f5558100ee0 unknown :-1 s=CLOSED pgs=892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 --2- 172.21.15.70:0/1230998563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5558106a80 0x7f5558106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 -- 172.21.15.70:0/1230998563 >> 172.21.15.70:0/1230998563 conn(0x7f55580fc7a0 msgr2=0x7f55580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 -- 172.21.15.70:0/1230998563 shutdown_connections 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.678+0000 7f555eb3d640 1 -- 172.21.15.70:0/1230998563 wait complete. 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.679+0000 7f555eb3d640 1 Processor -- start 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.679+0000 7f555eb3d640 1 -- start start 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.679+0000 7f555eb3d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5558100a80 0x7f55580fce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.679+0000 7f555eb3d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5558101420 0x7f55580fd3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.679+0000 7f555eb3d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558106a80 0x7f55580fd900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.679+0000 7f555eb3d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5558110e50 con 0x7f5558106a80 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.679+0000 7f555eb3d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5558110cd0 con 0x7f5558100a80 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.679+0000 7f555eb3d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5558110fd0 con 0x7f5558101420 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558106a80 0x7f55580fd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.684 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558106a80 0x7f55580fd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44854/0 (socket says 172.21.15.70:44854) 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 -- 172.21.15.70:0/3740671851 learned_addr learned my addr 172.21.15.70:0/3740671851 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555c8d9640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5558100a80 0x7f55580fce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f5557fff640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5558101420 0x7f55580fd3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 -- 172.21.15.70:0/3740671851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5558101420 msgr2=0x7f55580fd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5558101420 0x7f55580fd3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 -- 172.21.15.70:0/3740671851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5558100a80 msgr2=0x7f55580fce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5558100a80 0x7f55580fce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 -- 172.21.15.70:0/3740671851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55581a6940 con 0x7f5558106a80 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555d0da640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558106a80 0x7f55580fd900 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5550009fd0 tx=0x7f555000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:31.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f5555ffb640 1 -- 172.21.15.70:0/3740671851 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550017070 con 0x7f5558106a80 2024-09-19T04:37:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f5555ffb640 1 -- 172.21.15.70:0/3740671851 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5550003e40 con 0x7f5558106a80 2024-09-19T04:37:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f555eb3d640 1 -- 172.21.15.70:0/3740671851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55581a6c30 con 0x7f5558106a80 2024-09-19T04:37:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.680+0000 7f5555ffb640 1 -- 172.21.15.70:0/3740671851 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55500106c0 con 0x7f5558106a80 2024-09-19T04:37:31.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.681+0000 7f555eb3d640 1 -- 172.21.15.70:0/3740671851 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55581a70f0 con 0x7f5558106a80 2024-09-19T04:37:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5555ffb640 1 -- 172.21.15.70:0/3740671851 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5550003970 con 0x7f5558106a80 2024-09-19T04:37:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5560f16740 1 Processor -- start 2024-09-19T04:37:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5560f16740 1 -- start start 2024-09-19T04:37:31.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5555ffb640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55480a33b0 0x7f55480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5560f16740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06eed090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5560f16740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06eeda10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5560f16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06ef8370 0x55ba06efa760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5560f16740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ba06e532f0 con 0x55ba06eeeb40 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5560f16740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ba06dfacf0 con 0x55ba06eed5d0 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5560f16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ba06e4f2b0 con 0x55ba06ef8370 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5555ffb640 1 -- 172.21.15.70:0/3740671851 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f55500cfa00 con 0x7f5558106a80 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.683+0000 7f5557fff640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55480a33b0 0x7f55480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06eed090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f5557fff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06eeda10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06eed090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44856/0 (socket says 172.21.15.70:44856) 2024-09-19T04:37:31.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 -- 172.21.15.70:0/1775542662 learned_addr learned my addr 172.21.15.70:0/1775542662 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555d0da640 1 --2- 172.21.15.70:0/1775542662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06ef8370 0x55ba06efa760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 -- 172.21.15.70:0/1775542662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06ef8370 msgr2=0x55ba06efa760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 --2- 172.21.15.70:0/1775542662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06ef8370 0x55ba06efa760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 -- 172.21.15.70:0/1775542662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 msgr2=0x55ba06eeda10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 --2- 172.21.15.70:0/1775542662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06eeda10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 -- 172.21.15.70:0/1775542662 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba06ddf3a0 con 0x55ba06eeeb40 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f5557fff640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55480a33b0 0x7f55480a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55440314b0 tx=0x7f55440095d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f555c8d9640 1 --2- 172.21.15.70:0/1775542662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06eed090 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f554c00bc90 tx=0x7f554c0107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a927b11ab51c7bdc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f5542ffd640 1 -- 172.21.15.70:0/1775542662 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c01c480 con 0x55ba06eeeb40 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f5542ffd640 1 -- 172.21.15.70:0/1775542662 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f554c01caf0 con 0x55ba06eeeb40 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.684+0000 7f5542ffd640 1 -- 172.21.15.70:0/1775542662 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c011b60 con 0x55ba06eeeb40 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 -- 172.21.15.70:0/1775542662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 msgr2=0x55ba06eed090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 --2- 172.21.15.70:0/1775542662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06eed090 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f554c00bc90 tx=0x7f554c0107a0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 -- 172.21.15.70:0/1775542662 shutdown_connections 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 --2- 172.21.15.70:0/1775542662 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06ef8370 0x55ba06efa760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 --2- 172.21.15.70:0/1775542662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06eeda10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 --2- 172.21.15.70:0/1775542662 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06eed090 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 -- 172.21.15.70:0/1775542662 >> 172.21.15.70:0/1775542662 conn(0x55ba06eb6310 msgr2=0x55ba06ee9c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 -- 172.21.15.70:0/1775542662 shutdown_connections 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 -- 172.21.15.70:0/1775542662 wait complete. 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 -- start start 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.685+0000 7f5560f16740 1 Processor -- start 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f5560f16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 0x55ba06ef7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f5560f16740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eeeb40 0x55ba06ef4fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f5560f16740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06ef5570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f5560f16740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ba06efb070 con 0x55ba06ef8370 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f5560f16740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ba06e0e060 con 0x55ba06eeeb40 2024-09-19T04:37:31.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f5560f16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ba06efb1f0 con 0x55ba06eed5d0 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f5560f16740 10 client.0 _ll_register_callbacks cb 0x55ba06b618c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555d0da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06ef5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555d0da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06ef5570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44860/0 (socket says 172.21.15.70:44860) 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555d0da640 1 -- 172.21.15.70:0/3560323977 learned_addr learned my addr 172.21.15.70:0/3560323977 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f5557fff640 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eeeb40 0x55ba06ef4fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555c8d9640 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 0x55ba06ef7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555d0da640 1 -- 172.21.15.70:0/3560323977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 msgr2=0x55ba06ef7cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555d0da640 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 0x55ba06ef7cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555d0da640 1 -- 172.21.15.70:0/3560323977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eeeb40 msgr2=0x55ba06ef4fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555d0da640 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eeeb40 0x55ba06ef4fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.686+0000 7f555d0da640 1 -- 172.21.15.70:0/3560323977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba06bc43c0 con 0x55ba06ef8370 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f555d0da640 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06ef5570 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f55500cd1b0 tx=0x7f555009b760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e812188e5a77d9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5537fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:31.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5537fff640 1 -- 172.21.15.70:0/3560323977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550020040 con 0x55ba06ef8370 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5537fff640 1 -- 172.21.15.70:0/3560323977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f555009b1e0 con 0x55ba06ef8370 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 1 -- 172.21.15.70:0/3560323977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f554c01caf0 con 0x55ba06ef8370 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5537fff640 1 -- 172.21.15.70:0/3560323977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f555009bd90 con 0x55ba06ef8370 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 10 client.16932 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 1 -- 172.21.15.70:0/3560323977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ba06f06ac0 con 0x55ba06ef8370 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5537fff640 1 -- 172.21.15.70:0/3560323977 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f554c01caf0 con 0x55ba06ef8370 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5537fff640 1 -- 172.21.15.70:0/3560323977 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f555009ac50 con 0x55ba06ef8370 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 10 client.16932 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 10 client.16932 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 20 client.16932 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ba06f07f20 0x55ba06f0a370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 4 client.16932 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.687+0000 7f5560f16740 1 -- 172.21.15.70:0/3560323977 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ba06e60860 con 0x55ba06f07f20 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.688+0000 7f555c8d9640 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ba06f07f20 0x55ba06f0a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.688+0000 7f555c8d9640 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ba06f07f20 0x55ba06f0a370 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9597168a8e37c885 server_cookie=f56c18174196cb2c in_seq=0 out_seq=0 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.688+0000 7f5537fff640 10 client.16932 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5537fff640 1 -- 172.21.15.70:0/3560323977 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ba06e60860 con 0x55ba06f07f20 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5537fff640 10 client.16932 handle_command_reply: tid=0 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 client.16932 shutdown 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 -- 172.21.15.70:0/3560323977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 msgr2=0x55ba06ef5570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06ef5570 secure :-1 s=READY pgs=895 cs=0 l=1 rev1=1 crypto rx=0x7f55500cd1b0 tx=0x7f555009b760 comp rx=0 tx=0).stop 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 -- 172.21.15.70:0/3560323977 shutdown_connections 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ba06f07f20 0x55ba06f0a370 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06ef5570 unknown :-1 s=CLOSED pgs=895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eeeb40 0x55ba06ef4fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 --2- 172.21.15.70:0/3560323977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 0x55ba06ef7cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 -- 172.21.15.70:0/3560323977 >> 172.21.15.70:0/3560323977 conn(0x55ba06eb6310 msgr2=0x55ba06eef990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5537fff640 0 client.16932 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 -- 172.21.15.70:0/3560323977 shutdown_connections 2024-09-19T04:37:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 1 -- 172.21.15.70:0/3560323977 wait complete. 2024-09-19T04:37:31.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.689+0000 7f5560f16740 20 client.16932 trim_cache size 0 max 16384 2024-09-19T04:37:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5560f16740 1 Processor -- start 2024-09-19T04:37:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5560f16740 1 -- start start 2024-09-19T04:37:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5560f16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 0x55ba06f04310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5560f16740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06f0fc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5560f16740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06ef8370 0x55ba06f101a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5560f16740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55581b2360 con 0x55ba06eeeb40 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5560f16740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55581afc30 con 0x55ba06ef8370 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5560f16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55581adaa0 con 0x55ba06eed5d0 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5557fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06f0fc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5557fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06f0fc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44866/0 (socket says 172.21.15.70:44866) 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f5557fff640 1 -- 172.21.15.70:0/2681297457 learned_addr learned my addr 172.21.15.70:0/2681297457 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.702+0000 7f555d0da640 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06ef8370 0x55ba06f101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f5557fff640 1 -- 172.21.15.70:0/2681297457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 msgr2=0x55ba06f04310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f5557fff640 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 0x55ba06f04310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f5557fff640 1 -- 172.21.15.70:0/2681297457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06ef8370 msgr2=0x55ba06f101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:31.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f5557fff640 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06ef8370 0x55ba06f101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f5557fff640 1 -- 172.21.15.70:0/2681297457 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba06eedd50 con 0x55ba06eeeb40 2024-09-19T04:37:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f555d0da640 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06ef8370 0x55ba06f101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f5557fff640 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06f0fc60 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5544009230 tx=0x7f5544047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ab2bce64e81dc1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f55427fc640 1 -- 172.21.15.70:0/2681297457 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544035040 con 0x55ba06eeeb40 2024-09-19T04:37:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f55427fc640 1 -- 172.21.15.70:0/2681297457 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f554404f070 con 0x55ba06eeeb40 2024-09-19T04:37:31.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f55427fc640 1 -- 172.21.15.70:0/2681297457 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55440035f0 con 0x55ba06eeeb40 2024-09-19T04:37:31.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f5560f16740 1 -- 172.21.15.70:0/2681297457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 msgr2=0x55ba06f0fc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.703+0000 7f5560f16740 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06f0fc60 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f5544009230 tx=0x7f5544047000 comp rx=0 tx=0).stop 2024-09-19T04:37:31.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 -- 172.21.15.70:0/2681297457 shutdown_connections 2024-09-19T04:37:31.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06ef8370 0x55ba06f101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06eeeb40 0x55ba06f0fc60 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 --2- 172.21.15.70:0/2681297457 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eed5d0 0x55ba06f04310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 -- 172.21.15.70:0/2681297457 >> 172.21.15.70:0/2681297457 conn(0x55ba06eb6310 msgr2=0x55ba06ef38a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:31.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 -- 172.21.15.70:0/2681297457 shutdown_connections 2024-09-19T04:37:31.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 -- 172.21.15.70:0/2681297457 wait complete. 2024-09-19T04:37:31.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 -- start start 2024-09-19T04:37:31.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 Processor -- start 2024-09-19T04:37:31.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06efc250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eeeb40 0x55ba06efc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06efccd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55581ae0f0 con 0x55ba06ef8370 2024-09-19T04:37:31.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55581af560 con 0x55ba06eed5d0 2024-09-19T04:37:31.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55581ae7c0 con 0x55ba06eeeb40 2024-09-19T04:37:31.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.704+0000 7f5560f16740 10 client.0 _ll_register_callbacks cb 0x7f5550098030 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:31.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555c8d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06efc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555d0da640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06efccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555c8d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06efc250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:32970/0 (socket says 172.21.15.70:32970) 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555c8d9640 1 -- 172.21.15.70:0/3501240778 learned_addr learned my addr 172.21.15.70:0/3501240778 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f5557fff640 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eeeb40 0x55ba06efc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555d0da640 1 -- 172.21.15.70:0/3501240778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eeeb40 msgr2=0x55ba06efc790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555d0da640 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eeeb40 0x55ba06efc790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555d0da640 1 -- 172.21.15.70:0/3501240778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 msgr2=0x55ba06efc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555d0da640 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06efc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555d0da640 1 -- 172.21.15.70:0/3501240778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba06f71cb0 con 0x55ba06ef8370 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555c8d9640 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06efc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f555d0da640 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06efccd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f55500981f0 tx=0x7f5550004090 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814d1ac2d4fd93e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f5537fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:31.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f5537fff640 1 -- 172.21.15.70:0/3501240778 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5550020040 con 0x55ba06ef8370 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f5537fff640 1 -- 172.21.15.70:0/3501240778 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f55500a1430 con 0x55ba06ef8370 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f5560f16740 1 -- 172.21.15.70:0/3501240778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f554404f070 con 0x55ba06ef8370 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f5537fff640 1 -- 172.21.15.70:0/3501240778 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f55500a4950 con 0x55ba06ef8370 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f5560f16740 10 client.16938 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.705+0000 7f5560f16740 1 -- 172.21.15.70:0/3501240778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ba06f72f00 con 0x55ba06ef8370 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5537fff640 1 -- 172.21.15.70:0/3501240778 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f554404f070 con 0x55ba06ef8370 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5537fff640 1 -- 172.21.15.70:0/3501240778 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f55500a4ba0 con 0x55ba06ef8370 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5560f16740 10 client.16938 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5560f16740 10 client.16938 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5560f16740 20 client.16938 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5560f16740 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ba06f73610 0x55ba06f75a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5560f16740 4 client.16938 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5560f16740 1 -- 172.21.15.70:0/3501240778 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ba06e5ad70 con 0x55ba06f73610 2024-09-19T04:37:31.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f555c8d9640 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ba06f73610 0x55ba06f75a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f5537fff640 10 client.16938 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.706+0000 7f555c8d9640 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ba06f73610 0x55ba06f75a00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=77539a9fc64c54e5 server_cookie=bf002a9a4bdc3145 in_seq=0 out_seq=0 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5537fff640 1 -- 172.21.15.70:0/3501240778 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ba06e5ad70 con 0x55ba06f73610 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5537fff640 10 client.16938 handle_command_reply: tid=0 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 client.16938 shutdown 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 -- 172.21.15.70:0/3501240778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 msgr2=0x55ba06efccd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06efccd0 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f55500981f0 tx=0x7f5550004090 comp rx=0 tx=0).stop 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 -- 172.21.15.70:0/3501240778 shutdown_connections 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ba06f73610 0x55ba06f75a00 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ba06ef8370 0x55ba06efccd0 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ba06eeeb40 0x55ba06efc790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 --2- 172.21.15.70:0/3501240778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ba06eed5d0 0x55ba06efc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 -- 172.21.15.70:0/3501240778 >> 172.21.15.70:0/3501240778 conn(0x55ba06eb6310 msgr2=0x55ba06ef3cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:31.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5537fff640 0 client.16938 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:31.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 -- 172.21.15.70:0/3501240778 shutdown_connections 2024-09-19T04:37:31.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 1 -- 172.21.15.70:0/3501240778 wait complete. 2024-09-19T04:37:31.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f5560f16740 20 client.16938 trim_cache size 0 max 16384 2024-09-19T04:37:31.717 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f555eb3d640 1 -- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55480a33b0 msgr2=0x7f55480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f555eb3d640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55480a33b0 0x7f55480a5870 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f55440314b0 tx=0x7f55440095d0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f555eb3d640 1 -- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558106a80 msgr2=0x7f55580fd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.707+0000 7f555eb3d640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558106a80 0x7f55580fd900 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f5550009fd0 tx=0x7f555000b260 comp rx=0 tx=0).stop 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.708+0000 7f555eb3d640 1 -- 172.21.15.70:0/3740671851 shutdown_connections 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.708+0000 7f555eb3d640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55480a33b0 0x7f55480a5870 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.708+0000 7f555eb3d640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5558106a80 0x7f55580fd900 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.708+0000 7f555eb3d640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5558101420 0x7f55580fd3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.708+0000 7f555eb3d640 1 --2- 172.21.15.70:0/3740671851 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5558100a80 0x7f55580fce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:31.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.708+0000 7f555eb3d640 1 -- 172.21.15.70:0/3740671851 >> 172.21.15.70:0/3740671851 conn(0x7f55580fc7a0 msgr2=0x7f555806ab30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.708+0000 7f555eb3d640 1 -- 172.21.15.70:0/3740671851 shutdown_connections 2024-09-19T04:37:31.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:31.708+0000 7f555eb3d640 1 -- 172.21.15.70:0/3740671851 wait complete. 2024-09-19T04:37:31.719 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:31 smithi167 ceph-mon[34339]: pgmap v207: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:31.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:31 smithi134 ceph-mon[34525]: pgmap v207: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:32.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:37:32.596 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:33.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:32 smithi070 ceph-mon[30942]: pgmap v208: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:33.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:32 smithi134 ceph-mon[34525]: pgmap v208: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 -- 172.21.15.70:0/1509920886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481082a0 msgr2=0x7f554810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1509920886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481082a0 0x7f554810ec40 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7f5540009cd0 tx=0x7f554002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 -- 172.21.15.70:0/1509920886 shutdown_connections 2024-09-19T04:37:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1509920886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481082a0 0x7f554810ec40 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1509920886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f55481036e0 0x7f5548107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1509920886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5548102d30 0x7f5548103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 -- 172.21.15.70:0/1509920886 >> 172.21.15.70:0/1509920886 conn(0x7f55480fc7d0 msgr2=0x7f55480febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 -- 172.21.15.70:0/1509920886 shutdown_connections 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.093+0000 7f554e9d9640 1 -- 172.21.15.70:0/1509920886 wait complete. 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f554e9d9640 1 Processor -- start 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f554e9d9640 1 -- start start 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f554e9d9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5548102d30 0x7f5548198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f554e9d9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481036e0 0x7f55481989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f554e9d9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55481082a0 0x7f554819cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f554e9d9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5548112070 con 0x7f55481036e0 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f554e9d9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5548111ef0 con 0x7f5548102d30 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f554e9d9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55481121f0 con 0x7f55481082a0 2024-09-19T04:37:33.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f55477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481036e0 0x7f55481989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f55477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481036e0 0x7f55481989b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44902/0 (socket says 172.21.15.70:44902) 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f55477fe640 1 -- 172.21.15.70:0/1620474284 learned_addr learned my addr 172.21.15.70:0/1620474284 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.094+0000 7f5547fff640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5548102d30 0x7f5548198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f554cf76640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55481082a0 0x7f554819cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55477fe640 1 -- 172.21.15.70:0/1620474284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55481082a0 msgr2=0x7f554819cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55477fe640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55481082a0 0x7f554819cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55477fe640 1 -- 172.21.15.70:0/1620474284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5548102d30 msgr2=0x7f5548198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55477fe640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5548102d30 0x7f5548198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55477fe640 1 -- 172.21.15.70:0/1620474284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f554819d420 con 0x7f55481036e0 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f5547fff640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5548102d30 0x7f5548198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f554cf76640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55481082a0 0x7f554819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55477fe640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481036e0 0x7f55481989b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f553c00c8c0 tx=0x7f553c00cd80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:33.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55457fa640 1 -- 172.21.15.70:0/1620474284 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c007bb0 con 0x7f55481036e0 2024-09-19T04:37:33.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55457fa640 1 -- 172.21.15.70:0/1620474284 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f553c007d50 con 0x7f55481036e0 2024-09-19T04:37:33.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f554e9d9640 1 -- 172.21.15.70:0/1620474284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f554819d710 con 0x7f55481036e0 2024-09-19T04:37:33.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f55457fa640 1 -- 172.21.15.70:0/1620474284 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c018800 con 0x7f55481036e0 2024-09-19T04:37:33.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.095+0000 7f554e9d9640 1 -- 172.21.15.70:0/1620474284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55481a4ff0 con 0x7f55481036e0 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.097+0000 7f55457fa640 1 -- 172.21.15.70:0/1620474284 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f553c0189e0 con 0x7f55481036e0 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.097+0000 7f5550db2740 1 Processor -- start 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.097+0000 7f5550db2740 1 -- start start 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f5550db2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f567090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f5550db2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f5675d0 0x55a59f567a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f5550db2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f574760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f5550db2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a59f4cd2f0 con 0x55a59f568b40 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f567090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f5550db2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a59f474cf0 con 0x55a59f5675d0 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f5550db2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a59f4c92b0 con 0x55a59f572370 2024-09-19T04:37:33.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f567090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44914/0 (socket says 172.21.15.70:44914) 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 -- 172.21.15.70:0/2714990346 learned_addr learned my addr 172.21.15.70:0/2714990346 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f55477fe640 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f574760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f5547fff640 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f5675d0 0x55a59f567a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 -- 172.21.15.70:0/2714990346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 msgr2=0x55a59f574760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f574760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 -- 172.21.15.70:0/2714990346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f5675d0 msgr2=0x55a59f567a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f5675d0 0x55a59f567a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 -- 172.21.15.70:0/2714990346 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a59f4593a0 con 0x55a59f568b40 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f55457fa640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55300a33b0 0x7f55300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f5547fff640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55300a33b0 0x7f55300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.098+0000 7f554cf76640 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f567090 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5540009a60 tx=0x7f55400314b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=887c1a8f75797386 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.099+0000 7f55457fa640 1 -- 172.21.15.70:0/1620474284 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f553c0cfe50 con 0x7f55481036e0 2024-09-19T04:37:33.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.099+0000 7f552e7fc640 1 -- 172.21.15.70:0/2714990346 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5540031ae0 con 0x55a59f568b40 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.099+0000 7f552e7fc640 1 -- 172.21.15.70:0/2714990346 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5540036040 con 0x55a59f568b40 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.099+0000 7f552e7fc640 1 -- 172.21.15.70:0/2714990346 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55400045e0 con 0x55a59f568b40 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.099+0000 7f5550db2740 1 -- 172.21.15.70:0/2714990346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 msgr2=0x55a59f567090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.099+0000 7f5547fff640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55300a33b0 0x7f55300a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5538005fd0 tx=0x7f5538005850 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.099+0000 7f5550db2740 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f567090 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5540009a60 tx=0x7f55400314b0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 -- 172.21.15.70:0/2714990346 shutdown_connections 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f574760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f5675d0 0x55a59f567a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 --2- 172.21.15.70:0/2714990346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f567090 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 -- 172.21.15.70:0/2714990346 >> 172.21.15.70:0/2714990346 conn(0x55a59f530310 msgr2=0x55a59f563c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 -- 172.21.15.70:0/2714990346 shutdown_connections 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 -- 172.21.15.70:0/2714990346 wait complete. 2024-09-19T04:37:33.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 -- start start 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 Processor -- start 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 0x55a59f571d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f56f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f572370 0x55a59f56f5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a59f575010 con 0x55a59f568b40 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a59f488060 con 0x55a59f572370 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a59f575190 con 0x55a59f5675d0 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.100+0000 7f5550db2740 10 client.0 _ll_register_callbacks cb 0x55a59f1db8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f56f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f56f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44916/0 (socket says 172.21.15.70:44916) 2024-09-19T04:37:33.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 -- 172.21.15.70:0/2379541833 learned_addr learned my addr 172.21.15.70:0/2379541833 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f5547fff640 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 0x55a59f571d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f554cf76640 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f572370 0x55a59f56f5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 -- 172.21.15.70:0/2379541833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 msgr2=0x55a59f571d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 0x55a59f571d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 -- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f572370 msgr2=0x55a59f56f5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f572370 0x55a59f56f5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 -- 172.21.15.70:0/2379541833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a59f23e3c0 con 0x55a59f568b40 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f554cf76640 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f572370 0x55a59f56f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55477fe640 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f56f000 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f553c00c890 tx=0x7f553c09bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca49c734ba46d2a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55277fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55277fe640 1 -- 172.21.15.70:0/2379541833 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c09c830 con 0x55a59f568b40 2024-09-19T04:37:33.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55277fe640 1 -- 172.21.15.70:0/2379541833 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f553c0cd820 con 0x55a59f568b40 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f5550db2740 1 -- 172.21.15.70:0/2379541833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5540036040 con 0x55a59f568b40 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f55277fe640 1 -- 172.21.15.70:0/2379541833 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f553c09c130 con 0x55a59f568b40 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f5550db2740 10 client.16950 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.101+0000 7f5550db2740 1 -- 172.21.15.70:0/2379541833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a59f580a90 con 0x55a59f568b40 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f55277fe640 1 -- 172.21.15.70:0/2379541833 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5540036040 con 0x55a59f568b40 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f55277fe640 1 -- 172.21.15.70:0/2379541833 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f553c0a0120 con 0x55a59f568b40 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f5550db2740 10 client.16950 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f5550db2740 10 client.16950 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f5550db2740 20 client.16950 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f5550db2740 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55a59f581f50 0x55a59f584340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f5550db2740 4 client.16950 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f5550db2740 1 -- 172.21.15.70:0/2379541833 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a59f4da860 con 0x55a59f581f50 2024-09-19T04:37:33.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f5547fff640 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55a59f581f50 0x55a59f584340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f55277fe640 10 client.16950 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.102+0000 7f5547fff640 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55a59f581f50 0x55a59f584340 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=60188819d4be0eaf server_cookie=ccf2cf077e241162 in_seq=0 out_seq=0 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f55277fe640 1 -- 172.21.15.70:0/2379541833 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a59f4da860 con 0x55a59f581f50 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f55277fe640 10 client.16950 handle_command_reply: tid=0 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 client.16950 shutdown 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 -- 172.21.15.70:0/2379541833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 msgr2=0x55a59f56f000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f56f000 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f553c00c890 tx=0x7f553c09bfc0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 -- 172.21.15.70:0/2379541833 shutdown_connections 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55a59f581f50 0x55a59f584340 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f572370 0x55a59f56f5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f55277fe640 0 client.16950 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:33.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f568b40 0x55a59f56f000 unknown :-1 s=CLOSED pgs=901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 --2- 172.21.15.70:0/2379541833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 0x55a59f571d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.103+0000 7f5550db2740 1 -- 172.21.15.70:0/2379541833 >> 172.21.15.70:0/2379541833 conn(0x55a59f530310 msgr2=0x55a59f569930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:33.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.104+0000 7f5550db2740 1 -- 172.21.15.70:0/2379541833 shutdown_connections 2024-09-19T04:37:33.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.104+0000 7f5550db2740 1 -- 172.21.15.70:0/2379541833 wait complete. 2024-09-19T04:37:33.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.104+0000 7f5550db2740 20 client.16950 trim_cache size 0 max 16384 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.116+0000 7f5550db2740 1 Processor -- start 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.116+0000 7f5550db2740 1 -- start start 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5550db2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f5675d0 0x55a59f57e2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5550db2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f589bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5550db2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f58a130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5550db2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55481b0080 con 0x55a59f5675d0 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5550db2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ad950 con 0x55a59f568b40 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5550db2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ab7c0 con 0x55a59f572370 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f5675d0 0x55a59f57e2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f5675d0 0x55a59f57e2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44926/0 (socket says 172.21.15.70:44926) 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 -- 172.21.15.70:0/462477797 learned_addr learned my addr 172.21.15.70:0/462477797 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:33.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f554cf76640 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f58a130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f55477fe640 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f589bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 -- 172.21.15.70:0/462477797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 msgr2=0x55a59f58a130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f58a130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 -- 172.21.15.70:0/462477797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 msgr2=0x55a59f589bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f589bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 -- 172.21.15.70:0/462477797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a59f563510 con 0x55a59f5675d0 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f55477fe640 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f589bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f554cf76640 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f58a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f5547fff640 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f5675d0 0x55a59f57e2b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f55380058c0 tx=0x7f5538012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc4b10bd774a038 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f552dffb640 1 -- 172.21.15.70:0/462477797 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553802b070 con 0x55a59f5675d0 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f552dffb640 1 -- 172.21.15.70:0/462477797 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f553801ee30 con 0x55a59f5675d0 2024-09-19T04:37:33.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.117+0000 7f552dffb640 1 -- 172.21.15.70:0/462477797 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5538010b70 con 0x55a59f5675d0 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 -- 172.21.15.70:0/462477797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f5675d0 msgr2=0x55a59f57e2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f5675d0 0x55a59f57e2b0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f55380058c0 tx=0x7f5538012000 comp rx=0 tx=0).stop 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 -- 172.21.15.70:0/462477797 shutdown_connections 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f572370 0x55a59f58a130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f589bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 --2- 172.21.15.70:0/462477797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f5675d0 0x55a59f57e2b0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 -- 172.21.15.70:0/462477797 >> 172.21.15.70:0/462477797 conn(0x55a59f530310 msgr2=0x55a59f56a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 -- 172.21.15.70:0/462477797 shutdown_connections 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 -- 172.21.15.70:0/462477797 wait complete. 2024-09-19T04:37:33.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.118+0000 7f5550db2740 1 -- start start 2024-09-19T04:37:33.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5550db2740 1 Processor -- start 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5550db2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 0x55a59f57a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5550db2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f57aab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5550db2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f572370 0x55a59f575980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5550db2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55481abe10 con 0x55a59f572370 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5550db2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ad280 con 0x55a59f568b40 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5550db2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55481ac4e0 con 0x55a59f5675d0 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5550db2740 10 client.0 _ll_register_callbacks cb 0x7f553c0983d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f554cf76640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f572370 0x55a59f575980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f554cf76640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f572370 0x55a59f575980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44942/0 (socket says 172.21.15.70:44942) 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f554cf76640 1 -- 172.21.15.70:0/2645183731 learned_addr learned my addr 172.21.15.70:0/2645183731 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f5547fff640 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 0x55a59f57a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f554cf76640 1 -- 172.21.15.70:0/2645183731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 msgr2=0x55a59f57a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f554cf76640 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 0x55a59f57a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f554cf76640 1 -- 172.21.15.70:0/2645183731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 msgr2=0x55a59f57aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f55477fe640 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f57aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f554cf76640 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f57aab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.119+0000 7f554cf76640 1 -- 172.21.15.70:0/2645183731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a59f5761b0 con 0x55a59f572370 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f554cf76640 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f572370 0x55a59f575980 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5540000f80 tx=0x7f5540003c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0ea65bb75d3d1e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f55277fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f55277fe640 1 -- 172.21.15.70:0/2645183731 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554004e020 con 0x55a59f572370 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f55277fe640 1 -- 172.21.15.70:0/2645183731 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f5540004250 con 0x55a59f572370 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 1 -- 172.21.15.70:0/2645183731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f553801ee30 con 0x55a59f572370 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f55277fe640 1 -- 172.21.15.70:0/2645183731 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5540059050 con 0x55a59f572370 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 10 client.16956 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:33.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 1 -- 172.21.15.70:0/2645183731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a59f5ec5f0 con 0x55a59f572370 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f55277fe640 1 -- 172.21.15.70:0/2645183731 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f553801ee30 con 0x55a59f572370 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f55277fe640 1 -- 172.21.15.70:0/2645183731 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f5540030070 con 0x55a59f572370 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 10 client.16956 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 10 client.16956 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 20 client.16956 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55a59f581f50 0x55a59f5ee990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 4 client.16956 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.120+0000 7f5550db2740 1 -- 172.21.15.70:0/2645183731 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a59f4d4d70 con 0x55a59f581f50 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.121+0000 7f5547fff640 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55a59f581f50 0x55a59f5ee990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.121+0000 7f55277fe640 10 client.16956 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.121+0000 7f5547fff640 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55a59f581f50 0x55a59f5ee990 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f85ac8643ee7d6e server_cookie=e9b99ac189db8250 in_seq=0 out_seq=0 2024-09-19T04:37:33.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.121+0000 7f55277fe640 1 -- 172.21.15.70:0/2645183731 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a59f4d4d70 con 0x55a59f581f50 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.121+0000 7f55277fe640 10 client.16956 handle_command_reply: tid=0 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.121+0000 7f5550db2740 1 client.16956 shutdown 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.121+0000 7f5550db2740 1 -- 172.21.15.70:0/2645183731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f572370 msgr2=0x55a59f575980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.121+0000 7f5550db2740 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f572370 0x55a59f575980 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f5540000f80 tx=0x7f5540003c20 comp rx=0 tx=0).stop 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 1 -- 172.21.15.70:0/2645183731 shutdown_connections 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55a59f581f50 0x55a59f5ee990 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a59f572370 0x55a59f575980 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a59f568b40 0x55a59f57aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 1 --2- 172.21.15.70:0/2645183731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a59f5675d0 0x55a59f57a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 1 -- 172.21.15.70:0/2645183731 >> 172.21.15.70:0/2645183731 conn(0x55a59f530310 msgr2=0x55a59f56d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f55277fe640 0 client.16956 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 1 -- 172.21.15.70:0/2645183731 shutdown_connections 2024-09-19T04:37:33.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 1 -- 172.21.15.70:0/2645183731 wait complete. 2024-09-19T04:37:33.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f5550db2740 20 client.16956 trim_cache size 0 max 16384 2024-09-19T04:37:33.130 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 -- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55300a33b0 msgr2=0x7f55300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55300a33b0 0x7f55300a5870 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f5538005fd0 tx=0x7f5538005850 comp rx=0 tx=0).stop 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 -- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481036e0 msgr2=0x7f55481989b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481036e0 0x7f55481989b0 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f553c00c8c0 tx=0x7f553c00cd80 comp rx=0 tx=0).stop 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 -- 172.21.15.70:0/1620474284 shutdown_connections 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55300a33b0 0x7f55300a5870 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f55481082a0 0x7f554819cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f55481036e0 0x7f55481989b0 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 --2- 172.21.15.70:0/1620474284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5548102d30 0x7f5548198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 -- 172.21.15.70:0/1620474284 >> 172.21.15.70:0/1620474284 conn(0x7f55480fc7d0 msgr2=0x7f55480fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 -- 172.21.15.70:0/1620474284 shutdown_connections 2024-09-19T04:37:33.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:33.122+0000 7f554e9d9640 1 -- 172.21.15.70:0/1620474284 wait complete. 2024-09-19T04:37:33.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:32 smithi167 ceph-mon[34339]: pgmap v208: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:33.771 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:37:34.015 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.463+0000 7fa578df1640 1 -- 172.21.15.70:0/1046993342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 msgr2=0x7fa5741067d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.463+0000 7fa578df1640 1 --2- 172.21.15.70:0/1046993342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 0x7fa5741067d0 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7fa568009900 tx=0x7fa56802a410 comp rx=0 tx=0).stop 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 -- 172.21.15.70:0/1046993342 shutdown_connections 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 --2- 172.21.15.70:0/1046993342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa574106f00 0x7fa57410ea80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 --2- 172.21.15.70:0/1046993342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 0x7fa5741067d0 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 --2- 172.21.15.70:0/1046993342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa574101dd0 0x7fa5741021b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 -- 172.21.15.70:0/1046993342 >> 172.21.15.70:0/1046993342 conn(0x7fa5740fd8b0 msgr2=0x7fa5740ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 -- 172.21.15.70:0/1046993342 shutdown_connections 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 -- 172.21.15.70:0/1046993342 wait complete. 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 Processor -- start 2024-09-19T04:37:34.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.464+0000 7fa578df1640 1 -- start start 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa578df1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa574101dd0 0x7fa574198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa578df1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 0x7fa5741989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa578df1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa574106f00 0x7fa57419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa578df1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa574111f70 con 0x7fa574102780 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa578df1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa574111df0 con 0x7fa574106f00 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa578df1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741120f0 con 0x7fa574101dd0 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 0x7fa5741989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 0x7fa5741989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39884/0 (socket says 172.21.15.70:39884) 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 -- 172.21.15.70:0/1453639898 learned_addr learned my addr 172.21.15.70:0/1453639898 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa57259c640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa574101dd0 0x7fa574198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa572d9d640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa574106f00 0x7fa57419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 -- 172.21.15.70:0/1453639898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa574101dd0 msgr2=0x7fa574198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa574101dd0 0x7fa574198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 -- 172.21.15.70:0/1453639898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa574106f00 msgr2=0x7fa57419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa574106f00 0x7fa57419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 -- 172.21.15.70:0/1453639898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa57419d440 con 0x7fa574102780 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.465+0000 7fa571d9b640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 0x7fa5741989d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa568009a20 tx=0x7fa5680043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.466+0000 7fa5637fe640 1 -- 172.21.15.70:0/1453639898 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56803f030 con 0x7fa574102780 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.466+0000 7fa5637fe640 1 -- 172.21.15.70:0/1453639898 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa568031b80 con 0x7fa574102780 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.466+0000 7fa5637fe640 1 -- 172.21.15.70:0/1453639898 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568035070 con 0x7fa574102780 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.466+0000 7fa578df1640 1 -- 172.21.15.70:0/1453639898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa57419d6d0 con 0x7fa574102780 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.466+0000 7fa578df1640 1 -- 172.21.15.70:0/1453639898 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa5741a5010 con 0x7fa574102780 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.468+0000 7fa5637fe640 1 -- 172.21.15.70:0/1453639898 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa5680035f0 con 0x7fa574102780 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.468+0000 7fa57b1ca740 1 Processor -- start 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.468+0000 7fa57b1ca740 1 -- start start 2024-09-19T04:37:34.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 0x563b58734090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b58734a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b58741760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563b5869a2f0 con 0x563b5873f370 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b58641cf0 con 0x563b587345d0 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563b586962b0 con 0x563b58735b40 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa5637fe640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa55c0a3430 0x7fa55c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b58741760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b58741760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39894/0 (socket says 172.21.15.70:39894) 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 -- 172.21.15.70:0/786864906 learned_addr learned my addr 172.21.15.70:0/786864906 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa57259c640 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b58734a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa572d9d640 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 0x563b58734090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa572d9d640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa55c0a3430 0x7fa55c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa5637fe640 1 -- 172.21.15.70:0/1453639898 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fa5680f06f0 con 0x7fa574102780 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 -- 172.21.15.70:0/786864906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 msgr2=0x563b58734090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 0x563b58734090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 -- 172.21.15.70:0/786864906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 msgr2=0x563b58734a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b58734a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 -- 172.21.15.70:0/786864906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b586263a0 con 0x563b5873f370 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa57259c640 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b58734a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa571d9b640 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b58741760 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa5680b93a0 tx=0x7fa5680b8da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f807bffba97e7e8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.469+0000 7fa572d9d640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa55c0a3430 0x7fa55c0a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00bd20 tx=0x7fa56c009be0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa560ff9640 1 -- 172.21.15.70:0/786864906 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568049070 con 0x563b5873f370 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa560ff9640 1 -- 172.21.15.70:0/786864906 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa5680bd0d0 con 0x563b5873f370 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa560ff9640 1 -- 172.21.15.70:0/786864906 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa5680cae60 con 0x563b5873f370 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 -- 172.21.15.70:0/786864906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 msgr2=0x563b58741760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b58741760 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7fa5680b93a0 tx=0x7fa5680b8da0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 -- 172.21.15.70:0/786864906 shutdown_connections 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b58741760 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b58734a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/786864906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 0x563b58734090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 -- 172.21.15.70:0/786864906 >> 172.21.15.70:0/786864906 conn(0x563b586fd310 msgr2=0x563b58730c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 -- 172.21.15.70:0/786864906 shutdown_connections 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.470+0000 7fa57b1ca740 1 -- 172.21.15.70:0/786864906 wait complete. 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 1 -- start start 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 1 Processor -- start 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b5873edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 0x563b5873c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b5873c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563b58741e30 con 0x563b5873f370 2024-09-19T04:37:34.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563b58655060 con 0x563b587345d0 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563b58741fb0 con 0x563b58735b40 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57b1ca740 10 client.0 _ll_register_callbacks cb 0x563b583a88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa572d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b5873c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa572d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b5873c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39896/0 (socket says 172.21.15.70:39896) 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa572d9d640 1 -- 172.21.15.70:0/2670653669 learned_addr learned my addr 172.21.15.70:0/2670653669 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa571d9b640 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 0x563b5873c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa57259c640 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b5873edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa572d9d640 1 -- 172.21.15.70:0/2670653669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 msgr2=0x563b5873c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa572d9d640 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 0x563b5873c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa572d9d640 1 -- 172.21.15.70:0/2670653669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 msgr2=0x563b5873edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.471+0000 7fa572d9d640 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b5873edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.488 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa572d9d640 1 -- 172.21.15.70:0/2670653669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b5840b3c0 con 0x563b5873f370 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa572d9d640 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b5873c810 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0070a0 tx=0x7fa56c01a000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54c9b20bb86bffb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa559ffb640 1 -- 172.21.15.70:0/2670653669 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c014040 con 0x563b5873f370 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa559ffb640 1 -- 172.21.15.70:0/2670653669 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fa56c024600 con 0x563b5873f370 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2670653669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5680bd0d0 con 0x563b5873f370 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa559ffb640 1 -- 172.21.15.70:0/2670653669 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa56c032050 con 0x563b5873f370 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 10 client.16968 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2670653669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563b5874d840 con 0x563b5873f370 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa559ffb640 1 -- 172.21.15.70:0/2670653669 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa5680bd0d0 con 0x563b5873f370 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa559ffb640 1 -- 172.21.15.70:0/2670653669 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa56c02d700 con 0x563b5873f370 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 10 client.16968 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 10 client.16968 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 20 client.16968 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:34.489 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563b5874ed00 0x563b58751180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 4 client.16968 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.472+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2670653669 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563b586a7860 con 0x563b5874ed00 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.473+0000 7fa57259c640 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563b5874ed00 0x563b58751180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.473+0000 7fa57259c640 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563b5874ed00 0x563b58751180 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=10dd8bf3bea8a37c server_cookie=73ffb315e08fc597 in_seq=0 out_seq=0 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.473+0000 7fa559ffb640 10 client.16968 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa559ffb640 1 -- 172.21.15.70:0/2670653669 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563b586a7860 con 0x563b5874ed00 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa559ffb640 10 client.16968 handle_command_reply: tid=0 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 client.16968 shutdown 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2670653669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 msgr2=0x563b5873c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b5873c810 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7fa56c0070a0 tx=0x7fa56c01a000 comp rx=0 tx=0).stop 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2670653669 shutdown_connections 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563b5874ed00 0x563b58751180 crc :-1 s=READY pgs=144 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.490 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b5873c810 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b58735b40 0x563b5873c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa559ffb640 0 client.16968 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:34.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2670653669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b5873edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2670653669 >> 172.21.15.70:0/2670653669 conn(0x563b586fd310 msgr2=0x563b58736990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:34.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2670653669 shutdown_connections 2024-09-19T04:37:34.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2670653669 wait complete. 2024-09-19T04:37:34.491 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.474+0000 7fa57b1ca740 20 client.16968 trim_cache size 0 max 16384 2024-09-19T04:37:34.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.487+0000 7fa57b1ca740 1 Processor -- start 2024-09-19T04:37:34.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.487+0000 7fa57b1ca740 1 -- start start 2024-09-19T04:37:34.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.487+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b5872fbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.487+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b58735b40 0x563b58737180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.487+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b5873f370 0x563b587376c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.487+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741b00b0 con 0x563b58735b40 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.487+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741ad980 con 0x563b587345d0 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.487+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741ab7f0 con 0x563b5873f370 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b58735b40 0x563b58737180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b58735b40 0x563b58737180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39914/0 (socket says 172.21.15.70:39914) 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 -- 172.21.15.70:0/2407759473 learned_addr learned my addr 172.21.15.70:0/2407759473 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa57259c640 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b5872fbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa572d9d640 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b5873f370 0x563b587376c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 -- 172.21.15.70:0/2407759473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b5873f370 msgr2=0x563b587376c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b5873f370 0x563b587376c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 -- 172.21.15.70:0/2407759473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 msgr2=0x563b5872fbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:34.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b5872fbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 -- 172.21.15.70:0/2407759473 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b58741e80 con 0x563b58735b40 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa571d9b640 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b58735b40 0x563b58737180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa5680edef0 tx=0x7fa56802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebdb8c01061ebf5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa55bfff640 1 -- 172.21.15.70:0/2407759473 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568049040 con 0x563b58735b40 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa55bfff640 1 -- 172.21.15.70:0/2407759473 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa5680bd0d0 con 0x563b58735b40 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.488+0000 7fa55bfff640 1 -- 172.21.15.70:0/2407759473 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa568031dc0 con 0x563b58735b40 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2407759473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b58735b40 msgr2=0x563b58737180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b58735b40 0x563b58737180 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7fa5680edef0 tx=0x7fa56802a410 comp rx=0 tx=0).stop 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2407759473 shutdown_connections 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b5873f370 0x563b587376c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b58735b40 0x563b58737180 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/2407759473 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b587345d0 0x563b5872fbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2407759473 >> 172.21.15.70:0/2407759473 conn(0x563b586fd310 msgr2=0x563b5872f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:34.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2407759473 shutdown_connections 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 -- 172.21.15.70:0/2407759473 wait complete. 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 -- start start 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.489+0000 7fa57b1ca740 1 Processor -- start 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b587345d0 0x563b587470f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b58735b40 0x563b58747630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b587440c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741abe40 con 0x563b5873f370 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741ad2b0 con 0x563b58735b40 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa5741ac510 con 0x563b587345d0 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 10 client.0 _ll_register_callbacks cb 0x7fa56c009e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b587440c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b587440c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39916/0 (socket says 172.21.15.70:39916) 2024-09-19T04:37:34.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 -- 172.21.15.70:0/3835049098 learned_addr learned my addr 172.21.15.70:0/3835049098 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 -- 172.21.15.70:0/3835049098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b587345d0 msgr2=0x563b587470f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b587345d0 0x563b587470f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa571d9b640 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b58735b40 0x563b58747630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 -- 172.21.15.70:0/3835049098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b58735b40 msgr2=0x563b58747630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b58735b40 0x563b58747630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 -- 172.21.15.70:0/3835049098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b58744600 con 0x563b5873f370 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa572d9d640 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b587440c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa56c02dce0 tx=0x7fa56c02d5e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe25656099eaea5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa559ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa559ffb640 1 -- 172.21.15.70:0/3835049098 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa56c036600 con 0x563b5873f370 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa559ffb640 1 -- 172.21.15.70:0/3835049098 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fa56c0367a0 con 0x563b5873f370 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 1 -- 172.21.15.70:0/3835049098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa5680bd0d0 con 0x563b5873f370 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa559ffb640 1 -- 172.21.15.70:0/3835049098 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa56c009330 con 0x563b5873f370 2024-09-19T04:37:34.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.490+0000 7fa57b1ca740 10 client.16974 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa57b1ca740 1 -- 172.21.15.70:0/3835049098 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563b587ba2a0 con 0x563b5873f370 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa559ffb640 1 -- 172.21.15.70:0/3835049098 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa5680bd0d0 con 0x563b5873f370 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa559ffb640 1 -- 172.21.15.70:0/3835049098 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa56c024400 con 0x563b5873f370 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa57b1ca740 10 client.16974 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa57b1ca740 10 client.16974 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa57b1ca740 20 client.16974 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563b587ba9e0 0x563b587bce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa57b1ca740 4 client.16974 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa57b1ca740 1 -- 172.21.15.70:0/3835049098 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563b586a1d70 con 0x563b587ba9e0 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.491+0000 7fa57259c640 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563b587ba9e0 0x563b587bce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa559ffb640 10 client.16974 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:34.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57259c640 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563b587ba9e0 0x563b587bce20 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=65e5fcc9a4d7df83 server_cookie=ee3d004694c9ee63 in_seq=0 out_seq=0 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa559ffb640 1 -- 172.21.15.70:0/3835049098 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563b586a1d70 con 0x563b587ba9e0 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa559ffb640 10 client.16974 handle_command_reply: tid=0 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 client.16974 shutdown 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 -- 172.21.15.70:0/3835049098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 msgr2=0x563b587440c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b587440c0 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7fa56c02dce0 tx=0x7fa56c02d5e0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 -- 172.21.15.70:0/3835049098 shutdown_connections 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563b587ba9e0 0x563b587bce20 crc :-1 s=READY pgs=145 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563b5873f370 0x563b587440c0 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563b58735b40 0x563b58747630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa559ffb640 0 client.16974 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 --2- 172.21.15.70:0/3835049098 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563b587345d0 0x563b587470f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 -- 172.21.15.70:0/3835049098 >> 172.21.15.70:0/3835049098 conn(0x563b586fd310 msgr2=0x563b5873e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:34.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 -- 172.21.15.70:0/3835049098 shutdown_connections 2024-09-19T04:37:34.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 1 -- 172.21.15.70:0/3835049098 wait complete. 2024-09-19T04:37:34.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.492+0000 7fa57b1ca740 20 client.16974 trim_cache size 0 max 16384 2024-09-19T04:37:34.502 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:34.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 -- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa55c0a3430 msgr2=0x7fa55c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa55c0a3430 0x7fa55c0a58f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fa56c00bd20 tx=0x7fa56c009be0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 -- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 msgr2=0x7fa5741989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 0x7fa5741989d0 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7fa568009a20 tx=0x7fa5680043b0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 -- 172.21.15.70:0/1453639898 shutdown_connections 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa55c0a3430 0x7fa55c0a58f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa574106f00 0x7fa57419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa574102780 0x7fa5741989d0 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 --2- 172.21.15.70:0/1453639898 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa574101dd0 0x7fa574198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 -- 172.21.15.70:0/1453639898 >> 172.21.15.70:0/1453639898 conn(0x7fa5740fd8b0 msgr2=0x7fa5740fec20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 -- 172.21.15.70:0/1453639898 shutdown_connections 2024-09-19T04:37:34.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:34.493+0000 7fa578df1640 1 -- 172.21.15.70:0/1453639898 wait complete. 2024-09-19T04:37:35.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:35 smithi134 ceph-mon[34525]: pgmap v209: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:35.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:35 smithi070 ceph-mon[30942]: pgmap v209: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:35.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:35 smithi167 ceph-mon[34339]: pgmap v209: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:36.249 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:37:36.249 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:37:36.508 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:36.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:36 smithi070 ceph-mon[30942]: pgmap v210: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 -- 172.21.15.70:0/1307179511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004106a80 msgr2=0x7f1004106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 --2- 172.21.15.70:0/1307179511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004106a80 0x7f1004106e60 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f1000009930 tx=0x7f100002a420 comp rx=0 tx=0).stop 2024-09-19T04:37:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 -- 172.21.15.70:0/1307179511 shutdown_connections 2024-09-19T04:37:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 --2- 172.21.15.70:0/1307179511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004101420 0x7f100410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 --2- 172.21.15.70:0/1307179511 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1004100a80 0x7f1004100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 --2- 172.21.15.70:0/1307179511 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004106a80 0x7f1004106e60 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 -- 172.21.15.70:0/1307179511 >> 172.21.15.70:0/1307179511 conn(0x7f10040fc7a0 msgr2=0x7f10040febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:36.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 -- 172.21.15.70:0/1307179511 shutdown_connections 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.947+0000 7f100bf08640 1 -- 172.21.15.70:0/1307179511 wait complete. 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f100bf08640 1 Processor -- start 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f100bf08640 1 -- start start 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f100bf08640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1004100a80 0x7f1004197400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f100bf08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004101420 0x7f1004197940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f100bf08640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004106a80 0x7f100419bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f100bf08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1004110e90 con 0x7f1004101420 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f100bf08640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1004110d10 con 0x7f1004106a80 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f100bf08640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1004111010 con 0x7f1004100a80 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f10094a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004101420 0x7f1004197940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.948+0000 7f10094a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004101420 0x7f1004197940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39926/0 (socket says 172.21.15.70:39926) 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f10094a3640 1 -- 172.21.15.70:0/2811238670 learned_addr learned my addr 172.21.15.70:0/2811238670 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:36.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f1009ca4640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1004100a80 0x7f1004197400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f100a4a5640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004106a80 0x7f100419bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f10094a3640 1 -- 172.21.15.70:0/2811238670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1004100a80 msgr2=0x7f1004197400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f10094a3640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1004100a80 0x7f1004197400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f10094a3640 1 -- 172.21.15.70:0/2811238670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004106a80 msgr2=0x7f100419bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f10094a3640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004106a80 0x7f100419bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f10094a3640 1 -- 172.21.15.70:0/2811238670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100419c3b0 con 0x7f1004101420 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f10094a3640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004101420 0x7f1004197940 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800b4a0 tx=0x7f0ff800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f0ff6ffd640 1 -- 172.21.15.70:0/2811238670 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8014070 con 0x7f1004101420 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f0ff6ffd640 1 -- 172.21.15.70:0/2811238670 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0ff8010ae0 con 0x7f1004101420 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f100bf08640 1 -- 172.21.15.70:0/2811238670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100419c6a0 con 0x7f1004101420 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f0ff6ffd640 1 -- 172.21.15.70:0/2811238670 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ff8017c70 con 0x7f1004101420 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.949+0000 7f100bf08640 1 -- 172.21.15.70:0/2811238670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10041a3f80 con 0x7f1004101420 2024-09-19T04:37:36.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.951+0000 7f0ff6ffd640 1 -- 172.21.15.70:0/2811238670 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0ff8017070 con 0x7f1004101420 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100e2e1740 1 Processor -- start 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100e2e1740 1 -- start start 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e06150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e06690 0x55eb61e10a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e10f50 0x55eb61e13340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100e2e1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eb61d69280 con 0x55eb61e06690 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100e2e1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eb61d10b10 con 0x55eb61e10f50 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100e2e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb61d65240 con 0x55eb61e05d70 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f1009ca4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e06690 0x55eb61e10a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f1009ca4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e06690 0x55eb61e10a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39934/0 (socket says 172.21.15.70:39934) 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f1009ca4640 1 -- 172.21.15.70:0/3672487400 learned_addr learned my addr 172.21.15.70:0/3672487400 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:36.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100a4a5640 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e06150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f0ff6ffd640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a3430 0x7f0ff00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f1009ca4640 1 -- 172.21.15.70:0/3672487400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 msgr2=0x55eb61e06150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f1009ca4640 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e06150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f10094a3640 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e10f50 0x55eb61e13340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f1009ca4640 1 -- 172.21.15.70:0/3672487400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e10f50 msgr2=0x55eb61e13340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f1009ca4640 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e10f50 0x55eb61e13340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f1009ca4640 1 -- 172.21.15.70:0/3672487400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb61d1d1f0 con 0x55eb61e06690 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.952+0000 7f100a4a5640 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e06150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.953+0000 7f100a4a5640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a3430 0x7f0ff00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.953+0000 7f0ff6ffd640 1 -- 172.21.15.70:0/2811238670 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f0ff80ceeb0 con 0x7f1004101420 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.953+0000 7f1009ca4640 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e06690 0x55eb61e10a10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1000009230 tx=0x7f1000032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc3e695c99f87e4a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.953+0000 7f0feffff640 1 -- 172.21.15.70:0/3672487400 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000040070 con 0x55eb61e06690 2024-09-19T04:37:36.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.953+0000 7f0feffff640 1 -- 172.21.15.70:0/3672487400 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1000031710 con 0x55eb61e06690 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.953+0000 7f0feffff640 1 -- 172.21.15.70:0/3672487400 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000035040 con 0x55eb61e06690 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 -- 172.21.15.70:0/3672487400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e06690 msgr2=0x55eb61e10a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100a4a5640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a3430 0x7f0ff00a58f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098b0 tx=0x7f0ffc004a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e06690 0x55eb61e10a10 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7f1000009230 tx=0x7f1000032cc0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 -- 172.21.15.70:0/3672487400 shutdown_connections 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e10f50 0x55eb61e13340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e06690 0x55eb61e10a10 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 --2- 172.21.15.70:0/3672487400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e06150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 -- 172.21.15.70:0/3672487400 >> 172.21.15.70:0/3672487400 conn(0x55eb61e02300 msgr2=0x55eb61e026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 -- 172.21.15.70:0/3672487400 shutdown_connections 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 -- 172.21.15.70:0/3672487400 wait complete. 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 -- start start 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.954+0000 7f100e2e1740 1 Processor -- start 2024-09-19T04:37:36.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e05d70 0x55eb61e0de20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 0x55eb61e0e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e10f50 0x55eb61e0e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f100e2e1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55eb61e13b20 con 0x55eb61e05d70 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f100e2e1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55eb61d23f10 con 0x55eb61e06690 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f100e2e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55eb61e13ca0 con 0x55eb61e10f50 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f100e2e1740 10 client.0 _ll_register_callbacks cb 0x55eb61ceca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e05d70 0x55eb61e0de20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e05d70 0x55eb61e0de20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39944/0 (socket says 172.21.15.70:39944) 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 -- 172.21.15.70:0/143743985 learned_addr learned my addr 172.21.15.70:0/143743985 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f10094a3640 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 0x55eb61e0e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f100a4a5640 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e10f50 0x55eb61e0e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 -- 172.21.15.70:0/143743985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e10f50 msgr2=0x55eb61e0e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e10f50 0x55eb61e0e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 -- 172.21.15.70:0/143743985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 msgr2=0x55eb61e0e360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 0x55eb61e0e360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 -- 172.21.15.70:0/143743985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb61ada6a0 con 0x55eb61e05d70 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f1009ca4640 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e05d70 0x55eb61e0de20 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1000031600 tx=0x7f1000031630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97053af854b29bc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.955+0000 7f0fed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f0fed7fa640 1 -- 172.21.15.70:0/143743985 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100004b020 con 0x55eb61e05d70 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f0fed7fa640 1 -- 172.21.15.70:0/143743985 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f100003c850 con 0x55eb61e05d70 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 1 -- 172.21.15.70:0/143743985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1000031710 con 0x55eb61e05d70 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f0fed7fa640 1 -- 172.21.15.70:0/143743985 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1000056050 con 0x55eb61e05d70 2024-09-19T04:37:36.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 10 client.16986 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 1 -- 172.21.15.70:0/143743985 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55eb61e1f720 con 0x55eb61e05d70 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f0fed7fa640 1 -- 172.21.15.70:0/143743985 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1000031710 con 0x55eb61e05d70 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f0fed7fa640 1 -- 172.21.15.70:0/143743985 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1000044ba0 con 0x55eb61e05d70 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 10 client.16986 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 10 client.16986 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 20 client.16986 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55eb61e20a70 0x55eb61e22e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 4 client.16986 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f100e2e1740 1 -- 172.21.15.70:0/143743985 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55eb61d767f0 con 0x55eb61e20a70 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.956+0000 7f10094a3640 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55eb61e20a70 0x55eb61e22e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.957+0000 7f0fed7fa640 10 client.16986 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.957+0000 7f10094a3640 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55eb61e20a70 0x55eb61e22e60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87e1d1fe55be0458 server_cookie=53a96ba5e1106c66 in_seq=0 out_seq=0 2024-09-19T04:37:36.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f0fed7fa640 1 -- 172.21.15.70:0/143743985 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55eb61d767f0 con 0x55eb61e20a70 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f0fed7fa640 10 client.16986 handle_command_reply: tid=0 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 client.16986 shutdown 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 -- 172.21.15.70:0/143743985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e05d70 msgr2=0x55eb61e0de20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e05d70 0x55eb61e0de20 secure :-1 s=READY pgs=913 cs=0 l=1 rev1=1 crypto rx=0x7f1000031600 tx=0x7f1000031630 comp rx=0 tx=0).stop 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 -- 172.21.15.70:0/143743985 shutdown_connections 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55eb61e20a70 0x55eb61e22e60 crc :-1 s=READY pgs=146 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e10f50 0x55eb61e0e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f0fed7fa640 0 client.16986 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 0x55eb61e0e360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 --2- 172.21.15.70:0/143743985 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e05d70 0x55eb61e0de20 unknown :-1 s=CLOSED pgs=913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 -- 172.21.15.70:0/143743985 >> 172.21.15.70:0/143743985 conn(0x55eb61e02300 msgr2=0x55eb61dff270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:36.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 -- 172.21.15.70:0/143743985 shutdown_connections 2024-09-19T04:37:36.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 1 -- 172.21.15.70:0/143743985 wait complete. 2024-09-19T04:37:36.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.958+0000 7f100e2e1740 20 client.16986 trim_cache size 0 max 16384 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.975+0000 7f100e2e1740 1 Processor -- start 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.975+0000 7f100e2e1740 1 -- start start 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e28430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 0x55eb61e28970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61dfea50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100e2e1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f10041adf10 con 0x55eb61e10f50 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100e2e1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10041ab7e0 con 0x55eb61e06690 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100e2e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10041a9650 con 0x55eb61e05d70 2024-09-19T04:37:36.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61dfea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61dfea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39948/0 (socket says 172.21.15.70:39948) 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 -- 172.21.15.70:0/594109595 learned_addr learned my addr 172.21.15.70:0/594109595 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f1009ca4640 1 --2- 172.21.15.70:0/594109595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e28430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 -- 172.21.15.70:0/594109595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 msgr2=0x55eb61e28430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 --2- 172.21.15.70:0/594109595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e28430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 -- 172.21.15.70:0/594109595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 msgr2=0x55eb61e28970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 --2- 172.21.15.70:0/594109595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 0x55eb61e28970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 -- 172.21.15.70:0/594109595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55eb61e05af0 con 0x55eb61e10f50 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f100a4a5640 1 --2- 172.21.15.70:0/594109595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61dfea50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc005f40 tx=0x7f0ffc015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6033947eb3e752fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f0fef7fe640 1 -- 172.21.15.70:0/594109595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc020b60 con 0x55eb61e10f50 2024-09-19T04:37:36.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f0fef7fe640 1 -- 172.21.15.70:0/594109595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0ffc017070 con 0x55eb61e10f50 2024-09-19T04:37:36.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.976+0000 7f0fef7fe640 1 -- 172.21.15.70:0/594109595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc01e690 con 0x55eb61e10f50 2024-09-19T04:37:36.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 -- 172.21.15.70:0/594109595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 msgr2=0x55eb61dfea50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 --2- 172.21.15.70:0/594109595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61dfea50 secure :-1 s=READY pgs=914 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc005f40 tx=0x7f0ffc015000 comp rx=0 tx=0).stop 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 -- 172.21.15.70:0/594109595 shutdown_connections 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 --2- 172.21.15.70:0/594109595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61dfea50 unknown :-1 s=CLOSED pgs=914 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 --2- 172.21.15.70:0/594109595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e06690 0x55eb61e28970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 --2- 172.21.15.70:0/594109595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e05d70 0x55eb61e28430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 -- 172.21.15.70:0/594109595 >> 172.21.15.70:0/594109595 conn(0x55eb61e02300 msgr2=0x55eb61e07fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 -- 172.21.15.70:0/594109595 shutdown_connections 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 -- 172.21.15.70:0/594109595 wait complete. 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.977+0000 7f100e2e1740 1 -- start start 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100e2e1740 1 Processor -- start 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e05d70 0x55eb61e15290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e06690 0x55eb61e157d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100e2e1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61e8a400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100e2e1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f10041a9ca0 con 0x55eb61e10f50 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100e2e1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f10041ab110 con 0x55eb61e05d70 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100e2e1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10041aa370 con 0x55eb61e06690 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100e2e1740 10 client.0 _ll_register_callbacks cb 0x7f1000032b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100a4a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61e8a400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100a4a5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61e8a400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39970/0 (socket says 172.21.15.70:39970) 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100a4a5640 1 -- 172.21.15.70:0/2466788284 learned_addr learned my addr 172.21.15.70:0/2466788284 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f10094a3640 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e06690 0x55eb61e157d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f1009ca4640 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e05d70 0x55eb61e15290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100a4a5640 1 -- 172.21.15.70:0/2466788284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e06690 msgr2=0x55eb61e157d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100a4a5640 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e06690 0x55eb61e157d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.985 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100a4a5640 1 -- 172.21.15.70:0/2466788284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e05d70 msgr2=0x55eb61e15290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100a4a5640 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e05d70 0x55eb61e15290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.978+0000 7f100a4a5640 1 -- 172.21.15.70:0/2466788284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55eb61e8a940 con 0x55eb61e10f50 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100a4a5640 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61e8a400 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc005f10 tx=0x7f0ffc009600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80d84e196e7fadee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f0fed7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f0fed7fa640 1 -- 172.21.15.70:0/2466788284 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ffc020c30 con 0x55eb61e10f50 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f0fed7fa640 1 -- 172.21.15.70:0/2466788284 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f0ffc020dd0 con 0x55eb61e10f50 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 1 -- 172.21.15.70:0/2466788284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ffc017070 con 0x55eb61e10f50 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f0fed7fa640 1 -- 172.21.15.70:0/2466788284 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ffc040050 con 0x55eb61e10f50 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 10 client.16992 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 1 -- 172.21.15.70:0/2466788284 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55eb61e8bb80 con 0x55eb61e10f50 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f0fed7fa640 1 -- 172.21.15.70:0/2466788284 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0ffc017070 con 0x55eb61e10f50 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f0fed7fa640 1 -- 172.21.15.70:0/2466788284 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0ffc027020 con 0x55eb61e10f50 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 10 client.16992 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 10 client.16992 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:36.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 20 client.16992 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55eb61e8c1e0 0x55eb61e8e600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 4 client.16992 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.979+0000 7f100e2e1740 1 -- 172.21.15.70:0/2466788284 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55eb61d70d00 con 0x55eb61e8c1e0 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.980+0000 7f1009ca4640 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55eb61e8c1e0 0x55eb61e8e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.980+0000 7f0fed7fa640 10 client.16992 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.980+0000 7f1009ca4640 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55eb61e8c1e0 0x55eb61e8e600 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=788387ce2485b10e server_cookie=f3403f50b0fc4a6b in_seq=0 out_seq=0 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f0fed7fa640 1 -- 172.21.15.70:0/2466788284 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55eb61d70d00 con 0x55eb61e8c1e0 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f0fed7fa640 10 client.16992 handle_command_reply: tid=0 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 client.16992 shutdown 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 -- 172.21.15.70:0/2466788284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 msgr2=0x55eb61e8a400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61e8a400 secure :-1 s=READY pgs=915 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc005f10 tx=0x7f0ffc009600 comp rx=0 tx=0).stop 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 -- 172.21.15.70:0/2466788284 shutdown_connections 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55eb61e8c1e0 0x55eb61e8e600 crc :-1 s=READY pgs=147 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55eb61e10f50 0x55eb61e8a400 unknown :-1 s=CLOSED pgs=915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55eb61e06690 0x55eb61e157d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 --2- 172.21.15.70:0/2466788284 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55eb61e05d70 0x55eb61e15290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 -- 172.21.15.70:0/2466788284 >> 172.21.15.70:0/2466788284 conn(0x55eb61e02300 msgr2=0x55eb61e0ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f0fed7fa640 0 client.16992 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 -- 172.21.15.70:0/2466788284 shutdown_connections 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 1 -- 172.21.15.70:0/2466788284 wait complete. 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.981+0000 7f100e2e1740 20 client.16992 trim_cache size 0 max 16384 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "93045eac-8a56-4dd5-9b67-f555042b5ecc", 2024-09-19T04:37:36.988 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:37:36.989 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:36.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 -- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a3430 msgr2=0x7f0ff00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a3430 0x7f0ff00a58f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc0098b0 tx=0x7f0ffc004a40 comp rx=0 tx=0).stop 2024-09-19T04:37:36.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 -- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004101420 msgr2=0x7f1004197940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:36.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004101420 0x7f1004197940 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f0ff800b4a0 tx=0x7f0ff800b960 comp rx=0 tx=0).stop 2024-09-19T04:37:36.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 -- 172.21.15.70:0/2811238670 shutdown_connections 2024-09-19T04:37:36.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a3430 0x7f0ff00a58f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1004106a80 0x7f100419bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1004101420 0x7f1004197940 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 --2- 172.21.15.70:0/2811238670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1004100a80 0x7f1004197400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:36.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 -- 172.21.15.70:0/2811238670 >> 172.21.15.70:0/2811238670 conn(0x7f10040fc7a0 msgr2=0x7f10040fd150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:36.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 -- 172.21.15.70:0/2811238670 shutdown_connections 2024-09-19T04:37:36.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:36.982+0000 7f100bf08640 1 -- 172.21.15.70:0/2811238670 wait complete. 2024-09-19T04:37:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:36 smithi134 ceph-mon[34525]: pgmap v210: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:37.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:36 smithi167 ceph-mon[34339]: pgmap v210: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:37.744 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:37:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:37 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:37:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:37 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:37 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:37:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:37 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:37.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:37 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:37:37.991 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:37 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:37:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:37 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:37 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:37:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:37 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:37 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:37:38.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:37 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:37:38.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:37 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:37 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:37:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:37 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:37 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:37:38.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3274138738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24102790 msgr2=0x7f2f241067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3274138738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24102790 0x7f2f241067e0 secure :-1 s=READY pgs=916 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009900 tx=0x7f2f1802a410 comp rx=0 tx=0).stop 2024-09-19T04:37:38.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3274138738 shutdown_connections 2024-09-19T04:37:38.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3274138738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f24106f10 0x7f2f2410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3274138738 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24102790 0x7f2f241067e0 unknown :-1 s=CLOSED pgs=916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3274138738 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f24101de0 0x7f2f241021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3274138738 >> 172.21.15.70:0/3274138738 conn(0x7f2f240fd8c0 msgr2=0x7f2f240ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3274138738 shutdown_connections 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.478+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3274138738 wait complete. 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f2a44b640 1 Processor -- start 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f2a44b640 1 -- start start 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f2a44b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f24101de0 0x7f2f24198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f2a44b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f24102790 0x7f2f24198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f2a44b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24106f10 0x7f2f2419cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f2a44b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24111f40 con 0x7f2f24106f10 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f2a44b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f24111dc0 con 0x7f2f24102790 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f2a44b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241120c0 con 0x7f2f24101de0 2024-09-19T04:37:38.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f289e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24106f10 0x7f2f2419cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f289e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24106f10 0x7f2f2419cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:39988/0 (socket says 172.21.15.70:39988) 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f289e8640 1 -- 172.21.15.70:0/3278174253 learned_addr learned my addr 172.21.15.70:0/3278174253 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f23fff640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f24101de0 0x7f2f24198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.479+0000 7f2f237fe640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f24102790 0x7f2f24198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f289e8640 1 -- 172.21.15.70:0/3278174253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f24101de0 msgr2=0x7f2f24198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f289e8640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f24101de0 0x7f2f24198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f289e8640 1 -- 172.21.15.70:0/3278174253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f24102790 msgr2=0x7f2f24198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f289e8640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f24102790 0x7f2f24198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f289e8640 1 -- 172.21.15.70:0/3278174253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f2419d3e0 con 0x7f2f24106f10 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f289e8640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24106f10 0x7f2f2419cd00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00eaa0 tx=0x7f2f1c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f217fa640 1 -- 172.21.15.70:0/3278174253 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c00cdb0 con 0x7f2f24106f10 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f217fa640 1 -- 172.21.15.70:0/3278174253 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2f1c005020 con 0x7f2f24106f10 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3278174253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f2419d6d0 con 0x7f2f24106f10 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f217fa640 1 -- 172.21.15.70:0/3278174253 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f1c0116b0 con 0x7f2f24106f10 2024-09-19T04:37:38.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.480+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3278174253 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f241a4fb0 con 0x7f2f24106f10 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f217fa640 1 -- 172.21.15.70:0/3278174253 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2f1c0051d0 con 0x7f2f24106f10 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f2c824740 1 Processor -- start 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f2c824740 1 -- start start 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec93554a0 0x55dec9355880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec9360140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec9360680 0x55dec9362a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f2c824740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dec92bb2e0 con 0x55dec9360680 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f2c824740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dec9262ce0 con 0x55dec93554a0 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f2c824740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dec92b72a0 con 0x55dec9355dc0 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec9360680 0x55dec9362a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec9360680 0x55dec9362a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40002/0 (socket says 172.21.15.70:40002) 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f237fe640 1 -- 172.21.15.70:0/811133957 learned_addr learned my addr 172.21.15.70:0/811133957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f237fe640 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec93554a0 0x55dec9355880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f23fff640 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec9360140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.483+0000 7f2f217fa640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f0c0a33b0 0x7f2f0c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f237fe640 1 -- 172.21.15.70:0/811133957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 msgr2=0x55dec9360140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f237fe640 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec9360140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f237fe640 1 -- 172.21.15.70:0/811133957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec93554a0 msgr2=0x55dec9355880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f237fe640 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec93554a0 0x55dec9355880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f237fe640 1 -- 172.21.15.70:0/811133957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec9247440 con 0x55dec9360680 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f289e8640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f0c0a33b0 0x7f2f0c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f237fe640 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec9360680 0x55dec9362a70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2f180096c0 tx=0x7f2f18031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab1780ce7bba761 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f217fa640 1 -- 172.21.15.70:0/3278174253 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f2f1c0cffb0 con 0x7f2f24106f10 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f0a7fc640 1 -- 172.21.15.70:0/811133957 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18035040 con 0x55dec9360680 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f0a7fc640 1 -- 172.21.15.70:0/811133957 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2f18031b80 con 0x55dec9360680 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.484+0000 7f2f0a7fc640 1 -- 172.21.15.70:0/811133957 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18003900 con 0x55dec9360680 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 -- 172.21.15.70:0/811133957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec9360680 msgr2=0x55dec9362a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f289e8640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f0c0a33b0 0x7f2f0c0a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0cd760 tx=0x7f2f1c06e010 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec9360680 0x55dec9362a70 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f2f180096c0 tx=0x7f2f18031400 comp rx=0 tx=0).stop 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 -- 172.21.15.70:0/811133957 shutdown_connections 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec9360680 0x55dec9362a70 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec9360140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 --2- 172.21.15.70:0/811133957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec93554a0 0x55dec9355880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 -- 172.21.15.70:0/811133957 >> 172.21.15.70:0/811133957 conn(0x55dec9351a30 msgr2=0x55dec9351e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 -- 172.21.15.70:0/811133957 shutdown_connections 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 -- 172.21.15.70:0/811133957 wait complete. 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 -- start start 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.485+0000 7f2f2c824740 1 Processor -- start 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9360090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec935d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 0x55dec935d950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f2c824740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dec9363250 con 0x55dec93554a0 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f2c824740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dec9276050 con 0x55dec9360680 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f2c824740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dec93633d0 con 0x55dec9355dc0 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f2c824740 10 client.0 _ll_register_callbacks cb 0x55dec92b6160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9360090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9360090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40008/0 (socket says 172.21.15.70:40008) 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 -- 172.21.15.70:0/2409196038 learned_addr learned my addr 172.21.15.70:0/2409196038 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f23fff640 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec935d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 0x55dec935d950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 -- 172.21.15.70:0/2409196038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 msgr2=0x55dec935d340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec935d340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 -- 172.21.15.70:0/2409196038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 msgr2=0x55dec935d950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:38.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 0x55dec935d950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 -- 172.21.15.70:0/2409196038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dec902c3c0 con 0x55dec93554a0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f237fe640 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9360090 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2f18031f40 tx=0x7f2f18005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da375e016940f94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f037fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f037fe640 1 -- 172.21.15.70:0/2409196038 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18054060 con 0x55dec93554a0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f037fe640 1 -- 172.21.15.70:0/2409196038 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f2f1803d990 con 0x55dec93554a0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.486+0000 7f2f2c824740 1 -- 172.21.15.70:0/2409196038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f18031b80 con 0x55dec93554a0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f037fe640 1 -- 172.21.15.70:0/2409196038 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2f18035070 con 0x55dec93554a0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f2c824740 10 client.17004 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f2c824740 1 -- 172.21.15.70:0/2409196038 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dec936ece0 con 0x55dec93554a0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f037fe640 1 -- 172.21.15.70:0/2409196038 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2f18031b80 con 0x55dec93554a0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f037fe640 1 -- 172.21.15.70:0/2409196038 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2f1803a040 con 0x55dec93554a0 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f2c824740 10 client.17004 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:38.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f2c824740 10 client.17004 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f2c824740 20 client.17004 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f2c824740 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dec9370030 0x55dec9372420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f2c824740 4 client.17004 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f2c824740 1 -- 172.21.15.70:0/2409196038 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dec92c8850 con 0x55dec9370030 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.487+0000 7f2f23fff640 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dec9370030 0x55dec9372420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.488+0000 7f2f037fe640 10 client.17004 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.488+0000 7f2f23fff640 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dec9370030 0x55dec9372420 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56ff9bd5f2d42a4 server_cookie=acf540a27efa9513 in_seq=0 out_seq=0 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.488+0000 7f2f037fe640 1 -- 172.21.15.70:0/2409196038 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dec92c8850 con 0x55dec9370030 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.488+0000 7f2f037fe640 10 client.17004 handle_command_reply: tid=0 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.488+0000 7f2f2c824740 1 client.17004 shutdown 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 -- 172.21.15.70:0/2409196038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 msgr2=0x55dec9360090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9360090 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7f2f18031f40 tx=0x7f2f18005be0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 -- 172.21.15.70:0/2409196038 shutdown_connections 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dec9370030 0x55dec9372420 crc :-1 s=READY pgs=148 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 0x55dec935d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec935d340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 --2- 172.21.15.70:0/2409196038 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9360090 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 -- 172.21.15.70:0/2409196038 >> 172.21.15.70:0/2409196038 conn(0x55dec9351a30 msgr2=0x55dec9357710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f037fe640 0 client.17004 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 -- 172.21.15.70:0/2409196038 shutdown_connections 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 1 -- 172.21.15.70:0/2409196038 wait complete. 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.489+0000 7f2f2c824740 20 client.17004 trim_cache size 0 max 16384 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f2c824740 1 Processor -- start 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f2c824740 1 -- start start 2024-09-19T04:37:38.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec936c630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec935a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 0x55dec935aae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f2c824740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241b0170 con 0x55dec93554a0 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f2c824740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241ada40 con 0x55dec9360680 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f2c824740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241ab8b0 con 0x55dec9355dc0 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec936c630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec936c630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40018/0 (socket says 172.21.15.70:40018) 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 -- 172.21.15.70:0/552271698 learned_addr learned my addr 172.21.15.70:0/552271698 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 -- 172.21.15.70:0/552271698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 msgr2=0x55dec935a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:38.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 --2- 172.21.15.70:0/552271698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec935a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 -- 172.21.15.70:0/552271698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 msgr2=0x55dec935aae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 --2- 172.21.15.70:0/552271698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 0x55dec935aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 -- 172.21.15.70:0/552271698 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dec935fbb0 con 0x55dec93554a0 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f237fe640 1 --2- 172.21.15.70:0/552271698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec936c630 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2f180059d0 tx=0x7f2f180092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48fcbbeb6d39260a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.506+0000 7f2f09ffb640 1 -- 172.21.15.70:0/552271698 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18054040 con 0x55dec93554a0 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f09ffb640 1 -- 172.21.15.70:0/552271698 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2f18050030 con 0x55dec93554a0 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f09ffb640 1 -- 172.21.15.70:0/552271698 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18005460 con 0x55dec93554a0 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 -- 172.21.15.70:0/552271698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 msgr2=0x55dec936c630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 --2- 172.21.15.70:0/552271698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec936c630 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7f2f180059d0 tx=0x7f2f180092b0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 -- 172.21.15.70:0/552271698 shutdown_connections 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 --2- 172.21.15.70:0/552271698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9360680 0x55dec935aae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 --2- 172.21.15.70:0/552271698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9355dc0 0x55dec935a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 --2- 172.21.15.70:0/552271698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec936c630 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 -- 172.21.15.70:0/552271698 >> 172.21.15.70:0/552271698 conn(0x55dec9351a30 msgr2=0x55dec93588b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 -- 172.21.15.70:0/552271698 shutdown_connections 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 -- 172.21.15.70:0/552271698 wait complete. 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.507+0000 7f2f2c824740 1 -- start start 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f2c824740 1 Processor -- start 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9375500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9355dc0 0x55dec9372850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f2c824740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9360680 0x55dec9372d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f2c824740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241abf00 con 0x55dec93554a0 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f2c824740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241ad370 con 0x55dec9355dc0 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f2c824740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2f241ac5d0 con 0x55dec9360680 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f2c824740 10 client.0 _ll_register_callbacks cb 0x7f2f18009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:38.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9375500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9375500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40020/0 (socket says 172.21.15.70:40020) 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 -- 172.21.15.70:0/3282346028 learned_addr learned my addr 172.21.15.70:0/3282346028 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f23fff640 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9355dc0 0x55dec9372850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9360680 0x55dec9372d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 -- 172.21.15.70:0/3282346028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9360680 msgr2=0x55dec9372d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9360680 0x55dec9372d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 -- 172.21.15.70:0/3282346028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9355dc0 msgr2=0x55dec9372850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9355dc0 0x55dec9372850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.508+0000 7f2f237fe640 1 -- 172.21.15.70:0/3282346028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dec93732d0 con 0x55dec93554a0 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f237fe640 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9375500 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009340 tx=0x7f2f1802a410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef074239cf009a16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f037fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:38.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f037fe640 1 -- 172.21.15.70:0/3282346028 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f18054070 con 0x55dec93554a0 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f037fe640 1 -- 172.21.15.70:0/3282346028 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f2f18004460 con 0x55dec93554a0 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 1 -- 172.21.15.70:0/3282346028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2f18050030 con 0x55dec93554a0 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f037fe640 1 -- 172.21.15.70:0/3282346028 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2f18075050 con 0x55dec93554a0 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 10 client.17010 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 1 -- 172.21.15.70:0/3282346028 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dec93da6d0 con 0x55dec93554a0 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f037fe640 1 -- 172.21.15.70:0/3282346028 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2f18050030 con 0x55dec93554a0 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f037fe640 1 -- 172.21.15.70:0/3282346028 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2f18060070 con 0x55dec93554a0 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 10 client.17010 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 10 client.17010 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 20 client.17010 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dec93dab90 0x55dec93dcf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 4 client.17010 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.509+0000 7f2f2c824740 1 -- 172.21.15.70:0/3282346028 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55dec92c2d60 con 0x55dec93dab90 2024-09-19T04:37:38.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f23fff640 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dec93dab90 0x55dec93dcf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f037fe640 10 client.17010 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f23fff640 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dec93dab90 0x55dec93dcf80 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f17426023b0a0e08 server_cookie=cd094bcb067c2c7c in_seq=0 out_seq=0 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f037fe640 1 -- 172.21.15.70:0/3282346028 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55dec92c2d60 con 0x55dec93dab90 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f037fe640 10 client.17010 handle_command_reply: tid=0 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 client.17010 shutdown 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 -- 172.21.15.70:0/3282346028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 msgr2=0x55dec9375500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9375500 secure :-1 s=READY pgs=921 cs=0 l=1 rev1=1 crypto rx=0x7f2f18009340 tx=0x7f2f1802a410 comp rx=0 tx=0).stop 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 -- 172.21.15.70:0/3282346028 shutdown_connections 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dec93dab90 0x55dec93dcf80 crc :-1 s=READY pgs=149 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dec9360680 0x55dec9372d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dec9355dc0 0x55dec9372850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f037fe640 0 client.17010 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:38.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 --2- 172.21.15.70:0/3282346028 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dec93554a0 0x55dec9375500 unknown :-1 s=CLOSED pgs=921 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.510+0000 7f2f2c824740 1 -- 172.21.15.70:0/3282346028 >> 172.21.15.70:0/3282346028 conn(0x55dec9351a30 msgr2=0x55dec935eba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:38.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2c824740 1 -- 172.21.15.70:0/3282346028 shutdown_connections 2024-09-19T04:37:38.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2c824740 1 -- 172.21.15.70:0/3282346028 wait complete. 2024-09-19T04:37:38.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2c824740 20 client.17010 trim_cache size 0 max 16384 2024-09-19T04:37:38.532 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:37:38.532 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:37:38.532 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f0c0a33b0 msgr2=0x7f2f0c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f0c0a33b0 0x7f2f0c0a5870 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c0cd760 tx=0x7f2f1c06e010 comp rx=0 tx=0).stop 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24106f10 msgr2=0x7f2f2419cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24106f10 0x7f2f2419cd00 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f2f1c00eaa0 tx=0x7f2f1c00ef60 comp rx=0 tx=0).stop 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3278174253 shutdown_connections 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f0c0a33b0 0x7f2f0c0a5870 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2f24106f10 0x7f2f2419cd00 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f24102790 0x7f2f24198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 --2- 172.21.15.70:0/3278174253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2f24101de0 0x7f2f24198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3278174253 >> 172.21.15.70:0/3278174253 conn(0x7f2f240fd8c0 msgr2=0x7f2f240fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3278174253 shutdown_connections 2024-09-19T04:37:38.533 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:38.511+0000 7f2f2a44b640 1 -- 172.21.15.70:0/3278174253 wait complete. 2024-09-19T04:37:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:38 smithi134 ceph-mon[34525]: pgmap v211: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:39.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:38 smithi070 ceph-mon[30942]: pgmap v211: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:39.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:38 smithi167 ceph-mon[34339]: pgmap v211: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:39.215 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:37:39.215 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:37:39.467 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:39.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 -- 172.21.15.70:0/2130151749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 msgr2=0x7fb31010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:39.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 --2- 172.21.15.70:0/2130151749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 0x7fb31010e610 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7fb308009ca0 tx=0x7fb30802a950 comp rx=0 tx=0).stop 2024-09-19T04:37:39.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 -- 172.21.15.70:0/2130151749 shutdown_connections 2024-09-19T04:37:39.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 --2- 172.21.15.70:0/2130151749 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 0x7fb31010e610 unknown :-1 s=CLOSED pgs=922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:39.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 --2- 172.21.15.70:0/2130151749 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310103660 0x7fb31010bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:39.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 --2- 172.21.15.70:0/2130151749 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb310102d40 0x7fb310103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:39.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 -- 172.21.15.70:0/2130151749 >> 172.21.15.70:0/2130151749 conn(0x7fb3100fc7a0 msgr2=0x7fb3100febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:39.966 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 -- 172.21.15.70:0/2130151749 shutdown_connections 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.942+0000 7fb315d3a640 1 -- 172.21.15.70:0/2130151749 wait complete. 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb315d3a640 1 Processor -- start 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb315d3a640 1 -- start start 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb315d3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb310102d40 0x7fb3101984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb315d3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310103660 0x7fb310198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb315d3a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 0x7fb31019cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb315d3a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb310111f40 con 0x7fb31010c170 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb315d3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb310111dc0 con 0x7fb310102d40 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb315d3a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb3101120c0 con 0x7fb310103660 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb30ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 0x7fb31019cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb30ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 0x7fb31019cdc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40034/0 (socket says 172.21.15.70:40034) 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.943+0000 7fb30ffff640 1 -- 172.21.15.70:0/249640485 learned_addr learned my addr 172.21.15.70:0/249640485 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:39.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30effd640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310103660 0x7fb310198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30f7fe640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb310102d40 0x7fb3101984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30ffff640 1 -- 172.21.15.70:0/249640485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310103660 msgr2=0x7fb310198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30ffff640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310103660 0x7fb310198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30ffff640 1 -- 172.21.15.70:0/249640485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb310102d40 msgr2=0x7fb3101984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30ffff640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb310102d40 0x7fb3101984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30ffff640 1 -- 172.21.15.70:0/249640485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb31019d4a0 con 0x7fb31010c170 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30ffff640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 0x7fb31019cdc0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb308005cc0 tx=0x7fb30802f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30cff9640 1 -- 172.21.15.70:0/249640485 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308003d80 con 0x7fb31010c170 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb31019d730 con 0x7fb31010c170 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30cff9640 1 -- 172.21.15.70:0/249640485 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb308030910 con 0x7fb31010c170 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb30cff9640 1 -- 172.21.15.70:0/249640485 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb308039680 con 0x7fb31010c170 2024-09-19T04:37:39.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.944+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb31019dbb0 con 0x7fb31010c170 2024-09-19T04:37:39.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.945+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb310103120 con 0x7fb31010c170 2024-09-19T04:37:39.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.946+0000 7fb30cff9640 1 -- 172.21.15.70:0/249640485 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb308037020 con 0x7fb31010c170 2024-09-19T04:37:39.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.947+0000 7fb30cff9640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb2f80a33b0 0x7fb2f80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:39.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.947+0000 7fb30f7fe640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb2f80a33b0 0x7fb2f80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:39.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.947+0000 7fb30cff9640 1 -- 172.21.15.70:0/249640485 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fb3080f0c50 con 0x7fb31010c170 2024-09-19T04:37:39.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.947+0000 7fb30f7fe640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb2f80a33b0 0x7fb2f80a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb300005fd0 tx=0x7fb300005850 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:39.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:39.950+0000 7fb30cff9640 1 -- 172.21.15.70:0/249640485 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fb30803f070 con 0x7fb31010c170 2024-09-19T04:37:40.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.151+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb31002d7c0 con 0x7fb31010c170 2024-09-19T04:37:40.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.152+0000 7fb30cff9640 1 -- 172.21.15.70:0/249640485 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7fb3080bd630 con 0x7fb31010c170 2024-09-19T04:37:40.154 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:37:40.154 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:37:40.154 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:37:40.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb2f80a33b0 msgr2=0x7fb2f80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:40.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb2f80a33b0 0x7fb2f80a5870 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fb300005fd0 tx=0x7fb300005850 comp rx=0 tx=0).stop 2024-09-19T04:37:40.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 msgr2=0x7fb31019cdc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:40.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 0x7fb31019cdc0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7fb308005cc0 tx=0x7fb30802f650 comp rx=0 tx=0).stop 2024-09-19T04:37:40.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 shutdown_connections 2024-09-19T04:37:40.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb2f80a33b0 0x7fb2f80a5870 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb31010c170 0x7fb31019cdc0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb310103660 0x7fb310198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 --2- 172.21.15.70:0/249640485 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb310102d40 0x7fb3101984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 >> 172.21.15.70:0/249640485 conn(0x7fb3100fc7a0 msgr2=0x7fb3100fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 shutdown_connections 2024-09-19T04:37:40.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:40.154+0000 7fb315d3a640 1 -- 172.21.15.70:0/249640485 wait complete. 2024-09-19T04:37:40.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:40 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/249640485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:40.470 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:40 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/249640485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:40.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:40 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/249640485' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:40.807 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:37:41.052 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:41.424 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:41 smithi070 ceph-mon[30942]: pgmap v212: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:41.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 -- 172.21.15.70:0/2749727524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 msgr2=0x7f63e8107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 --2- 172.21.15.70:0/2749727524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 0x7f63e8107a50 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f63dc009930 tx=0x7f63dc02a420 comp rx=0 tx=0).stop 2024-09-19T04:37:41.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 -- 172.21.15.70:0/2749727524 shutdown_connections 2024-09-19T04:37:41.507 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 --2- 172.21.15.70:0/2749727524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8108160 0x7f63e810eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 --2- 172.21.15.70:0/2749727524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 0x7f63e8107a50 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 --2- 172.21.15.70:0/2749727524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e81008e0 0x7f63e8100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 -- 172.21.15.70:0/2749727524 >> 172.21.15.70:0/2749727524 conn(0x7f63e8077210 msgr2=0x7f63e8077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 -- 172.21.15.70:0/2749727524 shutdown_connections 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 -- 172.21.15.70:0/2749727524 wait complete. 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.503+0000 7f63edbe0640 1 Processor -- start 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63edbe0640 1 -- start start 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63edbe0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e81008e0 0x7f63e8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63edbe0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 0x7f63e81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.508 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63edbe0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8108160 0x7f63e819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63edbe0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63e8111f80 con 0x7f63e8101290 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63edbe0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63e8111e00 con 0x7f63e81008e0 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63edbe0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63e8112100 con 0x7f63e8108160 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 0x7f63e81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 0x7f63e81989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40048/0 (socket says 172.21.15.70:40048) 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 -- 172.21.15.70:0/926282084 learned_addr learned my addr 172.21.15.70:0/926282084 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e77fe640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e81008e0 0x7f63e8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e7fff640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8108160 0x7f63e819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 -- 172.21.15.70:0/926282084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8108160 msgr2=0x7f63e819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8108160 0x7f63e819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 -- 172.21.15.70:0/926282084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e81008e0 msgr2=0x7f63e8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e81008e0 0x7f63e8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 -- 172.21.15.70:0/926282084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f63e819d430 con 0x7f63e8101290 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e7fff640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8108160 0x7f63e819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.504+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 0x7f63e81989c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f63dc005940 tx=0x7f63dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.505+0000 7f63e4ff9640 1 -- 172.21.15.70:0/926282084 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc03f030 con 0x7f63e8101290 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.505+0000 7f63e4ff9640 1 -- 172.21.15.70:0/926282084 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f63dc003ac0 con 0x7f63e8101290 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.505+0000 7f63edbe0640 1 -- 172.21.15.70:0/926282084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f63e819d6c0 con 0x7f63e8101290 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.505+0000 7f63e4ff9640 1 -- 172.21.15.70:0/926282084 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63dc035070 con 0x7f63e8101290 2024-09-19T04:37:41.510 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.505+0000 7f63edbe0640 1 -- 172.21.15.70:0/926282084 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63e81a5000 con 0x7f63e8101290 2024-09-19T04:37:41.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63e4ff9640 1 -- 172.21.15.70:0/926282084 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f63dc042030 con 0x7f63e8101290 2024-09-19T04:37:41.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63effb9740 1 Processor -- start 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63effb9740 1 -- start start 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63effb9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190574090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63effb9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190574a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63effb9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190581760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63effb9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5611904da2f0 con 0x5611905745d0 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63effb9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561190481cf0 con 0x56119057f370 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.507+0000 7f63effb9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5611904d62b0 con 0x561190575b40 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190574a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e4ff9640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63d00a3430 0x7f63d00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190574a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40058/0 (socket says 172.21.15.70:40058) 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 -- 172.21.15.70:0/3038113645 learned_addr learned my addr 172.21.15.70:0/3038113645 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190581760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e7fff640 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190574090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e7fff640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63d00a3430 0x7f63d00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 -- 172.21.15.70:0/3038113645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 msgr2=0x561190574090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190574090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 -- 172.21.15.70:0/3038113645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 msgr2=0x561190581760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190581760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 -- 172.21.15.70:0/3038113645 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611904663a0 con 0x5611905745d0 2024-09-19T04:37:41.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e7fff640 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190574090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e4ff9640 1 -- 172.21.15.70:0/926282084 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f63dc0f00f0 con 0x7f63e8101290 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e77fe640 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190574a10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f63d800bd10 tx=0x7f63d80107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2391854fbf48df43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63e7fff640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63d00a3430 0x7f63d00a58f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f63e000afd0 tx=0x7f63e0005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.508+0000 7f63cdffb640 1 -- 172.21.15.70:0/3038113645 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8004030 con 0x5611905745d0 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63cdffb640 1 -- 172.21.15.70:0/3038113645 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f63d80041d0 con 0x5611905745d0 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63cdffb640 1 -- 172.21.15.70:0/3038113645 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d80117e0 con 0x5611905745d0 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 -- 172.21.15.70:0/3038113645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 msgr2=0x561190574a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190574a10 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f63d800bd10 tx=0x7f63d80107a0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 -- 172.21.15.70:0/3038113645 shutdown_connections 2024-09-19T04:37:41.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190581760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190574a10 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 --2- 172.21.15.70:0/3038113645 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190574090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 -- 172.21.15.70:0/3038113645 >> 172.21.15.70:0/3038113645 conn(0x56119053d310 msgr2=0x561190570c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 -- 172.21.15.70:0/3038113645 shutdown_connections 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.509+0000 7f63effb9740 1 -- 172.21.15.70:0/3038113645 wait complete. 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 1 -- start start 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 1 Processor -- start 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611905745d0 0x56119057ed40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x56119057bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56119057f370 0x56119057c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561190582070 con 0x56119057f370 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561190495060 con 0x5611905745d0 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5611905821f0 con 0x561190575b40 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63effb9740 10 client.0 _ll_register_callbacks cb 0x5611901e88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56119057f370 0x56119057c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56119057f370 0x56119057c5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40060/0 (socket says 172.21.15.70:40060) 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63e7fff640 1 -- 172.21.15.70:0/705525329 learned_addr learned my addr 172.21.15.70:0/705525329 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x56119057bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.510+0000 7f63e77fe640 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611905745d0 0x56119057ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63e7fff640 1 -- 172.21.15.70:0/705525329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 msgr2=0x56119057bff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:41.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63e7fff640 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x56119057bff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63e7fff640 1 -- 172.21.15.70:0/705525329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611905745d0 msgr2=0x56119057ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63e7fff640 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611905745d0 0x56119057ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63e7fff640 1 -- 172.21.15.70:0/705525329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56119024b3c0 con 0x56119057f370 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63e77fe640 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611905745d0 0x56119057ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63e7fff640 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56119057f370 0x56119057c5e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f63e000dbc0 tx=0x7f63e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=530b2d583970c0dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63c6ffd640 1 -- 172.21.15.70:0/705525329 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63e0004b20 con 0x56119057f370 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63c6ffd640 1 -- 172.21.15.70:0/705525329 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f63e0004cc0 con 0x56119057f370 2024-09-19T04:37:41.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63effb9740 1 -- 172.21.15.70:0/705525329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d80041d0 con 0x56119057f370 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63c6ffd640 1 -- 172.21.15.70:0/705525329 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f63e0005020 con 0x56119057f370 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63effb9740 10 client.17028 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63effb9740 1 -- 172.21.15.70:0/705525329 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56119058db40 con 0x56119057f370 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63c6ffd640 1 -- 172.21.15.70:0/705525329 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f63d80041d0 con 0x56119057f370 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.511+0000 7f63c6ffd640 1 -- 172.21.15.70:0/705525329 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f63e002f7b0 con 0x56119057f370 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63effb9740 10 client.17028 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63effb9740 10 client.17028 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63effb9740 20 client.17028 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63effb9740 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56119058ef50 0x5611905913a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63effb9740 4 client.17028 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63effb9740 1 -- 172.21.15.70:0/705525329 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611904e7860 con 0x56119058ef50 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63e77fe640 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56119058ef50 0x5611905913a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63e77fe640 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56119058ef50 0x5611905913a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ae370a848663e72 server_cookie=94dcaddef4c5c3b3 in_seq=0 out_seq=0 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.512+0000 7f63c6ffd640 10 client.17028 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63c6ffd640 1 -- 172.21.15.70:0/705525329 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611904e7860 con 0x56119058ef50 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63c6ffd640 10 client.17028 handle_command_reply: tid=0 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 client.17028 shutdown 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 -- 172.21.15.70:0/705525329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56119057f370 msgr2=0x56119057c5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56119057f370 0x56119057c5e0 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f63e000dbc0 tx=0x7f63e0004a40 comp rx=0 tx=0).stop 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 -- 172.21.15.70:0/705525329 shutdown_connections 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56119058ef50 0x5611905913a0 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56119057f370 0x56119057c5e0 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x56119057bff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 --2- 172.21.15.70:0/705525329 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611905745d0 0x56119057ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 -- 172.21.15.70:0/705525329 >> 172.21.15.70:0/705525329 conn(0x56119053d310 msgr2=0x561190576960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:41.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63c6ffd640 0 client.17028 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:41.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 -- 172.21.15.70:0/705525329 shutdown_connections 2024-09-19T04:37:41.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 1 -- 172.21.15.70:0/705525329 wait complete. 2024-09-19T04:37:41.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.513+0000 7f63effb9740 20 client.17028 trim_cache size 0 max 16384 2024-09-19T04:37:41.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63effb9740 1 Processor -- start 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63effb9740 1 -- start start 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63effb9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190570e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63effb9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x56119058b310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63effb9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190587860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63effb9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81b01a0 con 0x5611905745d0 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63effb9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81ada70 con 0x56119057f370 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63effb9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81ab8e0 con 0x561190575b40 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.526+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190570e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190570e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40068/0 (socket says 172.21.15.70:40068) 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e77fe640 1 -- 172.21.15.70:0/2200292796 learned_addr learned my addr 172.21.15.70:0/2200292796 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:41.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e7fff640 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190587860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x56119058b310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e77fe640 1 -- 172.21.15.70:0/2200292796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 msgr2=0x56119058b310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e77fe640 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x56119058b310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e77fe640 1 -- 172.21.15.70:0/2200292796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 msgr2=0x561190587860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e77fe640 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190587860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e77fe640 1 -- 172.21.15.70:0/2200292796 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56119056bf90 con 0x5611905745d0 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e7fff640 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190587860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63e77fe640 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190570e10 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f63d800baa0 tx=0x7f63d8011440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d107b02e5b641fd8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63cd7fa640 1 -- 172.21.15.70:0/2200292796 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d80035f0 con 0x5611905745d0 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63cd7fa640 1 -- 172.21.15.70:0/2200292796 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f63d8005040 con 0x5611905745d0 2024-09-19T04:37:41.531 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.527+0000 7f63cd7fa640 1 -- 172.21.15.70:0/2200292796 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d8011710 con 0x5611905745d0 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 -- 172.21.15.70:0/2200292796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 msgr2=0x561190570e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190570e10 secure :-1 s=READY pgs=928 cs=0 l=1 rev1=1 crypto rx=0x7f63d800baa0 tx=0x7f63d8011440 comp rx=0 tx=0).stop 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 -- 172.21.15.70:0/2200292796 shutdown_connections 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190587860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x56119058b310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 --2- 172.21.15.70:0/2200292796 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x561190570e10 unknown :-1 s=CLOSED pgs=928 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 -- 172.21.15.70:0/2200292796 >> 172.21.15.70:0/2200292796 conn(0x56119053d310 msgr2=0x561190570700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 -- 172.21.15.70:0/2200292796 shutdown_connections 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 -- 172.21.15.70:0/2200292796 wait complete. 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 -- start start 2024-09-19T04:37:41.532 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.528+0000 7f63effb9740 1 Processor -- start 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63effb9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x5611905799e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63effb9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190578550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63effb9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190578a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63effb9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81abf30 con 0x5611905745d0 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63effb9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81ad3a0 con 0x56119057f370 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63effb9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63e81ac600 con 0x561190575b40 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63effb9740 10 client.0 _ll_register_callbacks cb 0x7f63e000aef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x5611905799e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x5611905799e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40072/0 (socket says 172.21.15.70:40072) 2024-09-19T04:37:41.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 -- 172.21.15.70:0/1146283557 learned_addr learned my addr 172.21.15.70:0/1146283557 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e7fff640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190578a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190578550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 -- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 msgr2=0x561190578550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190578550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 -- 172.21.15.70:0/1146283557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 msgr2=0x561190578a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190578a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 -- 172.21.15.70:0/1146283557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561190579130 con 0x5611905745d0 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e7fff640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190578a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190578550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63e77fe640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x5611905799e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f63d8000c00 tx=0x7f63d8005300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63cb550c654d6813 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:41.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63c6ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63c6ffd640 1 -- 172.21.15.70:0/1146283557 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63d803d060 con 0x5611905745d0 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63c6ffd640 1 -- 172.21.15.70:0/1146283557 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f63d80037f0 con 0x5611905745d0 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63effb9740 1 -- 172.21.15.70:0/1146283557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63d8005040 con 0x5611905745d0 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.529+0000 7f63c6ffd640 1 -- 172.21.15.70:0/1146283557 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f63d80039f0 con 0x5611905745d0 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63effb9740 10 client.17034 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63effb9740 1 -- 172.21.15.70:0/1146283557 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5611905fdb20 con 0x5611905745d0 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63c6ffd640 1 -- 172.21.15.70:0/1146283557 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f63d8005040 con 0x5611905745d0 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63c6ffd640 1 -- 172.21.15.70:0/1146283557 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f63d8027420 con 0x5611905745d0 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63effb9740 10 client.17034 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63effb9740 10 client.17034 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63effb9740 20 client.17034 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:41.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63effb9740 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5611905fdfc0 0x5611906003e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63effb9740 4 client.17034 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63effb9740 1 -- 172.21.15.70:0/1146283557 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5611904e1d70 con 0x5611905fdfc0 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.530+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5611905fdfc0 0x5611906003e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63e6ffd640 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5611905fdfc0 0x5611906003e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=aab16e96a2e3b748 server_cookie=1a06c4ca7ca8de62 in_seq=0 out_seq=0 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63c6ffd640 10 client.17034 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63c6ffd640 1 -- 172.21.15.70:0/1146283557 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5611904e1d70 con 0x5611905fdfc0 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63c6ffd640 10 client.17034 handle_command_reply: tid=0 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 client.17034 shutdown 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 -- 172.21.15.70:0/1146283557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 msgr2=0x5611905799e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x5611905799e0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7f63d8000c00 tx=0x7f63d8005300 comp rx=0 tx=0).stop 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 -- 172.21.15.70:0/1146283557 shutdown_connections 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5611905fdfc0 0x5611906003e0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56119057f370 0x561190578a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561190575b40 0x561190578550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63c6ffd640 0 client.17034 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:41.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 --2- 172.21.15.70:0/1146283557 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611905745d0 0x5611905799e0 unknown :-1 s=CLOSED pgs=929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 -- 172.21.15.70:0/1146283557 >> 172.21.15.70:0/1146283557 conn(0x56119053d310 msgr2=0x56119057d850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:41.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 -- 172.21.15.70:0/1146283557 shutdown_connections 2024-09-19T04:37:41.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 1 -- 172.21.15.70:0/1146283557 wait complete. 2024-09-19T04:37:41.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.531+0000 7f63effb9740 20 client.17034 trim_cache size 0 max 16384 2024-09-19T04:37:41.540 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:41.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 -- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63d00a3430 msgr2=0x7f63d00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63d00a3430 0x7f63d00a58f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f63e000afd0 tx=0x7f63e0005f90 comp rx=0 tx=0).stop 2024-09-19T04:37:41.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 -- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 msgr2=0x7f63e81989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:41.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 0x7f63e81989c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f63dc005940 tx=0x7f63dc0042f0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 -- 172.21.15.70:0/926282084 shutdown_connections 2024-09-19T04:37:41.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63d00a3430 0x7f63d00a58f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f63e8108160 0x7f63e819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f63e8101290 0x7f63e81989c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 --2- 172.21.15.70:0/926282084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f63e81008e0 0x7f63e8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:41.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 -- 172.21.15.70:0/926282084 >> 172.21.15.70:0/926282084 conn(0x7f63e8077210 msgr2=0x7f63e8105c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:41.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 -- 172.21.15.70:0/926282084 shutdown_connections 2024-09-19T04:37:41.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:41.532+0000 7f63edbe0640 1 -- 172.21.15.70:0/926282084 wait complete. 2024-09-19T04:37:41.542 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:41 smithi134 ceph-mon[34525]: pgmap v212: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:41.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:41 smithi167 ceph-mon[34339]: pgmap v212: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:42.274 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:37:42.522 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:42.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:42 smithi070 ceph-mon[30942]: pgmap v213: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:43.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 -- 172.21.15.70:0/1587982901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0994101df0 msgr2=0x7f09941021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 --2- 172.21.15.70:0/1587982901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0994101df0 0x7f09941021d0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7f0984009900 tx=0x7f098402a410 comp rx=0 tx=0).stop 2024-09-19T04:37:43.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 -- 172.21.15.70:0/1587982901 shutdown_connections 2024-09-19T04:37:43.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 --2- 172.21.15.70:0/1587982901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994106f20 0x7f099410eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 --2- 172.21.15.70:0/1587982901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f09941027a0 0x7f09941067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 --2- 172.21.15.70:0/1587982901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0994101df0 0x7f09941021d0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 -- 172.21.15.70:0/1587982901 >> 172.21.15.70:0/1587982901 conn(0x7f09940fd8b0 msgr2=0x7f09940ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:43.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 -- 172.21.15.70:0/1587982901 shutdown_connections 2024-09-19T04:37:43.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.005+0000 7f0999189640 1 -- 172.21.15.70:0/1587982901 wait complete. 2024-09-19T04:37:43.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f0999189640 1 Processor -- start 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f0999189640 1 -- start start 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f0999189640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994101df0 0x7f0994198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f0999189640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09941027a0 0x7f0994198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f0999189640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0994106f20 0x7f099419ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f0999189640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0994112010 con 0x7f09941027a0 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f0999189640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0994111e90 con 0x7f0994101df0 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f0999189640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0994112190 con 0x7f0994106f20 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f098a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09941027a0 0x7f0994198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f098a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09941027a0 0x7f0994198aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40088/0 (socket says 172.21.15.70:40088) 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.006+0000 7f098a59c640 1 -- 172.21.15.70:0/1422203595 learned_addr learned my addr 172.21.15.70:0/1422203595 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f0992d9d640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994101df0 0x7f0994198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f098a59c640 1 -- 172.21.15.70:0/1422203595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0994106f20 msgr2=0x7f099419ce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f098a59c640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0994106f20 0x7f099419ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f098a59c640 1 -- 172.21.15.70:0/1422203595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994101df0 msgr2=0x7f0994198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f098a59c640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994101df0 0x7f0994198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f098a59c640 1 -- 172.21.15.70:0/1422203595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f099419d510 con 0x7f09941027a0 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f0992d9d640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994101df0 0x7f0994198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f098a59c640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09941027a0 0x7f0994198aa0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f097c00b4a0 tx=0x7f097c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f0990d99640 1 -- 172.21.15.70:0/1422203595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c014070 con 0x7f09941027a0 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f0990d99640 1 -- 172.21.15.70:0/1422203595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f097c010ae0 con 0x7f09941027a0 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f0999189640 1 -- 172.21.15.70:0/1422203595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f099419d800 con 0x7f09941027a0 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f0990d99640 1 -- 172.21.15.70:0/1422203595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c017c70 con 0x7f09941027a0 2024-09-19T04:37:43.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.007+0000 7f0999189640 1 -- 172.21.15.70:0/1422203595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09941a50e0 con 0x7f09941027a0 2024-09-19T04:37:43.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.009+0000 7f0990d99640 1 -- 172.21.15.70:0/1422203595 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f097c017070 con 0x7f09941027a0 2024-09-19T04:37:43.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.009+0000 7f099b562740 1 Processor -- start 2024-09-19T04:37:43.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099b562740 1 -- start start 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099b562740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d150090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099b562740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d150a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099b562740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d15d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099b562740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55621d0b62f0 con 0x55621d151b40 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099b562740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55621d05dcf0 con 0x55621d15b370 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099b562740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55621d0b22b0 con 0x55621d1505d0 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d150090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d150090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40094/0 (socket says 172.21.15.70:40094) 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099359e640 1 -- 172.21.15.70:0/2292783727 learned_addr learned my addr 172.21.15.70:0/2292783727 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f0990d99640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09800a33b0 0x7f09800a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f0992d9d640 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d150a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099359e640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09800a33b0 0x7f09800a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f098a59c640 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d15d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f0990d99640 1 -- 172.21.15.70:0/1422203595 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f097c0cf0b0 con 0x7f09941027a0 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099359e640 1 -- 172.21.15.70:0/2292783727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 msgr2=0x55621d150a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099359e640 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d150a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099359e640 1 -- 172.21.15.70:0/2292783727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 msgr2=0x55621d15d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.010+0000 7f099359e640 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d15d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.011+0000 7f099359e640 1 -- 172.21.15.70:0/2292783727 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621d0423a0 con 0x55621d151b40 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.011+0000 7f098a59c640 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d15d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.011+0000 7f099359e640 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d150090 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f098c0126c0 tx=0x7f098c012b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=923eb03e5a514f1f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.011+0000 7f098959a640 1 -- 172.21.15.70:0/2292783727 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c012050 con 0x55621d151b40 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.011+0000 7f098959a640 1 -- 172.21.15.70:0/2292783727 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f098c013040 con 0x55621d151b40 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.011+0000 7f098959a640 1 -- 172.21.15.70:0/2292783727 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c01b070 con 0x55621d151b40 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.011+0000 7f099359e640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09800a33b0 0x7f09800a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f098c01d000 tx=0x7f098c01b000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:43.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 -- 172.21.15.70:0/2292783727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 msgr2=0x55621d150090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d150090 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7f098c0126c0 tx=0x7f098c012b80 comp rx=0 tx=0).stop 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 -- 172.21.15.70:0/2292783727 shutdown_connections 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d15d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d150a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 --2- 172.21.15.70:0/2292783727 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d150090 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 -- 172.21.15.70:0/2292783727 >> 172.21.15.70:0/2292783727 conn(0x55621d119310 msgr2=0x55621d14cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 -- 172.21.15.70:0/2292783727 shutdown_connections 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 -- 172.21.15.70:0/2292783727 wait complete. 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 -- start start 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 Processor -- start 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d1505d0 0x55621d15ad70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d151b40 0x55621d158020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.020 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d15b370 0x55621d158610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.012+0000 7f099b562740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55621d15e070 con 0x55621d15b370 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099b562740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55621d071060 con 0x55621d1505d0 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099b562740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55621d15e1f0 con 0x55621d151b40 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099b562740 10 client.0 _ll_register_callbacks cb 0x55621cdc48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d15b370 0x55621d158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d15b370 0x55621d158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40102/0 (socket says 172.21.15.70:40102) 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f0992d9d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d1505d0 0x55621d15ad70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 -- 172.21.15.70:0/2544531034 learned_addr learned my addr 172.21.15.70:0/2544531034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f098a59c640 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d151b40 0x55621d158020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 -- 172.21.15.70:0/2544531034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d151b40 msgr2=0x55621d158020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d151b40 0x55621d158020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.021 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 -- 172.21.15.70:0/2544531034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d1505d0 msgr2=0x55621d15ad70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d1505d0 0x55621d15ad70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 -- 172.21.15.70:0/2544531034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621ce273c0 con 0x55621d15b370 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099359e640 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d15b370 0x55621d158610 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f098c009410 tx=0x7f098c00fe50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ca373016b1b6f26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f097a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f097a7fc640 1 -- 172.21.15.70:0/2544531034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f098c020860 con 0x55621d15b370 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f097a7fc640 1 -- 172.21.15.70:0/2544531034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f098c017530 con 0x55621d15b370 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.013+0000 7f099b562740 1 -- 172.21.15.70:0/2544531034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f098c013040 con 0x55621d15b370 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f097a7fc640 1 -- 172.21.15.70:0/2544531034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f098c037050 con 0x55621d15b370 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f099b562740 10 client.17046 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f099b562740 1 -- 172.21.15.70:0/2544531034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55621d169a80 con 0x55621d15b370 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f097a7fc640 1 -- 172.21.15.70:0/2544531034 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f098c013040 con 0x55621d15b370 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f097a7fc640 1 -- 172.21.15.70:0/2544531034 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f098c032030 con 0x55621d15b370 2024-09-19T04:37:43.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f099b562740 10 client.17046 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f099b562740 10 client.17046 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f099b562740 20 client.17046 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f099b562740 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55621d16af40 0x55621d16d330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f099b562740 4 client.17046 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f099b562740 1 -- 172.21.15.70:0/2544531034 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55621d0c3860 con 0x55621d16af40 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.014+0000 7f0992d9d640 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55621d16af40 0x55621d16d330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f0992d9d640 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55621d16af40 0x55621d16d330 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4c3dd73baf3ca44 server_cookie=72d7dbe5a7edbef in_seq=0 out_seq=0 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f097a7fc640 10 client.17046 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f097a7fc640 1 -- 172.21.15.70:0/2544531034 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55621d0c3860 con 0x55621d16af40 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f097a7fc640 10 client.17046 handle_command_reply: tid=0 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 client.17046 shutdown 2024-09-19T04:37:43.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 -- 172.21.15.70:0/2544531034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d15b370 msgr2=0x55621d158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d15b370 0x55621d158610 secure :-1 s=READY pgs=933 cs=0 l=1 rev1=1 crypto rx=0x7f098c009410 tx=0x7f098c00fe50 comp rx=0 tx=0).stop 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 -- 172.21.15.70:0/2544531034 shutdown_connections 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55621d16af40 0x55621d16d330 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d15b370 0x55621d158610 unknown :-1 s=CLOSED pgs=933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d151b40 0x55621d158020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 --2- 172.21.15.70:0/2544531034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d1505d0 0x55621d15ad70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f097a7fc640 0 client.17046 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.015+0000 7f099b562740 1 -- 172.21.15.70:0/2544531034 >> 172.21.15.70:0/2544531034 conn(0x55621d119310 msgr2=0x55621d152960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.016+0000 7f099b562740 1 -- 172.21.15.70:0/2544531034 shutdown_connections 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.016+0000 7f099b562740 1 -- 172.21.15.70:0/2544531034 wait complete. 2024-09-19T04:37:43.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.016+0000 7f099b562740 20 client.17046 trim_cache size 0 max 16384 2024-09-19T04:37:43.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.028+0000 7f099b562740 1 Processor -- start 2024-09-19T04:37:43.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.028+0000 7f099b562740 1 -- start start 2024-09-19T04:37:43.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f099b562740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d167310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f099b562740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d153120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f099b562740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d153660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f099b562740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09941b0210 con 0x55621d151b40 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f099b562740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09941adae0 con 0x55621d15b370 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f099b562740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f09941ab950 con 0x55621d1505d0 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d153120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d153120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40104/0 (socket says 172.21.15.70:40104) 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 -- 172.21.15.70:0/2630190355 learned_addr learned my addr 172.21.15.70:0/2630190355 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f0992d9d640 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d167310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f099359e640 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d153660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 -- 172.21.15.70:0/2630190355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 msgr2=0x55621d167310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d167310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 -- 172.21.15.70:0/2630190355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 msgr2=0x55621d153660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d153660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 -- 172.21.15.70:0/2630190355 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55621d156590 con 0x55621d151b40 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f0992d9d640 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f099359e640 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f098a59c640 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d153120 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f097c00be60 tx=0x7f097c01c310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0964cd374c6388e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f0988d99640 1 -- 172.21.15.70:0/2630190355 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c01e040 con 0x55621d151b40 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f0988d99640 1 -- 172.21.15.70:0/2630190355 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f097c09b4a0 con 0x55621d151b40 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.029+0000 7f0988d99640 1 -- 172.21.15.70:0/2630190355 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0cca80 con 0x55621d151b40 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 -- 172.21.15.70:0/2630190355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 msgr2=0x55621d153120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d153120 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f097c00be60 tx=0x7f097c01c310 comp rx=0 tx=0).stop 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 -- 172.21.15.70:0/2630190355 shutdown_connections 2024-09-19T04:37:43.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d153660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d153120 unknown :-1 s=CLOSED pgs=934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 --2- 172.21.15.70:0/2630190355 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d167310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 -- 172.21.15.70:0/2630190355 >> 172.21.15.70:0/2630190355 conn(0x55621d119310 msgr2=0x55621d157130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 -- 172.21.15.70:0/2630190355 shutdown_connections 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 -- 172.21.15.70:0/2630190355 wait complete. 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.030+0000 7f099b562740 1 -- start start 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099b562740 1 Processor -- start 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099b562740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d163710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099b562740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d163c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099b562740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d154950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099b562740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f09941abfa0 con 0x55621d151b40 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099b562740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f09941ad410 con 0x55621d15b370 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099b562740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f09941ac670 con 0x55621d1505d0 2024-09-19T04:37:43.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099b562740 10 client.0 _ll_register_callbacks cb 0x7f098c0124c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d163c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d163c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40108/0 (socket says 172.21.15.70:40108) 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 -- 172.21.15.70:0/3439458203 learned_addr learned my addr 172.21.15.70:0/3439458203 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f0992d9d640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d163710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099359e640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 -- 172.21.15.70:0/3439458203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 msgr2=0x55621d163710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d163710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 -- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 msgr2=0x55621d154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d154950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 -- 172.21.15.70:0/3439458203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55621d155180 con 0x55621d151b40 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f099359e640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:43.040 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f0992d9d640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f098a59c640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d163c50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f097c09b1a0 tx=0x7f097c097870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=314c855ee85ee054 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.031+0000 7f097a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f097a7fc640 1 -- 172.21.15.70:0/3439458203 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f097c0a4110 con 0x55621d151b40 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f097a7fc640 1 -- 172.21.15.70:0/3439458203 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f097c0cca80 con 0x55621d151b40 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 1 -- 172.21.15.70:0/3439458203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f097c09b4a0 con 0x55621d151b40 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f097a7fc640 1 -- 172.21.15.70:0/3439458203 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f097c097b10 con 0x55621d151b40 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 10 client.17052 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 1 -- 172.21.15.70:0/3439458203 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55621d1d54b0 con 0x55621d151b40 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f097a7fc640 1 -- 172.21.15.70:0/3439458203 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f097c09b4a0 con 0x55621d151b40 2024-09-19T04:37:43.041 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f097a7fc640 1 -- 172.21.15.70:0/3439458203 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f097c0b42a0 con 0x55621d151b40 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 10 client.17052 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 10 client.17052 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 20 client.17052 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55621d1d5be0 0x55621d1d8000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 4 client.17052 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f099b562740 1 -- 172.21.15.70:0/3439458203 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55621d0bdd70 con 0x55621d1d5be0 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.032+0000 7f0992d9d640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55621d1d5be0 0x55621d1d8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f097a7fc640 10 client.17052 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f0992d9d640 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55621d1d5be0 0x55621d1d8000 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9d7b678babaaff8d server_cookie=7ea57f80cc17a871 in_seq=0 out_seq=0 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f097a7fc640 1 -- 172.21.15.70:0/3439458203 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55621d0bdd70 con 0x55621d1d5be0 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f097a7fc640 10 client.17052 handle_command_reply: tid=0 2024-09-19T04:37:43.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 client.17052 shutdown 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 -- 172.21.15.70:0/3439458203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 msgr2=0x55621d163c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d163c50 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f097c09b1a0 tx=0x7f097c097870 comp rx=0 tx=0).stop 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 -- 172.21.15.70:0/3439458203 shutdown_connections 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55621d1d5be0 0x55621d1d8000 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55621d15b370 0x55621d154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55621d151b40 0x55621d163c50 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 --2- 172.21.15.70:0/3439458203 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55621d1505d0 0x55621d163710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 -- 172.21.15.70:0/3439458203 >> 172.21.15.70:0/3439458203 conn(0x55621d119310 msgr2=0x55621d1595b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f097a7fc640 0 client.17052 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 -- 172.21.15.70:0/3439458203 shutdown_connections 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 1 -- 172.21.15.70:0/3439458203 wait complete. 2024-09-19T04:37:43.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.033+0000 7f099b562740 20 client.17052 trim_cache size 0 max 16384 2024-09-19T04:37:43.044 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:43.044 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:42 smithi134 ceph-mon[34525]: pgmap v213: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 -- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09800a33b0 msgr2=0x7f09800a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09800a33b0 0x7f09800a5870 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f098c01d000 tx=0x7f098c01b000 comp rx=0 tx=0).stop 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 -- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09941027a0 msgr2=0x7f0994198aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09941027a0 0x7f0994198aa0 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7f097c00b4a0 tx=0x7f097c00b960 comp rx=0 tx=0).stop 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 -- 172.21.15.70:0/1422203595 shutdown_connections 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f09800a33b0 0x7f09800a5870 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0994106f20 0x7f099419ce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f09941027a0 0x7f0994198aa0 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 --2- 172.21.15.70:0/1422203595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0994101df0 0x7f0994198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:43.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 -- 172.21.15.70:0/1422203595 >> 172.21.15.70:0/1422203595 conn(0x7f09940fd8b0 msgr2=0x7f09940fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:43.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 -- 172.21.15.70:0/1422203595 shutdown_connections 2024-09-19T04:37:43.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:43.034+0000 7f0999189640 1 -- 172.21.15.70:0/1422203595 wait complete. 2024-09-19T04:37:43.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:42 smithi167 ceph-mon[34339]: pgmap v213: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:43.884 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:37:44.131 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:44.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 -- 172.21.15.70:0/2510889492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 msgr2=0x7f2b8010d960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 --2- 172.21.15.70:0/2510889492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 0x7f2b8010d960 secure :-1 s=READY pgs=936 cs=0 l=1 rev1=1 crypto rx=0x7f2b70009930 tx=0x7f2b7002a420 comp rx=0 tx=0).stop 2024-09-19T04:37:44.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 -- 172.21.15.70:0/2510889492 shutdown_connections 2024-09-19T04:37:44.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 --2- 172.21.15.70:0/2510889492 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 0x7f2b8010d960 unknown :-1 s=CLOSED pgs=936 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 --2- 172.21.15.70:0/2510889492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80100a90 0x7f2b80100ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 --2- 172.21.15.70:0/2510889492 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b80106a90 0x7f2b80106e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 -- 172.21.15.70:0/2510889492 >> 172.21.15.70:0/2510889492 conn(0x7f2b800fc7d0 msgr2=0x7f2b800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:44.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 -- 172.21.15.70:0/2510889492 shutdown_connections 2024-09-19T04:37:44.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.571+0000 7f2b85886640 1 -- 172.21.15.70:0/2510889492 wait complete. 2024-09-19T04:37:44.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b85886640 1 Processor -- start 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b85886640 1 -- start start 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b85886640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b80100a90 0x7f2b80198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b85886640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 0x7f2b80198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b85886640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80106a90 0x7f2b8019ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b85886640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b80110f20 con 0x7f2b80101430 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b85886640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b80110da0 con 0x7f2b80106a90 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b85886640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b801110a0 con 0x7f2b80100a90 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 0x7f2b80198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 0x7f2b80198ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58454/0 (socket says 172.21.15.70:58454) 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/2191096452 learned_addr learned my addr 172.21.15.70:0/2191096452 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:44.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7effd640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b80100a90 0x7f2b80198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80106a90 0x7f2b8019ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/2191096452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b80100a90 msgr2=0x7f2b80198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b80100a90 0x7f2b80198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/2191096452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80106a90 msgr2=0x7f2b8019ce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80106a90 0x7f2b8019ce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.572+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/2191096452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2b8019d530 con 0x7f2b80101430 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.573+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 0x7f2b80198ac0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800b4a0 tx=0x7f2b6800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.573+0000 7f2b84884640 1 -- 172.21.15.70:0/2191096452 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68014070 con 0x7f2b80101430 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.573+0000 7f2b85886640 1 -- 172.21.15.70:0/2191096452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2b8019d820 con 0x7f2b80101430 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.573+0000 7f2b84884640 1 -- 172.21.15.70:0/2191096452 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b68010ae0 con 0x7f2b80101430 2024-09-19T04:37:44.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.573+0000 7f2b84884640 1 -- 172.21.15.70:0/2191096452 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b68017c70 con 0x7f2b80101430 2024-09-19T04:37:44.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.573+0000 7f2b85886640 1 -- 172.21.15.70:0/2191096452 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2b801a5100 con 0x7f2b80101430 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.575+0000 7f2b84884640 1 -- 172.21.15.70:0/2191096452 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2b68017070 con 0x7f2b80101430 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b87c5f740 1 Processor -- start 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b87c5f740 1 -- start start 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 0x562f8037a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f8037aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038bb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f802e02f0 con 0x562f80389780 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562f80287cf0 con 0x562f8037a5d0 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562f802dc2b0 con 0x562f8037bb40 2024-09-19T04:37:44.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038bb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038bb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58466/0 (socket says 172.21.15.70:58466) 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/3254328715 learned_addr learned my addr 172.21.15.70:0/3254328715 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b84884640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b6c0a33b0 0x7f2b6c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 0x562f8037a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b7effd640 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f8037aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.576+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b6c0a33b0 0x7f2b6c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b84884640 1 -- 172.21.15.70:0/2191096452 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f2b680cf0c0 con 0x7f2b80101430 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/3254328715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 msgr2=0x562f8037a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:44.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 0x562f8037a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/3254328715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 msgr2=0x562f8037aa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f8037aa10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/3254328715 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f8026c3a0 con 0x562f80389780 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038bb70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2b680cc830 tx=0x7f2b68000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68640255da1c2089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b75ffb640 1 -- 172.21.15.70:0/3254328715 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6801e070 con 0x562f80389780 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b75ffb640 1 -- 172.21.15.70:0/3254328715 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b6809b450 con 0x562f80389780 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.577+0000 7f2b75ffb640 1 -- 172.21.15.70:0/3254328715 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b680971a0 con 0x562f80389780 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 -- 172.21.15.70:0/3254328715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 msgr2=0x562f8038bb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b6c0a33b0 0x7f2b6c0a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b70005940 tx=0x7f2b7002a420 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:44.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038bb70 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f2b680cc830 tx=0x7f2b68000bc0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 -- 172.21.15.70:0/3254328715 shutdown_connections 2024-09-19T04:37:44.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038bb70 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f8037aa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/3254328715 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 0x562f8037a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 -- 172.21.15.70:0/3254328715 >> 172.21.15.70:0/3254328715 conn(0x562f80343310 msgr2=0x562f80376c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:44.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 -- 172.21.15.70:0/3254328715 shutdown_connections 2024-09-19T04:37:44.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 -- 172.21.15.70:0/3254328715 wait complete. 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 -- start start 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.578+0000 7f2b87c5f740 1 Processor -- start 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f803891b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 0x562f80386460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f80386bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562f8038c420 con 0x562f80389780 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562f8029b060 con 0x562f8037a5d0 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562f8038c5a0 con 0x562f8037bb40 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b87c5f740 10 client.0 _ll_register_callbacks cb 0x562f7ffee8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f80386bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f80386bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58482/0 (socket says 172.21.15.70:58482) 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 -- 172.21.15.70:0/2536781388 learned_addr learned my addr 172.21.15.70:0/2536781388 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 0x562f80386460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7effd640 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f803891b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 -- 172.21.15.70:0/2536781388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 msgr2=0x562f80386460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 0x562f80386460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 -- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 msgr2=0x562f803891b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f803891b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 -- 172.21.15.70:0/2536781388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f800513c0 con 0x562f80389780 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7effd640 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f803891b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f80386bf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2b70005c40 tx=0x7f2b70009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d972db6aa44fb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b5effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:44.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.579+0000 7f2b5effd640 1 -- 172.21.15.70:0/2536781388 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7004e020 con 0x562f80389780 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b5effd640 1 -- 172.21.15.70:0/2536781388 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f2b70003d50 con 0x562f80389780 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 1 -- 172.21.15.70:0/2536781388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b6809b450 con 0x562f80389780 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b5effd640 1 -- 172.21.15.70:0/2536781388 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2b70059050 con 0x562f80389780 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 10 client.17064 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 1 -- 172.21.15.70:0/2536781388 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562f80397f00 con 0x562f80389780 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b5effd640 1 -- 172.21.15.70:0/2536781388 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b6809b450 con 0x562f80389780 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b5effd640 1 -- 172.21.15.70:0/2536781388 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2b7003a480 con 0x562f80389780 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 10 client.17064 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 10 client.17064 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 20 client.17064 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:44.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562f803993c0 0x562f8039b810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 4 client.17064 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b87c5f740 1 -- 172.21.15.70:0/2536781388 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562f802ed860 con 0x562f803993c0 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.580+0000 7f2b7effd640 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562f803993c0 0x562f8039b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.581+0000 7f2b5effd640 10 client.17064 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.581+0000 7f2b7effd640 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562f803993c0 0x562f8039b810 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2d5cb3ce0ccf1560 server_cookie=986e3452f4a400e4 in_seq=0 out_seq=0 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.581+0000 7f2b5effd640 1 -- 172.21.15.70:0/2536781388 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562f802ed860 con 0x562f803993c0 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.581+0000 7f2b5effd640 10 client.17064 handle_command_reply: tid=0 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 client.17064 shutdown 2024-09-19T04:37:44.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 -- 172.21.15.70:0/2536781388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 msgr2=0x562f80386bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f80386bf0 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7f2b70005c40 tx=0x7f2b70009260 comp rx=0 tx=0).stop 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 -- 172.21.15.70:0/2536781388 shutdown_connections 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562f803993c0 0x562f8039b810 crc :-1 s=READY pgs=150 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f80386bf0 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037bb40 0x562f80386460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b5effd640 0 client.17064 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/2536781388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037a5d0 0x562f803891b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 -- 172.21.15.70:0/2536781388 >> 172.21.15.70:0/2536781388 conn(0x562f80343310 msgr2=0x562f8037c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 -- 172.21.15.70:0/2536781388 shutdown_connections 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 1 -- 172.21.15.70:0/2536781388 wait complete. 2024-09-19T04:37:44.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.582+0000 7f2b87c5f740 20 client.17064 trim_cache size 0 max 16384 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b87c5f740 1 Processor -- start 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b87c5f740 1 -- start start 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80376e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f8037bb40 0x562f80385d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f80389780 0x562f803a1130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b801ae030 con 0x562f8037bb40 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b801ab900 con 0x562f80389780 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b801a9770 con 0x562f8037a5d0 2024-09-19T04:37:44.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f8037bb40 0x562f80385d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f8037bb40 0x562f80385d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58486/0 (socket says 172.21.15.70:58486) 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/1565228560 learned_addr learned my addr 172.21.15.70:0/1565228560 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7effd640 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80376e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/1565228560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 msgr2=0x562f80376e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80376e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/1565228560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f80389780 msgr2=0x562f803a1130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f80389780 0x562f803a1130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 -- 172.21.15.70:0/1565228560 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562f803849d0 con 0x562f8037bb40 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7effd640 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80376e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f8037bb40 0x562f80385d20 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800be60 tx=0x7f2b680d26a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d0c3c5f686f1406 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b757fa640 1 -- 172.21.15.70:0/1565228560 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b6801e040 con 0x562f8037bb40 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b757fa640 1 -- 172.21.15.70:0/1565228560 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b6809f800 con 0x562f8037bb40 2024-09-19T04:37:44.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.595+0000 7f2b757fa640 1 -- 172.21.15.70:0/1565228560 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b680971a0 con 0x562f8037bb40 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 -- 172.21.15.70:0/1565228560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f8037bb40 msgr2=0x562f80385d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f8037bb40 0x562f80385d20 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800be60 tx=0x7f2b680d26a0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 -- 172.21.15.70:0/1565228560 shutdown_connections 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f80389780 0x562f803a1130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f8037bb40 0x562f80385d20 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/1565228560 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80376e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 -- 172.21.15.70:0/1565228560 >> 172.21.15.70:0/1565228560 conn(0x562f80343310 msgr2=0x562f80376700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 -- 172.21.15.70:0/1565228560 shutdown_connections 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 -- 172.21.15.70:0/1565228560 wait complete. 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.596+0000 7f2b87c5f740 1 -- start start 2024-09-19T04:37:44.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b87c5f740 1 Processor -- start 2024-09-19T04:37:44.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80391830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037bb40 0x562f80391d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b87c5f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2b801a9dc0 con 0x562f80389780 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2b801ab230 con 0x562f8037bb40 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b87c5f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2b801aa490 con 0x562f8037a5d0 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b87c5f740 10 client.0 _ll_register_callbacks cb 0x7f2b70031c20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58494/0 (socket says 172.21.15.70:58494) 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7f7fe640 1 -- 172.21.15.70:0/163228845 learned_addr learned my addr 172.21.15.70:0/163228845 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7f7fe640 1 -- 172.21.15.70:0/163228845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 msgr2=0x562f80391830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7effd640 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80391830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7e7fc640 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037bb40 0x562f80391d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80391830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7f7fe640 1 -- 172.21.15.70:0/163228845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037bb40 msgr2=0x562f80391d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037bb40 0x562f80391d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.597+0000 7f2b7f7fe640 1 -- 172.21.15.70:0/163228845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562f8038ed40 con 0x562f80389780 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b7f7fe640 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038e800 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2b7003a920 tx=0x7f2b700095f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19327b2b1d9f3893 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b5effd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b5effd640 1 -- 172.21.15.70:0/163228845 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2b7004e040 con 0x562f80389780 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b5effd640 1 -- 172.21.15.70:0/163228845 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f2b7003ab10 con 0x562f80389780 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 1 -- 172.21.15.70:0/163228845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2b6809f800 con 0x562f80389780 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b5effd640 1 -- 172.21.15.70:0/163228845 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2b7006a050 con 0x562f80389780 2024-09-19T04:37:44.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 10 client.17070 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 1 -- 172.21.15.70:0/163228845 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562f80404760 con 0x562f80389780 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b5effd640 1 -- 172.21.15.70:0/163228845 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2b6809f800 con 0x562f80389780 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b5effd640 1 -- 172.21.15.70:0/163228845 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2b70065030 con 0x562f80389780 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 10 client.17070 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 10 client.17070 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 20 client.17070 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562f803993c0 0x562f80406f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 4 client.17070 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.598+0000 7f2b87c5f740 1 -- 172.21.15.70:0/163228845 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562f802e7d70 con 0x562f803993c0 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b7effd640 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562f803993c0 0x562f80406f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b7effd640 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562f803993c0 0x562f80406f10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8c662624db0e5141 server_cookie=3f24a9f20390fbab in_seq=0 out_seq=0 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b5effd640 10 client.17070 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:44.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b5effd640 1 -- 172.21.15.70:0/163228845 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562f802e7d70 con 0x562f803993c0 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b5effd640 10 client.17070 handle_command_reply: tid=0 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 client.17070 shutdown 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 -- 172.21.15.70:0/163228845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 msgr2=0x562f8038e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038e800 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f2b7003a920 tx=0x7f2b700095f0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 -- 172.21.15.70:0/163228845 shutdown_connections 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562f803993c0 0x562f80406f10 crc :-1 s=READY pgs=151 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562f80389780 0x562f8038e800 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562f8037bb40 0x562f80391d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 --2- 172.21.15.70:0/163228845 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562f8037a5d0 0x562f80391830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 -- 172.21.15.70:0/163228845 >> 172.21.15.70:0/163228845 conn(0x562f80343310 msgr2=0x562f80387cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:44.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b5effd640 0 client.17070 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:44.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 -- 172.21.15.70:0/163228845 shutdown_connections 2024-09-19T04:37:44.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.599+0000 7f2b87c5f740 1 -- 172.21.15.70:0/163228845 wait complete. 2024-09-19T04:37:44.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b87c5f740 20 client.17070 trim_cache size 0 max 16384 2024-09-19T04:37:44.608 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 -- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b6c0a33b0 msgr2=0x7f2b6c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b6c0a33b0 0x7f2b6c0a5870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f2b70005940 tx=0x7f2b7002a420 comp rx=0 tx=0).stop 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 -- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 msgr2=0x7f2b80198ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 0x7f2b80198ac0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f2b6800b4a0 tx=0x7f2b6800b960 comp rx=0 tx=0).stop 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 -- 172.21.15.70:0/2191096452 shutdown_connections 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2b6c0a33b0 0x7f2b6c0a5870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b80106a90 0x7f2b8019ce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2b80101430 0x7f2b80198ac0 unknown :-1 s=CLOSED pgs=937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 --2- 172.21.15.70:0/2191096452 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2b80100a90 0x7f2b80198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:44.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 -- 172.21.15.70:0/2191096452 >> 172.21.15.70:0/2191096452 conn(0x7f2b800fc7d0 msgr2=0x7f2b8006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:44.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 -- 172.21.15.70:0/2191096452 shutdown_connections 2024-09-19T04:37:44.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:44.600+0000 7f2b85886640 1 -- 172.21.15.70:0/2191096452 wait complete. 2024-09-19T04:37:44.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:44 smithi070 ceph-mon[30942]: pgmap v214: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:44 smithi134 ceph-mon[34525]: pgmap v214: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:45.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:44 smithi167 ceph-mon[34339]: pgmap v214: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:46.342 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:37:46.342 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:37:46.600 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:46.984 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:46 smithi070 ceph-mon[30942]: pgmap v215: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:46 smithi134 ceph-mon[34525]: pgmap v215: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 -- 172.21.15.70:0/1196600298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 msgr2=0x7f5554106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 --2- 172.21.15.70:0/1196600298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 0x7f5554106e60 secure :-1 s=READY pgs=942 cs=0 l=1 rev1=1 crypto rx=0x7f5544009930 tx=0x7f554402a420 comp rx=0 tx=0).stop 2024-09-19T04:37:47.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 -- 172.21.15.70:0/1196600298 shutdown_connections 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 --2- 172.21.15.70:0/1196600298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5554101420 0x7f555410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 --2- 172.21.15.70:0/1196600298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5554100a80 0x7f5554100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 --2- 172.21.15.70:0/1196600298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 0x7f5554106e60 unknown :-1 s=CLOSED pgs=942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 -- 172.21.15.70:0/1196600298 >> 172.21.15.70:0/1196600298 conn(0x7f55540fc7a0 msgr2=0x7f55540febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 -- 172.21.15.70:0/1196600298 shutdown_connections 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.065+0000 7f555a6df640 1 -- 172.21.15.70:0/1196600298 wait complete. 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f555a6df640 1 Processor -- start 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f555a6df640 1 -- start start 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f555a6df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5554100a80 0x7f5554198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f555a6df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5554101420 0x7f5554198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f555a6df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 0x7f555419cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f555a6df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5554110e90 con 0x7f5554106a80 2024-09-19T04:37:47.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f555a6df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5554110d10 con 0x7f5554101420 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f555a6df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5554111010 con 0x7f5554100a80 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f5558c7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 0x7f555419cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f5558c7c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 0x7f555419cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58510/0 (socket says 172.21.15.70:58510) 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f5558c7c640 1 -- 172.21.15.70:0/2952538635 learned_addr learned my addr 172.21.15.70:0/2952538635 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f554bfff640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5554101420 0x7f5554198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.066+0000 7f5553fff640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5554100a80 0x7f5554198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5558c7c640 1 -- 172.21.15.70:0/2952538635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5554100a80 msgr2=0x7f5554198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5558c7c640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5554100a80 0x7f5554198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5558c7c640 1 -- 172.21.15.70:0/2952538635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5554101420 msgr2=0x7f5554198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5558c7c640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5554101420 0x7f5554198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5558c7c640 1 -- 172.21.15.70:0/2952538635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f555419d3f0 con 0x7f5554106a80 2024-09-19T04:37:47.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f554bfff640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5554101420 0x7f5554198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5558c7c640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 0x7f555419cd10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f554c00b970 tx=0x7f554c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5551ffb640 1 -- 172.21.15.70:0/2952538635 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c019070 con 0x7f5554106a80 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5551ffb640 1 -- 172.21.15.70:0/2952538635 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f554c00cb40 con 0x7f5554106a80 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f555a6df640 1 -- 172.21.15.70:0/2952538635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f555419d6e0 con 0x7f5554106a80 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f5551ffb640 1 -- 172.21.15.70:0/2952538635 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f554c007650 con 0x7f5554106a80 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.067+0000 7f555a6df640 1 -- 172.21.15.70:0/2952538635 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55541a4fc0 con 0x7f5554106a80 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.069+0000 7f5551ffb640 1 -- 172.21.15.70:0/2952538635 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f554c01c070 con 0x7f5554106a80 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.069+0000 7f555cab8740 1 Processor -- start 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f555cab8740 1 -- start start 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f555cab8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x556749842e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f555cab8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749851c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f555cab8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749852150 0x556749854540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f555cab8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5567497a8280 con 0x556749842a60 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f555cab8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55674974fb10 con 0x556749843380 2024-09-19T04:37:47.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f555cab8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5567497a4240 con 0x556749852150 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f5551ffb640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55400a33b0 0x7f55400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x556749842e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x556749842e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58512/0 (socket says 172.21.15.70:58512) 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 -- 172.21.15.70:0/1867859820 learned_addr learned my addr 172.21.15.70:0/1867859820 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f5558c7c640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55400a33b0 0x7f55400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749852150 0x556749854540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f5553fff640 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749851c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f5551ffb640 1 -- 172.21.15.70:0/2952538635 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f554c0cf340 con 0x7f5554106a80 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 -- 172.21.15.70:0/1867859820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749852150 msgr2=0x556749854540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749852150 0x556749854540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 -- 172.21.15.70:0/1867859820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 msgr2=0x556749851c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749851c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 -- 172.21.15.70:0/1867859820 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55674975c1f0 con 0x556749842a60 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f5553fff640 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749851c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.070+0000 7f554bfff640 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x556749842e40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f553c008fc0 tx=0x7f553c008640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9dfa0e5d1fa46d1e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f554a7fc640 1 -- 172.21.15.70:0/1867859820 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c018030 con 0x556749842a60 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f554a7fc640 1 -- 172.21.15.70:0/1867859820 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f553c010b10 con 0x556749842a60 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f554a7fc640 1 -- 172.21.15.70:0/1867859820 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c01ca40 con 0x556749842a60 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f5558c7c640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55400a33b0 0x7f55400a5870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f554c09b430 tx=0x7f554c06e560 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f555cab8740 1 -- 172.21.15.70:0/1867859820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 msgr2=0x556749842e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f555cab8740 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x556749842e40 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7f553c008fc0 tx=0x7f553c008640 comp rx=0 tx=0).stop 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f555cab8740 1 -- 172.21.15.70:0/1867859820 shutdown_connections 2024-09-19T04:37:47.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f555cab8740 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749852150 0x556749854540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f555cab8740 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749851c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f555cab8740 1 --2- 172.21.15.70:0/1867859820 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x556749842e40 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f555cab8740 1 -- 172.21.15.70:0/1867859820 >> 172.21.15.70:0/1867859820 conn(0x55674983f0f0 msgr2=0x55674983f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.071+0000 7f555cab8740 1 -- 172.21.15.70:0/1867859820 shutdown_connections 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 -- 172.21.15.70:0/1867859820 wait complete. 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 -- start start 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 Processor -- start 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x55674984eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749843380 0x55674984f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 0x55674984fa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556749854d80 con 0x556749842a60 2024-09-19T04:37:47.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556749762f10 con 0x556749852150 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556749854f00 con 0x556749843380 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f555cab8740 10 client.0 _ll_register_callbacks cb 0x55674972ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f554bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x55674984eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f554bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x55674984eff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58528/0 (socket says 172.21.15.70:58528) 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.072+0000 7f554bfff640 1 -- 172.21.15.70:0/674636410 learned_addr learned my addr 172.21.15.70:0/674636410 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f5553fff640 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749843380 0x55674984f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f554bfff640 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 0x55674984fa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f554bfff640 1 -- 172.21.15.70:0/674636410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749843380 msgr2=0x55674984f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f554bfff640 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749843380 0x55674984f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f554bfff640 1 -- 172.21.15.70:0/674636410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 msgr2=0x55674984fa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f554bfff640 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 0x55674984fa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f554bfff640 1 -- 172.21.15.70:0/674636410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567495196a0 con 0x556749842a60 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f554bfff640 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x55674984eff0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f553c008470 tx=0x7f553c0088a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7076fea766b70e86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f55337fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f55337fe640 1 -- 172.21.15.70:0/674636410 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c026020 con 0x556749842a60 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f55337fe640 1 -- 172.21.15.70:0/674636410 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f553c005340 con 0x556749842a60 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f555cab8740 1 -- 172.21.15.70:0/674636410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f553c010b10 con 0x556749842a60 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f55337fe640 1 -- 172.21.15.70:0/674636410 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f553c031050 con 0x556749842a60 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f555cab8740 10 client.17082 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f555cab8740 1 -- 172.21.15.70:0/674636410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556749860900 con 0x556749842a60 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.073+0000 7f55337fe640 1 -- 172.21.15.70:0/674636410 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f553c010b10 con 0x556749842a60 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f55337fe640 1 -- 172.21.15.70:0/674636410 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f553c004880 con 0x556749842a60 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f555cab8740 10 client.17082 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f555cab8740 10 client.17082 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:47.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f555cab8740 20 client.17082 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f555cab8740 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556749861d00 0x5567498640f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f555cab8740 4 client.17082 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f555cab8740 1 -- 172.21.15.70:0/674636410 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5567497b57f0 con 0x556749861d00 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f5553fff640 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556749861d00 0x5567498640f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f5553fff640 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556749861d00 0x5567498640f0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cac476dca5a091b7 server_cookie=650a448a760c5f6c in_seq=0 out_seq=0 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.074+0000 7f55337fe640 10 client.17082 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f55337fe640 1 -- 172.21.15.70:0/674636410 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5567497b57f0 con 0x556749861d00 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f55337fe640 10 client.17082 handle_command_reply: tid=0 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f555cab8740 1 client.17082 shutdown 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f555cab8740 1 -- 172.21.15.70:0/674636410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 msgr2=0x55674984eff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f555cab8740 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x55674984eff0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7f553c008470 tx=0x7f553c0088a0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f555cab8740 1 -- 172.21.15.70:0/674636410 shutdown_connections 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f555cab8740 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556749861d00 0x5567498640f0 crc :-1 s=READY pgs=152 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f555cab8740 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 0x55674984fa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.075+0000 7f555cab8740 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749843380 0x55674984f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.076+0000 7f555cab8740 1 --2- 172.21.15.70:0/674636410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749842a60 0x55674984eff0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.076+0000 7f55337fe640 0 client.17082 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.076+0000 7f555cab8740 1 -- 172.21.15.70:0/674636410 >> 172.21.15.70:0/674636410 conn(0x55674983f0f0 msgr2=0x556749844e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.076+0000 7f555cab8740 1 -- 172.21.15.70:0/674636410 shutdown_connections 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.076+0000 7f555cab8740 1 -- 172.21.15.70:0/674636410 wait complete. 2024-09-19T04:37:47.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.076+0000 7f555cab8740 20 client.17082 trim_cache size 0 max 16384 2024-09-19T04:37:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f555cab8740 1 Processor -- start 2024-09-19T04:37:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f555cab8740 1 -- start start 2024-09-19T04:37:47.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f555cab8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674984dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f555cab8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749869810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f555cab8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749852150 0x556749869d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f555cab8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55541adf50 con 0x556749852150 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f555cab8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55541ab820 con 0x556749843380 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f555cab8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55541a9690 con 0x556749842a60 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f554bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749852150 0x556749869d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f554bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749852150 0x556749869d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58540/0 (socket says 172.21.15.70:58540) 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.093+0000 7f554bfff640 1 -- 172.21.15.70:0/829996668 learned_addr learned my addr 172.21.15.70:0/829996668 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f554bfff640 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674984dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f5553fff640 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749869810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f554bfff640 1 -- 172.21.15.70:0/829996668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 msgr2=0x55674984dea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:47.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f554bfff640 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674984dea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f554bfff640 1 -- 172.21.15.70:0/829996668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 msgr2=0x556749869810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f554bfff640 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749869810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f554bfff640 1 -- 172.21.15.70:0/829996668 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5567498518c0 con 0x556749852150 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f5553fff640 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749869810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f554bfff640 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749852150 0x556749869d50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f553c012eb0 tx=0x7f553c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a6fc650d6cc29c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f5549ffb640 1 -- 172.21.15.70:0/829996668 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c03b070 con 0x556749852150 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f5549ffb640 1 -- 172.21.15.70:0/829996668 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f553c008e50 con 0x556749852150 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.094+0000 7f5549ffb640 1 -- 172.21.15.70:0/829996668 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f553c026070 con 0x556749852150 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 -- 172.21.15.70:0/829996668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749852150 msgr2=0x556749869d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749852150 0x556749869d50 secure :-1 s=READY pgs=946 cs=0 l=1 rev1=1 crypto rx=0x7f553c012eb0 tx=0x7f553c000bc0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 -- 172.21.15.70:0/829996668 shutdown_connections 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749852150 0x556749869d50 unknown :-1 s=CLOSED pgs=946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749843380 0x556749869810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 --2- 172.21.15.70:0/829996668 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674984dea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 -- 172.21.15.70:0/829996668 >> 172.21.15.70:0/829996668 conn(0x55674983f0f0 msgr2=0x55674984d790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 -- 172.21.15.70:0/829996668 shutdown_connections 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 -- 172.21.15.70:0/829996668 wait complete. 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 -- start start 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.095+0000 7f555cab8740 1 Processor -- start 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f555cab8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674985a8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f555cab8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749843380 0x556749855c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f555cab8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 0x556749856180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f555cab8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f55541a9ce0 con 0x556749843380 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f555cab8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f55541ab150 con 0x556749852150 2024-09-19T04:37:47.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f555cab8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f55541aa3b0 con 0x556749842a60 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f555cab8740 10 client.0 _ll_register_callbacks cb 0x7f553c0123f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749843380 0x556749855c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749843380 0x556749855c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58556/0 (socket says 172.21.15.70:58556) 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 -- 172.21.15.70:0/453789275 learned_addr learned my addr 172.21.15.70:0/453789275 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f554bfff640 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674985a8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f554bfff640 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 0x556749856180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 -- 172.21.15.70:0/453789275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 msgr2=0x55674985a8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674985a8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 -- 172.21.15.70:0/453789275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 msgr2=0x556749856180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 0x556749856180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 -- 172.21.15.70:0/453789275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5567498569b0 con 0x556749843380 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f554bfff640 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674985a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f5553fff640 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749843380 0x556749855c40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f5544009230 tx=0x7f55440041a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76fc0e2d601f240 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f55337fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f55337fe640 1 -- 172.21.15.70:0/453789275 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5544035040 con 0x556749843380 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f55337fe640 1 -- 172.21.15.70:0/453789275 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f5544031710 con 0x556749843380 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.096+0000 7f555cab8740 1 -- 172.21.15.70:0/453789275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f553c008e50 con 0x556749843380 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f55337fe640 1 -- 172.21.15.70:0/453789275 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f5544031910 con 0x556749843380 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f555cab8740 10 client.17088 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f555cab8740 1 -- 172.21.15.70:0/453789275 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5567498cc870 con 0x556749843380 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f55337fe640 1 -- 172.21.15.70:0/453789275 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f553c008e50 con 0x556749843380 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f55337fe640 1 -- 172.21.15.70:0/453789275 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f55440556b0 con 0x556749843380 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f555cab8740 10 client.17088 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:47.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f555cab8740 10 client.17088 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f555cab8740 20 client.17088 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f555cab8740 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5567498ccff0 0x5567498cf410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f555cab8740 4 client.17088 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:37:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f555cab8740 1 -- 172.21.15.70:0/453789275 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5567497afd00 con 0x5567498ccff0 2024-09-19T04:37:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.097+0000 7f554bfff640 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5567498ccff0 0x5567498cf410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.098+0000 7f554bfff640 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5567498ccff0 0x5567498cf410 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5998cf3b183a048 server_cookie=b8e68808ea42b874 in_seq=0 out_seq=0 2024-09-19T04:37:47.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.098+0000 7f55337fe640 10 client.17088 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f55337fe640 1 -- 172.21.15.70:0/453789275 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5567497afd00 con 0x5567498ccff0 2024-09-19T04:37:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f55337fe640 10 client.17088 handle_command_reply: tid=0 2024-09-19T04:37:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 client.17088 shutdown 2024-09-19T04:37:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 -- 172.21.15.70:0/453789275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749843380 msgr2=0x556749855c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749843380 0x556749855c40 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f5544009230 tx=0x7f55440041a0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 -- 172.21.15.70:0/453789275 shutdown_connections 2024-09-19T04:37:47.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5567498ccff0 0x5567498cf410 crc :-1 s=READY pgs=153 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556749852150 0x556749856180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556749843380 0x556749855c40 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 --2- 172.21.15.70:0/453789275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556749842a60 0x55674985a8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 -- 172.21.15.70:0/453789275 >> 172.21.15.70:0/453789275 conn(0x55674983f0f0 msgr2=0x55674984dfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f55337fe640 0 client.17088 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 -- 172.21.15.70:0/453789275 shutdown_connections 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 1 -- 172.21.15.70:0/453789275 wait complete. 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.099+0000 7f555cab8740 20 client.17088 trim_cache size 0 max 16384 2024-09-19T04:37:47.107 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:37:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "2737fedc-c31e-4f6d-9e49-bc18a4154744", 2024-09-19T04:37:47.108 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:37:47.108 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:47.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 -- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55400a33b0 msgr2=0x7f55400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55400a33b0 0x7f55400a5870 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f554c09b430 tx=0x7f554c06e560 comp rx=0 tx=0).stop 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 -- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 msgr2=0x7f555419cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 0x7f555419cd10 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7f554c00b970 tx=0x7f554c00be30 comp rx=0 tx=0).stop 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 -- 172.21.15.70:0/2952538635 shutdown_connections 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f55400a33b0 0x7f55400a5870 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5554106a80 0x7f555419cd10 unknown :-1 s=CLOSED pgs=943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5554101420 0x7f5554198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 --2- 172.21.15.70:0/2952538635 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5554100a80 0x7f5554198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 -- 172.21.15.70:0/2952538635 >> 172.21.15.70:0/2952538635 conn(0x7f55540fc7a0 msgr2=0x7f555406a830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 -- 172.21.15.70:0/2952538635 shutdown_connections 2024-09-19T04:37:47.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:47.100+0000 7f555a6df640 1 -- 172.21.15.70:0/2952538635 wait complete. 2024-09-19T04:37:47.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:46 smithi167 ceph-mon[34339]: pgmap v215: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:47.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:47 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:37:47.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:47 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:47.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:47 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:37:47.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:47 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:47.839 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:47 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:37:47.868 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:37:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:47 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:37:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:47 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:47 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:37:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:47 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:47 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:37:48.112 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:47 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:37:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:47 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:47 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:37:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:47 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:47 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.656+0000 7f83843d2640 1 -- 172.21.15.70:0/1021094080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c102790 msgr2=0x7f837c1067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.656+0000 7f83843d2640 1 --2- 172.21.15.70:0/1021094080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c102790 0x7f837c1067e0 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f836c009900 tx=0x7f836c02a410 comp rx=0 tx=0).stop 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 -- 172.21.15.70:0/1021094080 shutdown_connections 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 --2- 172.21.15.70:0/1021094080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c106f10 0x7f837c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 --2- 172.21.15.70:0/1021094080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c102790 0x7f837c1067e0 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 --2- 172.21.15.70:0/1021094080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f837c101de0 0x7f837c1021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 -- 172.21.15.70:0/1021094080 >> 172.21.15.70:0/1021094080 conn(0x7f837c0fd8c0 msgr2=0x7f837c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 -- 172.21.15.70:0/1021094080 shutdown_connections 2024-09-19T04:37:48.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 -- 172.21.15.70:0/1021094080 wait complete. 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 Processor -- start 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 -- start start 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c101de0 0x7f837c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c102790 0x7f837c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f837c106f10 0x7f837c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f837c111f40 con 0x7f837c101de0 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f837c111dc0 con 0x7f837c102790 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f83843d2640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1120c0 con 0x7f837c106f10 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f838216e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c101de0 0x7f837c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f838216e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c101de0 0x7f837c0744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58576/0 (socket says 172.21.15.70:58576) 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.657+0000 7f838216e640 1 -- 172.21.15.70:0/3718081298 learned_addr learned my addr 172.21.15.70:0/3718081298 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f838196d640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c102790 0x7f837c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f838296f640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f837c106f10 0x7f837c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f838216e640 1 -- 172.21.15.70:0/3718081298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f837c106f10 msgr2=0x7f837c074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f838216e640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f837c106f10 0x7f837c074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f838216e640 1 -- 172.21.15.70:0/3718081298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c102790 msgr2=0x7f837c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f838216e640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c102790 0x7f837c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f838216e640 1 -- 172.21.15.70:0/3718081298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f837c1a6900 con 0x7f837c101de0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f838216e640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c101de0 0x7f837c0744f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f837800d770 tx=0x7f837800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f83737fe640 1 -- 172.21.15.70:0/3718081298 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378017070 con 0x7f837c101de0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f83737fe640 1 -- 172.21.15.70:0/3718081298 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f83780054f0 con 0x7f837c101de0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f83843d2640 1 -- 172.21.15.70:0/3718081298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f837c1a6bf0 con 0x7f837c101de0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f83737fe640 1 -- 172.21.15.70:0/3718081298 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378004d60 con 0x7f837c101de0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.658+0000 7f83843d2640 1 -- 172.21.15.70:0/3718081298 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f837c1a70e0 con 0x7f837c101de0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.660+0000 7f83737fe640 1 -- 172.21.15.70:0/3718081298 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8378004f00 con 0x7f837c101de0 2024-09-19T04:37:48.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83867ab740 1 Processor -- start 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83867ab740 1 -- start start 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83867ab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff384a0 0x55d82ff38880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83867ab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff43140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83867ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff43680 0x55d82ff45a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83867ab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d82fe9e2e0 con 0x55d82ff38dc0 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83867ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d82fe45ce0 con 0x55d82ff43680 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83867ab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d82fe9a2a0 con 0x55d82ff384a0 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83737fe640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f83680a33b0 0x7f83680a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f838216e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff43140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f838216e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff43140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58582/0 (socket says 172.21.15.70:58582) 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f838216e640 1 -- 172.21.15.70:0/1002227732 learned_addr learned my addr 172.21.15.70:0/1002227732 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f838296f640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff384a0 0x55d82ff38880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f838296f640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f83680a33b0 0x7f83680a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f838196d640 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff43680 0x55d82ff45a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.661+0000 7f83737fe640 1 -- 172.21.15.70:0/3718081298 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f83780cf880 con 0x7f837c101de0 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f838216e640 1 -- 172.21.15.70:0/1002227732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff384a0 msgr2=0x55d82ff38880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f838216e640 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff384a0 0x55d82ff38880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f838216e640 1 -- 172.21.15.70:0/1002227732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff43680 msgr2=0x55d82ff45a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f838216e640 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff43680 0x55d82ff45a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f838216e640 1 -- 172.21.15.70:0/1002227732 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82fe2a440 con 0x55d82ff38dc0 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f838196d640 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff43680 0x55d82ff45a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f838296f640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f83680a33b0 0x7f83680a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8374013a10 tx=0x7f837400d4a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f838216e640 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff43140 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f83780cd030 tx=0x7f837801e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950d5d80ecba3a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f8370dea640 1 -- 172.21.15.70:0/1002227732 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8378084e60 con 0x55d82ff38dc0 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f8370dea640 1 -- 172.21.15.70:0/1002227732 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f83780046c0 con 0x55d82ff38dc0 2024-09-19T04:37:48.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.662+0000 7f8370dea640 1 -- 172.21.15.70:0/1002227732 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780a47d0 con 0x55d82ff38dc0 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 -- 172.21.15.70:0/1002227732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 msgr2=0x55d82ff43140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff43140 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f83780cd030 tx=0x7f837801e000 comp rx=0 tx=0).stop 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 -- 172.21.15.70:0/1002227732 shutdown_connections 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff43680 0x55d82ff45a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff43140 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 --2- 172.21.15.70:0/1002227732 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff384a0 0x55d82ff38880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 -- 172.21.15.70:0/1002227732 >> 172.21.15.70:0/1002227732 conn(0x55d82ff34a30 msgr2=0x55d82ff34e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 -- 172.21.15.70:0/1002227732 shutdown_connections 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 -- 172.21.15.70:0/1002227732 wait complete. 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 -- start start 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 Processor -- start 2024-09-19T04:37:48.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff43010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.663+0000 7f83867ab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff402c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f83867ab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ff40840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f83867ab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d82ff46250 con 0x55d82ff38dc0 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f83867ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d82fe59050 con 0x55d82ff384a0 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f83867ab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d82ff463d0 con 0x55d82ff43680 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f83867ab740 10 client.0 _ll_register_callbacks cb 0x55d82fe99160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff402c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff402c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58588/0 (socket says 172.21.15.70:58588) 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 -- 172.21.15.70:0/1706399512 learned_addr learned my addr 172.21.15.70:0/1706399512 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838296f640 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ff40840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838216e640 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff43010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 -- 172.21.15.70:0/1706399512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 msgr2=0x55d82ff40840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ff40840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 -- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 msgr2=0x55d82ff43010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff43010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 -- 172.21.15.70:0/1706399512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82fc0f3c0 con 0x55d82ff38dc0 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838216e640 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff43010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f838196d640 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff402c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f836c02a930 tx=0x7f836c0317c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cee13d570f8be03 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f8365ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f8365ffb640 1 -- 172.21.15.70:0/1706399512 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c03f070 con 0x55d82ff38dc0 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f8365ffb640 1 -- 172.21.15.70:0/1706399512 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f836c004450 con 0x55d82ff38dc0 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.664+0000 7f83867ab740 1 -- 172.21.15.70:0/1706399512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d82feab850 con 0x55d82ff38dc0 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f8365ffb640 1 -- 172.21.15.70:0/1706399512 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f836c035070 con 0x55d82ff38dc0 2024-09-19T04:37:48.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f83867ab740 10 client.17100 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f83867ab740 1 -- 172.21.15.70:0/1706399512 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d82ff51be0 con 0x55d82ff38dc0 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f8365ffb640 1 -- 172.21.15.70:0/1706399512 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55d82feab850 con 0x55d82ff38dc0 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f8365ffb640 1 -- 172.21.15.70:0/1706399512 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f836c004b40 con 0x55d82ff38dc0 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f83867ab740 10 client.17100 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f83867ab740 10 client.17100 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f83867ab740 20 client.17100 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f83867ab740 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d82ff52ff0 0x55d82ff55450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f83867ab740 4 client.17100 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f83867ab740 1 -- 172.21.15.70:0/1706399512 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d82fea5d60 con 0x55d82ff52ff0 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.665+0000 7f838216e640 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d82ff52ff0 0x55d82ff55450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.666+0000 7f8365ffb640 10 client.17100 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.666+0000 7f838216e640 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d82ff52ff0 0x55d82ff55450 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8a00390881422f0e server_cookie=cbd3484f0916b566 in_seq=0 out_seq=0 2024-09-19T04:37:48.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.666+0000 7f8365ffb640 1 -- 172.21.15.70:0/1706399512 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d82fea5d60 con 0x55d82ff52ff0 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.666+0000 7f8365ffb640 10 client.17100 handle_command_reply: tid=0 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 client.17100 shutdown 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 -- 172.21.15.70:0/1706399512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 msgr2=0x55d82ff402c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff402c0 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f836c02a930 tx=0x7f836c0317c0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 -- 172.21.15.70:0/1706399512 shutdown_connections 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d82ff52ff0 0x55d82ff55450 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ff40840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f8365ffb640 0 client.17100 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff402c0 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 --2- 172.21.15.70:0/1706399512 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff43010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 -- 172.21.15.70:0/1706399512 >> 172.21.15.70:0/1706399512 conn(0x55d82ff34a30 msgr2=0x55d82ff3a710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 -- 172.21.15.70:0/1706399512 shutdown_connections 2024-09-19T04:37:48.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 1 -- 172.21.15.70:0/1706399512 wait complete. 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.667+0000 7f83867ab740 20 client.17100 trim_cache size 0 max 16384 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.684+0000 7f83867ab740 1 Processor -- start 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.684+0000 7f83867ab740 1 -- start start 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.684+0000 7f83867ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff3eb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.684+0000 7f83867ab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff5ad20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.684+0000 7f83867ab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ff5b260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.684+0000 7f83867ab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1b2340 con 0x55d82ff38dc0 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.684+0000 7f83867ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1afc10 con 0x55d82ff384a0 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.684+0000 7f83867ab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1ada80 con 0x55d82ff43680 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff5ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff5ad20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58596/0 (socket says 172.21.15.70:58596) 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 -- 172.21.15.70:0/3274001036 learned_addr learned my addr 172.21.15.70:0/3274001036 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:48.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838216e640 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff3eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 -- 172.21.15.70:0/3274001036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 msgr2=0x55d82ff5b260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ff5b260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 -- 172.21.15.70:0/3274001036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 msgr2=0x55d82ff3eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff3eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 -- 172.21.15.70:0/3274001036 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d82ff43380 con 0x55d82ff38dc0 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838216e640 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff3eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f838196d640 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff5ad20 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f836c003640 tx=0x7f836c032f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1142803804d60b8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f8367fff640 1 -- 172.21.15.70:0/3274001036 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c03f040 con 0x55d82ff38dc0 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f8367fff640 1 -- 172.21.15.70:0/3274001036 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f836c004250 con 0x55d82ff38dc0 2024-09-19T04:37:48.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.685+0000 7f8367fff640 1 -- 172.21.15.70:0/3274001036 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f836c004c30 con 0x55d82ff38dc0 2024-09-19T04:37:48.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 -- 172.21.15.70:0/3274001036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 msgr2=0x55d82ff5ad20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff5ad20 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f836c003640 tx=0x7f836c032f30 comp rx=0 tx=0).stop 2024-09-19T04:37:48.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 -- 172.21.15.70:0/3274001036 shutdown_connections 2024-09-19T04:37:48.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ff5b260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff38dc0 0x55d82ff5ad20 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 --2- 172.21.15.70:0/3274001036 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff384a0 0x55d82ff3eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 -- 172.21.15.70:0/3274001036 >> 172.21.15.70:0/3274001036 conn(0x55d82ff34a30 msgr2=0x55d82ff42340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:48.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 -- 172.21.15.70:0/3274001036 shutdown_connections 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 -- 172.21.15.70:0/3274001036 wait complete. 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 -- start start 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.686+0000 7f83867ab740 1 Processor -- start 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f83867ab740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff384a0 0x55d82ff49770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f83867ab740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff38dc0 0x55d82ff49cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f83867ab740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ffbcd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f83867ab740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1ae0d0 con 0x55d82ff384a0 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f83867ab740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1af540 con 0x55d82ff38dc0 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f83867ab740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f837c1ae7a0 con 0x55d82ff43680 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f83867ab740 10 client.0 _ll_register_callbacks cb 0x7f836c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff384a0 0x55d82ff49770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff384a0 0x55d82ff49770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58602/0 (socket says 172.21.15.70:58602) 2024-09-19T04:37:48.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 -- 172.21.15.70:0/1084327478 learned_addr learned my addr 172.21.15.70:0/1084327478 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838296f640 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ffbcd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 -- 172.21.15.70:0/1084327478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 msgr2=0x55d82ffbcd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ffbcd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 -- 172.21.15.70:0/1084327478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff38dc0 msgr2=0x55d82ff49cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff38dc0 0x55d82ff49cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 -- 172.21.15.70:0/1084327478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d82ff4a5b0 con 0x55d82ff384a0 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838296f640 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ffbcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f838216e640 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff384a0 0x55d82ff49770 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f83780cd080 tx=0x7f837809b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ad4ff9c2061110b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f8365ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.687+0000 7f8365ffb640 1 -- 172.21.15.70:0/1084327478 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f83780b8020 con 0x55d82ff384a0 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f8365ffb640 1 -- 172.21.15.70:0/1084327478 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f83780051f0 con 0x55d82ff384a0 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 1 -- 172.21.15.70:0/1084327478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f836c004250 con 0x55d82ff384a0 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f8365ffb640 1 -- 172.21.15.70:0/1084327478 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8378084e60 con 0x55d82ff384a0 2024-09-19T04:37:48.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 10 client.17106 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 1 -- 172.21.15.70:0/1084327478 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d82ffbe3e0 con 0x55d82ff384a0 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f8365ffb640 1 -- 172.21.15.70:0/1084327478 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f836c004250 con 0x55d82ff384a0 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f8365ffb640 1 -- 172.21.15.70:0/1084327478 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f83780cd250 con 0x55d82ff384a0 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 10 client.17106 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 10 client.17106 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 20 client.17106 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d82ffbe770 0x55d82ffc0b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 4 client.17106 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f83867ab740 1 -- 172.21.15.70:0/1084327478 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d82fe22210 con 0x55d82ffbe770 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.688+0000 7f838196d640 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d82ffbe770 0x55d82ffc0b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f8365ffb640 10 client.17106 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:48.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f838196d640 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d82ffbe770 0x55d82ffc0b60 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=34f2ca6f8bc64c57 server_cookie=48bfb0c09edcea5d in_seq=0 out_seq=0 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f8365ffb640 1 -- 172.21.15.70:0/1084327478 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55d82fe22210 con 0x55d82ffbe770 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f8365ffb640 10 client.17106 handle_command_reply: tid=0 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 client.17106 shutdown 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 -- 172.21.15.70:0/1084327478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff384a0 msgr2=0x55d82ff49770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff384a0 0x55d82ff49770 secure :-1 s=READY pgs=953 cs=0 l=1 rev1=1 crypto rx=0x7f83780cd080 tx=0x7f837809b7c0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 -- 172.21.15.70:0/1084327478 shutdown_connections 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d82ffbe770 0x55d82ffc0b60 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d82ff43680 0x55d82ffbcd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f8365ffb640 0 client.17106 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d82ff38dc0 0x55d82ff49cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 --2- 172.21.15.70:0/1084327478 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d82ff384a0 0x55d82ff49770 unknown :-1 s=CLOSED pgs=953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 -- 172.21.15.70:0/1084327478 >> 172.21.15.70:0/1084327478 conn(0x55d82ff34a30 msgr2=0x55d82ff33350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 -- 172.21.15.70:0/1084327478 shutdown_connections 2024-09-19T04:37:48.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 1 -- 172.21.15.70:0/1084327478 wait complete. 2024-09-19T04:37:48.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.689+0000 7f83867ab740 20 client.17106 trim_cache size 0 max 16384 2024-09-19T04:37:48.707 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:48.707 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:37:48.707 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:37:48.707 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 -- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f83680a33b0 msgr2=0x7f83680a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f83680a33b0 0x7f83680a5870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f8374013a10 tx=0x7f837400d4a0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 -- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c101de0 msgr2=0x7f837c0744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c101de0 0x7f837c0744f0 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f837800d770 tx=0x7f837800dc30 comp rx=0 tx=0).stop 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 -- 172.21.15.70:0/3718081298 shutdown_connections 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f83680a33b0 0x7f83680a5870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f837c106f10 0x7f837c074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f837c102790 0x7f837c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 --2- 172.21.15.70:0/3718081298 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f837c101de0 0x7f837c0744f0 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 -- 172.21.15.70:0/3718081298 >> 172.21.15.70:0/3718081298 conn(0x7f837c0fd8c0 msgr2=0x7f837c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:48.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 -- 172.21.15.70:0/3718081298 shutdown_connections 2024-09-19T04:37:48.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:48.690+0000 7f83843d2640 1 -- 172.21.15.70:0/3718081298 wait complete. 2024-09-19T04:37:48.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:48 smithi070 ceph-mon[30942]: pgmap v216: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:48 smithi134 ceph-mon[34525]: pgmap v216: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:49.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:48 smithi167 ceph-mon[34339]: pgmap v216: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:49.299 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:37:49.299 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:37:49.543 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:50.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 -- 172.21.15.70:0/257083139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108101de0 msgr2=0x7f31081021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 --2- 172.21.15.70:0/257083139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108101de0 0x7f31081021c0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7f30f8009ca0 tx=0x7f30f802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 -- 172.21.15.70:0/257083139 shutdown_connections 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 --2- 172.21.15.70:0/257083139 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3108106f10 0x7f310810ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 --2- 172.21.15.70:0/257083139 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3108102790 0x7f31081067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 --2- 172.21.15.70:0/257083139 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108101de0 0x7f31081021c0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 -- 172.21.15.70:0/257083139 >> 172.21.15.70:0/257083139 conn(0x7f31080fd8c0 msgr2=0x7f31080ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 -- 172.21.15.70:0/257083139 shutdown_connections 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 -- 172.21.15.70:0/257083139 wait complete. 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.021+0000 7f310e035640 1 Processor -- start 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f310e035640 1 -- start start 2024-09-19T04:37:50.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f310e035640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3108101de0 0x7f3108198440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f310e035640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3108102790 0x7f3108198980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f310e035640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108106f10 0x7f310819cd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f310e035640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3108111f40 con 0x7f3108106f10 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f310e035640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3108111dc0 con 0x7f3108101de0 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f310e035640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f31081120c0 con 0x7f3108102790 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3107fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108106f10 0x7f310819cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3107fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108106f10 0x7f310819cd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58624/0 (socket says 172.21.15.70:58624) 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3107fff640 1 -- 172.21.15.70:0/685906699 learned_addr learned my addr 172.21.15.70:0/685906699 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3106ffd640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3108102790 0x7f3108198980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f31077fe640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3108101de0 0x7f3108198440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:50.061 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3107fff640 1 -- 172.21.15.70:0/685906699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3108102790 msgr2=0x7f3108198980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3107fff640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3108102790 0x7f3108198980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3107fff640 1 -- 172.21.15.70:0/685906699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3108101de0 msgr2=0x7f3108198440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3107fff640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3108101de0 0x7f3108198440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.022+0000 7f3107fff640 1 -- 172.21.15.70:0/685906699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f310819d3f0 con 0x7f3108106f10 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.023+0000 7f3107fff640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108106f10 0x7f310819cd10 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f310000d750 tx=0x7f310000dc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.023+0000 7f3104ff9640 1 -- 172.21.15.70:0/685906699 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100017070 con 0x7f3108106f10 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.023+0000 7f3104ff9640 1 -- 172.21.15.70:0/685906699 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f31000054f0 con 0x7f3108106f10 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.023+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f310819d6e0 con 0x7f3108106f10 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.023+0000 7f3104ff9640 1 -- 172.21.15.70:0/685906699 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3100004cf0 con 0x7f3108106f10 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.023+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31081a4fc0 con 0x7f3108106f10 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.024+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31081021c0 con 0x7f3108106f10 2024-09-19T04:37:50.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.026+0000 7f3104ff9640 1 -- 172.21.15.70:0/685906699 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3100004e90 con 0x7f3108106f10 2024-09-19T04:37:50.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.026+0000 7f3104ff9640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30f40a33b0 0x7f30f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:50.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.026+0000 7f31077fe640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30f40a33b0 0x7f30f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:50.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.027+0000 7f3104ff9640 1 -- 172.21.15.70:0/685906699 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f31000cfae0 con 0x7f3108106f10 2024-09-19T04:37:50.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.027+0000 7f31077fe640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30f40a33b0 0x7f30f40a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f30f8000f80 tx=0x7f30f8005ef0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:50.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.029+0000 7f3104ff9640 1 -- 172.21.15.70:0/685906699 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f310009c4c0 con 0x7f3108106f10 2024-09-19T04:37:50.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.231+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f31081997a0 con 0x7f3108106f10 2024-09-19T04:37:50.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.231+0000 7f3104ff9640 1 -- 172.21.15.70:0/685906699 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f31081997a0 con 0x7f3108106f10 2024-09-19T04:37:50.233 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:37:50.233 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:37:50.234 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:37:50.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30f40a33b0 msgr2=0x7f30f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30f40a33b0 0x7f30f40a5870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f30f8000f80 tx=0x7f30f8005ef0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108106f10 msgr2=0x7f310819cd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108106f10 0x7f310819cd10 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7f310000d750 tx=0x7f310000dc10 comp rx=0 tx=0).stop 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 shutdown_connections 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f30f40a33b0 0x7f30f40a5870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3108106f10 0x7f310819cd10 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3108102790 0x7f3108198980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 --2- 172.21.15.70:0/685906699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3108101de0 0x7f3108198440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 >> 172.21.15.70:0/685906699 conn(0x7f31080fd8c0 msgr2=0x7f31080fec10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 shutdown_connections 2024-09-19T04:37:50.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:50.234+0000 7f310e035640 1 -- 172.21.15.70:0/685906699 wait complete. 2024-09-19T04:37:50.555 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/685906699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:50.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:50 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/685906699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:50.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:50 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/685906699' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:37:50.875 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:37:51.118 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:51.493 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:51 smithi070 ceph-mon[30942]: pgmap v217: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:51.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 -- 172.21.15.70:0/2515340358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 msgr2=0x7fef74100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 --2- 172.21.15.70:0/2515340358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 0x7fef74100ee0 secure :-1 s=READY pgs=956 cs=0 l=1 rev1=1 crypto rx=0x7fef5c009930 tx=0x7fef5c02a420 comp rx=0 tx=0).stop 2024-09-19T04:37:51.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 -- 172.21.15.70:0/2515340358 shutdown_connections 2024-09-19T04:37:51.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 --2- 172.21.15.70:0/2515340358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74101420 0x7fef7410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 --2- 172.21.15.70:0/2515340358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 0x7fef74100ee0 unknown :-1 s=CLOSED pgs=956 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 --2- 172.21.15.70:0/2515340358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef74106a80 0x7fef74106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 -- 172.21.15.70:0/2515340358 >> 172.21.15.70:0/2515340358 conn(0x7fef740fc7a0 msgr2=0x7fef740febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 -- 172.21.15.70:0/2515340358 shutdown_connections 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 -- 172.21.15.70:0/2515340358 wait complete. 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 Processor -- start 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.572+0000 7fef79636640 1 -- start start 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef79636640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 0x7fef74197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef79636640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74101420 0x7fef74197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef79636640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef74106a80 0x7fef7419bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef79636640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef74110e90 con 0x7fef74100a80 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef79636640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef74110d10 con 0x7fef74106a80 2024-09-19T04:37:51.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef79636640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fef74111010 con 0x7fef74101420 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 0x7fef74197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 0x7fef74197330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58648/0 (socket says 172.21.15.70:58648) 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 -- 172.21.15.70:0/698150542 learned_addr learned my addr 172.21.15.70:0/698150542 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef727fc640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74101420 0x7fef74197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 -- 172.21.15.70:0/698150542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74101420 msgr2=0x7fef74197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74101420 0x7fef74197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef737fe640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef74106a80 0x7fef7419bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 -- 172.21.15.70:0/698150542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef74106a80 msgr2=0x7fef7419bc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef74106a80 0x7fef7419bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 -- 172.21.15.70:0/698150542 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7419c2e0 con 0x7fef74100a80 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.573+0000 7fef72ffd640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 0x7fef74197330 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c920 tx=0x7fef6400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.574+0000 7fef6bfff640 1 -- 172.21.15.70:0/698150542 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64007c70 con 0x7fef74100a80 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.574+0000 7fef79636640 1 -- 172.21.15.70:0/698150542 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef7419c5d0 con 0x7fef74100a80 2024-09-19T04:37:51.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.574+0000 7fef6bfff640 1 -- 172.21.15.70:0/698150542 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fef64007e10 con 0x7fef74100a80 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.574+0000 7fef6bfff640 1 -- 172.21.15.70:0/698150542 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64018850 con 0x7fef74100a80 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.574+0000 7fef79636640 1 -- 172.21.15.70:0/698150542 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef741a3eb0 con 0x7fef74100a80 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.576+0000 7fef6bfff640 1 -- 172.21.15.70:0/698150542 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fef64018a30 con 0x7fef74100a80 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.576+0000 7fef7ba0f740 1 Processor -- start 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.576+0000 7fef7ba0f740 1 -- start start 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56a62a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56a6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd56b3970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef6bfff640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fef600a33b0 0x7fef600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ddd560a2f0 con 0x55ddd56a67e0 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ddd55b1cf0 con 0x55ddd56a7d50 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ddd56062b0 con 0x55ddd56b1580 2024-09-19T04:37:51.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56a6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef737fe640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fef600a33b0 0x7fef600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56a6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58652/0 (socket says 172.21.15.70:58652) 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 -- 172.21.15.70:0/2144680166 learned_addr learned my addr 172.21.15.70:0/2144680166 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef737fe640 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56a62a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef6bfff640 1 -- 172.21.15.70:0/698150542 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fef640cff30 con 0x7fef74100a80 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef727fc640 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd56b3970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 -- 172.21.15.70:0/2144680166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 msgr2=0x55ddd56b3970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd56b3970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 -- 172.21.15.70:0/2144680166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 msgr2=0x55ddd56a62a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56a62a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 -- 172.21.15.70:0/2144680166 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd55963a0 con 0x55ddd56a67e0 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef737fe640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fef600a33b0 0x7fef600a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0148c0 tx=0x7fef6c001df0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.577+0000 7fef72ffd640 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56a6c20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fef6409c1a0 tx=0x7fef6406be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874b420a1e8e8b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:51.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef697fa640 1 -- 172.21.15.70:0/2144680166 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6400fb90 con 0x55ddd56a67e0 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef697fa640 1 -- 172.21.15.70:0/2144680166 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fef640bae50 con 0x55ddd56a67e0 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef697fa640 1 -- 172.21.15.70:0/2144680166 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef640a05c0 con 0x55ddd56a67e0 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2144680166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 msgr2=0x55ddd56a6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56a6c20 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7fef6409c1a0 tx=0x7fef6406be30 comp rx=0 tx=0).stop 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2144680166 shutdown_connections 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd56b3970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56a6c20 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2144680166 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56a62a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2144680166 >> 172.21.15.70:0/2144680166 conn(0x55ddd566d310 msgr2=0x55ddd56a2e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2144680166 shutdown_connections 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.578+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2144680166 wait complete. 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 1 -- start start 2024-09-19T04:37:51.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 1 Processor -- start 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56b0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56ae270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd56aea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ddd56b4280 con 0x55ddd56a67e0 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ddd55c5060 con 0x55ddd56a7d50 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ddd56b4400 con 0x55ddd56b1580 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef7ba0f740 10 client.0 _ll_register_callbacks cb 0x55ddd53188c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef72ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56b0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef72ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56b0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58664/0 (socket says 172.21.15.70:58664) 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef72ffd640 1 -- 172.21.15.70:0/1125429196 learned_addr learned my addr 172.21.15.70:0/1125429196 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.579+0000 7fef737fe640 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd56aea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef727fc640 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56ae270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef72ffd640 1 -- 172.21.15.70:0/1125429196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 msgr2=0x55ddd56aea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef72ffd640 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd56aea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef72ffd640 1 -- 172.21.15.70:0/1125429196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 msgr2=0x55ddd56ae270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef72ffd640 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56ae270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef72ffd640 1 -- 172.21.15.70:0/1125429196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd537b3c0 con 0x55ddd56a67e0 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef727fc640 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef72ffd640 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56b0fc0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fef64007590 tx=0x7fef64018f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cfbcec45b9903be server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef5a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef5a7fc640 1 -- 172.21.15.70:0/1125429196 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef6400fb90 con 0x55ddd56a67e0 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef5a7fc640 1 -- 172.21.15.70:0/1125429196 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fef640a0160 con 0x55ddd56a67e0 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1125429196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef640bae50 con 0x55ddd56a67e0 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef5a7fc640 1 -- 172.21.15.70:0/1125429196 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fef6409c910 con 0x55ddd56a67e0 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef7ba0f740 10 client.17124 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:51.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1125429196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ddd56bfd70 con 0x55ddd56a67e0 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef5a7fc640 1 -- 172.21.15.70:0/1125429196 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fef640bae50 con 0x55ddd56a67e0 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef5a7fc640 1 -- 172.21.15.70:0/1125429196 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fef64068030 con 0x55ddd56a67e0 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef7ba0f740 10 client.17124 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef7ba0f740 10 client.17124 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef7ba0f740 20 client.17124 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.580+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ddd56c10c0 0x55ddd56c34b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.581+0000 7fef7ba0f740 4 client.17124 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.581+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1125429196 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ddd5617860 con 0x55ddd56c10c0 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.581+0000 7fef727fc640 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ddd56c10c0 0x55ddd56c34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.581+0000 7fef727fc640 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ddd56c10c0 0x55ddd56c34b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=687b6b86dbb49bcb server_cookie=32d5c088134ff6c1 in_seq=0 out_seq=0 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.581+0000 7fef5a7fc640 10 client.17124 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef5a7fc640 1 -- 172.21.15.70:0/1125429196 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ddd5617860 con 0x55ddd56c10c0 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef5a7fc640 10 client.17124 handle_command_reply: tid=0 2024-09-19T04:37:51.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 client.17124 shutdown 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1125429196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 msgr2=0x55ddd56b0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56b0fc0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7fef64007590 tx=0x7fef64018f50 comp rx=0 tx=0).stop 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1125429196 shutdown_connections 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ddd56c10c0 0x55ddd56c34b0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd56aea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef5a7fc640 0 client.17124 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56ae270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1125429196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56b0fc0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1125429196 >> 172.21.15.70:0/1125429196 conn(0x55ddd566d310 msgr2=0x55ddd56a8ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1125429196 shutdown_connections 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1125429196 wait complete. 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.582+0000 7fef7ba0f740 20 client.17124 trim_cache size 0 max 16384 2024-09-19T04:37:51.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef7ba0f740 1 Processor -- start 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef7ba0f740 1 -- start start 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56a67e0 0x55ddd56a7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a7d50 0x55ddd56bcda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56b1580 0x55ddd56a9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef741adf90 con 0x55ddd56a7d50 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef741ab860 con 0x55ddd56b1580 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fef741a96d0 con 0x55ddd56a67e0 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef727fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a7d50 0x55ddd56bcda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef727fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a7d50 0x55ddd56bcda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58674/0 (socket says 172.21.15.70:58674) 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef727fc640 1 -- 172.21.15.70:0/1444832780 learned_addr learned my addr 172.21.15.70:0/1444832780 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.595+0000 7fef72ffd640 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56a67e0 0x55ddd56a7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef737fe640 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56b1580 0x55ddd56a9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef727fc640 1 -- 172.21.15.70:0/1444832780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56a67e0 msgr2=0x55ddd56a7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef727fc640 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56a67e0 0x55ddd56a7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef727fc640 1 -- 172.21.15.70:0/1444832780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56b1580 msgr2=0x55ddd56a9330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef727fc640 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56b1580 0x55ddd56a9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef727fc640 1 -- 172.21.15.70:0/1444832780 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ddd56af360 con 0x55ddd56a7d50 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef72ffd640 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56a67e0 0x55ddd56a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef727fc640 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a7d50 0x55ddd56bcda0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fef5c005ab0 tx=0x7fef5c004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffb7641d4341e177 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef68ff9640 1 -- 172.21.15.70:0/1444832780 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c035040 con 0x55ddd56a7d50 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef68ff9640 1 -- 172.21.15.70:0/1444832780 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fef5c045030 con 0x55ddd56a7d50 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.596+0000 7fef68ff9640 1 -- 172.21.15.70:0/1444832780 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef5c005600 con 0x55ddd56a7d50 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1444832780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a7d50 msgr2=0x55ddd56bcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a7d50 0x55ddd56bcda0 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7fef5c005ab0 tx=0x7fef5c004310 comp rx=0 tx=0).stop 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1444832780 shutdown_connections 2024-09-19T04:37:51.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56b1580 0x55ddd56a9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a7d50 0x55ddd56bcda0 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/1444832780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56a67e0 0x55ddd56a7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1444832780 >> 172.21.15.70:0/1444832780 conn(0x55ddd566d310 msgr2=0x55ddd56bc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1444832780 shutdown_connections 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- 172.21.15.70:0/1444832780 wait complete. 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- start start 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 Processor -- start 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56c4930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56c4e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd572aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fef741a9d20 con 0x55ddd56a67e0 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fef741ab190 con 0x55ddd56a7d50 2024-09-19T04:37:51.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fef741aa3f0 con 0x55ddd56b1580 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef7ba0f740 10 client.0 _ll_register_callbacks cb 0x7fef6c0143d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef72ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56c4930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef72ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56c4930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58684/0 (socket says 172.21.15.70:58684) 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.597+0000 7fef72ffd640 1 -- 172.21.15.70:0/2134112984 learned_addr learned my addr 172.21.15.70:0/2134112984 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef727fc640 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56c4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef72ffd640 1 -- 172.21.15.70:0/2134112984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 msgr2=0x55ddd572aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef737fe640 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd572aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef72ffd640 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd572aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef72ffd640 1 -- 172.21.15.70:0/2134112984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 msgr2=0x55ddd56c4e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef72ffd640 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56c4e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef72ffd640 1 -- 172.21.15.70:0/2134112984 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ddd572af40 con 0x55ddd56a67e0 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef727fc640 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef72ffd640 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56c4930 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fef64098670 tx=0x7fef640984b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a514661d283f1fb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef5a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:51.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef5a7fc640 1 -- 172.21.15.70:0/2134112984 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef64085160 con 0x55ddd56a67e0 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef5a7fc640 1 -- 172.21.15.70:0/2134112984 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fef640a49f0 con 0x55ddd56a67e0 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2134112984 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fef5c045030 con 0x55ddd56a67e0 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef5a7fc640 1 -- 172.21.15.70:0/2134112984 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fef6400de20 con 0x55ddd56a67e0 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef7ba0f740 10 client.17130 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2134112984 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ddd572c1c0 con 0x55ddd56a67e0 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef5a7fc640 1 -- 172.21.15.70:0/2134112984 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fef5c045030 con 0x55ddd56a67e0 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef5a7fc640 1 -- 172.21.15.70:0/2134112984 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fef64068070 con 0x55ddd56a67e0 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.598+0000 7fef7ba0f740 10 client.17130 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.599+0000 7fef7ba0f740 10 client.17130 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.599+0000 7fef7ba0f740 20 client.17130 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.599+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ddd572c6f0 0x55ddd572eae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:51.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.599+0000 7fef7ba0f740 4 client.17130 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.599+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2134112984 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ddd5611d70 con 0x55ddd572c6f0 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.599+0000 7fef727fc640 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ddd572c6f0 0x55ddd572eae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.599+0000 7fef5a7fc640 10 client.17130 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.599+0000 7fef727fc640 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ddd572c6f0 0x55ddd572eae0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6ff8e244b9bc3066 server_cookie=5ce482c3c8f97e8a in_seq=0 out_seq=0 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef5a7fc640 1 -- 172.21.15.70:0/2134112984 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ddd5611d70 con 0x55ddd572c6f0 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef5a7fc640 10 client.17130 handle_command_reply: tid=0 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 client.17130 shutdown 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2134112984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 msgr2=0x55ddd56c4930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56c4930 secure :-1 s=READY pgs=961 cs=0 l=1 rev1=1 crypto rx=0x7fef64098670 tx=0x7fef640984b0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2134112984 shutdown_connections 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55ddd572c6f0 0x55ddd572eae0 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef5a7fc640 0 client.17130 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:37:51.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ddd56b1580 0x55ddd572aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ddd56a7d50 0x55ddd56c4e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 --2- 172.21.15.70:0/2134112984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ddd56a67e0 0x55ddd56c4930 unknown :-1 s=CLOSED pgs=961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.600+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2134112984 >> 172.21.15.70:0/2134112984 conn(0x55ddd566d310 msgr2=0x55ddd56bceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:51.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2134112984 shutdown_connections 2024-09-19T04:37:51.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef7ba0f740 1 -- 172.21.15.70:0/2134112984 wait complete. 2024-09-19T04:37:51.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef7ba0f740 20 client.17130 trim_cache size 0 max 16384 2024-09-19T04:37:51.618 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:51.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 -- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fef600a33b0 msgr2=0x7fef600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fef600a33b0 0x7fef600a5870 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fef6c0148c0 tx=0x7fef6c001df0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 -- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 msgr2=0x7fef74197330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:51.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 0x7fef74197330 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7fef6400c920 tx=0x7fef6400cde0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.619 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 -- 172.21.15.70:0/698150542 shutdown_connections 2024-09-19T04:37:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fef600a33b0 0x7fef600a5870 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef74106a80 0x7fef7419bc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fef74101420 0x7fef74197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 --2- 172.21.15.70:0/698150542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fef74100a80 0x7fef74197330 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 -- 172.21.15.70:0/698150542 >> 172.21.15.70:0/698150542 conn(0x7fef740fc7a0 msgr2=0x7fef740fce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 -- 172.21.15.70:0/698150542 shutdown_connections 2024-09-19T04:37:51.620 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:51.601+0000 7fef79636640 1 -- 172.21.15.70:0/698150542 wait complete. 2024-09-19T04:37:51.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:51 smithi167 ceph-mon[34339]: pgmap v217: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:51.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:51 smithi134 ceph-mon[34525]: pgmap v217: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:52.260 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:37:52.503 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:52.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:52 smithi070 ceph-mon[30942]: pgmap v218: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:52.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 -- 172.21.15.70:0/1094200072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8106a80 msgr2=0x7f43a8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:52.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 --2- 172.21.15.70:0/1094200072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8106a80 0x7f43a8106e60 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f4398009cd0 tx=0x7f439802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:37:52.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 -- 172.21.15.70:0/1094200072 shutdown_connections 2024-09-19T04:37:52.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 --2- 172.21.15.70:0/1094200072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a8101420 0x7f43a810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:52.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 --2- 172.21.15.70:0/1094200072 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8100a80 0x7f43a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:52.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 --2- 172.21.15.70:0/1094200072 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8106a80 0x7f43a8106e60 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 -- 172.21.15.70:0/1094200072 >> 172.21.15.70:0/1094200072 conn(0x7f43a80fc7a0 msgr2=0x7f43a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 -- 172.21.15.70:0/1094200072 shutdown_connections 2024-09-19T04:37:52.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.995+0000 7f43adffa640 1 -- 172.21.15.70:0/1094200072 wait complete. 2024-09-19T04:37:52.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.996+0000 7f43adffa640 1 Processor -- start 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.996+0000 7f43adffa640 1 -- start start 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43adffa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100a80 0x7f43a81973d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43adffa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8101420 0x7f43a8197910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43adffa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a8106a80 0x7f43a819bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43adffa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8110e90 con 0x7f43a8100a80 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43adffa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8110d10 con 0x7f43a8106a80 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43adffa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43a8111010 con 0x7f43a8101420 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100a80 0x7f43a81973d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100a80 0x7f43a81973d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58700/0 (socket says 172.21.15.70:58700) 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 -- 172.21.15.70:0/2992164858 learned_addr learned my addr 172.21.15.70:0/2992164858 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8101420 0x7f43a8197910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a8106a80 0x7f43a819bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 -- 172.21.15.70:0/2992164858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8101420 msgr2=0x7f43a8197910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8101420 0x7f43a8197910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 -- 172.21.15.70:0/2992164858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a8106a80 msgr2=0x7f43a819bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a8106a80 0x7f43a819bca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 -- 172.21.15.70:0/2992164858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43a819c380 con 0x7f43a8100a80 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a8106a80 0x7f43a819bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8101420 0x7f43a8197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.997+0000 7f43a77fe640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100a80 0x7f43a81973d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f4398006010 tx=0x7f4398003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.998+0000 7f43a4ff9640 1 -- 172.21.15.70:0/2992164858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398004040 con 0x7f43a8100a80 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.998+0000 7f43a4ff9640 1 -- 172.21.15.70:0/2992164858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f43980046b0 con 0x7f43a8100a80 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.998+0000 7f43adffa640 1 -- 172.21.15.70:0/2992164858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43a819c610 con 0x7f43a8100a80 2024-09-19T04:37:53.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.998+0000 7f43a4ff9640 1 -- 172.21.15.70:0/2992164858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4398046480 con 0x7f43a8100a80 2024-09-19T04:37:53.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:52.998+0000 7f43adffa640 1 -- 172.21.15.70:0/2992164858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43a81a3f50 con 0x7f43a8100a80 2024-09-19T04:37:53.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43a4ff9640 1 -- 172.21.15.70:0/2992164858 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f43980305a0 con 0x7f43a8100a80 2024-09-19T04:37:53.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43b03d3740 1 Processor -- start 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43b03d3740 1 -- start start 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd4b40 0x5611a5bd3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43a4ff9640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43900a33b0 0x7f43900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bd3a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bde370 0x5611a5be0760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43b03d3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5611a5b392f0 con 0x5611a5bde370 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43b03d3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5611a5ae0cf0 con 0x5611a5bd4b40 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.000+0000 7f43b03d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5611a5b352b0 con 0x5611a5bd35d0 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bde370 0x5611a5be0760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bde370 0x5611a5be0760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58714/0 (socket says 172.21.15.70:58714) 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 -- 172.21.15.70:0/3063494543 learned_addr learned my addr 172.21.15.70:0/3063494543 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:53.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a4ff9640 1 -- 172.21.15.70:0/2992164858 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f439802e030 con 0x7f43a8100a80 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a77fe640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43900a33b0 0x7f43900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bd3a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd4b40 0x5611a5bd3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 -- 172.21.15.70:0/3063494543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 msgr2=0x5611a5bd3a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bd3a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 -- 172.21.15.70:0/3063494543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd4b40 msgr2=0x5611a5bd3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd4b40 0x5611a5bd3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 -- 172.21.15.70:0/3063494543 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a5ac53a0 con 0x5611a5bde370 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bd3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a77fe640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43900a33b0 0x7f43900a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4398005e30 tx=0x7f43980a8040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f43a7fff640 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bde370 0x5611a5be0760 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f43a000cf40 tx=0x7f43a000c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70592efd1cd4c79e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f438dffb640 1 -- 172.21.15.70:0/3063494543 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a001b070 con 0x5611a5bde370 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f438dffb640 1 -- 172.21.15.70:0/3063494543 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f43a0016900 con 0x5611a5bde370 2024-09-19T04:37:53.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.001+0000 7f438dffb640 1 -- 172.21.15.70:0/3063494543 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43a000c030 con 0x5611a5bde370 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 -- 172.21.15.70:0/3063494543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bde370 msgr2=0x5611a5be0760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bde370 0x5611a5be0760 secure :-1 s=READY pgs=964 cs=0 l=1 rev1=1 crypto rx=0x7f43a000cf40 tx=0x7f43a000c3b0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 -- 172.21.15.70:0/3063494543 shutdown_connections 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bde370 0x5611a5be0760 unknown :-1 s=CLOSED pgs=964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bd3a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 --2- 172.21.15.70:0/3063494543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd4b40 0x5611a5bd3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 -- 172.21.15.70:0/3063494543 >> 172.21.15.70:0/3063494543 conn(0x5611a5b9c310 msgr2=0x5611a5bcfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 -- 172.21.15.70:0/3063494543 shutdown_connections 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 -- 172.21.15.70:0/3063494543 wait complete. 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.002+0000 7f43b03d3740 1 -- start start 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43b03d3740 1 Processor -- start 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bdddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bdb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bde370 0x5611a5bdb810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43b03d3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5611a5be1070 con 0x5611a5bd4b40 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43b03d3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5611a5af4060 con 0x5611a5bde370 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43b03d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5611a5be11f0 con 0x5611a5bd35d0 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43b03d3740 10 client.0 _ll_register_callbacks cb 0x5611a58478c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bdb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bdb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58718/0 (socket says 172.21.15.70:58718) 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a6ffd640 1 -- 172.21.15.70:0/1492566481 learned_addr learned my addr 172.21.15.70:0/1492566481 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a7fff640 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bdddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a7fff640 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bde370 0x5611a5bdb810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a6ffd640 1 -- 172.21.15.70:0/1492566481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 msgr2=0x5611a5bdddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:53.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bdddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a6ffd640 1 -- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bde370 msgr2=0x5611a5bdb810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bde370 0x5611a5bdb810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a6ffd640 1 -- 172.21.15.70:0/1492566481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a58aa3c0 con 0x5611a5bd4b40 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.003+0000 7f43a7fff640 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bde370 0x5611a5bdb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bdb080 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f439c00bec0 tx=0x7f439c0117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=759d1c3d64df632a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f4386ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f4386ffd640 1 -- 172.21.15.70:0/1492566481 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c005220 con 0x5611a5bd4b40 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f4386ffd640 1 -- 172.21.15.70:0/1492566481 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f439c0053c0 con 0x5611a5bd4b40 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f43b03d3740 1 -- 172.21.15.70:0/1492566481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43a0016900 con 0x5611a5bd4b40 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f4386ffd640 1 -- 172.21.15.70:0/1492566481 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f439c0055c0 con 0x5611a5bd4b40 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f43b03d3740 10 client.17142 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f43b03d3740 1 -- 172.21.15.70:0/1492566481 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5611a5becc40 con 0x5611a5bd4b40 2024-09-19T04:37:53.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f4386ffd640 1 -- 172.21.15.70:0/1492566481 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f43a0016900 con 0x5611a5bd4b40 2024-09-19T04:37:53.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f4386ffd640 1 -- 172.21.15.70:0/1492566481 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f439c012c70 con 0x5611a5bd4b40 2024-09-19T04:37:53.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f43b03d3740 10 client.17142 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:53.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.004+0000 7f43b03d3740 10 client.17142 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:53.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.005+0000 7f43b03d3740 20 client.17142 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:53.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.005+0000 7f43b03d3740 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5611a5bee150 0x5611a5bf0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.005+0000 7f43b03d3740 4 client.17142 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:53.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.005+0000 7f43b03d3740 1 -- 172.21.15.70:0/1492566481 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5611a5b46860 con 0x5611a5bee150 2024-09-19T04:37:53.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.005+0000 7f43a7fff640 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5611a5bee150 0x5611a5bf0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.005+0000 7f43a7fff640 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5611a5bee150 0x5611a5bf0570 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=dc48d112f00c9af0 server_cookie=62a7cbb961c23bea in_seq=0 out_seq=0 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.005+0000 7f4386ffd640 10 client.17142 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f4386ffd640 1 -- 172.21.15.70:0/1492566481 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5611a5b46860 con 0x5611a5bee150 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f4386ffd640 10 client.17142 handle_command_reply: tid=0 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 client.17142 shutdown 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 -- 172.21.15.70:0/1492566481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 msgr2=0x5611a5bdb080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bdb080 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f439c00bec0 tx=0x7f439c0117b0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 -- 172.21.15.70:0/1492566481 shutdown_connections 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5611a5bee150 0x5611a5bf0570 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bde370 0x5611a5bdb810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bdb080 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 --2- 172.21.15.70:0/1492566481 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bd35d0 0x5611a5bdddd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f4386ffd640 0 client.17142 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:53.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 -- 172.21.15.70:0/1492566481 >> 172.21.15.70:0/1492566481 conn(0x5611a5b9c310 msgr2=0x5611a5bd5990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:53.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 -- 172.21.15.70:0/1492566481 shutdown_connections 2024-09-19T04:37:53.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 1 -- 172.21.15.70:0/1492566481 wait complete. 2024-09-19T04:37:53.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.006+0000 7f43b03d3740 20 client.17142 trim_cache size 0 max 16384 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43b03d3740 1 Processor -- start 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43b03d3740 1 -- start start 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bcfe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd4300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 0x5611a5be6860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43b03d3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81adf10 con 0x5611a5bd4b40 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43b03d3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81ab7e0 con 0x5611a5bd35d0 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43b03d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81a9650 con 0x5611a5bde370 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd4300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd4300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58734/0 (socket says 172.21.15.70:58734) 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.019+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2185937822 learned_addr learned my addr 172.21.15.70:0/2185937822 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:53.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 0x5611a5be6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2185937822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 msgr2=0x5611a5be6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 0x5611a5be6860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bcfe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2185937822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 msgr2=0x5611a5bcfe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bcfe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2185937822 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5611a5bd0960 con 0x5611a5bd4b40 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bcfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd4300 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c010 tx=0x7f439c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba144c382ce4901 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f438d7fa640 1 -- 172.21.15.70:0/2185937822 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c029070 con 0x5611a5bd4b40 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f438d7fa640 1 -- 172.21.15.70:0/2185937822 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f439c02a040 con 0x5611a5bd4b40 2024-09-19T04:37:53.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.020+0000 7f438d7fa640 1 -- 172.21.15.70:0/2185937822 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c012bf0 con 0x5611a5bd4b40 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- 172.21.15.70:0/2185937822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 msgr2=0x5611a5bd4300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd4300 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f439c00c010 tx=0x7f439c001e70 comp rx=0 tx=0).stop 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- 172.21.15.70:0/2185937822 shutdown_connections 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 0x5611a5be6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd4300 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2185937822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bcfe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- 172.21.15.70:0/2185937822 >> 172.21.15.70:0/2185937822 conn(0x5611a5b9c310 msgr2=0x5611a5bcf700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- 172.21.15.70:0/2185937822 shutdown_connections 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- 172.21.15.70:0/2185937822 wait complete. 2024-09-19T04:37:53.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- start start 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 Processor -- start 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bd84e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd8a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 0x5611a5bf53b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81a9ca0 con 0x5611a5bd4b40 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81ab110 con 0x5611a5bd35d0 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.021+0000 7f43b03d3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43a81aa370 con 0x5611a5bde370 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43b03d3740 10 client.0 _ll_register_callbacks cb 0x7f439c00b3e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd8a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd8a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58740/0 (socket says 172.21.15.70:58740) 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2967695 learned_addr learned my addr 172.21.15.70:0/2967695 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bd84e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 0x5611a5bf53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2967695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 msgr2=0x5611a5bf53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 0x5611a5bf53b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2967695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 msgr2=0x5611a5bd84e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bd84e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 -- 172.21.15.70:0/2967695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5611a5bd6120 con 0x5611a5bd4b40 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43a6ffd640 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd8a20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x5611a5bcb660 tx=0x7f439c01ceb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7d3162f075e973ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f4386ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f4386ffd640 1 -- 172.21.15.70:0/2967695 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f439c03b070 con 0x5611a5bd4b40 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f4386ffd640 1 -- 172.21.15.70:0/2967695 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f439c012870 con 0x5611a5bd4b40 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43b03d3740 1 -- 172.21.15.70:0/2967695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f439c02a040 con 0x5611a5bd4b40 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f4386ffd640 1 -- 172.21.15.70:0/2967695 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f439c047050 con 0x5611a5bd4b40 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43b03d3740 10 client.17148 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.022+0000 7f43b03d3740 1 -- 172.21.15.70:0/2967695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5611a5c5c4f0 con 0x5611a5bd4b40 2024-09-19T04:37:53.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f4386ffd640 1 -- 172.21.15.70:0/2967695 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f439c02a040 con 0x5611a5bd4b40 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f4386ffd640 1 -- 172.21.15.70:0/2967695 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f439c003a80 con 0x5611a5bd4b40 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f43b03d3740 10 client.17148 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f43b03d3740 10 client.17148 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f43b03d3740 20 client.17148 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5611a5c5cb30 0x5611a5c5ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f43b03d3740 4 client.17148 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f43b03d3740 1 -- 172.21.15.70:0/2967695 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5611a5b40d70 con 0x5611a5c5cb30 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5611a5c5cb30 0x5611a5c5ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f43a7fff640 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5611a5c5cb30 0x5611a5c5ef50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=11bd846b1b8b5bc7 server_cookie=d4b739e73f9d69b in_seq=0 out_seq=0 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.023+0000 7f4386ffd640 10 client.17148 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f4386ffd640 1 -- 172.21.15.70:0/2967695 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5611a5b40d70 con 0x5611a5c5cb30 2024-09-19T04:37:53.030 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f4386ffd640 10 client.17148 handle_command_reply: tid=0 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 client.17148 shutdown 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 -- 172.21.15.70:0/2967695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 msgr2=0x5611a5bd8a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd8a20 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x5611a5bcb660 tx=0x7f439c01ceb0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 -- 172.21.15.70:0/2967695 shutdown_connections 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5611a5c5cb30 0x5611a5c5ef50 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5611a5bde370 0x5611a5bf53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5611a5bd4b40 0x5611a5bd8a20 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 --2- 172.21.15.70:0/2967695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5611a5bd35d0 0x5611a5bd84e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f4386ffd640 0 client.17148 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 -- 172.21.15.70:0/2967695 >> 172.21.15.70:0/2967695 conn(0x5611a5b9c310 msgr2=0x5611a5bdc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 -- 172.21.15.70:0/2967695 shutdown_connections 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 1 -- 172.21.15.70:0/2967695 wait complete. 2024-09-19T04:37:53.031 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43b03d3740 20 client.17148 trim_cache size 0 max 16384 2024-09-19T04:37:53.032 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:53.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43adffa640 1 -- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43900a33b0 msgr2=0x7f43900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:53.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43adffa640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43900a33b0 0x7f43900a5870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f4398005e30 tx=0x7f43980a8040 comp rx=0 tx=0).stop 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43adffa640 1 -- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100a80 msgr2=0x7f43a81973d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.024+0000 7f43adffa640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100a80 0x7f43a81973d0 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f4398006010 tx=0x7f4398003970 comp rx=0 tx=0).stop 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.025+0000 7f43adffa640 1 -- 172.21.15.70:0/2992164858 shutdown_connections 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.025+0000 7f43adffa640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43900a33b0 0x7f43900a5870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.025+0000 7f43adffa640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43a8106a80 0x7f43a819bca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.025+0000 7f43adffa640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43a8101420 0x7f43a8197910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.025+0000 7f43adffa640 1 --2- 172.21.15.70:0/2992164858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43a8100a80 0x7f43a81973d0 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.025+0000 7f43adffa640 1 -- 172.21.15.70:0/2992164858 >> 172.21.15.70:0/2992164858 conn(0x7f43a80fc7a0 msgr2=0x7f43a80fe0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.025+0000 7f43adffa640 1 -- 172.21.15.70:0/2992164858 shutdown_connections 2024-09-19T04:37:53.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:53.025+0000 7f43adffa640 1 -- 172.21.15.70:0/2992164858 wait complete. 2024-09-19T04:37:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:52 smithi134 ceph-mon[34525]: pgmap v218: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:53.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:52 smithi167 ceph-mon[34339]: pgmap v218: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:37:53.788 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:37:54.037 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:54.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 -- 172.21.15.70:0/1348838574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100350 msgr2=0x7f6ca8100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/1348838574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100350 0x7f6ca8100730 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f6c98009930 tx=0x7f6c9802a420 comp rx=0 tx=0).stop 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 -- 172.21.15.70:0/1348838574 shutdown_connections 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/1348838574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca8106f50 0x7f6ca810eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/1348838574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca8100d00 0x7f6ca8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/1348838574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100350 0x7f6ca8100730 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 -- 172.21.15.70:0/1348838574 >> 172.21.15.70:0/1348838574 conn(0x7f6ca8077210 msgr2=0x7f6ca80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 -- 172.21.15.70:0/1348838574 shutdown_connections 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 -- 172.21.15.70:0/1348838574 wait complete. 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 Processor -- start 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.499+0000 7f6cafe6c640 1 -- start start 2024-09-19T04:37:54.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cafe6c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca8100350 0x7f6ca8198550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cafe6c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100d00 0x7f6ca8198a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cafe6c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca8106f50 0x7f6ca819ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cafe6c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8112010 con 0x7f6ca8100d00 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cafe6c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8111e90 con 0x7f6ca8106f50 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cafe6c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca8112190 con 0x7f6ca8100350 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100d00 0x7f6ca8198a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100d00 0x7f6ca8198a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41018/0 (socket says 172.21.15.70:41018) 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 -- 172.21.15.70:0/3851385696 learned_addr learned my addr 172.21.15.70:0/3851385696 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca8100350 0x7f6ca8198550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 -- 172.21.15.70:0/3851385696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca8100350 msgr2=0x7f6ca8198550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca8100350 0x7f6ca8198550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 -- 172.21.15.70:0/3851385696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca8106f50 msgr2=0x7f6ca819ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca8106f50 0x7f6ca819ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 -- 172.21.15.70:0/3851385696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ca819d500 con 0x7f6ca8100d00 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cad407640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100d00 0x7f6ca8198a90 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400b450 tx=0x7f6ca400b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6c9effd640 1 -- 172.21.15.70:0/3851385696 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4015020 con 0x7f6ca8100d00 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cafe6c640 1 -- 172.21.15.70:0/3851385696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ca819d7f0 con 0x7f6ca8100d00 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6c9effd640 1 -- 172.21.15.70:0/3851385696 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6ca4011d60 con 0x7f6ca8100d00 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6c9effd640 1 -- 172.21.15.70:0/3851385696 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca400f340 con 0x7f6ca8100d00 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.500+0000 7f6cafe6c640 1 -- 172.21.15.70:0/3851385696 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ca81a50d0 con 0x7f6ca8100d00 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.503+0000 7f6cb2245740 1 Processor -- start 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.503+0000 7f6cb2245740 1 -- start start 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6c9effd640 1 -- 172.21.15.70:0/3851385696 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6ca4018020 con 0x7f6ca8100d00 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f33b40 0x55cfb0f32090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.522 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f325d0 0x55cfb0f32a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cb2245740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0e982f0 con 0x55cfb0f3d370 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cb2245740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0e3fcf0 con 0x55cfb0f33b40 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cb2245740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0e942b0 con 0x55cfb0f325d0 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cad407640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cadc08640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f325d0 0x55cfb0f32a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cadc08640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f325d0 0x55cfb0f32a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:44196/0 (socket says 172.21.15.70:44196) 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cad407640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41026/0 (socket says 172.21.15.70:41026) 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cadc08640 1 -- 172.21.15.70:0/2787579964 learned_addr learned my addr 172.21.15.70:0/2787579964 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cae409640 1 --2- 172.21.15.70:0/2787579964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f33b40 0x55cfb0f32090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.523 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cad407640 1 -- 172.21.15.70:0/2787579964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f325d0 msgr2=0x55cfb0f32a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cad407640 1 --2- 172.21.15.70:0/2787579964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f325d0 0x55cfb0f32a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cad407640 1 -- 172.21.15.70:0/2787579964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f33b40 msgr2=0x55cfb0f32090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cad407640 1 --2- 172.21.15.70:0/2787579964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f33b40 0x55cfb0f32090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.504+0000 7f6cad407640 1 -- 172.21.15.70:0/2787579964 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb0e243a0 con 0x55cfb0f3d370 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.505+0000 7f6c9effd640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c940a33b0 0x7f6c940a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.505+0000 7f6cad407640 1 --2- 172.21.15.70:0/2787579964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3f760 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40ccfa0 tx=0x7f6ca40d7690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1323f9bb713177fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.505+0000 7f6cae409640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c940a33b0 0x7f6c940a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.505+0000 7f6c9effd640 1 -- 172.21.15.70:0/3851385696 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f6ca40cf740 con 0x7f6ca8100d00 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.505+0000 7f6c93fff640 1 -- 172.21.15.70:0/2787579964 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca409ce60 con 0x55cfb0f3d370 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.505+0000 7f6c93fff640 1 -- 172.21.15.70:0/2787579964 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6ca40105e0 con 0x55cfb0f3d370 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.505+0000 7f6c93fff640 1 -- 172.21.15.70:0/2787579964 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca4097dd0 con 0x55cfb0f3d370 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 -- 172.21.15.70:0/2787579964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 msgr2=0x55cfb0f3f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cae409640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c940a33b0 0x7f6c940a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009270 tx=0x7f6ca00095e0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:54.524 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 --2- 172.21.15.70:0/2787579964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3f760 secure :-1 s=READY pgs=970 cs=0 l=1 rev1=1 crypto rx=0x7f6ca40ccfa0 tx=0x7f6ca40d7690 comp rx=0 tx=0).stop 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 -- 172.21.15.70:0/2787579964 shutdown_connections 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 --2- 172.21.15.70:0/2787579964 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3f760 unknown :-1 s=CLOSED pgs=970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 --2- 172.21.15.70:0/2787579964 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f325d0 0x55cfb0f32a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 --2- 172.21.15.70:0/2787579964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f33b40 0x55cfb0f32090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 -- 172.21.15.70:0/2787579964 >> 172.21.15.70:0/2787579964 conn(0x55cfb0efb310 msgr2=0x55cfb0f2ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 -- 172.21.15.70:0/2787579964 shutdown_connections 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 -- 172.21.15.70:0/2787579964 wait complete. 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 -- start start 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.506+0000 7f6cb2245740 1 Processor -- start 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f3cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.525 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f3a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cb2245740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0f40070 con 0x55cfb0f3d370 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cb2245740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0e53060 con 0x55cfb0f325d0 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cb2245740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cfb0f401f0 con 0x55cfb0f33b40 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cb2245740 10 client.0 _ll_register_callbacks cb 0x55cfb0ba68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3a7d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41030/0 (socket says 172.21.15.70:41030) 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 -- 172.21.15.70:0/3490422250 learned_addr learned my addr 172.21.15.70:0/3490422250 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f3cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cad407640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f3a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 -- 172.21.15.70:0/3490422250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 msgr2=0x55cfb0f3a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:54.526 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f3a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 -- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 msgr2=0x55cfb0f3cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f3cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 -- 172.21.15.70:0/3490422250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb0c093c0 con 0x55cfb0f3d370 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cad407640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f3a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f3cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cae409640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3a7d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00127b0 tx=0x7f6ca0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f19feb70add522a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6c917fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6c917fa640 1 -- 172.21.15.70:0/3490422250 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca0003b70 con 0x55cfb0f3d370 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6c917fa640 1 -- 172.21.15.70:0/3490422250 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f6ca0003d10 con 0x55cfb0f3d370 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6cb2245740 1 -- 172.21.15.70:0/3490422250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55cfb0ea5860 con 0x55cfb0f3d370 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.507+0000 7f6c917fa640 1 -- 172.21.15.70:0/3490422250 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6ca0004b20 con 0x55cfb0f3d370 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cb2245740 10 client.17160 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:54.527 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cb2245740 1 -- 172.21.15.70:0/3490422250 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cfb0f4bc00 con 0x55cfb0f3d370 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6c917fa640 1 -- 172.21.15.70:0/3490422250 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55cfb0ea5860 con 0x55cfb0f3d370 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6c917fa640 1 -- 172.21.15.70:0/3490422250 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6ca000f040 con 0x55cfb0f3d370 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cb2245740 10 client.17160 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cb2245740 10 client.17160 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cb2245740 20 client.17160 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cfb0f4d0c0 0x55cfb0f4f4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cb2245740 4 client.17160 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cb2245740 1 -- 172.21.15.70:0/3490422250 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cfb0e9fd70 con 0x55cfb0f4d0c0 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.508+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cfb0f4d0c0 0x55cfb0f4f4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.509+0000 7f6c917fa640 10 client.17160 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.509+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cfb0f4d0c0 0x55cfb0f4f4b0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2fff70299676934 server_cookie=b7412bb6d2381110 in_seq=0 out_seq=0 2024-09-19T04:37:54.528 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.509+0000 7f6c917fa640 1 -- 172.21.15.70:0/3490422250 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cfb0e9fd70 con 0x55cfb0f4d0c0 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.509+0000 7f6c917fa640 10 client.17160 handle_command_reply: tid=0 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.509+0000 7f6cb2245740 1 client.17160 shutdown 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.509+0000 7f6cb2245740 1 -- 172.21.15.70:0/3490422250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 msgr2=0x55cfb0f3a7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.509+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3a7d0 secure :-1 s=READY pgs=971 cs=0 l=1 rev1=1 crypto rx=0x7f6ca00127b0 tx=0x7f6ca0004a40 comp rx=0 tx=0).stop 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 1 -- 172.21.15.70:0/3490422250 shutdown_connections 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cfb0f4d0c0 0x55cfb0f4f4b0 crc :-1 s=READY pgs=156 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f3d370 0x55cfb0f3a7d0 unknown :-1 s=CLOSED pgs=971 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f3a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6c917fa640 0 client.17160 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3490422250 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f3cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 1 -- 172.21.15.70:0/3490422250 >> 172.21.15.70:0/3490422250 conn(0x55cfb0efb310 msgr2=0x55cfb0f34960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 1 -- 172.21.15.70:0/3490422250 shutdown_connections 2024-09-19T04:37:54.529 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 1 -- 172.21.15.70:0/3490422250 wait complete. 2024-09-19T04:37:54.530 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.510+0000 7f6cb2245740 20 client.17160 trim_cache size 0 max 16384 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.522+0000 7f6cb2245740 1 Processor -- start 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.522+0000 7f6cb2245740 1 -- start start 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f325d0 0x55cfb0f2ed70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f39970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f3d370 0x55cfb0f49310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cb2245740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca81b0260 con 0x55cfb0f325d0 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cb2245740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca81adb30 con 0x55cfb0f3d370 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cb2245740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca81ab9a0 con 0x55cfb0f33b40 2024-09-19T04:37:54.535 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f325d0 0x55cfb0f2ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f325d0 0x55cfb0f2ed70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41034/0 (socket says 172.21.15.70:41034) 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 -- 172.21.15.70:0/1162104020 learned_addr learned my addr 172.21.15.70:0/1162104020 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cad407640 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f39970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cae409640 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f3d370 0x55cfb0f49310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 -- 172.21.15.70:0/1162104020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 msgr2=0x55cfb0f39970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f39970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 -- 172.21.15.70:0/1162104020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f3d370 msgr2=0x55cfb0f49310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f3d370 0x55cfb0f49310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 -- 172.21.15.70:0/1162104020 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cfb0f49850 con 0x55cfb0f325d0 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cae409640 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f3d370 0x55cfb0f49310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6cadc08640 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f325d0 0x55cfb0f2ed70 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6c980314b0 tx=0x7f6c980058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac39f442f0c1a238 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:54.536 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6c937fe640 1 -- 172.21.15.70:0/1162104020 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c98035040 con 0x55cfb0f325d0 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6c937fe640 1 -- 172.21.15.70:0/1162104020 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c9804a070 con 0x55cfb0f325d0 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.523+0000 7f6c937fe640 1 -- 172.21.15.70:0/1162104020 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c980049c0 con 0x55cfb0f325d0 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 -- 172.21.15.70:0/1162104020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f325d0 msgr2=0x55cfb0f2ed70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f325d0 0x55cfb0f2ed70 secure :-1 s=READY pgs=972 cs=0 l=1 rev1=1 crypto rx=0x7f6c980314b0 tx=0x7f6c980058d0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 -- 172.21.15.70:0/1162104020 shutdown_connections 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f3d370 0x55cfb0f49310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f33b40 0x55cfb0f39970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 --2- 172.21.15.70:0/1162104020 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f325d0 0x55cfb0f2ed70 unknown :-1 s=CLOSED pgs=972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 -- 172.21.15.70:0/1162104020 >> 172.21.15.70:0/1162104020 conn(0x55cfb0efb310 msgr2=0x55cfb0f3c110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 -- 172.21.15.70:0/1162104020 shutdown_connections 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 -- 172.21.15.70:0/1162104020 wait complete. 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.524+0000 7f6cb2245740 1 -- start start 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cb2245740 1 Processor -- start 2024-09-19T04:37:54.537 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f54940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f33b40 0x55cfb0f54e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cb2245740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f3d370 0x55cfb0fb3090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cb2245740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca81abff0 con 0x55cfb0f33b40 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cb2245740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca81ad460 con 0x55cfb0f325d0 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cb2245740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6ca81ac6c0 con 0x55cfb0f3d370 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cb2245740 10 client.0 _ll_register_callbacks cb 0x7f6ca0009ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cad407640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f33b40 0x55cfb0f54e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cad407640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f33b40 0x55cfb0f54e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41038/0 (socket says 172.21.15.70:41038) 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cad407640 1 -- 172.21.15.70:0/3136478550 learned_addr learned my addr 172.21.15.70:0/3136478550 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cae409640 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f3d370 0x55cfb0fb3090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f54940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cad407640 1 -- 172.21.15.70:0/3136478550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f3d370 msgr2=0x55cfb0fb3090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:54.538 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cad407640 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f3d370 0x55cfb0fb3090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cad407640 1 -- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 msgr2=0x55cfb0f54940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cad407640 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f54940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cad407640 1 -- 172.21.15.70:0/3136478550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cfb0fb3730 con 0x55cfb0f33b40 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.525+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f54940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cad407640 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f33b40 0x55cfb0f54e80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4000c00 tx=0x7f6ca40cfa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ba3d028d0e1920b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6c917fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6c917fa640 1 -- 172.21.15.70:0/3136478550 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ca409ce60 con 0x55cfb0f33b40 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6c917fa640 1 -- 172.21.15.70:0/3136478550 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f6ca40981a0 con 0x55cfb0f33b40 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 1 -- 172.21.15.70:0/3136478550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6c9804a070 con 0x55cfb0f33b40 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6c917fa640 1 -- 172.21.15.70:0/3136478550 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6ca409b490 con 0x55cfb0f33b40 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 10 client.17166 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:54.539 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 1 -- 172.21.15.70:0/3136478550 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cfb0fbbc30 con 0x55cfb0f33b40 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6c917fa640 1 -- 172.21.15.70:0/3136478550 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6c9804a070 con 0x55cfb0f33b40 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6c917fa640 1 -- 172.21.15.70:0/3136478550 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6ca40ba340 con 0x55cfb0f33b40 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 10 client.17166 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 10 client.17166 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 20 client.17166 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cfb0fbbf10 0x55cfb0fbe300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 4 client.17166 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.526+0000 7f6cb2245740 1 -- 172.21.15.70:0/3136478550 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cfb0e1c170 con 0x55cfb0fbbf10 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cfb0fbbf10 0x55cfb0fbe300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cadc08640 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cfb0fbbf10 0x55cfb0fbe300 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c657beaa3c0784e server_cookie=8cc48ceec4f12460 in_seq=0 out_seq=0 2024-09-19T04:37:54.540 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6c917fa640 10 client.17166 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6c917fa640 1 -- 172.21.15.70:0/3136478550 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cfb0e1c170 con 0x55cfb0fbbf10 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6c917fa640 10 client.17166 handle_command_reply: tid=0 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 client.17166 shutdown 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 -- 172.21.15.70:0/3136478550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f33b40 msgr2=0x55cfb0f54e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f33b40 0x55cfb0f54e80 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f6ca4000c00 tx=0x7f6ca40cfa40 comp rx=0 tx=0).stop 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 -- 172.21.15.70:0/3136478550 shutdown_connections 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55cfb0fbbf10 0x55cfb0fbe300 crc :-1 s=READY pgs=157 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cfb0f3d370 0x55cfb0fb3090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cfb0f33b40 0x55cfb0f54e80 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6c917fa640 0 client.17166 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 --2- 172.21.15.70:0/3136478550 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cfb0f325d0 0x55cfb0f54940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 -- 172.21.15.70:0/3136478550 >> 172.21.15.70:0/3136478550 conn(0x55cfb0efb310 msgr2=0x55cfb0f34110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:54.541 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.527+0000 7f6cb2245740 1 -- 172.21.15.70:0/3136478550 shutdown_connections 2024-09-19T04:37:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cb2245740 1 -- 172.21.15.70:0/3136478550 wait complete. 2024-09-19T04:37:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cb2245740 20 client.17166 trim_cache size 0 max 16384 2024-09-19T04:37:54.542 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:37:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 -- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c940a33b0 msgr2=0x7f6c940a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.542 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c940a33b0 0x7f6c940a5870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f6ca0009270 tx=0x7f6ca00095e0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 -- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100d00 msgr2=0x7f6ca8198a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100d00 0x7f6ca8198a90 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f6ca400b450 tx=0x7f6ca400b910 comp rx=0 tx=0).stop 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 -- 172.21.15.70:0/3851385696 shutdown_connections 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f6c940a33b0 0x7f6c940a5870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ca8106f50 0x7f6ca819ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6ca8100d00 0x7f6ca8198a90 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 --2- 172.21.15.70:0/3851385696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6ca8100350 0x7f6ca8198550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 -- 172.21.15.70:0/3851385696 >> 172.21.15.70:0/3851385696 conn(0x7f6ca8077210 msgr2=0x7f6ca81052b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 -- 172.21.15.70:0/3851385696 shutdown_connections 2024-09-19T04:37:54.543 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:54.528+0000 7f6cafe6c640 1 -- 172.21.15.70:0/3851385696 wait complete. 2024-09-19T04:37:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:54 smithi134 ceph-mon[34525]: pgmap v219: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:55.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:54 smithi070 ceph-mon[30942]: pgmap v219: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:54 smithi167 ceph-mon[34339]: pgmap v219: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:56.159 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:37:56.160 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:37:56.422 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:56.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:56 smithi070 ceph-mon[30942]: pgmap v220: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:56.927 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 -- 172.21.15.70:0/4115377775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 msgr2=0x7f14701067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 --2- 172.21.15.70:0/4115377775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 0x7f14701067f0 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f1464009900 tx=0x7f146402a410 comp rx=0 tx=0).stop 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 -- 172.21.15.70:0/4115377775 shutdown_connections 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 --2- 172.21.15.70:0/4115377775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1470106f20 0x7f147010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 --2- 172.21.15.70:0/4115377775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 0x7f14701067f0 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 --2- 172.21.15.70:0/4115377775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1470101df0 0x7f14701021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 -- 172.21.15.70:0/4115377775 >> 172.21.15.70:0/4115377775 conn(0x7f14700fd8f0 msgr2=0x7f14700ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 -- 172.21.15.70:0/4115377775 shutdown_connections 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.905+0000 7f1476286640 1 -- 172.21.15.70:0/4115377775 wait complete. 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f1476286640 1 Processor -- start 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f1476286640 1 -- start start 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f1476286640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1470101df0 0x7f1470198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.928 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f1476286640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 0x7f1470198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f1476286640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1470106f20 0x7f147019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f1476286640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1470111f10 con 0x7f14701027a0 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f1476286640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1470111d90 con 0x7f1470106f20 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f1476286640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1470112090 con 0x7f1470101df0 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.906+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 0x7f1470198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 0x7f1470198a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41046/0 (socket says 172.21.15.70:41046) 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146f7fe640 1 -- 172.21.15.70:0/690406160 learned_addr learned my addr 172.21.15.70:0/690406160 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f1474823640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1470106f20 0x7f147019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146ffff640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1470101df0 0x7f1470198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146f7fe640 1 -- 172.21.15.70:0/690406160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1470101df0 msgr2=0x7f1470198510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146f7fe640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1470101df0 0x7f1470198510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146f7fe640 1 -- 172.21.15.70:0/690406160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1470106f20 msgr2=0x7f147019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.929 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146f7fe640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1470106f20 0x7f147019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146f7fe640 1 -- 172.21.15.70:0/690406160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f147019d4c0 con 0x7f14701027a0 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146ffff640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1470101df0 0x7f1470198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146f7fe640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 0x7f1470198a50 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1464009230 tx=0x7f1464004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146d7fa640 1 -- 172.21.15.70:0/690406160 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146403f030 con 0x7f14701027a0 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f1476286640 1 -- 172.21.15.70:0/690406160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f147019d750 con 0x7f14701027a0 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146d7fa640 1 -- 172.21.15.70:0/690406160 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1464003ac0 con 0x7f14701027a0 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f146d7fa640 1 -- 172.21.15.70:0/690406160 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464035070 con 0x7f14701027a0 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.907+0000 7f1476286640 1 -- 172.21.15.70:0/690406160 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14701a5090 con 0x7f14701027a0 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f147865f740 1 Processor -- start 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f146d7fa640 1 -- 172.21.15.70:0/690406160 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1464042030 con 0x7f14701027a0 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f147865f740 1 -- start start 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f147865f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66dbf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f147865f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66e6800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.930 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f147865f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a66e9130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f147865f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5638a6641280 con 0x5638a66dbb60 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f147865f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5638a65e8b10 con 0x5638a66e6d40 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f147865f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5638a663d240 con 0x5638a66dc480 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f1474823640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66dbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f1474823640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66dbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41056/0 (socket says 172.21.15.70:41056) 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f1474823640 1 -- 172.21.15.70:0/3527007137 learned_addr learned my addr 172.21.15.70:0/3527007137 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f146f7fe640 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a66e9130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f146ffff640 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66e6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f1474823640 1 -- 172.21.15.70:0/3527007137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 msgr2=0x5638a66e6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f1474823640 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66e6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f1474823640 1 -- 172.21.15.70:0/3527007137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 msgr2=0x5638a66e9130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f1474823640 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a66e9130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.910+0000 7f1474823640 1 -- 172.21.15.70:0/3527007137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a65f51f0 con 0x5638a66dbb60 2024-09-19T04:37:56.931 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.911+0000 7f1474823640 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66dbf40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1468009f50 tx=0x7f14680118d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1f0059c82441c92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.911+0000 7f146d7fa640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f14580a33b0 0x7f14580a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.911+0000 7f14567fc640 1 -- 172.21.15.70:0/3527007137 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468004d20 con 0x5638a66dbb60 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.911+0000 7f14567fc640 1 -- 172.21.15.70:0/3527007137 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1468004050 con 0x5638a66dbb60 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.911+0000 7f14567fc640 1 -- 172.21.15.70:0/3527007137 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1468005280 con 0x5638a66dbb60 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.911+0000 7f146ffff640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f14580a33b0 0x7f14580a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.911+0000 7f146d7fa640 1 -- 172.21.15.70:0/690406160 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f14640f0210 con 0x7f14701027a0 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 -- 172.21.15.70:0/3527007137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 msgr2=0x5638a66dbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f146ffff640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f14580a33b0 0x7f14580a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5638a66d8f50 tx=0x7f146000b5a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66dbf40 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f1468009f50 tx=0x7f14680118d0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 -- 172.21.15.70:0/3527007137 shutdown_connections 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a66e9130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66e6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 --2- 172.21.15.70:0/3527007137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66dbf40 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.932 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 -- 172.21.15.70:0/3527007137 >> 172.21.15.70:0/3527007137 conn(0x5638a66d80f0 msgr2=0x5638a66d84d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 -- 172.21.15.70:0/3527007137 shutdown_connections 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 -- 172.21.15.70:0/3527007137 wait complete. 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 -- start start 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 Processor -- start 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.912+0000 7f147865f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dbb60 0x5638a66e3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f147865f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66e4150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f147865f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a66e4690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f147865f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5638a66e9910 con 0x5638a66dc480 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f147865f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5638a65fbf10 con 0x5638a66e6d40 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f147865f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5638a66e9a90 con 0x5638a66dbb60 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f147865f740 10 client.0 _ll_register_callbacks cb 0x5638a65c4a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66e4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66e4150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41070/0 (socket says 172.21.15.70:41070) 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 -- 172.21.15.70:0/3977257065 learned_addr learned my addr 172.21.15.70:0/3977257065 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:56.933 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146ffff640 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dbb60 0x5638a66e3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f1474823640 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a66e4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 -- 172.21.15.70:0/3977257065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dbb60 msgr2=0x5638a66e3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dbb60 0x5638a66e3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 -- 172.21.15.70:0/3977257065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 msgr2=0x5638a66e4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a66e4690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 -- 172.21.15.70:0/3977257065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a63b26a0 con 0x5638a66dc480 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f146f7fe640 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66e4150 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f14640ed9c0 tx=0x7f14640f3b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b3f567aa9920949 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f144f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f144f7fe640 1 -- 172.21.15.70:0/3977257065 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464049070 con 0x5638a66dc480 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f144f7fe640 1 -- 172.21.15.70:0/3977257065 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f14640b8b60 con 0x5638a66dc480 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.913+0000 7f147865f740 1 -- 172.21.15.70:0/3977257065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1468004050 con 0x5638a66dc480 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f144f7fe640 1 -- 172.21.15.70:0/3977257065 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f14640bc2c0 con 0x5638a66dc480 2024-09-19T04:37:56.934 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f147865f740 10 client.17178 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f147865f740 1 -- 172.21.15.70:0/3977257065 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5638a66f5510 con 0x5638a66dc480 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f144f7fe640 1 -- 172.21.15.70:0/3977257065 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1468004050 con 0x5638a66dc480 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f144f7fe640 1 -- 172.21.15.70:0/3977257065 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f14640bc750 con 0x5638a66dc480 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f147865f740 10 client.17178 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f147865f740 10 client.17178 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f147865f740 20 client.17178 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f147865f740 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5638a66f69a0 0x5638a66f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f147865f740 4 client.17178 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f147865f740 1 -- 172.21.15.70:0/3977257065 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5638a664e7f0 con 0x5638a66f69a0 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.914+0000 7f146ffff640 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5638a66f69a0 0x5638a66f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.915+0000 7f144f7fe640 10 client.17178 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.915+0000 7f146ffff640 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5638a66f69a0 0x5638a66f8db0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5bf89e39ced6cfb4 server_cookie=4ca979ede2635e08 in_seq=0 out_seq=0 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f144f7fe640 1 -- 172.21.15.70:0/3977257065 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5638a664e7f0 con 0x5638a66f69a0 2024-09-19T04:37:56.935 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f144f7fe640 10 client.17178 handle_command_reply: tid=0 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 client.17178 shutdown 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 -- 172.21.15.70:0/3977257065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 msgr2=0x5638a66e4150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66e4150 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f14640ed9c0 tx=0x7f14640f3b60 comp rx=0 tx=0).stop 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 -- 172.21.15.70:0/3977257065 shutdown_connections 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5638a66f69a0 0x5638a66f8db0 crc :-1 s=READY pgs=158 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a66e4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66e4150 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 --2- 172.21.15.70:0/3977257065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dbb60 0x5638a66e3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 -- 172.21.15.70:0/3977257065 >> 172.21.15.70:0/3977257065 conn(0x5638a66d80f0 msgr2=0x5638a66d7270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f144f7fe640 0 client.17178 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 -- 172.21.15.70:0/3977257065 shutdown_connections 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 1 -- 172.21.15.70:0/3977257065 wait complete. 2024-09-19T04:37:56.936 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.916+0000 7f147865f740 20 client.17178 trim_cache size 0 max 16384 2024-09-19T04:37:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f147865f740 1 Processor -- start 2024-09-19T04:37:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f147865f740 1 -- start start 2024-09-19T04:37:56.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f147865f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66dbb60 0x5638a66e5a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f147865f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66fe680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f147865f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66e6d40 0x5638a66febc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f147865f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14701b0070 con 0x5638a66dc480 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f147865f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14701ad940 con 0x5638a66dbb60 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f147865f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14701ab7b0 con 0x5638a66e6d40 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66fe680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66fe680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41082/0 (socket says 172.21.15.70:41082) 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 -- 172.21.15.70:0/4261752908 learned_addr learned my addr 172.21.15.70:0/4261752908 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 -- 172.21.15.70:0/4261752908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66e6d40 msgr2=0x5638a66febc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 --2- 172.21.15.70:0/4261752908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66e6d40 0x5638a66febc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 -- 172.21.15.70:0/4261752908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66dbb60 msgr2=0x5638a66e5a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 --2- 172.21.15.70:0/4261752908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66dbb60 0x5638a66e5a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 -- 172.21.15.70:0/4261752908 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638a66e2160 con 0x5638a66dc480 2024-09-19T04:37:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.947+0000 7f146f7fe640 1 --2- 172.21.15.70:0/4261752908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66fe680 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f14640c0920 tx=0x7f1464009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66942e51fa8b0b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f1455ffb640 1 -- 172.21.15.70:0/4261752908 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1464049070 con 0x5638a66dc480 2024-09-19T04:37:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f1455ffb640 1 -- 172.21.15.70:0/4261752908 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f14640bcbf0 con 0x5638a66dc480 2024-09-19T04:37:56.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f1455ffb640 1 -- 172.21.15.70:0/4261752908 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14640bbe50 con 0x5638a66dc480 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f147865f740 1 -- 172.21.15.70:0/4261752908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 msgr2=0x5638a66fe680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f147865f740 1 --2- 172.21.15.70:0/4261752908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66fe680 secure :-1 s=READY pgs=978 cs=0 l=1 rev1=1 crypto rx=0x7f14640c0920 tx=0x7f1464009680 comp rx=0 tx=0).stop 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f147865f740 1 -- 172.21.15.70:0/4261752908 shutdown_connections 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f147865f740 1 --2- 172.21.15.70:0/4261752908 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66e6d40 0x5638a66febc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f147865f740 1 --2- 172.21.15.70:0/4261752908 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dc480 0x5638a66fe680 unknown :-1 s=CLOSED pgs=978 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f147865f740 1 --2- 172.21.15.70:0/4261752908 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66dbb60 0x5638a66e5a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.948+0000 7f147865f740 1 -- 172.21.15.70:0/4261752908 >> 172.21.15.70:0/4261752908 conn(0x5638a66d80f0 msgr2=0x5638a66e52f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 -- 172.21.15.70:0/4261752908 shutdown_connections 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 -- 172.21.15.70:0/4261752908 wait complete. 2024-09-19T04:37:56.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 -- start start 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 Processor -- start 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66eb650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66ebb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a6759610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f14701abe00 con 0x5638a66dbb60 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f14701ad270 con 0x5638a66e6d40 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f14701ac4d0 con 0x5638a66dc480 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f147865f740 10 client.0 _ll_register_callbacks cb 0x7f14640f3c60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f146ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66eb650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f146ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66eb650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41090/0 (socket says 172.21.15.70:41090) 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.949+0000 7f146ffff640 1 -- 172.21.15.70:0/1652814515 learned_addr learned my addr 172.21.15.70:0/1652814515 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:56.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f146f7fe640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66ebb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f1474823640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a6759610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f146ffff640 1 -- 172.21.15.70:0/1652814515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 msgr2=0x5638a66ebb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f146ffff640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66ebb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f146ffff640 1 -- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 msgr2=0x5638a6759610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f146ffff640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a6759610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f146ffff640 1 -- 172.21.15.70:0/1652814515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638a6759e20 con 0x5638a66dbb60 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f146f7fe640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66ebb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f1474823640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a6759610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f146ffff640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66eb650 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f1460005f00 tx=0x7f1460004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3058b7d05fb588a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f144f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f144f7fe640 1 -- 172.21.15.70:0/1652814515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f146002f060 con 0x5638a66dbb60 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f144f7fe640 1 -- 172.21.15.70:0/1652814515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f146002a5f0 con 0x5638a66dbb60 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f147865f740 1 -- 172.21.15.70:0/1652814515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f14640bcbf0 con 0x5638a66dbb60 2024-09-19T04:37:56.956 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f144f7fe640 1 -- 172.21.15.70:0/1652814515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f146002a7f0 con 0x5638a66dbb60 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f147865f740 10 client.17184 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.950+0000 7f147865f740 1 -- 172.21.15.70:0/1652814515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5638a6762210 con 0x5638a66dbb60 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f144f7fe640 1 -- 172.21.15.70:0/1652814515 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f14640bcbf0 con 0x5638a66dbb60 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f144f7fe640 1 -- 172.21.15.70:0/1652814515 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1460029070 con 0x5638a66dbb60 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f147865f740 10 client.17184 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f147865f740 10 client.17184 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f147865f740 20 client.17184 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f147865f740 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5638a6762910 0x5638a6764d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f147865f740 4 client.17184 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f147865f740 1 -- 172.21.15.70:0/1652814515 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5638a6648d00 con 0x5638a6762910 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.951+0000 7f146f7fe640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5638a6762910 0x5638a6764d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.952+0000 7f146f7fe640 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5638a6762910 0x5638a6764d30 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8b30fecbce8e23a4 server_cookie=3e12b9b50672104a in_seq=0 out_seq=0 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.952+0000 7f144f7fe640 10 client.17184 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:56.957 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f144f7fe640 1 -- 172.21.15.70:0/1652814515 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5638a6648d00 con 0x5638a6762910 2024-09-19T04:37:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f144f7fe640 10 client.17184 handle_command_reply: tid=0 2024-09-19T04:37:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 client.17184 shutdown 2024-09-19T04:37:56.958 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 -- 172.21.15.70:0/1652814515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 msgr2=0x5638a66eb650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66eb650 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7f1460005f00 tx=0x7f1460004730 comp rx=0 tx=0).stop 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 -- 172.21.15.70:0/1652814515 shutdown_connections 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5638a6762910 0x5638a6764d30 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638a66e6d40 0x5638a6759610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5638a66dc480 0x5638a66ebb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 --2- 172.21.15.70:0/1652814515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638a66dbb60 0x5638a66eb650 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 -- 172.21.15.70:0/1652814515 >> 172.21.15.70:0/1652814515 conn(0x5638a66d80f0 msgr2=0x5638a66dddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f144f7fe640 0 client.17184 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 -- 172.21.15.70:0/1652814515 shutdown_connections 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 1 -- 172.21.15.70:0/1652814515 wait complete. 2024-09-19T04:37:56.959 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.953+0000 7f147865f740 20 client.17184 trim_cache size 0 max 16384 2024-09-19T04:37:56.960 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:37:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "c08af14f-12e3-4e47-bb54-0b424f330b89", 2024-09-19T04:37:56.960 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:37:56.960 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:56.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 -- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f14580a33b0 msgr2=0x7f14580a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f14580a33b0 0x7f14580a5870 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x5638a66d8f50 tx=0x7f146000b5a0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 -- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 msgr2=0x7f1470198a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 0x7f1470198a50 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7f1464009230 tx=0x7f1464004270 comp rx=0 tx=0).stop 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 -- 172.21.15.70:0/690406160 shutdown_connections 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f14580a33b0 0x7f14580a5870 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1470106f20 0x7f147019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f14701027a0 0x7f1470198a50 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 --2- 172.21.15.70:0/690406160 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1470101df0 0x7f1470198510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 -- 172.21.15.70:0/690406160 >> 172.21.15.70:0/690406160 conn(0x7f14700fd8f0 msgr2=0x7f14700fec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 -- 172.21.15.70:0/690406160 shutdown_connections 2024-09-19T04:37:56.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:56.954+0000 7f1476286640 1 -- 172.21.15.70:0/690406160 wait complete. 2024-09-19T04:37:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:56 smithi134 ceph-mon[34525]: pgmap v220: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:57.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:56 smithi167 ceph-mon[34339]: pgmap v220: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:37:57.559 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:37:57.807 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:57 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:37:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:57 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:57 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:37:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:57 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:57 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:37:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:57 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:37:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:57 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:57 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:37:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:57 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:57 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:37:58.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:57 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:37:58.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:57 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:58.113 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:57 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:37:58.113 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:57 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:37:58.113 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:57 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:37:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 -- 172.21.15.70:0/2086008614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c100a80 msgr2=0x7fd82c100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 --2- 172.21.15.70:0/2086008614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c100a80 0x7fd82c100ee0 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fd820009930 tx=0x7fd82002a420 comp rx=0 tx=0).stop 2024-09-19T04:37:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 -- 172.21.15.70:0/2086008614 shutdown_connections 2024-09-19T04:37:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 --2- 172.21.15.70:0/2086008614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd82c101420 0x7fd82c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 --2- 172.21.15.70:0/2086008614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c100a80 0x7fd82c100ee0 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 --2- 172.21.15.70:0/2086008614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c106a80 0x7fd82c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 -- 172.21.15.70:0/2086008614 >> 172.21.15.70:0/2086008614 conn(0x7fd82c0fc7a0 msgr2=0x7fd82c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 -- 172.21.15.70:0/2086008614 shutdown_connections 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.282+0000 7fd8316bf640 1 -- 172.21.15.70:0/2086008614 wait complete. 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd8316bf640 1 Processor -- start 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd8316bf640 1 -- start start 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd8316bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd82c100a80 0x7fd82c10e3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd8316bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c101420 0x7fd82c10e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd8316bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106a80 0x7fd82c10ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd8316bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c111f70 con 0x7fd82c106a80 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd8316bf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c111df0 con 0x7fd82c101420 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd8316bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1120f0 con 0x7fd82c100a80 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.283+0000 7fd82b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106a80 0x7fd82c10ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106a80 0x7fd82c10ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41106/0 (socket says 172.21.15.70:41106) 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82b7fe640 1 -- 172.21.15.70:0/648893620 learned_addr learned my addr 172.21.15.70:0/648893620 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c101420 0x7fd82c10e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82affd640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd82c100a80 0x7fd82c10e3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82b7fe640 1 -- 172.21.15.70:0/648893620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd82c100a80 msgr2=0x7fd82c10e3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82b7fe640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd82c100a80 0x7fd82c10e3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82b7fe640 1 -- 172.21.15.70:0/648893620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c101420 msgr2=0x7fd82c10e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82b7fe640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c101420 0x7fd82c10e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82b7fe640 1 -- 172.21.15.70:0/648893620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd82c1a6910 con 0x7fd82c106a80 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c101420 0x7fd82c10e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82affd640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd82c100a80 0x7fd82c10e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd82b7fe640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106a80 0x7fd82c10ee60 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fd82400eaa0 tx=0x7fd82400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:58.304 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd813fff640 1 -- 172.21.15.70:0/648893620 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd82400cdb0 con 0x7fd82c106a80 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd813fff640 1 -- 172.21.15.70:0/648893620 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd824005020 con 0x7fd82c106a80 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd8316bf640 1 -- 172.21.15.70:0/648893620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd82c1a6c00 con 0x7fd82c106a80 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd813fff640 1 -- 172.21.15.70:0/648893620 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd8240116b0 con 0x7fd82c106a80 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.284+0000 7fd8316bf640 1 -- 172.21.15.70:0/648893620 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd82c1a7110 con 0x7fd82c106a80 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.286+0000 7fd813fff640 1 -- 172.21.15.70:0/648893620 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd8240051d0 con 0x7fd82c106a80 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd833a98740 1 Processor -- start 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd833a98740 1 -- start start 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd833a98740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f17880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd833a98740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 0x562048f22140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd833a98740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 0x562048f24a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd833a98740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562048e7d2e0 con 0x562048f174a0 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd833a98740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562048e24ce0 con 0x562048f17dc0 2024-09-19T04:37:58.305 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd833a98740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562048e792a0 con 0x562048f22680 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd813fff640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8140a33b0 0x7fd8140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f17880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82b7fe640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8140a33b0 0x7fd8140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f17880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41118/0 (socket says 172.21.15.70:41118) 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82a7fc640 1 -- 172.21.15.70:0/3928061012 learned_addr learned my addr 172.21.15.70:0/3928061012 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82affd640 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 0x562048f22140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd813fff640 1 -- 172.21.15.70:0/648893620 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fd8240d0060 con 0x7fd82c106a80 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 0x562048f24a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82a7fc640 1 -- 172.21.15.70:0/3928061012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 msgr2=0x562048f24a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 0x562048f24a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82a7fc640 1 -- 172.21.15.70:0/3928061012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 msgr2=0x562048f22140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.287+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 0x562048f22140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.288+0000 7fd82a7fc640 1 -- 172.21.15.70:0/3928061012 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562048e09440 con 0x562048f174a0 2024-09-19T04:37:58.306 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.288+0000 7fd82b7fe640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8140a33b0 0x7fd8140a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8240cd860 tx=0x7fd82406e0c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.288+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f17880 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd820005c40 tx=0x7fd820005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb96c47f003ecfe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.288+0000 7fd8117fa640 1 -- 172.21.15.70:0/3928061012 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820044020 con 0x562048f174a0 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.288+0000 7fd8117fa640 1 -- 172.21.15.70:0/3928061012 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8200318b0 con 0x562048f174a0 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.288+0000 7fd8117fa640 1 -- 172.21.15.70:0/3928061012 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820035070 con 0x562048f174a0 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.288+0000 7fd833a98740 1 -- 172.21.15.70:0/3928061012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 msgr2=0x562048f17880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.288+0000 7fd833a98740 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f17880 secure :-1 s=READY pgs=982 cs=0 l=1 rev1=1 crypto rx=0x7fd820005c40 tx=0x7fd820005b50 comp rx=0 tx=0).stop 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 -- 172.21.15.70:0/3928061012 shutdown_connections 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 0x562048f24a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 0x562048f22140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 --2- 172.21.15.70:0/3928061012 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f17880 unknown :-1 s=CLOSED pgs=982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 -- 172.21.15.70:0/3928061012 >> 172.21.15.70:0/3928061012 conn(0x562048f13a30 msgr2=0x562048f13e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:58.307 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 -- 172.21.15.70:0/3928061012 shutdown_connections 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 -- 172.21.15.70:0/3928061012 wait complete. 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 -- start start 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 Processor -- start 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f174a0 0x562048f21f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f17dc0 0x562048f1f240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f22680 0x562048f1f780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x562048f25250 con 0x562048f17dc0 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562048e38050 con 0x562048f22680 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x562048f253d0 con 0x562048f174a0 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd833a98740 10 client.0 _ll_register_callbacks cb 0x562048e78160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd82affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f17dc0 0x562048f1f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.308 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd82affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f17dc0 0x562048f1f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41134/0 (socket says 172.21.15.70:41134) 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.289+0000 7fd82affd640 1 -- 172.21.15.70:0/325103212 learned_addr learned my addr 172.21.15.70:0/325103212 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f174a0 0x562048f21f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd82affd640 1 -- 172.21.15.70:0/325103212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f174a0 msgr2=0x562048f21f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd82affd640 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f174a0 0x562048f21f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd82affd640 1 -- 172.21.15.70:0/325103212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f22680 msgr2=0x562048f1f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd82affd640 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f22680 0x562048f1f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd82affd640 1 -- 172.21.15.70:0/325103212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562048bee3c0 con 0x562048f17dc0 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f174a0 0x562048f21f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd82affd640 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f17dc0 0x562048f1f240 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00bf30 tx=0x7fd81c0128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bcabaab2620cac5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd80eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd80eff5640 1 -- 172.21.15.70:0/325103212 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd81c0035f0 con 0x562048f17dc0 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd80eff5640 1 -- 172.21.15.70:0/325103212 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fd81c003790 con 0x562048f17dc0 2024-09-19T04:37:58.309 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd833a98740 1 -- 172.21.15.70:0/325103212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd8200318b0 con 0x562048f17dc0 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd80eff5640 1 -- 172.21.15.70:0/325103212 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd81c003990 con 0x562048f17dc0 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd833a98740 10 client.17196 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd833a98740 1 -- 172.21.15.70:0/325103212 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562048f30c30 con 0x562048f17dc0 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd80eff5640 1 -- 172.21.15.70:0/325103212 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd8200318b0 con 0x562048f17dc0 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.290+0000 7fd80eff5640 1 -- 172.21.15.70:0/325103212 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd81c019070 con 0x562048f17dc0 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd833a98740 10 client.17196 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd833a98740 10 client.17196 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd833a98740 20 client.17196 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd833a98740 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562048f32190 0x562048f345b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd833a98740 4 client.17196 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd833a98740 1 -- 172.21.15.70:0/325103212 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562048e8a850 con 0x562048f32190 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562048f32190 0x562048f345b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd80eff5640 10 client.17196 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:58.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.291+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562048f32190 0x562048f345b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c56e63de0f06d32d server_cookie=62a6d123e13f4c32 in_seq=0 out_seq=0 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.292+0000 7fd80eff5640 1 -- 172.21.15.70:0/325103212 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562048e8a850 con 0x562048f32190 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.292+0000 7fd80eff5640 10 client.17196 handle_command_reply: tid=0 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.292+0000 7fd833a98740 1 client.17196 shutdown 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 -- 172.21.15.70:0/325103212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f17dc0 msgr2=0x562048f1f240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f17dc0 0x562048f1f240 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7fd81c00bf30 tx=0x7fd81c0128e0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 -- 172.21.15.70:0/325103212 shutdown_connections 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562048f32190 0x562048f345b0 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f22680 0x562048f1f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f17dc0 0x562048f1f240 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd80eff5640 0 client.17196 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 --2- 172.21.15.70:0/325103212 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f174a0 0x562048f21f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 -- 172.21.15.70:0/325103212 >> 172.21.15.70:0/325103212 conn(0x562048f13a30 msgr2=0x562048f19760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:58.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 -- 172.21.15.70:0/325103212 shutdown_connections 2024-09-19T04:37:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 1 -- 172.21.15.70:0/325103212 wait complete. 2024-09-19T04:37:58.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.293+0000 7fd833a98740 20 client.17196 trim_cache size 0 max 16384 2024-09-19T04:37:58.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd833a98740 1 Processor -- start 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd833a98740 1 -- start start 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd833a98740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f2e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd833a98740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 0x562048f39e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd833a98740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 0x562048f3a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd833a98740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1b22d0 con 0x562048f174a0 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd833a98740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1afba0 con 0x562048f17dc0 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd833a98740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1ada10 con 0x562048f22680 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f2e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f2e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41144/0 (socket says 172.21.15.70:41144) 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 -- 172.21.15.70:0/1538174385 learned_addr learned my addr 172.21.15.70:0/1538174385 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:58.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 -- 172.21.15.70:0/1538174385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 msgr2=0x562048f3a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/1538174385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 0x562048f3a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 -- 172.21.15.70:0/1538174385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 msgr2=0x562048f39e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/1538174385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 0x562048f39e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 -- 172.21.15.70:0/1538174385 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562048f134d0 con 0x562048f174a0 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.310+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/1538174385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f2e4b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd820004650 tx=0x7fd820009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a720883a75200908 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd810ff9640 1 -- 172.21.15.70:0/1538174385 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820035070 con 0x562048f174a0 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd810ff9640 1 -- 172.21.15.70:0/1538174385 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd82004e030 con 0x562048f174a0 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd810ff9640 1 -- 172.21.15.70:0/1538174385 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820044040 con 0x562048f174a0 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 -- 172.21.15.70:0/1538174385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 msgr2=0x562048f2e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 --2- 172.21.15.70:0/1538174385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f2e4b0 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7fd820004650 tx=0x7fd820009260 comp rx=0 tx=0).stop 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 -- 172.21.15.70:0/1538174385 shutdown_connections 2024-09-19T04:37:58.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 --2- 172.21.15.70:0/1538174385 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f22680 0x562048f3a3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 --2- 172.21.15.70:0/1538174385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f17dc0 0x562048f39e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 --2- 172.21.15.70:0/1538174385 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f2e4b0 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 -- 172.21.15.70:0/1538174385 >> 172.21.15.70:0/1538174385 conn(0x562048f13a30 msgr2=0x562048f212c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 -- 172.21.15.70:0/1538174385 shutdown_connections 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.311+0000 7fd833a98740 1 -- 172.21.15.70:0/1538174385 wait complete. 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 1 -- start start 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 1 Processor -- start 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f265d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f17dc0 0x562048f26b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f22680 0x562048f27050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1ae060 con 0x562048f174a0 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1af4d0 con 0x562048f22680 2024-09-19T04:37:58.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd82c1ae730 con 0x562048f17dc0 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd833a98740 10 client.0 _ll_register_callbacks cb 0x7fd81c00bb40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f265d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41148/0 (socket says 172.21.15.70:41148) 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 -- 172.21.15.70:0/3131919238 learned_addr learned my addr 172.21.15.70:0/3131919238 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 -- 172.21.15.70:0/3131919238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f17dc0 msgr2=0x562048f26b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f17dc0 0x562048f26b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 -- 172.21.15.70:0/3131919238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f22680 msgr2=0x562048f27050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f22680 0x562048f27050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 -- 172.21.15.70:0/3131919238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562048f9c080 con 0x562048f174a0 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd82a7fc640 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f265d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd820005b90 tx=0x7fd820031de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17ebac9a83ae498 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:58.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.312+0000 7fd80eff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd80eff5640 1 -- 172.21.15.70:0/3131919238 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd820057020 con 0x562048f174a0 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd80eff5640 1 -- 172.21.15.70:0/3131919238 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fd820049650 con 0x562048f174a0 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 1 -- 172.21.15.70:0/3131919238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd82004e030 con 0x562048f174a0 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd80eff5640 1 -- 172.21.15.70:0/3131919238 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd820044040 con 0x562048f174a0 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 10 client.17202 fetch_fsmap learned FSMap version 34 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 1 -- 172.21.15.70:0/3131919238 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562048f9d370 con 0x562048f174a0 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd80eff5640 1 -- 172.21.15.70:0/3131919238 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd82004e030 con 0x562048f174a0 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd80eff5640 1 -- 172.21.15.70:0/3131919238 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd820053c50 con 0x562048f174a0 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 10 client.17202 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 10 client.17202 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 20 client.17202 populate_metadata read hostname 'smithi070' 2024-09-19T04:37:58.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562048f9d590 0x562048f9f980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 4 client.17202 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd833a98740 1 -- 172.21.15.70:0/3131919238 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x562048e84d60 con 0x562048f9d590 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.313+0000 7fd82affd640 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562048f9d590 0x562048f9f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd80eff5640 10 client.17202 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd82affd640 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562048f9d590 0x562048f9f980 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff3446cf055c7e65 server_cookie=c0a17dc3520c7972 in_seq=0 out_seq=0 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd80eff5640 1 -- 172.21.15.70:0/3131919238 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x562048e84d60 con 0x562048f9d590 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd80eff5640 10 client.17202 handle_command_reply: tid=0 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 client.17202 shutdown 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 -- 172.21.15.70:0/3131919238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 msgr2=0x562048f265d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f265d0 secure :-1 s=READY pgs=985 cs=0 l=1 rev1=1 crypto rx=0x7fd820005b90 tx=0x7fd820031de0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 -- 172.21.15.70:0/3131919238 shutdown_connections 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562048f9d590 0x562048f9f980 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x562048f22680 0x562048f27050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.322 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd80eff5640 0 client.17202 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x562048f17dc0 0x562048f26b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 --2- 172.21.15.70:0/3131919238 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x562048f174a0 0x562048f265d0 unknown :-1 s=CLOSED pgs=985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.314+0000 7fd833a98740 1 -- 172.21.15.70:0/3131919238 >> 172.21.15.70:0/3131919238 conn(0x562048f13a30 msgr2=0x562048f122e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd833a98740 1 -- 172.21.15.70:0/3131919238 shutdown_connections 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd833a98740 1 -- 172.21.15.70:0/3131919238 wait complete. 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd833a98740 20 client.17202 trim_cache size 0 max 16384 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:37:58.323 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 -- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8140a33b0 msgr2=0x7fd8140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8140a33b0 0x7fd8140a5870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd8240cd860 tx=0x7fd82406e0c0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 -- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106a80 msgr2=0x7fd82c10ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106a80 0x7fd82c10ee60 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7fd82400eaa0 tx=0x7fd82400ef60 comp rx=0 tx=0).stop 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 -- 172.21.15.70:0/648893620 shutdown_connections 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd8140a33b0 0x7fd8140a5870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd82c106a80 0x7fd82c10ee60 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd82c101420 0x7fd82c10e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.324 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 --2- 172.21.15.70:0/648893620 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd82c100a80 0x7fd82c10e3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 -- 172.21.15.70:0/648893620 >> 172.21.15.70:0/648893620 conn(0x7fd82c0fc7a0 msgr2=0x7fd82c0fcfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 -- 172.21.15.70:0/648893620 shutdown_connections 2024-09-19T04:37:58.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:58.315+0000 7fd8316bf640 1 -- 172.21.15.70:0/648893620 wait complete. 2024-09-19T04:37:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:37:58 smithi070 ceph-mon[30942]: pgmap v221: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:37:58 smithi134 ceph-mon[34525]: pgmap v221: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:59.093 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:37:59.094 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:37:59.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:37:58 smithi167 ceph-mon[34339]: pgmap v221: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:37:59.337 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:37:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 -- 172.21.15.70:0/2059969581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102570 msgr2=0x7fed541029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 --2- 172.21.15.70:0/2059969581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102570 0x7fed541029b0 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7fed48009900 tx=0x7fed4802a480 comp rx=0 tx=0).stop 2024-09-19T04:37:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 -- 172.21.15.70:0/2059969581 shutdown_connections 2024-09-19T04:37:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 --2- 172.21.15.70:0/2059969581 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54102ef0 0x7fed5410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 --2- 172.21.15.70:0/2059969581 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102570 0x7fed541029b0 unknown :-1 s=CLOSED pgs=986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 --2- 172.21.15.70:0/2059969581 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54100e20 0x7fed54101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 -- 172.21.15.70:0/2059969581 >> 172.21.15.70:0/2059969581 conn(0x7fed540fc7d0 msgr2=0x7fed540febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:37:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 -- 172.21.15.70:0/2059969581 shutdown_connections 2024-09-19T04:37:59.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 -- 172.21.15.70:0/2059969581 wait complete. 2024-09-19T04:37:59.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.846+0000 7fed59ee0640 1 Processor -- start 2024-09-19T04:37:59.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed59ee0640 1 -- start start 2024-09-19T04:37:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed59ee0640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54100e20 0x7fed540fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed59ee0640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54102570 0x7fed540fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed59ee0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102ef0 0x7fed540fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed59ee0640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fed54110f50 con 0x7fed54102ef0 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed59ee0640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fed54110dd0 con 0x7fed54100e20 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed59ee0640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fed541110d0 con 0x7fed54102570 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102ef0 0x7fed540fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed53fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102ef0 0x7fed540fd700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41164/0 (socket says 172.21.15.70:41164) 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed53fff640 1 -- 172.21.15.70:0/1496058735 learned_addr learned my addr 172.21.15.70:0/1496058735 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed52ffd640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54102570 0x7fed540fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed537fe640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54100e20 0x7fed540fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed53fff640 1 -- 172.21.15.70:0/1496058735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54102570 msgr2=0x7fed540fd1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed53fff640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54102570 0x7fed540fd1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed53fff640 1 -- 172.21.15.70:0/1496058735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54100e20 msgr2=0x7fed540fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed53fff640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54100e20 0x7fed540fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.847+0000 7fed53fff640 1 -- 172.21.15.70:0/1496058735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed541a6a40 con 0x7fed54102ef0 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.848+0000 7fed53fff640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102ef0 0x7fed540fd700 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00cad0 tx=0x7fed4c00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.848+0000 7fed50ff9640 1 -- 172.21.15.70:0/1496058735 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00ae20 con 0x7fed54102ef0 2024-09-19T04:37:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.848+0000 7fed50ff9640 1 -- 172.21.15.70:0/1496058735 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fed4c005020 con 0x7fed54102ef0 2024-09-19T04:37:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.848+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed541a6d30 con 0x7fed54102ef0 2024-09-19T04:37:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.848+0000 7fed50ff9640 1 -- 172.21.15.70:0/1496058735 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed4c00f690 con 0x7fed54102ef0 2024-09-19T04:37:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.848+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed541a7270 con 0x7fed54102ef0 2024-09-19T04:37:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.849+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed54101200 con 0x7fed54102ef0 2024-09-19T04:37:59.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.850+0000 7fed50ff9640 1 -- 172.21.15.70:0/1496058735 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fed4c0051d0 con 0x7fed54102ef0 2024-09-19T04:37:59.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.850+0000 7fed50ff9640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fed3c0a33b0 0x7fed3c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:37:59.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.851+0000 7fed50ff9640 1 -- 172.21.15.70:0/1496058735 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fed4c0cfd90 con 0x7fed54102ef0 2024-09-19T04:37:59.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.851+0000 7fed537fe640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fed3c0a33b0 0x7fed3c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:37:59.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.851+0000 7fed537fe640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fed3c0a33b0 0x7fed3c0a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed44005fd0 tx=0x7fed4400b590 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:37:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:37:59.855+0000 7fed50ff9640 1 -- 172.21.15.70:0/1496058735 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fed4c014030 con 0x7fed54102ef0 2024-09-19T04:38:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.058+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fed5410a0a0 con 0x7fed54102ef0 2024-09-19T04:38:00.060 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.058+0000 7fed50ff9640 1 -- 172.21.15.70:0/1496058735 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7fed4c09c770 con 0x7fed54102ef0 2024-09-19T04:38:00.060 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:38:00.060 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:38:00.061 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:38:00.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fed3c0a33b0 msgr2=0x7fed3c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:00.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fed3c0a33b0 0x7fed3c0a5870 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fed44005fd0 tx=0x7fed4400b590 comp rx=0 tx=0).stop 2024-09-19T04:38:00.062 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102ef0 msgr2=0x7fed540fd700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102ef0 0x7fed540fd700 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7fed4c00cad0 tx=0x7fed4c00cf90 comp rx=0 tx=0).stop 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 shutdown_connections 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fed3c0a33b0 0x7fed3c0a5870 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fed54102ef0 0x7fed540fd700 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fed54102570 0x7fed540fd1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 --2- 172.21.15.70:0/1496058735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fed54100e20 0x7fed540fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 >> 172.21.15.70:0/1496058735 conn(0x7fed540fc7d0 msgr2=0x7fed5406a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 shutdown_connections 2024-09-19T04:38:00.063 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:00.061+0000 7fed59ee0640 1 -- 172.21.15.70:0/1496058735 wait complete. 2024-09-19T04:38:00.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:00 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1496058735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:00.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:00 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1496058735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:00.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:00 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1496058735' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:00.751 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:38:00.996 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:01.394 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:01 smithi070 ceph-mon[30942]: pgmap v222: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:01.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:01 smithi167 ceph-mon[34339]: pgmap v222: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:01.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 -- 172.21.15.70:0/3986512711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8103660 msgr2=0x7f0cf810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/3986512711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8103660 0x7f0cf810bb50 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009900 tx=0x7f0ce802a480 comp rx=0 tx=0).stop 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 -- 172.21.15.70:0/3986512711 shutdown_connections 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/3986512711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf810c170 0x7f0cf810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/3986512711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8103660 0x7f0cf810bb50 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/3986512711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cf8102d40 0x7f0cf8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 -- 172.21.15.70:0/3986512711 >> 172.21.15.70:0/3986512711 conn(0x7f0cf80fc7a0 msgr2=0x7f0cf80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 -- 172.21.15.70:0/3986512711 shutdown_connections 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.473+0000 7f0cfcd32640 1 -- 172.21.15.70:0/3986512711 wait complete. 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cfcd32640 1 Processor -- start 2024-09-19T04:38:01.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cfcd32640 1 -- start start 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cfcd32640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8102d40 0x7f0cf8198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cfcd32640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf8103660 0x7f0cf81989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cfcd32640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cf810c170 0x7f0cf819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cfcd32640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8111f40 con 0x7f0cf8102d40 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cfcd32640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf8111dc0 con 0x7f0cf810c170 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cfcd32640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81120c0 con 0x7f0cf8103660 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cf659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8102d40 0x7f0cf8198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cf659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8102d40 0x7f0cf8198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41186/0 (socket says 172.21.15.70:41186) 2024-09-19T04:38:01.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cf659c640 1 -- 172.21.15.70:0/2401083950 learned_addr learned my addr 172.21.15.70:0/2401083950 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.474+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf8103660 0x7f0cf81989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cf810c170 0x7f0cf819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cf659c640 1 -- 172.21.15.70:0/2401083950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf8103660 msgr2=0x7f0cf81989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cf659c640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf8103660 0x7f0cf81989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cf659c640 1 -- 172.21.15.70:0/2401083950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cf810c170 msgr2=0x7f0cf819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cf659c640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cf810c170 0x7f0cf819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cf659c640 1 -- 172.21.15.70:0/2401083950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cf819d410 con 0x7f0cf8102d40 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cf810c170 0x7f0cf819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cf659c640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8102d40 0x7f0cf8198460 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000c890 tx=0x7f0ce000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cef7fe640 1 -- 172.21.15.70:0/2401083950 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0004220 con 0x7f0cf8102d40 2024-09-19T04:38:01.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cfcd32640 1 -- 172.21.15.70:0/2401083950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cf819d700 con 0x7f0cf8102d40 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cef7fe640 1 -- 172.21.15.70:0/2401083950 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0ce00043c0 con 0x7f0cf8102d40 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cef7fe640 1 -- 172.21.15.70:0/2401083950 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce0004a00 con 0x7f0cf8102d40 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.475+0000 7f0cfcd32640 1 -- 172.21.15.70:0/2401083950 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cf81a4fe0 con 0x7f0cf8102d40 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.477+0000 7f0cef7fe640 1 -- 172.21.15.70:0/2401083950 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0ce0004ba0 con 0x7f0cf8102d40 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.477+0000 7f0cff10b740 1 Processor -- start 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cff10b740 1 -- start start 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a0c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a0ca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a17370 0x55cdf4a19760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cff10b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cdf49722f0 con 0x55cdf4a0db40 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cff10b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cdf4919cf0 con 0x55cdf4a0c5d0 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cff10b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cdf496e2b0 con 0x55cdf4a17370 2024-09-19T04:38:01.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a0c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a0c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41192/0 (socket says 172.21.15.70:41192) 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 -- 172.21.15.70:0/630016352 learned_addr learned my addr 172.21.15.70:0/630016352 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cef7fe640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ce40a33b0 0x7f0ce40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a17370 0x55cdf4a19760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf659c640 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a0ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 -- 172.21.15.70:0/630016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a17370 msgr2=0x55cdf4a19760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a17370 0x55cdf4a19760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 -- 172.21.15.70:0/630016352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 msgr2=0x55cdf4a0ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a0ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 -- 172.21.15.70:0/630016352 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf48fe3a0 con 0x55cdf4a0db40 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a17370 0x55cdf4a19760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf659c640 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a0ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.478+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ce40a33b0 0x7f0ce40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.479+0000 7f0cef7fe640 1 -- 172.21.15.70:0/2401083950 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f0ce00cfa70 con 0x7f0cf8102d40 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.479+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a0c090 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0008ed0 tx=0x7f0cf000d710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ceee1111a3cb86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.479+0000 7f0cecff9640 1 -- 172.21.15.70:0/630016352 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0011e60 con 0x55cdf4a0db40 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.479+0000 7f0cecff9640 1 -- 172.21.15.70:0/630016352 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0cf001adb0 con 0x55cdf4a0db40 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.479+0000 7f0cecff9640 1 -- 172.21.15.70:0/630016352 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0019bd0 con 0x55cdf4a0db40 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.479+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ce40a33b0 0x7f0ce40a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0cf001e000 tx=0x7f0cf001f000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- 172.21.15.70:0/630016352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 msgr2=0x55cdf4a0c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a0c090 secure :-1 s=READY pgs=990 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0008ed0 tx=0x7f0cf000d710 comp rx=0 tx=0).stop 2024-09-19T04:38:01.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- 172.21.15.70:0/630016352 shutdown_connections 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a17370 0x55cdf4a19760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a0ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 --2- 172.21.15.70:0/630016352 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a0c090 unknown :-1 s=CLOSED pgs=990 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- 172.21.15.70:0/630016352 >> 172.21.15.70:0/630016352 conn(0x55cdf49d5310 msgr2=0x55cdf4a08c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- 172.21.15.70:0/630016352 shutdown_connections 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- 172.21.15.70:0/630016352 wait complete. 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- start start 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 Processor -- start 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a16d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a13ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a17370 0x55cdf4a145e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55cdf4a1a070 con 0x55cdf4a17370 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55cdf492d060 con 0x55cdf4a0c5d0 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55cdf4a1a1f0 con 0x55cdf4a0db40 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cff10b740 10 client.0 _ll_register_callbacks cb 0x55cdf46808c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a17370 0x55cdf4a145e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cf6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a17370 0x55cdf4a145e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41204/0 (socket says 172.21.15.70:41204) 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.480+0000 7f0cf6d9d640 1 -- 172.21.15.70:0/3952769155 learned_addr learned my addr 172.21.15.70:0/3952769155 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cf659c640 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a16d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a13ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cf6d9d640 1 -- 172.21.15.70:0/3952769155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 msgr2=0x55cdf4a13ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a13ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cf6d9d640 1 -- 172.21.15.70:0/3952769155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 msgr2=0x55cdf4a16d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:01.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a16d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cf6d9d640 1 -- 172.21.15.70:0/3952769155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdf46e33c0 con 0x55cdf4a17370 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a17370 0x55cdf4a145e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0019c00 tx=0x7f0cf0019c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a619b3e5aa7f2868 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cddffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cddffb640 1 -- 172.21.15.70:0/3952769155 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0cf0011e60 con 0x55cdf4a17370 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cddffb640 1 -- 172.21.15.70:0/3952769155 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f0cf0020070 con 0x55cdf4a17370 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cff10b740 1 -- 172.21.15.70:0/3952769155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0cf001adb0 con 0x55cdf4a17370 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cddffb640 1 -- 172.21.15.70:0/3952769155 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0cf001aa70 con 0x55cdf4a17370 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cff10b740 10 client.17220 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.481+0000 7f0cff10b740 1 -- 172.21.15.70:0/3952769155 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cdf4a25a50 con 0x55cdf4a17370 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cddffb640 1 -- 172.21.15.70:0/3952769155 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0cf001adb0 con 0x55cdf4a17370 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cddffb640 1 -- 172.21.15.70:0/3952769155 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0cf0024a70 con 0x55cdf4a17370 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cff10b740 10 client.17220 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cff10b740 10 client.17220 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:01.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cff10b740 20 client.17220 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cff10b740 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55cdf4a26f10 0x55cdf4a29300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cff10b740 4 client.17220 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cff10b740 1 -- 172.21.15.70:0/3952769155 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cdf497f860 con 0x55cdf4a26f10 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cf659c640 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55cdf4a26f10 0x55cdf4a29300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cddffb640 10 client.17220 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.482+0000 7f0cf659c640 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55cdf4a26f10 0x55cdf4a29300 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=26bd0657ece38879 server_cookie=d6e96ca61215c6eb in_seq=0 out_seq=0 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cddffb640 1 -- 172.21.15.70:0/3952769155 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55cdf497f860 con 0x55cdf4a26f10 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cddffb640 10 client.17220 handle_command_reply: tid=0 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 client.17220 shutdown 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 -- 172.21.15.70:0/3952769155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a17370 msgr2=0x55cdf4a145e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a17370 0x55cdf4a145e0 secure :-1 s=READY pgs=991 cs=0 l=1 rev1=1 crypto rx=0x7f0cf0019c00 tx=0x7f0cf0019c30 comp rx=0 tx=0).stop 2024-09-19T04:38:01.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 -- 172.21.15.70:0/3952769155 shutdown_connections 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55cdf4a26f10 0x55cdf4a29300 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a17370 0x55cdf4a145e0 unknown :-1 s=CLOSED pgs=991 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a13ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 --2- 172.21.15.70:0/3952769155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a16d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cff10b740 1 -- 172.21.15.70:0/3952769155 >> 172.21.15.70:0/3952769155 conn(0x55cdf49d5310 msgr2=0x55cdf4a0e960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.483+0000 7f0cddffb640 0 client.17220 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.484+0000 7f0cff10b740 1 -- 172.21.15.70:0/3952769155 shutdown_connections 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.484+0000 7f0cff10b740 1 -- 172.21.15.70:0/3952769155 wait complete. 2024-09-19T04:38:01.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.484+0000 7f0cff10b740 20 client.17220 trim_cache size 0 max 16384 2024-09-19T04:38:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.496+0000 7f0cff10b740 1 Processor -- start 2024-09-19T04:38:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.496+0000 7f0cff10b740 1 -- start start 2024-09-19T04:38:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.496+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a23310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.496+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a12fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.496+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a0f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cff10b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81b01c0 con 0x55cdf4a0c5d0 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cff10b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81ada90 con 0x55cdf4a17370 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cff10b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81ab900 con 0x55cdf4a0db40 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a23310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a23310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41206/0 (socket says 172.21.15.70:41206) 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 -- 172.21.15.70:0/672395863 learned_addr learned my addr 172.21.15.70:0/672395863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a0f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a12fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 -- 172.21.15.70:0/672395863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 msgr2=0x55cdf4a12fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:01.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a12fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 -- 172.21.15.70:0/672395863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 msgr2=0x55cdf4a0f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a0f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 -- 172.21.15.70:0/672395863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cdf4a08ed0 con 0x55cdf4a0c5d0 2024-09-19T04:38:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a0f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a12fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cf659c640 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a23310 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0ce009bce0 tx=0x7f0ce00c6b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aebec532223859 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cdffff640 1 -- 172.21.15.70:0/672395863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce001d040 con 0x55cdf4a0c5d0 2024-09-19T04:38:01.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cdffff640 1 -- 172.21.15.70:0/672395863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0ce00a0100 con 0x55cdf4a0c5d0 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.497+0000 7f0cdffff640 1 -- 172.21.15.70:0/672395863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce00983c0 con 0x55cdf4a0c5d0 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 -- 172.21.15.70:0/672395863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0c5d0 msgr2=0x55cdf4a23310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a23310 secure :-1 s=READY pgs=992 cs=0 l=1 rev1=1 crypto rx=0x7f0ce009bce0 tx=0x7f0ce00c6b20 comp rx=0 tx=0).stop 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 -- 172.21.15.70:0/672395863 shutdown_connections 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a0f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0db40 0x55cdf4a12fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 --2- 172.21.15.70:0/672395863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a23310 unknown :-1 s=CLOSED pgs=992 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 -- 172.21.15.70:0/672395863 >> 172.21.15.70:0/672395863 conn(0x55cdf49d5310 msgr2=0x55cdf4a128c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 -- 172.21.15.70:0/672395863 shutdown_connections 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 -- 172.21.15.70:0/672395863 wait complete. 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.498+0000 7f0cff10b740 1 -- start start 2024-09-19T04:38:01.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cff10b740 1 Processor -- start 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a1aa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a1af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cff10b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a8f920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cff10b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81abf50 con 0x55cdf4a0db40 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cff10b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81ad3c0 con 0x55cdf4a17370 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cff10b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0cf81ac620 con 0x55cdf4a0c5d0 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cff10b740 10 client.0 _ll_register_callbacks cb 0x7f0cf001d020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a1af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a1af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41208/0 (socket says 172.21.15.70:41208) 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf5d9b640 1 -- 172.21.15.70:0/844098262 learned_addr learned my addr 172.21.15.70:0/844098262 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf659c640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a1aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a8f920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf5d9b640 1 -- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0c5d0 msgr2=0x55cdf4a1aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a1aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf5d9b640 1 -- 172.21.15.70:0/844098262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 msgr2=0x55cdf4a8f920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a8f920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf5d9b640 1 -- 172.21.15.70:0/844098262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cdf4a8fe90 con 0x55cdf4a0db40 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf659c640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a1aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.499+0000 7f0cf6d9d640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a8f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cf5d9b640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a1af70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009900 tx=0x7f0ce8031740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3920d8f55285155d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cddffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cddffb640 1 -- 172.21.15.70:0/844098262 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ce8035040 con 0x55cdf4a0db40 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cddffb640 1 -- 172.21.15.70:0/844098262 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7f0ce8004240 con 0x55cdf4a0db40 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 1 -- 172.21.15.70:0/844098262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0ce00a0100 con 0x55cdf4a0db40 2024-09-19T04:38:01.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cddffb640 1 -- 172.21.15.70:0/844098262 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0ce8004440 con 0x55cdf4a0db40 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 10 client.17226 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 1 -- 172.21.15.70:0/844098262 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55cdf4a95520 con 0x55cdf4a0db40 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cddffb640 1 -- 172.21.15.70:0/844098262 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0ce00a0100 con 0x55cdf4a0db40 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cddffb640 1 -- 172.21.15.70:0/844098262 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0ce80035f0 con 0x55cdf4a0db40 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 10 client.17226 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 10 client.17226 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 20 client.17226 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55cdf4a95cd0 0x55cdf4a980f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:01.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 4 client.17226 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.500+0000 7f0cff10b740 1 -- 172.21.15.70:0/844098262 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55cdf4979d70 con 0x55cdf4a95cd0 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cf659c640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55cdf4a95cd0 0x55cdf4a980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cf659c640 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55cdf4a95cd0 0x55cdf4a980f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a3097cc2fba459a server_cookie=718076608bb75610 in_seq=0 out_seq=0 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cddffb640 10 client.17226 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cddffb640 1 -- 172.21.15.70:0/844098262 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55cdf4979d70 con 0x55cdf4a95cd0 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cddffb640 10 client.17226 handle_command_reply: tid=0 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 client.17226 shutdown 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 -- 172.21.15.70:0/844098262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 msgr2=0x55cdf4a1af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a1af70 secure :-1 s=READY pgs=993 cs=0 l=1 rev1=1 crypto rx=0x7f0ce8009900 tx=0x7f0ce8031740 comp rx=0 tx=0).stop 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 -- 172.21.15.70:0/844098262 shutdown_connections 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55cdf4a95cd0 0x55cdf4a980f0 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55cdf4a17370 0x55cdf4a8f920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55cdf4a0db40 0x55cdf4a1af70 unknown :-1 s=CLOSED pgs=993 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cddffb640 0 client.17226 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 --2- 172.21.15.70:0/844098262 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55cdf4a0c5d0 0x55cdf4a1aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 -- 172.21.15.70:0/844098262 >> 172.21.15.70:0/844098262 conn(0x55cdf49d5310 msgr2=0x55cdf4a130e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 -- 172.21.15.70:0/844098262 shutdown_connections 2024-09-19T04:38:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.501+0000 7f0cff10b740 1 -- 172.21.15.70:0/844098262 wait complete. 2024-09-19T04:38:01.519 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cff10b740 20 client.17226 trim_cache size 0 max 16384 2024-09-19T04:38:01.519 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:01.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 -- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ce40a33b0 msgr2=0x7f0ce40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ce40a33b0 0x7f0ce40a5870 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f0cf001e000 tx=0x7f0cf001f000 comp rx=0 tx=0).stop 2024-09-19T04:38:01.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 -- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8102d40 msgr2=0x7f0cf8198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8102d40 0x7f0cf8198460 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7f0ce000c890 tx=0x7f0ce000cd50 comp rx=0 tx=0).stop 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 -- 172.21.15.70:0/2401083950 shutdown_connections 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ce40a33b0 0x7f0ce40a5870 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0cf810c170 0x7f0cf819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0cf8103660 0x7f0cf81989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 --2- 172.21.15.70:0/2401083950 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0cf8102d40 0x7f0cf8198460 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 -- 172.21.15.70:0/2401083950 >> 172.21.15.70:0/2401083950 conn(0x7f0cf80fc7a0 msgr2=0x7f0cf80fd4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 -- 172.21.15.70:0/2401083950 shutdown_connections 2024-09-19T04:38:01.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:01.502+0000 7f0cfcd32640 1 -- 172.21.15.70:0/2401083950 wait complete. 2024-09-19T04:38:01.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:01 smithi134 ceph-mon[34525]: pgmap v222: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:02.336 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:38:02.583 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:02.969 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:02 smithi070 ceph-mon[30942]: pgmap v223: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:38:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:02 smithi134 ceph-mon[34525]: pgmap v223: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:38:03.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 -- 172.21.15.70:0/4069871483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830100a80 msgr2=0x7fa830100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 --2- 172.21.15.70:0/4069871483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830100a80 0x7fa830100ee0 secure :-1 s=READY pgs=994 cs=0 l=1 rev1=1 crypto rx=0x7fa824009930 tx=0x7fa82402a420 comp rx=0 tx=0).stop 2024-09-19T04:38:03.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 -- 172.21.15.70:0/4069871483 shutdown_connections 2024-09-19T04:38:03.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 --2- 172.21.15.70:0/4069871483 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830101420 0x7fa83010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 --2- 172.21.15.70:0/4069871483 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830100a80 0x7fa830100ee0 unknown :-1 s=CLOSED pgs=994 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 --2- 172.21.15.70:0/4069871483 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa830106a80 0x7fa830106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 -- 172.21.15.70:0/4069871483 >> 172.21.15.70:0/4069871483 conn(0x7fa8300fc7a0 msgr2=0x7fa8300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 -- 172.21.15.70:0/4069871483 shutdown_connections 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.050+0000 7fa838475640 1 -- 172.21.15.70:0/4069871483 wait complete. 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa838475640 1 Processor -- start 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa838475640 1 -- start start 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa838475640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa830100a80 0x7fa830198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa838475640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830101420 0x7fa8301989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa838475640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830106a80 0x7fa83019cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa838475640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa830110e50 con 0x7fa830106a80 2024-09-19T04:38:03.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa838475640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa830110cd0 con 0x7fa830101420 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa838475640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa830110fd0 con 0x7fa830100a80 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836a12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830106a80 0x7fa83019cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836a12640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830106a80 0x7fa83019cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41236/0 (socket says 172.21.15.70:41236) 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836211640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa830100a80 0x7fa830198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836a12640 1 -- 172.21.15.70:0/2394245713 learned_addr learned my addr 172.21.15.70:0/2394245713 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa835a10640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830101420 0x7fa8301989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836a12640 1 -- 172.21.15.70:0/2394245713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa830100a80 msgr2=0x7fa830198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836a12640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa830100a80 0x7fa830198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836a12640 1 -- 172.21.15.70:0/2394245713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830101420 msgr2=0x7fa8301989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836a12640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830101420 0x7fa8301989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa836a12640 1 -- 172.21.15.70:0/2394245713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa83019d440 con 0x7fa830106a80 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.051+0000 7fa835a10640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830101420 0x7fa8301989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.052+0000 7fa836a12640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830106a80 0x7fa83019cd60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa82800cad0 tx=0x7fa82800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.052+0000 7fa8237fe640 1 -- 172.21.15.70:0/2394245713 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82800ae20 con 0x7fa830106a80 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.052+0000 7fa8237fe640 1 -- 172.21.15.70:0/2394245713 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa828005020 con 0x7fa830106a80 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.052+0000 7fa838475640 1 -- 172.21.15.70:0/2394245713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa83019d730 con 0x7fa830106a80 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.052+0000 7fa8237fe640 1 -- 172.21.15.70:0/2394245713 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82800f690 con 0x7fa830106a80 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.052+0000 7fa838475640 1 -- 172.21.15.70:0/2394245713 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8301a5010 con 0x7fa830106a80 2024-09-19T04:38:03.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.054+0000 7fa8237fe640 1 -- 172.21.15.70:0/2394245713 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa8280051d0 con 0x7fa830106a80 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.054+0000 7fa83a84e740 1 Processor -- start 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.054+0000 7fa83a84e740 1 -- start start 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d3227090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3227a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d3234760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa83a84e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5627d318d2f0 con 0x5627d32275d0 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa83a84e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5627d3134cf0 con 0x5627d3228b40 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa83a84e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5627d31892b0 con 0x5627d3232370 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3227a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3227a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41252/0 (socket says 172.21.15.70:41252) 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 -- 172.21.15.70:0/450020540 learned_addr learned my addr 172.21.15.70:0/450020540 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa8237fe640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa81c0a33b0 0x7fa81c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa835a10640 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d3227090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa835a10640 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d3234760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836a12640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa81c0a33b0 0x7fa81c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 -- 172.21.15.70:0/450020540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 msgr2=0x5627d3234760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d3234760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 -- 172.21.15.70:0/450020540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 msgr2=0x5627d3227090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d3227090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 -- 172.21.15.70:0/450020540 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627d31193a0 con 0x5627d32275d0 2024-09-19T04:38:03.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa8237fe640 1 -- 172.21.15.70:0/2394245713 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fa8280cfdd0 con 0x7fa830106a80 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.055+0000 7fa836211640 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3227a10 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00b710 tx=0x7fa82c004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=354413ba3bc6dd59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa836a12640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa81c0a33b0 0x7fa81c0a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa82800caa0 tx=0x7fa82806eee0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa820dea640 1 -- 172.21.15.70:0/450020540 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c003b50 con 0x5627d32275d0 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa820dea640 1 -- 172.21.15.70:0/450020540 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa82c015070 con 0x5627d32275d0 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa820dea640 1 -- 172.21.15.70:0/450020540 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa82c004d30 con 0x5627d32275d0 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 -- 172.21.15.70:0/450020540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 msgr2=0x5627d3227a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3227a10 secure :-1 s=READY pgs=996 cs=0 l=1 rev1=1 crypto rx=0x7fa82c00b710 tx=0x7fa82c004610 comp rx=0 tx=0).stop 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 -- 172.21.15.70:0/450020540 shutdown_connections 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d3234760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3227a10 unknown :-1 s=CLOSED pgs=996 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 --2- 172.21.15.70:0/450020540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d3227090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 -- 172.21.15.70:0/450020540 >> 172.21.15.70:0/450020540 conn(0x5627d31f0310 msgr2=0x5627d3223c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 -- 172.21.15.70:0/450020540 shutdown_connections 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.056+0000 7fa83a84e740 1 -- 172.21.15.70:0/450020540 wait complete. 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 1 -- start start 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 1 Processor -- start 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d32275d0 0x5627d3231d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d322eff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d3232370 0x5627d322f5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5627d3235070 con 0x5627d3232370 2024-09-19T04:38:03.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5627d3148060 con 0x5627d3228b40 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5627d32351f0 con 0x5627d32275d0 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa83a84e740 10 client.0 _ll_register_callbacks cb 0x5627d2e9b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d3232370 0x5627d322f5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d3232370 0x5627d322f5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41256/0 (socket says 172.21.15.70:41256) 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 -- 172.21.15.70:0/1834524144 learned_addr learned my addr 172.21.15.70:0/1834524144 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d32275d0 0x5627d3231d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 -- 172.21.15.70:0/1834524144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d32275d0 msgr2=0x5627d3231d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d32275d0 0x5627d3231d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 -- 172.21.15.70:0/1834524144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 msgr2=0x5627d322eff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:03.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d322eff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.057+0000 7fa835a10640 1 -- 172.21.15.70:0/1834524144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627d2efe3c0 con 0x5627d3232370 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa835a10640 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d3232370 0x5627d322f5e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa83006b7e0 tx=0x7fa824040040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aa9c79af63956fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa819ffb640 1 -- 172.21.15.70:0/1834524144 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824035030 con 0x5627d3232370 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa819ffb640 1 -- 172.21.15.70:0/1834524144 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fa824004260 con 0x5627d3232370 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 1 -- 172.21.15.70:0/1834524144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa82c015070 con 0x5627d3232370 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa819ffb640 1 -- 172.21.15.70:0/1834524144 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa824004460 con 0x5627d3232370 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 10 client.17238 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 1 -- 172.21.15.70:0/1834524144 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5627d3240ae0 con 0x5627d3232370 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa819ffb640 1 -- 172.21.15.70:0/1834524144 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa82c015070 con 0x5627d3232370 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa819ffb640 1 -- 172.21.15.70:0/1834524144 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa82403a040 con 0x5627d3232370 2024-09-19T04:38:03.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 10 client.17238 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 10 client.17238 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 20 client.17238 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5627d3241fa0 0x5627d3244410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 4 client.17238 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.058+0000 7fa83a84e740 1 -- 172.21.15.70:0/1834524144 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5627d319a860 con 0x5627d3241fa0 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.059+0000 7fa836211640 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5627d3241fa0 0x5627d3244410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.059+0000 7fa836211640 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5627d3241fa0 0x5627d3244410 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=773eb1fb0d34a61d server_cookie=147b9f1b2e27671d in_seq=0 out_seq=0 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.059+0000 7fa819ffb640 10 client.17238 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:03.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa819ffb640 1 -- 172.21.15.70:0/1834524144 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5627d319a860 con 0x5627d3241fa0 2024-09-19T04:38:03.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa819ffb640 10 client.17238 handle_command_reply: tid=0 2024-09-19T04:38:03.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 client.17238 shutdown 2024-09-19T04:38:03.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 -- 172.21.15.70:0/1834524144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d3232370 msgr2=0x5627d322f5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d3232370 0x5627d322f5e0 secure :-1 s=READY pgs=997 cs=0 l=1 rev1=1 crypto rx=0x7fa83006b7e0 tx=0x7fa824040040 comp rx=0 tx=0).stop 2024-09-19T04:38:03.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 -- 172.21.15.70:0/1834524144 shutdown_connections 2024-09-19T04:38:03.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5627d3241fa0 0x5627d3244410 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d3232370 0x5627d322f5e0 unknown :-1 s=CLOSED pgs=997 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d322eff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa819ffb640 0 client.17238 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:03.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 --2- 172.21.15.70:0/1834524144 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d32275d0 0x5627d3231d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 -- 172.21.15.70:0/1834524144 >> 172.21.15.70:0/1834524144 conn(0x5627d31f0310 msgr2=0x5627d3229930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:03.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 -- 172.21.15.70:0/1834524144 shutdown_connections 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 1 -- 172.21.15.70:0/1834524144 wait complete. 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.060+0000 7fa83a84e740 20 client.17238 trim_cache size 0 max 16384 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa83a84e740 1 Processor -- start 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa83a84e740 1 -- start start 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3230f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d322a120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d322a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa83a84e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301b0150 con 0x5627d32275d0 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa83a84e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301ada20 con 0x5627d3228b40 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa83a84e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301ab890 con 0x5627d3232370 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3230f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3230f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41272/0 (socket says 172.21.15.70:41272) 2024-09-19T04:38:03.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 -- 172.21.15.70:0/3462710612 learned_addr learned my addr 172.21.15.70:0/3462710612 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 --2- 172.21.15.70:0/3462710612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d322a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 -- 172.21.15.70:0/3462710612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 msgr2=0x5627d322a660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 --2- 172.21.15.70:0/3462710612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d322a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 -- 172.21.15.70:0/3462710612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 msgr2=0x5627d322a120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 --2- 172.21.15.70:0/3462710612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d322a120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.073+0000 7fa835a10640 1 -- 172.21.15.70:0/3462710612 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627d322dfe0 con 0x5627d32275d0 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa835a10640 1 --2- 172.21.15.70:0/3462710612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3230f60 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa824009930 tx=0x7fa82402ab60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c993e768f430054 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa81bfff640 1 -- 172.21.15.70:0/3462710612 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824057040 con 0x5627d32275d0 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa81bfff640 1 -- 172.21.15.70:0/3462710612 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa824003b20 con 0x5627d32275d0 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa81bfff640 1 -- 172.21.15.70:0/3462710612 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824035040 con 0x5627d32275d0 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 -- 172.21.15.70:0/3462710612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 msgr2=0x5627d3230f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 --2- 172.21.15.70:0/3462710612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3230f60 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fa824009930 tx=0x7fa82402ab60 comp rx=0 tx=0).stop 2024-09-19T04:38:03.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 -- 172.21.15.70:0/3462710612 shutdown_connections 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 --2- 172.21.15.70:0/3462710612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d322a660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 --2- 172.21.15.70:0/3462710612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d322a120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 --2- 172.21.15.70:0/3462710612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d3230f60 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 -- 172.21.15.70:0/3462710612 >> 172.21.15.70:0/3462710612 conn(0x5627d31f0310 msgr2=0x5627d3230850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 -- 172.21.15.70:0/3462710612 shutdown_connections 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.074+0000 7fa83a84e740 1 -- 172.21.15.70:0/3462710612 wait complete. 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 1 -- start start 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 1 Processor -- start 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d323a480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d323a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d3237450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301abee0 con 0x5627d32275d0 2024-09-19T04:38:03.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301ad350 con 0x5627d3228b40 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa8301ac5b0 con 0x5627d3232370 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa83a84e740 10 client.0 _ll_register_callbacks cb 0x7fa824032ea0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d323a480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d323a480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41286/0 (socket says 172.21.15.70:41286) 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 -- 172.21.15.70:0/2870674858 learned_addr learned my addr 172.21.15.70:0/2870674858 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d3237450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 -- 172.21.15.70:0/2870674858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 msgr2=0x5627d3237450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d3237450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 -- 172.21.15.70:0/2870674858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 msgr2=0x5627d323a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d323a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.075+0000 7fa835a10640 1 -- 172.21.15.70:0/2870674858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627d3237990 con 0x5627d32275d0 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa835a10640 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d323a480 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa824031750 tx=0x7fa824009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=863eaa2b5f3386ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:03.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa819ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa819ffb640 1 -- 172.21.15.70:0/2870674858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa824057070 con 0x5627d32275d0 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa819ffb640 1 -- 172.21.15.70:0/2870674858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fa8240035f0 con 0x5627d32275d0 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 1 -- 172.21.15.70:0/2870674858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa824003b20 con 0x5627d32275d0 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa819ffb640 1 -- 172.21.15.70:0/2870674858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fa824035040 con 0x5627d32275d0 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 10 client.17244 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 1 -- 172.21.15.70:0/2870674858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5627d32ad2f0 con 0x5627d32275d0 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa819ffb640 1 -- 172.21.15.70:0/2870674858 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa824003b20 con 0x5627d32275d0 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa819ffb640 1 -- 172.21.15.70:0/2870674858 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fa82403d570 con 0x5627d32275d0 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 10 client.17244 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 10 client.17244 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 20 client.17244 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5627d32ad8a0 0x5627d32afc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:03.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 4 client.17244 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:03.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.076+0000 7fa83a84e740 1 -- 172.21.15.70:0/2870674858 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5627d3194d70 con 0x5627d32ad8a0 2024-09-19T04:38:03.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.077+0000 7fa836211640 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5627d32ad8a0 0x5627d32afc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:03.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa836211640 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5627d32ad8a0 0x5627d32afc90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=da0bd40294ec005f server_cookie=782eca73af21a50e in_seq=0 out_seq=0 2024-09-19T04:38:03.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa819ffb640 10 client.17244 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:03.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa819ffb640 1 -- 172.21.15.70:0/2870674858 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5627d3194d70 con 0x5627d32ad8a0 2024-09-19T04:38:03.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa819ffb640 10 client.17244 handle_command_reply: tid=0 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 client.17244 shutdown 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 -- 172.21.15.70:0/2870674858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 msgr2=0x5627d323a480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d323a480 secure :-1 s=READY pgs=999 cs=0 l=1 rev1=1 crypto rx=0x7fa824031750 tx=0x7fa824009640 comp rx=0 tx=0).stop 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 -- 172.21.15.70:0/2870674858 shutdown_connections 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5627d32ad8a0 0x5627d32afc90 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627d3232370 0x5627d3237450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627d3228b40 0x5627d323a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa819ffb640 0 client.17244 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:03.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 --2- 172.21.15.70:0/2870674858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627d32275d0 0x5627d323a480 unknown :-1 s=CLOSED pgs=999 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 -- 172.21.15.70:0/2870674858 >> 172.21.15.70:0/2870674858 conn(0x5627d31f0310 msgr2=0x5627d3231070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:03.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 -- 172.21.15.70:0/2870674858 shutdown_connections 2024-09-19T04:38:03.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.078+0000 7fa83a84e740 1 -- 172.21.15.70:0/2870674858 wait complete. 2024-09-19T04:38:03.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa83a84e740 20 client.17244 trim_cache size 0 max 16384 2024-09-19T04:38:03.100 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:03.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 -- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa81c0a33b0 msgr2=0x7fa81c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa81c0a33b0 0x7fa81c0a5870 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fa82800caa0 tx=0x7fa82806eee0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 -- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830106a80 msgr2=0x7fa83019cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:03.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830106a80 0x7fa83019cd60 secure :-1 s=READY pgs=995 cs=0 l=1 rev1=1 crypto rx=0x7fa82800cad0 tx=0x7fa82800cf90 comp rx=0 tx=0).stop 2024-09-19T04:38:03.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 -- 172.21.15.70:0/2394245713 shutdown_connections 2024-09-19T04:38:03.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa81c0a33b0 0x7fa81c0a5870 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa830106a80 0x7fa83019cd60 unknown :-1 s=CLOSED pgs=995 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa830101420 0x7fa8301989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 --2- 172.21.15.70:0/2394245713 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa830100a80 0x7fa830198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:03.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 -- 172.21.15.70:0/2394245713 >> 172.21.15.70:0/2394245713 conn(0x7fa8300fc7a0 msgr2=0x7fa830104910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:03.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 -- 172.21.15.70:0/2394245713 shutdown_connections 2024-09-19T04:38:03.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:03.079+0000 7fa838475640 1 -- 172.21.15.70:0/2394245713 wait complete. 2024-09-19T04:38:03.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:02 smithi167 ceph-mon[34339]: pgmap v223: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:38:03.913 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:38:04.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:03 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:38:04.174 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:04.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:03 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:38:04.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:03 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 -- 172.21.15.70:0/260715847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534100e20 msgr2=0x7ff534101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/260715847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534100e20 0x7ff534101200 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7ff524009900 tx=0x7ff52402a480 comp rx=0 tx=0).stop 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 -- 172.21.15.70:0/260715847 shutdown_connections 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/260715847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff534102ef0 0x7ff53410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/260715847 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534102570 0x7ff5341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/260715847 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534100e20 0x7ff534101200 unknown :-1 s=CLOSED pgs=1000 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 -- 172.21.15.70:0/260715847 >> 172.21.15.70:0/260715847 conn(0x7ff5340fc7d0 msgr2=0x7ff5340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 -- 172.21.15.70:0/260715847 shutdown_connections 2024-09-19T04:38:04.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 -- 172.21.15.70:0/260715847 wait complete. 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.645+0000 7ff53a1fc640 1 Processor -- start 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff53a1fc640 1 -- start start 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff53a1fc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff534100e20 0x7ff5341a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff53a1fc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534102570 0x7ff5341a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff53a1fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534102ef0 0x7ff53419a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff53a1fc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff534110f50 con 0x7ff534102ef0 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff53a1fc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff534110dd0 con 0x7ff534100e20 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff53a1fc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341110d0 con 0x7ff534102570 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534102ef0 0x7ff53419a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534102ef0 0x7ff53419a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46472/0 (socket says 172.21.15.70:46472) 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 -- 172.21.15.70:0/38080837 learned_addr learned my addr 172.21.15.70:0/38080837 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:04.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff52bfff640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534102570 0x7ff5341a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 -- 172.21.15.70:0/38080837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534102570 msgr2=0x7ff5341a0920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534102570 0x7ff5341a0920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 -- 172.21.15.70:0/38080837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff534100e20 msgr2=0x7ff5341a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff534100e20 0x7ff5341a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 -- 172.21.15.70:0/38080837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff53419acd0 con 0x7ff534102ef0 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff533fff640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534102ef0 0x7ff53419a5a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00eb10 tx=0x7ff52c00c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff5317fa640 1 -- 172.21.15.70:0/38080837 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c004b20 con 0x7ff534102ef0 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff5317fa640 1 -- 172.21.15.70:0/38080837 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff52c004cc0 con 0x7ff534102ef0 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff5317fa640 1 -- 172.21.15.70:0/38080837 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff52c010700 con 0x7ff534102ef0 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.646+0000 7ff53a1fc640 1 -- 172.21.15.70:0/38080837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff53419afc0 con 0x7ff534102ef0 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.647+0000 7ff53a1fc640 1 -- 172.21.15.70:0/38080837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5341a72b0 con 0x7ff534102ef0 2024-09-19T04:38:04.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.649+0000 7ff5317fa640 1 -- 172.21.15.70:0/38080837 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff52c004e70 con 0x7ff534102ef0 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.649+0000 7ff53c5d5740 1 Processor -- start 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.649+0000 7ff53c5d5740 1 -- start start 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.649+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.649+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf75d0 0x55e00ebf7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.649+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ec02370 0x55e00ec04760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.649+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e00eb5d2f0 con 0x55e00ebf8b40 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.649+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e00eb04cf0 con 0x55e00ebf75d0 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e00eb592b0 con 0x55e00ec02370 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff5317fa640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff5200a33b0 0x7ff5200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf7090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46474/0 (socket says 172.21.15.70:46474) 2024-09-19T04:38:04.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 -- 172.21.15.70:0/1424561558 learned_addr learned my addr 172.21.15.70:0/1424561558 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff5337fe640 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf75d0 0x55e00ebf7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ec02370 0x55e00ec04760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff533fff640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff5200a33b0 0x7ff5200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff5317fa640 1 -- 172.21.15.70:0/38080837 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7ff52c0d0380 con 0x7ff534102ef0 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 -- 172.21.15.70:0/1424561558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ec02370 msgr2=0x55e00ec04760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ec02370 0x55e00ec04760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 -- 172.21.15.70:0/1424561558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf75d0 msgr2=0x55e00ebf7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf75d0 0x55e00ebf7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 -- 172.21.15.70:0/1424561558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00eae93a0 con 0x55e00ebf8b40 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf7090 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0058c0 tx=0x7ff51c00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb746e01c3f6a6a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:04.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff533fff640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff5200a33b0 0x7ff5200a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff52c09c5f0 tx=0x7ff52c01bfa0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff529ffb640 1 -- 172.21.15.70:0/1424561558 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c011780 con 0x55e00ebf8b40 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff529ffb640 1 -- 172.21.15.70:0/1424561558 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff51c011df0 con 0x55e00ebf8b40 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.650+0000 7ff529ffb640 1 -- 172.21.15.70:0/1424561558 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c00fa40 con 0x55e00ebf8b40 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1424561558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 msgr2=0x55e00ebf7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf7090 secure :-1 s=READY pgs=1002 cs=0 l=1 rev1=1 crypto rx=0x7ff51c0058c0 tx=0x7ff51c00b690 comp rx=0 tx=0).stop 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1424561558 shutdown_connections 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ec02370 0x55e00ec04760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf75d0 0x55e00ebf7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1424561558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf7090 unknown :-1 s=CLOSED pgs=1002 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1424561558 >> 172.21.15.70:0/1424561558 conn(0x55e00ebc0310 msgr2=0x55e00ebf3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1424561558 shutdown_connections 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1424561558 wait complete. 2024-09-19T04:38:04.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.651+0000 7ff53c5d5740 1 -- start start 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff53c5d5740 1 Processor -- start 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf75d0 0x55e00ec01cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf8b40 0x55e00ebfef70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebff4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e00ec05010 con 0x55e00ebf75d0 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e00eb18060 con 0x55e00ec02370 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e00ec05190 con 0x55e00ebf8b40 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff53c5d5740 10 client.0 _ll_register_callbacks cb 0x55e00e86b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf75d0 0x55e00ec01cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf75d0 0x55e00ec01cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46488/0 (socket says 172.21.15.70:46488) 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 -- 172.21.15.70:0/3094038622 learned_addr learned my addr 172.21.15.70:0/3094038622 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff5337fe640 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf8b40 0x55e00ebfef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebff4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 -- 172.21.15.70:0/3094038622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf8b40 msgr2=0x55e00ebfef70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf8b40 0x55e00ebfef70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 -- 172.21.15.70:0/3094038622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 msgr2=0x55e00ebff4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebff4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff52bfff640 1 -- 172.21.15.70:0/3094038622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00e8ce3c0 con 0x55e00ebf75d0 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.652+0000 7ff5337fe640 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf8b40 0x55e00ebfef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff52bfff640 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf75d0 0x55e00ec01cc0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00b660 tx=0x7ff51c00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1cd1ac7da00d962 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff512ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff512ffd640 1 -- 172.21.15.70:0/3094038622 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c023020 con 0x55e00ebf75d0 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 1 -- 172.21.15.70:0/3094038622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff51c011df0 con 0x55e00ebf75d0 2024-09-19T04:38:04.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff512ffd640 1 -- 172.21.15.70:0/3094038622 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7ff51c011a90 con 0x55e00ebf75d0 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff512ffd640 1 -- 172.21.15.70:0/3094038622 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff51c005020 con 0x55e00ebf75d0 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 10 client.17256 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 1 -- 172.21.15.70:0/3094038622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e00ec10a50 con 0x55e00ebf75d0 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff512ffd640 1 -- 172.21.15.70:0/3094038622 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff51c011df0 con 0x55e00ebf75d0 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff512ffd640 1 -- 172.21.15.70:0/3094038622 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff51c00fbe0 con 0x55e00ebf75d0 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 10 client.17256 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 10 client.17256 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 20 client.17256 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e00ec11da0 0x55e00ec14190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 4 client.17256 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.653+0000 7ff53c5d5740 1 -- 172.21.15.70:0/3094038622 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e00eb6a860 con 0x55e00ec11da0 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.654+0000 7ff5337fe640 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e00ec11da0 0x55e00ec14190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.654+0000 7ff512ffd640 10 client.17256 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.654+0000 7ff5337fe640 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e00ec11da0 0x55e00ec14190 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=744291072b764085 server_cookie=c4eb87d9f29d2d7f in_seq=0 out_seq=0 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff512ffd640 1 -- 172.21.15.70:0/3094038622 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e00eb6a860 con 0x55e00ec11da0 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff512ffd640 10 client.17256 handle_command_reply: tid=0 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 client.17256 shutdown 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 -- 172.21.15.70:0/3094038622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf75d0 msgr2=0x55e00ec01cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf75d0 0x55e00ec01cc0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7ff51c00b660 tx=0x7ff51c00b7e0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 -- 172.21.15.70:0/3094038622 shutdown_connections 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e00ec11da0 0x55e00ec14190 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebff4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf8b40 0x55e00ebfef70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/3094038622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf75d0 0x55e00ec01cc0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff512ffd640 0 client.17256 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:04.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.655+0000 7ff53c5d5740 1 -- 172.21.15.70:0/3094038622 >> 172.21.15.70:0/3094038622 conn(0x55e00ebc0310 msgr2=0x55e00ebf9930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:04.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.656+0000 7ff53c5d5740 1 -- 172.21.15.70:0/3094038622 shutdown_connections 2024-09-19T04:38:04.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.656+0000 7ff53c5d5740 1 -- 172.21.15.70:0/3094038622 wait complete. 2024-09-19T04:38:04.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.656+0000 7ff53c5d5740 20 client.17256 trim_cache size 0 max 16384 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.668+0000 7ff53c5d5740 1 Processor -- start 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.668+0000 7ff53c5d5740 1 -- start start 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.668+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 0x55e00ec0e2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.668+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf2500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.668+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebfa120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341b2400 con 0x55e00ebf8b40 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341afcd0 con 0x55e00ec02370 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341adb40 con 0x55e00ebf75d0 2024-09-19T04:38:04.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf2500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf2500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46498/0 (socket says 172.21.15.70:46498) 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 -- 172.21.15.70:0/1177955091 learned_addr learned my addr 172.21.15.70:0/1177955091 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 0x55e00ec0e2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebfa120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 -- 172.21.15.70:0/1177955091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 msgr2=0x55e00ec0e2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 0x55e00ec0e2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 -- 172.21.15.70:0/1177955091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 msgr2=0x55e00ebfa120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebfa120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 -- 172.21.15.70:0/1177955091 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e00ebf2be0 con 0x55e00ebf8b40 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebfa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5337fe640 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf2500 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff524033000 tx=0x7ff524031400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d312ff77bc5e06a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:04.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5297fa640 1 -- 172.21.15.70:0/1177955091 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524049070 con 0x55e00ebf8b40 2024-09-19T04:38:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5297fa640 1 -- 172.21.15.70:0/1177955091 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff524005040 con 0x55e00ebf8b40 2024-09-19T04:38:04.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.669+0000 7ff5297fa640 1 -- 172.21.15.70:0/1177955091 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff524035040 con 0x55e00ebf8b40 2024-09-19T04:38:04.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1177955091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 msgr2=0x55e00ebf2500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf2500 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7ff524033000 tx=0x7ff524031400 comp rx=0 tx=0).stop 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1177955091 shutdown_connections 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ec02370 0x55e00ebfa120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ebf8b40 0x55e00ebf2500 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1177955091 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 0x55e00ec0e2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1177955091 >> 172.21.15.70:0/1177955091 conn(0x55e00ebc0310 msgr2=0x55e00ec00ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1177955091 shutdown_connections 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1177955091 wait complete. 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.670+0000 7ff53c5d5740 1 -- start start 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff53c5d5740 1 Processor -- start 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 0x55e00ec0a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf8b40 0x55e00ec05ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff53c5d5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ec02370 0x55e00ec060e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341ae190 con 0x55e00ec02370 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341af600 con 0x55e00ebf8b40 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff53c5d5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff5341ae860 con 0x55e00ebf75d0 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff53c5d5740 10 client.0 _ll_register_callbacks cb 0x7ff52c0093a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ec02370 0x55e00ec060e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ec02370 0x55e00ec060e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46508/0 (socket says 172.21.15.70:46508) 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 -- 172.21.15.70:0/1572505334 learned_addr learned my addr 172.21.15.70:0/1572505334 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 0x55e00ec0a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff5337fe640 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf8b40 0x55e00ec05ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 -- 172.21.15.70:0/1572505334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 msgr2=0x55e00ec0a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 0x55e00ec0a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 -- 172.21.15.70:0/1572505334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf8b40 msgr2=0x55e00ec05ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf8b40 0x55e00ec05ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 -- 172.21.15.70:0/1572505334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e00ec06620 con 0x55e00ec02370 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff52bfff640 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ec02370 0x55e00ec060e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff51c004ff0 tx=0x7ff51c00b7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6105126a23e53c67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.671+0000 7ff512ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff512ffd640 1 -- 172.21.15.70:0/1572505334 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff51c023040 con 0x55e00ec02370 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff512ffd640 1 -- 172.21.15.70:0/1572505334 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7ff51c00bbc0 con 0x55e00ec02370 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1572505334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff524005040 con 0x55e00ec02370 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff512ffd640 1 -- 172.21.15.70:0/1572505334 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff51c00b850 con 0x55e00ec02370 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 10 client.17262 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1572505334 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e00ec7c4e0 con 0x55e00ec02370 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff512ffd640 1 -- 172.21.15.70:0/1572505334 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff524005040 con 0x55e00ec02370 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff512ffd640 1 -- 172.21.15.70:0/1572505334 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff51c0052c0 con 0x55e00ec02370 2024-09-19T04:38:04.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 10 client.17262 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 10 client.17262 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 20 client.17262 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e00ec7cbe0 0x55e00ec7f000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 4 client.17262 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.672+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1572505334 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55e00eb64d70 con 0x55e00ec7cbe0 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff5337fe640 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e00ec7cbe0 0x55e00ec7f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff512ffd640 10 client.17262 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff5337fe640 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e00ec7cbe0 0x55e00ec7f000 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=24158c3874fc1a25 server_cookie=80243891936d1d8b in_seq=0 out_seq=0 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff512ffd640 1 -- 172.21.15.70:0/1572505334 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55e00eb64d70 con 0x55e00ec7cbe0 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff512ffd640 10 client.17262 handle_command_reply: tid=0 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 client.17262 shutdown 2024-09-19T04:38:04.680 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1572505334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ec02370 msgr2=0x55e00ec060e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ec02370 0x55e00ec060e0 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7ff51c004ff0 tx=0x7ff51c00b7e0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1572505334 shutdown_connections 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e00ec7cbe0 0x55e00ec7f000 crc :-1 s=READY pgs=163 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e00ec02370 0x55e00ec060e0 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e00ebf8b40 0x55e00ec05ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 --2- 172.21.15.70:0/1572505334 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e00ebf75d0 0x55e00ec0a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1572505334 >> 172.21.15.70:0/1572505334 conn(0x55e00ebc0310 msgr2=0x55e00ebfd840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff512ffd640 0 client.17262 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1572505334 shutdown_connections 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.673+0000 7ff53c5d5740 1 -- 172.21.15.70:0/1572505334 wait complete. 2024-09-19T04:38:04.681 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53c5d5740 20 client.17262 trim_cache size 0 max 16384 2024-09-19T04:38:04.682 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:04.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 -- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff5200a33b0 msgr2=0x7ff5200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.682 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff5200a33b0 0x7ff5200a5870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7ff52c09c5f0 tx=0x7ff52c01bfa0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 -- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534102ef0 msgr2=0x7ff53419a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534102ef0 0x7ff53419a5a0 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7ff52c00eb10 tx=0x7ff52c00c2d0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 -- 172.21.15.70:0/38080837 shutdown_connections 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff5200a33b0 0x7ff5200a5870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff534102ef0 0x7ff53419a5a0 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff534102570 0x7ff5341a0920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 --2- 172.21.15.70:0/38080837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff534100e20 0x7ff5341a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 -- 172.21.15.70:0/38080837 >> 172.21.15.70:0/38080837 conn(0x7ff5340fc7d0 msgr2=0x7ff53406a110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 -- 172.21.15.70:0/38080837 shutdown_connections 2024-09-19T04:38:04.683 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:04.674+0000 7ff53a1fc640 1 -- 172.21.15.70:0/38080837 wait complete. 2024-09-19T04:38:05.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:04 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:38:05.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:04 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:38:05.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:04 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:38:05.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:04 smithi134 ceph-mon[34525]: pgmap v224: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:38:05.296 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:04 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:38:05.296 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:04 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:38:05.296 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:04 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:38:05.296 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:04 smithi070 ceph-mon[30942]: pgmap v224: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:38:05.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:04 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:38:05.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:04 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:38:05.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:04 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:38:05.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:04 smithi167 ceph-mon[34339]: pgmap v224: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:38:06.338 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:38:06.339 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:38:06.601 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:06 smithi134 ceph-mon[34525]: pgmap v225: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:38:07.038 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:06 smithi070 ceph-mon[30942]: pgmap v225: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:38:07.074 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 -- 172.21.15.70:0/577709780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc106f20 msgr2=0x7fe0dc10eaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/577709780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc106f20 0x7fe0dc10eaa0 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009900 tx=0x7fe0d402a410 comp rx=0 tx=0).stop 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 -- 172.21.15.70:0/577709780 shutdown_connections 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/577709780 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc106f20 0x7fe0dc10eaa0 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/577709780 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc1027a0 0x7fe0dc1067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/577709780 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc101df0 0x7fe0dc1021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 -- 172.21.15.70:0/577709780 >> 172.21.15.70:0/577709780 conn(0x7fe0dc0fd8f0 msgr2=0x7fe0dc0ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 -- 172.21.15.70:0/577709780 shutdown_connections 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.036+0000 7fe0e13bf640 1 -- 172.21.15.70:0/577709780 wait complete. 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.037+0000 7fe0e13bf640 1 Processor -- start 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.037+0000 7fe0e13bf640 1 -- start start 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0e13bf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc101df0 0x7fe0dc198450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0e13bf640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc1027a0 0x7fe0dc198990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0e13bf640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc106f20 0x7fe0dc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0e13bf640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111f90 con 0x7fe0dc101df0 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0e13bf640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc111e10 con 0x7fe0dc1027a0 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0e13bf640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc112110 con 0x7fe0dc106f20 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc101df0 0x7fe0dc198450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc101df0 0x7fe0dc198450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46518/0 (socket says 172.21.15.70:46518) 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 -- 172.21.15.70:0/1399458966 learned_addr learned my addr 172.21.15.70:0/1399458966 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc1027a0 0x7fe0dc198990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 -- 172.21.15.70:0/1399458966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc106f20 msgr2=0x7fe0dc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc106f20 0x7fe0dc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc106f20 0x7fe0dc19cd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 -- 172.21.15.70:0/1399458966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc1027a0 msgr2=0x7fe0dc198990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc1027a0 0x7fe0dc198990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 -- 172.21.15.70:0/1399458966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0dc19d400 con 0x7fe0dc101df0 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0daffd640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc101df0 0x7fe0dc198450 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00ba50 tx=0x7fe0cc00bf10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0c3fff640 1 -- 172.21.15.70:0/1399458966 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc019070 con 0x7fe0dc101df0 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0c3fff640 1 -- 172.21.15.70:0/1399458966 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe0cc00cbe0 con 0x7fe0dc101df0 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.038+0000 7fe0e13bf640 1 -- 172.21.15.70:0/1399458966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe0dc19d6f0 con 0x7fe0dc101df0 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.039+0000 7fe0c3fff640 1 -- 172.21.15.70:0/1399458966 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc007630 con 0x7fe0dc101df0 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.039+0000 7fe0e13bf640 1 -- 172.21.15.70:0/1399458966 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0dc1a4fd0 con 0x7fe0dc101df0 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0c3fff640 1 -- 172.21.15.70:0/1399458966 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe0cc01c070 con 0x7fe0dc101df0 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0e3798740 1 Processor -- start 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0e3798740 1 -- start start 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eafb60 0x55e217eaff40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217eba800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217ebad40 0x55e217ebd130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0e3798740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e217e15280 con 0x55e217eb0480 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0e3798740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e217dbcb10 con 0x55e217ebad40 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0e3798740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e217e11240 con 0x55e217eafb60 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217eba800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217eba800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46532/0 (socket says 172.21.15.70:46532) 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0daffd640 1 -- 172.21.15.70:0/1517169547 learned_addr learned my addr 172.21.15.70:0/1517169547 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.041+0000 7fe0c3fff640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0c40a33b0 0x7fe0c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eafb60 0x55e217eaff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217ebad40 0x55e217ebd130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0c40a33b0 0x7fe0c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0daffd640 1 -- 172.21.15.70:0/1517169547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eafb60 msgr2=0x55e217eaff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0daffd640 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eafb60 0x55e217eaff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0daffd640 1 -- 172.21.15.70:0/1517169547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217ebad40 msgr2=0x55e217ebd130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:07.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0daffd640 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217ebad40 0x55e217ebd130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0daffd640 1 -- 172.21.15.70:0/1517169547 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e217dc91f0 con 0x55e217eb0480 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0c3fff640 1 -- 172.21.15.70:0/1399458966 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fe0cc0cf200 con 0x7fe0dc101df0 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0daffd640 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217eba800 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc09b3a0 tx=0x7fe0cc021000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddfb1a2e28fed121 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0c17fa640 1 -- 172.21.15.70:0/1517169547 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc00f160 con 0x55e217eb0480 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0c40a33b0 0x7fe0c40a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40314b0 tx=0x7fe0d4005fd0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0c17fa640 1 -- 172.21.15.70:0/1517169547 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe0cc0b47f0 con 0x55e217eb0480 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.042+0000 7fe0c17fa640 1 -- 172.21.15.70:0/1517169547 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc046170 con 0x55e217eb0480 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 -- 172.21.15.70:0/1517169547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 msgr2=0x55e217eba800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217eba800 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc09b3a0 tx=0x7fe0cc021000 comp rx=0 tx=0).stop 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 -- 172.21.15.70:0/1517169547 shutdown_connections 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217ebad40 0x55e217ebd130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217eba800 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 --2- 172.21.15.70:0/1517169547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eafb60 0x55e217eaff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 -- 172.21.15.70:0/1517169547 >> 172.21.15.70:0/1517169547 conn(0x55e217eac0f0 msgr2=0x55e217eac4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:07.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 -- 172.21.15.70:0/1517169547 shutdown_connections 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 -- 172.21.15.70:0/1517169547 wait complete. 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 -- start start 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.043+0000 7fe0e3798740 1 Processor -- start 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eafb60 0x55e217eb7c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eb0480 0x55e217eb8150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217eb8690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e217ebd910 con 0x55e217eafb60 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e217dcff10 con 0x55e217eb0480 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e217ebda90 con 0x55e217ebad40 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 10 client.0 _ll_register_callbacks cb 0x55e217d98a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eafb60 0x55e217eb7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eafb60 0x55e217eb7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46538/0 (socket says 172.21.15.70:46538) 2024-09-19T04:38:07.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 -- 172.21.15.70:0/158417867 learned_addr learned my addr 172.21.15.70:0/158417867 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eb0480 0x55e217eb8150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 -- 172.21.15.70:0/158417867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 msgr2=0x55e217eb8690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217eb8690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217eb8690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 -- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eb0480 msgr2=0x55e217eb8150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eb0480 0x55e217eb8150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 -- 172.21.15.70:0/158417867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e217b866a0 con 0x55e217eafb60 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217eb8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eb0480 0x55e217eb8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0daffd640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eafb60 0x55e217eb7c10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0a3d30 tx=0x7fe0cc00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b04c2421ec8299db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0beff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:07.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0beff5640 1 -- 172.21.15.70:0/158417867 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0cc09f9a0 con 0x55e217eafb60 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0beff5640 1 -- 172.21.15.70:0/158417867 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fe0cc0999a0 con 0x55e217eafb60 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 1 -- 172.21.15.70:0/158417867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0cc0b47f0 con 0x55e217eafb60 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0beff5640 1 -- 172.21.15.70:0/158417867 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe0cc0a3dd0 con 0x55e217eafb60 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 10 client.17274 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.044+0000 7fe0e3798740 1 -- 172.21.15.70:0/158417867 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e217ec9510 con 0x55e217eafb60 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0beff5640 1 -- 172.21.15.70:0/158417867 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe0cc0b47f0 con 0x55e217eafb60 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0beff5640 1 -- 172.21.15.70:0/158417867 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe0cc0b4ad0 con 0x55e217eafb60 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0e3798740 10 client.17274 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0e3798740 10 client.17274 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0e3798740 20 client.17274 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0e3798740 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e217eca860 0x55e217eccc50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0e3798740 4 client.17274 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:07.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0e3798740 1 -- 172.21.15.70:0/158417867 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e217e227f0 con 0x55e217eca860 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.045+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e217eca860 0x55e217eccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0beff5640 10 client.17274 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e217eca860 0x55e217eccc50 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=52209c5f6d736cf2 server_cookie=280e1d8f4d3564b8 in_seq=0 out_seq=0 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0beff5640 1 -- 172.21.15.70:0/158417867 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e217e227f0 con 0x55e217eca860 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0beff5640 10 client.17274 handle_command_reply: tid=0 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 client.17274 shutdown 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 -- 172.21.15.70:0/158417867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eafb60 msgr2=0x55e217eb7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eafb60 0x55e217eb7c10 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc0a3d30 tx=0x7fe0cc00c6a0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 -- 172.21.15.70:0/158417867 shutdown_connections 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e217eca860 0x55e217eccc50 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217eb8690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0beff5640 0 client.17274 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eb0480 0x55e217eb8150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 --2- 172.21.15.70:0/158417867 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eafb60 0x55e217eb7c10 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 -- 172.21.15.70:0/158417867 >> 172.21.15.70:0/158417867 conn(0x55e217eac0f0 msgr2=0x55e217eb1e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 -- 172.21.15.70:0/158417867 shutdown_connections 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.046+0000 7fe0e3798740 1 -- 172.21.15.70:0/158417867 wait complete. 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.047+0000 7fe0e3798740 20 client.17274 trim_cache size 0 max 16384 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.063+0000 7fe0e3798740 1 Processor -- start 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.063+0000 7fe0e3798740 1 -- start start 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 0x55e217ec63f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eb0480 0x55e217ecfc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217ebad40 0x55e217ed01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0e3798740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1b01b0 con 0x55e217ebad40 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0e3798740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ada80 con 0x55e217eafb60 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0e3798740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ab8f0 con 0x55e217eb0480 2024-09-19T04:38:07.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217ebad40 0x55e217ed01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217ebad40 0x55e217ed01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46544/0 (socket says 172.21.15.70:46544) 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 -- 172.21.15.70:0/3216670317 learned_addr learned my addr 172.21.15.70:0/3216670317 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0daffd640 1 --2- 172.21.15.70:0/3216670317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 0x55e217ec63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 -- 172.21.15.70:0/3216670317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eb0480 msgr2=0x55e217ecfc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/3216670317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eb0480 0x55e217ecfc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 -- 172.21.15.70:0/3216670317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 msgr2=0x55e217ec63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/3216670317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 0x55e217ec63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 -- 172.21.15.70:0/3216670317 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e217eabf20 con 0x55e217ebad40 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/3216670317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217ebad40 0x55e217ed01b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009900 tx=0x7fe0d40058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa65f1eb8c47438e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0c0ff9640 1 -- 172.21.15.70:0/3216670317 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d4035040 con 0x55e217ebad40 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0c0ff9640 1 -- 172.21.15.70:0/3216670317 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe0d4043070 con 0x55e217ebad40 2024-09-19T04:38:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.064+0000 7fe0c0ff9640 1 -- 172.21.15.70:0/3216670317 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d403d6a0 con 0x55e217ebad40 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 -- 172.21.15.70:0/3216670317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217ebad40 msgr2=0x55e217ed01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 --2- 172.21.15.70:0/3216670317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217ebad40 0x55e217ed01b0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7fe0d4009900 tx=0x7fe0d40058d0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 -- 172.21.15.70:0/3216670317 shutdown_connections 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 --2- 172.21.15.70:0/3216670317 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217ebad40 0x55e217ed01b0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 --2- 172.21.15.70:0/3216670317 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217eb0480 0x55e217ecfc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 --2- 172.21.15.70:0/3216670317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 0x55e217ec63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 -- 172.21.15.70:0/3216670317 >> 172.21.15.70:0/3216670317 conn(0x55e217eac0f0 msgr2=0x55e217ec5ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 -- 172.21.15.70:0/3216670317 shutdown_connections 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 -- 172.21.15.70:0/3216670317 wait complete. 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 -- start start 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 Processor -- start 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 0x55e217ece100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.065+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217ece640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0e3798740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217f385b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0e3798740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1abf40 con 0x55e217eb0480 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0e3798740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ad3b0 con 0x55e217eafb60 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0e3798740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe0dc1ac610 con 0x55e217ebad40 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0e3798740 10 client.0 _ll_register_callbacks cb 0x7fe0cc09b500 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217ece640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217ece640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46546/0 (socket says 172.21.15.70:46546) 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 -- 172.21.15.70:0/4209768307 learned_addr learned my addr 172.21.15.70:0/4209768307 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0daffd640 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 0x55e217ece100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217f385b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 -- 172.21.15.70:0/4209768307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 msgr2=0x55e217f385b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217f385b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 -- 172.21.15.70:0/4209768307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 msgr2=0x55e217ece100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 0x55e217ece100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 -- 172.21.15.70:0/4209768307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e217eb2530 con 0x55e217eb0480 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0db7fe640 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217f385b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0da7fc640 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217ece640 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x55e217ead470 tx=0x7fe0d000bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e9bb48266651ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0beff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0beff5640 1 -- 172.21.15.70:0/4209768307 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0d0022020 con 0x55e217eb0480 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0beff5640 1 -- 172.21.15.70:0/4209768307 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(86..86 src has 1..86) ==== 8527+0+0 (secure 0 0 0) 0x7fe0d001d420 con 0x55e217eb0480 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0e3798740 1 -- 172.21.15.70:0/4209768307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe0d4043070 con 0x55e217eb0480 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0beff5640 1 -- 172.21.15.70:0/4209768307 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe0d002d050 con 0x55e217eb0480 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0e3798740 10 client.17280 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.066+0000 7fe0e3798740 1 -- 172.21.15.70:0/4209768307 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e217f39cc0 con 0x55e217eb0480 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0beff5640 1 -- 172.21.15.70:0/4209768307 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe0d4043070 con 0x55e217eb0480 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0beff5640 1 -- 172.21.15.70:0/4209768307 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe0d00119e0 con 0x55e217eb0480 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0e3798740 10 client.17280 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0e3798740 10 client.17280 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0e3798740 20 client.17280 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0e3798740 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e217f3a4c0 0x55e217f3c8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0e3798740 4 client.17280 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0e3798740 1 -- 172.21.15.70:0/4209768307 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55e217e1cd00 con 0x55e217f3a4c0 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0daffd640 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e217f3a4c0 0x55e217f3c8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0beff5640 10 client.17280 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.067+0000 7fe0daffd640 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e217f3a4c0 0x55e217f3c8e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f53442391f021d21 server_cookie=b007df7be9a5cf99 in_seq=0 out_seq=0 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0beff5640 1 -- 172.21.15.70:0/4209768307 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55e217e1cd00 con 0x55e217f3a4c0 2024-09-19T04:38:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0beff5640 10 client.17280 handle_command_reply: tid=0 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 client.17280 shutdown 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 -- 172.21.15.70:0/4209768307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 msgr2=0x55e217ece640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217ece640 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x55e217ead470 tx=0x7fe0d000bf60 comp rx=0 tx=0).stop 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 -- 172.21.15.70:0/4209768307 shutdown_connections 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e217f3a4c0 0x55e217f3c8e0 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e217ebad40 0x55e217f385b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e217eb0480 0x55e217ece640 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 --2- 172.21.15.70:0/4209768307 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e217eafb60 0x55e217ece100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0beff5640 0 client.17280 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.068+0000 7fe0e3798740 1 -- 172.21.15.70:0/4209768307 >> 172.21.15.70:0/4209768307 conn(0x55e217eac0f0 msgr2=0x55e217eb1d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e3798740 1 -- 172.21.15.70:0/4209768307 shutdown_connections 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e3798740 1 -- 172.21.15.70:0/4209768307 wait complete. 2024-09-19T04:38:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e3798740 20 client.17280 trim_cache size 0 max 16384 2024-09-19T04:38:07.091 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:07.091 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:38:07.091 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "11c5a07d-60e7-45e5-9394-d7bf5eb70070", 2024-09-19T04:38:07.091 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:38:07.091 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 -- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0c40a33b0 msgr2=0x7fe0c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0c40a33b0 0x7fe0c40a5870 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fe0d40314b0 tx=0x7fe0d4005fd0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 -- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc101df0 msgr2=0x7fe0dc198450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc101df0 0x7fe0dc198450 secure :-1 s=READY pgs=1007 cs=0 l=1 rev1=1 crypto rx=0x7fe0cc00ba50 tx=0x7fe0cc00bf10 comp rx=0 tx=0).stop 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 -- 172.21.15.70:0/1399458966 shutdown_connections 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0c40a33b0 0x7fe0c40a5870 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe0dc106f20 0x7fe0dc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0dc1027a0 0x7fe0dc198990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 --2- 172.21.15.70:0/1399458966 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe0dc101df0 0x7fe0dc198450 unknown :-1 s=CLOSED pgs=1007 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 -- 172.21.15.70:0/1399458966 >> 172.21.15.70:0/1399458966 conn(0x7fe0dc0fd8f0 msgr2=0x7fe0dc0fec40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 -- 172.21.15.70:0/1399458966 shutdown_connections 2024-09-19T04:38:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:07.069+0000 7fe0e13bf640 1 -- 172.21.15.70:0/1399458966 wait complete. 2024-09-19T04:38:07.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:06 smithi167 ceph-mon[34339]: pgmap v225: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:38:07.813 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:38:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:07 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:38:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:07 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:07 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:38:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:07 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:07 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:38:08.060 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:07 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:38:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:07 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:07 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:38:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:07 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:08.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:07 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:38:08.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:07 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:38:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:07 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:07 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:38:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:07 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:07 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 -- 172.21.15.70:0/3568219054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c101de0 msgr2=0x7f0f5c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 --2- 172.21.15.70:0/3568219054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c101de0 0x7f0f5c1021c0 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009900 tx=0x7f0f4c02a410 comp rx=0 tx=0).stop 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 -- 172.21.15.70:0/3568219054 shutdown_connections 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 --2- 172.21.15.70:0/3568219054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c106f10 0x7f0f5c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 --2- 172.21.15.70:0/3568219054 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102790 0x7f0f5c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 --2- 172.21.15.70:0/3568219054 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c101de0 0x7f0f5c1021c0 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 -- 172.21.15.70:0/3568219054 >> 172.21.15.70:0/3568219054 conn(0x7f0f5c0fd8c0 msgr2=0x7f0f5c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 -- 172.21.15.70:0/3568219054 shutdown_connections 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.537+0000 7f0f625e8640 1 -- 172.21.15.70:0/3568219054 wait complete. 2024-09-19T04:38:08.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f625e8640 1 Processor -- start 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f625e8640 1 -- start start 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f625e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c101de0 0x7f0f5c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f625e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102790 0x7f0f5c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f625e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c106f10 0x7f0f5c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f625e8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c111f40 con 0x7f0f5c106f10 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f625e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c111dc0 con 0x7f0f5c101de0 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f625e8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c1120c0 con 0x7f0f5c102790 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f60b85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c106f10 0x7f0f5c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f60b85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c106f10 0x7f0f5c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46564/0 (socket says 172.21.15.70:46564) 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f60b85640 1 -- 172.21.15.70:0/2013706965 learned_addr learned my addr 172.21.15.70:0/2013706965 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102790 0x7f0f5c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.538+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c101de0 0x7f0f5c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f60b85640 1 -- 172.21.15.70:0/2013706965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102790 msgr2=0x7f0f5c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f60b85640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102790 0x7f0f5c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f60b85640 1 -- 172.21.15.70:0/2013706965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c101de0 msgr2=0x7f0f5c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f60b85640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c101de0 0x7f0f5c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f60b85640 1 -- 172.21.15.70:0/2013706965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f5c1a6900 con 0x7f0f5c106f10 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c101de0 0x7f0f5c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f60b85640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c106f10 0x7f0f5c074f70 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400cad0 tx=0x7f0f5400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f597fa640 1 -- 172.21.15.70:0/2013706965 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400ae20 con 0x7f0f5c106f10 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f625e8640 1 -- 172.21.15.70:0/2013706965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f5c1a6bf0 con 0x7f0f5c106f10 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f597fa640 1 -- 172.21.15.70:0/2013706965 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f54005020 con 0x7f0f5c106f10 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f597fa640 1 -- 172.21.15.70:0/2013706965 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5400f690 con 0x7f0f5c106f10 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.539+0000 7f0f625e8640 1 -- 172.21.15.70:0/2013706965 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f5c1a70e0 con 0x7f0f5c106f10 2024-09-19T04:38:08.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.541+0000 7f0f597fa640 1 -- 172.21.15.70:0/2013706965 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0f540051d0 con 0x7f0f5c106f10 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.541+0000 7f0f649c1740 1 Processor -- start 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f649c1740 1 -- start start 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f597fa640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f440a33b0 0x7f0f440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce6904a0 0x5641ce690880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce690dc0 0x5641ce69b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce69da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f649c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641ce5f62e0 con 0x5641ce69b680 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f649c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5641ce59dce0 con 0x5641ce690dc0 2024-09-19T04:38:08.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f649c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5641ce5f22a0 con 0x5641ce6904a0 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f440a33b0 0x7f0f440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f597fa640 1 -- 172.21.15.70:0/2013706965 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f0f540cfd20 con 0x7f0f5c106f10 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f60b85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce69da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f60b85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce69da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46570/0 (socket says 172.21.15.70:46570) 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f60b85640 1 -- 172.21.15.70:0/960344291 learned_addr learned my addr 172.21.15.70:0/960344291 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce6904a0 0x5641ce690880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce690dc0 0x5641ce69b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f60b85640 1 -- 172.21.15.70:0/960344291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce6904a0 msgr2=0x5641ce690880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f60b85640 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce6904a0 0x5641ce690880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f60b85640 1 -- 172.21.15.70:0/960344291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce690dc0 msgr2=0x5641ce69b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f60b85640 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce690dc0 0x5641ce69b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f60b85640 1 -- 172.21.15.70:0/960344291 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ce582440 con 0x5641ce69b680 2024-09-19T04:38:08.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce6904a0 0x5641ce690880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.542+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f440a33b0 0x7f0f440a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c075f80 tx=0x7f0f500041e0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f60b85640 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce69da70 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f0f54005cc0 tx=0x7f0f5409bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15b9d2ae5e8689e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f427fc640 1 -- 172.21.15.70:0/960344291 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5401d040 con 0x5641ce69b680 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f427fc640 1 -- 172.21.15.70:0/960344291 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f540a0380 con 0x5641ce69b680 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f427fc640 1 -- 172.21.15.70:0/960344291 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f540cdb90 con 0x5641ce69b680 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 -- 172.21.15.70:0/960344291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 msgr2=0x5641ce69da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce69da70 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f0f54005cc0 tx=0x7f0f5409bed0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 -- 172.21.15.70:0/960344291 shutdown_connections 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce69da70 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce690dc0 0x5641ce69b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 --2- 172.21.15.70:0/960344291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce6904a0 0x5641ce690880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 -- 172.21.15.70:0/960344291 >> 172.21.15.70:0/960344291 conn(0x5641ce68ca30 msgr2=0x5641ce68ce10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:08.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 -- 172.21.15.70:0/960344291 shutdown_connections 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.543+0000 7f0f649c1740 1 -- 172.21.15.70:0/960344291 wait complete. 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 1 -- start start 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 1 Processor -- start 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce69af70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce698220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 0x5641ce698760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641ce69e250 con 0x5641ce6904a0 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5641ce5b1050 con 0x5641ce69b680 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5641ce69e3d0 con 0x5641ce690dc0 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f649c1740 10 client.0 _ll_register_callbacks cb 0x5641ce5f1160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce69af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce69af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46580/0 (socket says 172.21.15.70:46580) 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f5bfff640 1 -- 172.21.15.70:0/4049260416 learned_addr learned my addr 172.21.15.70:0/4049260416 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f60b85640 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 0x5641ce698760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.544+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce698220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f5bfff640 1 -- 172.21.15.70:0/4049260416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 msgr2=0x5641ce698220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce698220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f5bfff640 1 -- 172.21.15.70:0/4049260416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 msgr2=0x5641ce698760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 0x5641ce698760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f5bfff640 1 -- 172.21.15.70:0/4049260416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ce3673c0 con 0x5641ce6904a0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce69af70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009900 tx=0x7f0f4c031f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=511a1df5cee2e4e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/4049260416 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c040070 con 0x5641ce6904a0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/4049260416 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f0f4c004240 con 0x5641ce6904a0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f649c1740 1 -- 172.21.15.70:0/4049260416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f540a0380 con 0x5641ce6904a0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/4049260416 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0f4c035040 con 0x5641ce6904a0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f649c1740 10 client.17292 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f649c1740 1 -- 172.21.15.70:0/4049260416 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5641ce6a9bc0 con 0x5641ce6904a0 2024-09-19T04:38:08.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/4049260416 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f540a0380 con 0x5641ce6904a0 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.545+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/4049260416 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0f4c04c070 con 0x5641ce6904a0 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f649c1740 10 client.17292 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f649c1740 10 client.17292 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f649c1740 20 client.17292 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f649c1740 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5641ce6ab080 0x5641ce6ad500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f649c1740 4 client.17292 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f649c1740 1 -- 172.21.15.70:0/4049260416 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5641ce603850 con 0x5641ce6ab080 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5641ce6ab080 0x5641ce6ad500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f3b7fe640 10 client.17292 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.546+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5641ce6ab080 0x5641ce6ad500 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c713e2c2b8cc706a server_cookie=ca58f411029e9ff6 in_seq=0 out_seq=0 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/4049260416 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5641ce603850 con 0x5641ce6ab080 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f3b7fe640 10 client.17292 handle_command_reply: tid=0 2024-09-19T04:38:08.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 client.17292 shutdown 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 -- 172.21.15.70:0/4049260416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 msgr2=0x5641ce69af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce69af70 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c009900 tx=0x7f0f4c031f70 comp rx=0 tx=0).stop 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 -- 172.21.15.70:0/4049260416 shutdown_connections 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5641ce6ab080 0x5641ce6ad500 crc :-1 s=READY pgs=166 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 0x5641ce698760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce698220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f3b7fe640 0 client.17292 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 --2- 172.21.15.70:0/4049260416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce69af70 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.547+0000 7f0f649c1740 1 -- 172.21.15.70:0/4049260416 >> 172.21.15.70:0/4049260416 conn(0x5641ce68ca30 msgr2=0x5641ce692710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.548+0000 7f0f649c1740 1 -- 172.21.15.70:0/4049260416 shutdown_connections 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.548+0000 7f0f649c1740 1 -- 172.21.15.70:0/4049260416 wait complete. 2024-09-19T04:38:08.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.548+0000 7f0f649c1740 20 client.17292 trim_cache size 0 max 16384 2024-09-19T04:38:08.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f649c1740 1 Processor -- start 2024-09-19T04:38:08.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f649c1740 1 -- start start 2024-09-19T04:38:08.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce6a74b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce68ba60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 0x5641ce6b2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f649c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c1b2380 con 0x5641ce6904a0 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f649c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c1afc50 con 0x5641ce69b680 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f649c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c1adac0 con 0x5641ce690dc0 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce6a74b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce6a74b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46590/0 (socket says 172.21.15.70:46590) 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f5bfff640 1 -- 172.21.15.70:0/512028189 learned_addr learned my addr 172.21.15.70:0/512028189 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.565+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce68ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f60b85640 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 0x5641ce6b2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f5bfff640 1 -- 172.21.15.70:0/512028189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 msgr2=0x5641ce68ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce68ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f5bfff640 1 -- 172.21.15.70:0/512028189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 msgr2=0x5641ce6b2dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:08.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 0x5641ce6b2dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f5bfff640 1 -- 172.21.15.70:0/512028189 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641ce69b2e0 con 0x5641ce6904a0 2024-09-19T04:38:08.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce6a74b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c02a930 tx=0x7f0f4c031ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7ea8212aa88fcd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:08.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f41ffb640 1 -- 172.21.15.70:0/512028189 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c052070 con 0x5641ce6904a0 2024-09-19T04:38:08.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f41ffb640 1 -- 172.21.15.70:0/512028189 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f4c0458d0 con 0x5641ce6904a0 2024-09-19T04:38:08.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.566+0000 7f0f41ffb640 1 -- 172.21.15.70:0/512028189 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f4c040040 con 0x5641ce6904a0 2024-09-19T04:38:08.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 -- 172.21.15.70:0/512028189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 msgr2=0x5641ce6a74b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce6a74b0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f0f4c02a930 tx=0x7f0f4c031ba0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 -- 172.21.15.70:0/512028189 shutdown_connections 2024-09-19T04:38:08.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce69b680 0x5641ce6b2dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce68ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 --2- 172.21.15.70:0/512028189 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce6904a0 0x5641ce6a74b0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 -- 172.21.15.70:0/512028189 >> 172.21.15.70:0/512028189 conn(0x5641ce68ca30 msgr2=0x5641ce68b350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 -- 172.21.15.70:0/512028189 shutdown_connections 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 -- 172.21.15.70:0/512028189 wait complete. 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 -- start start 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.567+0000 7f0f649c1740 1 Processor -- start 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce6904a0 0x5641ce69f730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce69fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f649c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce714da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f649c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c1ae110 con 0x5641ce69b680 2024-09-19T04:38:08.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f649c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c1af580 con 0x5641ce6904a0 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f649c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0f5c1ae7e0 con 0x5641ce690dc0 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f649c1740 10 client.0 _ll_register_callbacks cb 0x7f0f4c009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce714da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce714da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46592/0 (socket says 172.21.15.70:46592) 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 -- 172.21.15.70:0/865465290 learned_addr learned my addr 172.21.15.70:0/865465290 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f5b7fe640 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce69fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce6904a0 0x5641ce69f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 -- 172.21.15.70:0/865465290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 msgr2=0x5641ce69fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce69fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 -- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce6904a0 msgr2=0x5641ce69f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce6904a0 0x5641ce69f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 -- 172.21.15.70:0/865465290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5641ce7152e0 con 0x5641ce69b680 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce6904a0 0x5641ce69f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f60b85640 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce714da0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0f5409bcd0 tx=0x7f0f540bc1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dcbf862fd11dc6d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:08.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f3b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/865465290 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f5401d040 con 0x5641ce69b680 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/865465290 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f0f5409a2d0 con 0x5641ce69b680 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f649c1740 1 -- 172.21.15.70:0/865465290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0f4c0458d0 con 0x5641ce69b680 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.568+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/865465290 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0f540a4c40 con 0x5641ce69b680 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f649c1740 10 client.17298 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f649c1740 1 -- 172.21.15.70:0/865465290 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5641ce716440 con 0x5641ce69b680 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/865465290 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0f4c0458d0 con 0x5641ce69b680 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/865465290 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0f54096b40 con 0x5641ce69b680 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f649c1740 10 client.17298 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f649c1740 10 client.17298 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f649c1740 20 client.17298 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f649c1740 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5641ce716780 0x5641ce718b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f649c1740 4 client.17298 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:38:08.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f649c1740 1 -- 172.21.15.70:0/865465290 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5641ce5fdd60 con 0x5641ce716780 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.569+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5641ce716780 0x5641ce718b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f3b7fe640 10 client.17298 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f5bfff640 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5641ce716780 0x5641ce718b70 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=53b75be307071516 server_cookie=de04c21c1cb825f7 in_seq=0 out_seq=0 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f3b7fe640 1 -- 172.21.15.70:0/865465290 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5641ce5fdd60 con 0x5641ce716780 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f3b7fe640 10 client.17298 handle_command_reply: tid=0 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 client.17298 shutdown 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 -- 172.21.15.70:0/865465290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 msgr2=0x5641ce714da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce714da0 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f0f5409bcd0 tx=0x7f0f540bc1c0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 -- 172.21.15.70:0/865465290 shutdown_connections 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5641ce716780 0x5641ce718b70 crc :-1 s=READY pgs=167 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f3b7fe640 0 client.17298 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641ce69b680 0x5641ce714da0 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641ce690dc0 0x5641ce69fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 --2- 172.21.15.70:0/865465290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641ce6904a0 0x5641ce69f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 -- 172.21.15.70:0/865465290 >> 172.21.15.70:0/865465290 conn(0x5641ce68ca30 msgr2=0x5641ce691ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:08.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 -- 172.21.15.70:0/865465290 shutdown_connections 2024-09-19T04:38:08.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 1 -- 172.21.15.70:0/865465290 wait complete. 2024-09-19T04:38:08.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.570+0000 7f0f649c1740 20 client.17298 trim_cache size 0 max 16384 2024-09-19T04:38:08.577 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:38:08.577 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:38:08.577 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:08.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 -- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f440a33b0 msgr2=0x7f0f440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f440a33b0 0x7f0f440a5870 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c075f80 tx=0x7f0f500041e0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 -- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c106f10 msgr2=0x7f0f5c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:08.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c106f10 0x7f0f5c074f70 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7f0f5400cad0 tx=0x7f0f5400cf90 comp rx=0 tx=0).stop 2024-09-19T04:38:08.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 -- 172.21.15.70:0/2013706965 shutdown_connections 2024-09-19T04:38:08.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0f440a33b0 0x7f0f440a5870 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0f5c106f10 0x7f0f5c074f70 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0f5c102790 0x7f0f5c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 --2- 172.21.15.70:0/2013706965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f5c101de0 0x7f0f5c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 -- 172.21.15.70:0/2013706965 >> 172.21.15.70:0/2013706965 conn(0x7f0f5c0fd8c0 msgr2=0x7f0f5c0feca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 -- 172.21.15.70:0/2013706965 shutdown_connections 2024-09-19T04:38:08.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:08.571+0000 7f0f625e8640 1 -- 172.21.15.70:0/2013706965 wait complete. 2024-09-19T04:38:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:08 smithi134 ceph-mon[34525]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:38:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:08 smithi134 ceph-mon[34525]: pgmap v227: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:38:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:08 smithi070 ceph-mon[30942]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:38:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:08 smithi070 ceph-mon[30942]: pgmap v227: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:38:09.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:08 smithi167 ceph-mon[34339]: osdmap e87: 12 total, 12 up, 12 in 2024-09-19T04:38:09.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:08 smithi167 ceph-mon[34339]: pgmap v227: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:38:09.347 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:38:09.347 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:38:09.593 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:10.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 -- 172.21.15.70:0/3702835240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0101de0 msgr2=0x7ff9c01021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:10.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/3702835240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0101de0 0x7ff9c01021c0 secure :-1 s=READY pgs=1018 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc009900 tx=0x7ff9bc02a410 comp rx=0 tx=0).stop 2024-09-19T04:38:10.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 -- 172.21.15.70:0/3702835240 shutdown_connections 2024-09-19T04:38:10.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/3702835240 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c0106f10 0x7ff9c010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/3702835240 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9c0102790 0x7ff9c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/3702835240 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0101de0 0x7ff9c01021c0 unknown :-1 s=CLOSED pgs=1018 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 -- 172.21.15.70:0/3702835240 >> 172.21.15.70:0/3702835240 conn(0x7ff9c00fd8c0 msgr2=0x7ff9c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:10.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 -- 172.21.15.70:0/3702835240 shutdown_connections 2024-09-19T04:38:10.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.074+0000 7ff9c7d48640 1 -- 172.21.15.70:0/3702835240 wait complete. 2024-09-19T04:38:10.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c7d48640 1 Processor -- start 2024-09-19T04:38:10.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c7d48640 1 -- start start 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c7d48640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c0101de0 0x7ff9c0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c7d48640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9c0102790 0x7ff9c0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c7d48640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0106f10 0x7ff9c019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c7d48640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c0111f40 con 0x7ff9c0106f10 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c7d48640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c0111dc0 con 0x7ff9c0102790 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c7d48640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff9c01120c0 con 0x7ff9c0101de0 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c62e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0106f10 0x7ff9c019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c62e5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0106f10 0x7ff9c019ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46622/0 (socket says 172.21.15.70:46622) 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.075+0000 7ff9c62e5640 1 -- 172.21.15.70:0/2767048186 learned_addr learned my addr 172.21.15.70:0/2767048186 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c52e3640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9c0102790 0x7ff9c0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c5ae4640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c0101de0 0x7ff9c0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:10.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c62e5640 1 -- 172.21.15.70:0/2767048186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c0101de0 msgr2=0x7ff9c0198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c62e5640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c0101de0 0x7ff9c0198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c62e5640 1 -- 172.21.15.70:0/2767048186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9c0102790 msgr2=0x7ff9c0198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c62e5640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9c0102790 0x7ff9c0198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c62e5640 1 -- 172.21.15.70:0/2767048186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9c019d3d0 con 0x7ff9c0106f10 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c62e5640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0106f10 0x7ff9c019ccf0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800eaa0 tx=0x7ff9b800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9b6ffd640 1 -- 172.21.15.70:0/2767048186 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b800cdb0 con 0x7ff9c0106f10 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9c019d6c0 con 0x7ff9c0106f10 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9b6ffd640 1 -- 172.21.15.70:0/2767048186 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff9b8005020 con 0x7ff9c0106f10 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9b6ffd640 1 -- 172.21.15.70:0/2767048186 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9b80116d0 con 0x7ff9c0106f10 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.076+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9c01a4fa0 con 0x7ff9c0106f10 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.077+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9c01021c0 con 0x7ff9c0106f10 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.078+0000 7ff9b6ffd640 1 -- 172.21.15.70:0/2767048186 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff9b80051d0 con 0x7ff9c0106f10 2024-09-19T04:38:10.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.079+0000 7ff9b6ffd640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff9ac0a33b0 0x7ff9ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:10.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.079+0000 7ff9c5ae4640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff9ac0a33b0 0x7ff9ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:10.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.079+0000 7ff9b6ffd640 1 -- 172.21.15.70:0/2767048186 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7ff9b80d03c0 con 0x7ff9c0106f10 2024-09-19T04:38:10.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.079+0000 7ff9c5ae4640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff9ac0a33b0 0x7ff9ac0a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc005ab0 tx=0x7ff9bc005a20 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:10.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.082+0000 7ff9b6ffd640 1 -- 172.21.15.70:0/2767048186 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff9b8016030 con 0x7ff9c0106f10 2024-09-19T04:38:10.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.286+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9c010a0f0 con 0x7ff9c0106f10 2024-09-19T04:38:10.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.287+0000 7ff9b6ffd640 1 -- 172.21.15.70:0/2767048186 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7ff9b809cd70 con 0x7ff9c0106f10 2024-09-19T04:38:10.289 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:38:10.289 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:38:10.290 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:38:10.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff9ac0a33b0 msgr2=0x7ff9ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:10.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff9ac0a33b0 0x7ff9ac0a5870 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc005ab0 tx=0x7ff9bc005a20 comp rx=0 tx=0).stop 2024-09-19T04:38:10.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0106f10 msgr2=0x7ff9c019ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:10.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0106f10 0x7ff9c019ccf0 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7ff9b800eaa0 tx=0x7ff9b800ef60 comp rx=0 tx=0).stop 2024-09-19T04:38:10.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 shutdown_connections 2024-09-19T04:38:10.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff9ac0a33b0 0x7ff9ac0a5870 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff9c0106f10 0x7ff9c019ccf0 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9c0102790 0x7ff9c0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 --2- 172.21.15.70:0/2767048186 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff9c0101de0 0x7ff9c0198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:10.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.289+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 >> 172.21.15.70:0/2767048186 conn(0x7ff9c00fd8c0 msgr2=0x7ff9c00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:10.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.290+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 shutdown_connections 2024-09-19T04:38:10.292 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:10.290+0000 7ff9c7d48640 1 -- 172.21.15.70:0/2767048186 wait complete. 2024-09-19T04:38:10.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:10 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2767048186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:10.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:10 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2767048186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:10 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2767048186' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:10.965 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:38:11.211 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:11.604 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:11 smithi070 ceph-mon[30942]: pgmap v228: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 -- 172.21.15.70:0/1314039703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 msgr2=0x7f32081029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 --2- 172.21.15.70:0/1314039703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 0x7f32081029b0 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7f31fc009900 tx=0x7f31fc02a480 comp rx=0 tx=0).stop 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 -- 172.21.15.70:0/1314039703 shutdown_connections 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 --2- 172.21.15.70:0/1314039703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3208102ef0 0x7f320810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 --2- 172.21.15.70:0/1314039703 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 0x7f32081029b0 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 --2- 172.21.15.70:0/1314039703 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208100e20 0x7f3208101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 -- 172.21.15.70:0/1314039703 >> 172.21.15.70:0/1314039703 conn(0x7f32080fc7d0 msgr2=0x7f32080febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 -- 172.21.15.70:0/1314039703 shutdown_connections 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 -- 172.21.15.70:0/1314039703 wait complete. 2024-09-19T04:38:11.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 Processor -- start 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 -- start start 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.682+0000 7f3210212640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3208100e20 0x7f32081992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f3210212640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 0x7f3208199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f3210212640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ef0 0x7f32081a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f3210212640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3208110f20 con 0x7f3208102570 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f3210212640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3208110da0 con 0x7f3208100e20 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f3210212640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32081110a0 con 0x7f3208102ef0 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 0x7f3208199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 0x7f3208199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46638/0 (socket says 172.21.15.70:46638) 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 -- 172.21.15.70:0/1253929153 learned_addr learned my addr 172.21.15.70:0/1253929153 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320e7af640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ef0 0x7f32081a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320dfae640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3208100e20 0x7f32081992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 -- 172.21.15.70:0/1253929153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ef0 msgr2=0x7f32081a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ef0 0x7f32081a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 -- 172.21.15.70:0/1253929153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3208100e20 msgr2=0x7f32081992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3208100e20 0x7f32081992f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 -- 172.21.15.70:0/1253929153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32081a48b0 con 0x7f3208102570 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f320d7ad640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 0x7f3208199830 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f31fc005940 tx=0x7f31fc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f31faffd640 1 -- 172.21.15.70:0/1253929153 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc03f030 con 0x7f3208102570 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f31faffd640 1 -- 172.21.15.70:0/1253929153 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f31fc003ac0 con 0x7f3208102570 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f3210212640 1 -- 172.21.15.70:0/1253929153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32081a4a80 con 0x7f3208102570 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.683+0000 7f31faffd640 1 -- 172.21.15.70:0/1253929153 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31fc035070 con 0x7f3208102570 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.684+0000 7f3210212640 1 -- 172.21.15.70:0/1253929153 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32081a4ed0 con 0x7f3208102570 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.686+0000 7f32125eb740 1 Processor -- start 2024-09-19T04:38:11.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.686+0000 7f32125eb740 1 -- start start 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f32125eb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d367090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f32125eb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d367a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f32125eb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d378b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f32125eb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a6d2cd2f0 con 0x561a6d376780 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f32125eb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561a6d274cf0 con 0x561a6d3675d0 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f32125eb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a6d2c92b0 con 0x561a6d368b40 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f31faffd640 1 -- 172.21.15.70:0/1253929153 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f31fc042030 con 0x7f3208102570 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320e7af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d367090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320e7af640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d367090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.167:3300/0 says I am v2:172.21.15.70:48374/0 (socket says 172.21.15.70:48374) 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320e7af640 1 -- 172.21.15.70:0/894625254 learned_addr learned my addr 172.21.15.70:0/894625254 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320d7ad640 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d378b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320dfae640 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d367a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320e7af640 1 -- 172.21.15.70:0/894625254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 msgr2=0x561a6d367a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320e7af640 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d367a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320e7af640 1 -- 172.21.15.70:0/894625254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 msgr2=0x561a6d378b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320e7af640 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d378b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320e7af640 1 -- 172.21.15.70:0/894625254 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6d2593a0 con 0x561a6d368b40 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.687+0000 7f320dfae640 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d367a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.688+0000 7f320e7af640 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d367090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3200007ec0 tx=0x7f320000f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=93e3e0cfdbebcf5e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.688+0000 7f31faffd640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f31f40a33b0 0x7f31f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.688+0000 7f31f3fff640 1 -- 172.21.15.70:0/894625254 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200010840 con 0x561a6d368b40 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.688+0000 7f31f3fff640 1 -- 172.21.15.70:0/894625254 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f32000183f0 con 0x561a6d368b40 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.688+0000 7f31f3fff640 1 -- 172.21.15.70:0/894625254 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32000175e0 con 0x561a6d368b40 2024-09-19T04:38:11.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.688+0000 7f320dfae640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f31f40a33b0 0x7f31f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.688+0000 7f31faffd640 1 -- 172.21.15.70:0/1253929153 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f31fc0f0530 con 0x7f3208102570 2024-09-19T04:38:11.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 -- 172.21.15.70:0/894625254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 msgr2=0x561a6d367090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f320dfae640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f31f40a33b0 0x7f31f40a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x561a6d364ac0 tx=0x7f320400a2d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:11.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d367090 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3200007ec0 tx=0x7f320000f790 comp rx=0 tx=0).stop 2024-09-19T04:38:11.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 -- 172.21.15.70:0/894625254 shutdown_connections 2024-09-19T04:38:11.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d378b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d367a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 --2- 172.21.15.70:0/894625254 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d367090 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 -- 172.21.15.70:0/894625254 >> 172.21.15.70:0/894625254 conn(0x561a6d330310 msgr2=0x561a6d363c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 -- 172.21.15.70:0/894625254 shutdown_connections 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 -- 172.21.15.70:0/894625254 wait complete. 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 -- start start 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.689+0000 7f32125eb740 1 Processor -- start 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f32125eb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d376110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f32125eb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d3733c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f32125eb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d373940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f32125eb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561a6d379480 con 0x561a6d376780 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f32125eb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561a6d288060 con 0x561a6d3675d0 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f32125eb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561a6d379600 con 0x561a6d368b40 2024-09-19T04:38:11.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f32125eb740 10 client.0 _ll_register_callbacks cb 0x561a6cfdb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d373940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d373940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46664/0 (socket says 172.21.15.70:46664) 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 -- 172.21.15.70:0/2154454782 learned_addr learned my addr 172.21.15.70:0/2154454782 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320d7ad640 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d3733c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320dfae640 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d376110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 -- 172.21.15.70:0/2154454782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 msgr2=0x561a6d3733c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d3733c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 -- 172.21.15.70:0/2154454782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 msgr2=0x561a6d376110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d376110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 -- 172.21.15.70:0/2154454782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6d03e3c0 con 0x561a6d376780 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320dfae640 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d376110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f320e7af640 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d373940 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3200018e40 tx=0x7f3200007340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ed284df22d92860 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.690+0000 7f31f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:11.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f31f17fa640 1 -- 172.21.15.70:0/2154454782 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200026020 con 0x561a6d376780 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 1 -- 172.21.15.70:0/2154454782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32000183f0 con 0x561a6d376780 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f31f17fa640 1 -- 172.21.15.70:0/2154454782 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f3200003b80 con 0x561a6d376780 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f31f17fa640 1 -- 172.21.15.70:0/2154454782 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3200031050 con 0x561a6d376780 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 10 client.17316 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 1 -- 172.21.15.70:0/2154454782 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561a6d384ee0 con 0x561a6d376780 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f31f17fa640 1 -- 172.21.15.70:0/2154454782 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f32000183f0 con 0x561a6d376780 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f31f17fa640 1 -- 172.21.15.70:0/2154454782 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f32000040d0 con 0x561a6d376780 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 10 client.17316 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 10 client.17316 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 20 client.17316 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x561a6d386340 0x561a6d388730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 4 client.17316 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f32125eb740 1 -- 172.21.15.70:0/2154454782 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a6d2da860 con 0x561a6d386340 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.691+0000 7f320dfae640 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x561a6d386340 0x561a6d388730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.692+0000 7f320dfae640 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x561a6d386340 0x561a6d388730 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6827e6d186a7a024 server_cookie=dbf7159d857f4a25 in_seq=0 out_seq=0 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.692+0000 7f31f17fa640 10 client.17316 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.692+0000 7f31f17fa640 1 -- 172.21.15.70:0/2154454782 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561a6d2da860 con 0x561a6d386340 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.692+0000 7f31f17fa640 10 client.17316 handle_command_reply: tid=0 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 client.17316 shutdown 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 -- 172.21.15.70:0/2154454782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 msgr2=0x561a6d373940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d373940 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f3200018e40 tx=0x7f3200007340 comp rx=0 tx=0).stop 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 -- 172.21.15.70:0/2154454782 shutdown_connections 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x561a6d386340 0x561a6d388730 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d373940 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d3733c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f31f17fa640 0 client.17316 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:11.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 --2- 172.21.15.70:0/2154454782 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d376110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 -- 172.21.15.70:0/2154454782 >> 172.21.15.70:0/2154454782 conn(0x561a6d330310 msgr2=0x561a6d369960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:11.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 -- 172.21.15.70:0/2154454782 shutdown_connections 2024-09-19T04:38:11.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 1 -- 172.21.15.70:0/2154454782 wait complete. 2024-09-19T04:38:11.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.693+0000 7f32125eb740 20 client.17316 trim_cache size 0 max 16384 2024-09-19T04:38:11.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f32125eb740 1 Processor -- start 2024-09-19T04:38:11.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f32125eb740 1 -- start start 2024-09-19T04:38:11.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f32125eb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d3675d0 0x561a6d382750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f32125eb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d368b40 0x561a6d3723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f32125eb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d38dcd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f32125eb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32081adf10 con 0x561a6d376780 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f32125eb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32081ab7e0 con 0x561a6d368b40 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f32125eb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32081a9650 con 0x561a6d3675d0 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d38dcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d38dcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46672/0 (socket says 172.21.15.70:46672) 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 -- 172.21.15.70:0/2473228682 learned_addr learned my addr 172.21.15.70:0/2473228682 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320d7ad640 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d368b40 0x561a6d3723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320dfae640 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d3675d0 0x561a6d382750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 -- 172.21.15.70:0/2473228682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d3675d0 msgr2=0x561a6d382750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d3675d0 0x561a6d382750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 -- 172.21.15.70:0/2473228682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d368b40 msgr2=0x561a6d3723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d368b40 0x561a6d3723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 -- 172.21.15.70:0/2473228682 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a6d3683a0 con 0x561a6d376780 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.706+0000 7f320e7af640 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d38dcd0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3200007580 tx=0x7f3200007d10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd9e42984bd61946 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f31f37fe640 1 -- 172.21.15.70:0/2473228682 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320003b070 con 0x561a6d376780 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f31f37fe640 1 -- 172.21.15.70:0/2473228682 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f32000183f0 con 0x561a6d376780 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f31f37fe640 1 -- 172.21.15.70:0/2473228682 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3200026070 con 0x561a6d376780 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 -- 172.21.15.70:0/2473228682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 msgr2=0x561a6d38dcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d38dcd0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f3200007580 tx=0x7f3200007d10 comp rx=0 tx=0).stop 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 -- 172.21.15.70:0/2473228682 shutdown_connections 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d38dcd0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d368b40 0x561a6d3723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 --2- 172.21.15.70:0/2473228682 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d3675d0 0x561a6d382750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 -- 172.21.15.70:0/2473228682 >> 172.21.15.70:0/2473228682 conn(0x561a6d330310 msgr2=0x561a6d371c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 -- 172.21.15.70:0/2473228682 shutdown_connections 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.707+0000 7f32125eb740 1 -- 172.21.15.70:0/2473228682 wait complete. 2024-09-19T04:38:11.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 1 -- start start 2024-09-19T04:38:11.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 1 Processor -- start 2024-09-19T04:38:11.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:11 smithi167 ceph-mon[34339]: pgmap v228: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d37ef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d37a250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d37a790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f32081a9ca0 con 0x561a6d376780 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f32081ab110 con 0x561a6d3675d0 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f32081aa370 con 0x561a6d368b40 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f32125eb740 10 client.0 _ll_register_callbacks cb 0x7f31fc0f3eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f320e7af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d37a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f320e7af640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d37a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46676/0 (socket says 172.21.15.70:46676) 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f320e7af640 1 -- 172.21.15.70:0/1842093037 learned_addr learned my addr 172.21.15.70:0/1842093037 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f320dfae640 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d37ef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.708+0000 7f320d7ad640 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d37a250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f320e7af640 1 -- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 msgr2=0x561a6d37a250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f320e7af640 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d37a250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f320e7af640 1 -- 172.21.15.70:0/1842093037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 msgr2=0x561a6d37ef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f320e7af640 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d37ef20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f320e7af640 1 -- 172.21.15.70:0/1842093037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a6d37afc0 con 0x561a6d376780 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f320d7ad640 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d37a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f320e7af640 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d37a790 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3200018db0 tx=0x7f3200018920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8d155590b5fe89 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f31f17fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f31f17fa640 1 -- 172.21.15.70:0/1842093037 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f320003b070 con 0x561a6d376780 2024-09-19T04:38:11.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f31f17fa640 1 -- 172.21.15.70:0/1842093037 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f32000041a0 con 0x561a6d376780 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f32125eb740 1 -- 172.21.15.70:0/1842093037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f32000183f0 con 0x561a6d376780 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f31f17fa640 1 -- 172.21.15.70:0/1842093037 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3200047050 con 0x561a6d376780 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f32125eb740 10 client.17322 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f32125eb740 1 -- 172.21.15.70:0/1842093037 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561a6d3f0bb0 con 0x561a6d376780 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f31f17fa640 1 -- 172.21.15.70:0/1842093037 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f32000183f0 con 0x561a6d376780 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f31f17fa640 1 -- 172.21.15.70:0/1842093037 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3200010a40 con 0x561a6d376780 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f32125eb740 10 client.17322 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.709+0000 7f32125eb740 10 client.17322 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f32125eb740 20 client.17322 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f32125eb740 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x561a6d3f1190 0x561a6d3f35b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f32125eb740 4 client.17322 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:11.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f32125eb740 1 -- 172.21.15.70:0/1842093037 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x561a6d2d4d70 con 0x561a6d3f1190 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f320dfae640 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x561a6d3f1190 0x561a6d3f35b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f31f17fa640 10 client.17322 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f320dfae640 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x561a6d3f1190 0x561a6d3f35b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=89832bff5f70cef4 server_cookie=c458f93d49459c86 in_seq=0 out_seq=0 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f31f17fa640 1 -- 172.21.15.70:0/1842093037 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x561a6d2d4d70 con 0x561a6d3f1190 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f31f17fa640 10 client.17322 handle_command_reply: tid=0 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f32125eb740 1 client.17322 shutdown 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.710+0000 7f32125eb740 1 -- 172.21.15.70:0/1842093037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 msgr2=0x561a6d37a790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d37a790 secure :-1 s=READY pgs=1024 cs=0 l=1 rev1=1 crypto rx=0x7f3200018db0 tx=0x7f3200018920 comp rx=0 tx=0).stop 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 -- 172.21.15.70:0/1842093037 shutdown_connections 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x561a6d3f1190 0x561a6d3f35b0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561a6d376780 0x561a6d37a790 unknown :-1 s=CLOSED pgs=1024 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561a6d368b40 0x561a6d37a250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f31f17fa640 0 client.17322 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:11.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 --2- 172.21.15.70:0/1842093037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561a6d3675d0 0x561a6d37ef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 -- 172.21.15.70:0/1842093037 >> 172.21.15.70:0/1842093037 conn(0x561a6d330310 msgr2=0x561a6d3724b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:11.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 -- 172.21.15.70:0/1842093037 shutdown_connections 2024-09-19T04:38:11.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 1 -- 172.21.15.70:0/1842093037 wait complete. 2024-09-19T04:38:11.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f32125eb740 20 client.17322 trim_cache size 0 max 16384 2024-09-19T04:38:11.719 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:11.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f3210212640 1 -- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f31f40a33b0 msgr2=0x7f31f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f3210212640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f31f40a33b0 0x7f31f40a5870 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x561a6d364ac0 tx=0x7f320400a2d0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f3210212640 1 -- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 msgr2=0x7f3208199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:11.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f3210212640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 0x7f3208199830 secure :-1 s=READY pgs=1021 cs=0 l=1 rev1=1 crypto rx=0x7f31fc005940 tx=0x7f31fc004270 comp rx=0 tx=0).stop 2024-09-19T04:38:11.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.711+0000 7f3210212640 1 -- 172.21.15.70:0/1253929153 shutdown_connections 2024-09-19T04:38:11.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.712+0000 7f3210212640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f31f40a33b0 0x7f31f40a5870 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.712+0000 7f3210212640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3208102ef0 0x7f32081a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.712+0000 7f3210212640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3208102570 0x7f3208199830 unknown :-1 s=CLOSED pgs=1021 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.712+0000 7f3210212640 1 --2- 172.21.15.70:0/1253929153 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3208100e20 0x7f32081992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:11.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.712+0000 7f3210212640 1 -- 172.21.15.70:0/1253929153 >> 172.21.15.70:0/1253929153 conn(0x7f32080fc7d0 msgr2=0x7f3208106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:11.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.712+0000 7f3210212640 1 -- 172.21.15.70:0/1253929153 shutdown_connections 2024-09-19T04:38:11.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:11.712+0000 7f3210212640 1 -- 172.21.15.70:0/1253929153 wait complete. 2024-09-19T04:38:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:11 smithi134 ceph-mon[34525]: pgmap v228: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:38:12.448 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:38:12.700 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:12 smithi134 ceph-mon[34525]: pgmap v229: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:13.069 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:12 smithi070 ceph-mon[30942]: pgmap v229: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:13.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 -- 172.21.15.70:0/851439350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520102790 msgr2=0x7f65201067e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 --2- 172.21.15.70:0/851439350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520102790 0x7f65201067e0 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f6508009900 tx=0x7f650802a410 comp rx=0 tx=0).stop 2024-09-19T04:38:13.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 -- 172.21.15.70:0/851439350 shutdown_connections 2024-09-19T04:38:13.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 --2- 172.21.15.70:0/851439350 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6520106f10 0x7f652010ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 --2- 172.21.15.70:0/851439350 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520102790 0x7f65201067e0 unknown :-1 s=CLOSED pgs=1025 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 --2- 172.21.15.70:0/851439350 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6520101de0 0x7f65201021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 -- 172.21.15.70:0/851439350 >> 172.21.15.70:0/851439350 conn(0x7f65200fd8c0 msgr2=0x7f65200ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 -- 172.21.15.70:0/851439350 shutdown_connections 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.148+0000 7f6524ecd640 1 -- 172.21.15.70:0/851439350 wait complete. 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f6524ecd640 1 Processor -- start 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f6524ecd640 1 -- start start 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f6524ecd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6520101de0 0x7f65201984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f6524ecd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6520102790 0x7f6520198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f6524ecd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520106f10 0x7f652019cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f6524ecd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6520111f40 con 0x7f6520106f10 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f6524ecd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6520111dc0 con 0x7f6520101de0 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f6524ecd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65201120c0 con 0x7f6520102790 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520106f10 0x7f652019cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520106f10 0x7f652019cd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46698/0 (socket says 172.21.15.70:46698) 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.149+0000 7f651ed9d640 1 -- 172.21.15.70:0/3882232007 learned_addr learned my addr 172.21.15.70:0/3882232007 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651dd9b640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6520102790 0x7f6520198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651e59c640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6520101de0 0x7f65201984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651ed9d640 1 -- 172.21.15.70:0/3882232007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6520102790 msgr2=0x7f6520198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651ed9d640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6520102790 0x7f6520198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651ed9d640 1 -- 172.21.15.70:0/3882232007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6520101de0 msgr2=0x7f65201984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651ed9d640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6520101de0 0x7f65201984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651ed9d640 1 -- 172.21.15.70:0/3882232007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f652019d470 con 0x7f6520106f10 2024-09-19T04:38:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651dd9b640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6520102790 0x7f6520198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651e59c640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6520101de0 0x7f65201984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f651ed9d640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520106f10 0x7f652019cd90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f651000c970 tx=0x7f651000ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f65177fe640 1 -- 172.21.15.70:0/3882232007 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510007bb0 con 0x7f6520106f10 2024-09-19T04:38:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f65177fe640 1 -- 172.21.15.70:0/3882232007 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6510007d50 con 0x7f6520106f10 2024-09-19T04:38:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f6524ecd640 1 -- 172.21.15.70:0/3882232007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f652019d760 con 0x7f6520106f10 2024-09-19T04:38:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f65177fe640 1 -- 172.21.15.70:0/3882232007 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651000f450 con 0x7f6520106f10 2024-09-19T04:38:13.156 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.150+0000 7f6524ecd640 1 -- 172.21.15.70:0/3882232007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65201a5040 con 0x7f6520106f10 2024-09-19T04:38:13.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.152+0000 7f65177fe640 1 -- 172.21.15.70:0/3882232007 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6510004ef0 con 0x7f6520106f10 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65272a6740 1 Processor -- start 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65272a6740 1 -- start start 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65177fe640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f650c0a33b0 0x7f650c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65272a6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 0x55fcd4a11090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65272a6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a115d0 0x55fcd4a11a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65272a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a1e760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65272a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fcd49772f0 con 0x55fcd4a1c370 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65272a6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fcd491ecf0 con 0x55fcd4a115d0 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65272a6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fcd49732b0 con 0x55fcd4a12b40 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f651dd9b640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f650c0a33b0 0x7f650c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a1e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a1e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46706/0 (socket says 172.21.15.70:46706) 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f65177fe640 1 -- 172.21.15.70:0/3882232007 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f65100cfa80 con 0x7f6520106f10 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f651ed9d640 1 -- 172.21.15.70:0/229554631 learned_addr learned my addr 172.21.15.70:0/229554631 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.153+0000 7f651e59c640 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 0x55fcd4a11090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651dd9b640 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a115d0 0x55fcd4a11a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651ed9d640 1 -- 172.21.15.70:0/229554631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 msgr2=0x55fcd4a11090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651ed9d640 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 0x55fcd4a11090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651ed9d640 1 -- 172.21.15.70:0/229554631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a115d0 msgr2=0x55fcd4a11a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651ed9d640 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a115d0 0x55fcd4a11a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651ed9d640 1 -- 172.21.15.70:0/229554631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd49033a0 con 0x55fcd4a1c370 2024-09-19T04:38:13.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651dd9b640 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a115d0 0x55fcd4a11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651ed9d640 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a1e760 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f65100cd7a0 tx=0x7f651009b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e05368348672b4ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f651dd9b640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f650c0a33b0 0x7f650c0a5870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f65200ffe30 tx=0x7f65080095f0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f6514ff9640 1 -- 172.21.15.70:0/229554631 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510047e60 con 0x55fcd4a1c370 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f6514ff9640 1 -- 172.21.15.70:0/229554631 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f65100055f0 con 0x55fcd4a1c370 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.154+0000 7f6514ff9640 1 -- 172.21.15.70:0/229554631 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651001d070 con 0x55fcd4a1c370 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 -- 172.21.15.70:0/229554631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 msgr2=0x55fcd4a1e760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a1e760 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f65100cd7a0 tx=0x7f651009b690 comp rx=0 tx=0).stop 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 -- 172.21.15.70:0/229554631 shutdown_connections 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a1e760 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a115d0 0x55fcd4a11a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 --2- 172.21.15.70:0/229554631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 0x55fcd4a11090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 -- 172.21.15.70:0/229554631 >> 172.21.15.70:0/229554631 conn(0x55fcd49da310 msgr2=0x55fcd4a0dc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:13.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 -- 172.21.15.70:0/229554631 shutdown_connections 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 -- 172.21.15.70:0/229554631 wait complete. 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 -- start start 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.155+0000 7f65272a6740 1 Processor -- start 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f65272a6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a1bda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f65272a6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a19050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f65272a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a197e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f65272a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4a23480 con 0x55fcd4a1c370 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f65272a6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4932060 con 0x55fcd4a12b40 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f65272a6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55fcd4a23600 con 0x55fcd4a115d0 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f65272a6740 10 client.0 _ll_register_callbacks cb 0x55fcd46858c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a197e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a197e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46720/0 (socket says 172.21.15.70:46720) 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 -- 172.21.15.70:0/348991099 learned_addr learned my addr 172.21.15.70:0/348991099 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:13.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651dd9b640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a19050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651e59c640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a1bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 -- 172.21.15.70:0/348991099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 msgr2=0x55fcd4a1bda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a1bda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 -- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 msgr2=0x55fcd4a19050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a19050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 -- 172.21.15.70:0/348991099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd46e83c0 con 0x55fcd4a1c370 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651dd9b640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a19050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651e59c640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a1bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f651ed9d640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a197e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f651009b9e0 tx=0x7f65100cd180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8265136e6a2b3917 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f6505ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f6505ffb640 1 -- 172.21.15.70:0/348991099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f651001d070 con 0x55fcd4a1c370 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f6505ffb640 1 -- 172.21.15.70:0/348991099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f6510014210 con 0x55fcd4a1c370 2024-09-19T04:38:13.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.156+0000 7f65272a6740 1 -- 172.21.15.70:0/348991099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fcd4984860 con 0x55fcd4a1c370 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f6505ffb640 1 -- 172.21.15.70:0/348991099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6510078ef0 con 0x55fcd4a1c370 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f65272a6740 10 client.17334 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f65272a6740 1 -- 172.21.15.70:0/348991099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fcd4a2eed0 con 0x55fcd4a1c370 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f6505ffb640 1 -- 172.21.15.70:0/348991099 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55fcd4984860 con 0x55fcd4a1c370 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f6505ffb640 1 -- 172.21.15.70:0/348991099 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f65100b2020 con 0x55fcd4a1c370 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f65272a6740 10 client.17334 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f65272a6740 10 client.17334 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f65272a6740 20 client.17334 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f65272a6740 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55fcd4a30220 0x55fcd4a32610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f65272a6740 4 client.17334 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f65272a6740 1 -- 172.21.15.70:0/348991099 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcd497ed70 con 0x55fcd4a30220 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.157+0000 7f651e59c640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55fcd4a30220 0x55fcd4a32610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.158+0000 7f651e59c640 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55fcd4a30220 0x55fcd4a32610 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=628344aa2616846f server_cookie=b5338f6d434f4536 in_seq=0 out_seq=0 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.158+0000 7f6505ffb640 10 client.17334 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:13.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f6505ffb640 1 -- 172.21.15.70:0/348991099 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55fcd497ed70 con 0x55fcd4a30220 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f6505ffb640 10 client.17334 handle_command_reply: tid=0 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 client.17334 shutdown 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 -- 172.21.15.70:0/348991099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 msgr2=0x55fcd4a197e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a197e0 secure :-1 s=READY pgs=1028 cs=0 l=1 rev1=1 crypto rx=0x7f651009b9e0 tx=0x7f65100cd180 comp rx=0 tx=0).stop 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 -- 172.21.15.70:0/348991099 shutdown_connections 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55fcd4a30220 0x55fcd4a32610 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a197e0 unknown :-1 s=CLOSED pgs=1028 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a19050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f6505ffb640 0 client.17334 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 --2- 172.21.15.70:0/348991099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a1bda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 -- 172.21.15.70:0/348991099 >> 172.21.15.70:0/348991099 conn(0x55fcd49da310 msgr2=0x55fcd4a13990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 -- 172.21.15.70:0/348991099 shutdown_connections 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 1 -- 172.21.15.70:0/348991099 wait complete. 2024-09-19T04:38:13.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.159+0000 7f65272a6740 20 client.17334 trim_cache size 0 max 16384 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f65272a6740 1 Processor -- start 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f65272a6740 1 -- start start 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f65272a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a115d0 0x55fcd4a14120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f65272a6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 0x55fcd4a14660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f65272a6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a1c370 0x55fcd4a162b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f65272a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65201adff0 con 0x55fcd4a115d0 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f65272a6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f65201ab8c0 con 0x55fcd4a1c370 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f65272a6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65201a9710 con 0x55fcd4a12b40 2024-09-19T04:38:13.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a115d0 0x55fcd4a14120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a115d0 0x55fcd4a14120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46722/0 (socket says 172.21.15.70:46722) 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 -- 172.21.15.70:0/5681901 learned_addr learned my addr 172.21.15.70:0/5681901 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 -- 172.21.15.70:0/5681901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 msgr2=0x55fcd4a14660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 --2- 172.21.15.70:0/5681901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 0x55fcd4a14660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 -- 172.21.15.70:0/5681901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a1c370 msgr2=0x55fcd4a162b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 --2- 172.21.15.70:0/5681901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a1c370 0x55fcd4a162b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 -- 172.21.15.70:0/5681901 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcd4a235f0 con 0x55fcd4a115d0 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f651e59c640 1 --2- 172.21.15.70:0/5681901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a115d0 0x55fcd4a14120 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x55fcd4a23560 tx=0x7f65180096b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fd72c510fe24f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.172+0000 7f6507fff640 1 -- 172.21.15.70:0/5681901 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518024070 con 0x55fcd4a115d0 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f6507fff640 1 -- 172.21.15.70:0/5681901 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6518011dc0 con 0x55fcd4a115d0 2024-09-19T04:38:13.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f6507fff640 1 -- 172.21.15.70:0/5681901 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6518004790 con 0x55fcd4a115d0 2024-09-19T04:38:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 -- 172.21.15.70:0/5681901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a115d0 msgr2=0x55fcd4a14120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 --2- 172.21.15.70:0/5681901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a115d0 0x55fcd4a14120 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x55fcd4a23560 tx=0x7f65180096b0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 -- 172.21.15.70:0/5681901 shutdown_connections 2024-09-19T04:38:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 --2- 172.21.15.70:0/5681901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a1c370 0x55fcd4a162b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 --2- 172.21.15.70:0/5681901 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a12b40 0x55fcd4a14660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 --2- 172.21.15.70:0/5681901 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a115d0 0x55fcd4a14120 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 -- 172.21.15.70:0/5681901 >> 172.21.15.70:0/5681901 conn(0x55fcd49da310 msgr2=0x55fcd4a1b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 -- 172.21.15.70:0/5681901 shutdown_connections 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 -- 172.21.15.70:0/5681901 wait complete. 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.173+0000 7f65272a6740 1 -- start start 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f65272a6740 1 Processor -- start 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f65272a6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a35dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f65272a6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a21c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f65272a6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a22180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f65272a6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f65201a9d80 con 0x55fcd4a1c370 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f65272a6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f65201ab1f0 con 0x55fcd4a12b40 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f65272a6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f65201aa450 con 0x55fcd4a115d0 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f65272a6740 10 client.0 _ll_register_callbacks cb 0x7f6518009720 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a22180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a22180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46734/0 (socket says 172.21.15.70:46734) 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 -- 172.21.15.70:0/2366856306 learned_addr learned my addr 172.21.15.70:0/2366856306 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651e59c640 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a35dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651dd9b640 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a21c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 -- 172.21.15.70:0/2366856306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 msgr2=0x55fcd4a35dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a35dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 -- 172.21.15.70:0/2366856306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 msgr2=0x55fcd4a21c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a21c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 -- 172.21.15.70:0/2366856306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcd4a0e960 con 0x55fcd4a1c370 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f651ed9d640 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a22180 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6510098190 tx=0x7f65100048b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acbbef8499e6c82c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.174+0000 7f6505ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f6505ffb640 1 -- 172.21.15.70:0/2366856306 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6510078f40 con 0x55fcd4a1c370 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f6505ffb640 1 -- 172.21.15.70:0/2366856306 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8571+0+0 (secure 0 0 0) 0x7f65100a4510 con 0x55fcd4a1c370 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 1 -- 172.21.15.70:0/2366856306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6518011dc0 con 0x55fcd4a1c370 2024-09-19T04:38:13.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f6505ffb640 1 -- 172.21.15.70:0/2366856306 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f65100046c0 con 0x55fcd4a1c370 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 10 client.17340 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 1 -- 172.21.15.70:0/2366856306 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55fcd4a344e0 con 0x55fcd4a1c370 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f6505ffb640 1 -- 172.21.15.70:0/2366856306 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6518011dc0 con 0x55fcd4a1c370 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f6505ffb640 1 -- 172.21.15.70:0/2366856306 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f65100b2040 con 0x55fcd4a1c370 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 10 client.17340 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 10 client.17340 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 20 client.17340 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55fcd4a9f5a0 0x55fcd4aa19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 4 client.17340 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f65272a6740 1 -- 172.21.15.70:0/2366856306 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55fcd48fb170 con 0x55fcd4a9f5a0 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.175+0000 7f651e59c640 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55fcd4a9f5a0 0x55fcd4aa19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f651e59c640 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55fcd4a9f5a0 0x55fcd4aa19c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=cc2485d5330e1075 server_cookie=a022092e348be2be in_seq=0 out_seq=0 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f6505ffb640 10 client.17340 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:13.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f6505ffb640 1 -- 172.21.15.70:0/2366856306 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55fcd48fb170 con 0x55fcd4a9f5a0 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f6505ffb640 10 client.17340 handle_command_reply: tid=0 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 client.17340 shutdown 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 -- 172.21.15.70:0/2366856306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 msgr2=0x55fcd4a22180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a22180 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7f6510098190 tx=0x7f65100048b0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 -- 172.21.15.70:0/2366856306 shutdown_connections 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55fcd4a9f5a0 0x55fcd4aa19c0 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55fcd4a1c370 0x55fcd4a22180 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55fcd4a12b40 0x55fcd4a21c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f6505ffb640 0 client.17340 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 --2- 172.21.15.70:0/2366856306 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55fcd4a115d0 0x55fcd4a35dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 -- 172.21.15.70:0/2366856306 >> 172.21.15.70:0/2366856306 conn(0x55fcd49da310 msgr2=0x55fcd4a0c4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 -- 172.21.15.70:0/2366856306 shutdown_connections 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 1 -- 172.21.15.70:0/2366856306 wait complete. 2024-09-19T04:38:13.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.176+0000 7f65272a6740 20 client.17340 trim_cache size 0 max 16384 2024-09-19T04:38:13.184 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 -- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f650c0a33b0 msgr2=0x7f650c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f650c0a33b0 0x7f650c0a5870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f65200ffe30 tx=0x7f65080095f0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 -- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520106f10 msgr2=0x7f652019cd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520106f10 0x7f652019cd90 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f651000c970 tx=0x7f651000ce30 comp rx=0 tx=0).stop 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 -- 172.21.15.70:0/3882232007 shutdown_connections 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f650c0a33b0 0x7f650c0a5870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6520106f10 0x7f652019cd90 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6520102790 0x7f6520198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 --2- 172.21.15.70:0/3882232007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6520101de0 0x7f65201984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 -- 172.21.15.70:0/3882232007 >> 172.21.15.70:0/3882232007 conn(0x7f65200fd8c0 msgr2=0x7f65200fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 -- 172.21.15.70:0/3882232007 shutdown_connections 2024-09-19T04:38:13.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:13.177+0000 7f6524ecd640 1 -- 172.21.15.70:0/3882232007 wait complete. 2024-09-19T04:38:13.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:12 smithi167 ceph-mon[34339]: pgmap v229: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:13.928 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:38:14.174 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 -- 172.21.15.70:0/182869155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158106a80 msgr2=0x7f5158106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 --2- 172.21.15.70:0/182869155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158106a80 0x7f5158106e60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7f5150009930 tx=0x7f515002a420 comp rx=0 tx=0).stop 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 -- 172.21.15.70:0/182869155 shutdown_connections 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 --2- 172.21.15.70:0/182869155 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5158101420 0x7f515810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 --2- 172.21.15.70:0/182869155 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5158100a80 0x7f5158100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 --2- 172.21.15.70:0/182869155 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158106a80 0x7f5158106e60 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 -- 172.21.15.70:0/182869155 >> 172.21.15.70:0/182869155 conn(0x7f51580fc7a0 msgr2=0x7f51580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 -- 172.21.15.70:0/182869155 shutdown_connections 2024-09-19T04:38:14.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.657+0000 7f515ff65640 1 -- 172.21.15.70:0/182869155 wait complete. 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515ff65640 1 Processor -- start 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515ff65640 1 -- start start 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515ff65640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5158100a80 0x7f5158199240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515ff65640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158101420 0x7f5158199780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515ff65640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5158106a80 0x7f51581a42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515ff65640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5158110e50 con 0x7f5158101420 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515ff65640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5158110cd0 con 0x7f5158106a80 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515ff65640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5158110fd0 con 0x7f5158100a80 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515d500640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158101420 0x7f5158199780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515d500640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158101420 0x7f5158199780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40662/0 (socket says 172.21.15.70:40662) 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515d500640 1 -- 172.21.15.70:0/3470786021 learned_addr learned my addr 172.21.15.70:0/3470786021 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:14.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515dd01640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5158100a80 0x7f5158199240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515e502640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5158106a80 0x7f51581a42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515d500640 1 -- 172.21.15.70:0/3470786021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5158100a80 msgr2=0x7f5158199240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515d500640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5158100a80 0x7f5158199240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515d500640 1 -- 172.21.15.70:0/3470786021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5158106a80 msgr2=0x7f51581a42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515d500640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5158106a80 0x7f51581a42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.658+0000 7f515d500640 1 -- 172.21.15.70:0/3470786021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51581a4800 con 0x7f5158101420 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.659+0000 7f515e502640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5158106a80 0x7f51581a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.659+0000 7f515d500640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158101420 0x7f5158199780 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f514c00d770 tx=0x7f514c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.659+0000 7f5156ffd640 1 -- 172.21.15.70:0/3470786021 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c017070 con 0x7f5158101420 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.659+0000 7f5156ffd640 1 -- 172.21.15.70:0/3470786021 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f514c0054f0 con 0x7f5158101420 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.659+0000 7f515ff65640 1 -- 172.21.15.70:0/3470786021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51581a49d0 con 0x7f5158101420 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.659+0000 7f5156ffd640 1 -- 172.21.15.70:0/3470786021 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c004d60 con 0x7f5158101420 2024-09-19T04:38:14.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.659+0000 7f515ff65640 1 -- 172.21.15.70:0/3470786021 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51581a4ec0 con 0x7f5158101420 2024-09-19T04:38:14.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.661+0000 7f5156ffd640 1 -- 172.21.15.70:0/3470786021 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f514c004f00 con 0x7f5158101420 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f516233e740 1 Processor -- start 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f516233e740 1 -- start start 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f516233e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a77090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f516233e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a775d0 0x563c70a77a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f516233e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a84760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f516233e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563c709dd2f0 con 0x563c70a775d0 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f516233e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563c70984cf0 con 0x563c70a78b40 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f516233e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563c709d92b0 con 0x563c70a82370 2024-09-19T04:38:14.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f515dd01640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a775d0 0x563c70a77a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f515dd01640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a775d0 0x563c70a77a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40666/0 (socket says 172.21.15.70:40666) 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f515dd01640 1 -- 172.21.15.70:0/2049016879 learned_addr learned my addr 172.21.15.70:0/2049016879 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f5156ffd640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f51400a33b0 0x7f51400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f515d500640 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a84760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.662+0000 7f515e502640 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a77090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515e502640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f51400a33b0 0x7f51400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f5156ffd640 1 -- 172.21.15.70:0/3470786021 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f514c0cf820 con 0x7f5158101420 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515dd01640 1 -- 172.21.15.70:0/2049016879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 msgr2=0x563c70a84760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515dd01640 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a84760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515dd01640 1 -- 172.21.15.70:0/2049016879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 msgr2=0x563c70a77090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515dd01640 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a77090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515dd01640 1 -- 172.21.15.70:0/2049016879 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c709693a0 con 0x563c70a775d0 2024-09-19T04:38:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515e502640 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a77090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515dd01640 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a775d0 0x563c70a77a10 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f5150009230 tx=0x7f5150032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6796489fd8cc86 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f515e502640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f51400a33b0 0x7f51400a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5148007fd0 tx=0x7f51480072a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f513ffff640 1 -- 172.21.15.70:0/2049016879 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150040070 con 0x563c70a775d0 2024-09-19T04:38:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f513ffff640 1 -- 172.21.15.70:0/2049016879 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5150031710 con 0x563c70a775d0 2024-09-19T04:38:14.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.663+0000 7f513ffff640 1 -- 172.21.15.70:0/2049016879 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5150035040 con 0x563c70a775d0 2024-09-19T04:38:14.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 -- 172.21.15.70:0/2049016879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a775d0 msgr2=0x563c70a77a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a775d0 0x563c70a77a10 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f5150009230 tx=0x7f5150032cc0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 -- 172.21.15.70:0/2049016879 shutdown_connections 2024-09-19T04:38:14.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a84760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a775d0 0x563c70a77a10 unknown :-1 s=CLOSED pgs=1033 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 --2- 172.21.15.70:0/2049016879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a77090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 -- 172.21.15.70:0/2049016879 >> 172.21.15.70:0/2049016879 conn(0x563c70a40310 msgr2=0x563c70a73c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 -- 172.21.15.70:0/2049016879 shutdown_connections 2024-09-19T04:38:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 -- 172.21.15.70:0/2049016879 wait complete. 2024-09-19T04:38:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.664+0000 7f516233e740 1 -- start start 2024-09-19T04:38:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f516233e740 1 Processor -- start 2024-09-19T04:38:14.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f516233e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 0x563c70a81d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f516233e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a7efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f516233e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a82370 0x563c70a7f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f516233e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563c70a89420 con 0x563c70a82370 2024-09-19T04:38:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f516233e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563c70998060 con 0x563c70a78b40 2024-09-19T04:38:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f516233e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563c70a895a0 con 0x563c70a775d0 2024-09-19T04:38:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f516233e740 10 client.0 _ll_register_callbacks cb 0x563c706eb8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:14.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515e502640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a82370 0x563c70a7f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515e502640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a82370 0x563c70a7f530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40676/0 (socket says 172.21.15.70:40676) 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515e502640 1 -- 172.21.15.70:0/3186443089 learned_addr learned my addr 172.21.15.70:0/3186443089 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515dd01640 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 0x563c70a81d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515d500640 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a7efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515e502640 1 -- 172.21.15.70:0/3186443089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 msgr2=0x563c70a81d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515e502640 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 0x563c70a81d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515e502640 1 -- 172.21.15.70:0/3186443089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 msgr2=0x563c70a7efb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515e502640 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a7efb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.665+0000 7f515e502640 1 -- 172.21.15.70:0/3186443089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c7074e3c0 con 0x563c70a82370 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f515e502640 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a82370 0x563c70a7f530 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f5148010fa0 tx=0x7f5148004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4d89ab1fdc883bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f513d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f513d7fa640 1 -- 172.21.15.70:0/3186443089 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5148024020 con 0x563c70a82370 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f513d7fa640 1 -- 172.21.15.70:0/3186443089 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f514800ed40 con 0x563c70a82370 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f516233e740 1 -- 172.21.15.70:0/3186443089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5150031710 con 0x563c70a82370 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f513d7fa640 1 -- 172.21.15.70:0/3186443089 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f514802f050 con 0x563c70a82370 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f516233e740 10 client.17352 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f516233e740 1 -- 172.21.15.70:0/3186443089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563c70a94e50 con 0x563c70a82370 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.666+0000 7f513d7fa640 1 -- 172.21.15.70:0/3186443089 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5150031710 con 0x563c70a82370 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f513d7fa640 1 -- 172.21.15.70:0/3186443089 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f514801f030 con 0x563c70a82370 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f516233e740 10 client.17352 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:14.676 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f516233e740 10 client.17352 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:14.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f516233e740 20 client.17352 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:14.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f516233e740 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563c70a96310 0x563c70a987b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f516233e740 4 client.17352 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:14.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f516233e740 1 -- 172.21.15.70:0/3186443089 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c709ea860 con 0x563c70a96310 2024-09-19T04:38:14.677 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f515dd01640 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563c70a96310 0x563c70a987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f513d7fa640 10 client.17352 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.667+0000 7f515dd01640 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563c70a96310 0x563c70a987b0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c8b4416dc1995083 server_cookie=622bb899401b542b in_seq=0 out_seq=0 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.668+0000 7f513d7fa640 1 -- 172.21.15.70:0/3186443089 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563c709ea860 con 0x563c70a96310 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.668+0000 7f513d7fa640 10 client.17352 handle_command_reply: tid=0 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.668+0000 7f516233e740 1 client.17352 shutdown 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.668+0000 7f516233e740 1 -- 172.21.15.70:0/3186443089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a82370 msgr2=0x563c70a7f530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.668+0000 7f516233e740 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a82370 0x563c70a7f530 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f5148010fa0 tx=0x7f5148004a40 comp rx=0 tx=0).stop 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 1 -- 172.21.15.70:0/3186443089 shutdown_connections 2024-09-19T04:38:14.678 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563c70a96310 0x563c70a987b0 crc :-1 s=READY pgs=168 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a82370 0x563c70a7f530 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a78b40 0x563c70a7efb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f513d7fa640 0 client.17352 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:14.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 1 --2- 172.21.15.70:0/3186443089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 0x563c70a81d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 1 -- 172.21.15.70:0/3186443089 >> 172.21.15.70:0/3186443089 conn(0x563c70a40310 msgr2=0x563c70a79930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:14.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 1 -- 172.21.15.70:0/3186443089 shutdown_connections 2024-09-19T04:38:14.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 1 -- 172.21.15.70:0/3186443089 wait complete. 2024-09-19T04:38:14.679 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.669+0000 7f516233e740 20 client.17352 trim_cache size 0 max 16384 2024-09-19T04:38:14.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f516233e740 1 Processor -- start 2024-09-19T04:38:14.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f516233e740 1 -- start start 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f516233e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 0x563c70a73e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f516233e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a926c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f516233e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a82370 0x563c70a7e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f516233e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f51581ade70 con 0x563c70a78b40 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f516233e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51581ab740 con 0x563c70a82370 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f516233e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f51581a95b0 con 0x563c70a775d0 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a926c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a926c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40692/0 (socket says 172.21.15.70:40692) 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 -- 172.21.15.70:0/3025313324 learned_addr learned my addr 172.21.15.70:0/3025313324 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515e502640 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a82370 0x563c70a7e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515dd01640 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 0x563c70a73e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 -- 172.21.15.70:0/3025313324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 msgr2=0x563c70a73e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 0x563c70a73e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 -- 172.21.15.70:0/3025313324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a82370 msgr2=0x563c70a7e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a82370 0x563c70a7e870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 -- 172.21.15.70:0/3025313324 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c70a7df60 con 0x563c70a78b40 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f515d500640 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a926c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f514c009610 tx=0x7f514c009c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2512abab453ec9c1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.682+0000 7f513f7fe640 1 -- 172.21.15.70:0/3025313324 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c020040 con 0x563c70a78b40 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f513f7fe640 1 -- 172.21.15.70:0/3025313324 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f514c09fe50 con 0x563c70a78b40 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f513f7fe640 1 -- 172.21.15.70:0/3025313324 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c0052e0 con 0x563c70a78b40 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 -- 172.21.15.70:0/3025313324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 msgr2=0x563c70a926c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a926c0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f514c009610 tx=0x7f514c009c30 comp rx=0 tx=0).stop 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 -- 172.21.15.70:0/3025313324 shutdown_connections 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a82370 0x563c70a7e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.690 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a926c0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 --2- 172.21.15.70:0/3025313324 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a775d0 0x563c70a73e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 -- 172.21.15.70:0/3025313324 >> 172.21.15.70:0/3025313324 conn(0x563c70a40310 msgr2=0x563c70a73700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 -- 172.21.15.70:0/3025313324 shutdown_connections 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.683+0000 7f516233e740 1 -- 172.21.15.70:0/3025313324 wait complete. 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 1 -- start start 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 1 Processor -- start 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a775d0 0x563c70a8f120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a8a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a8ab90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f51581a9c00 con 0x563c70a78b40 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f51581ab070 con 0x563c70a775d0 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f51581aa2d0 con 0x563c70a82370 2024-09-19T04:38:14.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f516233e740 10 client.0 _ll_register_callbacks cb 0x7f5148007a70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f515d500640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a8a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f515d500640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a8a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40704/0 (socket says 172.21.15.70:40704) 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f515d500640 1 -- 172.21.15.70:0/2304823797 learned_addr learned my addr 172.21.15.70:0/2304823797 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f515dd01640 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a775d0 0x563c70a8f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f515e502640 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a8ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f515d500640 1 -- 172.21.15.70:0/2304823797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 msgr2=0x563c70a8ab90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f515d500640 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a8ab90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.684+0000 7f515d500640 1 -- 172.21.15.70:0/2304823797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a775d0 msgr2=0x563c70a8f120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f515d500640 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a775d0 0x563c70a8f120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f515d500640 1 -- 172.21.15.70:0/2304823797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c70b000a0 con 0x563c70a78b40 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f515e502640 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a8ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:14.692 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f515d500640 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a8a450 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f514c098470 tx=0x7f514c0ccf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3aeca829a276d9e2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f513d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f513d7fa640 1 -- 172.21.15.70:0/2304823797 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f514c020070 con 0x563c70a78b40 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f513d7fa640 1 -- 172.21.15.70:0/2304823797 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f514c098110 con 0x563c70a78b40 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 1 -- 172.21.15.70:0/2304823797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f514c09fe50 con 0x563c70a78b40 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f513d7fa640 1 -- 172.21.15.70:0/2304823797 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f514c081050 con 0x563c70a78b40 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 10 client.17358 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 1 -- 172.21.15.70:0/2304823797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563c70b01240 con 0x563c70a78b40 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f513d7fa640 1 -- 172.21.15.70:0/2304823797 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f514c09fe50 con 0x563c70a78b40 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f513d7fa640 1 -- 172.21.15.70:0/2304823797 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f514c0cd190 con 0x563c70a78b40 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 10 client.17358 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 10 client.17358 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:14.693 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 20 client.17358 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563c70a96310 0x563c70b03a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 4 client.17358 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.685+0000 7f516233e740 1 -- 172.21.15.70:0/2304823797 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563c709e4d70 con 0x563c70a96310 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f515dd01640 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563c70a96310 0x563c70b03a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f515dd01640 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563c70a96310 0x563c70b03a20 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=872fd0408b658a5b server_cookie=e86e1f5089deff52 in_seq=0 out_seq=0 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f513d7fa640 10 client.17358 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f513d7fa640 1 -- 172.21.15.70:0/2304823797 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563c709e4d70 con 0x563c70a96310 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f513d7fa640 10 client.17358 handle_command_reply: tid=0 2024-09-19T04:38:14.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f516233e740 1 client.17358 shutdown 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f516233e740 1 -- 172.21.15.70:0/2304823797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 msgr2=0x563c70a8a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f516233e740 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a8a450 secure :-1 s=READY pgs=1036 cs=0 l=1 rev1=1 crypto rx=0x7f514c098470 tx=0x7f514c0ccf00 comp rx=0 tx=0).stop 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f516233e740 1 -- 172.21.15.70:0/2304823797 shutdown_connections 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.686+0000 7f516233e740 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x563c70a96310 0x563c70b03a20 crc :-1 s=READY pgs=169 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f516233e740 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563c70a82370 0x563c70a8ab90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f516233e740 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563c70a78b40 0x563c70a8a450 unknown :-1 s=CLOSED pgs=1036 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f513d7fa640 0 client.17358 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f516233e740 1 --2- 172.21.15.70:0/2304823797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563c70a775d0 0x563c70a8f120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f516233e740 1 -- 172.21.15.70:0/2304823797 >> 172.21.15.70:0/2304823797 conn(0x563c70a40310 msgr2=0x563c70a80810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:14.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f516233e740 1 -- 172.21.15.70:0/2304823797 shutdown_connections 2024-09-19T04:38:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f516233e740 1 -- 172.21.15.70:0/2304823797 wait complete. 2024-09-19T04:38:14.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f516233e740 20 client.17358 trim_cache size 0 max 16384 2024-09-19T04:38:14.696 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 -- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f51400a33b0 msgr2=0x7f51400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f51400a33b0 0x7f51400a5870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f5148007fd0 tx=0x7f51480072a0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 -- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158101420 msgr2=0x7f5158199780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158101420 0x7f5158199780 secure :-1 s=READY pgs=1032 cs=0 l=1 rev1=1 crypto rx=0x7f514c00d770 tx=0x7f514c00dc30 comp rx=0 tx=0).stop 2024-09-19T04:38:14.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 -- 172.21.15.70:0/3470786021 shutdown_connections 2024-09-19T04:38:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f51400a33b0 0x7f51400a5870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5158106a80 0x7f51581a42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5158101420 0x7f5158199780 unknown :-1 s=CLOSED pgs=1032 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 --2- 172.21.15.70:0/3470786021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5158100a80 0x7f5158199240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 -- 172.21.15.70:0/3470786021 >> 172.21.15.70:0/3470786021 conn(0x7f51580fc7a0 msgr2=0x7f51580fced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:14.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 -- 172.21.15.70:0/3470786021 shutdown_connections 2024-09-19T04:38:14.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:14.687+0000 7f515ff65640 1 -- 172.21.15.70:0/3470786021 wait complete. 2024-09-19T04:38:15.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:15 smithi070 ceph-mon[30942]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:38:15.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:15 smithi070 ceph-mon[30942]: pgmap v231: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:38:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:15 smithi134 ceph-mon[34525]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:38:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:15 smithi134 ceph-mon[34525]: pgmap v231: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:38:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:15 smithi167 ceph-mon[34339]: osdmap e88: 12 total, 12 up, 12 in 2024-09-19T04:38:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:15 smithi167 ceph-mon[34339]: pgmap v231: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:38:16.467 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:38:16.468 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:38:16.727 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:16.848 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:16 smithi070 ceph-mon[30942]: pgmap v232: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:38:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:16 smithi134 ceph-mon[34525]: pgmap v232: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:38:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 -- 172.21.15.70:0/2635649037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8101420 msgr2=0x7ff6a810d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 --2- 172.21.15.70:0/2635649037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8101420 0x7ff6a810d950 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7ff6a0009cd0 tx=0x7ff6a002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 -- 172.21.15.70:0/2635649037 shutdown_connections 2024-09-19T04:38:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 --2- 172.21.15.70:0/2635649037 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8101420 0x7ff6a810d950 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 --2- 172.21.15.70:0/2635649037 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8100a80 0x7ff6a8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 --2- 172.21.15.70:0/2635649037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a8106a80 0x7ff6a8106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 -- 172.21.15.70:0/2635649037 >> 172.21.15.70:0/2635649037 conn(0x7ff6a80fc7a0 msgr2=0x7ff6a80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:17.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 -- 172.21.15.70:0/2635649037 shutdown_connections 2024-09-19T04:38:17.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.199+0000 7ff6ad000640 1 -- 172.21.15.70:0/2635649037 wait complete. 2024-09-19T04:38:17.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.200+0000 7ff6ad000640 1 Processor -- start 2024-09-19T04:38:17.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.200+0000 7ff6ad000640 1 -- start start 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.200+0000 7ff6ad000640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8100a80 0x7ff6a81983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.200+0000 7ff6ad000640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a8101420 0x7ff6a8198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.200+0000 7ff6ad000640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8106a80 0x7ff6a819ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.200+0000 7ff6ad000640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8110e50 con 0x7ff6a8106a80 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.200+0000 7ff6ad000640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8110cd0 con 0x7ff6a8101420 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6ad000640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a8110fd0 con 0x7ff6a8100a80 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8106a80 0x7ff6a819ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8106a80 0x7ff6a819ccc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40720/0 (socket says 172.21.15.70:40720) 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 -- 172.21.15.70:0/3282639398 learned_addr learned my addr 172.21.15.70:0/3282639398 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a659c640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8100a80 0x7ff6a81983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a8101420 0x7ff6a8198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 -- 172.21.15.70:0/3282639398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8100a80 msgr2=0x7ff6a81983f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8100a80 0x7ff6a81983f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 -- 172.21.15.70:0/3282639398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a8101420 msgr2=0x7ff6a8198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a8101420 0x7ff6a8198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 -- 172.21.15.70:0/3282639398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6a819d3a0 con 0x7ff6a8106a80 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a8101420 0x7ff6a8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a659c640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8100a80 0x7ff6a81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6a6d9d640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8106a80 0x7ff6a819ccc0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00097b0 tx=0x7ff6a0003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6977fe640 1 -- 172.21.15.70:0/3282639398 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0004040 con 0x7ff6a8106a80 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6977fe640 1 -- 172.21.15.70:0/3282639398 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff6a00046b0 con 0x7ff6a8106a80 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6ad000640 1 -- 172.21.15.70:0/3282639398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6a819d630 con 0x7ff6a8106a80 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.201+0000 7ff6977fe640 1 -- 172.21.15.70:0/3282639398 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6a0046480 con 0x7ff6a8106a80 2024-09-19T04:38:17.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.202+0000 7ff6ad000640 1 -- 172.21.15.70:0/3282639398 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6a81a4f70 con 0x7ff6a8106a80 2024-09-19T04:38:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.204+0000 7ff6977fe640 1 -- 172.21.15.70:0/3282639398 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff6a0030730 con 0x7ff6a8106a80 2024-09-19T04:38:17.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.204+0000 7ff6af3d9740 1 Processor -- start 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.204+0000 7ff6af3d9740 1 -- start start 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.204+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0419e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f041a360 0x5637f0428c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f0429150 0x5637f042b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5637f037f280 con 0x5637f0429150 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5637f0326b10 con 0x5637f0419a40 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5637f037b240 con 0x5637f041a360 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6977fe640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff6900a33b0 0x7ff6900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f0429150 0x5637f042b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f0429150 0x5637f042b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40730/0 (socket says 172.21.15.70:40730) 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 -- 172.21.15.70:0/3867551633 learned_addr learned my addr 172.21.15.70:0/3867551633 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:17.211 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0419e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a659c640 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f041a360 0x5637f0428c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6977fe640 1 -- 172.21.15.70:0/3282639398 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff6a002e030 con 0x7ff6a8106a80 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a6d9d640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff6900a33b0 0x7ff6900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 -- 172.21.15.70:0/3867551633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f041a360 msgr2=0x5637f0428c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f041a360 0x5637f0428c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 -- 172.21.15.70:0/3867551633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 msgr2=0x5637f0419e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0419e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 -- 172.21.15.70:0/3867551633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f03331f0 con 0x5637f0429150 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f0429150 0x5637f042b540 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff69c005fd0 tx=0x7ff69c00b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659a4088cd9e316b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.205+0000 7ff694ff9640 1 -- 172.21.15.70:0/3867551633 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c004020 con 0x5637f0429150 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6a6d9d640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff6900a33b0 0x7ff6900a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00eec40 tx=0x7ff6a003d040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff694ff9640 1 -- 172.21.15.70:0/3867551633 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff69c00ee30 con 0x5637f0429150 2024-09-19T04:38:17.212 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff694ff9640 1 -- 172.21.15.70:0/3867551633 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff69c0038f0 con 0x5637f0429150 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 -- 172.21.15.70:0/3867551633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f0429150 msgr2=0x5637f042b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f0429150 0x5637f042b540 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7ff69c005fd0 tx=0x7ff69c00b4a0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 -- 172.21.15.70:0/3867551633 shutdown_connections 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f0429150 0x5637f042b540 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f041a360 0x5637f0428c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/3867551633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0419e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 -- 172.21.15.70:0/3867551633 >> 172.21.15.70:0/3867551633 conn(0x5637f04160f0 msgr2=0x5637f04164d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 -- 172.21.15.70:0/3867551633 shutdown_connections 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.206+0000 7ff6af3d9740 1 -- 172.21.15.70:0/3867551633 wait complete. 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 1 -- start start 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 1 Processor -- start 2024-09-19T04:38:17.213 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0419a40 0x5637f0426090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04265d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0429150 0x5637f0426b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5637f042bd20 con 0x5637f041a360 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5637f0339f10 con 0x5637f0429150 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5637f042bea0 con 0x5637f0419a40 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6af3d9740 10 client.0 _ll_register_callbacks cb 0x5637f0302a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04265d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04265d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40740/0 (socket says 172.21.15.70:40740) 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6a659c640 1 -- 172.21.15.70:0/2583076410 learned_addr learned my addr 172.21.15.70:0/2583076410 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.207+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0419a40 0x5637f0426090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0429150 0x5637f0426b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6a659c640 1 -- 172.21.15.70:0/2583076410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0419a40 msgr2=0x5637f0426090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:17.214 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6a659c640 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0419a40 0x5637f0426090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6a659c640 1 -- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0429150 msgr2=0x5637f0426b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6a659c640 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0429150 0x5637f0426b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6a659c640 1 -- 172.21.15.70:0/2583076410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f00f06a0 con 0x5637f041a360 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0429150 0x5637f0426b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6a659c640 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04265d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff69800bfb0 tx=0x7ff6980128e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3762c1cf0bb9aef2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff68dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff68dffb640 1 -- 172.21.15.70:0/2583076410 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff6980035f0 con 0x5637f041a360 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6af3d9740 1 -- 172.21.15.70:0/2583076410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff69c00ee30 con 0x5637f041a360 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff68dffb640 1 -- 172.21.15.70:0/2583076410 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff698003790 con 0x5637f041a360 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff68dffb640 1 -- 172.21.15.70:0/2583076410 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff698003990 con 0x5637f041a360 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6af3d9740 10 client.17370 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff6af3d9740 1 -- 172.21.15.70:0/2583076410 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5637f0437a10 con 0x5637f041a360 2024-09-19T04:38:17.215 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff68dffb640 1 -- 172.21.15.70:0/2583076410 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff69c00ee30 con 0x5637f041a360 2024-09-19T04:38:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.208+0000 7ff68dffb640 1 -- 172.21.15.70:0/2583076410 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff698019070 con 0x5637f041a360 2024-09-19T04:38:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff6af3d9740 10 client.17370 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff6af3d9740 10 client.17370 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff6af3d9740 20 client.17370 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5637f0438f70 0x5637f043b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff6af3d9740 4 client.17370 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff6af3d9740 1 -- 172.21.15.70:0/2583076410 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5637f038c7f0 con 0x5637f0438f70 2024-09-19T04:38:17.216 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5637f0438f70 0x5637f043b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.217 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:16 smithi167 ceph-mon[34339]: pgmap v232: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff68dffb640 10 client.17370 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.209+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5637f0438f70 0x5637f043b3b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=134095f71d6913cc server_cookie=939d2baf98cbd230 in_seq=0 out_seq=0 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff68dffb640 1 -- 172.21.15.70:0/2583076410 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5637f038c7f0 con 0x5637f0438f70 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff68dffb640 10 client.17370 handle_command_reply: tid=0 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 client.17370 shutdown 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 -- 172.21.15.70:0/2583076410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 msgr2=0x5637f04265d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04265d0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7ff69800bfb0 tx=0x7ff6980128e0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 -- 172.21.15.70:0/2583076410 shutdown_connections 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5637f0438f70 0x5637f043b3b0 crc :-1 s=READY pgs=170 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0429150 0x5637f0426b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.218 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04265d0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/2583076410 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0419a40 0x5637f0426090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 -- 172.21.15.70:0/2583076410 >> 172.21.15.70:0/2583076410 conn(0x5637f04160f0 msgr2=0x5637f041be50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:17.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff68dffb640 0 client.17370 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:17.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 -- 172.21.15.70:0/2583076410 shutdown_connections 2024-09-19T04:38:17.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.210+0000 7ff6af3d9740 1 -- 172.21.15.70:0/2583076410 wait complete. 2024-09-19T04:38:17.219 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.211+0000 7ff6af3d9740 20 client.17370 trim_cache size 0 max 16384 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6af3d9740 1 Processor -- start 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6af3d9740 1 -- start start 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0440c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 0x5637f0414a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81adf20 con 0x5637f041a360 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81ab7f0 con 0x5637f0419a40 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81a9660 con 0x5637f0429150 2024-09-19T04:38:17.230 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04411c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40742/0 (socket says 172.21.15.70:40742) 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 -- 172.21.15.70:0/1119917961 learned_addr learned my addr 172.21.15.70:0/1119917961 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0440c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 0x5637f0414a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 -- 172.21.15.70:0/1119917961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 msgr2=0x5637f0414a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 0x5637f0414a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 -- 172.21.15.70:0/1119917961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 msgr2=0x5637f0440c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0440c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 -- 172.21.15.70:0/1119917961 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5637f0411830 con 0x5637f041a360 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 0x5637f0414a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff6a659c640 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04411c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ff698010e50 tx=0x7ff6980045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5331c2a08336fca server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff68ffff640 1 -- 172.21.15.70:0/1119917961 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698030070 con 0x5637f041a360 2024-09-19T04:38:17.231 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff68ffff640 1 -- 172.21.15.70:0/1119917961 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff698005040 con 0x5637f041a360 2024-09-19T04:38:17.232 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.228+0000 7ff68ffff640 1 -- 172.21.15.70:0/1119917961 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698010750 con 0x5637f041a360 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 -- 172.21.15.70:0/1119917961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 msgr2=0x5637f04411c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04411c0 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7ff698010e50 tx=0x7ff6980045b0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 -- 172.21.15.70:0/1119917961 shutdown_connections 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 0x5637f0414a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f04411c0 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/1119917961 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0440c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 -- 172.21.15.70:0/1119917961 >> 172.21.15.70:0/1119917961 conn(0x5637f04160f0 msgr2=0x5637f0428000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 -- 172.21.15.70:0/1119917961 shutdown_connections 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 -- 172.21.15.70:0/1119917961 wait complete. 2024-09-19T04:38:17.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 -- start start 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.229+0000 7ff6af3d9740 1 Processor -- start 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0431860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f042cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6af3d9740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 0x5637f042d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81a9cb0 con 0x5637f041a360 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81ab120 con 0x5637f0419a40 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6af3d9740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff6a81aa380 con 0x5637f0429150 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6af3d9740 10 client.0 _ll_register_callbacks cb 0x7ff69800bbc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f042cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f042cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40744/0 (socket says 172.21.15.70:40744) 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 -- 172.21.15.70:0/471969076 learned_addr learned my addr 172.21.15.70:0/471969076 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 -- 172.21.15.70:0/471969076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 msgr2=0x5637f042d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:17.236 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 0x5637f042d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 -- 172.21.15.70:0/471969076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 msgr2=0x5637f0431860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0431860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 -- 172.21.15.70:0/471969076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5637f042d900 con 0x5637f041a360 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6a659c640 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f042cb90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff698003820 tx=0x7ff698003890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66bbc7c3498238fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff68dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff68dffb640 1 -- 172.21.15.70:0/471969076 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff698039060 con 0x5637f041a360 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff68dffb640 1 -- 172.21.15.70:0/471969076 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff6980053f0 con 0x5637f041a360 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.230+0000 7ff6af3d9740 1 -- 172.21.15.70:0/471969076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff698005040 con 0x5637f041a360 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff68dffb640 1 -- 172.21.15.70:0/471969076 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff698030040 con 0x5637f041a360 2024-09-19T04:38:17.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6af3d9740 10 client.17376 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6af3d9740 1 -- 172.21.15.70:0/471969076 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5637f04a3bf0 con 0x5637f041a360 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff68dffb640 1 -- 172.21.15.70:0/471969076 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff698005040 con 0x5637f041a360 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff68dffb640 1 -- 172.21.15.70:0/471969076 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff698033070 con 0x5637f041a360 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6af3d9740 10 client.17376 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6af3d9740 10 client.17376 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6af3d9740 20 client.17376 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5637f04a42a0 0x5637f04a66c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6af3d9740 4 client.17376 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6af3d9740 1 -- 172.21.15.70:0/471969076 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5637f0386d00 con 0x5637f04a42a0 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.231+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5637f04a42a0 0x5637f04a66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.232+0000 7ff6a5d9b640 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5637f04a42a0 0x5637f04a66c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48f9f99882fc8109 server_cookie=8615018781dd1cbf in_seq=0 out_seq=0 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.232+0000 7ff68dffb640 10 client.17376 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:17.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff68dffb640 1 -- 172.21.15.70:0/471969076 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5637f0386d00 con 0x5637f04a42a0 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff68dffb640 10 client.17376 handle_command_reply: tid=0 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 client.17376 shutdown 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 -- 172.21.15.70:0/471969076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 msgr2=0x5637f042cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f042cb90 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7ff698003820 tx=0x7ff698003890 comp rx=0 tx=0).stop 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 -- 172.21.15.70:0/471969076 shutdown_connections 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5637f04a42a0 0x5637f04a66c0 crc :-1 s=READY pgs=171 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff68dffb640 0 client.17376 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5637f0429150 0x5637f042d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5637f041a360 0x5637f042cb90 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 --2- 172.21.15.70:0/471969076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5637f0419a40 0x5637f0431860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 -- 172.21.15.70:0/471969076 >> 172.21.15.70:0/471969076 conn(0x5637f04160f0 msgr2=0x5637f0424830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:17.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 -- 172.21.15.70:0/471969076 shutdown_connections 2024-09-19T04:38:17.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 1 -- 172.21.15.70:0/471969076 wait complete. 2024-09-19T04:38:17.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.233+0000 7ff6af3d9740 20 client.17376 trim_cache size 0 max 16384 2024-09-19T04:38:17.240 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:38:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "8463dda3-9302-492f-ae76-a675378178c6", 2024-09-19T04:38:17.240 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:38:17.240 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:17.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 -- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff6900a33b0 msgr2=0x7ff6900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff6900a33b0 0x7ff6900a5870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00eec40 tx=0x7ff6a003d040 comp rx=0 tx=0).stop 2024-09-19T04:38:17.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 -- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8106a80 msgr2=0x7ff6a819ccc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:17.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8106a80 0x7ff6a819ccc0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7ff6a00097b0 tx=0x7ff6a0003970 comp rx=0 tx=0).stop 2024-09-19T04:38:17.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 -- 172.21.15.70:0/3282639398 shutdown_connections 2024-09-19T04:38:17.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff6900a33b0 0x7ff6900a5870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff6a8106a80 0x7ff6a819ccc0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff6a8101420 0x7ff6a8198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 --2- 172.21.15.70:0/3282639398 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff6a8100a80 0x7ff6a81983f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:17.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 -- 172.21.15.70:0/3282639398 >> 172.21.15.70:0/3282639398 conn(0x7ff6a80fc7a0 msgr2=0x7ff6a806aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:17.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 -- 172.21.15.70:0/3282639398 shutdown_connections 2024-09-19T04:38:17.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:17.234+0000 7ff6ad000640 1 -- 172.21.15.70:0/3282639398 wait complete. 2024-09-19T04:38:18.002 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:17 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:38:18.002 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:17 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:18.002 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:17 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:38:18.002 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:17 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:18.002 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:17 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:38:18.003 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:38:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:17 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:38:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:17 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:17 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:38:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:17 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:17 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:38:18.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:17 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:38:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:17 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:17 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:38:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:17 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:17 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:38:18.249 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 -- 172.21.15.70:0/1841720610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c105a90 msgr2=0x7f533c105e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 --2- 172.21.15.70:0/1841720610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c105a90 0x7f533c105e70 secure :-1 s=READY pgs=1043 cs=0 l=1 rev1=1 crypto rx=0x7f532c009900 tx=0x7f532c02a410 comp rx=0 tx=0).stop 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 -- 172.21.15.70:0/1841720610 shutdown_connections 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 --2- 172.21.15.70:0/1841720610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f533c101bc0 0x7f533c10d910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 --2- 172.21.15.70:0/1841720610 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f533c101240 0x7f533c101680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 --2- 172.21.15.70:0/1841720610 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c105a90 0x7f533c105e70 unknown :-1 s=CLOSED pgs=1043 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 -- 172.21.15.70:0/1841720610 >> 172.21.15.70:0/1841720610 conn(0x7f533c077210 msgr2=0x7f533c0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 -- 172.21.15.70:0/1841720610 shutdown_connections 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 -- 172.21.15.70:0/1841720610 wait complete. 2024-09-19T04:38:18.694 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 Processor -- start 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.681+0000 7f53427a3640 1 -- start start 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f53427a3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c101240 0x7f533c1985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f53427a3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f533c101bc0 0x7f533c198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f53427a3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f533c105a90 0x7f533c19cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f53427a3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1120f0 con 0x7f533c101240 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f53427a3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f533c111f70 con 0x7f533c101bc0 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f53427a3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f533c112270 con 0x7f533c105a90 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c101240 0x7f533c1985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c101240 0x7f533c1985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40764/0 (socket says 172.21.15.70:40764) 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 -- 172.21.15.70:0/3969318009 learned_addr learned my addr 172.21.15.70:0/3969318009 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533b7fe640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f533c101bc0 0x7f533c198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.695 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f5340d40640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f533c105a90 0x7f533c19cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 -- 172.21.15.70:0/3969318009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f533c105a90 msgr2=0x7f533c19cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f533c105a90 0x7f533c19cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 -- 172.21.15.70:0/3969318009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f533c101bc0 msgr2=0x7f533c198b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f533c101bc0 0x7f533c198b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 -- 172.21.15.70:0/3969318009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f533c19d5a0 con 0x7f533c101240 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533b7fe640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f533c101bc0 0x7f533c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f5340d40640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f533c105a90 0x7f533c19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.682+0000 7f533bfff640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c101240 0x7f533c1985f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f532c031440 tx=0x7f532c0052d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.683+0000 7f53397fa640 1 -- 172.21.15.70:0/3969318009 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c03f070 con 0x7f533c101240 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.683+0000 7f53427a3640 1 -- 172.21.15.70:0/3969318009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f533c19d830 con 0x7f533c101240 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.683+0000 7f53397fa640 1 -- 172.21.15.70:0/3969318009 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f532c003ac0 con 0x7f533c101240 2024-09-19T04:38:18.696 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.683+0000 7f53397fa640 1 -- 172.21.15.70:0/3969318009 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c035030 con 0x7f533c101240 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.683+0000 7f53427a3640 1 -- 172.21.15.70:0/3969318009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f533c1a5170 con 0x7f533c101240 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f53397fa640 1 -- 172.21.15.70:0/3969318009 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f532c042070 con 0x7f533c101240 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f5344b7c740 1 Processor -- start 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f5344b7c740 1 -- start start 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc4fc880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc507140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc509a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f5344b7c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e6dc4622e0 con 0x55e6dc507680 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f5344b7c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e6dc409ce0 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.685+0000 7f5344b7c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e6dc45e2a0 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc509a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.697 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc509a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40778/0 (socket says 172.21.15.70:40778) 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 -- 172.21.15.70:0/1939094787 learned_addr learned my addr 172.21.15.70:0/1939094787 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533bfff640 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc507140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f5340d40640 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc4fc880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f53397fa640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f53240a33b0 0x7f53240a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 -- 172.21.15.70:0/1939094787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 msgr2=0x55e6dc4fc880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc4fc880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 -- 172.21.15.70:0/1939094787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 msgr2=0x55e6dc507140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc507140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 -- 172.21.15.70:0/1939094787 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6dc3ee440 con 0x55e6dc507680 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f5340d40640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f53240a33b0 0x7f53240a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f53397fa640 1 -- 172.21.15.70:0/3969318009 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f532c0f06d0 con 0x7f533c101240 2024-09-19T04:38:18.698 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f533b7fe640 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc509a70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f533000a9d0 tx=0x7f533000ae90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=357776bd964c056b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f53227fc640 1 -- 172.21.15.70:0/1939094787 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330015070 con 0x55e6dc507680 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f53227fc640 1 -- 172.21.15.70:0/1939094787 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f533000cc60 con 0x55e6dc507680 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f5340d40640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f53240a33b0 0x7f53240a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5334005fd0 tx=0x7f5334004ab0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.686+0000 7f53227fc640 1 -- 172.21.15.70:0/1939094787 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53300105b0 con 0x55e6dc507680 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 -- 172.21.15.70:0/1939094787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 msgr2=0x55e6dc509a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc509a70 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f533000a9d0 tx=0x7f533000ae90 comp rx=0 tx=0).stop 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 -- 172.21.15.70:0/1939094787 shutdown_connections 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc509a70 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc507140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1939094787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc4fc880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 -- 172.21.15.70:0/1939094787 >> 172.21.15.70:0/1939094787 conn(0x55e6dc4f8a30 msgr2=0x55e6dc4f8e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 -- 172.21.15.70:0/1939094787 shutdown_connections 2024-09-19T04:38:18.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 -- 172.21.15.70:0/1939094787 wait complete. 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.687+0000 7f5344b7c740 1 -- start start 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5344b7c740 1 Processor -- start 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc506f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc504240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc504780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5344b7c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e6dc50e660 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5344b7c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e6dc41d050 con 0x55e6dc507680 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5344b7c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e6dc50e7e0 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5344b7c740 10 client.0 _ll_register_callbacks cb 0x55e6dc45d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc506f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc506f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40790/0 (socket says 172.21.15.70:40790) 2024-09-19T04:38:18.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533bfff640 1 -- 172.21.15.70:0/1592984280 learned_addr learned my addr 172.21.15.70:0/1592984280 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533b7fe640 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc504240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5340d40640 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc504780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533bfff640 1 -- 172.21.15.70:0/1592984280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fcdc0 msgr2=0x55e6dc504240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533bfff640 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc504240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533bfff640 1 -- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 msgr2=0x55e6dc504780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533bfff640 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc504780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f533bfff640 1 -- 172.21.15.70:0/1592984280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6dc1d33c0 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.688+0000 7f5340d40640 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc504780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f533bfff640 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc506f90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f532c000c00 tx=0x7f532c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=601e0c72a90fdb6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:18.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f531b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f531b7fe640 1 -- 172.21.15.70:0/1592984280 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f532c049070 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f531b7fe640 1 -- 172.21.15.70:0/1592984280 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f532c0314a0 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 1 -- 172.21.15.70:0/1592984280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f533000cc60 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f531b7fe640 1 -- 172.21.15.70:0/1592984280 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f532c0bdce0 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 10 client.17388 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 1 -- 172.21.15.70:0/1592984280 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e6dc519fe0 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f531b7fe640 1 -- 172.21.15.70:0/1592984280 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f533000cc60 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f531b7fe640 1 -- 172.21.15.70:0/1592984280 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f532c0ee0a0 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 10 client.17388 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 10 client.17388 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 20 client.17388 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e6dc51b3f0 0x55e6dc51d820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 4 client.17388 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:18.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.689+0000 7f5344b7c740 1 -- 172.21.15.70:0/1592984280 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e6dc46f850 con 0x55e6dc51b3f0 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.690+0000 7f533b7fe640 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e6dc51b3f0 0x55e6dc51d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.690+0000 7f533b7fe640 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e6dc51b3f0 0x55e6dc51d820 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db68f32b20c8fea0 server_cookie=2484db128a82739b in_seq=0 out_seq=0 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.690+0000 7f531b7fe640 10 client.17388 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f531b7fe640 1 -- 172.21.15.70:0/1592984280 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e6dc46f850 con 0x55e6dc51b3f0 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f531b7fe640 10 client.17388 handle_command_reply: tid=0 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 client.17388 shutdown 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 -- 172.21.15.70:0/1592984280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fc4a0 msgr2=0x55e6dc506f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc506f90 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7f532c000c00 tx=0x7f532c009260 comp rx=0 tx=0).stop 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 -- 172.21.15.70:0/1592984280 shutdown_connections 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e6dc51b3f0 0x55e6dc51d820 crc :-1 s=READY pgs=172 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc504780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc504240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 --2- 172.21.15.70:0/1592984280 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc506f90 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 -- 172.21.15.70:0/1592984280 >> 172.21.15.70:0/1592984280 conn(0x55e6dc4f8a30 msgr2=0x55e6dc4fe710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f531b7fe640 0 client.17388 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 -- 172.21.15.70:0/1592984280 shutdown_connections 2024-09-19T04:38:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 1 -- 172.21.15.70:0/1592984280 wait complete. 2024-09-19T04:38:18.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.691+0000 7f5344b7c740 20 client.17388 trim_cache size 0 max 16384 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.708+0000 7f5344b7c740 1 Processor -- start 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.708+0000 7f5344b7c740 1 -- start start 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.708+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc5178c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.708+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc504430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.708+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc4ff7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.708+0000 7f5344b7c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1adf70 con 0x55e6dc507680 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.708+0000 7f5344b7c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1ab840 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.708+0000 7f5344b7c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1a96d0 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc4ff7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc4ff7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40804/0 (socket says 172.21.15.70:40804) 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 -- 172.21.15.70:0/3403696739 learned_addr learned my addr 172.21.15.70:0/3403696739 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f533b7fe640 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc504430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.711 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f533bfff640 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc5178c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 -- 172.21.15.70:0/3403696739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 msgr2=0x55e6dc5178c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc5178c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 -- 172.21.15.70:0/3403696739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 msgr2=0x55e6dc504430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc504430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 -- 172.21.15.70:0/3403696739 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6dc5031f0 con 0x55e6dc507680 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5340d40640 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc4ff7f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f5334008610 tx=0x7f5334008510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=479361fb9bbf5537 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5321ffb640 1 -- 172.21.15.70:0/3403696739 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5334022070 con 0x55e6dc507680 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5321ffb640 1 -- 172.21.15.70:0/3403696739 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5334016040 con 0x55e6dc507680 2024-09-19T04:38:18.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.709+0000 7f5321ffb640 1 -- 172.21.15.70:0/3403696739 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f533401d3e0 con 0x55e6dc507680 2024-09-19T04:38:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 -- 172.21.15.70:0/3403696739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 msgr2=0x55e6dc4ff7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc4ff7f0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7f5334008610 tx=0x7f5334008510 comp rx=0 tx=0).stop 2024-09-19T04:38:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 -- 172.21.15.70:0/3403696739 shutdown_connections 2024-09-19T04:38:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc507680 0x55e6dc4ff7f0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc504430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3403696739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc5178c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 -- 172.21.15.70:0/3403696739 >> 172.21.15.70:0/3403696739 conn(0x55e6dc4f8a30 msgr2=0x55e6dc4ff0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:18.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 -- 172.21.15.70:0/3403696739 shutdown_connections 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 -- 172.21.15.70:0/3403696739 wait complete. 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 -- start start 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.710+0000 7f5344b7c740 1 Processor -- start 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc513e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc50f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f5344b7c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc50f6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f5344b7c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1a9d20 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f5344b7c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1ab170 con 0x55e6dc507680 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f5344b7c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f533c1aa3d0 con 0x55e6dc4fc4a0 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f5344b7c740 10 client.0 _ll_register_callbacks cb 0x7f532c0bc810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc50f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc50f1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40820/0 (socket says 172.21.15.70:40820) 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 -- 172.21.15.70:0/3420183358 learned_addr learned my addr 172.21.15.70:0/3420183358 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f5340d40640 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc50f6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533bfff640 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc513e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 -- 172.21.15.70:0/3420183358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 msgr2=0x55e6dc513e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc513e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 -- 172.21.15.70:0/3420183358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 msgr2=0x55e6dc50f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc50f6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 -- 172.21.15.70:0/3420183358 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6dc50fc30 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f533b7fe640 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc50f1b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f533000a9d0 tx=0x7f533000a920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68326ad4eb3f93b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.711+0000 7f531b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f531b7fe640 1 -- 172.21.15.70:0/3420183358 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5330015040 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 1 -- 172.21.15.70:0/3420183358 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5334016040 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f531b7fe640 1 -- 172.21.15.70:0/3420183358 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f533000a480 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f531b7fe640 1 -- 172.21.15.70:0/3420183358 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f53300113f0 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 10 client.17394 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 1 -- 172.21.15.70:0/3420183358 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e6dc585ea0 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f531b7fe640 1 -- 172.21.15.70:0/3420183358 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5334016040 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f531b7fe640 1 -- 172.21.15.70:0/3420183358 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f533001abb0 con 0x55e6dc4fcdc0 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 10 client.17394 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 10 client.17394 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 20 client.17394 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e6dc586340 0x55e6dc588730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 4 client.17394 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.712+0000 7f5344b7c740 1 -- 172.21.15.70:0/3420183358 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e6dc504b10 con 0x55e6dc586340 2024-09-19T04:38:18.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f533bfff640 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e6dc586340 0x55e6dc588730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f533bfff640 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e6dc586340 0x55e6dc588730 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=452755fa9e5f5771 server_cookie=be57591237d70748 in_seq=0 out_seq=0 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f531b7fe640 10 client.17394 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f531b7fe640 1 -- 172.21.15.70:0/3420183358 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55e6dc504b10 con 0x55e6dc586340 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f531b7fe640 10 client.17394 handle_command_reply: tid=0 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 client.17394 shutdown 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 -- 172.21.15.70:0/3420183358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fcdc0 msgr2=0x55e6dc50f1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc50f1b0 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7f533000a9d0 tx=0x7f533000a920 comp rx=0 tx=0).stop 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 -- 172.21.15.70:0/3420183358 shutdown_connections 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e6dc586340 0x55e6dc588730 crc :-1 s=READY pgs=173 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e6dc507680 0x55e6dc50f6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e6dc4fcdc0 0x55e6dc50f1b0 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f531b7fe640 0 client.17394 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 --2- 172.21.15.70:0/3420183358 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e6dc4fc4a0 0x55e6dc513e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 -- 172.21.15.70:0/3420183358 >> 172.21.15.70:0/3420183358 conn(0x55e6dc4f8a30 msgr2=0x55e6dc4f7a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 -- 172.21.15.70:0/3420183358 shutdown_connections 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.713+0000 7f5344b7c740 1 -- 172.21.15.70:0/3420183358 wait complete. 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f5344b7c740 20 client.17394 trim_cache size 0 max 16384 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:38:18.721 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:18.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 -- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f53240a33b0 msgr2=0x7f53240a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f53240a33b0 0x7f53240a5870 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f5334005fd0 tx=0x7f5334004ab0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 -- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c101240 msgr2=0x7f533c1985f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:18.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c101240 0x7f533c1985f0 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f532c031440 tx=0x7f532c0052d0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 -- 172.21.15.70:0/3969318009 shutdown_connections 2024-09-19T04:38:18.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f53240a33b0 0x7f53240a5870 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f533c105a90 0x7f533c19cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f533c101bc0 0x7f533c198b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 --2- 172.21.15.70:0/3969318009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f533c101240 0x7f533c1985f0 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:18.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 -- 172.21.15.70:0/3969318009 >> 172.21.15.70:0/3969318009 conn(0x7f533c077210 msgr2=0x7f533c103a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:18.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 -- 172.21.15.70:0/3969318009 shutdown_connections 2024-09-19T04:38:18.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:18.714+0000 7f53427a3640 1 -- 172.21.15.70:0/3969318009 wait complete. 2024-09-19T04:38:19.029 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:18 smithi070 ceph-mon[30942]: pgmap v233: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:19.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:18 smithi134 ceph-mon[34525]: pgmap v233: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:19.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:18 smithi167 ceph-mon[34339]: pgmap v233: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:19.408 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:38:19.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:38:19.654 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:20.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 -- 172.21.15.70:0/3489503875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 msgr2=0x7f68c810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:20.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 --2- 172.21.15.70:0/3489503875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 0x7f68c810bb50 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009900 tx=0x7f68bc02a480 comp rx=0 tx=0).stop 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 -- 172.21.15.70:0/3489503875 shutdown_connections 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 --2- 172.21.15.70:0/3489503875 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c810c170 0x7f68c810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 --2- 172.21.15.70:0/3489503875 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 0x7f68c810bb50 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 --2- 172.21.15.70:0/3489503875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68c8102d40 0x7f68c8103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 -- 172.21.15.70:0/3489503875 >> 172.21.15.70:0/3489503875 conn(0x7f68c80fc7a0 msgr2=0x7f68c80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 -- 172.21.15.70:0/3489503875 shutdown_connections 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.112+0000 7f68cdb68640 1 -- 172.21.15.70:0/3489503875 wait complete. 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68cdb68640 1 Processor -- start 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68cdb68640 1 -- start start 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68cdb68640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68c8102d40 0x7f68c81984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68cdb68640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 0x7f68c8198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68cdb68640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c810c170 0x7f68c819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:20.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68cdb68640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68c8111fa0 con 0x7f68c8103660 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68cdb68640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f68c8111e20 con 0x7f68c8102d40 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68cdb68640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68c8112120 con 0x7f68c810c170 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 0x7f68c8198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68c6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 0x7f68c8198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40834/0 (socket says 172.21.15.70:40834) 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68c6ffd640 1 -- 172.21.15.70:0/1509526583 learned_addr learned my addr 172.21.15.70:0/1509526583 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68c7fff640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c810c170 0x7f68c819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68c6ffd640 1 -- 172.21.15.70:0/1509526583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c810c170 msgr2=0x7f68c819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68c6ffd640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c810c170 0x7f68c819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68c6ffd640 1 -- 172.21.15.70:0/1509526583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68c8102d40 msgr2=0x7f68c81984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.113+0000 7f68c77fe640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68c8102d40 0x7f68c81984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68c6ffd640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68c8102d40 0x7f68c81984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68c6ffd640 1 -- 172.21.15.70:0/1509526583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c819d470 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68c77fe640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68c8102d40 0x7f68c81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68c6ffd640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 0x7f68c8198a00 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009230 tx=0x7f68bc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68c4ff9640 1 -- 172.21.15.70:0/1509526583 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc03f030 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68c4ff9640 1 -- 172.21.15.70:0/1509526583 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f68bc003ac0 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c819d700 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68c4ff9640 1 -- 172.21.15.70:0/1509526583 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68bc035070 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.114+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c81a5040 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.115+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c806b070 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.116+0000 7f68c4ff9640 1 -- 172.21.15.70:0/1509526583 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f68bc042030 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.117+0000 7f68c4ff9640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68b00a33b0 0x7f68b00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.117+0000 7f68c77fe640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68b00a33b0 0x7f68b00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.117+0000 7f68c4ff9640 1 -- 172.21.15.70:0/1509526583 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f68bc0f0490 con 0x7f68c8103660 2024-09-19T04:38:20.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.117+0000 7f68c77fe640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68b00a33b0 0x7f68b00a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68b8006fd0 tx=0x7f68b8008040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:20.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.121+0000 7f68c4ff9640 1 -- 172.21.15.70:0/1509526583 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f68bc0bce70 con 0x7f68c8103660 2024-09-19T04:38:20.325 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.323+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f68c81071e0 con 0x7f68c8103660 2024-09-19T04:38:20.326 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.324+0000 7f68c4ff9640 1 -- 172.21.15.70:0/1509526583 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f68bc0bc770 con 0x7f68c8103660 2024-09-19T04:38:20.326 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:38:20.326 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:38:20.326 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:38:20.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.326+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68b00a33b0 msgr2=0x7f68b00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:20.328 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.326+0000 7f68cdb68640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68b00a33b0 0x7f68b00a5870 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f68b8006fd0 tx=0x7f68b8008040 comp rx=0 tx=0).stop 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.326+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 msgr2=0x7f68c8198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.326+0000 7f68cdb68640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 0x7f68c8198a00 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7f68bc009230 tx=0x7f68bc004270 comp rx=0 tx=0).stop 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.326+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 shutdown_connections 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.326+0000 7f68cdb68640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68b00a33b0 0x7f68b00a5870 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.326+0000 7f68cdb68640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68c810c170 0x7f68c819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.326+0000 7f68cdb68640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68c8103660 0x7f68c8198a00 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.327+0000 7f68cdb68640 1 --2- 172.21.15.70:0/1509526583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68c8102d40 0x7f68c81984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.327+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 >> 172.21.15.70:0/1509526583 conn(0x7f68c80fc7a0 msgr2=0x7f68c80fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.327+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 shutdown_connections 2024-09-19T04:38:20.329 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:20.327+0000 7f68cdb68640 1 -- 172.21.15.70:0/1509526583 wait complete. 2024-09-19T04:38:20.629 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:20 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1509526583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:20.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:20 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1509526583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:20.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:20 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1509526583' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:20.925 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:38:21.169 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:21.558 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:21 smithi070 ceph-mon[30942]: pgmap v234: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 -- 172.21.15.70:0/2642433345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 msgr2=0x7f61a41029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 --2- 172.21.15.70:0/2642433345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 0x7f61a41029b0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7f618c009900 tx=0x7f618c02a480 comp rx=0 tx=0).stop 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 -- 172.21.15.70:0/2642433345 shutdown_connections 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 --2- 172.21.15.70:0/2642433345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a4102ef0 0x7f61a410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 --2- 172.21.15.70:0/2642433345 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 0x7f61a41029b0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 --2- 172.21.15.70:0/2642433345 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a4100e20 0x7f61a4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 -- 172.21.15.70:0/2642433345 >> 172.21.15.70:0/2642433345 conn(0x7f61a40fc7d0 msgr2=0x7f61a40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 -- 172.21.15.70:0/2642433345 shutdown_connections 2024-09-19T04:38:21.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.637+0000 7f61aa21e640 1 -- 172.21.15.70:0/2642433345 wait complete. 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61aa21e640 1 Processor -- start 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61aa21e640 1 -- start start 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61aa21e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a4100e20 0x7f61a4198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61aa21e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 0x7f61a41989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61aa21e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a4102ef0 0x7f61a419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61aa21e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f61a4110f50 con 0x7f61a4102570 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61aa21e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61a4110dd0 con 0x7f61a4100e20 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61aa21e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61a41110d0 con 0x7f61a4102ef0 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f619bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 0x7f61a41989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f619bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 0x7f61a41989d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40846/0 (socket says 172.21.15.70:40846) 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f619bfff640 1 -- 172.21.15.70:0/1585674318 learned_addr learned my addr 172.21.15.70:0/1585674318 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:21.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61a37fe640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a4100e20 0x7f61a4198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f61a3fff640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a4102ef0 0x7f61a419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.638+0000 7f619bfff640 1 -- 172.21.15.70:0/1585674318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a4102ef0 msgr2=0x7f61a419cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f619bfff640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a4102ef0 0x7f61a419cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f619bfff640 1 -- 172.21.15.70:0/1585674318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a4100e20 msgr2=0x7f61a4198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f619bfff640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a4100e20 0x7f61a4198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f619bfff640 1 -- 172.21.15.70:0/1585674318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61a419d440 con 0x7f61a4102570 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f619bfff640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 0x7f61a41989d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f618c005940 tx=0x7f618c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f61a17fa640 1 -- 172.21.15.70:0/1585674318 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c03f030 con 0x7f61a4102570 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f61aa21e640 1 -- 172.21.15.70:0/1585674318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61a419d6d0 con 0x7f61a4102570 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f61a17fa640 1 -- 172.21.15.70:0/1585674318 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f618c003ac0 con 0x7f61a4102570 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f61a17fa640 1 -- 172.21.15.70:0/1585674318 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c035070 con 0x7f61a4102570 2024-09-19T04:38:21.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.639+0000 7f61aa21e640 1 -- 172.21.15.70:0/1585674318 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61a41a5010 con 0x7f61a4102570 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.641+0000 7f61a17fa640 1 -- 172.21.15.70:0/1585674318 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f618c042030 con 0x7f61a4102570 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.641+0000 7f61ac5f7740 1 Processor -- start 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61ac5f7740 1 -- start start 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366eea090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eea5d0 0x55a366eeaa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366efbb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a366e502f0 con 0x55a366eea5d0 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a366df7cf0 con 0x55a366ef9780 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a366e4c2b0 con 0x55a366eebb40 2024-09-19T04:38:21.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eea5d0 0x55a366eeaa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eea5d0 0x55a366eeaa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40848/0 (socket says 172.21.15.70:40848) 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a37fe640 1 -- 172.21.15.70:0/806493833 learned_addr learned my addr 172.21.15.70:0/806493833 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a17fa640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f61900a33b0 0x7f61900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a3fff640 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366eea090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a3fff640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f61900a33b0 0x7f61900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a37fe640 1 -- 172.21.15.70:0/806493833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 msgr2=0x55a366eea090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a37fe640 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366eea090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a37fe640 1 -- 172.21.15.70:0/806493833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 msgr2=0x55a366efbb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a17fa640 1 -- 172.21.15.70:0/1585674318 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f618c0effb0 con 0x7f61a4102570 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f619bfff640 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366efbb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a37fe640 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366efbb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f61a37fe640 1 -- 172.21.15.70:0/806493833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a366ddc3a0 con 0x55a366eea5d0 2024-09-19T04:38:21.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.642+0000 7f619bfff640 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366efbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.643+0000 7f61a37fe640 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eea5d0 0x55a366eeaa10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f619400ac10 tx=0x7f619400f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfa89b566e3da069 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.643+0000 7f61a3fff640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f61900a33b0 0x7f61900a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f619c007fd0 tx=0x7f619c004a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.643+0000 7f6199ffb640 1 -- 172.21.15.70:0/806493833 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619401d070 con 0x55a366eea5d0 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.643+0000 7f6199ffb640 1 -- 172.21.15.70:0/806493833 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6194018b10 con 0x55a366eea5d0 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.643+0000 7f6199ffb640 1 -- 172.21.15.70:0/806493833 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6194010b20 con 0x55a366eea5d0 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 -- 172.21.15.70:0/806493833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eea5d0 msgr2=0x55a366eeaa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eea5d0 0x55a366eeaa10 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7f619400ac10 tx=0x7f619400f790 comp rx=0 tx=0).stop 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 -- 172.21.15.70:0/806493833 shutdown_connections 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366efbb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eea5d0 0x55a366eeaa10 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/806493833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366eea090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 -- 172.21.15.70:0/806493833 >> 172.21.15.70:0/806493833 conn(0x55a366eb3310 msgr2=0x55a366ee6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 -- 172.21.15.70:0/806493833 shutdown_connections 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 -- 172.21.15.70:0/806493833 wait complete. 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 -- start start 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.644+0000 7f61ac5f7740 1 Processor -- start 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef91a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef6a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a366efc480 con 0x55a366ef9780 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a366e0b060 con 0x55a366eea5d0 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a366efc600 con 0x55a366eebb40 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61ac5f7740 10 client.0 _ll_register_callbacks cb 0x55a366b5e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:21.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef6a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40854/0 (socket says 172.21.15.70:40854) 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 -- 172.21.15.70:0/45229616 learned_addr learned my addr 172.21.15.70:0/45229616 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a37fe640 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f619bfff640 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 -- 172.21.15.70:0/45229616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 msgr2=0x55a366ef6450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef6450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 -- 172.21.15.70:0/45229616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 msgr2=0x55a366ef91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 -- 172.21.15.70:0/45229616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a366bc13c0 con 0x55a366ef9780 2024-09-19T04:38:21.652 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61a3fff640 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef6a60 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f619c010ea0 tx=0x7f619c004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d039ff83de87ce3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f6182ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f6182ffd640 1 -- 172.21.15.70:0/45229616 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c00eea0 con 0x55a366ef9780 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f6182ffd640 1 -- 172.21.15.70:0/45229616 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f619c004d20 con 0x55a366ef9780 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.645+0000 7f61ac5f7740 1 -- 172.21.15.70:0/45229616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6194018b10 con 0x55a366ef9780 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f6182ffd640 1 -- 172.21.15.70:0/45229616 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f619c01e640 con 0x55a366ef9780 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61ac5f7740 10 client.17412 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61ac5f7740 1 -- 172.21.15.70:0/45229616 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a366f07f20 con 0x55a366ef9780 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f6182ffd640 1 -- 172.21.15.70:0/45229616 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6194018b10 con 0x55a366ef9780 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f6182ffd640 1 -- 172.21.15.70:0/45229616 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f619c005460 con 0x55a366ef9780 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61ac5f7740 10 client.17412 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61ac5f7740 10 client.17412 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:21.653 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61ac5f7740 20 client.17412 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:21.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a366f09330 0x55a366f0b740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61ac5f7740 4 client.17412 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:21.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61ac5f7740 1 -- 172.21.15.70:0/45229616 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a366e5d860 con 0x55a366f09330 2024-09-19T04:38:21.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.646+0000 7f61a37fe640 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a366f09330 0x55a366f0b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.647+0000 7f61a37fe640 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a366f09330 0x55a366f0b740 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=84f808095bd30d2 server_cookie=796e1c39f2479b91 in_seq=0 out_seq=0 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.647+0000 7f6182ffd640 10 client.17412 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f6182ffd640 1 -- 172.21.15.70:0/45229616 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a366e5d860 con 0x55a366f09330 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f6182ffd640 10 client.17412 handle_command_reply: tid=0 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 client.17412 shutdown 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 -- 172.21.15.70:0/45229616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 msgr2=0x55a366ef6a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef6a60 secure :-1 s=READY pgs=1054 cs=0 l=1 rev1=1 crypto rx=0x7f619c010ea0 tx=0x7f619c004ab0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 -- 172.21.15.70:0/45229616 shutdown_connections 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a366f09330 0x55a366f0b740 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef6a60 unknown :-1 s=CLOSED pgs=1054 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef6450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/45229616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 -- 172.21.15.70:0/45229616 >> 172.21.15.70:0/45229616 conn(0x55a366eb3310 msgr2=0x55a366eec960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:21.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f6182ffd640 0 client.17412 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:21.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 -- 172.21.15.70:0/45229616 shutdown_connections 2024-09-19T04:38:21.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 1 -- 172.21.15.70:0/45229616 wait complete. 2024-09-19T04:38:21.656 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.648+0000 7f61ac5f7740 20 client.17412 trim_cache size 0 max 16384 2024-09-19T04:38:21.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61ac5f7740 1 Processor -- start 2024-09-19T04:38:21.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61ac5f7740 1 -- start start 2024-09-19T04:38:21.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eea5d0 0x55a366ee6e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eebb40 0x55a366f05720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366f10fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f61a41ade90 con 0x55a366eebb40 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61a41ab760 con 0x55a366ef9780 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61a41a95d0 con 0x55a366eea5d0 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eebb40 0x55a366f05720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eebb40 0x55a366f05720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40868/0 (socket says 172.21.15.70:40868) 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 -- 172.21.15.70:0/2178373943 learned_addr learned my addr 172.21.15.70:0/2178373943 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61a37fe640 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eea5d0 0x55a366ee6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 -- 172.21.15.70:0/2178373943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eea5d0 msgr2=0x55a366ee6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eea5d0 0x55a366ee6e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61a3fff640 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366f10fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 -- 172.21.15.70:0/2178373943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 msgr2=0x55a366f10fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366f10fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 -- 172.21.15.70:0/2178373943 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a366ef9510 con 0x55a366eebb40 2024-09-19T04:38:21.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f61a3fff640 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366f10fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:21.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.661+0000 7f619bfff640 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eebb40 0x55a366f05720 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f618c005ec0 tx=0x7f618c0bbcb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fe9f9207442b31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:21.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61997fa640 1 -- 172.21.15.70:0/2178373943 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c049030 con 0x55a366eebb40 2024-09-19T04:38:21.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61997fa640 1 -- 172.21.15.70:0/2178373943 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f618c0ede50 con 0x55a366eebb40 2024-09-19T04:38:21.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61997fa640 1 -- 172.21.15.70:0/2178373943 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f618c003c70 con 0x55a366eebb40 2024-09-19T04:38:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 -- 172.21.15.70:0/2178373943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eebb40 msgr2=0x55a366f05720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eebb40 0x55a366f05720 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f618c005ec0 tx=0x7f618c0bbcb0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 -- 172.21.15.70:0/2178373943 shutdown_connections 2024-09-19T04:38:21.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366ef9780 0x55a366f10fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366eebb40 0x55a366f05720 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/2178373943 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eea5d0 0x55a366ee6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 -- 172.21.15.70:0/2178373943 >> 172.21.15.70:0/2178373943 conn(0x55a366eb3310 msgr2=0x55a366ee6700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 -- 172.21.15.70:0/2178373943 shutdown_connections 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.662+0000 7f61ac5f7740 1 -- 172.21.15.70:0/2178373943 wait complete. 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 1 -- start start 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 1 Processor -- start 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef3490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef39d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f61a41a9c20 con 0x55a366ef9780 2024-09-19T04:38:21.669 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f61a41ab090 con 0x55a366eea5d0 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f61a41aa2f0 con 0x55a366eebb40 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61ac5f7740 10 client.0 _ll_register_callbacks cb 0x7f619c0134c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61a3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef3f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40874/0 (socket says 172.21.15.70:40874) 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61a3fff640 1 -- 172.21.15.70:0/1562724095 learned_addr learned my addr 172.21.15.70:0/1562724095 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f619bfff640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61a37fe640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.663+0000 7f61a3fff640 1 -- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 msgr2=0x55a366ef39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61a3fff640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61a3fff640 1 -- 172.21.15.70:0/1562724095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 msgr2=0x55a366ef3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61a3fff640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61a3fff640 1 -- 172.21.15.70:0/1562724095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a366f73000 con 0x55a366ef9780 2024-09-19T04:38:21.670 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f619bfff640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61a37fe640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61a3fff640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef3f10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f619c000f80 tx=0x7f619c0071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f7b82386d56c2a42 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f6182ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f6182ffd640 1 -- 172.21.15.70:0/1562724095 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f619c037070 con 0x55a366ef9780 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f6182ffd640 1 -- 172.21.15.70:0/1562724095 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f619c01e9e0 con 0x55a366ef9780 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 1 -- 172.21.15.70:0/1562724095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f618c0ede50 con 0x55a366ef9780 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f6182ffd640 1 -- 172.21.15.70:0/1562724095 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f619c00eea0 con 0x55a366ef9780 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 10 client.17418 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 1 -- 172.21.15.70:0/1562724095 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a366f74250 con 0x55a366ef9780 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f6182ffd640 1 -- 172.21.15.70:0/1562724095 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f618c0ede50 con 0x55a366ef9780 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f6182ffd640 1 -- 172.21.15.70:0/1562724095 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f619c031b60 con 0x55a366ef9780 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 10 client.17418 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:21.671 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 10 client.17418 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 20 client.17418 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a366f74970 0x55a366f76d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 4 client.17418 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.664+0000 7f61ac5f7740 1 -- 172.21.15.70:0/1562724095 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a366e57d70 con 0x55a366f74970 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.665+0000 7f61a37fe640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a366f74970 0x55a366f76d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.665+0000 7f61a37fe640 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a366f74970 0x55a366f76d60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=78392698ff4736ca server_cookie=676512e69be8b39 in_seq=0 out_seq=0 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.665+0000 7f6182ffd640 10 client.17418 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.665+0000 7f6182ffd640 1 -- 172.21.15.70:0/1562724095 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a366e57d70 con 0x55a366f74970 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.665+0000 7f6182ffd640 10 client.17418 handle_command_reply: tid=0 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.665+0000 7f61ac5f7740 1 client.17418 shutdown 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 -- 172.21.15.70:0/1562724095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 msgr2=0x55a366ef3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.672 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef3f10 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f619c000f80 tx=0x7f619c0071c0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 -- 172.21.15.70:0/1562724095 shutdown_connections 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a366f74970 0x55a366f76d60 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a366ef9780 0x55a366ef3f10 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a366eebb40 0x55a366ef39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 --2- 172.21.15.70:0/1562724095 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a366eea5d0 0x55a366ef3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 -- 172.21.15.70:0/1562724095 >> 172.21.15.70:0/1562724095 conn(0x55a366eb3310 msgr2=0x55a366eec930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f6182ffd640 0 client.17418 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 -- 172.21.15.70:0/1562724095 shutdown_connections 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 1 -- 172.21.15.70:0/1562724095 wait complete. 2024-09-19T04:38:21.673 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61ac5f7740 20 client.17418 trim_cache size 0 max 16384 2024-09-19T04:38:21.674 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:21.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 -- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f61900a33b0 msgr2=0x7f61900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.674 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f61900a33b0 0x7f61900a5870 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f619c007fd0 tx=0x7f619c004a40 comp rx=0 tx=0).stop 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 -- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 msgr2=0x7f61a41989d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 0x7f61a41989d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7f618c005940 tx=0x7f618c004270 comp rx=0 tx=0).stop 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 -- 172.21.15.70:0/1585674318 shutdown_connections 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f61900a33b0 0x7f61900a5870 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f61a4102ef0 0x7f61a419cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f61a4102570 0x7f61a41989d0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 --2- 172.21.15.70:0/1585674318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61a4100e20 0x7f61a4198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.666+0000 7f61aa21e640 1 -- 172.21.15.70:0/1585674318 >> 172.21.15.70:0/1585674318 conn(0x7f61a40fc7d0 msgr2=0x7f61a4069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.667+0000 7f61aa21e640 1 -- 172.21.15.70:0/1585674318 shutdown_connections 2024-09-19T04:38:21.675 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:21.667+0000 7f61aa21e640 1 -- 172.21.15.70:0/1585674318 wait complete. 2024-09-19T04:38:21.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:21 smithi167 ceph-mon[34339]: pgmap v234: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:21.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:21 smithi134 ceph-mon[34525]: pgmap v234: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:38:22.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:38:22.628 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:23.008 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:22 smithi070 ceph-mon[30942]: pgmap v235: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:38:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:22 smithi134 ceph-mon[34525]: pgmap v235: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:38:23.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.085+0000 7ff48068b640 1 -- 172.21.15.70:0/1535888078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478105ad0 msgr2=0x7ff478105eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.085+0000 7ff48068b640 1 --2- 172.21.15.70:0/1535888078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478105ad0 0x7ff478105eb0 secure :-1 s=READY pgs=1057 cs=0 l=1 rev1=1 crypto rx=0x7ff474009900 tx=0x7ff47402a410 comp rx=0 tx=0).stop 2024-09-19T04:38:23.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 -- 172.21.15.70:0/1535888078 shutdown_connections 2024-09-19T04:38:23.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 --2- 172.21.15.70:0/1535888078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff478101ba0 0x7ff47810d970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 --2- 172.21.15.70:0/1535888078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff478101200 0x7ff478101660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 --2- 172.21.15.70:0/1535888078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478105ad0 0x7ff478105eb0 unknown :-1 s=CLOSED pgs=1057 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 -- 172.21.15.70:0/1535888078 >> 172.21.15.70:0/1535888078 conn(0x7ff478077210 msgr2=0x7ff4780fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:23.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 -- 172.21.15.70:0/1535888078 shutdown_connections 2024-09-19T04:38:23.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 -- 172.21.15.70:0/1535888078 wait complete. 2024-09-19T04:38:23.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 Processor -- start 2024-09-19T04:38:23.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 -- start start 2024-09-19T04:38:23.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff478101200 0x7ff4781a03e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478101ba0 0x7ff4781a0920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.086+0000 7ff48068b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff478105ad0 0x7ff47819a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff48068b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff478110f60 con 0x7ff478101ba0 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff48068b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff478110de0 con 0x7ff478105ad0 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff48068b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff4781110e0 con 0x7ff478101200 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478101ba0 0x7ff4781a0920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478101ba0 0x7ff4781a0920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40894/0 (socket says 172.21.15.70:40894) 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 -- 172.21.15.70:0/1071741215 learned_addr learned my addr 172.21.15.70:0/1071741215 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47e427640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff478101200 0x7ff4781a03e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 -- 172.21.15.70:0/1071741215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff478101200 msgr2=0x7ff4781a03e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff478101200 0x7ff4781a03e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47ec28640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff478105ad0 0x7ff47819a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 -- 172.21.15.70:0/1071741215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff478105ad0 msgr2=0x7ff47819a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff478105ad0 0x7ff47819a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 -- 172.21.15.70:0/1071741215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff47819acd0 con 0x7ff478101ba0 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47e427640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff478101200 0x7ff4781a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff47dc26640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478101ba0 0x7ff4781a0920 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff46800b4a0 tx=0x7ff46800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff46f7fe640 1 -- 172.21.15.70:0/1071741215 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468014070 con 0x7ff478101ba0 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff46f7fe640 1 -- 172.21.15.70:0/1071741215 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff468010ae0 con 0x7ff478101ba0 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff48068b640 1 -- 172.21.15.70:0/1071741215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff47819afc0 con 0x7ff478101ba0 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff48068b640 1 -- 172.21.15.70:0/1071741215 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4781a72b0 con 0x7ff478101ba0 2024-09-19T04:38:23.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.087+0000 7ff46f7fe640 1 -- 172.21.15.70:0/1071741215 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff468017c70 con 0x7ff478101ba0 2024-09-19T04:38:23.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.089+0000 7ff46f7fe640 1 -- 172.21.15.70:0/1071741215 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff468017070 con 0x7ff478101ba0 2024-09-19T04:38:23.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff482a64740 1 Processor -- start 2024-09-19T04:38:23.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff482a64740 1 -- start start 2024-09-19T04:38:23.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff482a64740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211ddb40 0x559d211dc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff482a64740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211dc5d0 0x559d211dca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff482a64740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211e7370 0x559d211e9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff46f7fe640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff4640a33b0 0x7ff4640a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff482a64740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d211422f0 con 0x559d211e7370 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff482a64740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559d210e9cf0 con 0x559d211ddb40 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff482a64740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559d2113e2b0 con 0x559d211dc5d0 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.090+0000 7ff47ec28640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff4640a33b0 0x7ff4640a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47dc26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211e7370 0x559d211e9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211ddb40 0x559d211dc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211ddb40 0x559d211dc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:60628/0 (socket says 172.21.15.70:60628) 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 -- 172.21.15.70:0/2589026291 learned_addr learned my addr 172.21.15.70:0/2589026291 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff46f7fe640 1 -- 172.21.15.70:0/1071741215 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff4680cef10 con 0x7ff478101ba0 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47e427640 1 --2- 172.21.15.70:0/2589026291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211dc5d0 0x559d211dca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 -- 172.21.15.70:0/2589026291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211dc5d0 msgr2=0x559d211dca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 --2- 172.21.15.70:0/2589026291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211dc5d0 0x559d211dca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 -- 172.21.15.70:0/2589026291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211e7370 msgr2=0x559d211e9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 --2- 172.21.15.70:0/2589026291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211e7370 0x559d211e9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 -- 172.21.15.70:0/2589026291 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d210ce3a0 con 0x559d211ddb40 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff4640a33b0 0x7ff4640a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff470014940 tx=0x7ff470001e80 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff47ec28640 1 --2- 172.21.15.70:0/2589026291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211ddb40 0x559d211dc090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff470002230 tx=0x7ff47001b000 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2741a53bf08822e9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff46cff9640 1 -- 172.21.15.70:0/2589026291 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff470025070 con 0x559d211ddb40 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff46cff9640 1 -- 172.21.15.70:0/2589026291 <== mon.2 v2:172.21.15.134:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff470018c10 con 0x559d211ddb40 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.091+0000 7ff46cff9640 1 -- 172.21.15.70:0/2589026291 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff47001c070 con 0x559d211ddb40 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 -- 172.21.15.70:0/2589026291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211ddb40 msgr2=0x559d211dc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 --2- 172.21.15.70:0/2589026291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211ddb40 0x559d211dc090 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7ff470002230 tx=0x7ff47001b000 comp rx=0 tx=0).stop 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 -- 172.21.15.70:0/2589026291 shutdown_connections 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 --2- 172.21.15.70:0/2589026291 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211e7370 0x559d211e9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 --2- 172.21.15.70:0/2589026291 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211dc5d0 0x559d211dca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 --2- 172.21.15.70:0/2589026291 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211ddb40 0x559d211dc090 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 -- 172.21.15.70:0/2589026291 >> 172.21.15.70:0/2589026291 conn(0x559d211a5310 msgr2=0x559d211d8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 -- 172.21.15.70:0/2589026291 shutdown_connections 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.092+0000 7ff482a64740 1 -- 172.21.15.70:0/2589026291 wait complete. 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 1 -- start start 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 1 Processor -- start 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 0x559d211e6d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211e3fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 0x559d211e4570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x559d211ea010 con 0x559d211ddb40 2024-09-19T04:38:23.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559d210fd060 con 0x559d211dc5d0 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x559d211ea190 con 0x559d211e7370 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff482a64740 10 client.0 _ll_register_callbacks cb 0x559d20e508c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211e3fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211e3fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40904/0 (socket says 172.21.15.70:40904) 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 -- 172.21.15.70:0/1107351857 learned_addr learned my addr 172.21.15.70:0/1107351857 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47e427640 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 0x559d211e6d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47ec28640 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 0x559d211e4570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 -- 172.21.15.70:0/1107351857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 msgr2=0x559d211e4570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 0x559d211e4570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 -- 172.21.15.70:0/1107351857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 msgr2=0x559d211e6d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 0x559d211e6d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 -- 172.21.15.70:0/1107351857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d20eb33c0 con 0x559d211ddb40 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.093+0000 7ff47dc26640 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211e3fd0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff4680177a0 tx=0x7ff4680047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7304ba3eaadb36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:23.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff461ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff461ffb640 1 -- 172.21.15.70:0/1107351857 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46801e040 con 0x559d211ddb40 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff461ffb640 1 -- 172.21.15.70:0/1107351857 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff468097970 con 0x559d211ddb40 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 1 -- 172.21.15.70:0/1107351857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff470018c10 con 0x559d211ddb40 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff461ffb640 1 -- 172.21.15.70:0/1107351857 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff4680a3f70 con 0x559d211ddb40 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 10 client.17430 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 1 -- 172.21.15.70:0/1107351857 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559d211f5b20 con 0x559d211ddb40 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff461ffb640 1 -- 172.21.15.70:0/1107351857 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff470018c10 con 0x559d211ddb40 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff461ffb640 1 -- 172.21.15.70:0/1107351857 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff46809a8e0 con 0x559d211ddb40 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 10 client.17430 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 10 client.17430 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 20 client.17430 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559d211f7230 0x559d211f9620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 4 client.17430 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:23.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.094+0000 7ff482a64740 1 -- 172.21.15.70:0/1107351857 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d2114f860 con 0x559d211f7230 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.095+0000 7ff47e427640 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559d211f7230 0x559d211f9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.095+0000 7ff47e427640 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559d211f7230 0x559d211f9620 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=378fec303577d3d0 server_cookie=a6c4b329dc8cbebf in_seq=0 out_seq=0 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.095+0000 7ff461ffb640 10 client.17430 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff461ffb640 1 -- 172.21.15.70:0/1107351857 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x559d2114f860 con 0x559d211f7230 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff461ffb640 10 client.17430 handle_command_reply: tid=0 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 client.17430 shutdown 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 -- 172.21.15.70:0/1107351857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 msgr2=0x559d211e3fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211e3fd0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7ff4680177a0 tx=0x7ff4680047d0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 -- 172.21.15.70:0/1107351857 shutdown_connections 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559d211f7230 0x559d211f9620 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 0x559d211e4570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211e3fd0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 --2- 172.21.15.70:0/1107351857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 0x559d211e6d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 -- 172.21.15.70:0/1107351857 >> 172.21.15.70:0/1107351857 conn(0x559d211a5310 msgr2=0x559d211de930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff461ffb640 0 client.17430 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 -- 172.21.15.70:0/1107351857 shutdown_connections 2024-09-19T04:38:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 1 -- 172.21.15.70:0/1107351857 wait complete. 2024-09-19T04:38:23.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.096+0000 7ff482a64740 20 client.17430 trim_cache size 0 max 16384 2024-09-19T04:38:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff482a64740 1 Processor -- start 2024-09-19T04:38:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff482a64740 1 -- start start 2024-09-19T04:38:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff482a64740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211dc5d0 0x559d211f3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff482a64740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211ddb40 0x559d211fed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff482a64740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211e7370 0x559d211ff250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff482a64740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c010f40 con 0x559d211dc5d0 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff482a64740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c00e810 con 0x559d211e7370 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff482a64740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c00c680 con 0x559d211ddb40 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47e427640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211dc5d0 0x559d211f3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47e427640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211dc5d0 0x559d211f3310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40910/0 (socket says 172.21.15.70:40910) 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47e427640 1 -- 172.21.15.70:0/864396754 learned_addr learned my addr 172.21.15.70:0/864396754 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47ec28640 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211e7370 0x559d211ff250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47dc26640 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211ddb40 0x559d211fed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47e427640 1 -- 172.21.15.70:0/864396754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211ddb40 msgr2=0x559d211fed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:23.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47e427640 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211ddb40 0x559d211fed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47e427640 1 -- 172.21.15.70:0/864396754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211e7370 msgr2=0x559d211ff250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:23.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47e427640 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211e7370 0x559d211ff250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.109+0000 7ff47e427640 1 -- 172.21.15.70:0/864396754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d211e48e0 con 0x559d211dc5d0 2024-09-19T04:38:23.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff47e427640 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211dc5d0 0x559d211f3310 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7ff47402a930 tx=0x7ff474009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc1fd0b6a903cea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:23.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff463fff640 1 -- 172.21.15.70:0/864396754 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474048030 con 0x559d211dc5d0 2024-09-19T04:38:23.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff463fff640 1 -- 172.21.15.70:0/864396754 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff474031830 con 0x559d211dc5d0 2024-09-19T04:38:23.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff463fff640 1 -- 172.21.15.70:0/864396754 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff474035040 con 0x559d211dc5d0 2024-09-19T04:38:23.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 -- 172.21.15.70:0/864396754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211dc5d0 msgr2=0x559d211f3310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211dc5d0 0x559d211f3310 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7ff47402a930 tx=0x7ff474009680 comp rx=0 tx=0).stop 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 -- 172.21.15.70:0/864396754 shutdown_connections 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211e7370 0x559d211ff250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211ddb40 0x559d211fed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 --2- 172.21.15.70:0/864396754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211dc5d0 0x559d211f3310 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 -- 172.21.15.70:0/864396754 >> 172.21.15.70:0/864396754 conn(0x559d211a5310 msgr2=0x559d211e28a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 -- 172.21.15.70:0/864396754 shutdown_connections 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.110+0000 7ff482a64740 1 -- 172.21.15.70:0/864396754 wait complete. 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 1 -- start start 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 1 Processor -- start 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 0x559d211eb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211eb890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 0x559d211ebdd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c00ccd0 con 0x559d211ddb40 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c00e140 con 0x559d211dc5d0 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff45c00d3a0 con 0x559d211e7370 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff482a64740 10 client.0 _ll_register_callbacks cb 0x7ff46800b3f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47dc26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211eb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47dc26640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211eb890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40918/0 (socket says 172.21.15.70:40918) 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47ec28640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 0x559d211ebdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47dc26640 1 -- 172.21.15.70:0/117908786 learned_addr learned my addr 172.21.15.70:0/117908786 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47e427640 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 0x559d211eb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47dc26640 1 -- 172.21.15.70:0/117908786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 msgr2=0x559d211ebdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47dc26640 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 0x559d211ebdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47dc26640 1 -- 172.21.15.70:0/117908786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 msgr2=0x559d211eb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:23.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47dc26640 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 0x559d211eb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.111+0000 7ff47dc26640 1 -- 172.21.15.70:0/117908786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d21260e80 con 0x559d211ddb40 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff47dc26640 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211eb890 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7ff4680cc820 tx=0x7ff468096fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3933641c551643b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff461ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff461ffb640 1 -- 172.21.15.70:0/117908786 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff46809ac60 con 0x559d211ddb40 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff461ffb640 1 -- 172.21.15.70:0/117908786 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff4680a3ae0 con 0x559d211ddb40 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 1 -- 172.21.15.70:0/117908786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff474031830 con 0x559d211ddb40 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff461ffb640 1 -- 172.21.15.70:0/117908786 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff4680bb3d0 con 0x559d211ddb40 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 10 client.17436 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 1 -- 172.21.15.70:0/117908786 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559d21262120 con 0x559d211ddb40 2024-09-19T04:38:23.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff461ffb640 1 -- 172.21.15.70:0/117908786 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff474031830 con 0x559d211ddb40 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff461ffb640 1 -- 172.21.15.70:0/117908786 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff468010610 con 0x559d211ddb40 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 10 client.17436 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 10 client.17436 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 20 client.17436 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559d21262850 0x559d21264c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 4 client.17436 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff482a64740 1 -- 172.21.15.70:0/117908786 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d21149d70 con 0x559d21262850 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.112+0000 7ff47e427640 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559d21262850 0x559d21264c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff461ffb640 10 client.17436 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff47e427640 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559d21262850 0x559d21264c70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=fcaec05976f53bb2 server_cookie=28a7c85e9c08f3d1 in_seq=0 out_seq=0 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff461ffb640 1 -- 172.21.15.70:0/117908786 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d21149d70 con 0x559d21262850 2024-09-19T04:38:23.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff461ffb640 10 client.17436 handle_command_reply: tid=0 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 client.17436 shutdown 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 -- 172.21.15.70:0/117908786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 msgr2=0x559d211eb890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211eb890 secure :-1 s=READY pgs=1061 cs=0 l=1 rev1=1 crypto rx=0x7ff4680cc820 tx=0x7ff468096fa0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 -- 172.21.15.70:0/117908786 shutdown_connections 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x559d21262850 0x559d21264c70 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x559d211e7370 0x559d211ebdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff461ffb640 0 client.17436 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x559d211ddb40 0x559d211eb890 unknown :-1 s=CLOSED pgs=1061 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 --2- 172.21.15.70:0/117908786 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x559d211dc5d0 0x559d211eb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 -- 172.21.15.70:0/117908786 >> 172.21.15.70:0/117908786 conn(0x559d211a5310 msgr2=0x559d211e5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 -- 172.21.15.70:0/117908786 shutdown_connections 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 1 -- 172.21.15.70:0/117908786 wait complete. 2024-09-19T04:38:23.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.113+0000 7ff482a64740 20 client.17436 trim_cache size 0 max 16384 2024-09-19T04:38:23.123 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:23.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 -- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff4640a33b0 msgr2=0x7ff4640a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff4640a33b0 0x7ff4640a5870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff470014940 tx=0x7ff470001e80 comp rx=0 tx=0).stop 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 -- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478101ba0 msgr2=0x7ff4781a0920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478101ba0 0x7ff4781a0920 secure :-1 s=READY pgs=1058 cs=0 l=1 rev1=1 crypto rx=0x7ff46800b4a0 tx=0x7ff46800b960 comp rx=0 tx=0).stop 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 -- 172.21.15.70:0/1071741215 shutdown_connections 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff4640a33b0 0x7ff4640a5870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff478105ad0 0x7ff47819a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff478101ba0 0x7ff4781a0920 unknown :-1 s=CLOSED pgs=1058 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 --2- 172.21.15.70:0/1071741215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff478101200 0x7ff4781a03e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 -- 172.21.15.70:0/1071741215 >> 172.21.15.70:0/1071741215 conn(0x7ff478077210 msgr2=0x7ff4781070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 -- 172.21.15.70:0/1071741215 shutdown_connections 2024-09-19T04:38:23.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:23.114+0000 7ff48068b640 1 -- 172.21.15.70:0/1071741215 wait complete. 2024-09-19T04:38:23.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:22 smithi167 ceph-mon[34339]: pgmap v235: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:38:23.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:38:24.055 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 -- 172.21.15.70:0/918344021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9081055b0 msgr2=0x7fc90810d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 --2- 172.21.15.70:0/918344021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9081055b0 0x7fc90810d130 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7fc900009ca0 tx=0x7fc90002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 -- 172.21.15.70:0/918344021 shutdown_connections 2024-09-19T04:38:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 --2- 172.21.15.70:0/918344021 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc9081055b0 0x7fc90810d130 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 --2- 172.21.15.70:0/918344021 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc908100e30 0x7fc908104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 --2- 172.21.15.70:0/918344021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc908100480 0x7fc908100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 -- 172.21.15.70:0/918344021 >> 172.21.15.70:0/918344021 conn(0x7fc908077210 msgr2=0x7fc9080fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 -- 172.21.15.70:0/918344021 shutdown_connections 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 -- 172.21.15.70:0/918344021 wait complete. 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.527+0000 7fc90f386640 1 Processor -- start 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90f386640 1 -- start start 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90f386640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc908100480 0x7fc908198410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90f386640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc908100e30 0x7fc908198950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90f386640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9081055b0 0x7fc90819cce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90f386640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc90810fd50 con 0x7fc908100480 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90f386640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc90810fbd0 con 0x7fc9081055b0 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90f386640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc90810fed0 con 0x7fc908100e30 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d122640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc908100480 0x7fc908198410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d122640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc908100480 0x7fc908198410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42282/0 (socket says 172.21.15.70:42282) 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d122640 1 -- 172.21.15.70:0/2304549444 learned_addr learned my addr 172.21.15.70:0/2304549444 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90c921640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc908100e30 0x7fc908198950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d923640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9081055b0 0x7fc90819cce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d122640 1 -- 172.21.15.70:0/2304549444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc908100e30 msgr2=0x7fc908198950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d122640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc908100e30 0x7fc908198950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d122640 1 -- 172.21.15.70:0/2304549444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9081055b0 msgr2=0x7fc90819cce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d122640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9081055b0 0x7fc90819cce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d122640 1 -- 172.21.15.70:0/2304549444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc90819d3c0 con 0x7fc908100480 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.528+0000 7fc90d923640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9081055b0 0x7fc90819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.529+0000 7fc90d122640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc908100480 0x7fc908198410 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800c890 tx=0x7fc8f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.529+0000 7fc8fe7fc640 1 -- 172.21.15.70:0/2304549444 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8004220 con 0x7fc908100480 2024-09-19T04:38:24.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.529+0000 7fc8fe7fc640 1 -- 172.21.15.70:0/2304549444 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc8f80043c0 con 0x7fc908100480 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.529+0000 7fc90f386640 1 -- 172.21.15.70:0/2304549444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc90819d6b0 con 0x7fc908100480 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.529+0000 7fc8fe7fc640 1 -- 172.21.15.70:0/2304549444 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f8004a00 con 0x7fc908100480 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.529+0000 7fc90f386640 1 -- 172.21.15.70:0/2304549444 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9081a4f90 con 0x7fc908100480 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.531+0000 7fc8fe7fc640 1 -- 172.21.15.70:0/2304549444 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc8f8004ba0 con 0x7fc908100480 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.531+0000 7fc91175f740 1 Processor -- start 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.531+0000 7fc91175f740 1 -- start start 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc91175f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b99b40 0x55f206b98090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc91175f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206b98a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc91175f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206ba3370 0x55f206ba5760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc91175f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f206afe2f0 con 0x55f206ba3370 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc91175f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f206aa5cf0 con 0x55f206b985d0 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc91175f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f206afa2b0 con 0x55f206b99b40 2024-09-19T04:38:24.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206ba3370 0x55f206ba5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206ba3370 0x55f206ba5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42294/0 (socket says 172.21.15.70:42294) 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 -- 172.21.15.70:0/489578558 learned_addr learned my addr 172.21.15.70:0/489578558 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90d923640 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b99b40 0x55f206b98090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90d122640 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206b98a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 -- 172.21.15.70:0/489578558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b99b40 msgr2=0x55f206b98090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b99b40 0x55f206b98090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 -- 172.21.15.70:0/489578558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 msgr2=0x55f206b98a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206b98a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 -- 172.21.15.70:0/489578558 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f206a8a3a0 con 0x55f206ba3370 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc8fe7fc640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8f40a33b0 0x7fc8f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90c921640 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206ba3370 0x55f206ba5760 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc90400bcb0 tx=0x7fc90400e820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d135c572fd98536 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:24.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc90d923640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8f40a33b0 0x7fc8f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.532+0000 7fc8fe7fc640 1 -- 172.21.15.70:0/2304549444 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc8f80cfad0 con 0x7fc908100480 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc8f37fe640 1 -- 172.21.15.70:0/489578558 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90400be60 con 0x55f206ba3370 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc8f37fe640 1 -- 172.21.15.70:0/489578558 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc9040054f0 con 0x55f206ba3370 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc8f37fe640 1 -- 172.21.15.70:0/489578558 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90400d8b0 con 0x55f206ba3370 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc91175f740 1 -- 172.21.15.70:0/489578558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206ba3370 msgr2=0x55f206ba5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc90d923640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8f40a33b0 0x7fc8f40a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc900005fe0 tx=0x7fc900005c30 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc91175f740 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206ba3370 0x55f206ba5760 secure :-1 s=READY pgs=1064 cs=0 l=1 rev1=1 crypto rx=0x7fc90400bcb0 tx=0x7fc90400e820 comp rx=0 tx=0).stop 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc91175f740 1 -- 172.21.15.70:0/489578558 shutdown_connections 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc91175f740 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206ba3370 0x55f206ba5760 unknown :-1 s=CLOSED pgs=1064 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc91175f740 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206b98a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.533+0000 7fc91175f740 1 --2- 172.21.15.70:0/489578558 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b99b40 0x55f206b98090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 -- 172.21.15.70:0/489578558 >> 172.21.15.70:0/489578558 conn(0x55f206b61310 msgr2=0x55f206b94c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 -- 172.21.15.70:0/489578558 shutdown_connections 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 -- 172.21.15.70:0/489578558 wait complete. 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 -- start start 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 Processor -- start 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206ba2d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b9ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 0x55f206ba0530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f206ba6070 con 0x55f206b99b40 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f206ab9060 con 0x55f206ba3370 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f206ba61f0 con 0x55f206b985d0 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.534+0000 7fc91175f740 10 client.0 _ll_register_callbacks cb 0x55f20680c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b9ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b9ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42302/0 (socket says 172.21.15.70:42302) 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 -- 172.21.15.70:0/1172867776 learned_addr learned my addr 172.21.15.70:0/1172867776 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90d923640 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 0x55f206ba0530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90d122640 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206ba2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 -- 172.21.15.70:0/1172867776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 msgr2=0x55f206ba2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206ba2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 -- 172.21.15.70:0/1172867776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 msgr2=0x55f206ba0530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 0x55f206ba0530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 -- 172.21.15.70:0/1172867776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f20686f3c0 con 0x55f206b99b40 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90d122640 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206ba2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc90c921640 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b9ffb0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc904005250 tx=0x7fc904004b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2ac96c977107dce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc8f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:24.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/1172867776 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc90400be60 con 0x55f206b99b40 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/1172867776 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc904014040 con 0x55f206b99b40 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc91175f740 1 -- 172.21.15.70:0/1172867776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc9040054f0 con 0x55f206b99b40 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/1172867776 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc90400b900 con 0x55f206b99b40 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc91175f740 10 client.17448 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc91175f740 1 -- 172.21.15.70:0/1172867776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f206bb1ad0 con 0x55f206b99b40 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.535+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/1172867776 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc9040054f0 con 0x55f206b99b40 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.536+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/1172867776 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc90400b040 con 0x55f206b99b40 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.536+0000 7fc91175f740 10 client.17448 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.536+0000 7fc91175f740 10 client.17448 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.536+0000 7fc91175f740 20 client.17448 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.536+0000 7fc91175f740 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f206bb2e80 0x55f206bb5270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.536+0000 7fc91175f740 4 client.17448 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.536+0000 7fc91175f740 1 -- 172.21.15.70:0/1172867776 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f206b0b860 con 0x55f206bb2e80 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.536+0000 7fc90d122640 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f206bb2e80 0x55f206bb5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc90d122640 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f206bb2e80 0x55f206bb5270 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59da9e99d85c0948 server_cookie=1a8281fbf23de3b0 in_seq=0 out_seq=0 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc8f0ff9640 10 client.17448 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/1172867776 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f206b0b860 con 0x55f206bb2e80 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc8f0ff9640 10 client.17448 handle_command_reply: tid=0 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc91175f740 1 client.17448 shutdown 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc91175f740 1 -- 172.21.15.70:0/1172867776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 msgr2=0x55f206b9ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc91175f740 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b9ffb0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7fc904005250 tx=0x7fc904004b90 comp rx=0 tx=0).stop 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc91175f740 1 -- 172.21.15.70:0/1172867776 shutdown_connections 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc91175f740 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f206bb2e80 0x55f206bb5270 crc :-1 s=READY pgs=174 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc91175f740 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 0x55f206ba0530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc91175f740 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b9ffb0 unknown :-1 s=CLOSED pgs=1065 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.537+0000 7fc91175f740 1 --2- 172.21.15.70:0/1172867776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206ba2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.538+0000 7fc91175f740 1 -- 172.21.15.70:0/1172867776 >> 172.21.15.70:0/1172867776 conn(0x55f206b61310 msgr2=0x55f206b9a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.538+0000 7fc8f0ff9640 0 client.17448 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.538+0000 7fc91175f740 1 -- 172.21.15.70:0/1172867776 shutdown_connections 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.538+0000 7fc91175f740 1 -- 172.21.15.70:0/1172867776 wait complete. 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.538+0000 7fc91175f740 20 client.17448 trim_cache size 0 max 16384 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.550+0000 7fc91175f740 1 Processor -- start 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.550+0000 7fc91175f740 1 -- start start 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.550+0000 7fc91175f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206baf340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.550+0000 7fc91175f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b93bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.550+0000 7fc91175f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 0x55f206bba8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc91175f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9081b0170 con 0x55f206b99b40 2024-09-19T04:38:24.610 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc91175f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9081ada40 con 0x55f206ba3370 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc91175f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9081ab8b0 con 0x55f206b985d0 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b93bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b93bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42310/0 (socket says 172.21.15.70:42310) 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 -- 172.21.15.70:0/2717514759 learned_addr learned my addr 172.21.15.70:0/2717514759 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90d122640 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206baf340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 -- 172.21.15.70:0/2717514759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 msgr2=0x55f206baf340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206baf340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 -- 172.21.15.70:0/2717514759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 msgr2=0x55f206bba8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 0x55f206bba8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 -- 172.21.15.70:0/2717514759 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f206b95960 con 0x55f206b99b40 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90d122640 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206baf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:24.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc90c921640 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b93bf0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc90400de80 tx=0x7fc90400bc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e74196a569291d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc8f2ffd640 1 -- 172.21.15.70:0/2717514759 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9040035f0 con 0x55f206b99b40 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc8f2ffd640 1 -- 172.21.15.70:0/2717514759 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc904004c00 con 0x55f206b99b40 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.551+0000 7fc8f2ffd640 1 -- 172.21.15.70:0/2717514759 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9040185a0 con 0x55f206b99b40 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 -- 172.21.15.70:0/2717514759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 msgr2=0x55f206b93bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b93bf0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7fc90400de80 tx=0x7fc90400bc00 comp rx=0 tx=0).stop 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 -- 172.21.15.70:0/2717514759 shutdown_connections 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206ba3370 0x55f206bba8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206b93bf0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 --2- 172.21.15.70:0/2717514759 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206b985d0 0x55f206baf340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 -- 172.21.15.70:0/2717514759 >> 172.21.15.70:0/2717514759 conn(0x55f206b61310 msgr2=0x55f206b934e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 -- 172.21.15.70:0/2717514759 shutdown_connections 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 -- 172.21.15.70:0/2717514759 wait complete. 2024-09-19T04:38:24.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 -- start start 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.552+0000 7fc91175f740 1 Processor -- start 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc91175f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206bab920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc91175f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206ba6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc91175f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206ba3370 0x55f206ba7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc91175f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc9081abf00 con 0x55f206b99b40 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc91175f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc9081ad370 con 0x55f206b985d0 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc91175f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc9081ac5d0 con 0x55f206ba3370 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc91175f740 10 client.0 _ll_register_callbacks cb 0x7fc900009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206ba6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206ba6c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42320/0 (socket says 172.21.15.70:42320) 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 -- 172.21.15.70:0/3147091256 learned_addr learned my addr 172.21.15.70:0/3147091256 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90d122640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206bab920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90d923640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206ba3370 0x55f206ba7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 -- 172.21.15.70:0/3147091256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206ba3370 msgr2=0x55f206ba7190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206ba3370 0x55f206ba7190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 -- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 msgr2=0x55f206bab920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206bab920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 -- 172.21.15.70:0/3147091256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f206b9b120 con 0x55f206b99b40 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90d122640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206bab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90d923640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206ba3370 0x55f206ba7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc90c921640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206ba6c50 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc90400ddb0 tx=0x7fc904004e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8517feef40665226 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc8f0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.553+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/3147091256 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc904037020 con 0x55f206b99b40 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 1 -- 172.21.15.70:0/3147091256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc904004c00 con 0x55f206b99b40 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/3147091256 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc90401f040 con 0x55f206b99b40 2024-09-19T04:38:24.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/3147091256 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc904042050 con 0x55f206b99b40 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 10 client.17454 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 1 -- 172.21.15.70:0/3147091256 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f206c1d350 con 0x55f206b99b40 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/3147091256 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc904004c00 con 0x55f206b99b40 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/3147091256 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc904018cb0 con 0x55f206b99b40 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 10 client.17454 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 10 client.17454 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 20 client.17454 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f206c1da00 0x55f206c1fdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 4 client.17454 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc91175f740 1 -- 172.21.15.70:0/3147091256 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f206b05d70 con 0x55f206c1da00 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.554+0000 7fc90d122640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f206c1da00 0x55f206c1fdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc8f0ff9640 10 client.17454 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:24.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc90d122640 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f206c1da00 0x55f206c1fdf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=324a2914fc7655f4 server_cookie=82a5a2ba06288952 in_seq=0 out_seq=0 2024-09-19T04:38:24.616 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc8f0ff9640 1 -- 172.21.15.70:0/3147091256 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f206b05d70 con 0x55f206c1da00 2024-09-19T04:38:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc8f0ff9640 10 client.17454 handle_command_reply: tid=0 2024-09-19T04:38:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 client.17454 shutdown 2024-09-19T04:38:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 -- 172.21.15.70:0/3147091256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 msgr2=0x55f206ba6c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206ba6c50 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7fc90400ddb0 tx=0x7fc904004e20 comp rx=0 tx=0).stop 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 -- 172.21.15.70:0/3147091256 shutdown_connections 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f206c1da00 0x55f206c1fdf0 crc :-1 s=READY pgs=175 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f206ba3370 0x55f206ba7190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f206b99b40 0x55f206ba6c50 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc8f0ff9640 0 client.17454 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 --2- 172.21.15.70:0/3147091256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f206b985d0 0x55f206bab920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 -- 172.21.15.70:0/3147091256 >> 172.21.15.70:0/3147091256 conn(0x55f206b61310 msgr2=0x55f206ba2030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 -- 172.21.15.70:0/3147091256 shutdown_connections 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 1 -- 172.21.15.70:0/3147091256 wait complete. 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.555+0000 7fc91175f740 20 client.17454 trim_cache size 0 max 16384 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 -- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8f40a33b0 msgr2=0x7fc8f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8f40a33b0 0x7fc8f40a5870 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc900005fe0 tx=0x7fc900005c30 comp rx=0 tx=0).stop 2024-09-19T04:38:24.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 -- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc908100480 msgr2=0x7fc908198410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc908100480 0x7fc908198410 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800c890 tx=0x7fc8f800cd50 comp rx=0 tx=0).stop 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 -- 172.21.15.70:0/2304549444 shutdown_connections 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc8f40a33b0 0x7fc8f40a5870 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc9081055b0 0x7fc90819cce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc908100e30 0x7fc908198950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 --2- 172.21.15.70:0/2304549444 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc908100480 0x7fc908198410 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 -- 172.21.15.70:0/2304549444 >> 172.21.15.70:0/2304549444 conn(0x7fc908077210 msgr2=0x7fc9080feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 -- 172.21.15.70:0/2304549444 shutdown_connections 2024-09-19T04:38:24.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:24.556+0000 7fc90f386640 1 -- 172.21.15.70:0/2304549444 wait complete. 2024-09-19T04:38:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:24 smithi134 ceph-mon[34525]: pgmap v236: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:38:25.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:24 smithi070 ceph-mon[30942]: pgmap v236: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:38:25.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:24 smithi167 ceph-mon[34339]: pgmap v236: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:38:26.470 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:38:26.471 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:38:26.731 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:26.852 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:26 smithi070 ceph-mon[30942]: pgmap v237: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:38:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:26 smithi134 ceph-mon[34525]: pgmap v237: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:38:27.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:26 smithi167 ceph-mon[34339]: pgmap v237: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 -- 172.21.15.70:0/577535013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 msgr2=0x7f77c010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 --2- 172.21.15.70:0/577535013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 0x7f77c010ea90 secure :-1 s=READY pgs=1068 cs=0 l=1 rev1=1 crypto rx=0x7f77b8009ca0 tx=0x7f77b802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 -- 172.21.15.70:0/577535013 shutdown_connections 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 --2- 172.21.15.70:0/577535013 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 0x7f77c010ea90 unknown :-1 s=CLOSED pgs=1068 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 --2- 172.21.15.70:0/577535013 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0102790 0x7f77c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 --2- 172.21.15.70:0/577535013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77c0101de0 0x7f77c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 -- 172.21.15.70:0/577535013 >> 172.21.15.70:0/577535013 conn(0x7f77c00fd8c0 msgr2=0x7f77c00ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 -- 172.21.15.70:0/577535013 shutdown_connections 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.231+0000 7f77c50e8640 1 -- 172.21.15.70:0/577535013 wait complete. 2024-09-19T04:38:27.248 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.232+0000 7f77c50e8640 1 Processor -- start 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.232+0000 7f77c50e8640 1 -- start start 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77c50e8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77c0101de0 0x7f77c01985a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77c50e8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0102790 0x7f77c0198ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77c50e8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 0x7f77c019ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77c50e8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0112000 con 0x7f77c0106f10 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77c50e8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0111e80 con 0x7f77c0101de0 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77c50e8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77c0112180 con 0x7f77c0102790 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 0x7f77c019ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 0x7f77c019ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42346/0 (socket says 172.21.15.70:42346) 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 -- 172.21.15.70:0/2143839791 learned_addr learned my addr 172.21.15.70:0/2143839791 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:27.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bed9d640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77c0101de0 0x7f77c01985a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77be59c640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0102790 0x7f77c0198ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 -- 172.21.15.70:0/2143839791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0102790 msgr2=0x7f77c0198ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0102790 0x7f77c0198ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 -- 172.21.15.70:0/2143839791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77c0101de0 msgr2=0x7f77c01985a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77c0101de0 0x7f77c01985a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 -- 172.21.15.70:0/2143839791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77c019d550 con 0x7f77c0106f10 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77bf59e640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 0x7f77c019ce70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f77b80097b0 tx=0x7f77b8003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77b7fff640 1 -- 172.21.15.70:0/2143839791 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b80317d0 con 0x7f77c0106f10 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77b7fff640 1 -- 172.21.15.70:0/2143839791 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f77b8031970 con 0x7f77c0106f10 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77b7fff640 1 -- 172.21.15.70:0/2143839791 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b802fc70 con 0x7f77c0106f10 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77c50e8640 1 -- 172.21.15.70:0/2143839791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77c019d7e0 con 0x7f77c0106f10 2024-09-19T04:38:27.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.233+0000 7f77c50e8640 1 -- 172.21.15.70:0/2143839791 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77c01a5120 con 0x7f77c0106f10 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.236+0000 7f77b7fff640 1 -- 172.21.15.70:0/2143839791 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f77b8004040 con 0x7f77c0106f10 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.236+0000 7f77c74c1740 1 Processor -- start 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.236+0000 7f77c74c1740 1 -- start start 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802eb60 0x55dd1802ef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 0x55dd18039800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd1803c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77c74c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dd17f94280 con 0x55dd1802eb60 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77c74c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dd17f3bb10 con 0x55dd1802f480 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77c74c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dd17f90240 con 0x55dd18039d40 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802eb60 0x55dd1802ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77b7fff640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f77ac0a33b0 0x7f77ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802eb60 0x55dd1802ef40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42348/0 (socket says 172.21.15.70:42348) 2024-09-19T04:38:27.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 -- 172.21.15.70:0/3082073829 learned_addr learned my addr 172.21.15.70:0/3082073829 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77bf59e640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f77ac0a33b0 0x7f77ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd1803c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77bed9d640 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 0x55dd18039800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 -- 172.21.15.70:0/3082073829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 msgr2=0x55dd1803c130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd1803c130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 -- 172.21.15.70:0/3082073829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 msgr2=0x55dd18039800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 0x55dd18039800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 -- 172.21.15.70:0/3082073829 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd17f481f0 con 0x55dd1802eb60 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77b7fff640 1 -- 172.21.15.70:0/2143839791 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f77b80f13a0 con 0x7f77c0106f10 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.237+0000 7f77be59c640 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802eb60 0x55dd1802ef40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f77b0006e10 tx=0x7f77b0009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281d9a123e666ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77bf59e640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f77ac0a33b0 0x7f77ac0a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f77b80c5e70 tx=0x7f77b80b9a50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:27.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77b57fa640 1 -- 172.21.15.70:0/3082073829 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b000fe60 con 0x55dd1802eb60 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77b57fa640 1 -- 172.21.15.70:0/3082073829 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f77b001e070 con 0x55dd1802eb60 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77b57fa640 1 -- 172.21.15.70:0/3082073829 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0014be0 con 0x55dd1802eb60 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77c74c1740 1 -- 172.21.15.70:0/3082073829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802eb60 msgr2=0x55dd1802ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77c74c1740 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802eb60 0x55dd1802ef40 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f77b0006e10 tx=0x7f77b0009420 comp rx=0 tx=0).stop 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77c74c1740 1 -- 172.21.15.70:0/3082073829 shutdown_connections 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77c74c1740 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd1803c130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77c74c1740 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 0x55dd18039800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77c74c1740 1 --2- 172.21.15.70:0/3082073829 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802eb60 0x55dd1802ef40 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.238+0000 7f77c74c1740 1 -- 172.21.15.70:0/3082073829 >> 172.21.15.70:0/3082073829 conn(0x55dd1802b0f0 msgr2=0x55dd1802b4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 -- 172.21.15.70:0/3082073829 shutdown_connections 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 -- 172.21.15.70:0/3082073829 wait complete. 2024-09-19T04:38:27.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 -- start start 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 Processor -- start 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802eb60 0x55dd18036bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd18037100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd18037640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55dd1803c910 con 0x55dd1802f480 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55dd17f4ef10 con 0x55dd1802eb60 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55dd1803ca90 con 0x55dd18039d40 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77c74c1740 10 client.0 _ll_register_callbacks cb 0x55dd17f17a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77bed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd18037100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77bed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd18037100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42352/0 (socket says 172.21.15.70:42352) 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77bed9d640 1 -- 172.21.15.70:0/2746129515 learned_addr learned my addr 172.21.15.70:0/2746129515 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:27.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77be59c640 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd18037640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77be59c640 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802eb60 0x55dd18036bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77bed9d640 1 -- 172.21.15.70:0/2746129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 msgr2=0x55dd18037640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77bed9d640 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd18037640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77bed9d640 1 -- 172.21.15.70:0/2746129515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802eb60 msgr2=0x55dd18036bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77bed9d640 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802eb60 0x55dd18036bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77bed9d640 1 -- 172.21.15.70:0/2746129515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd17d056a0 con 0x55dd1802f480 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.239+0000 7f77be59c640 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd18037640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77bed9d640 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd18037100 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009ee0 tx=0x7f77a8011630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=712b81c8f9ff1b6e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77a67fc640 1 -- 172.21.15.70:0/2746129515 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a8019070 con 0x55dd1802f480 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77a67fc640 1 -- 172.21.15.70:0/2746129515 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f77a8015660 con 0x55dd1802f480 2024-09-19T04:38:27.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 1 -- 172.21.15.70:0/2746129515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b001e070 con 0x55dd1802f480 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77a67fc640 1 -- 172.21.15.70:0/2746129515 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f77a8025050 con 0x55dd1802f480 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 10 client.17466 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 1 -- 172.21.15.70:0/2746129515 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dd18048520 con 0x55dd1802f480 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77a67fc640 1 -- 172.21.15.70:0/2746129515 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f77b001e070 con 0x55dd1802f480 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77a67fc640 1 -- 172.21.15.70:0/2746129515 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f77a8014ac0 con 0x55dd1802f480 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 10 client.17466 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 10 client.17466 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 20 client.17466 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dd18049980 0x55dd1804bde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 4 client.17466 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.240+0000 7f77c74c1740 1 -- 172.21.15.70:0/2746129515 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55dd17fa17f0 con 0x55dd18049980 2024-09-19T04:38:27.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.241+0000 7f77be59c640 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dd18049980 0x55dd1804bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.241+0000 7f77a67fc640 10 client.17466 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.241+0000 7f77be59c640 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dd18049980 0x55dd1804bde0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=272e2156ee65d3a3 server_cookie=c15257df84c81be5 in_seq=0 out_seq=0 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77a67fc640 1 -- 172.21.15.70:0/2746129515 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55dd17fa17f0 con 0x55dd18049980 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77a67fc640 10 client.17466 handle_command_reply: tid=0 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 client.17466 shutdown 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 -- 172.21.15.70:0/2746129515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 msgr2=0x55dd18037100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd18037100 secure :-1 s=READY pgs=1071 cs=0 l=1 rev1=1 crypto rx=0x7f77a8009ee0 tx=0x7f77a8011630 comp rx=0 tx=0).stop 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 -- 172.21.15.70:0/2746129515 shutdown_connections 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dd18049980 0x55dd1804bde0 crc :-1 s=READY pgs=176 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77a67fc640 0 client.17466 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd18039d40 0x55dd18037640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd18037100 unknown :-1 s=CLOSED pgs=1071 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2746129515 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802eb60 0x55dd18036bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 -- 172.21.15.70:0/2746129515 >> 172.21.15.70:0/2746129515 conn(0x55dd1802b0f0 msgr2=0x55dd18030e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:27.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 -- 172.21.15.70:0/2746129515 shutdown_connections 2024-09-19T04:38:27.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 1 -- 172.21.15.70:0/2746129515 wait complete. 2024-09-19T04:38:27.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.242+0000 7f77c74c1740 20 client.17466 trim_cache size 0 max 16384 2024-09-19T04:38:27.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.259+0000 7f77c74c1740 1 Processor -- start 2024-09-19T04:38:27.261 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.259+0000 7f77c74c1740 1 -- start start 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 0x55dd180315c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 0x55dd18038a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd18039d40 0x55dd180516b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77c74c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01adfa0 con 0x55dd18039d40 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77c74c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01ab870 con 0x55dd1802f480 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77c74c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01a96e0 con 0x55dd1802eb60 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd18039d40 0x55dd180516b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd18039d40 0x55dd180516b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42362/0 (socket says 172.21.15.70:42362) 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 -- 172.21.15.70:0/2990136524 learned_addr learned my addr 172.21.15.70:0/2990136524 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:27.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77bed9d640 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 0x55dd18038a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 0x55dd180315c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 -- 172.21.15.70:0/2990136524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 msgr2=0x55dd180315c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 0x55dd180315c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 -- 172.21.15.70:0/2990136524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 msgr2=0x55dd18038a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 0x55dd18038a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 -- 172.21.15.70:0/2990136524 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dd1802af20 con 0x55dd18039d40 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.260+0000 7f77be59c640 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd18039d40 0x55dd180516b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f77b001d000 tx=0x7f77b0009420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4247481fa583c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77b4ff9640 1 -- 172.21.15.70:0/2990136524 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b0033070 con 0x55dd18039d40 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77b4ff9640 1 -- 172.21.15.70:0/2990136524 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f77b001e040 con 0x55dd18039d40 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77b4ff9640 1 -- 172.21.15.70:0/2990136524 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77b002d2f0 con 0x55dd18039d40 2024-09-19T04:38:27.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 -- 172.21.15.70:0/2990136524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd18039d40 msgr2=0x55dd180516b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd18039d40 0x55dd180516b0 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f77b001d000 tx=0x7f77b0009420 comp rx=0 tx=0).stop 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 -- 172.21.15.70:0/2990136524 shutdown_connections 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd18039d40 0x55dd180516b0 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd1802f480 0x55dd18038a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2990136524 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 0x55dd180315c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 -- 172.21.15.70:0/2990136524 >> 172.21.15.70:0/2990136524 conn(0x55dd1802b0f0 msgr2=0x55dd18038310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 -- 172.21.15.70:0/2990136524 shutdown_connections 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.261+0000 7f77c74c1740 1 -- 172.21.15.70:0/2990136524 wait complete. 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 1 -- start start 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 1 Processor -- start 2024-09-19T04:38:27.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 0x55dd18041cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd180421f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd18039d40 0x55dd1803ec80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01a9d30 con 0x55dd1802f480 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01ab1a0 con 0x55dd18039d40 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f77c01aa400 con 0x55dd1802eb60 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77c74c1740 10 client.0 _ll_register_callbacks cb 0x7f77a80094a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77bed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd180421f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77bed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd180421f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42368/0 (socket says 172.21.15.70:42368) 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77bed9d640 1 -- 172.21.15.70:0/2341884114 learned_addr learned my addr 172.21.15.70:0/2341884114 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77be59c640 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 0x55dd18041cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77be59c640 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd18039d40 0x55dd1803ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77bed9d640 1 -- 172.21.15.70:0/2341884114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 msgr2=0x55dd18041cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:27.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77bed9d640 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 0x55dd18041cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77bed9d640 1 -- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd18039d40 msgr2=0x55dd1803ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.262+0000 7f77bed9d640 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd18039d40 0x55dd1803ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77bed9d640 1 -- 172.21.15.70:0/2341884114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dd18042860 con 0x55dd1802f480 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77be59c640 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd18039d40 0x55dd1803ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77bed9d640 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd180421f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f77a800a010 tx=0x7f77a801d690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5982b439c237798 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77a67fc640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77a67fc640 1 -- 172.21.15.70:0/2341884114 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77a802d070 con 0x55dd1802f480 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77a67fc640 1 -- 172.21.15.70:0/2341884114 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f77a8005dd0 con 0x55dd1802f480 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 1 -- 172.21.15.70:0/2341884114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f77b001e040 con 0x55dd1802f480 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77a67fc640 1 -- 172.21.15.70:0/2341884114 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f77a8035050 con 0x55dd1802f480 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 10 client.17472 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:27.270 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 1 -- 172.21.15.70:0/2341884114 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55dd180b4c10 con 0x55dd1802f480 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77a67fc640 1 -- 172.21.15.70:0/2341884114 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f77b001e040 con 0x55dd1802f480 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77a67fc640 1 -- 172.21.15.70:0/2341884114 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f77a8030030 con 0x55dd1802f480 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 10 client.17472 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 10 client.17472 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 20 client.17472 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dd18049980 0x55dd180b7340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 4 client.17472 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.263+0000 7f77c74c1740 1 -- 172.21.15.70:0/2341884114 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55dd17f9bd00 con 0x55dd18049980 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.264+0000 7f77be59c640 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dd18049980 0x55dd180b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.264+0000 7f77a67fc640 10 client.17472 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:27.271 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.264+0000 7f77be59c640 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dd18049980 0x55dd180b7340 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7fba7af158d2e992 server_cookie=844b1648aa1feaf in_seq=0 out_seq=0 2024-09-19T04:38:27.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77a67fc640 1 -- 172.21.15.70:0/2341884114 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55dd17f9bd00 con 0x55dd18049980 2024-09-19T04:38:27.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77a67fc640 10 client.17472 handle_command_reply: tid=0 2024-09-19T04:38:27.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 client.17472 shutdown 2024-09-19T04:38:27.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 -- 172.21.15.70:0/2341884114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 msgr2=0x55dd180421f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.272 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd180421f0 secure :-1 s=READY pgs=1073 cs=0 l=1 rev1=1 crypto rx=0x7f77a800a010 tx=0x7f77a801d690 comp rx=0 tx=0).stop 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 -- 172.21.15.70:0/2341884114 shutdown_connections 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55dd18049980 0x55dd180b7340 crc :-1 s=READY pgs=177 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55dd18039d40 0x55dd1803ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55dd1802f480 0x55dd180421f0 unknown :-1 s=CLOSED pgs=1073 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 --2- 172.21.15.70:0/2341884114 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55dd1802eb60 0x55dd18041cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 -- 172.21.15.70:0/2341884114 >> 172.21.15.70:0/2341884114 conn(0x55dd1802b0f0 msgr2=0x55dd1802a270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77a67fc640 0 client.17472 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 -- 172.21.15.70:0/2341884114 shutdown_connections 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.265+0000 7f77c74c1740 1 -- 172.21.15.70:0/2341884114 wait complete. 2024-09-19T04:38:27.273 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c74c1740 20 client.17472 trim_cache size 0 max 16384 2024-09-19T04:38:27.274 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:38:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "446ed45c-f4c1-4b25-9de4-19e74bd82ae9", 2024-09-19T04:38:27.274 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:38:27.274 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 -- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f77ac0a33b0 msgr2=0x7f77ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f77ac0a33b0 0x7f77ac0a5870 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f77b80c5e70 tx=0x7f77b80b9a50 comp rx=0 tx=0).stop 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 -- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 msgr2=0x7f77c019ce70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 0x7f77c019ce70 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f77b80097b0 tx=0x7f77b8003f30 comp rx=0 tx=0).stop 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 -- 172.21.15.70:0/2143839791 shutdown_connections 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f77ac0a33b0 0x7f77ac0a5870 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f77c0106f10 0x7f77c019ce70 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f77c0102790 0x7f77c0198ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 --2- 172.21.15.70:0/2143839791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f77c0101de0 0x7f77c01985a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:27.275 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 -- 172.21.15.70:0/2143839791 >> 172.21.15.70:0/2143839791 conn(0x7f77c00fd8c0 msgr2=0x7f77c00fecc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:27.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 -- 172.21.15.70:0/2143839791 shutdown_connections 2024-09-19T04:38:27.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:27.266+0000 7f77c50e8640 1 -- 172.21.15.70:0/2143839791 wait complete. 2024-09-19T04:38:27.940 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:38:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:27 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:38:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:27 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:27 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:38:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:27 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:28.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:27 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:38:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:27 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:38:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:27 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:27 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:38:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:27 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:28.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:27 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:38:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:27 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:38:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:27 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:27 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:38:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:27 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:28.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:27 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:38:28.188 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:28.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 -- 172.21.15.70:0/3713228791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 msgr2=0x7f0818107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 --2- 172.21.15.70:0/3713228791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 0x7f0818107b90 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7f080c009930 tx=0x7f080c02a420 comp rx=0 tx=0).stop 2024-09-19T04:38:28.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 -- 172.21.15.70:0/3713228791 shutdown_connections 2024-09-19T04:38:28.699 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 --2- 172.21.15.70:0/3713228791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08181082a0 0x7f081810ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 --2- 172.21.15.70:0/3713228791 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 0x7f0818107b90 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 --2- 172.21.15.70:0/3713228791 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0818102d30 0x7f0818103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 -- 172.21.15.70:0/3713228791 >> 172.21.15.70:0/3713228791 conn(0x7f08180fc7d0 msgr2=0x7f08180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 -- 172.21.15.70:0/3713228791 shutdown_connections 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.677+0000 7f081ec4e640 1 -- 172.21.15.70:0/3713228791 wait complete. 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081ec4e640 1 Processor -- start 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081ec4e640 1 -- start start 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081ec4e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0818102d30 0x7f08181985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081ec4e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 0x7f0818198b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081ec4e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08181082a0 0x7f081819cec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081ec4e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0818112070 con 0x7f08181036e0 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081ec4e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0818111ef0 con 0x7f0818102d30 2024-09-19T04:38:28.700 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081ec4e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f08181121f0 con 0x7f08181082a0 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f0817fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 0x7f0818198b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f0817fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 0x7f0818198b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42398/0 (socket says 172.21.15.70:42398) 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f0817fff640 1 -- 172.21.15.70:0/2579121100 learned_addr learned my addr 172.21.15.70:0/2579121100 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081c9ea640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0818102d30 0x7f08181985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f081d1eb640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08181082a0 0x7f081819cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f0817fff640 1 -- 172.21.15.70:0/2579121100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08181082a0 msgr2=0x7f081819cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f0817fff640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08181082a0 0x7f081819cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f0817fff640 1 -- 172.21.15.70:0/2579121100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0818102d30 msgr2=0x7f08181985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f0817fff640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0818102d30 0x7f08181985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.678+0000 7f0817fff640 1 -- 172.21.15.70:0/2579121100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f081819d5a0 con 0x7f08181036e0 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.679+0000 7f081c9ea640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0818102d30 0x7f08181985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:28.701 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.679+0000 7f0817fff640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 0x7f0818198b30 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f080c005940 tx=0x7f080c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.679+0000 7f0815ffb640 1 -- 172.21.15.70:0/2579121100 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c03f030 con 0x7f08181036e0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.679+0000 7f0815ffb640 1 -- 172.21.15.70:0/2579121100 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f080c003ac0 con 0x7f08181036e0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.679+0000 7f0815ffb640 1 -- 172.21.15.70:0/2579121100 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c035070 con 0x7f08181036e0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.679+0000 7f081ec4e640 1 -- 172.21.15.70:0/2579121100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f081819d830 con 0x7f08181036e0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.679+0000 7f081ec4e640 1 -- 172.21.15.70:0/2579121100 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08181a5170 con 0x7f08181036e0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.681+0000 7f0815ffb640 1 -- 172.21.15.70:0/2579121100 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f080c042030 con 0x7f08181036e0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0821027740 1 Processor -- start 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0815ffb640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08000a3430 0x7f08000a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0821027740 1 -- start start 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f081d1eb640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08000a3430 0x7f08000a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0815ffb640 1 -- 172.21.15.70:0/2579121100 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f080c0f0110 con 0x7f08181036e0 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0821027740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359ed2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.702 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0821027740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359edd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0821027740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 0x561359edfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0821027740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561359e382e0 con 0x561359ed24a0 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0821027740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561359ddfce0 con 0x561359ed2dc0 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.682+0000 7f0821027740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561359e342a0 con 0x561359edd680 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359ed2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359ed2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42404/0 (socket says 172.21.15.70:42404) 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 -- 172.21.15.70:0/1325766768 learned_addr learned my addr 172.21.15.70:0/1325766768 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081d1eb640 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 0x561359edfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f0817fff640 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359edd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 -- 172.21.15.70:0/1325766768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 msgr2=0x561359edfa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 0x561359edfa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.703 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 -- 172.21.15.70:0/1325766768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 msgr2=0x561359edd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359edd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081d1eb640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08000a3430 0x7f08000a58f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f081000ca20 tx=0x7f081000ce20 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 -- 172.21.15.70:0/1325766768 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561359dc4440 con 0x561359ed24a0 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f0817fff640 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359edd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f081c9ea640 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359ed2880 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f08080103a0 tx=0x7f0808010860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc8404a68c8e60c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f07feffd640 1 -- 172.21.15.70:0/1325766768 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808016070 con 0x561359ed24a0 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f07feffd640 1 -- 172.21.15.70:0/1325766768 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0808012be0 con 0x561359ed24a0 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.683+0000 7f07feffd640 1 -- 172.21.15.70:0/1325766768 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0808011c80 con 0x561359ed24a0 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 -- 172.21.15.70:0/1325766768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 msgr2=0x561359ed2880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359ed2880 secure :-1 s=READY pgs=1076 cs=0 l=1 rev1=1 crypto rx=0x7f08080103a0 tx=0x7f0808010860 comp rx=0 tx=0).stop 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 -- 172.21.15.70:0/1325766768 shutdown_connections 2024-09-19T04:38:28.704 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 0x561359edfa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359edd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 --2- 172.21.15.70:0/1325766768 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359ed2880 unknown :-1 s=CLOSED pgs=1076 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 -- 172.21.15.70:0/1325766768 >> 172.21.15.70:0/1325766768 conn(0x561359ecea30 msgr2=0x561359ecee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 -- 172.21.15.70:0/1325766768 shutdown_connections 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 -- 172.21.15.70:0/1325766768 wait complete. 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 -- start start 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.684+0000 7f0821027740 1 Processor -- start 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0821027740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359edcfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0821027740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed2dc0 0x561359eda280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0821027740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359edd680 0x561359eda7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0821027740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x561359ee0250 con 0x561359ed24a0 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0821027740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x561359df3050 con 0x561359edd680 2024-09-19T04:38:28.705 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0821027740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x561359ee03d0 con 0x561359ed2dc0 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0821027740 10 client.0 _ll_register_callbacks cb 0x561359e33160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359edcfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359edcfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42420/0 (socket says 172.21.15.70:42420) 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 -- 172.21.15.70:0/1338509165 learned_addr learned my addr 172.21.15.70:0/1338509165 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081d1eb640 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359edd680 0x561359eda7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0817fff640 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed2dc0 0x561359eda280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 -- 172.21.15.70:0/1338509165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed2dc0 msgr2=0x561359eda280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed2dc0 0x561359eda280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 -- 172.21.15.70:0/1338509165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359edd680 msgr2=0x561359eda7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359edd680 0x561359eda7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 -- 172.21.15.70:0/1338509165 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561359ba93c0 con 0x561359ed24a0 2024-09-19T04:38:28.706 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f0817fff640 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed2dc0 0x561359eda280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f081c9ea640 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359edcfd0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0808013fd0 tx=0x7f08080117b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2767066e9c131328 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.685+0000 7f07f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f07f7fff640 1 -- 172.21.15.70:0/1338509165 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080802a060 con 0x561359ed24a0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f07f7fff640 1 -- 172.21.15.70:0/1338509165 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0808004c50 con 0x561359ed24a0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 1 -- 172.21.15.70:0/1338509165 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0808012be0 con 0x561359ed24a0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f07f7fff640 1 -- 172.21.15.70:0/1338509165 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0808016050 con 0x561359ed24a0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 10 client.17484 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 1 -- 172.21.15.70:0/1338509165 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561359eebb90 con 0x561359ed24a0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f07f7fff640 1 -- 172.21.15.70:0/1338509165 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0808012be0 con 0x561359ed24a0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f07f7fff640 1 -- 172.21.15.70:0/1338509165 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f080800f040 con 0x561359ed24a0 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 10 client.17484 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 10 client.17484 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:28.707 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 20 client.17484 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x561359eed050 0x561359eef440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 4 client.17484 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.686+0000 7f0821027740 1 -- 172.21.15.70:0/1338509165 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561359e45850 con 0x561359eed050 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.687+0000 7f0817fff640 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x561359eed050 0x561359eef440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.687+0000 7f07f7fff640 10 client.17484 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.687+0000 7f0817fff640 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x561359eed050 0x561359eef440 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afa92c00586dbb05 server_cookie=9a6dfca96c182f72 in_seq=0 out_seq=0 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f07f7fff640 1 -- 172.21.15.70:0/1338509165 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x561359e45850 con 0x561359eed050 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f07f7fff640 10 client.17484 handle_command_reply: tid=0 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 client.17484 shutdown 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 -- 172.21.15.70:0/1338509165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 msgr2=0x561359edcfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359edcfd0 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f0808013fd0 tx=0x7f08080117b0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.708 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 -- 172.21.15.70:0/1338509165 shutdown_connections 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x561359eed050 0x561359eef440 crc :-1 s=READY pgs=178 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359edd680 0x561359eda7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed2dc0 0x561359eda280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 --2- 172.21.15.70:0/1338509165 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed24a0 0x561359edcfd0 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 -- 172.21.15.70:0/1338509165 >> 172.21.15.70:0/1338509165 conn(0x561359ecea30 msgr2=0x561359ed4760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f07f7fff640 0 client.17484 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 -- 172.21.15.70:0/1338509165 shutdown_connections 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 1 -- 172.21.15.70:0/1338509165 wait complete. 2024-09-19T04:38:28.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.688+0000 7f0821027740 20 client.17484 trim_cache size 0 max 16384 2024-09-19T04:38:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0821027740 1 Processor -- start 2024-09-19T04:38:28.714 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0821027740 1 -- start start 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0821027740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed24a0 0x561359ee94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0821027740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359ef49e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0821027740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359edd680 0x561359ef4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0821027740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f08181b0190 con 0x561359edd680 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0821027740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08181ada60 con 0x561359ed2dc0 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0821027740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f08181ab8d0 con 0x561359ed24a0 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081d1eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359edd680 0x561359ef4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081d1eb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359edd680 0x561359ef4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42428/0 (socket says 172.21.15.70:42428) 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081d1eb640 1 -- 172.21.15.70:0/268917721 learned_addr learned my addr 172.21.15.70:0/268917721 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f0817fff640 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359ef49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081c9ea640 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed24a0 0x561359ee94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.715 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081d1eb640 1 -- 172.21.15.70:0/268917721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed24a0 msgr2=0x561359ee94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081d1eb640 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed24a0 0x561359ee94b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081d1eb640 1 -- 172.21.15.70:0/268917721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 msgr2=0x561359ef49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081d1eb640 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359ef49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.706+0000 7f081d1eb640 1 -- 172.21.15.70:0/268917721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561359ed87d0 con 0x561359edd680 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.707+0000 7f081d1eb640 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359edd680 0x561359ef4f20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f081000ee20 tx=0x7f0810019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e66c2474f1ee2750 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.707+0000 7f07fe7fc640 1 -- 172.21.15.70:0/268917721 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810010840 con 0x561359edd680 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.707+0000 7f07fe7fc640 1 -- 172.21.15.70:0/268917721 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f081000ee50 con 0x561359edd680 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.707+0000 7f07fe7fc640 1 -- 172.21.15.70:0/268917721 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0810026dc0 con 0x561359edd680 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- 172.21.15.70:0/268917721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359edd680 msgr2=0x561359ef4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359edd680 0x561359ef4f20 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f081000ee20 tx=0x7f0810019000 comp rx=0 tx=0).stop 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- 172.21.15.70:0/268917721 shutdown_connections 2024-09-19T04:38:28.716 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359edd680 0x561359ef4f20 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed2dc0 0x561359ef49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 --2- 172.21.15.70:0/268917721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359ed24a0 0x561359ee94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- 172.21.15.70:0/268917721 >> 172.21.15.70:0/268917721 conn(0x561359ecea30 msgr2=0x561359ed9370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- 172.21.15.70:0/268917721 shutdown_connections 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- 172.21.15.70:0/268917721 wait complete. 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- start start 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 Processor -- start 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed24a0 0x561359f4ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed2dc0 0x561359f4f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 0x561359ee2bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f08181abf20 con 0x561359ed2dc0 2024-09-19T04:38:28.717 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f08181ad390 con 0x561359ed24a0 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f08181ac5f0 con 0x561359edd680 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.708+0000 7f0821027740 10 client.0 _ll_register_callbacks cb 0x7f0808009e80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed2dc0 0x561359f4f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed2dc0 0x561359f4f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42430/0 (socket says 172.21.15.70:42430) 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 -- 172.21.15.70:0/949472192 learned_addr learned my addr 172.21.15.70:0/949472192 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f081c9ea640 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed24a0 0x561359f4ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 -- 172.21.15.70:0/949472192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 msgr2=0x561359ee2bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 0x561359ee2bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 -- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed24a0 msgr2=0x561359f4ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed24a0 0x561359f4ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.718 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 -- 172.21.15.70:0/949472192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561359ee33c0 con 0x561359ed2dc0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f081c9ea640 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed24a0 0x561359f4ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0817fff640 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed2dc0 0x561359f4f250 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f080c0b8e60 tx=0x7f080c009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af43e44a67860c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f07f7fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f07f7fff640 1 -- 172.21.15.70:0/949472192 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f080c0da060 con 0x561359ed2dc0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f07f7fff640 1 -- 172.21.15.70:0/949472192 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f080c003c70 con 0x561359ed2dc0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0821027740 1 -- 172.21.15.70:0/949472192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f081000ee50 con 0x561359ed2dc0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f07f7fff640 1 -- 172.21.15.70:0/949472192 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f080c049040 con 0x561359ed2dc0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0821027740 10 client.17490 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.709+0000 7f0821027740 1 -- 172.21.15.70:0/949472192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x561359f57540 con 0x561359ed2dc0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f07f7fff640 1 -- 172.21.15.70:0/949472192 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f081000ee50 con 0x561359ed2dc0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f07f7fff640 1 -- 172.21.15.70:0/949472192 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f080c0c4c70 con 0x561359ed2dc0 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f0821027740 10 client.17490 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:28.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f0821027740 10 client.17490 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f0821027740 20 client.17490 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f0821027740 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x561359f57c70 0x561359f5a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f0821027740 4 client.17490 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f0821027740 1 -- 172.21.15.70:0/949472192 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x561359e3fd60 con 0x561359f57c70 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.710+0000 7f081c9ea640 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x561359f57c70 0x561359f5a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f081c9ea640 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x561359f57c70 0x561359f5a090 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6621add4c1b1adee server_cookie=c15a81ea34a7a276 in_seq=0 out_seq=0 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f07f7fff640 10 client.17490 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f07f7fff640 1 -- 172.21.15.70:0/949472192 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x561359e3fd60 con 0x561359f57c70 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f07f7fff640 10 client.17490 handle_command_reply: tid=0 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 client.17490 shutdown 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 -- 172.21.15.70:0/949472192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed2dc0 msgr2=0x561359f4f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed2dc0 0x561359f4f250 secure :-1 s=READY pgs=1079 cs=0 l=1 rev1=1 crypto rx=0x7f080c0b8e60 tx=0x7f080c009680 comp rx=0 tx=0).stop 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 -- 172.21.15.70:0/949472192 shutdown_connections 2024-09-19T04:38:28.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x561359f57c70 0x561359f5a090 crc :-1 s=READY pgs=179 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x561359edd680 0x561359ee2bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x561359ed2dc0 0x561359f4f250 unknown :-1 s=CLOSED pgs=1079 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 --2- 172.21.15.70:0/949472192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x561359ed24a0 0x561359f4ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 -- 172.21.15.70:0/949472192 >> 172.21.15.70:0/949472192 conn(0x561359ecea30 msgr2=0x561359ecd220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f07f7fff640 0 client.17490 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 -- 172.21.15.70:0/949472192 shutdown_connections 2024-09-19T04:38:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 1 -- 172.21.15.70:0/949472192 wait complete. 2024-09-19T04:38:28.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.711+0000 7f0821027740 20 client.17490 trim_cache size 0 max 16384 2024-09-19T04:38:28.722 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:38:28.722 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:38:28.722 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:28.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 -- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08000a3430 msgr2=0x7f08000a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08000a3430 0x7f08000a58f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f081000ca20 tx=0x7f081000ce20 comp rx=0 tx=0).stop 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 -- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 msgr2=0x7f0818198b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 0x7f0818198b30 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7f080c005940 tx=0x7f080c0042f0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 -- 172.21.15.70:0/2579121100 shutdown_connections 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f08000a3430 0x7f08000a58f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f08181082a0 0x7f081819cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f08181036e0 0x7f0818198b30 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 --2- 172.21.15.70:0/2579121100 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0818102d30 0x7f08181985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 -- 172.21.15.70:0/2579121100 >> 172.21.15.70:0/2579121100 conn(0x7f08180fc7d0 msgr2=0x7f0818105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 -- 172.21.15.70:0/2579121100 shutdown_connections 2024-09-19T04:38:28.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:28.712+0000 7f081ec4e640 1 -- 172.21.15.70:0/2579121100 wait complete. 2024-09-19T04:38:28.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:28 smithi070 ceph-mon[30942]: pgmap v238: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:38:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:28 smithi134 ceph-mon[34525]: pgmap v238: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:38:29.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:28 smithi167 ceph-mon[34339]: pgmap v238: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:38:29.328 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:38:29.328 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:38:29.575 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:30.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 -- 172.21.15.70:0/3175311836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22181036c0 msgr2=0x7f221810bbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:30.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3175311836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22181036c0 0x7f221810bbb0 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7f220c009900 tx=0x7f220c02a480 comp rx=0 tx=0).stop 2024-09-19T04:38:30.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 -- 172.21.15.70:0/3175311836 shutdown_connections 2024-09-19T04:38:30.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3175311836 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f221810c180 0x7f221810e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.075 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3175311836 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f22181036c0 0x7f221810bbb0 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3175311836 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2218102da0 0x7f2218103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 -- 172.21.15.70:0/3175311836 >> 172.21.15.70:0/3175311836 conn(0x7f22180fc7a0 msgr2=0x7f22180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:30.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 -- 172.21.15.70:0/3175311836 shutdown_connections 2024-09-19T04:38:30.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.073+0000 7f221ddeb640 1 -- 172.21.15.70:0/3175311836 wait complete. 2024-09-19T04:38:30.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.074+0000 7f221ddeb640 1 Processor -- start 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.074+0000 7f221ddeb640 1 -- start start 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f221ddeb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2218102da0 0x7f22181983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f221ddeb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22181036c0 0x7f2218198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f221ddeb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221810c180 0x7f221819cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f221ddeb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2218111f30 con 0x7f221810c180 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f221ddeb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2218111db0 con 0x7f22181036c0 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f221ddeb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f22181120b0 con 0x7f2218102da0 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221810c180 0x7f221819cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221810c180 0x7f221819cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42448/0 (socket says 172.21.15.70:42448) 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 -- 172.21.15.70:0/3529747024 learned_addr learned my addr 172.21.15.70:0/3529747024 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2216ffd640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22181036c0 0x7f2218198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:30.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f22177fe640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2218102da0 0x7f22181983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 -- 172.21.15.70:0/3529747024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2218102da0 msgr2=0x7f22181983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2218102da0 0x7f22181983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 -- 172.21.15.70:0/3529747024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22181036c0 msgr2=0x7f2218198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22181036c0 0x7f2218198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 -- 172.21.15.70:0/3529747024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f221819d380 con 0x7f221810c180 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2217fff640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221810c180 0x7f221819cca0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2210009fd0 tx=0x7f221000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2214ff9640 1 -- 172.21.15.70:0/3529747024 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2210017070 con 0x7f221810c180 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2214ff9640 1 -- 172.21.15.70:0/3529747024 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2210003e40 con 0x7f221810c180 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f221819d670 con 0x7f221810c180 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.075+0000 7f2214ff9640 1 -- 172.21.15.70:0/3529747024 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22100106c0 con 0x7f221810c180 2024-09-19T04:38:30.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.076+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22181a4f50 con 0x7f221810c180 2024-09-19T04:38:30.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.077+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2218103180 con 0x7f221810c180 2024-09-19T04:38:30.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.078+0000 7f2214ff9640 1 -- 172.21.15.70:0/3529747024 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2210003970 con 0x7f221810c180 2024-09-19T04:38:30.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.078+0000 7f2214ff9640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f22000a33b0 0x7f22000a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:30.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.079+0000 7f22177fe640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f22000a33b0 0x7f22000a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:30.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.079+0000 7f2214ff9640 1 -- 172.21.15.70:0/3529747024 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f22100cfa50 con 0x7f221810c180 2024-09-19T04:38:30.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.079+0000 7f22177fe640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f22000a33b0 0x7f22000a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2208005e10 tx=0x7f2208005da0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:30.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.083+0000 7f2214ff9640 1 -- 172.21.15.70:0/3529747024 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2210003c60 con 0x7f221810c180 2024-09-19T04:38:30.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.282+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22181071c0 con 0x7f221810c180 2024-09-19T04:38:30.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.283+0000 7f2214ff9640 1 -- 172.21.15.70:0/3529747024 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f221009c430 con 0x7f221810c180 2024-09-19T04:38:30.285 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:38:30.285 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:38:30.285 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:38:30.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f22000a33b0 msgr2=0x7f22000a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:30.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f22000a33b0 0x7f22000a5870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f2208005e10 tx=0x7f2208005da0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221810c180 msgr2=0x7f221819cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:30.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221810c180 0x7f221819cca0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7f2210009fd0 tx=0x7f221000b260 comp rx=0 tx=0).stop 2024-09-19T04:38:30.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 shutdown_connections 2024-09-19T04:38:30.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f22000a33b0 0x7f22000a5870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f221810c180 0x7f221819cca0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f22181036c0 0x7f2218198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 --2- 172.21.15.70:0/3529747024 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2218102da0 0x7f22181983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:30.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 >> 172.21.15.70:0/3529747024 conn(0x7f22180fc7a0 msgr2=0x7f22180fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:30.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 shutdown_connections 2024-09-19T04:38:30.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:30.285+0000 7f221ddeb640 1 -- 172.21.15.70:0/3529747024 wait complete. 2024-09-19T04:38:30.599 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:30 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3529747024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:30.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:30 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3529747024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:30.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:30 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3529747024' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:30.911 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:38:31.156 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:31.599 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:31 smithi070 ceph-mon[30942]: pgmap v239: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.597+0000 7f7397d5d640 1 -- 172.21.15.70:0/821648756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390100a80 msgr2=0x7f7390100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.597+0000 7f7397d5d640 1 --2- 172.21.15.70:0/821648756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390100a80 0x7f7390100ee0 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f7384009930 tx=0x7f738402a420 comp rx=0 tx=0).stop 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.597+0000 7f7397d5d640 1 -- 172.21.15.70:0/821648756 shutdown_connections 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.597+0000 7f7397d5d640 1 --2- 172.21.15.70:0/821648756 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101420 0x7f739010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.597+0000 7f7397d5d640 1 --2- 172.21.15.70:0/821648756 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390100a80 0x7f7390100ee0 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.597+0000 7f7397d5d640 1 --2- 172.21.15.70:0/821648756 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390106a80 0x7f7390106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.597+0000 7f7397d5d640 1 -- 172.21.15.70:0/821648756 >> 172.21.15.70:0/821648756 conn(0x7f73900fc7a0 msgr2=0x7f73900febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.597+0000 7f7397d5d640 1 -- 172.21.15.70:0/821648756 shutdown_connections 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 -- 172.21.15.70:0/821648756 wait complete. 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 Processor -- start 2024-09-19T04:38:31.627 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 -- start start 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390100a80 0x7f73901984b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101420 0x7f73901989f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390106a80 0x7f739019cd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7390110e50 con 0x7f7390106a80 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7390110cd0 con 0x7f7390100a80 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f7397d5d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7390110fd0 con 0x7f7390101420 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f73962fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390106a80 0x7f739019cd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.598+0000 7f73962fa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390106a80 0x7f739019cd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42472/0 (socket says 172.21.15.70:42472) 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f73962fa640 1 -- 172.21.15.70:0/1418761015 learned_addr learned my addr 172.21.15.70:0/1418761015 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f7395af9640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390100a80 0x7f73901984b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f73952f8640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101420 0x7f73901989f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.628 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f73962fa640 1 -- 172.21.15.70:0/1418761015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101420 msgr2=0x7f73901989f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f73962fa640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101420 0x7f73901989f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f73962fa640 1 -- 172.21.15.70:0/1418761015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390100a80 msgr2=0x7f73901984b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f73962fa640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390100a80 0x7f73901984b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f73962fa640 1 -- 172.21.15.70:0/1418761015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f739019d460 con 0x7f7390106a80 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f73962fa640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390106a80 0x7f739019cd80 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f738800eb10 tx=0x7f738800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f7382ffd640 1 -- 172.21.15.70:0/1418761015 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388004b20 con 0x7f7390106a80 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f7397d5d640 1 -- 172.21.15.70:0/1418761015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f739019d750 con 0x7f7390106a80 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f7382ffd640 1 -- 172.21.15.70:0/1418761015 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7388004cc0 con 0x7f7390106a80 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f7382ffd640 1 -- 172.21.15.70:0/1418761015 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7388010700 con 0x7f7390106a80 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.599+0000 7f7397d5d640 1 -- 172.21.15.70:0/1418761015 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73901a5030 con 0x7f7390106a80 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.601+0000 7f7382ffd640 1 -- 172.21.15.70:0/1418761015 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7388004e70 con 0x7f7390106a80 2024-09-19T04:38:31.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f739a136740 1 Processor -- start 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f739a136740 1 -- start start 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f739a136740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f15fb40 0x55b98f15e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f739a136740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f15ea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f739a136740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f169370 0x55b98f16b760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f739a136740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b98f0c42f0 con 0x55b98f15e5d0 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f739a136740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b98f06bcf0 con 0x55b98f169370 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f739a136740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b98f0c02b0 con 0x55b98f15fb40 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f7395af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f15ea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f7395af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f15ea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42484/0 (socket says 172.21.15.70:42484) 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f7395af9640 1 -- 172.21.15.70:0/1187764890 learned_addr learned my addr 172.21.15.70:0/1187764890 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:31.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f7382ffd640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f737c0a33b0 0x7f737c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.602+0000 7f73952f8640 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f15fb40 0x55b98f15e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f73952f8640 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f169370 0x55b98f16b760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f73962fa640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f737c0a33b0 0x7f737c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f7395af9640 1 -- 172.21.15.70:0/1187764890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f15fb40 msgr2=0x55b98f15e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f7395af9640 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f15fb40 0x55b98f15e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f7395af9640 1 -- 172.21.15.70:0/1187764890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f169370 msgr2=0x55b98f16b760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f7395af9640 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f169370 0x55b98f16b760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f7395af9640 1 -- 172.21.15.70:0/1187764890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98f0503a0 con 0x55b98f15e5d0 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f7382ffd640 1 -- 172.21.15.70:0/1418761015 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f73880d0450 con 0x7f7390106a80 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f7395af9640 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f15ea10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f738c00bc60 tx=0x7f738c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6647f5356348b17a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f73962fa640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f737c0a33b0 0x7f737c0a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73880990a0 tx=0x7f738806b3c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f737bfff640 1 -- 172.21.15.70:0/1187764890 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c015070 con 0x55b98f15e5d0 2024-09-19T04:38:31.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f737bfff640 1 -- 172.21.15.70:0/1187764890 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f738c011910 con 0x55b98f15e5d0 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.603+0000 7f737bfff640 1 -- 172.21.15.70:0/1187764890 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c0108b0 con 0x55b98f15e5d0 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 -- 172.21.15.70:0/1187764890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 msgr2=0x55b98f15ea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f15ea10 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f738c00bc60 tx=0x7f738c00f730 comp rx=0 tx=0).stop 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 -- 172.21.15.70:0/1187764890 shutdown_connections 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f169370 0x55b98f16b760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f15ea10 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 --2- 172.21.15.70:0/1187764890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f15fb40 0x55b98f15e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 -- 172.21.15.70:0/1187764890 >> 172.21.15.70:0/1187764890 conn(0x55b98f127310 msgr2=0x55b98f15ac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 -- 172.21.15.70:0/1187764890 shutdown_connections 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 -- 172.21.15.70:0/1187764890 wait complete. 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 -- start start 2024-09-19T04:38:31.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.604+0000 7f739a136740 1 Processor -- start 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f739a136740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15e5d0 0x55b98f168d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f739a136740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15fb40 0x55b98f165ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f739a136740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f1665e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f739a136740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55b98f16c070 con 0x55b98f15fb40 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f739a136740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55b98f07f060 con 0x55b98f15e5d0 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f739a136740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55b98f16c1f0 con 0x55b98f169370 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f739a136740 10 client.0 _ll_register_callbacks cb 0x55b98edd28c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15fb40 0x55b98f165ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15fb40 0x55b98f165ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42492/0 (socket says 172.21.15.70:42492) 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 -- 172.21.15.70:0/1598730071 learned_addr learned my addr 172.21.15.70:0/1598730071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f73952f8640 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15e5d0 0x55b98f168d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f73952f8640 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f1665e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 -- 172.21.15.70:0/1598730071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 msgr2=0x55b98f1665e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f1665e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 -- 172.21.15.70:0/1598730071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15e5d0 msgr2=0x55b98f168d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15e5d0 0x55b98f168d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 -- 172.21.15.70:0/1598730071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b98ee353c0 con 0x55b98f15fb40 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f73952f8640 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15e5d0 0x55b98f168d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f7395af9640 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15fb40 0x55b98f165ff0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f738c000c00 tx=0x7f738c00bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16bb0e314a55c7c7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.605+0000 7f73797fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f73797fa640 1 -- 172.21.15.70:0/1598730071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f738c015070 con 0x55b98f15fb40 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f73797fa640 1 -- 172.21.15.70:0/1598730071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f738c011ac0 con 0x55b98f15fb40 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 1 -- 172.21.15.70:0/1598730071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f738c011910 con 0x55b98f15fb40 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f73797fa640 1 -- 172.21.15.70:0/1598730071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f738c011cc0 con 0x55b98f15fb40 2024-09-19T04:38:31.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 10 client.17508 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 1 -- 172.21.15.70:0/1598730071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b98f177ae0 con 0x55b98f15fb40 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f73797fa640 1 -- 172.21.15.70:0/1598730071 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f738c011910 con 0x55b98f15fb40 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f73797fa640 1 -- 172.21.15.70:0/1598730071 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f738c004680 con 0x55b98f15fb40 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 10 client.17508 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 10 client.17508 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 20 client.17508 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b98f178ee0 0x55b98f17b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 4 client.17508 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.606+0000 7f739a136740 1 -- 172.21.15.70:0/1598730071 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b98f0d1860 con 0x55b98f178ee0 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.607+0000 7f73952f8640 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b98f178ee0 0x55b98f17b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.607+0000 7f73797fa640 10 client.17508 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.607+0000 7f73952f8640 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b98f178ee0 0x55b98f17b2d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dc42e3a465d66d79 server_cookie=e65167953b8cee74 in_seq=0 out_seq=0 2024-09-19T04:38:31.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f73797fa640 1 -- 172.21.15.70:0/1598730071 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55b98f0d1860 con 0x55b98f178ee0 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f73797fa640 10 client.17508 handle_command_reply: tid=0 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 client.17508 shutdown 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 -- 172.21.15.70:0/1598730071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15fb40 msgr2=0x55b98f165ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15fb40 0x55b98f165ff0 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f738c000c00 tx=0x7f738c00bf80 comp rx=0 tx=0).stop 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 -- 172.21.15.70:0/1598730071 shutdown_connections 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b98f178ee0 0x55b98f17b2d0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f1665e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15fb40 0x55b98f165ff0 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 --2- 172.21.15.70:0/1598730071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15e5d0 0x55b98f168d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f73797fa640 0 client.17508 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 -- 172.21.15.70:0/1598730071 >> 172.21.15.70:0/1598730071 conn(0x55b98f127310 msgr2=0x55b98f160960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 -- 172.21.15.70:0/1598730071 shutdown_connections 2024-09-19T04:38:31.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 1 -- 172.21.15.70:0/1598730071 wait complete. 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.608+0000 7f739a136740 20 client.17508 trim_cache size 0 max 16384 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f739a136740 1 Processor -- start 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f739a136740 1 -- start start 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f739a136740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f159bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f739a136740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 0x55b98f161120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f739a136740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f161660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f739a136740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73901b02d0 con 0x55b98f15e5d0 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f739a136740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73901adba0 con 0x55b98f15fb40 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f739a136740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73901aba10 con 0x55b98f169370 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f159bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f159bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42494/0 (socket says 172.21.15.70:42494) 2024-09-19T04:38:31.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 -- 172.21.15.70:0/3533121757 learned_addr learned my addr 172.21.15.70:0/3533121757 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 -- 172.21.15.70:0/3533121757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 msgr2=0x55b98f161660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 --2- 172.21.15.70:0/3533121757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f161660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 -- 172.21.15.70:0/3533121757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 msgr2=0x55b98f161120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 --2- 172.21.15.70:0/3533121757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 0x55b98f161120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 -- 172.21.15.70:0/3533121757 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b98f15b960 con 0x55b98f15e5d0 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.621+0000 7f73952f8640 1 --2- 172.21.15.70:0/3533121757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f159bf0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f73900ff240 tx=0x7f738402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d185697a558d9451 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f737b7fe640 1 -- 172.21.15.70:0/3533121757 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384035040 con 0x55b98f15e5d0 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f737b7fe640 1 -- 172.21.15.70:0/3533121757 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73840044a0 con 0x55b98f15e5d0 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f737b7fe640 1 -- 172.21.15.70:0/3533121757 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384048730 con 0x55b98f15e5d0 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 -- 172.21.15.70:0/3533121757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 msgr2=0x55b98f159bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 --2- 172.21.15.70:0/3533121757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f159bf0 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f73900ff240 tx=0x7f738402a420 comp rx=0 tx=0).stop 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 -- 172.21.15.70:0/3533121757 shutdown_connections 2024-09-19T04:38:31.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 --2- 172.21.15.70:0/3533121757 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f161660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 --2- 172.21.15.70:0/3533121757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 0x55b98f161120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 --2- 172.21.15.70:0/3533121757 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f159bf0 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 -- 172.21.15.70:0/3533121757 >> 172.21.15.70:0/3533121757 conn(0x55b98f127310 msgr2=0x55b98f1594e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 -- 172.21.15.70:0/3533121757 shutdown_connections 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 -- 172.21.15.70:0/3533121757 wait complete. 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.622+0000 7f739a136740 1 -- start start 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f739a136740 1 Processor -- start 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f739a136740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f171d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f739a136740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 0x55b98f162ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f739a136740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f163670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f739a136740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f73901ac060 con 0x55b98f15e5d0 2024-09-19T04:38:31.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f739a136740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f73901ad4d0 con 0x55b98f15fb40 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f739a136740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f73901ac730 con 0x55b98f169370 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f739a136740 10 client.0 _ll_register_callbacks cb 0x7f738c00bab0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f73952f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f171d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f73952f8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f171d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42496/0 (socket says 172.21.15.70:42496) 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f73952f8640 1 -- 172.21.15.70:0/2760484853 learned_addr learned my addr 172.21.15.70:0/2760484853 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f7395af9640 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 0x55b98f162ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f73952f8640 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f163670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f73952f8640 1 -- 172.21.15.70:0/2760484853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 msgr2=0x55b98f163670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f73952f8640 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f163670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.623+0000 7f73952f8640 1 -- 172.21.15.70:0/2760484853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 msgr2=0x55b98f162ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73952f8640 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 0x55b98f162ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73952f8640 1 -- 172.21.15.70:0/2760484853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b98f1e2900 con 0x55b98f15e5d0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73952f8640 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f171d40 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f73840314b0 tx=0x7f7384009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8cb3b636a25e001 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73797fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73797fa640 1 -- 172.21.15.70:0/2760484853 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7384059020 con 0x55b98f15e5d0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73797fa640 1 -- 172.21.15.70:0/2760484853 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f7384048b40 con 0x55b98f15e5d0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f739a136740 1 -- 172.21.15.70:0/2760484853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73840044a0 con 0x55b98f15e5d0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73797fa640 1 -- 172.21.15.70:0/2760484853 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7384064050 con 0x55b98f15e5d0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f739a136740 10 client.17514 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f739a136740 1 -- 172.21.15.70:0/2760484853 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55b98f1e3ac0 con 0x55b98f15e5d0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73797fa640 1 -- 172.21.15.70:0/2760484853 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73840044a0 con 0x55b98f15e5d0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.624+0000 7f73797fa640 1 -- 172.21.15.70:0/2760484853 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f738403a040 con 0x55b98f15e5d0 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f739a136740 10 client.17514 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f739a136740 10 client.17514 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:31.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f739a136740 20 client.17514 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f739a136740 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b98f1e41e0 0x55b98f1e6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f739a136740 4 client.17514 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f739a136740 1 -- 172.21.15.70:0/2760484853 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b98f0cbd70 con 0x55b98f1e41e0 2024-09-19T04:38:31.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f7395af9640 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b98f1e41e0 0x55b98f1e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f7395af9640 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b98f1e41e0 0x55b98f1e6600 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=29038926aa3505ff server_cookie=9a15ad0ca1d4165b in_seq=0 out_seq=0 2024-09-19T04:38:31.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.625+0000 7f73797fa640 10 client.17514 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f73797fa640 1 -- 172.21.15.70:0/2760484853 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b98f0cbd70 con 0x55b98f1e41e0 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f73797fa640 10 client.17514 handle_command_reply: tid=0 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 client.17514 shutdown 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 -- 172.21.15.70:0/2760484853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 msgr2=0x55b98f171d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f171d40 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f73840314b0 tx=0x7f7384009640 comp rx=0 tx=0).stop 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 -- 172.21.15.70:0/2760484853 shutdown_connections 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55b98f1e41e0 0x55b98f1e6600 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55b98f169370 0x55b98f163670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55b98f15fb40 0x55b98f162ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 --2- 172.21.15.70:0/2760484853 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55b98f15e5d0 0x55b98f171d40 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f73797fa640 0 client.17514 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:31.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 -- 172.21.15.70:0/2760484853 >> 172.21.15.70:0/2760484853 conn(0x55b98f127310 msgr2=0x55b98f168070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:31.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 -- 172.21.15.70:0/2760484853 shutdown_connections 2024-09-19T04:38:31.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 1 -- 172.21.15.70:0/2760484853 wait complete. 2024-09-19T04:38:31.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.626+0000 7f739a136740 20 client.17514 trim_cache size 0 max 16384 2024-09-19T04:38:31.645 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:31.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 -- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f737c0a33b0 msgr2=0x7f737c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f737c0a33b0 0x7f737c0a5870 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f73880990a0 tx=0x7f738806b3c0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 -- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390106a80 msgr2=0x7f739019cd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:31.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390106a80 0x7f739019cd80 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f738800eb10 tx=0x7f738800c2d0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 -- 172.21.15.70:0/1418761015 shutdown_connections 2024-09-19T04:38:31.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f737c0a33b0 0x7f737c0a5870 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7390106a80 0x7f739019cd80 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7390101420 0x7f73901989f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 --2- 172.21.15.70:0/1418761015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7390100a80 0x7f73901984b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:31.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 -- 172.21.15.70:0/1418761015 >> 172.21.15.70:0/1418761015 conn(0x7f73900fc7a0 msgr2=0x7f739006aa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:31.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 -- 172.21.15.70:0/1418761015 shutdown_connections 2024-09-19T04:38:31.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:31.627+0000 7f7397d5d640 1 -- 172.21.15.70:0/1418761015 wait complete. 2024-09-19T04:38:31.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:31 smithi167 ceph-mon[34339]: pgmap v239: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:31.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:31 smithi134 ceph-mon[34525]: pgmap v239: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:32.418 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:38:32.666 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:33.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:32 smithi134 ceph-mon[34525]: pgmap v240: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:33.093 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:32 smithi070 ceph-mon[30942]: pgmap v240: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:33.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.171+0000 7f4584d8d640 1 -- 172.21.15.70:0/2304978909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580102570 msgr2=0x7f45801029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.171+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2304978909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580102570 0x7f45801029b0 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7f4568009900 tx=0x7f456802a480 comp rx=0 tx=0).stop 2024-09-19T04:38:33.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 -- 172.21.15.70:0/2304978909 shutdown_connections 2024-09-19T04:38:33.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2304978909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4580102ef0 0x7f458010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2304978909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580102570 0x7f45801029b0 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2304978909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4580100e20 0x7f4580101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 -- 172.21.15.70:0/2304978909 >> 172.21.15.70:0/2304978909 conn(0x7f45800fc7d0 msgr2=0x7f45800febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 -- 172.21.15.70:0/2304978909 shutdown_connections 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 -- 172.21.15.70:0/2304978909 wait complete. 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 Processor -- start 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.172+0000 7f4584d8d640 1 -- start start 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f4584d8d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580100e20 0x7f4580199300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f4584d8d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4580102570 0x7f4580199840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f4584d8d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4580102ef0 0x7f45801a4380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f4584d8d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f4580110f90 con 0x7f4580100e20 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f4584d8d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f4580110e10 con 0x7f4580102570 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f4584d8d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f4580111110 con 0x7f4580102ef0 2024-09-19T04:38:33.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580100e20 0x7f4580199300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580100e20 0x7f4580199300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42512/0 (socket says 172.21.15.70:42512) 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 -- 172.21.15.70:0/2357971458 learned_addr learned my addr 172.21.15.70:0/2357971458 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f4577fff640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4580102570 0x7f4580199840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457ed9d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4580102ef0 0x7f45801a4380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 -- 172.21.15.70:0/2357971458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4580102ef0 msgr2=0x7f45801a4380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4580102ef0 0x7f45801a4380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 -- 172.21.15.70:0/2357971458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4580102570 msgr2=0x7f4580199840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4580102570 0x7f4580199840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 -- 172.21.15.70:0/2357971458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45801a48c0 con 0x7f4580100e20 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f457e59c640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580100e20 0x7f4580199300 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f457000b4a0 tx=0x7f457000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f45777fe640 1 -- 172.21.15.70:0/2357971458 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570014070 con 0x7f4580100e20 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f4584d8d640 1 -- 172.21.15.70:0/2357971458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45801a4a90 con 0x7f4580100e20 2024-09-19T04:38:33.177 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f45777fe640 1 -- 172.21.15.70:0/2357971458 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4570010ae0 con 0x7f4580100e20 2024-09-19T04:38:33.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.173+0000 7f45777fe640 1 -- 172.21.15.70:0/2357971458 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570017c70 con 0x7f4580100e20 2024-09-19T04:38:33.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.174+0000 7f4584d8d640 1 -- 172.21.15.70:0/2357971458 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45801a4fa0 con 0x7f4580100e20 2024-09-19T04:38:33.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.176+0000 7f45777fe640 1 -- 172.21.15.70:0/2357971458 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f4570017070 con 0x7f4580100e20 2024-09-19T04:38:33.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.176+0000 7f4587166740 1 Processor -- start 2024-09-19T04:38:33.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.176+0000 7f4587166740 1 -- start start 2024-09-19T04:38:33.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.176+0000 7f45777fe640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f456c0a33b0 0x7f456c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4587166740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301b8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4587166740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 0x5651301b8a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4587166740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4587166740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56513011e2f0 con 0x5651301b9b40 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4587166740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5651300c5cf0 con 0x5651301b85d0 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4587166740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56513011a2b0 con 0x5651301c7780 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457ed9d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f456c0a33b0 0x7f456c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301b8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301b8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42526/0 (socket says 172.21.15.70:42526) 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 -- 172.21.15.70:0/3064120480 learned_addr learned my addr 172.21.15.70:0/3064120480 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f45777fe640 1 -- 172.21.15.70:0/2357971458 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f45700ceff0 con 0x7f4580100e20 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457ed9d640 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 -- 172.21.15.70:0/3064120480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 msgr2=0x5651301c9b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4577fff640 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 0x5651301b8a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301c9b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 -- 172.21.15.70:0/3064120480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 msgr2=0x5651301b8a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 0x5651301b8a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 -- 172.21.15.70:0/3064120480 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651300aa3a0 con 0x5651301b9b40 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457ed9d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f456c0a33b0 0x7f456c0a5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4578013a90 tx=0x7f4578007cd0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f457e59c640 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301b8090 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4570097db0 tx=0x7f457000bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96bc42c36897bd2c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4574ff9640 1 -- 172.21.15.70:0/3064120480 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457001e050 con 0x5651301b9b40 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4574ff9640 1 -- 172.21.15.70:0/3064120480 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f457009f790 con 0x5651301b9b40 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.177+0000 7f4574ff9640 1 -- 172.21.15.70:0/3064120480 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45700cc9c0 con 0x5651301b9b40 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 -- 172.21.15.70:0/3064120480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 msgr2=0x5651301b8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301b8090 secure :-1 s=READY pgs=1090 cs=0 l=1 rev1=1 crypto rx=0x7f4570097db0 tx=0x7f457000bf90 comp rx=0 tx=0).stop 2024-09-19T04:38:33.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 -- 172.21.15.70:0/3064120480 shutdown_connections 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301c9b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 0x5651301b8a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 --2- 172.21.15.70:0/3064120480 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301b8090 unknown :-1 s=CLOSED pgs=1090 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 -- 172.21.15.70:0/3064120480 >> 172.21.15.70:0/3064120480 conn(0x565130181310 msgr2=0x5651301b4c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 -- 172.21.15.70:0/3064120480 shutdown_connections 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.178+0000 7f4587166740 1 -- 172.21.15.70:0/3064120480 wait complete. 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 1 -- start start 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 1 Processor -- start 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 0x5651301c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301c4460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301c4bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5651301ca420 con 0x5651301b9b40 2024-09-19T04:38:33.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5651300d9060 con 0x5651301b85d0 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5651301ca5a0 con 0x5651301c7780 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4587166740 10 client.0 _ll_register_callbacks cb 0x56512fe2c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4577fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301c4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4577fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301c4460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42538/0 (socket says 172.21.15.70:42538) 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4577fff640 1 -- 172.21.15.70:0/527341695 learned_addr learned my addr 172.21.15.70:0/527341695 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f457ed9d640 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301c4bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f457e59c640 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 0x5651301c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4577fff640 1 -- 172.21.15.70:0/527341695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 msgr2=0x5651301c4bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4577fff640 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301c4bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4577fff640 1 -- 172.21.15.70:0/527341695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 msgr2=0x5651301c71b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4577fff640 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 0x5651301c71b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.179+0000 7f4577fff640 1 -- 172.21.15.70:0/527341695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56512fe8f3c0 con 0x5651301b9b40 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4577fff640 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301c4460 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4568009900 tx=0x7f45680316d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee68d863910d3df2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:33.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4565ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4565ffb640 1 -- 172.21.15.70:0/527341695 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4568035040 con 0x5651301b9b40 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4565ffb640 1 -- 172.21.15.70:0/527341695 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4568004240 con 0x5651301b9b40 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 1 -- 172.21.15.70:0/527341695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f457009f790 con 0x5651301b9b40 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4565ffb640 1 -- 172.21.15.70:0/527341695 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4568004440 con 0x5651301b9b40 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 10 client.17526 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 1 -- 172.21.15.70:0/527341695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5651301d5f00 con 0x5651301b9b40 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4565ffb640 1 -- 172.21.15.70:0/527341695 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f457009f790 con 0x5651301b9b40 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4565ffb640 1 -- 172.21.15.70:0/527341695 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f456804f7b0 con 0x5651301b9b40 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 10 client.17526 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 10 client.17526 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 20 client.17526 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5651301d7310 0x5651301d9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 4 client.17526 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:33.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.180+0000 7f4587166740 1 -- 172.21.15.70:0/527341695 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56513012b860 con 0x5651301d7310 2024-09-19T04:38:33.188 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.181+0000 7f457e59c640 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5651301d7310 0x5651301d9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.181+0000 7f457e59c640 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5651301d7310 0x5651301d9790 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=499ce2888f46a710 server_cookie=1bd5b00164d60323 in_seq=0 out_seq=0 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.181+0000 7f4565ffb640 10 client.17526 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4565ffb640 1 -- 172.21.15.70:0/527341695 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56513012b860 con 0x5651301d7310 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4565ffb640 10 client.17526 handle_command_reply: tid=0 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 client.17526 shutdown 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 -- 172.21.15.70:0/527341695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 msgr2=0x5651301c4460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301c4460 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f4568009900 tx=0x7f45680316d0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 -- 172.21.15.70:0/527341695 shutdown_connections 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5651301d7310 0x5651301d9790 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301c4bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.189 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4565ffb640 0 client.17526 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b9b40 0x5651301c4460 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 --2- 172.21.15.70:0/527341695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b85d0 0x5651301c71b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.182+0000 7f4587166740 1 -- 172.21.15.70:0/527341695 >> 172.21.15.70:0/527341695 conn(0x565130181310 msgr2=0x5651301ba990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.183+0000 7f4587166740 1 -- 172.21.15.70:0/527341695 shutdown_connections 2024-09-19T04:38:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.183+0000 7f4587166740 1 -- 172.21.15.70:0/527341695 wait complete. 2024-09-19T04:38:33.190 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.183+0000 7f4587166740 20 client.17526 trim_cache size 0 max 16384 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.195+0000 7f4587166740 1 Processor -- start 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.195+0000 7f4587166740 1 -- start start 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.195+0000 7f4587166740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301c71b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.195+0000 7f4587166740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301b4700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.195+0000 7f4587166740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301b4c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.195+0000 7f4587166740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45801adf70 con 0x5651301b85d0 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f4587166740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45801ab840 con 0x5651301b9b40 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f4587166740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45801a96b0 con 0x5651301c7780 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301c71b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301c71b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42542/0 (socket says 172.21.15.70:42542) 2024-09-19T04:38:33.198 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 -- 172.21.15.70:0/3391571034 learned_addr learned my addr 172.21.15.70:0/3391571034 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f4577fff640 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301b4700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 -- 172.21.15.70:0/3391571034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 msgr2=0x5651301b4c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457ed9d640 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301b4c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301b4c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 -- 172.21.15.70:0/3391571034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 msgr2=0x5651301b4700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301b4700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 -- 172.21.15.70:0/3391571034 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5651301d9e10 con 0x5651301b85d0 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f4577fff640 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457ed9d640 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f457e59c640 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301c71b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f45700ccd40 tx=0x7f45700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60d82fec1f0549cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f4567fff640 1 -- 172.21.15.70:0/3391571034 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457001e040 con 0x5651301b85d0 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f4567fff640 1 -- 172.21.15.70:0/3391571034 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4570082050 con 0x5651301b85d0 2024-09-19T04:38:33.199 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.196+0000 7f4567fff640 1 -- 172.21.15.70:0/3391571034 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4570084300 con 0x5651301b85d0 2024-09-19T04:38:33.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- 172.21.15.70:0/3391571034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 msgr2=0x5651301c71b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301c71b0 secure :-1 s=READY pgs=1092 cs=0 l=1 rev1=1 crypto rx=0x7f45700ccd40 tx=0x7f45700046c0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- 172.21.15.70:0/3391571034 shutdown_connections 2024-09-19T04:38:33.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301b4c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301b4700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 --2- 172.21.15.70:0/3391571034 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301c71b0 unknown :-1 s=CLOSED pgs=1092 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- 172.21.15.70:0/3391571034 >> 172.21.15.70:0/3391571034 conn(0x565130181310 msgr2=0x5651301afa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:33.203 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- 172.21.15.70:0/3391571034 shutdown_connections 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- 172.21.15.70:0/3391571034 wait complete. 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- start start 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 Processor -- start 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301cb040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301cb580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45801a9d00 con 0x5651301b85d0 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45801ab170 con 0x5651301b9b40 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.197+0000 7f4587166740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45801aa3d0 con 0x5651301c7780 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4587166740 10 client.0 _ll_register_callbacks cb 0x7f4568005e40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42558/0 (socket says 172.21.15.70:42558) 2024-09-19T04:38:33.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 -- 172.21.15.70:0/771548058 learned_addr learned my addr 172.21.15.70:0/771548058 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4577fff640 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301cb040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457ed9d640 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301cb580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 -- 172.21.15.70:0/771548058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 msgr2=0x5651301cb580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301cb580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 -- 172.21.15.70:0/771548058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 msgr2=0x5651301cb040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301cb040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 -- 172.21.15.70:0/771548058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5651301cbb40 con 0x5651301b85d0 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f457e59c640 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301cfd10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f4570097840 tx=0x7f45700977b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc820573a6631026 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4565ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4565ffb640 1 -- 172.21.15.70:0/771548058 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f457001e040 con 0x5651301b85d0 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4565ffb640 1 -- 172.21.15.70:0/771548058 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f4570010610 con 0x5651301b85d0 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4587166740 1 -- 172.21.15.70:0/771548058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4570082050 con 0x5651301b85d0 2024-09-19T04:38:33.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4565ffb640 1 -- 172.21.15.70:0/771548058 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f4570097a50 con 0x5651301b85d0 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4587166740 10 client.17532 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.198+0000 7f4587166740 1 -- 172.21.15.70:0/771548058 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x565130241d30 con 0x5651301b85d0 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4565ffb640 1 -- 172.21.15.70:0/771548058 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f4570082050 con 0x5651301b85d0 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4565ffb640 1 -- 172.21.15.70:0/771548058 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f45700a6080 con 0x5651301b85d0 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4587166740 10 client.17532 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4587166740 10 client.17532 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4587166740 20 client.17532 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4587166740 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x565130241fb0 0x5651302443a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:33.206 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4587166740 4 client.17532 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4587166740 1 -- 172.21.15.70:0/771548058 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x565130125d70 con 0x565130241fb0 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4577fff640 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x565130241fb0 0x5651302443a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4577fff640 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x565130241fb0 0x5651302443a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4cdc2fc5e41976ac server_cookie=90d9bec6cb935aa6 in_seq=0 out_seq=0 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.199+0000 7f4565ffb640 10 client.17532 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4565ffb640 1 -- 172.21.15.70:0/771548058 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x565130125d70 con 0x565130241fb0 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4565ffb640 10 client.17532 handle_command_reply: tid=0 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 client.17532 shutdown 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 -- 172.21.15.70:0/771548058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 msgr2=0x5651301cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301cfd10 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7f4570097840 tx=0x7f45700977b0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 -- 172.21.15.70:0/771548058 shutdown_connections 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x565130241fb0 0x5651302443a0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.207 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5651301c7780 0x5651301cb580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5651301b9b40 0x5651301cb040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4565ffb640 0 client.17532 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:33.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 --2- 172.21.15.70:0/771548058 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5651301b85d0 0x5651301cfd10 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 -- 172.21.15.70:0/771548058 >> 172.21.15.70:0/771548058 conn(0x565130181310 msgr2=0x5651301b4700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:33.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 -- 172.21.15.70:0/771548058 shutdown_connections 2024-09-19T04:38:33.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 1 -- 172.21.15.70:0/771548058 wait complete. 2024-09-19T04:38:33.208 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4587166740 20 client.17532 trim_cache size 0 max 16384 2024-09-19T04:38:33.208 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:33.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4584d8d640 1 -- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f456c0a33b0 msgr2=0x7f456c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f456c0a33b0 0x7f456c0a5870 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f4578013a90 tx=0x7f4578007cd0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4584d8d640 1 -- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580100e20 msgr2=0x7f4580199300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:33.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.200+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580100e20 0x7f4580199300 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7f457000b4a0 tx=0x7f457000b960 comp rx=0 tx=0).stop 2024-09-19T04:38:33.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.201+0000 7f4584d8d640 1 -- 172.21.15.70:0/2357971458 shutdown_connections 2024-09-19T04:38:33.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.201+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f456c0a33b0 0x7f456c0a5870 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.201+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f4580102ef0 0x7f45801a4380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.209 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.201+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4580102570 0x7f4580199840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.201+0000 7f4584d8d640 1 --2- 172.21.15.70:0/2357971458 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f4580100e20 0x7f4580199300 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:33.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.201+0000 7f4584d8d640 1 -- 172.21.15.70:0/2357971458 >> 172.21.15.70:0/2357971458 conn(0x7f45800fc7d0 msgr2=0x7f4580105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:33.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.201+0000 7f4584d8d640 1 -- 172.21.15.70:0/2357971458 shutdown_connections 2024-09-19T04:38:33.210 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:33.201+0000 7f4584d8d640 1 -- 172.21.15.70:0/2357971458 wait complete. 2024-09-19T04:38:33.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:32 smithi167 ceph-mon[34339]: pgmap v240: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:33.808 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:38:34.051 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:34.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.555+0000 7f1bdacb6640 1 -- 172.21.15.70:0/1822795787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102ef0 msgr2=0x7f1bd410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.555+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/1822795787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102ef0 0x7f1bd410da40 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc009ca0 tx=0x7f1bcc02a950 comp rx=0 tx=0).stop 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.555+0000 7f1bdacb6640 1 -- 172.21.15.70:0/1822795787 shutdown_connections 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.555+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/1822795787 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102ef0 0x7f1bd410da40 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.555+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/1822795787 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4102570 0x7f1bd41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.555+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/1822795787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd4100e20 0x7f1bd4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.555+0000 7f1bdacb6640 1 -- 172.21.15.70:0/1822795787 >> 172.21.15.70:0/1822795787 conn(0x7f1bd40fc7d0 msgr2=0x7f1bd40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 -- 172.21.15.70:0/1822795787 shutdown_connections 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 -- 172.21.15.70:0/1822795787 wait complete. 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 Processor -- start 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 -- start start 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4100e20 0x7f1bd41994e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102570 0x7f1bd4199a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd4102ef0 0x7f1bd41a4560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd4111010 con 0x7f1bd4102570 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd4110e90 con 0x7f1bd4102ef0 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bdacb6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd4111190 con 0x7f1bd4100e20 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102570 0x7f1bd4199a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bd3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102570 0x7f1bd4199a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42222/0 (socket says 172.21.15.70:42222) 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.556+0000 7f1bd3fff640 1 -- 172.21.15.70:0/3738761225 learned_addr learned my addr 172.21.15.70:0/3738761225 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4100e20 0x7f1bd41994e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd9253640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd4102ef0 0x7f1bd41a4560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd3fff640 1 -- 172.21.15.70:0/3738761225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4100e20 msgr2=0x7f1bd41994e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4100e20 0x7f1bd41994e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd3fff640 1 -- 172.21.15.70:0/3738761225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd4102ef0 msgr2=0x7f1bd41a4560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd4102ef0 0x7f1bd41a4560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd3fff640 1 -- 172.21.15.70:0/3738761225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bd41a4aa0 con 0x7f1bd4102570 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd9253640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd4102ef0 0x7f1bd41a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4100e20 0x7f1bd41994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102570 0x7f1bd4199a20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b4a0 tx=0x7f1bc000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd1ffb640 1 -- 172.21.15.70:0/3738761225 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0014070 con 0x7f1bd4102570 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bdacb6640 1 -- 172.21.15.70:0/3738761225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bd41a4c70 con 0x7f1bd4102570 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd1ffb640 1 -- 172.21.15.70:0/3738761225 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1bc0010ae0 con 0x7f1bd4102570 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bd1ffb640 1 -- 172.21.15.70:0/3738761225 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc0017c70 con 0x7f1bd4102570 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.557+0000 7f1bdacb6640 1 -- 172.21.15.70:0/3738761225 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bd41a51b0 con 0x7f1bd4102570 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.559+0000 7f1bd1ffb640 1 -- 172.21.15.70:0/3738761225 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1bc0017070 con 0x7f1bd4102570 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bdd08f740 1 Processor -- start 2024-09-19T04:38:34.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bdd08f740 1 -- start start 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbdb40 0x556ffafbc090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbc5d0 0x556ffafbca10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc9760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556ffaf222f0 con 0x556ffafbdb40 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556ffaec9cf0 con 0x556ffafbc5d0 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556ffaf1e2b0 con 0x556ffafc7370 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bd9253640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbdb40 0x556ffafbc090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bd9253640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbdb40 0x556ffafbc090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42226/0 (socket says 172.21.15.70:42226) 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bd9253640 1 -- 172.21.15.70:0/751164140 learned_addr learned my addr 172.21.15.70:0/751164140 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bd1ffb640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1bc40a33b0 0x7f1bc40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.560+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbc5d0 0x556ffafbca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bd9253640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1bc40a33b0 0x7f1bc40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bd1ffb640 1 -- 172.21.15.70:0/3738761225 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1bc00cf0a0 con 0x7f1bd4102570 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bd9253640 1 -- 172.21.15.70:0/751164140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 msgr2=0x556ffafc9760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bd9253640 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc9760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bd9253640 1 -- 172.21.15.70:0/751164140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbc5d0 msgr2=0x556ffafbca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bd9253640 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbc5d0 0x556ffafbca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bd9253640 1 -- 172.21.15.70:0/751164140 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ffaeae3a0 con 0x556ffafbdb40 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bd9253640 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbdb40 0x556ffafbc090 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc02f580 tx=0x7f1bcc02f5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46738e2c7f292d3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bbeffd640 1 -- 172.21.15.70:0/751164140 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc034030 con 0x556ffafbdb40 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bbeffd640 1 -- 172.21.15.70:0/751164140 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1bcc04d070 con 0x556ffafbdb40 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.561+0000 7f1bbeffd640 1 -- 172.21.15.70:0/751164140 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bcc044040 con 0x556ffafbdb40 2024-09-19T04:38:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 -- 172.21.15.70:0/751164140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbdb40 msgr2=0x556ffafbc090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bd9253640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1bc40a33b0 0x7f1bc40a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc04c000 tx=0x7f1bcc04a000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbdb40 0x556ffafbc090 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc02f580 tx=0x7f1bcc02f5b0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 -- 172.21.15.70:0/751164140 shutdown_connections 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc9760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbc5d0 0x556ffafbca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/751164140 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbdb40 0x556ffafbc090 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 -- 172.21.15.70:0/751164140 >> 172.21.15.70:0/751164140 conn(0x556ffaf85310 msgr2=0x556ffafb8c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 -- 172.21.15.70:0/751164140 shutdown_connections 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 -- 172.21.15.70:0/751164140 wait complete. 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 -- start start 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.562+0000 7f1bdd08f740 1 Processor -- start 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafc6d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 0x556ffafc3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc45d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x556ffafca070 con 0x556ffafbc5d0 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x556ffaedd060 con 0x556ffafbdb40 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x556ffafca1f0 con 0x556ffafc7370 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bdd08f740 10 client.0 _ll_register_callbacks cb 0x556ffac308c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafc6d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafc6d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42240/0 (socket says 172.21.15.70:42240) 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 -- 172.21.15.70:0/3204954234 learned_addr learned my addr 172.21.15.70:0/3204954234 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd9253640 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 -- 172.21.15.70:0/3204954234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 msgr2=0x556ffafc45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 -- 172.21.15.70:0/3204954234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 msgr2=0x556ffafc3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 0x556ffafc3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 -- 172.21.15.70:0/3204954234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ffac933c0 con 0x556ffafbc5d0 2024-09-19T04:38:34.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd9253640 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafc6d30 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800f4f0 tx=0x7f1bc800f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8ee7c777eb6a45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bb3fff640 1 -- 172.21.15.70:0/3204954234 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8013850 con 0x556ffafbc5d0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bb3fff640 1 -- 172.21.15.70:0/3204954234 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1bc80139f0 con 0x556ffafbc5d0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.563+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3204954234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bcc04d070 con 0x556ffafbc5d0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bb3fff640 1 -- 172.21.15.70:0/3204954234 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1bc8013bf0 con 0x556ffafbc5d0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bdd08f740 10 client.17544 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3204954234 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556ffafd5b30 con 0x556ffafbc5d0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bb3fff640 1 -- 172.21.15.70:0/3204954234 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1bcc04d070 con 0x556ffafbc5d0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bb3fff640 1 -- 172.21.15.70:0/3204954234 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1bc80113e0 con 0x556ffafbc5d0 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bdd08f740 10 client.17544 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bdd08f740 10 client.17544 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:34.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bdd08f740 20 client.17544 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556ffafd6ff0 0x556ffafd9460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bdd08f740 4 client.17544 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3204954234 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556ffaf2f860 con 0x556ffafd6ff0 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.564+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556ffafd6ff0 0x556ffafd9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.565+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556ffafd6ff0 0x556ffafd9460 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1dcc3bd39fa72780 server_cookie=c8f70d840357d2c9 in_seq=0 out_seq=0 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.565+0000 7f1bb3fff640 10 client.17544 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bb3fff640 1 -- 172.21.15.70:0/3204954234 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x556ffaf2f860 con 0x556ffafd6ff0 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bb3fff640 10 client.17544 handle_command_reply: tid=0 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 client.17544 shutdown 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3204954234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 msgr2=0x556ffafc6d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafc6d30 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800f4f0 tx=0x7f1bc800f9b0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3204954234 shutdown_connections 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556ffafd6ff0 0x556ffafd9460 crc :-1 s=READY pgs=180 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bb3fff640 0 client.17544 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafc45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 0x556ffafc3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3204954234 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafc6d30 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3204954234 >> 172.21.15.70:0/3204954234 conn(0x556ffaf85310 msgr2=0x556ffafbe930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3204954234 shutdown_connections 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3204954234 wait complete. 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.566+0000 7f1bdd08f740 20 client.17544 trim_cache size 0 max 16384 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bdd08f740 1 Processor -- start 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bdd08f740 1 -- start start 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafb3c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 0x556ffafd3310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafded30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd41b0270 con 0x556ffafbc5d0 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd41adb40 con 0x556ffafbdb40 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd41ab9b0 con 0x556ffafc7370 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd8a52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafb3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd8a52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafb3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42244/0 (socket says 172.21.15.70:42244) 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd8a52640 1 -- 172.21.15.70:0/3391917417 learned_addr learned my addr 172.21.15.70:0/3391917417 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 0x556ffafd3310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd9253640 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafded30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd8a52640 1 -- 172.21.15.70:0/3391917417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 msgr2=0x556ffafded30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafded30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd8a52640 1 -- 172.21.15.70:0/3391917417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 msgr2=0x556ffafd3310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:34.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 0x556ffafd3310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd8a52640 1 -- 172.21.15.70:0/3391917417 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ffafbf120 con 0x556ffafbc5d0 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.579+0000 7f1bd9253640 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafded30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafb3c60 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800a120 tx=0x7f1bc8006c40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=424afaf60819b7b5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bbe7fc640 1 -- 172.21.15.70:0/3391917417 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8033070 con 0x556ffafbc5d0 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bbe7fc640 1 -- 172.21.15.70:0/3391917417 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1bc8011ea0 con 0x556ffafbc5d0 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bbe7fc640 1 -- 172.21.15.70:0/3391917417 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8028070 con 0x556ffafbc5d0 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3391917417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 msgr2=0x556ffafb3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafb3c60 secure :-1 s=READY pgs=1098 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800a120 tx=0x7f1bc8006c40 comp rx=0 tx=0).stop 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3391917417 shutdown_connections 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafc7370 0x556ffafded30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafbdb40 0x556ffafd3310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/3391917417 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafb3c60 unknown :-1 s=CLOSED pgs=1098 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3391917417 >> 172.21.15.70:0/3391917417 conn(0x556ffaf85310 msgr2=0x556ffafbf310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3391917417 shutdown_connections 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.580+0000 7f1bdd08f740 1 -- 172.21.15.70:0/3391917417 wait complete. 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 1 -- start start 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 1 Processor -- start 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafcb620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafbdb40 0x556ffafcbb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafc7370 0x556ffb040d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd41ac000 con 0x556ffafbc5d0 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd41ad470 con 0x556ffafc7370 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1bd41ac6d0 con 0x556ffafbdb40 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bdd08f740 10 client.0 _ll_register_callbacks cb 0x7f1bc800a530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:34.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bd8a52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafcb620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bd8a52640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafcb620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42254/0 (socket says 172.21.15.70:42254) 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.581+0000 7f1bd8a52640 1 -- 172.21.15.70:0/901022577 learned_addr learned my addr 172.21.15.70:0/901022577 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bd9253640 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafc7370 0x556ffb040d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bd8a52640 1 -- 172.21.15.70:0/901022577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafbdb40 msgr2=0x556ffafcbb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafbdb40 0x556ffafcbb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bd8a52640 1 -- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafc7370 msgr2=0x556ffb040d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafc7370 0x556ffb040d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bd8a52640 1 -- 172.21.15.70:0/901022577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ffb041240 con 0x556ffafbc5d0 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bd9253640 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafc7370 0x556ffb040d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bd8a52640 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafcb620 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800a500 tx=0x7f1bc8011c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2610b9ff90042cb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:34.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bb3fff640 1 -- 172.21.15.70:0/901022577 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bc8033070 con 0x556ffafbc5d0 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bb3fff640 1 -- 172.21.15.70:0/901022577 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f1bc80059c0 con 0x556ffafbc5d0 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.582+0000 7f1bdd08f740 1 -- 172.21.15.70:0/901022577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1bc8011ea0 con 0x556ffafbc5d0 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bb3fff640 1 -- 172.21.15.70:0/901022577 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1bc803d050 con 0x556ffafbc5d0 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bdd08f740 10 client.17550 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bdd08f740 1 -- 172.21.15.70:0/901022577 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x556ffb042390 con 0x556ffafbc5d0 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bb3fff640 1 -- 172.21.15.70:0/901022577 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1bc8011ea0 con 0x556ffafbc5d0 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bb3fff640 1 -- 172.21.15.70:0/901022577 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1bc8038440 con 0x556ffafbc5d0 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bdd08f740 10 client.17550 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bdd08f740 10 client.17550 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bdd08f740 20 client.17550 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556ffafd6ff0 0x556ffb044a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bdd08f740 4 client.17550 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.583+0000 7f1bdd08f740 1 -- 172.21.15.70:0/901022577 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556ffaf29d70 con 0x556ffafd6ff0 2024-09-19T04:38:34.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.584+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556ffafd6ff0 0x556ffb044a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.584+0000 7f1bd3fff640 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556ffafd6ff0 0x556ffb044a80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=85bcec36557e3e55 server_cookie=bb4b2fd91d3aeeae in_seq=0 out_seq=0 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.584+0000 7f1bb3fff640 10 client.17550 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bb3fff640 1 -- 172.21.15.70:0/901022577 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556ffaf29d70 con 0x556ffafd6ff0 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bb3fff640 10 client.17550 handle_command_reply: tid=0 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 client.17550 shutdown 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 -- 172.21.15.70:0/901022577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 msgr2=0x556ffafcb620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafcb620 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7f1bc800a500 tx=0x7f1bc8011c80 comp rx=0 tx=0).stop 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 -- 172.21.15.70:0/901022577 shutdown_connections 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x556ffafd6ff0 0x556ffb044a80 crc :-1 s=READY pgs=181 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x556ffafc7370 0x556ffb040d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x556ffafbdb40 0x556ffafcbb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 --2- 172.21.15.70:0/901022577 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x556ffafbc5d0 0x556ffafcb620 unknown :-1 s=CLOSED pgs=1099 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 -- 172.21.15.70:0/901022577 >> 172.21.15.70:0/901022577 conn(0x556ffaf85310 msgr2=0x556ffafbe110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:34.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bb3fff640 0 client.17550 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:34.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 -- 172.21.15.70:0/901022577 shutdown_connections 2024-09-19T04:38:34.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 1 -- 172.21.15.70:0/901022577 wait complete. 2024-09-19T04:38:34.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.585+0000 7f1bdd08f740 20 client.17550 trim_cache size 0 max 16384 2024-09-19T04:38:34.603 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:34.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 -- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1bc40a33b0 msgr2=0x7f1bc40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1bc40a33b0 0x7f1bc40a5870 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f1bcc04c000 tx=0x7f1bcc04a000 comp rx=0 tx=0).stop 2024-09-19T04:38:34.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 -- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102570 msgr2=0x7f1bd4199a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:34.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102570 0x7f1bd4199a20 secure :-1 s=READY pgs=1095 cs=0 l=1 rev1=1 crypto rx=0x7f1bc000b4a0 tx=0x7f1bc000b960 comp rx=0 tx=0).stop 2024-09-19T04:38:34.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 -- 172.21.15.70:0/3738761225 shutdown_connections 2024-09-19T04:38:34.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1bc40a33b0 0x7f1bc40a5870 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1bd4102ef0 0x7f1bd41a4560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1bd4102570 0x7f1bd4199a20 unknown :-1 s=CLOSED pgs=1095 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 --2- 172.21.15.70:0/3738761225 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1bd4100e20 0x7f1bd41994e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:34.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 -- 172.21.15.70:0/3738761225 >> 172.21.15.70:0/3738761225 conn(0x7f1bd40fc7d0 msgr2=0x7f1bd40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:34.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 -- 172.21.15.70:0/3738761225 shutdown_connections 2024-09-19T04:38:34.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:34.586+0000 7f1bdacb6640 1 -- 172.21.15.70:0/3738761225 wait complete. 2024-09-19T04:38:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:34 smithi134 ceph-mon[34525]: pgmap v241: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:34 smithi070 ceph-mon[30942]: pgmap v241: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:35.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:34 smithi167 ceph-mon[34339]: pgmap v241: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:36.275 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:38:36.275 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:38:36.535 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:36.916 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:36 smithi070 ceph-mon[30942]: pgmap v242: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 -- 172.21.15.70:0/907735993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102ef0 msgr2=0x7f2a3410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 --2- 172.21.15.70:0/907735993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102ef0 0x7f2a3410da40 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009ca0 tx=0x7f2a2c02a950 comp rx=0 tx=0).stop 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 -- 172.21.15.70:0/907735993 shutdown_connections 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 --2- 172.21.15.70:0/907735993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102ef0 0x7f2a3410da40 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 --2- 172.21.15.70:0/907735993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a34102570 0x7f2a341029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 --2- 172.21.15.70:0/907735993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a34100e20 0x7f2a34101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 -- 172.21.15.70:0/907735993 >> 172.21.15.70:0/907735993 conn(0x7f2a340fc7d0 msgr2=0x7f2a340febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 -- 172.21.15.70:0/907735993 shutdown_connections 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 -- 172.21.15.70:0/907735993 wait complete. 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.998+0000 7f2a38882640 1 Processor -- start 2024-09-19T04:38:37.009 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a38882640 1 -- start start 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a38882640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a34100e20 0x7f2a341992c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a38882640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102570 0x7f2a34199800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a38882640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a34102ef0 0x7f2a341a4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a38882640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a34110f50 con 0x7f2a34102570 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a38882640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a34110dd0 con 0x7f2a34102ef0 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a38882640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a341110d0 con 0x7f2a34100e20 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102570 0x7f2a34199800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102570 0x7f2a34199800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42270/0 (socket says 172.21.15.70:42270) 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 -- 172.21.15.70:0/4037954137 learned_addr learned my addr 172.21.15.70:0/4037954137 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a3259c640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a34100e20 0x7f2a341992c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a32d9d640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a34102ef0 0x7f2a341a4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 -- 172.21.15.70:0/4037954137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a34100e20 msgr2=0x7f2a341992c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.010 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a34100e20 0x7f2a341992c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 -- 172.21.15.70:0/4037954137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a34102ef0 msgr2=0x7f2a341a4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a34102ef0 0x7f2a341a4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 -- 172.21.15.70:0/4037954137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a341a4880 con 0x7f2a34102570 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102570 0x7f2a34199800 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800d950 tx=0x7f2a2800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:36.999+0000 7f2a237fe640 1 -- 172.21.15.70:0/4037954137 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a28017030 con 0x7f2a34102570 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.000+0000 7f2a237fe640 1 -- 172.21.15.70:0/4037954137 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a28004020 con 0x7f2a34102570 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.000+0000 7f2a38882640 1 -- 172.21.15.70:0/4037954137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a341a4a50 con 0x7f2a34102570 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.000+0000 7f2a237fe640 1 -- 172.21.15.70:0/4037954137 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a280047a0 con 0x7f2a34102570 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.000+0000 7f2a38882640 1 -- 172.21.15.70:0/4037954137 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a341a4f60 con 0x7f2a34102570 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.002+0000 7f2a237fe640 1 -- 172.21.15.70:0/4037954137 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2a280041d0 con 0x7f2a34102570 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.002+0000 7f2a3ac5b740 1 Processor -- start 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.002+0000 7f2a3ac5b740 1 -- start start 2024-09-19T04:38:37.011 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f615b60 0x55883f615f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f620800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a237fe640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a1c0a33b0 0x7f2a1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f620d40 0x55883f623130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55883f57b280 con 0x55883f620d40 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55883f522b10 con 0x55883f615b60 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55883f577240 con 0x55883f616480 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f620d40 0x55883f623130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a32d9d640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a1c0a33b0 0x7f2a1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f620d40 0x55883f623130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42272/0 (socket says 172.21.15.70:42272) 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 -- 172.21.15.70:0/2423152463 learned_addr learned my addr 172.21.15.70:0/2423152463 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a3259c640 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f620800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a32d9d640 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f615b60 0x55883f615f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a237fe640 1 -- 172.21.15.70:0/4037954137 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2a280cf6e0 con 0x7f2a34102570 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 -- 172.21.15.70:0/2423152463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 msgr2=0x55883f620800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f620800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 -- 172.21.15.70:0/2423152463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f615b60 msgr2=0x55883f615f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f615b60 0x55883f615f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 -- 172.21.15.70:0/2423152463 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883f52f1f0 con 0x55883f620d40 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a32d9d640 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f615b60 0x55883f615f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.003+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f620d40 0x55883f623130 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2a2809b950 tx=0x7f2a28097a90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=becf80c256e190a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a32d9d640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a1c0a33b0 0x7f2a1c0a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009a60 tx=0x7f2a2c005d80 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a20ff9640 1 -- 172.21.15.70:0/2423152463 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2809b500 con 0x55883f620d40 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a20ff9640 1 -- 172.21.15.70:0/2423152463 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a2809c0c0 con 0x55883f620d40 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a20ff9640 1 -- 172.21.15.70:0/2423152463 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2809b320 con 0x55883f620d40 2024-09-19T04:38:37.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2423152463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f620d40 msgr2=0x55883f623130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f620d40 0x55883f623130 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f2a2809b950 tx=0x7f2a28097a90 comp rx=0 tx=0).stop 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2423152463 shutdown_connections 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f620d40 0x55883f623130 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f620800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2423152463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f615b60 0x55883f615f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2423152463 >> 172.21.15.70:0/2423152463 conn(0x55883f6120f0 msgr2=0x55883f6124d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2423152463 shutdown_connections 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.004+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2423152463 wait complete. 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 1 -- start start 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 1 Processor -- start 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61dbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f61e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 0x55883f61e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55883f623910 con 0x55883f615b60 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55883f535f10 con 0x55883f620d40 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55883f623a90 con 0x55883f616480 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3ac5b740 10 client.0 _ll_register_callbacks cb 0x55883f4fea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61dbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61dbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42278/0 (socket says 172.21.15.70:42278) 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3259c640 1 -- 172.21.15.70:0/2670537822 learned_addr learned my addr 172.21.15.70:0/2670537822 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f61e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3259c640 1 -- 172.21.15.70:0/2670537822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 msgr2=0x55883f61e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3259c640 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f61e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3259c640 1 -- 172.21.15.70:0/2670537822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 msgr2=0x55883f61e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.005+0000 7f2a3259c640 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 0x55883f61e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3259c640 1 -- 172.21.15.70:0/2670537822 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883f2ec6a0 con 0x55883f615b60 2024-09-19T04:38:37.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3259c640 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61dbc0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400bad0 tx=0x7f2a2400bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccd391737899887a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2670537822 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a24003da0 con 0x55883f615b60 2024-09-19T04:38:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2670537822 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2a24005020 con 0x55883f615b60 2024-09-19T04:38:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2670537822 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a2809c0c0 con 0x55883f615b60 2024-09-19T04:38:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2670537822 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2a24005220 con 0x55883f615b60 2024-09-19T04:38:37.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 10 client.17562 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2670537822 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55883f62f520 con 0x55883f615b60 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2670537822 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a2809c0c0 con 0x55883f615b60 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2670537822 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2a240245a0 con 0x55883f615b60 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 10 client.17562 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 10 client.17562 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 20 client.17562 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55883f630930 0x55883f632df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 4 client.17562 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.006+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2670537822 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55883f5887f0 con 0x55883f630930 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.007+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55883f630930 0x55883f632df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.007+0000 7f2a19ffb640 10 client.17562 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:37.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.007+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55883f630930 0x55883f632df0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=367c752b6fefdc43 server_cookie=5bc00b0ecb2d440c in_seq=0 out_seq=0 2024-09-19T04:38:37.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2670537822 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55883f5887f0 con 0x55883f630930 2024-09-19T04:38:37.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a19ffb640 10 client.17562 handle_command_reply: tid=0 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 client.17562 shutdown 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2670537822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 msgr2=0x55883f61dbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61dbc0 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400bad0 tx=0x7f2a2400bf90 comp rx=0 tx=0).stop 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2670537822 shutdown_connections 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55883f630930 0x55883f632df0 crc :-1 s=READY pgs=182 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 0x55883f61e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f61e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2670537822 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61dbc0 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a19ffb640 0 client.17562 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2670537822 >> 172.21.15.70:0/2670537822 conn(0x55883f6120f0 msgr2=0x55883f617e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2670537822 shutdown_connections 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2670537822 wait complete. 2024-09-19T04:38:37.019 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.008+0000 7f2a3ac5b740 20 client.17562 trim_cache size 0 max 16384 2024-09-19T04:38:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3ac5b740 1 Processor -- start 2024-09-19T04:38:37.027 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3ac5b740 1 -- start start 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f617cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f616480 0x55883f6290c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f620d40 0x55883f629600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a341b01d0 con 0x55883f615b60 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a341adaa0 con 0x55883f616480 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a341ab910 con 0x55883f620d40 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f617cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f617cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42284/0 (socket says 172.21.15.70:42284) 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.025+0000 7f2a3259c640 1 -- 172.21.15.70:0/4233144883 learned_addr learned my addr 172.21.15.70:0/4233144883 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/4233144883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f616480 0x55883f6290c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a3259c640 1 -- 172.21.15.70:0/4233144883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f620d40 msgr2=0x55883f629600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:37.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a3259c640 1 --2- 172.21.15.70:0/4233144883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f620d40 0x55883f629600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a3259c640 1 -- 172.21.15.70:0/4233144883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f616480 msgr2=0x55883f6290c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a3259c640 1 --2- 172.21.15.70:0/4233144883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f616480 0x55883f6290c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a3259c640 1 -- 172.21.15.70:0/4233144883 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55883f611f20 con 0x55883f615b60 2024-09-19T04:38:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a3259c640 1 --2- 172.21.15.70:0/4233144883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f617cc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f2a240249c0 tx=0x7f2a24003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90deba47d9b710f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a1bfff640 1 -- 172.21.15.70:0/4233144883 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2402a070 con 0x55883f615b60 2024-09-19T04:38:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a1bfff640 1 -- 172.21.15.70:0/4233144883 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a240053c0 con 0x55883f615b60 2024-09-19T04:38:37.029 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.026+0000 7f2a1bfff640 1 -- 172.21.15.70:0/4233144883 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2401bbe0 con 0x55883f615b60 2024-09-19T04:38:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/4233144883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 msgr2=0x55883f617cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.032 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/4233144883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f617cc0 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f2a240249c0 tx=0x7f2a24003da0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/4233144883 shutdown_connections 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/4233144883 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f620d40 0x55883f629600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/4233144883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f616480 0x55883f6290c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/4233144883 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f617cc0 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/4233144883 >> 172.21.15.70:0/4233144883 conn(0x55883f6120f0 msgr2=0x55883f6175b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/4233144883 shutdown_connections 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/4233144883 wait complete. 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- start start 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 Processor -- start 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f61a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.033 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 0x55883f61aa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a341abf60 con 0x55883f615b60 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a341ad3d0 con 0x55883f620d40 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a341ac630 con 0x55883f616480 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3ac5b740 10 client.0 _ll_register_callbacks cb 0x7f2a24004040 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42292/0 (socket says 172.21.15.70:42292) 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.027+0000 7f2a3259c640 1 -- 172.21.15.70:0/2705651006 learned_addr learned my addr 172.21.15.70:0/2705651006 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f61a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a32d9d640 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 0x55883f61aa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3259c640 1 -- 172.21.15.70:0/2705651006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 msgr2=0x55883f61a550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3259c640 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f61a550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3259c640 1 -- 172.21.15.70:0/2705651006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 msgr2=0x55883f61aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3259c640 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 0x55883f61aa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.034 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3259c640 1 -- 172.21.15.70:0/2705651006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55883f61b310 con 0x55883f615b60 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3259c640 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61a010 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400bfd0 tx=0x7f2a24005cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=182350ca8c8d5472 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a19ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2705651006 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a2402a070 con 0x55883f615b60 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2705651006 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2a2401bb70 con 0x55883f615b60 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2705651006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a240053c0 con 0x55883f615b60 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2705651006 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2a2401bd70 con 0x55883f615b60 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3ac5b740 10 client.17568 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2705651006 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55883f69fee0 con 0x55883f615b60 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.028+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2705651006 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a240053c0 con 0x55883f615b60 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2705651006 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2a24037410 con 0x55883f615b60 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a3ac5b740 10 client.17568 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a3ac5b740 10 client.17568 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:37.035 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a3ac5b740 20 client.17568 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55883f6a0540 0x55883f6a2930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a3ac5b740 4 client.17568 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2705651006 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55883f582d00 con 0x55883f6a0540 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55883f6a0540 0x55883f6a2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a31d9b640 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55883f6a0540 0x55883f6a2930 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2a34401befe98aaf server_cookie=b2916e8c099e5cd3 in_seq=0 out_seq=0 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.029+0000 7f2a19ffb640 10 client.17568 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a19ffb640 1 -- 172.21.15.70:0/2705651006 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55883f582d00 con 0x55883f6a0540 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a19ffb640 10 client.17568 handle_command_reply: tid=0 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a3ac5b740 1 client.17568 shutdown 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2705651006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 msgr2=0x55883f61a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61a010 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f2a2400bfd0 tx=0x7f2a24005cc0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.036 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2705651006 shutdown_connections 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55883f6a0540 0x55883f6a2930 crc :-1 s=READY pgs=183 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55883f620d40 0x55883f61aa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a19ffb640 0 client.17568 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55883f616480 0x55883f61a550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.030+0000 7f2a3ac5b740 1 --2- 172.21.15.70:0/2705651006 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55883f615b60 0x55883f61a010 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2705651006 >> 172.21.15.70:0/2705651006 conn(0x55883f6120f0 msgr2=0x55883f611270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2705651006 shutdown_connections 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a3ac5b740 1 -- 172.21.15.70:0/2705651006 wait complete. 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a3ac5b740 20 client.17568 trim_cache size 0 max 16384 2024-09-19T04:38:37.037 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:37.038 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:38:37.038 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "7e93c404-44a7-4a17-83af-9e81dfb0eca9", 2024-09-19T04:38:37.038 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:38:37.038 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:37.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 -- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a1c0a33b0 msgr2=0x7f2a1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.038 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a1c0a33b0 0x7f2a1c0a5870 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c009a60 tx=0x7f2a2c005d80 comp rx=0 tx=0).stop 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 -- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102570 msgr2=0x7f2a34199800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102570 0x7f2a34199800 secure :-1 s=READY pgs=1101 cs=0 l=1 rev1=1 crypto rx=0x7f2a2800d950 tx=0x7f2a2800de10 comp rx=0 tx=0).stop 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 -- 172.21.15.70:0/4037954137 shutdown_connections 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a1c0a33b0 0x7f2a1c0a5870 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a34102ef0 0x7f2a341a4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a34102570 0x7f2a34199800 unknown :-1 s=CLOSED pgs=1101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 --2- 172.21.15.70:0/4037954137 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a34100e20 0x7f2a341992c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 -- 172.21.15.70:0/4037954137 >> 172.21.15.70:0/4037954137 conn(0x7f2a340fc7d0 msgr2=0x7f2a340febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 -- 172.21.15.70:0/4037954137 shutdown_connections 2024-09-19T04:38:37.039 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:37.031+0000 7f2a38882640 1 -- 172.21.15.70:0/4037954137 wait complete. 2024-09-19T04:38:37.040 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:36 smithi134 ceph-mon[34525]: pgmap v242: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:37.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:36 smithi167 ceph-mon[34339]: pgmap v242: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:37.743 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:38:37.986 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:37 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:38:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:37 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:37 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:38:38.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:37 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:38.036 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:37 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:38:38.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:37 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:38:38.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:37 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:38.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:37 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:38:38.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:37 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:38.105 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:37 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:38:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:37 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:38:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:37 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:37 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:38:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:37 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:38.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:37 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.439+0000 7f639f6c9640 1 -- 172.21.15.70:0/792134627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f639810c170 msgr2=0x7f639810e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.439+0000 7f639f6c9640 1 --2- 172.21.15.70:0/792134627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f639810c170 0x7f639810e610 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f6390009ca0 tx=0x7f639002a950 comp rx=0 tx=0).stop 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 -- 172.21.15.70:0/792134627 shutdown_connections 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 --2- 172.21.15.70:0/792134627 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f639810c170 0x7f639810e610 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 --2- 172.21.15.70:0/792134627 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f6398103660 0x7f639810bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 --2- 172.21.15.70:0/792134627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398102d40 0x7f6398103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 -- 172.21.15.70:0/792134627 >> 172.21.15.70:0/792134627 conn(0x7f63980fc7a0 msgr2=0x7f63980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 -- 172.21.15.70:0/792134627 shutdown_connections 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 -- 172.21.15.70:0/792134627 wait complete. 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 Processor -- start 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.440+0000 7f639f6c9640 1 -- start start 2024-09-19T04:38:38.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639f6c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398102d40 0x7f6398198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639f6c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6398103660 0x7f63981989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639f6c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f639810c170 0x7f639819cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639f6c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f6398111fa0 con 0x7f6398103660 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639f6c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f6398111e20 con 0x7f6398102d40 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639f6c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f6398112120 con 0x7f639810c170 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6398103660 0x7f63981989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6398103660 0x7f63981989a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42312/0 (socket says 172.21.15.70:42312) 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 -- 172.21.15.70:0/2623093133 learned_addr learned my addr 172.21.15.70:0/2623093133 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639dc66640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f639810c170 0x7f639819cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639d465640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398102d40 0x7f6398198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 -- 172.21.15.70:0/2623093133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f639810c170 msgr2=0x7f639819cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f639810c170 0x7f639819cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 -- 172.21.15.70:0/2623093133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398102d40 msgr2=0x7f6398198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398102d40 0x7f6398198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 -- 172.21.15.70:0/2623093133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f639819d410 con 0x7f6398103660 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639cc64640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6398103660 0x7f63981989a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f638800b3f0 tx=0x7f638800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f638e7fc640 1 -- 172.21.15.70:0/2623093133 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388015020 con 0x7f6398103660 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f638e7fc640 1 -- 172.21.15.70:0/2623093133 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6388011d00 con 0x7f6398103660 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639f6c9640 1 -- 172.21.15.70:0/2623093133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f639819d700 con 0x7f6398103660 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f638e7fc640 1 -- 172.21.15.70:0/2623093133 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388010e10 con 0x7f6398103660 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.441+0000 7f639f6c9640 1 -- 172.21.15.70:0/2623093133 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f63981a4fe0 con 0x7f6398103660 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.444+0000 7f638e7fc640 1 -- 172.21.15.70:0/2623093133 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6388018020 con 0x7f6398103660 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.444+0000 7f63a1aa2740 1 Processor -- start 2024-09-19T04:38:38.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.444+0000 7f63a1aa2740 1 -- start start 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.444+0000 7f638e7fc640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63840a3430 0x7f63840a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.444+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cb7880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc2140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cc2680 0x55a775cc4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a775c1d2e0 con 0x55a775cb7dc0 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a775bc4ce0 con 0x55a775cb74a0 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a775c192a0 con 0x55a775cc2680 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639dc66640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63840a3430 0x7f63840a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f638e7fc640 1 -- 172.21.15.70:0/2623093133 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f63880cf350 con 0x7f6398103660 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc2140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc2140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42318/0 (socket says 172.21.15.70:42318) 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 -- 172.21.15.70:0/1313603977 learned_addr learned my addr 172.21.15.70:0/1313603977 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:38.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639d465640 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cb7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639dc66640 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cc2680 0x55a775cc4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 -- 172.21.15.70:0/1313603977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cc2680 msgr2=0x55a775cc4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cc2680 0x55a775cc4a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 -- 172.21.15.70:0/1313603977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 msgr2=0x55a775cb7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cb7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 -- 172.21.15.70:0/1313603977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a775ba9440 con 0x55a775cb7dc0 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639d465640 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cb7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639dc66640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63840a3430 0x7f63840a58f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6390005e30 tx=0x7f639002ff50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f639cc64640 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc2140 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f638809b440 tx=0x7f6388097b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b915a19091f0704f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f63837fe640 1 -- 172.21.15.70:0/1313603977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388078b20 con 0x55a775cb7dc0 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f63837fe640 1 -- 172.21.15.70:0/1313603977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6388010510 con 0x55a775cb7dc0 2024-09-19T04:38:38.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.445+0000 7f63837fe640 1 -- 172.21.15.70:0/1313603977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388009200 con 0x55a775cb7dc0 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 -- 172.21.15.70:0/1313603977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 msgr2=0x55a775cc2140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc2140 secure :-1 s=READY pgs=1108 cs=0 l=1 rev1=1 crypto rx=0x7f638809b440 tx=0x7f6388097b10 comp rx=0 tx=0).stop 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 -- 172.21.15.70:0/1313603977 shutdown_connections 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cc2680 0x55a775cc4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc2140 unknown :-1 s=CLOSED pgs=1108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/1313603977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cb7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 -- 172.21.15.70:0/1313603977 >> 172.21.15.70:0/1313603977 conn(0x55a775cb3a30 msgr2=0x55a775cb3e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 -- 172.21.15.70:0/1313603977 shutdown_connections 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 -- 172.21.15.70:0/1313603977 wait complete. 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.446+0000 7f63a1aa2740 1 -- start start 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f63a1aa2740 1 Processor -- start 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 0x55a775cc2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cbf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cbf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a775cc5250 con 0x55a775cb7dc0 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a775bd8050 con 0x55a775cc2680 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a775cc53d0 con 0x55a775cb74a0 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f63a1aa2740 10 client.0 _ll_register_callbacks cb 0x55a775c18160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f639cc64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cbf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f639cc64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cbf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42334/0 (socket says 172.21.15.70:42334) 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f639cc64640 1 -- 172.21.15.70:0/2122840771 learned_addr learned my addr 172.21.15.70:0/2122840771 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f639d465640 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 0x55a775cc2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f639dc66640 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cbf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.447+0000 7f639cc64640 1 -- 172.21.15.70:0/2122840771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 msgr2=0x55a775cc2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f639cc64640 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 0x55a775cc2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f639cc64640 1 -- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 msgr2=0x55a775cbf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f639cc64640 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cbf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f639cc64640 1 -- 172.21.15.70:0/2122840771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a77598e3c0 con 0x55a775cb7dc0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f639dc66640 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cbf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f639cc64640 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cbf2e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f63880a3e80 tx=0x7f638809fb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50a0c18b11836c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f6380ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f6380ff9640 1 -- 172.21.15.70:0/2122840771 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388078ee0 con 0x55a775cb7dc0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f6380ff9640 1 -- 172.21.15.70:0/2122840771 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f6388011830 con 0x55a775cb7dc0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f63a1aa2740 1 -- 172.21.15.70:0/2122840771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a775c2a850 con 0x55a775cb7dc0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f6380ff9640 1 -- 172.21.15.70:0/2122840771 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6388078940 con 0x55a775cb7dc0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f63a1aa2740 10 client.17580 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f63a1aa2740 1 -- 172.21.15.70:0/2122840771 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a775cc5250 con 0x55a775cb7dc0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f6380ff9640 1 -- 172.21.15.70:0/2122840771 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55a775c2a850 con 0x55a775cb7dc0 2024-09-19T04:38:38.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f6380ff9640 1 -- 172.21.15.70:0/2122840771 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6388097db0 con 0x55a775cb7dc0 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f63a1aa2740 10 client.17580 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f63a1aa2740 10 client.17580 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.448+0000 7f63a1aa2740 20 client.17580 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.449+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a775cd1de0 0x55a775cd41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.449+0000 7f63a1aa2740 4 client.17580 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.449+0000 7f63a1aa2740 1 -- 172.21.15.70:0/2122840771 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a775c24d60 con 0x55a775cd1de0 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.449+0000 7f639d465640 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a775cd1de0 0x55a775cd41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.449+0000 7f639d465640 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a775cd1de0 0x55a775cd41d0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6eee631c0da2792 server_cookie=636cc80867cf988a in_seq=0 out_seq=0 2024-09-19T04:38:38.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.449+0000 7f6380ff9640 10 client.17580 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:38.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f6380ff9640 1 -- 172.21.15.70:0/2122840771 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a775c24d60 con 0x55a775cd1de0 2024-09-19T04:38:38.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f6380ff9640 10 client.17580 handle_command_reply: tid=0 2024-09-19T04:38:38.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 client.17580 shutdown 2024-09-19T04:38:38.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 -- 172.21.15.70:0/2122840771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 msgr2=0x55a775cbf2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cbf2e0 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7f63880a3e80 tx=0x7f638809fb60 comp rx=0 tx=0).stop 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 -- 172.21.15.70:0/2122840771 shutdown_connections 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a775cd1de0 0x55a775cd41d0 crc :-1 s=READY pgs=184 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cbf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cbf2e0 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/2122840771 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 0x55a775cc2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 -- 172.21.15.70:0/2122840771 >> 172.21.15.70:0/2122840771 conn(0x55a775cb3a30 msgr2=0x55a775cb2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f6380ff9640 0 client.17580 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.450+0000 7f63a1aa2740 1 -- 172.21.15.70:0/2122840771 shutdown_connections 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.451+0000 7f63a1aa2740 1 -- 172.21.15.70:0/2122840771 wait complete. 2024-09-19T04:38:38.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.451+0000 7f63a1aa2740 20 client.17580 trim_cache size 0 max 16384 2024-09-19T04:38:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.467+0000 7f63a1aa2740 1 Processor -- start 2024-09-19T04:38:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f63a1aa2740 1 -- start start 2024-09-19T04:38:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cce4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb7dc0 0x55a775cd9830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cc2680 0x55a775cd9d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63981b0130 con 0x55a775cc2680 2024-09-19T04:38:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ada00 con 0x55a775cb74a0 2024-09-19T04:38:38.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ab870 con 0x55a775cb7dc0 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cc2680 0x55a775cd9d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cc2680 0x55a775cd9d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42344/0 (socket says 172.21.15.70:42344) 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 -- 172.21.15.70:0/3067786063 learned_addr learned my addr 172.21.15.70:0/3067786063 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639cc64640 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb7dc0 0x55a775cd9830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639d465640 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cce4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 -- 172.21.15.70:0/3067786063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb7dc0 msgr2=0x55a775cd9830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb7dc0 0x55a775cd9830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 -- 172.21.15.70:0/3067786063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 msgr2=0x55a775cce4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cce4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 -- 172.21.15.70:0/3067786063 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a775cb72d0 con 0x55a775cc2680 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f639dc66640 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cc2680 0x55a775cd9d70 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6390035000 tx=0x7f6390046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=35c69550a9d056e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.468+0000 7f6382ffd640 1 -- 172.21.15.70:0/3067786063 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6390034040 con 0x55a775cc2680 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f6382ffd640 1 -- 172.21.15.70:0/3067786063 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6390004040 con 0x55a775cc2680 2024-09-19T04:38:38.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f6382ffd640 1 -- 172.21.15.70:0/3067786063 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63900506a0 con 0x55a775cc2680 2024-09-19T04:38:38.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3067786063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cc2680 msgr2=0x55a775cd9d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cc2680 0x55a775cd9d70 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7f6390035000 tx=0x7f6390046000 comp rx=0 tx=0).stop 2024-09-19T04:38:38.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3067786063 shutdown_connections 2024-09-19T04:38:38.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cc2680 0x55a775cd9d70 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb7dc0 0x55a775cd9830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3067786063 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cb74a0 0x55a775cce4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3067786063 >> 172.21.15.70:0/3067786063 conn(0x55a775cb3a30 msgr2=0x55a775cc1360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3067786063 shutdown_connections 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3067786063 wait complete. 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.469+0000 7f63a1aa2740 1 -- start start 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f63a1aa2740 1 Processor -- start 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 0x55a775ccac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f63a1aa2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cc6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f63981abec0 con 0x55a775cb7dc0 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ad330 con 0x55a775cc2680 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f63a1aa2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f63981ac590 con 0x55a775cb74a0 2024-09-19T04:38:38.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f63a1aa2740 10 client.0 _ll_register_callbacks cb 0x7f638809b280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639cc64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639cc64640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42350/0 (socket says 172.21.15.70:42350) 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639cc64640 1 -- 172.21.15.70:0/3250656575 learned_addr learned my addr 172.21.15.70:0/3250656575 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639d465640 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 0x55a775ccac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639dc66640 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cc6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639cc64640 1 -- 172.21.15.70:0/3250656575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 msgr2=0x55a775ccac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639cc64640 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 0x55a775ccac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639cc64640 1 -- 172.21.15.70:0/3250656575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 msgr2=0x55a775cc6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639cc64640 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cc6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.470+0000 7f639cc64640 1 -- 172.21.15.70:0/3250656575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a775cb8a20 con 0x55a775cb7dc0 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f639cc64640 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc5f40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f638809b6d0 tx=0x7f63880783c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5068698dac33447a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:38.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f6380ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f6380ff9640 1 -- 172.21.15.70:0/3250656575 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6388078ee0 con 0x55a775cb7dc0 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f6380ff9640 1 -- 172.21.15.70:0/3250656575 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f638809ab90 con 0x55a775cb7dc0 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3250656575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6390004040 con 0x55a775cb7dc0 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f6380ff9640 1 -- 172.21.15.70:0/3250656575 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f63880786d0 con 0x55a775cb7dc0 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 10 client.17586 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3250656575 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a775d3c4d0 con 0x55a775cb7dc0 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f6380ff9640 1 -- 172.21.15.70:0/3250656575 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6390004040 con 0x55a775cb7dc0 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f6380ff9640 1 -- 172.21.15.70:0/3250656575 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6388084480 con 0x55a775cb7dc0 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 10 client.17586 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 10 client.17586 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 20 client.17586 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a775d3c960 0x55a775d3ed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:38.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 4 client.17586 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.471+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3250656575 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a775ba1210 con 0x55a775d3c960 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f639d465640 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a775d3c960 0x55a775d3ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f639d465640 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a775d3c960 0x55a775d3ed80 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28f1237f3adeed1 server_cookie=d83e60b0ed85f477 in_seq=0 out_seq=0 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f6380ff9640 10 client.17586 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f6380ff9640 1 -- 172.21.15.70:0/3250656575 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a775ba1210 con 0x55a775d3c960 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f6380ff9640 10 client.17586 handle_command_reply: tid=0 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 client.17586 shutdown 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3250656575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 msgr2=0x55a775cc5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc5f40 secure :-1 s=READY pgs=1111 cs=0 l=1 rev1=1 crypto rx=0x7f638809b6d0 tx=0x7f63880783c0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3250656575 shutdown_connections 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a775d3c960 0x55a775d3ed80 crc :-1 s=READY pgs=185 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a775cc2680 0x55a775cc6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f6380ff9640 0 client.17586 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a775cb7dc0 0x55a775cc5f40 unknown :-1 s=CLOSED pgs=1111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 --2- 172.21.15.70:0/3250656575 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a775cb74a0 0x55a775ccac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3250656575 >> 172.21.15.70:0/3250656575 conn(0x55a775cb3a30 msgr2=0x55a775cb2350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3250656575 shutdown_connections 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.472+0000 7f63a1aa2740 1 -- 172.21.15.70:0/3250656575 wait complete. 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f63a1aa2740 20 client.17586 trim_cache size 0 max 16384 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:38:38.480 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:38.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 -- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63840a3430 msgr2=0x7f63840a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63840a3430 0x7f63840a58f0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6390005e30 tx=0x7f639002ff50 comp rx=0 tx=0).stop 2024-09-19T04:38:38.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 -- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6398103660 msgr2=0x7f63981989a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:38.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6398103660 0x7f63981989a0 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f638800b3f0 tx=0x7f638800b8b0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 -- 172.21.15.70:0/2623093133 shutdown_connections 2024-09-19T04:38:38.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f63840a3430 0x7f63840a58f0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f639810c170 0x7f639819cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f6398103660 0x7f63981989a0 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 --2- 172.21.15.70:0/2623093133 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6398102d40 0x7f6398198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:38.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 -- 172.21.15.70:0/2623093133 >> 172.21.15.70:0/2623093133 conn(0x7f63980fc7a0 msgr2=0x7f63980fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:38.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 -- 172.21.15.70:0/2623093133 shutdown_connections 2024-09-19T04:38:38.482 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:38.473+0000 7f639f6c9640 1 -- 172.21.15.70:0/2623093133 wait complete. 2024-09-19T04:38:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:38 smithi134 ceph-mon[34525]: pgmap v243: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:39.103 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:38 smithi070 ceph-mon[30942]: pgmap v243: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:39.131 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:38:39.131 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:38:39.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:38 smithi167 ceph-mon[34339]: pgmap v243: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:39.375 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/3188698953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58106f10 msgr2=0x7f9e5810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/3188698953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58106f10 0x7f9e5810ea90 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7f9e50009ca0 tx=0x7f9e5002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:38:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/3188698953 shutdown_connections 2024-09-19T04:38:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/3188698953 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58106f10 0x7f9e5810ea90 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/3188698953 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e58102790 0x7f9e581067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/3188698953 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e58101de0 0x7f9e581021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/3188698953 >> 172.21.15.70:0/3188698953 conn(0x7f9e580fd8c0 msgr2=0x7f9e580ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:39.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/3188698953 shutdown_connections 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.842+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/3188698953 wait complete. 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5f0e3640 1 Processor -- start 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5f0e3640 1 -- start start 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5f0e3640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e58101de0 0x7f9e580744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5f0e3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58102790 0x7f9e58074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5f0e3640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e58106f10 0x7f9e58074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5f0e3640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58112000 con 0x7f9e58102790 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5f0e3640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58111e80 con 0x7f9e58101de0 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5f0e3640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9e58112180 con 0x7f9e58106f10 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58102790 0x7f9e58074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:39.874 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58102790 0x7f9e58074a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42364/0 (socket says 172.21.15.70:42364) 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 -- 172.21.15.70:0/447700716 learned_addr learned my addr 172.21.15.70:0/447700716 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5ce7f640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e58101de0 0x7f9e580744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5d680640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e58106f10 0x7f9e58074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 -- 172.21.15.70:0/447700716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e58106f10 msgr2=0x7f9e58074f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e58106f10 0x7f9e58074f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 -- 172.21.15.70:0/447700716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e58101de0 msgr2=0x7f9e580744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e58101de0 0x7f9e580744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 -- 172.21.15.70:0/447700716 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e581a6a40 con 0x7f9e58102790 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e5d680640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e58106f10 0x7f9e58074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.843+0000 7f9e57fff640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58102790 0x7f9e58074a30 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400b4a0 tx=0x7f9e4400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.844+0000 7f9e55ffb640 1 -- 172.21.15.70:0/447700716 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44014070 con 0x7f9e58102790 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.844+0000 7f9e55ffb640 1 -- 172.21.15.70:0/447700716 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9e44010ae0 con 0x7f9e58102790 2024-09-19T04:38:39.875 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.844+0000 7f9e55ffb640 1 -- 172.21.15.70:0/447700716 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e44017c70 con 0x7f9e58102790 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.844+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e581a6d30 con 0x7f9e58102790 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.844+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e581a7210 con 0x7f9e58102790 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.845+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e58102240 con 0x7f9e58102790 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.846+0000 7f9e55ffb640 1 -- 172.21.15.70:0/447700716 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9e44017070 con 0x7f9e58102790 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.846+0000 7f9e55ffb640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9e480a33b0 0x7f9e480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.847+0000 7f9e5ce7f640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9e480a33b0 0x7f9e480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.847+0000 7f9e55ffb640 1 -- 172.21.15.70:0/447700716 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f9e440cf040 con 0x7f9e58102790 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.847+0000 7f9e5ce7f640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9e480a33b0 0x7f9e480a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009890 tx=0x7f9e4c008040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:39.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:39.851+0000 7f9e55ffb640 1 -- 172.21.15.70:0/447700716 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9e4409bb30 con 0x7f9e58102790 2024-09-19T04:38:40.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.054+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e58109b60 con 0x7f9e58102790 2024-09-19T04:38:40.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.054+0000 7f9e55ffb640 1 -- 172.21.15.70:0/447700716 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f9e4409b430 con 0x7f9e58102790 2024-09-19T04:38:40.056 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:38:40.056 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:38:40.057 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:38:40.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9e480a33b0 msgr2=0x7f9e480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:40.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9e480a33b0 0x7f9e480a5870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f9e4c009890 tx=0x7f9e4c008040 comp rx=0 tx=0).stop 2024-09-19T04:38:40.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58102790 msgr2=0x7f9e58074a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58102790 0x7f9e58074a30 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7f9e4400b4a0 tx=0x7f9e4400b960 comp rx=0 tx=0).stop 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 shutdown_connections 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9e480a33b0 0x7f9e480a5870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9e58106f10 0x7f9e58074f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9e58102790 0x7f9e58074a30 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 --2- 172.21.15.70:0/447700716 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e58101de0 0x7f9e580744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 >> 172.21.15.70:0/447700716 conn(0x7f9e580fd8c0 msgr2=0x7f9e580fece0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 shutdown_connections 2024-09-19T04:38:40.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:40.057+0000 7f9e5f0e3640 1 -- 172.21.15.70:0/447700716 wait complete. 2024-09-19T04:38:40.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:40 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/447700716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:40.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:40 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/447700716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:40.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:40 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/447700716' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:40.731 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:38:40.976 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:41.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:41 smithi070 ceph-mon[30942]: pgmap v244: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 -- 172.21.15.70:0/1245783785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400101450 msgr2=0x7f7400105920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1245783785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400101450 0x7f7400105920 secure :-1 s=READY pgs=1114 cs=0 l=1 rev1=1 crypto rx=0x7f73f4009900 tx=0x7f73f402a470 comp rx=0 tx=0).stop 2024-09-19T04:38:41.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 -- 172.21.15.70:0/1245783785 shutdown_connections 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1245783785 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400105f40 0x7f74001063d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1245783785 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400101450 0x7f7400105920 unknown :-1 s=CLOSED pgs=1114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1245783785 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7400100b30 0x7f7400100f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 -- 172.21.15.70:0/1245783785 >> 172.21.15.70:0/1245783785 conn(0x7f74000fc7a0 msgr2=0x7f74000febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 -- 172.21.15.70:0/1245783785 shutdown_connections 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.408+0000 7f7407bfa640 1 -- 172.21.15.70:0/1245783785 wait complete. 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7407bfa640 1 Processor -- start 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7407bfa640 1 -- start start 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7407bfa640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7400100b30 0x7f74001a4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7407bfa640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400101450 0x7f74001a4e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7407bfa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400105f40 0x7f740019eac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7407bfa640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7400118630 con 0x7f7400105f40 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7407bfa640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74001184b0 con 0x7f7400100b30 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7407bfa640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74001187b0 con 0x7f7400101450 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400105f40 0x7f740019eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400105f40 0x7f740019eac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42380/0 (socket says 172.21.15.70:42380) 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 -- 172.21.15.70:0/1538974986 learned_addr learned my addr 172.21.15.70:0/1538974986 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7405996640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7400100b30 0x7f74001a4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7405195640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400101450 0x7f74001a4e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 -- 172.21.15.70:0/1538974986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400101450 msgr2=0x7f74001a4e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400101450 0x7f74001a4e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 -- 172.21.15.70:0/1538974986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7400100b30 msgr2=0x7f74001a4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7400100b30 0x7f74001a4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 -- 172.21.15.70:0/1538974986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f740019f1f0 con 0x7f7400105f40 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7405996640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7400100b30 0x7f74001a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.409+0000 7f7406197640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400105f40 0x7f740019eac0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f73f800b970 tx=0x7f73f800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.410+0000 7f73feffd640 1 -- 172.21.15.70:0/1538974986 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8019070 con 0x7f7400105f40 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.410+0000 7f73feffd640 1 -- 172.21.15.70:0/1538974986 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73f800cb40 con 0x7f7400105f40 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.410+0000 7f7407bfa640 1 -- 172.21.15.70:0/1538974986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f740019f4e0 con 0x7f7400105f40 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.410+0000 7f73feffd640 1 -- 172.21.15.70:0/1538974986 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f8007650 con 0x7f7400105f40 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.410+0000 7f7407bfa640 1 -- 172.21.15.70:0/1538974986 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74001ab7d0 con 0x7f7400105f40 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.412+0000 7f73feffd640 1 -- 172.21.15.70:0/1538974986 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f73f801c070 con 0x7f7400105f40 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.412+0000 7f7409fd3740 1 Processor -- start 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.412+0000 7f7409fd3740 1 -- start start 2024-09-19T04:38:41.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 0x55962c2d7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d75d0 0x55962c2d7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2e4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7409fd3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55962c23d2f0 con 0x55962c2e2370 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7409fd3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55962c1e4cf0 con 0x55962c2d75d0 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7409fd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55962c2392b0 con 0x55962c2d8b40 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2e4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42396/0 (socket says 172.21.15.70:42396) 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 -- 172.21.15.70:0/3318106541 learned_addr learned my addr 172.21.15.70:0/3318106541 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405996640 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d75d0 0x55962c2d7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f73feffd640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e80a3430 0x7f73e80a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 0x55962c2d7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7406197640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e80a3430 0x7f73e80a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 -- 172.21.15.70:0/3318106541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 msgr2=0x55962c2d7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 0x55962c2d7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 -- 172.21.15.70:0/3318106541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d75d0 msgr2=0x55962c2d7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d75d0 0x55962c2d7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 -- 172.21.15.70:0/3318106541 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55962c1c93a0 con 0x55962c2e2370 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405996640 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d75d0 0x55962c2d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f73feffd640 1 -- 172.21.15.70:0/1538974986 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f73f80cf250 con 0x7f7400105f40 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.413+0000 7f7405195640 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2e4760 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f73f402a990 tx=0x7f73f4005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8db6cc37818e9f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f73e7fff640 1 -- 172.21.15.70:0/3318106541 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4035040 con 0x55962c2e2370 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f7406197640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e80a3430 0x7f73e80a58f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f73f809b5d0 tx=0x7f73f806d3c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f73e7fff640 1 -- 172.21.15.70:0/3318106541 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73f4004030 con 0x55962c2e2370 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f73e7fff640 1 -- 172.21.15.70:0/3318106541 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4003b80 con 0x55962c2e2370 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f7409fd3740 1 -- 172.21.15.70:0/3318106541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 msgr2=0x55962c2e4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f7409fd3740 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2e4760 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f73f402a990 tx=0x7f73f4005b50 comp rx=0 tx=0).stop 2024-09-19T04:38:41.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f7409fd3740 1 -- 172.21.15.70:0/3318106541 shutdown_connections 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f7409fd3740 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2e4760 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f7409fd3740 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d75d0 0x55962c2d7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f7409fd3740 1 --2- 172.21.15.70:0/3318106541 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 0x55962c2d7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.414+0000 7f7409fd3740 1 -- 172.21.15.70:0/3318106541 >> 172.21.15.70:0/3318106541 conn(0x55962c2a0310 msgr2=0x55962c2d3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 -- 172.21.15.70:0/3318106541 shutdown_connections 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 -- 172.21.15.70:0/3318106541 wait complete. 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 -- start start 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 Processor -- start 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 0x55962c2e1d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2df020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2df610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55962c2e5010 con 0x55962c2e2370 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55962c1f8060 con 0x55962c2d8b40 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55962c2e5190 con 0x55962c2d75d0 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7409fd3740 10 client.0 _ll_register_callbacks cb 0x55962bf4b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7405195640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2df610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7405195640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2df610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42412/0 (socket says 172.21.15.70:42412) 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.415+0000 7f7405195640 1 -- 172.21.15.70:0/1981028687 learned_addr learned my addr 172.21.15.70:0/1981028687 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405195640 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 0x55962c2e1d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405996640 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2df020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405195640 1 -- 172.21.15.70:0/1981028687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 msgr2=0x55962c2e1d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405195640 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 0x55962c2e1d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405195640 1 -- 172.21.15.70:0/1981028687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 msgr2=0x55962c2df020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:41.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405195640 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2df020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405195640 1 -- 172.21.15.70:0/1981028687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55962bfae3c0 con 0x55962c2e2370 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405996640 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2df020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7405195640 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2df610 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f73f40096c0 tx=0x7f73f40058b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=303e566058390e2e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f73e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f73e57fa640 1 -- 172.21.15.70:0/1981028687 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4003b10 con 0x55962c2e2370 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f73e57fa640 1 -- 172.21.15.70:0/1981028687 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f73f4003cb0 con 0x55962c2e2370 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7409fd3740 1 -- 172.21.15.70:0/1981028687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f4004030 con 0x55962c2e2370 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f73e57fa640 1 -- 172.21.15.70:0/1981028687 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f73f4005020 con 0x55962c2e2370 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7409fd3740 10 client.17604 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.416+0000 7f7409fd3740 1 -- 172.21.15.70:0/1981028687 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55962c2f0ab0 con 0x55962c2e2370 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f73e57fa640 1 -- 172.21.15.70:0/1981028687 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73f4004030 con 0x55962c2e2370 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f73e57fa640 1 -- 172.21.15.70:0/1981028687 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f73f403a040 con 0x55962c2e2370 2024-09-19T04:38:41.468 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f7409fd3740 10 client.17604 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f7409fd3740 10 client.17604 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f7409fd3740 20 client.17604 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55962c2f1e00 0x55962c2f41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f7409fd3740 4 client.17604 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f7409fd3740 1 -- 172.21.15.70:0/1981028687 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55962c24a860 con 0x55962c2f1e00 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.417+0000 7f7405996640 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55962c2f1e00 0x55962c2f41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.418+0000 7f73e57fa640 10 client.17604 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.418+0000 7f7405996640 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55962c2f1e00 0x55962c2f41f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e799eb89b60931f2 server_cookie=d1f88aff60fc5439 in_seq=0 out_seq=0 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.418+0000 7f73e57fa640 1 -- 172.21.15.70:0/1981028687 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55962c24a860 con 0x55962c2f1e00 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.418+0000 7f73e57fa640 10 client.17604 handle_command_reply: tid=0 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.418+0000 7f7409fd3740 1 client.17604 shutdown 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.418+0000 7f7409fd3740 1 -- 172.21.15.70:0/1981028687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 msgr2=0x55962c2df610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2df610 secure :-1 s=READY pgs=1117 cs=0 l=1 rev1=1 crypto rx=0x7f73f40096c0 tx=0x7f73f40058b0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 -- 172.21.15.70:0/1981028687 shutdown_connections 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55962c2f1e00 0x55962c2f41f0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2df610 unknown :-1 s=CLOSED pgs=1117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2df020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1981028687 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 0x55962c2e1d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f73e57fa640 0 client.17604 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 -- 172.21.15.70:0/1981028687 >> 172.21.15.70:0/1981028687 conn(0x55962c2a0310 msgr2=0x55962c2d9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 -- 172.21.15.70:0/1981028687 shutdown_connections 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 1 -- 172.21.15.70:0/1981028687 wait complete. 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.419+0000 7f7409fd3740 20 client.17604 trim_cache size 0 max 16384 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.431+0000 7f7409fd3740 1 Processor -- start 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.431+0000 7f7409fd3740 1 -- start start 2024-09-19T04:38:41.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2d75d0 0x55962c2d3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 0x55962c2f7210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2e2370 0x55962c2f7750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7409fd3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b6800 con 0x55962c2d75d0 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7409fd3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b40d0 con 0x55962c2e2370 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7409fd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b1f40 con 0x55962c2d8b40 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2d75d0 0x55962c2d3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2d75d0 0x55962c2d3e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42414/0 (socket says 172.21.15.70:42414) 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 -- 172.21.15.70:0/1588631367 learned_addr learned my addr 172.21.15.70:0/1588631367 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405996640 1 --2- 172.21.15.70:0/1588631367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 0x55962c2f7210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 -- 172.21.15.70:0/1588631367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 msgr2=0x55962c2f7210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 --2- 172.21.15.70:0/1588631367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 0x55962c2f7210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 -- 172.21.15.70:0/1588631367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2e2370 msgr2=0x55962c2f7750 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 --2- 172.21.15.70:0/1588631367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2e2370 0x55962c2f7750 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 -- 172.21.15.70:0/1588631367 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55962c2d8760 con 0x55962c2d75d0 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f7405195640 1 --2- 172.21.15.70:0/1588631367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2d75d0 0x55962c2d3e10 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f73f4000c00 tx=0x7f73f4009800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411bbb7082f00967 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f73e77fe640 1 -- 172.21.15.70:0/1588631367 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4035030 con 0x55962c2d75d0 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f73e77fe640 1 -- 172.21.15.70:0/1588631367 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73f40035f0 con 0x55962c2d75d0 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.432+0000 7f73e77fe640 1 -- 172.21.15.70:0/1588631367 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4003d70 con 0x55962c2d75d0 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 -- 172.21.15.70:0/1588631367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2d75d0 msgr2=0x55962c2d3e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1588631367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2d75d0 0x55962c2d3e10 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7f73f4000c00 tx=0x7f73f4009800 comp rx=0 tx=0).stop 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 -- 172.21.15.70:0/1588631367 shutdown_connections 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1588631367 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2e2370 0x55962c2f7750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1588631367 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d8b40 0x55962c2f7210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 --2- 172.21.15.70:0/1588631367 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2d75d0 0x55962c2d3e10 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 -- 172.21.15.70:0/1588631367 >> 172.21.15.70:0/1588631367 conn(0x55962c2a0310 msgr2=0x55962c2d3700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 -- 172.21.15.70:0/1588631367 shutdown_connections 2024-09-19T04:38:41.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 -- 172.21.15.70:0/1588631367 wait complete. 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.433+0000 7f7409fd3740 1 -- start start 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7409fd3740 1 Processor -- start 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 0x55962c2f7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2f4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7409fd3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2f5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7409fd3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b2590 con 0x55962c2e2370 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7409fd3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b3a00 con 0x55962c2d8b40 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7409fd3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f74001b2c60 con 0x55962c2d75d0 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7409fd3740 10 client.0 _ll_register_callbacks cb 0x7f73f00071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2f5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2f5460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42422/0 (socket says 172.21.15.70:42422) 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 -- 172.21.15.70:0/2861944087 learned_addr learned my addr 172.21.15.70:0/2861944087 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 0x55962c2f7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.473 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405996640 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2f4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 -- 172.21.15.70:0/2861944087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 msgr2=0x55962c2f7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 0x55962c2f7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 -- 172.21.15.70:0/2861944087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 msgr2=0x55962c2f4e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2f4e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 -- 172.21.15.70:0/2861944087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55962c2f5c90 con 0x55962c2e2370 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405996640 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.434+0000 7f7405195640 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2f5460 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f73f4004610 tx=0x7f73f4004e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3baa4b7d6413f45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f73e57fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f73e57fa640 1 -- 172.21.15.70:0/2861944087 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f73f4035070 con 0x55962c2e2370 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f73e57fa640 1 -- 172.21.15.70:0/2861944087 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f73f4003d20 con 0x55962c2e2370 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 1 -- 172.21.15.70:0/2861944087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f73f40035f0 con 0x55962c2e2370 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f73e57fa640 1 -- 172.21.15.70:0/2861944087 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f73f4058460 con 0x55962c2e2370 2024-09-19T04:38:41.474 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 10 client.17610 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 1 -- 172.21.15.70:0/2861944087 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55962c35c870 con 0x55962c2e2370 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f73e57fa640 1 -- 172.21.15.70:0/2861944087 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f73f40035f0 con 0x55962c2e2370 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f73e57fa640 1 -- 172.21.15.70:0/2861944087 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f73f40586a0 con 0x55962c2e2370 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 10 client.17610 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 10 client.17610 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 20 client.17610 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55962c35ce80 0x55962c35f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 4 client.17610 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.435+0000 7f7409fd3740 1 -- 172.21.15.70:0/2861944087 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55962c244d70 con 0x55962c35ce80 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7405996640 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55962c35ce80 0x55962c35f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7405996640 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55962c35ce80 0x55962c35f2a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=dee7e04b96d12f1b server_cookie=67f411f271bdfa79 in_seq=0 out_seq=0 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f73e57fa640 10 client.17610 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:41.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f73e57fa640 1 -- 172.21.15.70:0/2861944087 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55962c244d70 con 0x55962c35ce80 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f73e57fa640 10 client.17610 handle_command_reply: tid=0 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 client.17610 shutdown 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 -- 172.21.15.70:0/2861944087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 msgr2=0x55962c2f5460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2f5460 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7f73f4004610 tx=0x7f73f4004e80 comp rx=0 tx=0).stop 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 -- 172.21.15.70:0/2861944087 shutdown_connections 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55962c35ce80 0x55962c35f2a0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55962c2e2370 0x55962c2f5460 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55962c2d8b40 0x55962c2f4e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 --2- 172.21.15.70:0/2861944087 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55962c2d75d0 0x55962c2f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f73e57fa640 0 client.17610 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 -- 172.21.15.70:0/2861944087 >> 172.21.15.70:0/2861944087 conn(0x55962c2a0310 msgr2=0x55962c2e0880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 -- 172.21.15.70:0/2861944087 shutdown_connections 2024-09-19T04:38:41.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.436+0000 7f7409fd3740 1 -- 172.21.15.70:0/2861944087 wait complete. 2024-09-19T04:38:41.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7409fd3740 20 client.17610 trim_cache size 0 max 16384 2024-09-19T04:38:41.477 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:41.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 -- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e80a3430 msgr2=0x7f73e80a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e80a3430 0x7f73e80a58f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f73f809b5d0 tx=0x7f73f806d3c0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 -- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400105f40 msgr2=0x7f740019eac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:41.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400105f40 0x7f740019eac0 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f73f800b970 tx=0x7f73f800be30 comp rx=0 tx=0).stop 2024-09-19T04:38:41.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 -- 172.21.15.70:0/1538974986 shutdown_connections 2024-09-19T04:38:41.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f73e80a3430 0x7f73e80a58f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7400105f40 0x7f740019eac0 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7400101450 0x7f74001a4e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 --2- 172.21.15.70:0/1538974986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7400100b30 0x7f74001a4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:41.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 -- 172.21.15.70:0/1538974986 >> 172.21.15.70:0/1538974986 conn(0x7f74000fc7a0 msgr2=0x7f740010f700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:41.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 -- 172.21.15.70:0/1538974986 shutdown_connections 2024-09-19T04:38:41.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:41.437+0000 7f7407bfa640 1 -- 172.21.15.70:0/1538974986 wait complete. 2024-09-19T04:38:41.478 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:41 smithi167 ceph-mon[34339]: pgmap v244: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:41.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:41 smithi134 ceph-mon[34525]: pgmap v244: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:42.109 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:38:42.358 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:42.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/830047698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4101290 msgr2=0x7fc0b4107a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/830047698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4101290 0x7fc0b4107a50 secure :-1 s=READY pgs=1120 cs=0 l=1 rev1=1 crypto rx=0x7fc09c009930 tx=0x7fc09c02a420 comp rx=0 tx=0).stop 2024-09-19T04:38:42.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/830047698 shutdown_connections 2024-09-19T04:38:42.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/830047698 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0b4108160 0x7fc0b410eb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/830047698 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4101290 0x7fc0b4107a50 unknown :-1 s=CLOSED pgs=1120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/830047698 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b41008e0 0x7fc0b4100cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/830047698 >> 172.21.15.70:0/830047698 conn(0x7fc0b4077210 msgr2=0x7fc0b4077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:42.837 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/830047698 shutdown_connections 2024-09-19T04:38:42.838 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.835+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/830047698 wait complete. 2024-09-19T04:38:42.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b9c1e640 1 Processor -- start 2024-09-19T04:38:42.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b9c1e640 1 -- start start 2024-09-19T04:38:42.839 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b9c1e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b41008e0 0x7fc0b4198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b9c1e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0b4101290 0x7fc0b4198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b9c1e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4108160 0x7fc0b419ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b9c1e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4111fe0 con 0x7fc0b4108160 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b9c1e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4111e60 con 0x7fc0b4101290 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b9c1e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b4112160 con 0x7fc0b41008e0 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4108160 0x7fc0b419ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4108160 0x7fc0b419ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42432/0 (socket says 172.21.15.70:42432) 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b3fff640 1 -- 172.21.15.70:0/3808186425 learned_addr learned my addr 172.21.15.70:0/3808186425 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.836+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b41008e0 0x7fc0b4198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0abfff640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0b4101290 0x7fc0b4198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b3fff640 1 -- 172.21.15.70:0/3808186425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b41008e0 msgr2=0x7fc0b4198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b3fff640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b41008e0 0x7fc0b4198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.840 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b3fff640 1 -- 172.21.15.70:0/3808186425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0b4101290 msgr2=0x7fc0b4198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b3fff640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0b4101290 0x7fc0b4198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b3fff640 1 -- 172.21.15.70:0/3808186425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc0b419d530 con 0x7fc0b4108160 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0abfff640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0b4101290 0x7fc0b4198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b3fff640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4108160 0x7fc0b419ce50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00cce0 tx=0x7fc0ac00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b17fa640 1 -- 172.21.15.70:0/3808186425 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac00f450 con 0x7fc0b4108160 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/3808186425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc0b419d820 con 0x7fc0b4108160 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b17fa640 1 -- 172.21.15.70:0/3808186425 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc0ac00fac0 con 0x7fc0b4108160 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b17fa640 1 -- 172.21.15.70:0/3808186425 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0ac018b10 con 0x7fc0b4108160 2024-09-19T04:38:42.841 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.837+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/3808186425 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc0b41a5100 con 0x7fc0b4108160 2024-09-19T04:38:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.839+0000 7fc0b17fa640 1 -- 172.21.15.70:0/3808186425 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc0ac00fc70 con 0x7fc0b4108160 2024-09-19T04:38:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0bbff7740 1 Processor -- start 2024-09-19T04:38:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0bbff7740 1 -- start start 2024-09-19T04:38:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b6b40 0x5641459b5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 0x5641459b5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.846 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459c0370 0x5641459c2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56414591b2f0 con 0x5641459c0370 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5641458c2cf0 con 0x5641459b55d0 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5641459172b0 con 0x5641459b6b40 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0b17fa640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0a00a33b0 0x7fc0a00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0abfff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b6b40 0x5641459b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0abfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459c0370 0x5641459c2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0b3fff640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0a00a33b0 0x7fc0a00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0abfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459c0370 0x5641459c2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42444/0 (socket says 172.21.15.70:42444) 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0abfff640 1 -- 172.21.15.70:0/2257766866 learned_addr learned my addr 172.21.15.70:0/2257766866 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/2257766866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 0x5641459b5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.840+0000 7fc0b17fa640 1 -- 172.21.15.70:0/3808186425 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc0ac0d01e0 con 0x7fc0b4108160 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0abfff640 1 -- 172.21.15.70:0/2257766866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b6b40 msgr2=0x5641459b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:42.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0abfff640 1 --2- 172.21.15.70:0/2257766866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b6b40 0x5641459b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0abfff640 1 -- 172.21.15.70:0/2257766866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 msgr2=0x5641459b5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0abfff640 1 --2- 172.21.15.70:0/2257766866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 0x5641459b5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0abfff640 1 -- 172.21.15.70:0/2257766866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641458a73a0 con 0x5641459c0370 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0b3fff640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0a00a33b0 0x7fc0a00a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0cdf30 tx=0x7fc0ac06c0e0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0abfff640 1 --2- 172.21.15.70:0/2257766866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459c0370 0x5641459c2760 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc09c006010 tx=0x7fc09c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9611035615a5b3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0a9ffb640 1 -- 172.21.15.70:0/2257766866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c035040 con 0x5641459c0370 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0a9ffb640 1 -- 172.21.15.70:0/2257766866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc09c005020 con 0x5641459c0370 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.841+0000 7fc0a9ffb640 1 -- 172.21.15.70:0/2257766866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc09c0049a0 con 0x5641459c0370 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 -- 172.21.15.70:0/2257766866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459c0370 msgr2=0x5641459c2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/2257766866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459c0370 0x5641459c2760 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fc09c006010 tx=0x7fc09c000bc0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 -- 172.21.15.70:0/2257766866 shutdown_connections 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/2257766866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459c0370 0x5641459c2760 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/2257766866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 0x5641459b5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/2257766866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b6b40 0x5641459b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 -- 172.21.15.70:0/2257766866 >> 172.21.15.70:0/2257766866 conn(0x56414597e310 msgr2=0x5641459b1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 -- 172.21.15.70:0/2257766866 shutdown_connections 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 -- 172.21.15.70:0/2257766866 wait complete. 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.842+0000 7fc0bbff7740 1 -- start start 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0bbff7740 1 Processor -- start 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 0x5641459bfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bd020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459bd610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5641459c3010 con 0x5641459b6b40 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5641458d6060 con 0x5641459c0370 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5641459c3190 con 0x5641459b55d0 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0bbff7740 10 client.0 _ll_register_callbacks cb 0x5641456298c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:42.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bd020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bd020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42450/0 (socket says 172.21.15.70:42450) 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 -- 172.21.15.70:0/3981470711 learned_addr learned my addr 172.21.15.70:0/3981470711 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0abfff640 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 0x5641459bfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0abfff640 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459bd610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 -- 172.21.15.70:0/3981470711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 msgr2=0x5641459bfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 0x5641459bfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 -- 172.21.15.70:0/3981470711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 msgr2=0x5641459bd610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459bd610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 -- 172.21.15.70:0/3981470711 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56414568c3c0 con 0x5641459b6b40 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bd020 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4011540 tx=0x7fc0a4011a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d33705c635f887f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.843+0000 7fc092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:42.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc092ffd640 1 -- 172.21.15.70:0/3981470711 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a400f6d0 con 0x5641459b6b40 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc092ffd640 1 -- 172.21.15.70:0/3981470711 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc0a400f870 con 0x5641459b6b40 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 1 -- 172.21.15.70:0/3981470711 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc09c005020 con 0x5641459b6b40 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc092ffd640 1 -- 172.21.15.70:0/3981470711 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc0a400fab0 con 0x5641459b6b40 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 10 client.17622 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 1 -- 172.21.15.70:0/3981470711 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5641459ceb10 con 0x5641459b6b40 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc092ffd640 1 -- 172.21.15.70:0/3981470711 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc09c005020 con 0x5641459b6b40 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc092ffd640 1 -- 172.21.15.70:0/3981470711 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc0a401d400 con 0x5641459b6b40 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 10 client.17622 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 10 client.17622 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 20 client.17622 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5641459d0020 0x5641459d2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 4 client.17622 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:42.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0bbff7740 1 -- 172.21.15.70:0/3981470711 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564145928860 con 0x5641459d0020 2024-09-19T04:38:42.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.844+0000 7fc0abfff640 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5641459d0020 0x5641459d2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.845+0000 7fc0abfff640 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5641459d0020 0x5641459d2440 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=86f4624c10f3a3f1 server_cookie=d4f771a12eafe820 in_seq=0 out_seq=0 2024-09-19T04:38:42.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.845+0000 7fc092ffd640 10 client.17622 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc092ffd640 1 -- 172.21.15.70:0/3981470711 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564145928860 con 0x5641459d0020 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc092ffd640 10 client.17622 handle_command_reply: tid=0 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 client.17622 shutdown 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 -- 172.21.15.70:0/3981470711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 msgr2=0x5641459bd020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bd020 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4011540 tx=0x7fc0a4011a00 comp rx=0 tx=0).stop 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 -- 172.21.15.70:0/3981470711 shutdown_connections 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5641459d0020 0x5641459d2440 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459bd610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bd020 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/3981470711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 0x5641459bfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 -- 172.21.15.70:0/3981470711 >> 172.21.15.70:0/3981470711 conn(0x56414597e310 msgr2=0x5641459b7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:42.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc092ffd640 0 client.17622 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:42.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 -- 172.21.15.70:0/3981470711 shutdown_connections 2024-09-19T04:38:42.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 1 -- 172.21.15.70:0/3981470711 wait complete. 2024-09-19T04:38:42.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.846+0000 7fc0bbff7740 20 client.17622 trim_cache size 0 max 16384 2024-09-19T04:38:42.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0bbff7740 1 Processor -- start 2024-09-19T04:38:42.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0bbff7740 1 -- start start 2024-09-19T04:38:42.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 0x5641459cc2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bc020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.861 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459c0370 0x5641459d7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b41b00b0 con 0x5641459b6b40 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b41ad980 con 0x5641459b55d0 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b41ab7f0 con 0x5641459c0370 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bc020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bc020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42452/0 (socket says 172.21.15.70:42452) 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0b37fe640 1 -- 172.21.15.70:0/1898445088 learned_addr learned my addr 172.21.15.70:0/1898445088 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0abfff640 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 0x5641459cc2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0abfff640 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459c0370 0x5641459d7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0b37fe640 1 -- 172.21.15.70:0/1898445088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459c0370 msgr2=0x5641459d7cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459c0370 0x5641459d7cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0b37fe640 1 -- 172.21.15.70:0/1898445088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 msgr2=0x5641459cc2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 0x5641459cc2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0b37fe640 1 -- 172.21.15.70:0/1898445088 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5641459b1de0 con 0x5641459b6b40 2024-09-19T04:38:42.862 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.859+0000 7fc0abfff640 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459c0370 0x5641459d7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:42.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bc020 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc0a401d820 tx=0x7fc0a40094f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc03c9d4c9642b36 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:42.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0a97fa640 1 -- 172.21.15.70:0/1898445088 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a402a030 con 0x5641459b6b40 2024-09-19T04:38:42.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0a97fa640 1 -- 172.21.15.70:0/1898445088 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc0a400f040 con 0x5641459b6b40 2024-09-19T04:38:42.863 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0a97fa640 1 -- 172.21.15.70:0/1898445088 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a4014440 con 0x5641459b6b40 2024-09-19T04:38:42.866 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1898445088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 msgr2=0x5641459bc020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bc020 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7fc0a401d820 tx=0x7fc0a40094f0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1898445088 shutdown_connections 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459c0370 0x5641459d7cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459bc020 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1898445088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459b55d0 0x5641459cc2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1898445088 >> 172.21.15.70:0/1898445088 conn(0x56414597e310 msgr2=0x5641459bb910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1898445088 shutdown_connections 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.860+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1898445088 wait complete. 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 1 -- start start 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 1 Processor -- start 2024-09-19T04:38:42.867 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 0x5641459c8ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459b9e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459ba5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b41abe40 con 0x5641459b6b40 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b41ad2b0 con 0x5641459c0370 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc0b41ac510 con 0x5641459b55d0 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0bbff7740 10 client.0 _ll_register_callbacks cb 0x7fc0a4009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459b9e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0b37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459b9e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:42468/0 (socket says 172.21.15.70:42468) 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0b37fe640 1 -- 172.21.15.70:0/1786201721 learned_addr learned my addr 172.21.15.70:0/1786201721 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.861+0000 7fc0abfff640 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459ba5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0b37fe640 1 -- 172.21.15.70:0/1786201721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 msgr2=0x5641459c8ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:42.868 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 0x5641459c8ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0b37fe640 1 -- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 msgr2=0x5641459ba5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459ba5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0b37fe640 1 -- 172.21.15.70:0/1786201721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564145a3e0d0 con 0x5641459b6b40 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0abfff640 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0b37fe640 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459b9e80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009560 tx=0x7fc0a400f960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52716c45df5e94f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc092ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc092ffd640 1 -- 172.21.15.70:0/1786201721 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0a402a070 con 0x5641459b6b40 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc092ffd640 1 -- 172.21.15.70:0/1786201721 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fc0a401dc40 con 0x5641459b6b40 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1786201721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc0a400f040 con 0x5641459b6b40 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc092ffd640 1 -- 172.21.15.70:0/1786201721 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc0a4014440 con 0x5641459b6b40 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0bbff7740 10 client.17628 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1786201721 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564145a3f180 con 0x5641459b6b40 2024-09-19T04:38:42.869 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc092ffd640 1 -- 172.21.15.70:0/1786201721 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc0a400f040 con 0x5641459b6b40 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc092ffd640 1 -- 172.21.15.70:0/1786201721 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc0a4040610 con 0x5641459b6b40 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0bbff7740 10 client.17628 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0bbff7740 10 client.17628 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0bbff7740 20 client.17628 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.862+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564145a3f770 0x564145a41b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.863+0000 7fc0bbff7740 4 client.17628 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.863+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1786201721 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564145922d70 con 0x564145a3f770 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.863+0000 7fc0abfff640 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564145a3f770 0x564145a41b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.863+0000 7fc092ffd640 10 client.17628 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.863+0000 7fc0abfff640 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564145a3f770 0x564145a41b90 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=940230bce79530ff server_cookie=550be2b82a750f05 in_seq=0 out_seq=0 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.863+0000 7fc092ffd640 1 -- 172.21.15.70:0/1786201721 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564145922d70 con 0x564145a3f770 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.863+0000 7fc092ffd640 10 client.17628 handle_command_reply: tid=0 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.863+0000 7fc0bbff7740 1 client.17628 shutdown 2024-09-19T04:38:42.870 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1786201721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 msgr2=0x5641459b9e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459b9e80 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fc0a4009560 tx=0x7fc0a400f960 comp rx=0 tx=0).stop 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1786201721 shutdown_connections 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564145a3f770 0x564145a41b90 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5641459c0370 0x5641459ba5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5641459b6b40 0x5641459b9e80 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc092ffd640 0 client.17628 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 --2- 172.21.15.70:0/1786201721 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5641459b55d0 0x5641459c8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1786201721 >> 172.21.15.70:0/1786201721 conn(0x56414597e310 msgr2=0x5641459b04e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1786201721 shutdown_connections 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 1 -- 172.21.15.70:0/1786201721 wait complete. 2024-09-19T04:38:42.871 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0bbff7740 20 client.17628 trim_cache size 0 max 16384 2024-09-19T04:38:42.872 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:42.872 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0a00a33b0 msgr2=0x7fc0a00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0a00a33b0 0x7fc0a00a5870 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac0cdf30 tx=0x7fc0ac06c0e0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4108160 msgr2=0x7fc0b419ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4108160 0x7fc0b419ce50 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fc0ac00cce0 tx=0x7fc0ac00a620 comp rx=0 tx=0).stop 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/3808186425 shutdown_connections 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0a00a33b0 0x7fc0a00a5870 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc0b4108160 0x7fc0b419ce50 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc0b4101290 0x7fc0b4198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 --2- 172.21.15.70:0/3808186425 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc0b41008e0 0x7fc0b4198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/3808186425 >> 172.21.15.70:0/3808186425 conn(0x7fc0b4077210 msgr2=0x7fc0b4105d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.864+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/3808186425 shutdown_connections 2024-09-19T04:38:42.873 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:42.865+0000 7fc0b9c1e640 1 -- 172.21.15.70:0/3808186425 wait complete. 2024-09-19T04:38:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:42 smithi134 ceph-mon[34525]: pgmap v245: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:43.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:42 smithi070 ceph-mon[30942]: pgmap v245: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:43.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:42 smithi167 ceph-mon[34339]: pgmap v245: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:43.600 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:38:43.848 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:44.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 -- 172.21.15.70:0/903093794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b0103660 msgr2=0x7f47b010bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 --2- 172.21.15.70:0/903093794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b0103660 0x7f47b010bb50 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7f47ac009900 tx=0x7f47ac02a480 comp rx=0 tx=0).stop 2024-09-19T04:38:44.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 -- 172.21.15.70:0/903093794 shutdown_connections 2024-09-19T04:38:44.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 --2- 172.21.15.70:0/903093794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b010c170 0x7f47b010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 --2- 172.21.15.70:0/903093794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b0103660 0x7f47b010bb50 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 --2- 172.21.15.70:0/903093794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b0102d40 0x7f47b0103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 -- 172.21.15.70:0/903093794 >> 172.21.15.70:0/903093794 conn(0x7f47b00fc7a0 msgr2=0x7f47b00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 -- 172.21.15.70:0/903093794 shutdown_connections 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.284+0000 7f47b7abd640 1 -- 172.21.15.70:0/903093794 wait complete. 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b7abd640 1 Processor -- start 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b7abd640 1 -- start start 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b7abd640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b0102d40 0x7f47b01984a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b7abd640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b0103660 0x7f47b01989e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b7abd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b010c170 0x7f47b019cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b7abd640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0111fc0 con 0x7f47b010c170 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b7abd640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0111e40 con 0x7f47b0102d40 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b7abd640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0112140 con 0x7f47b0103660 2024-09-19T04:38:44.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b605a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b010c170 0x7f47b019cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b605a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b010c170 0x7f47b019cd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34888/0 (socket says 172.21.15.70:34888) 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.285+0000 7f47b605a640 1 -- 172.21.15.70:0/3503945443 learned_addr learned my addr 172.21.15.70:0/3503945443 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b5058640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b0103660 0x7f47b01989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b5859640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b0102d40 0x7f47b01984a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b605a640 1 -- 172.21.15.70:0/3503945443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b0103660 msgr2=0x7f47b01989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b605a640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b0103660 0x7f47b01989e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b605a640 1 -- 172.21.15.70:0/3503945443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b0102d40 msgr2=0x7f47b01984a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b605a640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b0102d40 0x7f47b01984a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b605a640 1 -- 172.21.15.70:0/3503945443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b019d450 con 0x7f47b010c170 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b605a640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b010c170 0x7f47b019cd70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f47a800b970 tx=0x7f47a800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47a2ffd640 1 -- 172.21.15.70:0/3503945443 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8019070 con 0x7f47b010c170 2024-09-19T04:38:44.290 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b7abd640 1 -- 172.21.15.70:0/3503945443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b019d740 con 0x7f47b010c170 2024-09-19T04:38:44.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47a2ffd640 1 -- 172.21.15.70:0/3503945443 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f47a800cb40 con 0x7f47b010c170 2024-09-19T04:38:44.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47b7abd640 1 -- 172.21.15.70:0/3503945443 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b01a5020 con 0x7f47b010c170 2024-09-19T04:38:44.291 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.286+0000 7f47a2ffd640 1 -- 172.21.15.70:0/3503945443 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a8007650 con 0x7f47b010c170 2024-09-19T04:38:44.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.288+0000 7f47a2ffd640 1 -- 172.21.15.70:0/3503945443 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f47a801c070 con 0x7f47b010c170 2024-09-19T04:38:44.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b9e96740 1 Processor -- start 2024-09-19T04:38:44.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b9e96740 1 -- start start 2024-09-19T04:38:44.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79a5090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.295 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79a5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 0x5612b79b2760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b9e96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5612b790b2f0 con 0x5612b79a55d0 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b9e96740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5612b78b2cf0 con 0x5612b79a6b40 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b9e96740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5612b79072b0 con 0x5612b79b0370 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b5859640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79a5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b5859640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79a5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34894/0 (socket says 172.21.15.70:34894) 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b5859640 1 -- 172.21.15.70:0/3214896320 learned_addr learned my addr 172.21.15.70:0/3214896320 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b5058640 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 0x5612b79b2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47a2ffd640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f479c0a33b0 0x7f479c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b5058640 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79a5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b5859640 1 -- 172.21.15.70:0/3214896320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 msgr2=0x5612b79b2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.289+0000 7f47b5859640 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 0x5612b79b2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f47b5859640 1 -- 172.21.15.70:0/3214896320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 msgr2=0x5612b79a5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f47b5859640 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79a5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f47b605a640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f479c0a33b0 0x7f479c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f47b5859640 1 -- 172.21.15.70:0/3214896320 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612b78973a0 con 0x5612b79a55d0 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f47b5058640 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f47a2ffd640 1 -- 172.21.15.70:0/3503945443 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f47a80cf2a0 con 0x7f47b010c170 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f47b5859640 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79a5a10 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f47a400bcf0 tx=0x7f47a400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4f943bc1dba334a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f479bfff640 1 -- 172.21.15.70:0/3214896320 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a40147e0 con 0x5612b79a55d0 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f479bfff640 1 -- 172.21.15.70:0/3214896320 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f47a4014e50 con 0x5612b79a55d0 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.290+0000 7f479bfff640 1 -- 172.21.15.70:0/3214896320 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a401b380 con 0x5612b79a55d0 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 -- 172.21.15.70:0/3214896320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 msgr2=0x5612b79a5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b605a640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f479c0a33b0 0x7f479c0a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f47a80ccbb0 tx=0x7f47a8004a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79a5a10 secure :-1 s=READY pgs=1128 cs=0 l=1 rev1=1 crypto rx=0x7f47a400bcf0 tx=0x7f47a400f730 comp rx=0 tx=0).stop 2024-09-19T04:38:44.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 -- 172.21.15.70:0/3214896320 shutdown_connections 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 0x5612b79b2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79a5a10 unknown :-1 s=CLOSED pgs=1128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3214896320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79a5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 -- 172.21.15.70:0/3214896320 >> 172.21.15.70:0/3214896320 conn(0x5612b796e310 msgr2=0x5612b79a1c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 -- 172.21.15.70:0/3214896320 shutdown_connections 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 -- 172.21.15.70:0/3214896320 wait complete. 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 -- start start 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.291+0000 7f47b9e96740 1 Processor -- start 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a55d0 0x5612b79afda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a6b40 0x5612b79ad050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79b0370 0x5612b79ad7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b9e96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5612b79b3070 con 0x5612b79a6b40 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b9e96740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5612b78c6060 con 0x5612b79b0370 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b9e96740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5612b79b31f0 con 0x5612b79a55d0 2024-09-19T04:38:44.298 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b9e96740 10 client.0 _ll_register_callbacks cb 0x5612b76198c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a6b40 0x5612b79ad050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a6b40 0x5612b79ad050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34896/0 (socket says 172.21.15.70:34896) 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 -- 172.21.15.70:0/2952032906 learned_addr learned my addr 172.21.15.70:0/2952032906 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5058640 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a55d0 0x5612b79afda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 -- 172.21.15.70:0/2952032906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a55d0 msgr2=0x5612b79afda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5058640 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79b0370 0x5612b79ad7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a55d0 0x5612b79afda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 -- 172.21.15.70:0/2952032906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79b0370 msgr2=0x5612b79ad7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79b0370 0x5612b79ad7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 -- 172.21.15.70:0/2952032906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612b767c3c0 con 0x5612b79a6b40 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47b5859640 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a6b40 0x5612b79ad050 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f47a401cbb0 tx=0x7f47a400be70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=797374e930371a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:44.299 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47997fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.292+0000 7f47997fa640 1 -- 172.21.15.70:0/2952032906 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a401ce60 con 0x5612b79a6b40 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47997fa640 1 -- 172.21.15.70:0/2952032906 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f47a401c3d0 con 0x5612b79a6b40 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 1 -- 172.21.15.70:0/2952032906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47a4014e50 con 0x5612b79a6b40 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47997fa640 1 -- 172.21.15.70:0/2952032906 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f47a4033050 con 0x5612b79a6b40 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 10 client.17640 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 1 -- 172.21.15.70:0/2952032906 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5612b79beac0 con 0x5612b79a6b40 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47997fa640 1 -- 172.21.15.70:0/2952032906 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f47a4014e50 con 0x5612b79a6b40 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47997fa640 1 -- 172.21.15.70:0/2952032906 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f47a4005340 con 0x5612b79a6b40 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 10 client.17640 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 10 client.17640 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 20 client.17640 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5612b79bfec0 0x5612b79c22b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.300 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 4 client.17640 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:44.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b9e96740 1 -- 172.21.15.70:0/2952032906 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5612b7918860 con 0x5612b79bfec0 2024-09-19T04:38:44.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.293+0000 7f47b5058640 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5612b79bfec0 0x5612b79c22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.294+0000 7f47997fa640 10 client.17640 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:44.301 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.294+0000 7f47b5058640 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5612b79bfec0 0x5612b79c22b0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e2c94f3e11c15caf server_cookie=3b5957fedfdbace3 in_seq=0 out_seq=0 2024-09-19T04:38:44.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47997fa640 1 -- 172.21.15.70:0/2952032906 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5612b7918860 con 0x5612b79bfec0 2024-09-19T04:38:44.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47997fa640 10 client.17640 handle_command_reply: tid=0 2024-09-19T04:38:44.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 client.17640 shutdown 2024-09-19T04:38:44.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 -- 172.21.15.70:0/2952032906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a6b40 msgr2=0x5612b79ad050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a6b40 0x5612b79ad050 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f47a401cbb0 tx=0x7f47a400be70 comp rx=0 tx=0).stop 2024-09-19T04:38:44.302 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 -- 172.21.15.70:0/2952032906 shutdown_connections 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5612b79bfec0 0x5612b79c22b0 crc :-1 s=READY pgs=186 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79b0370 0x5612b79ad7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a6b40 0x5612b79ad050 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47997fa640 0 client.17640 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2952032906 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a55d0 0x5612b79afda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 -- 172.21.15.70:0/2952032906 >> 172.21.15.70:0/2952032906 conn(0x5612b796e310 msgr2=0x5612b79a7960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 -- 172.21.15.70:0/2952032906 shutdown_connections 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 1 -- 172.21.15.70:0/2952032906 wait complete. 2024-09-19T04:38:44.303 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.295+0000 7f47b9e96740 20 client.17640 trim_cache size 0 max 16384 2024-09-19T04:38:44.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b9e96740 1 Processor -- start 2024-09-19T04:38:44.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b9e96740 1 -- start start 2024-09-19T04:38:44.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a55d0 0x5612b79abf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a6b40 0x5612b79c7910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79b0370 0x5612b79c7e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.310 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b9e96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01adfd0 con 0x5612b79b0370 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b9e96740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01ab8a0 con 0x5612b79a55d0 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b9e96740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01a9710 con 0x5612b79a6b40 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5058640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79b0370 0x5612b79c7e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5058640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79b0370 0x5612b79c7e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34906/0 (socket says 172.21.15.70:34906) 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5058640 1 -- 172.21.15.70:0/2590674 learned_addr learned my addr 172.21.15.70:0/2590674 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5859640 1 --2- 172.21.15.70:0/2590674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a6b40 0x5612b79c7910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5058640 1 -- 172.21.15.70:0/2590674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a6b40 msgr2=0x5612b79c7910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5058640 1 --2- 172.21.15.70:0/2590674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a6b40 0x5612b79c7910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5058640 1 -- 172.21.15.70:0/2590674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a55d0 msgr2=0x5612b79abf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5058640 1 --2- 172.21.15.70:0/2590674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a55d0 0x5612b79abf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.308+0000 7f47b5058640 1 -- 172.21.15.70:0/2590674 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612b79a1510 con 0x5612b79b0370 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b5058640 1 --2- 172.21.15.70:0/2590674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79b0370 0x5612b79c7e50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f47ac02a9a0 tx=0x7f47ac005b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5dc93911149365c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f479b7fe640 1 -- 172.21.15.70:0/2590674 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac04a020 con 0x5612b79b0370 2024-09-19T04:38:44.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f479b7fe640 1 -- 172.21.15.70:0/2590674 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f47ac004460 con 0x5612b79b0370 2024-09-19T04:38:44.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f479b7fe640 1 -- 172.21.15.70:0/2590674 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac035040 con 0x5612b79b0370 2024-09-19T04:38:44.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 -- 172.21.15.70:0/2590674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79b0370 msgr2=0x5612b79c7e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2590674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79b0370 0x5612b79c7e50 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f47ac02a9a0 tx=0x7f47ac005b50 comp rx=0 tx=0).stop 2024-09-19T04:38:44.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 -- 172.21.15.70:0/2590674 shutdown_connections 2024-09-19T04:38:44.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2590674 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79b0370 0x5612b79c7e50 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2590674 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79a6b40 0x5612b79c7910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 --2- 172.21.15.70:0/2590674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a55d0 0x5612b79abf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 -- 172.21.15.70:0/2590674 >> 172.21.15.70:0/2590674 conn(0x5612b796e310 msgr2=0x5612b79ab810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 -- 172.21.15.70:0/2590674 shutdown_connections 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.309+0000 7f47b9e96740 1 -- 172.21.15.70:0/2590674 wait complete. 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 1 -- start start 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 1 Processor -- start 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79aa040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79aa580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 0x5612b79aaac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01a9d60 con 0x5612b79a55d0 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01ab1d0 con 0x5612b79a6b40 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01aa430 con 0x5612b79b0370 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b9e96740 10 client.0 _ll_register_callbacks cb 0x7f47b006b7f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:44.316 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b5058640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79aa040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b5058640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79aa040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34918/0 (socket says 172.21.15.70:34918) 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.310+0000 7f47b5058640 1 -- 172.21.15.70:0/3186860981 learned_addr learned my addr 172.21.15.70:0/3186860981 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b5859640 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79aa580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b5058640 1 -- 172.21.15.70:0/3186860981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 msgr2=0x5612b79aaac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b5058640 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 0x5612b79aaac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b5058640 1 -- 172.21.15.70:0/3186860981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 msgr2=0x5612b79aa580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b5058640 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79aa580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b5058640 1 -- 172.21.15.70:0/3186860981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612b7a298e0 con 0x5612b79a55d0 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b5058640 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79aa040 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0092c0 tx=0x7f47ac0043c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d7e1f9ab0dc9da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47997fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47997fa640 1 -- 172.21.15.70:0/3186860981 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47ac053030 con 0x5612b79a55d0 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b9e96740 1 -- 172.21.15.70:0/3186860981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47ac004460 con 0x5612b79a55d0 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47997fa640 1 -- 172.21.15.70:0/3186860981 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f47ac0318a0 con 0x5612b79a55d0 2024-09-19T04:38:44.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47997fa640 1 -- 172.21.15.70:0/3186860981 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f47ac04a050 con 0x5612b79a55d0 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b9e96740 10 client.17646 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b9e96740 1 -- 172.21.15.70:0/3186860981 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5612b7a2ab80 con 0x5612b79a55d0 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47997fa640 1 -- 172.21.15.70:0/3186860981 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f47ac004460 con 0x5612b79a55d0 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47997fa640 1 -- 172.21.15.70:0/3186860981 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f47ac03a040 con 0x5612b79a55d0 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b9e96740 10 client.17646 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b9e96740 10 client.17646 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b9e96740 20 client.17646 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5612b7a2b1f0 0x5612b7a2d610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.311+0000 7f47b9e96740 4 client.17646 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.312+0000 7f47b9e96740 1 -- 172.21.15.70:0/3186860981 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5612b7912d70 con 0x5612b7a2b1f0 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.312+0000 7f47b5859640 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5612b7a2b1f0 0x5612b7a2d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.312+0000 7f47b5859640 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5612b7a2b1f0 0x5612b7a2d610 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=778c43dfd549019f server_cookie=38e534083be2219e in_seq=0 out_seq=0 2024-09-19T04:38:44.318 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.312+0000 7f47997fa640 10 client.17646 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.312+0000 7f47997fa640 1 -- 172.21.15.70:0/3186860981 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5612b7912d70 con 0x5612b7a2b1f0 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.312+0000 7f47997fa640 10 client.17646 handle_command_reply: tid=0 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 client.17646 shutdown 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 -- 172.21.15.70:0/3186860981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 msgr2=0x5612b79aa040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79aa040 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f47ac0092c0 tx=0x7f47ac0043c0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 -- 172.21.15.70:0/3186860981 shutdown_connections 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5612b7a2b1f0 0x5612b7a2d610 crc :-1 s=READY pgs=187 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5612b79b0370 0x5612b79aaac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5612b79a6b40 0x5612b79aa580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 --2- 172.21.15.70:0/3186860981 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5612b79a55d0 0x5612b79aa040 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47997fa640 0 client.17646 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 -- 172.21.15.70:0/3186860981 >> 172.21.15.70:0/3186860981 conn(0x5612b796e310 msgr2=0x5612b79a0d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:44.319 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 -- 172.21.15.70:0/3186860981 shutdown_connections 2024-09-19T04:38:44.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 1 -- 172.21.15.70:0/3186860981 wait complete. 2024-09-19T04:38:44.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b9e96740 20 client.17646 trim_cache size 0 max 16384 2024-09-19T04:38:44.320 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:44.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 -- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f479c0a33b0 msgr2=0x7f479c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.320 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f479c0a33b0 0x7f479c0a5870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f47a80ccbb0 tx=0x7f47a8004a40 comp rx=0 tx=0).stop 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 -- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b010c170 msgr2=0x7f47b019cd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b010c170 0x7f47b019cd70 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7f47a800b970 tx=0x7f47a800be30 comp rx=0 tx=0).stop 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 -- 172.21.15.70:0/3503945443 shutdown_connections 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f479c0a33b0 0x7f479c0a5870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f47b010c170 0x7f47b019cd70 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f47b0103660 0x7f47b01989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 --2- 172.21.15.70:0/3503945443 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f47b0102d40 0x7f47b01984a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.313+0000 7f47b7abd640 1 -- 172.21.15.70:0/3503945443 >> 172.21.15.70:0/3503945443 conn(0x7f47b00fc7a0 msgr2=0x7f47b00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.314+0000 7f47b7abd640 1 -- 172.21.15.70:0/3503945443 shutdown_connections 2024-09-19T04:38:44.321 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:44.314+0000 7f47b7abd640 1 -- 172.21.15.70:0/3503945443 wait complete. 2024-09-19T04:38:45.018 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:44 smithi070 ceph-mon[30942]: pgmap v246: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:44 smithi134 ceph-mon[34525]: pgmap v246: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:45.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:44 smithi167 ceph-mon[34339]: pgmap v246: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:46.049 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:38:46.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:38:46.307 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:46.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 -- 172.21.15.70:0/3691762734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c100e20 msgr2=0x7f396c101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 --2- 172.21.15.70:0/3691762734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c100e20 0x7f396c101200 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f3964009900 tx=0x7f396402a480 comp rx=0 tx=0).stop 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 -- 172.21.15.70:0/3691762734 shutdown_connections 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 --2- 172.21.15.70:0/3691762734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396c102ef0 0x7f396c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 --2- 172.21.15.70:0/3691762734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396c102570 0x7f396c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 --2- 172.21.15.70:0/3691762734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c100e20 0x7f396c101200 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 -- 172.21.15.70:0/3691762734 >> 172.21.15.70:0/3691762734 conn(0x7f396c0fc7d0 msgr2=0x7f396c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 -- 172.21.15.70:0/3691762734 shutdown_connections 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.754+0000 7f397380d640 1 -- 172.21.15.70:0/3691762734 wait complete. 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f397380d640 1 Processor -- start 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f397380d640 1 -- start start 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f397380d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396c100e20 0x7f396c0fcc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f397380d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c102570 0x7f396c0fd1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f397380d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396c102ef0 0x7f396c0fd700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f397380d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f396c110f90 con 0x7f396c102570 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f397380d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f396c110e10 con 0x7f396c102ef0 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f397380d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f396c111110 con 0x7f396c100e20 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3970da8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c102570 0x7f396c0fd1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3970da8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c102570 0x7f396c0fd1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34942/0 (socket says 172.21.15.70:34942) 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3970da8640 1 -- 172.21.15.70:0/4298394 learned_addr learned my addr 172.21.15.70:0/4298394 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3971daa640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396c102ef0 0x7f396c0fd700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f39715a9640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396c100e20 0x7f396c0fcc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3970da8640 1 -- 172.21.15.70:0/4298394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396c100e20 msgr2=0x7f396c0fcc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3970da8640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396c100e20 0x7f396c0fcc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3970da8640 1 -- 172.21.15.70:0/4298394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396c102ef0 msgr2=0x7f396c0fd700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3970da8640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396c102ef0 0x7f396c0fd700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f3970da8640 1 -- 172.21.15.70:0/4298394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f396c1a69c0 con 0x7f396c102570 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.755+0000 7f39715a9640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396c100e20 0x7f396c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.756+0000 7f3970da8640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c102570 0x7f396c0fd1c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f396000cce0 tx=0x7f396000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.756+0000 7f396a7fc640 1 -- 172.21.15.70:0/4298394 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3960004b20 con 0x7f396c102570 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.756+0000 7f397380d640 1 -- 172.21.15.70:0/4298394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f396c1a6cb0 con 0x7f396c102570 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.756+0000 7f396a7fc640 1 -- 172.21.15.70:0/4298394 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3960004cc0 con 0x7f396c102570 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.756+0000 7f396a7fc640 1 -- 172.21.15.70:0/4298394 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396000f740 con 0x7f396c102570 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.756+0000 7f397380d640 1 -- 172.21.15.70:0/4298394 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f396c1a71a0 con 0x7f396c102570 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.758+0000 7f396a7fc640 1 -- 172.21.15.70:0/4298394 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3960005020 con 0x7f396c102570 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.758+0000 7f3975be6740 1 Processor -- start 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.758+0000 7f3975be6740 1 -- start start 2024-09-19T04:38:46.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3975be6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdf5f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f396a7fc640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39540a33b0 0x7f39540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3975be6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe00800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3975be6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 0x55676fe03130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3975be6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55676fd5b280 con 0x55676fdf5b60 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3975be6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55676fd02b10 con 0x55676fe00d40 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3975be6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55676fd57240 con 0x55676fdf6480 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdf5f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdf5f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34954/0 (socket says 172.21.15.70:34954) 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f39715a9640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39540a33b0 0x7f39540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 -- 172.21.15.70:0/2157373564 learned_addr learned my addr 172.21.15.70:0/2157373564 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f396a7fc640 1 -- 172.21.15.70:0/4298394 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f39600cfdc0 con 0x7f396c102570 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3970da8640 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe00800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 0x55676fe03130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 -- 172.21.15.70:0/2157373564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 msgr2=0x55676fe00800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe00800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 -- 172.21.15.70:0/2157373564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 msgr2=0x55676fe03130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 0x55676fe03130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 -- 172.21.15.70:0/2157373564 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55676fd0f1f0 con 0x55676fdf5b60 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3970da8640 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe00800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f39715a9640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39540a33b0 0x7f39540a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3964031440 tx=0x7f3964031d50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.759+0000 7f3971daa640 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdf5f40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f395c009f50 tx=0x7f395c009540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6c0c8e25a897628 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f39537fe640 1 -- 172.21.15.70:0/2157373564 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c017610 con 0x55676fdf5b60 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f39537fe640 1 -- 172.21.15.70:0/2157373564 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f395c01c070 con 0x55676fdf5b60 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f39537fe640 1 -- 172.21.15.70:0/2157373564 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c015930 con 0x55676fdf5b60 2024-09-19T04:38:46.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 -- 172.21.15.70:0/2157373564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 msgr2=0x55676fdf5f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdf5f40 secure :-1 s=READY pgs=1134 cs=0 l=1 rev1=1 crypto rx=0x7f395c009f50 tx=0x7f395c009540 comp rx=0 tx=0).stop 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 -- 172.21.15.70:0/2157373564 shutdown_connections 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 0x55676fe03130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe00800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 --2- 172.21.15.70:0/2157373564 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdf5f40 unknown :-1 s=CLOSED pgs=1134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 -- 172.21.15.70:0/2157373564 >> 172.21.15.70:0/2157373564 conn(0x55676fdf20f0 msgr2=0x55676fdf24d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 -- 172.21.15.70:0/2157373564 shutdown_connections 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.760+0000 7f3975be6740 1 -- 172.21.15.70:0/2157373564 wait complete. 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 1 -- start start 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 1 Processor -- start 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fe007c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fdfdb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fe00d40 0x55676fdfe250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55676fe03910 con 0x55676fdf5b60 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55676fd15f10 con 0x55676fdf6480 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55676fe03a90 con 0x55676fe00d40 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3975be6740 10 client.0 _ll_register_callbacks cb 0x55676fcdea40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f39715a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fe007c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f39715a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fe007c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34960/0 (socket says 172.21.15.70:34960) 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f39715a9640 1 -- 172.21.15.70:0/1405423192 learned_addr learned my addr 172.21.15.70:0/1405423192 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3971daa640 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fe00d40 0x55676fdfe250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.761+0000 7f3970da8640 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fdfdb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f39715a9640 1 -- 172.21.15.70:0/1405423192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fe00d40 msgr2=0x55676fdfe250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:46.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f39715a9640 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fe00d40 0x55676fdfe250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f39715a9640 1 -- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 msgr2=0x55676fdfdb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f39715a9640 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fdfdb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f39715a9640 1 -- 172.21.15.70:0/1405423192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55676facc6a0 con 0x55676fdf5b60 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3970da8640 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fdfdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f39715a9640 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fe007c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f3964033000 tx=0x7f3964009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8b4018200edba8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3950ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3950ff9640 1 -- 172.21.15.70:0/1405423192 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396404d020 con 0x55676fdf5b60 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3950ff9640 1 -- 172.21.15.70:0/1405423192 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f39640037f0 con 0x55676fdf5b60 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3975be6740 1 -- 172.21.15.70:0/1405423192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f395c01c070 con 0x55676fdf5b60 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3950ff9640 1 -- 172.21.15.70:0/1405423192 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f3964058050 con 0x55676fdf5b60 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3975be6740 10 client.17658 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3975be6740 1 -- 172.21.15.70:0/1405423192 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55676fe0f430 con 0x55676fdf5b60 2024-09-19T04:38:46.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3950ff9640 1 -- 172.21.15.70:0/1405423192 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f395c01c070 con 0x55676fdf5b60 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.762+0000 7f3950ff9640 1 -- 172.21.15.70:0/1405423192 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f3964049bc0 con 0x55676fdf5b60 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3975be6740 10 client.17658 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3975be6740 10 client.17658 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3975be6740 20 client.17658 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3975be6740 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55676fe10940 0x55676fe12de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3975be6740 4 client.17658 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3975be6740 1 -- 172.21.15.70:0/1405423192 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55676fd687f0 con 0x55676fe10940 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3970da8640 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55676fe10940 0x55676fe12de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3950ff9640 10 client.17658 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.763+0000 7f3970da8640 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55676fe10940 0x55676fe12de0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=94fba3b95587a47c server_cookie=a7078994a3977af2 in_seq=0 out_seq=0 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3950ff9640 1 -- 172.21.15.70:0/1405423192 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55676fd687f0 con 0x55676fe10940 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3950ff9640 10 client.17658 handle_command_reply: tid=0 2024-09-19T04:38:46.780 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 client.17658 shutdown 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 -- 172.21.15.70:0/1405423192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 msgr2=0x55676fe007c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fe007c0 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7f3964033000 tx=0x7f3964009260 comp rx=0 tx=0).stop 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 -- 172.21.15.70:0/1405423192 shutdown_connections 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55676fe10940 0x55676fe12de0 crc :-1 s=READY pgs=188 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fe00d40 0x55676fdfe250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fdfdb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3950ff9640 0 client.17658 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 --2- 172.21.15.70:0/1405423192 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fe007c0 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 -- 172.21.15.70:0/1405423192 >> 172.21.15.70:0/1405423192 conn(0x55676fdf20f0 msgr2=0x55676fdf7dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 -- 172.21.15.70:0/1405423192 shutdown_connections 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 1 -- 172.21.15.70:0/1405423192 wait complete. 2024-09-19T04:38:46.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.764+0000 7f3975be6740 20 client.17658 trim_cache size 0 max 16384 2024-09-19T04:38:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.781+0000 7f3975be6740 1 Processor -- start 2024-09-19T04:38:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.781+0000 7f3975be6740 1 -- start start 2024-09-19T04:38:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3975be6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdfca70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3975be6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe0cba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3975be6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 0x55676fe186b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3975be6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1b23e0 con 0x55676fdf5b60 2024-09-19T04:38:46.784 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3975be6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1afcb0 con 0x55676fe00d40 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3975be6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1adb20 con 0x55676fdf6480 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdfca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdfca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34968/0 (socket says 172.21.15.70:34968) 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 -- 172.21.15.70:0/1121619521 learned_addr learned my addr 172.21.15.70:0/1121619521 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3970da8640 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe0cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3971daa640 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 0x55676fe186b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 -- 172.21.15.70:0/1121619521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 msgr2=0x55676fe0cba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe0cba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 -- 172.21.15.70:0/1121619521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 msgr2=0x55676fe186b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 0x55676fe186b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 -- 172.21.15.70:0/1121619521 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55676fdf62b0 con 0x55676fdf5b60 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f39715a9640 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdfca70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f3964009230 tx=0x7f3964031a50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=322755f12059e168 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:46.785 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.782+0000 7f3952ffd640 1 -- 172.21.15.70:0/1121619521 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3964062020 con 0x55676fdf5b60 2024-09-19T04:38:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3952ffd640 1 -- 172.21.15.70:0/1121619521 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f396403c800 con 0x55676fdf5b60 2024-09-19T04:38:46.786 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3952ffd640 1 -- 172.21.15.70:0/1121619521 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f396404d040 con 0x55676fdf5b60 2024-09-19T04:38:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 -- 172.21.15.70:0/1121619521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 msgr2=0x55676fdfca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdfca70 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7f3964009230 tx=0x7f3964031a50 comp rx=0 tx=0).stop 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 -- 172.21.15.70:0/1121619521 shutdown_connections 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fe00d40 0x55676fe186b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf6480 0x55676fe0cba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 --2- 172.21.15.70:0/1121619521 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fdf5b60 0x55676fdfca70 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 -- 172.21.15.70:0/1121619521 >> 172.21.15.70:0/1121619521 conn(0x55676fdf20f0 msgr2=0x55676fdffa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 -- 172.21.15.70:0/1121619521 shutdown_connections 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 -- 172.21.15.70:0/1121619521 wait complete. 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.783+0000 7f3975be6740 1 -- start start 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3975be6740 1 Processor -- start 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3975be6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf5b60 0x55676fe09040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3975be6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fe09580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3975be6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fe00d40 0x55676fe03e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3975be6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1ae170 con 0x55676fe00d40 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3975be6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1af5e0 con 0x55676fdf6480 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3975be6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f396c1ae840 con 0x55676fdf5b60 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3975be6740 10 client.0 _ll_register_callbacks cb 0x7f3964040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3971daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fe00d40 0x55676fe03e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3971daa640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fe00d40 0x55676fe03e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34978/0 (socket says 172.21.15.70:34978) 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3971daa640 1 -- 172.21.15.70:0/2220998874 learned_addr learned my addr 172.21.15.70:0/2220998874 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f39715a9640 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf5b60 0x55676fe09040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3970da8640 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fe09580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3971daa640 1 -- 172.21.15.70:0/2220998874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf5b60 msgr2=0x55676fe09040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.784+0000 7f3971daa640 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf5b60 0x55676fe09040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3971daa640 1 -- 172.21.15.70:0/2220998874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 msgr2=0x55676fe09580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3971daa640 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fe09580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3971daa640 1 -- 172.21.15.70:0/2220998874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55676fe04640 con 0x55676fe00d40 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f39715a9640 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf5b60 0x55676fe09040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3971daa640 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fe00d40 0x55676fe03e10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f395c004810 tx=0x7f395c0091d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed583412be3dd4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3950ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3950ff9640 1 -- 172.21.15.70:0/2220998874 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f395c02c020 con 0x55676fe00d40 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3950ff9640 1 -- 172.21.15.70:0/2220998874 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f395c015840 con 0x55676fe00d40 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3975be6740 1 -- 172.21.15.70:0/2220998874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f396403c800 con 0x55676fe00d40 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3950ff9640 1 -- 172.21.15.70:0/2220998874 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f395c037050 con 0x55676fe00d40 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3975be6740 10 client.17664 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3975be6740 1 -- 172.21.15.70:0/2220998874 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55676fe7c320 con 0x55676fe00d40 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3950ff9640 1 -- 172.21.15.70:0/2220998874 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f396403c800 con 0x55676fe00d40 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3950ff9640 1 -- 172.21.15.70:0/2220998874 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f395c0179d0 con 0x55676fe00d40 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3975be6740 10 client.17664 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:46.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3975be6740 10 client.17664 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.785+0000 7f3975be6740 20 client.17664 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.786+0000 7f3975be6740 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55676fe7c750 0x55676fe7eb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.786+0000 7f3975be6740 4 client.17664 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.786+0000 7f3975be6740 1 -- 172.21.15.70:0/2220998874 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55676fd62d00 con 0x55676fe7c750 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.786+0000 7f39715a9640 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55676fe7c750 0x55676fe7eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.786+0000 7f3950ff9640 10 client.17664 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.786+0000 7f39715a9640 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55676fe7c750 0x55676fe7eb70 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f49283672b9b7dc7 server_cookie=700eedc8880010a5 in_seq=0 out_seq=0 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3950ff9640 1 -- 172.21.15.70:0/2220998874 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55676fd62d00 con 0x55676fe7c750 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3950ff9640 10 client.17664 handle_command_reply: tid=0 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 client.17664 shutdown 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 -- 172.21.15.70:0/2220998874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fe00d40 msgr2=0x55676fe03e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fe00d40 0x55676fe03e10 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f395c004810 tx=0x7f395c0091d0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 -- 172.21.15.70:0/2220998874 shutdown_connections 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55676fe7c750 0x55676fe7eb70 crc :-1 s=READY pgs=189 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55676fe00d40 0x55676fe03e10 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55676fdf6480 0x55676fe09580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 --2- 172.21.15.70:0/2220998874 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55676fdf5b60 0x55676fe09040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3975be6740 1 -- 172.21.15.70:0/2220998874 >> 172.21.15.70:0/2220998874 conn(0x55676fdf20f0 msgr2=0x55676fdf75b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.787+0000 7f3950ff9640 0 client.17664 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f3975be6740 1 -- 172.21.15.70:0/2220998874 shutdown_connections 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f3975be6740 1 -- 172.21.15.70:0/2220998874 wait complete. 2024-09-19T04:38:46.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f3975be6740 20 client.17664 trim_cache size 0 max 16384 2024-09-19T04:38:46.795 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:38:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "c02a9a8f-1ea1-433e-8c43-c613bddef9aa", 2024-09-19T04:38:46.795 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:38:46.795 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:46.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 -- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39540a33b0 msgr2=0x7f39540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39540a33b0 0x7f39540a5870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3964031440 tx=0x7f3964031d50 comp rx=0 tx=0).stop 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 -- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c102570 msgr2=0x7f396c0fd1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c102570 0x7f396c0fd1c0 secure :-1 s=READY pgs=1133 cs=0 l=1 rev1=1 crypto rx=0x7f396000cce0 tx=0x7f396000a620 comp rx=0 tx=0).stop 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 -- 172.21.15.70:0/4298394 shutdown_connections 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39540a33b0 0x7f39540a5870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f396c102ef0 0x7f396c0fd700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f396c102570 0x7f396c0fd1c0 unknown :-1 s=CLOSED pgs=1133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 --2- 172.21.15.70:0/4298394 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f396c100e20 0x7f396c0fcc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 -- 172.21.15.70:0/4298394 >> 172.21.15.70:0/4298394 conn(0x7f396c0fc7d0 msgr2=0x7f396c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 -- 172.21.15.70:0/4298394 shutdown_connections 2024-09-19T04:38:46.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:46.788+0000 7f397380d640 1 -- 172.21.15.70:0/4298394 wait complete. 2024-09-19T04:38:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:46 smithi134 ceph-mon[34525]: pgmap v247: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:47.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:46 smithi070 ceph-mon[30942]: pgmap v247: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:47.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:46 smithi167 ceph-mon[34339]: pgmap v247: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:47.630 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:38:47.876 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:47.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:47 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:38:47.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:47 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:47.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:47 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:38:47.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:47 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:47.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:47 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:38:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:47 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:38:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:47 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:47 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:38:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:47 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:48.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:47 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:38:48.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:47 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:38:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:47 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:47 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:38:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:47 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:48.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:47 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:38:48.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 -- 172.21.15.70:0/833044586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100500 msgr2=0x7f48dc1008e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 --2- 172.21.15.70:0/833044586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100500 0x7f48dc1008e0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f48cc009900 tx=0x7f48cc02a410 comp rx=0 tx=0).stop 2024-09-19T04:38:48.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 -- 172.21.15.70:0/833044586 shutdown_connections 2024-09-19T04:38:48.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 --2- 172.21.15.70:0/833044586 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48dc106f70 0x7f48dc10eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 --2- 172.21.15.70:0/833044586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc100eb0 0x7f48dc106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.362 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 --2- 172.21.15.70:0/833044586 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100500 0x7f48dc1008e0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 -- 172.21.15.70:0/833044586 >> 172.21.15.70:0/833044586 conn(0x7f48dc0fc5c0 msgr2=0x7f48dc0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 -- 172.21.15.70:0/833044586 shutdown_connections 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 -- 172.21.15.70:0/833044586 wait complete. 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.326+0000 7f48e1914640 1 Processor -- start 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48e1914640 1 -- start start 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48e1914640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48dc100500 0x7f48dc198520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48e1914640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100eb0 0x7f48dc198a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48e1914640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc106f70 0x7f48dc19cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48e1914640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc111fe0 con 0x7f48dc100eb0 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48e1914640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc111e60 con 0x7f48dc106f70 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48e1914640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc112160 con 0x7f48dc100500 2024-09-19T04:38:48.363 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100eb0 0x7f48dc198a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100eb0 0x7f48dc198a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34986/0 (socket says 172.21.15.70:34986) 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 -- 172.21.15.70:0/2687156704 learned_addr learned my addr 172.21.15.70:0/2687156704 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48daffd640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48dc100500 0x7f48dc198520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48db7fe640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc106f70 0x7f48dc19cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 -- 172.21.15.70:0/2687156704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48dc100500 msgr2=0x7f48dc198520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48dc100500 0x7f48dc198520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 -- 172.21.15.70:0/2687156704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc106f70 msgr2=0x7f48dc19cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc106f70 0x7f48dc19cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 -- 172.21.15.70:0/2687156704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f48dc19d4d0 con 0x7f48dc100eb0 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.327+0000 7f48da7fc640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100eb0 0x7f48dc198a60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f48c4006fd0 tx=0x7f48c400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.328+0000 7f48e0912640 1 -- 172.21.15.70:0/2687156704 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c4011830 con 0x7f48dc100eb0 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.328+0000 7f48e1914640 1 -- 172.21.15.70:0/2687156704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48dc19d7c0 con 0x7f48dc100eb0 2024-09-19T04:38:48.364 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.328+0000 7f48e0912640 1 -- 172.21.15.70:0/2687156704 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f48c4016070 con 0x7f48dc100eb0 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.328+0000 7f48e0912640 1 -- 172.21.15.70:0/2687156704 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c400f2e0 con 0x7f48dc100eb0 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.328+0000 7f48e1914640 1 -- 172.21.15.70:0/2687156704 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48dc1a50a0 con 0x7f48dc100eb0 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.330+0000 7f48e0912640 1 -- 172.21.15.70:0/2687156704 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f48c40119d0 con 0x7f48dc100eb0 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e3ced740 1 Processor -- start 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e3ced740 1 -- start start 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4881c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 0x55ed48827140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48827680 0x55ed48829a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e3ced740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ed487822e0 con 0x55ed4881c4a0 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e3ced740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ed48729ce0 con 0x55ed48827680 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e3ced740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ed4877e2a0 con 0x55ed4881cdc0 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4881c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.365 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4881c880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:34998/0 (socket says 172.21.15.70:34998) 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 -- 172.21.15.70:0/2669937210 learned_addr learned my addr 172.21.15.70:0/2669937210 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48daffd640 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 0x55ed48827140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 -- 172.21.15.70:0/2669937210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 msgr2=0x55ed48827140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 0x55ed48827140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 -- 172.21.15.70:0/2669937210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48827680 msgr2=0x55ed48829a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48da7fc640 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48827680 0x55ed48829a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48827680 0x55ed48829a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e0912640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f48c80a33b0 0x7f48c80a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 -- 172.21.15.70:0/2669937210 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed4870e440 con 0x55ed4881c4a0 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48daffd640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f48c80a33b0 0x7f48c80a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48db7fe640 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4881c880 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009df0 tx=0x7f48d400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ffacb48348655eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.331+0000 7f48e0912640 1 -- 172.21.15.70:0/2687156704 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f48c40cf340 con 0x7f48dc100eb0 2024-09-19T04:38:48.366 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48d1ffb640 1 -- 172.21.15.70:0/2669937210 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4003970 con 0x55ed4881c4a0 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48d1ffb640 1 -- 172.21.15.70:0/2669937210 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f48d4004030 con 0x55ed4881c4a0 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48d1ffb640 1 -- 172.21.15.70:0/2669937210 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48d4011840 con 0x55ed4881c4a0 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 -- 172.21.15.70:0/2669937210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 msgr2=0x55ed4881c880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48daffd640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f48c80a33b0 0x7f48c80a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0314b0 tx=0x7f48cc0058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4881c880 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009df0 tx=0x7f48d400f730 comp rx=0 tx=0).stop 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 -- 172.21.15.70:0/2669937210 shutdown_connections 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48827680 0x55ed48829a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 0x55ed48827140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 --2- 172.21.15.70:0/2669937210 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4881c880 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 -- 172.21.15.70:0/2669937210 >> 172.21.15.70:0/2669937210 conn(0x55ed48818a30 msgr2=0x55ed48818e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 -- 172.21.15.70:0/2669937210 shutdown_connections 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.332+0000 7f48e3ced740 1 -- 172.21.15.70:0/2669937210 wait complete. 2024-09-19T04:38:48.367 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 1 -- start start 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 1 Processor -- start 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed48826f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 0x55ed488241e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed48827680 0x55ed48824720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ed4882a250 con 0x55ed4881c4a0 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ed4873d050 con 0x55ed4881cdc0 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ed4882a3d0 con 0x55ed48827680 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48e3ced740 10 client.0 _ll_register_callbacks cb 0x55ed4877d160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed48826f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed48826f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35014/0 (socket says 172.21.15.70:35014) 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.333+0000 7f48daffd640 1 -- 172.21.15.70:0/1530882972 learned_addr learned my addr 172.21.15.70:0/1530882972 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48da7fc640 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 0x55ed488241e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.368 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48db7fe640 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed48827680 0x55ed48824720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48daffd640 1 -- 172.21.15.70:0/1530882972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed48827680 msgr2=0x55ed48824720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48daffd640 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed48827680 0x55ed48824720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48daffd640 1 -- 172.21.15.70:0/1530882972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 msgr2=0x55ed488241e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48daffd640 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 0x55ed488241e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48daffd640 1 -- 172.21.15.70:0/1530882972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed484f33c0 con 0x55ed4881c4a0 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48daffd640 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed48826f30 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f48cc033000 tx=0x7f48cc009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47cfbc6c0f790b7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48baffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48baffd640 1 -- 172.21.15.70:0/1530882972 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc04c070 con 0x55ed4881c4a0 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48baffd640 1 -- 172.21.15.70:0/1530882972 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f48cc005040 con 0x55ed4881c4a0 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48e3ced740 1 -- 172.21.15.70:0/1530882972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48d4004030 con 0x55ed4881c4a0 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48baffd640 1 -- 172.21.15.70:0/1530882972 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f48cc058050 con 0x55ed4881c4a0 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48e3ced740 10 client.17676 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:48.369 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48e3ced740 1 -- 172.21.15.70:0/1530882972 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ed48835b70 con 0x55ed4881c4a0 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.334+0000 7f48baffd640 1 -- 172.21.15.70:0/1530882972 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f48d4004030 con 0x55ed4881c4a0 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48baffd640 1 -- 172.21.15.70:0/1530882972 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f48cc0035f0 con 0x55ed4881c4a0 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48e3ced740 10 client.17676 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48e3ced740 10 client.17676 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48e3ced740 20 client.17676 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48e3ced740 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ed48836f80 0x55ed488393f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48e3ced740 4 client.17676 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48e3ced740 1 -- 172.21.15.70:0/1530882972 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ed4878f850 con 0x55ed48836f80 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48da7fc640 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ed48836f80 0x55ed488393f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48baffd640 10 client.17676 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.335+0000 7f48da7fc640 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ed48836f80 0x55ed488393f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=974a7fc25aebdc74 server_cookie=b534f4107a35c555 in_seq=0 out_seq=0 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48baffd640 1 -- 172.21.15.70:0/1530882972 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ed4878f850 con 0x55ed48836f80 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48baffd640 10 client.17676 handle_command_reply: tid=0 2024-09-19T04:38:48.370 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 client.17676 shutdown 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 -- 172.21.15.70:0/1530882972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 msgr2=0x55ed48826f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed48826f30 secure :-1 s=READY pgs=1141 cs=0 l=1 rev1=1 crypto rx=0x7f48cc033000 tx=0x7f48cc009260 comp rx=0 tx=0).stop 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 -- 172.21.15.70:0/1530882972 shutdown_connections 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ed48836f80 0x55ed488393f0 crc :-1 s=READY pgs=190 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed48827680 0x55ed48824720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 0x55ed488241e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 --2- 172.21.15.70:0/1530882972 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed48826f30 unknown :-1 s=CLOSED pgs=1141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 -- 172.21.15.70:0/1530882972 >> 172.21.15.70:0/1530882972 conn(0x55ed48818a30 msgr2=0x55ed4881e710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48baffd640 0 client.17676 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 -- 172.21.15.70:0/1530882972 shutdown_connections 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.336+0000 7f48e3ced740 1 -- 172.21.15.70:0/1530882972 wait complete. 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.337+0000 7f48e3ced740 20 client.17676 trim_cache size 0 max 16384 2024-09-19T04:38:48.371 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.353+0000 7f48e3ced740 1 Processor -- start 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.353+0000 7f48e3ced740 1 -- start start 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.353+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed48818a30 0x55ed4883ed10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.353+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881c4a0 0x55ed4883f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.353+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 0x55ed48821440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.353+0000 7f48e3ced740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1b0230 con 0x55ed48818a30 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48e3ced740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1adb00 con 0x55ed4881cdc0 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48e3ced740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1ab970 con 0x55ed4881c4a0 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed48818a30 0x55ed4883ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed48818a30 0x55ed4883ed10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35026/0 (socket says 172.21.15.70:35026) 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 -- 172.21.15.70:0/3318602493 learned_addr learned my addr 172.21.15.70:0/3318602493 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:48.372 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48db7fe640 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 0x55ed48821440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48da7fc640 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881c4a0 0x55ed4883f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 -- 172.21.15.70:0/3318602493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881c4a0 msgr2=0x55ed4883f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881c4a0 0x55ed4883f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 -- 172.21.15.70:0/3318602493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 msgr2=0x55ed48821440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 0x55ed48821440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 -- 172.21.15.70:0/3318602493 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ed488182e0 con 0x55ed48818a30 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48daffd640 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed48818a30 0x55ed4883ed10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f48cc006010 tx=0x7f48cc032de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30e2b9ca26d094e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48d17fa640 1 -- 172.21.15.70:0/3318602493 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc04c070 con 0x55ed48818a30 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48d17fa640 1 -- 172.21.15.70:0/3318602493 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f48cc005500 con 0x55ed48818a30 2024-09-19T04:38:48.373 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.354+0000 7f48d17fa640 1 -- 172.21.15.70:0/3318602493 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48cc035040 con 0x55ed48818a30 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 -- 172.21.15.70:0/3318602493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed48818a30 msgr2=0x55ed4883ed10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed48818a30 0x55ed4883ed10 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7f48cc006010 tx=0x7f48cc032de0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 -- 172.21.15.70:0/3318602493 shutdown_connections 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed4881cdc0 0x55ed48821440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881c4a0 0x55ed4883f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3318602493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed48818a30 0x55ed4883ed10 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 -- 172.21.15.70:0/3318602493 >> 172.21.15.70:0/3318602493 conn(0x55ed488194b0 msgr2=0x55ed48817b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 -- 172.21.15.70:0/3318602493 shutdown_connections 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 -- 172.21.15.70:0/3318602493 wait complete. 2024-09-19T04:38:48.374 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 -- start start 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.355+0000 7f48e3ced740 1 Processor -- start 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48818a30 0x55ed4882d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4882dd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48e3ced740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 0x55ed488a0cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48e3ced740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1abfc0 con 0x55ed4881c4a0 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48e3ced740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1ad430 con 0x55ed48818a30 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48e3ced740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f48dc1ac690 con 0x55ed4881cdc0 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48e3ced740 10 client.0 _ll_register_callbacks cb 0x7f48cc009580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4882dd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4882dd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35034/0 (socket says 172.21.15.70:35034) 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 -- 172.21.15.70:0/3637170592 learned_addr learned my addr 172.21.15.70:0/3637170592 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:48.375 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48daffd640 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48818a30 0x55ed4882d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48db7fe640 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 0x55ed488a0cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 -- 172.21.15.70:0/3637170592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 msgr2=0x55ed488a0cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 0x55ed488a0cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 -- 172.21.15.70:0/3637170592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48818a30 msgr2=0x55ed4882d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48818a30 0x55ed4882d800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 -- 172.21.15.70:0/3637170592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ed4881cbf0 con 0x55ed4881c4a0 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48da7fc640 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4882dd40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f48c409b6c0 tx=0x7f48c4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eac6d4b19c5412c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48baffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48baffd640 1 -- 172.21.15.70:0/3637170592 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f48c409be30 con 0x55ed4881c4a0 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48baffd640 1 -- 172.21.15.70:0/3637170592 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f48c4099a30 con 0x55ed4881c4a0 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.356+0000 7f48e3ced740 1 -- 172.21.15.70:0/3637170592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f48cc005500 con 0x55ed4881c4a0 2024-09-19T04:38:48.376 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48baffd640 1 -- 172.21.15.70:0/3637170592 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f48c409b730 con 0x55ed4881c4a0 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48e3ced740 10 client.17682 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48e3ced740 1 -- 172.21.15.70:0/3637170592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ed488a2290 con 0x55ed4881c4a0 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48baffd640 1 -- 172.21.15.70:0/3637170592 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f48cc005500 con 0x55ed4881c4a0 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48baffd640 1 -- 172.21.15.70:0/3637170592 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f48c40ccd10 con 0x55ed4881c4a0 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48e3ced740 10 client.17682 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48e3ced740 10 client.17682 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48e3ced740 20 client.17682 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ed48827680 0x55ed488a4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48e3ced740 4 client.17682 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48e3ced740 1 -- 172.21.15.70:0/3637170592 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ed48824ab0 con 0x55ed48827680 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.357+0000 7f48daffd640 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ed48827680 0x55ed488a4a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48baffd640 10 client.17682 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:48.377 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48daffd640 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ed48827680 0x55ed488a4a00 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4eb828c3fe196c00 server_cookie=29d59da2676a66af in_seq=0 out_seq=0 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48baffd640 1 -- 172.21.15.70:0/3637170592 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ed48824ab0 con 0x55ed48827680 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48baffd640 10 client.17682 handle_command_reply: tid=0 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 client.17682 shutdown 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 -- 172.21.15.70:0/3637170592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 msgr2=0x55ed4882dd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4882dd40 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7f48c409b6c0 tx=0x7f48c4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 -- 172.21.15.70:0/3637170592 shutdown_connections 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ed48827680 0x55ed488a4a00 crc :-1 s=READY pgs=191 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48baffd640 0 client.17682 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ed4881cdc0 0x55ed488a0cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ed4881c4a0 0x55ed4882dd40 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 --2- 172.21.15.70:0/3637170592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ed48818a30 0x55ed4882d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 -- 172.21.15.70:0/3637170592 >> 172.21.15.70:0/3637170592 conn(0x55ed488194b0 msgr2=0x55ed48825a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:48.378 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 -- 172.21.15.70:0/3637170592 shutdown_connections 2024-09-19T04:38:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 1 -- 172.21.15.70:0/3637170592 wait complete. 2024-09-19T04:38:48.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.358+0000 7f48e3ced740 20 client.17682 trim_cache size 0 max 16384 2024-09-19T04:38:48.379 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:48.379 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:38:48.379 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:38:48.379 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 -- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f48c80a33b0 msgr2=0x7f48c80a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f48c80a33b0 0x7f48c80a5870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f48cc0314b0 tx=0x7f48cc0058d0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 -- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100eb0 msgr2=0x7f48dc198a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100eb0 0x7f48dc198a60 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f48c4006fd0 tx=0x7f48c400b8e0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 -- 172.21.15.70:0/2687156704 shutdown_connections 2024-09-19T04:38:48.380 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f48c80a33b0 0x7f48c80a5870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48dc106f70 0x7f48dc19cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f48dc100eb0 0x7f48dc198a60 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 --2- 172.21.15.70:0/2687156704 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f48dc100500 0x7f48dc198520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 -- 172.21.15.70:0/2687156704 >> 172.21.15.70:0/2687156704 conn(0x7f48dc0fc5c0 msgr2=0x7f48dc0fe9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 -- 172.21.15.70:0/2687156704 shutdown_connections 2024-09-19T04:38:48.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:48.359+0000 7f48e1914640 1 -- 172.21.15.70:0/2687156704 wait complete. 2024-09-19T04:38:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:48 smithi134 ceph-mon[34525]: pgmap v248: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:49.085 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:48 smithi070 ceph-mon[30942]: pgmap v248: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:49.120 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:38:49.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:38:49.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:48 smithi167 ceph-mon[34339]: pgmap v248: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:49.373 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:49.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 -- 172.21.15.70:0/3252103442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30102ef0 msgr2=0x7efe3010da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:49.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 --2- 172.21.15.70:0/3252103442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30102ef0 0x7efe3010da40 secure :-1 s=READY pgs=1144 cs=0 l=1 rev1=1 crypto rx=0x7efe28009ca0 tx=0x7efe2802a950 comp rx=0 tx=0).stop 2024-09-19T04:38:49.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 -- 172.21.15.70:0/3252103442 shutdown_connections 2024-09-19T04:38:49.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 --2- 172.21.15.70:0/3252103442 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30102ef0 0x7efe3010da40 unknown :-1 s=CLOSED pgs=1144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 --2- 172.21.15.70:0/3252103442 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe30102570 0x7efe301029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 --2- 172.21.15.70:0/3252103442 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe30100e20 0x7efe30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 -- 172.21.15.70:0/3252103442 >> 172.21.15.70:0/3252103442 conn(0x7efe300fc7d0 msgr2=0x7efe300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:49.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 -- 172.21.15.70:0/3252103442 shutdown_connections 2024-09-19T04:38:49.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.765+0000 7efe35968640 1 -- 172.21.15.70:0/3252103442 wait complete. 2024-09-19T04:38:49.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe35968640 1 Processor -- start 2024-09-19T04:38:49.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe35968640 1 -- start start 2024-09-19T04:38:49.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe35968640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30100e20 0x7efe30199400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:49.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe35968640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe30102570 0x7efe30199940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:49.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe35968640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe30102ef0 0x7efe301a4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:49.769 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe35968640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7efe30110fb0 con 0x7efe30100e20 2024-09-19T04:38:49.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe35968640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7efe30110e30 con 0x7efe30102ef0 2024-09-19T04:38:49.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe35968640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7efe30111130 con 0x7efe30102570 2024-09-19T04:38:49.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe2effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30100e20 0x7efe30199400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:49.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe2effd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30100e20 0x7efe30199400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35050/0 (socket says 172.21.15.70:35050) 2024-09-19T04:38:49.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe2effd640 1 -- 172.21.15.70:0/2528802644 learned_addr learned my addr 172.21.15.70:0/2528802644 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:49.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe2f7fe640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe30102ef0 0x7efe301a4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:49.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.766+0000 7efe267fc640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe30102570 0x7efe30199940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:49.770 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.767+0000 7efe267fc640 1 -- 172.21.15.70:0/2528802644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe30102ef0 msgr2=0x7efe301a4480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.767+0000 7efe267fc640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe30102ef0 0x7efe301a4480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.767+0000 7efe267fc640 1 -- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30100e20 msgr2=0x7efe30199400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.767+0000 7efe267fc640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30100e20 0x7efe30199400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.767+0000 7efe267fc640 1 -- 172.21.15.70:0/2528802644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe301a49c0 con 0x7efe30102570 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.767+0000 7efe2effd640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30100e20 0x7efe30199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.767+0000 7efe267fc640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe30102570 0x7efe30199940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe1800b3f0 tx=0x7efe1800b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.768+0000 7efe34966640 1 -- 172.21.15.70:0/2528802644 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18015020 con 0x7efe30102570 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.768+0000 7efe34966640 1 -- 172.21.15.70:0/2528802644 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7efe18011d00 con 0x7efe30102570 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.768+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe301a4b90 con 0x7efe30102570 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.768+0000 7efe34966640 1 -- 172.21.15.70:0/2528802644 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe18010e10 con 0x7efe30102570 2024-09-19T04:38:49.771 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.768+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe301a50a0 con 0x7efe30102570 2024-09-19T04:38:49.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.769+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe30101200 con 0x7efe30102570 2024-09-19T04:38:49.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.771+0000 7efe34966640 1 -- 172.21.15.70:0/2528802644 <== mon.1 v2:172.21.15.167:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7efe18018020 con 0x7efe30102570 2024-09-19T04:38:49.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.772+0000 7efe34966640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efe1c0a33b0 0x7efe1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:49.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.772+0000 7efe2effd640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efe1c0a33b0 0x7efe1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:49.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.772+0000 7efe34966640 1 -- 172.21.15.70:0/2528802644 <== mon.1 v2:172.21.15.167:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7efe180cfa40 con 0x7efe30102570 2024-09-19T04:38:49.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.772+0000 7efe2effd640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efe1c0a33b0 0x7efe1c0a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efe20005e30 tx=0x7efe20005dc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:49.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.774+0000 7efe34966640 1 -- 172.21.15.70:0/2528802644 <== mon.1 v2:172.21.15.167:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7efe1801f020 con 0x7efe30102570 2024-09-19T04:38:49.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.975+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efe3006a560 con 0x7efe30102570 2024-09-19T04:38:49.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.976+0000 7efe34966640 1 -- 172.21.15.70:0/2528802644 <== mon.1 v2:172.21.15.167:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7efe3006a560 con 0x7efe30102570 2024-09-19T04:38:49.977 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:38:49.978 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:38:49.978 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efe1c0a33b0 msgr2=0x7efe1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efe1c0a33b0 0x7efe1c0a5870 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7efe20005e30 tx=0x7efe20005dc0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe30102570 msgr2=0x7efe30199940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe30102570 0x7efe30199940 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7efe1800b3f0 tx=0x7efe1800b8b0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 shutdown_connections 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7efe1c0a33b0 0x7efe1c0a5870 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe30102ef0 0x7efe301a4480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7efe30102570 0x7efe30199940 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 --2- 172.21.15.70:0/2528802644 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7efe30100e20 0x7efe30199400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 >> 172.21.15.70:0/2528802644 conn(0x7efe300fc7d0 msgr2=0x7efe30105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 shutdown_connections 2024-09-19T04:38:49.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:49.978+0000 7efe35968640 1 -- 172.21.15.70:0/2528802644 wait complete. 2024-09-19T04:38:50.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:50 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2528802644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:50.325 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:50 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2528802644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:50.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:50 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2528802644' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:38:50.748 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:38:50.996 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:51.363 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:51 smithi070 ceph-mon[30942]: pgmap v249: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:51.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 -- 172.21.15.70:0/1668350835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 msgr2=0x7f655c106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 --2- 172.21.15.70:0/1668350835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 0x7f655c106e60 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f654c009930 tx=0x7f654c02a420 comp rx=0 tx=0).stop 2024-09-19T04:38:51.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 -- 172.21.15.70:0/1668350835 shutdown_connections 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 --2- 172.21.15.70:0/1668350835 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f655c101420 0x7f655c10d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 --2- 172.21.15.70:0/1668350835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f655c100a80 0x7f655c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 --2- 172.21.15.70:0/1668350835 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 0x7f655c106e60 unknown :-1 s=CLOSED pgs=1145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 -- 172.21.15.70:0/1668350835 >> 172.21.15.70:0/1668350835 conn(0x7f655c0fc7a0 msgr2=0x7f655c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 -- 172.21.15.70:0/1668350835 shutdown_connections 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.443+0000 7f6561a08640 1 -- 172.21.15.70:0/1668350835 wait complete. 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f6561a08640 1 Processor -- start 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f6561a08640 1 -- start start 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f6561a08640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f655c100a80 0x7f655c198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f6561a08640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f655c101420 0x7f655c198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f6561a08640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 0x7f655c19cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f6561a08640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f655c110e50 con 0x7f655c106a80 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f6561a08640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f655c110cd0 con 0x7f655c101420 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f6561a08640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f655c110fd0 con 0x7f655c100a80 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 0x7f655c19cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 0x7f655c19cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35074/0 (socket says 172.21.15.70:35074) 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655b7fe640 1 -- 172.21.15.70:0/1938896792 learned_addr learned my addr 172.21.15.70:0/1938896792 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655affd640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f655c100a80 0x7f655c198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655a7fc640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f655c101420 0x7f655c198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655b7fe640 1 -- 172.21.15.70:0/1938896792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f655c100a80 msgr2=0x7f655c198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655b7fe640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f655c100a80 0x7f655c198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655b7fe640 1 -- 172.21.15.70:0/1938896792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f655c101420 msgr2=0x7f655c198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655b7fe640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f655c101420 0x7f655c198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655b7fe640 1 -- 172.21.15.70:0/1938896792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f655c19d3e0 con 0x7f655c106a80 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.444+0000 7f655a7fc640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f655c101420 0x7f655c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.445+0000 7f655b7fe640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 0x7f655c19cd00 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f655400eb10 tx=0x7f655400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.445+0000 7f6560a06640 1 -- 172.21.15.70:0/1938896792 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554004b20 con 0x7f655c106a80 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.445+0000 7f6560a06640 1 -- 172.21.15.70:0/1938896792 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6554004cc0 con 0x7f655c106a80 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.445+0000 7f6561a08640 1 -- 172.21.15.70:0/1938896792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f655c19d6d0 con 0x7f655c106a80 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.445+0000 7f6560a06640 1 -- 172.21.15.70:0/1938896792 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6554010700 con 0x7f655c106a80 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.445+0000 7f6561a08640 1 -- 172.21.15.70:0/1938896792 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f655c1a4fb0 con 0x7f655c106a80 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.447+0000 7f6560a06640 1 -- 172.21.15.70:0/1938896792 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f6554004e70 con 0x7f655c106a80 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.447+0000 7f6563de1740 1 Processor -- start 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.447+0000 7f6563de1740 1 -- start start 2024-09-19T04:38:51.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f6563de1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d02a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f6563de1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d02aa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f6563de1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 0x55a35d037760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f6563de1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a35cf902f0 con 0x55a35d02a5d0 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f6563de1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a35cf37cf0 con 0x55a35d035370 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f6563de1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a35cf8c2b0 con 0x55a35d02bb40 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d02aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d02aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35086/0 (socket says 172.21.15.70:35086) 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 -- 172.21.15.70:0/4253903595 learned_addr learned my addr 172.21.15.70:0/4253903595 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f6560a06640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65440a3430 0x7f65440a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655a7fc640 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 0x55a35d037760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655b7fe640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65440a3430 0x7f65440a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.458 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 -- 172.21.15.70:0/4253903595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 msgr2=0x55a35d02a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d02a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 -- 172.21.15.70:0/4253903595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 msgr2=0x55a35d037760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 0x55a35d037760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 -- 172.21.15.70:0/4253903595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35cf1c3a0 con 0x55a35d02a5d0 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655a7fc640 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 0x55a35d037760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f6560a06640 1 -- 172.21.15.70:0/1938896792 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f65540d0200 con 0x7f655c106a80 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.448+0000 7f655affd640 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d02aa10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f654c000c00 tx=0x7f654c005dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fcf94cf53275b517 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6541ffb640 1 -- 172.21.15.70:0/4253903595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c040070 con 0x55a35d02a5d0 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f655b7fe640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65440a3430 0x7f65440a58f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f655409c1e0 tx=0x7f6554000f40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6541ffb640 1 -- 172.21.15.70:0/4253903595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f654c004030 con 0x55a35d02a5d0 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6541ffb640 1 -- 172.21.15.70:0/4253903595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f654c035040 con 0x55a35d02a5d0 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 -- 172.21.15.70:0/4253903595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 msgr2=0x55a35d02aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d02aa10 secure :-1 s=READY pgs=1147 cs=0 l=1 rev1=1 crypto rx=0x7f654c000c00 tx=0x7f654c005dd0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 -- 172.21.15.70:0/4253903595 shutdown_connections 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 0x55a35d037760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d02aa10 unknown :-1 s=CLOSED pgs=1147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 --2- 172.21.15.70:0/4253903595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d02a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 -- 172.21.15.70:0/4253903595 >> 172.21.15.70:0/4253903595 conn(0x55a35cff3310 msgr2=0x55a35d026c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 -- 172.21.15.70:0/4253903595 shutdown_connections 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.449+0000 7f6563de1740 1 -- 172.21.15.70:0/4253903595 wait complete. 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 1 -- start start 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 1 Processor -- start 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02a5d0 0x55a35d034da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02bb40 0x55a35d032050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d0327e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a35d038010 con 0x55a35d035370 2024-09-19T04:38:51.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a35cf4b060 con 0x55a35d02bb40 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a35d038190 con 0x55a35d02a5d0 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f6563de1740 10 client.0 _ll_register_callbacks cb 0x55a35cc9e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f655a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d0327e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f655a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d0327e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35090/0 (socket says 172.21.15.70:35090) 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f655a7fc640 1 -- 172.21.15.70:0/948634931 learned_addr learned my addr 172.21.15.70:0/948634931 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.450+0000 7f655a7fc640 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02a5d0 0x55a35d034da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f655affd640 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02bb40 0x55a35d032050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f655a7fc640 1 -- 172.21.15.70:0/948634931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02a5d0 msgr2=0x55a35d034da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f655a7fc640 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02a5d0 0x55a35d034da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f655a7fc640 1 -- 172.21.15.70:0/948634931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02bb40 msgr2=0x55a35d032050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f655a7fc640 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02bb40 0x55a35d032050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f655a7fc640 1 -- 172.21.15.70:0/948634931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35cd013c0 con 0x55a35d035370 2024-09-19T04:38:51.461 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f655a7fc640 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d0327e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6550011af0 tx=0x7f6550009730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1281977c29fa927a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f653affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f653affd640 1 -- 172.21.15.70:0/948634931 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65500110d0 con 0x55a35d035370 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f653affd640 1 -- 172.21.15.70:0/948634931 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f655000eab0 con 0x55a35d035370 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f6563de1740 1 -- 172.21.15.70:0/948634931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f654c004030 con 0x55a35d035370 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f653affd640 1 -- 172.21.15.70:0/948634931 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6550025050 con 0x55a35d035370 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f6563de1740 10 client.17700 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f6563de1740 1 -- 172.21.15.70:0/948634931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a35d043ac0 con 0x55a35d035370 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f653affd640 1 -- 172.21.15.70:0/948634931 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f654c004030 con 0x55a35d035370 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f653affd640 1 -- 172.21.15.70:0/948634931 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f65500037f0 con 0x55a35d035370 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f6563de1740 10 client.17700 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.451+0000 7f6563de1740 10 client.17700 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.452+0000 7f6563de1740 20 client.17700 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.452+0000 7f6563de1740 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a35d044ed0 0x55a35d0472f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.462 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.452+0000 7f6563de1740 4 client.17700 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:51.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.452+0000 7f6563de1740 1 -- 172.21.15.70:0/948634931 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a35cf9d860 con 0x55a35d044ed0 2024-09-19T04:38:51.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.452+0000 7f655affd640 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a35d044ed0 0x55a35d0472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.452+0000 7f653affd640 10 client.17700 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:51.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.452+0000 7f655affd640 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a35d044ed0 0x55a35d0472f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=559de0860988d727 server_cookie=1ea30d764b05e8d5 in_seq=0 out_seq=0 2024-09-19T04:38:51.463 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:51 smithi167 ceph-mon[34339]: pgmap v249: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:51.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f653affd640 1 -- 172.21.15.70:0/948634931 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a35cf9d860 con 0x55a35d044ed0 2024-09-19T04:38:51.464 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f653affd640 10 client.17700 handle_command_reply: tid=0 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 client.17700 shutdown 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 -- 172.21.15.70:0/948634931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 msgr2=0x55a35d0327e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d0327e0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7f6550011af0 tx=0x7f6550009730 comp rx=0 tx=0).stop 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 -- 172.21.15.70:0/948634931 shutdown_connections 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a35d044ed0 0x55a35d0472f0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d0327e0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f653affd640 0 client.17700 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02bb40 0x55a35d032050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 --2- 172.21.15.70:0/948634931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02a5d0 0x55a35d034da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.453+0000 7f6563de1740 1 -- 172.21.15.70:0/948634931 >> 172.21.15.70:0/948634931 conn(0x55a35cff3310 msgr2=0x55a35d02c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:51.465 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.454+0000 7f6563de1740 1 -- 172.21.15.70:0/948634931 shutdown_connections 2024-09-19T04:38:51.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.454+0000 7f6563de1740 1 -- 172.21.15.70:0/948634931 wait complete. 2024-09-19T04:38:51.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.454+0000 7f6563de1740 20 client.17700 trim_cache size 0 max 16384 2024-09-19T04:38:51.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.466+0000 7f6563de1740 1 Processor -- start 2024-09-19T04:38:51.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.466+0000 7f6563de1740 1 -- start start 2024-09-19T04:38:51.469 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.466+0000 7f6563de1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02a5d0 0x55a35d025bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.466+0000 7f6563de1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d02d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.466+0000 7f6563de1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d02d660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.466+0000 7f6563de1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1b0160 con 0x55a35d035370 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.466+0000 7f6563de1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ada30 con 0x55a35d02a5d0 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.466+0000 7f6563de1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ab8a0 con 0x55a35d02bb40 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d02d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d02d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35094/0 (socket says 172.21.15.70:35094) 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 -- 172.21.15.70:0/2421641917 learned_addr learned my addr 172.21.15.70:0/2421641917 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655affd640 1 --2- 172.21.15.70:0/2421641917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d02d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 -- 172.21.15.70:0/2421641917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 msgr2=0x55a35d02d120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 --2- 172.21.15.70:0/2421641917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d02d120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.470 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 -- 172.21.15.70:0/2421641917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02a5d0 msgr2=0x55a35d025bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 --2- 172.21.15.70:0/2421641917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02a5d0 0x55a35d025bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 -- 172.21.15.70:0/2421641917 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a35d026510 con 0x55a35d035370 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f655a7fc640 1 --2- 172.21.15.70:0/2421641917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d02d660 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6550005d00 tx=0x7f6550011560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=477342b42274b3eb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f65417fa640 1 -- 172.21.15.70:0/2421641917 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65500097a0 con 0x55a35d035370 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f65417fa640 1 -- 172.21.15.70:0/2421641917 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6550011070 con 0x55a35d035370 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.467+0000 7f65417fa640 1 -- 172.21.15.70:0/2421641917 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6550003ff0 con 0x55a35d035370 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 -- 172.21.15.70:0/2421641917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 msgr2=0x55a35d02d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 --2- 172.21.15.70:0/2421641917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d02d660 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7f6550005d00 tx=0x7f6550011560 comp rx=0 tx=0).stop 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 -- 172.21.15.70:0/2421641917 shutdown_connections 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 --2- 172.21.15.70:0/2421641917 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d035370 0x55a35d02d660 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 --2- 172.21.15.70:0/2421641917 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d02d120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 --2- 172.21.15.70:0/2421641917 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d02a5d0 0x55a35d025bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.471 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 -- 172.21.15.70:0/2421641917 >> 172.21.15.70:0/2421641917 conn(0x55a35cff3310 msgr2=0x55a35d0254e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:51.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 -- 172.21.15.70:0/2421641917 shutdown_connections 2024-09-19T04:38:51.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 -- 172.21.15.70:0/2421641917 wait complete. 2024-09-19T04:38:51.472 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 -- start start 2024-09-19T04:38:51.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.468+0000 7f6563de1740 1 Processor -- start 2024-09-19T04:38:51.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f6563de1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d03d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f6563de1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d03d960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f6563de1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 0x55a35d03a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f6563de1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1abef0 con 0x55a35d02a5d0 2024-09-19T04:38:51.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f6563de1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ad360 con 0x55a35d035370 2024-09-19T04:38:51.475 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f6563de1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f655c1ac5c0 con 0x55a35d02bb40 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f6563de1740 10 client.0 _ll_register_callbacks cb 0x7f6550009680 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d03d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d03d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35106/0 (socket says 172.21.15.70:35106) 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 -- 172.21.15.70:0/911762008 learned_addr learned my addr 172.21.15.70:0/911762008 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655affd640 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d03d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 -- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 msgr2=0x55a35d03d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d03d960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 -- 172.21.15.70:0/911762008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 msgr2=0x55a35d03a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 0x55a35d03a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 -- 172.21.15.70:0/911762008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a35d03e050 con 0x55a35d02a5d0 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655affd640 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d03d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:51.476 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f655a7fc640 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d03d420 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6550011510 tx=0x7f6550003a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c424489746ecad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f653affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.469+0000 7f653affd640 1 -- 172.21.15.70:0/911762008 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65500037f0 con 0x55a35d02a5d0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f653affd640 1 -- 172.21.15.70:0/911762008 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f655000eab0 con 0x55a35d02a5d0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 1 -- 172.21.15.70:0/911762008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6550011070 con 0x55a35d02a5d0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f653affd640 1 -- 172.21.15.70:0/911762008 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f655000ecb0 con 0x55a35d02a5d0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 10 client.17706 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 1 -- 172.21.15.70:0/911762008 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a35d0b45b0 con 0x55a35d02a5d0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f653affd640 1 -- 172.21.15.70:0/911762008 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6550011070 con 0x55a35d02a5d0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f653affd640 1 -- 172.21.15.70:0/911762008 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f65500041e0 con 0x55a35d02a5d0 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 10 client.17706 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 10 client.17706 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 20 client.17706 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:51.477 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a35d044ed0 0x55a35d0b6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 4 client.17706 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f6563de1740 1 -- 172.21.15.70:0/911762008 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55a35cf97d70 con 0x55a35d044ed0 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.470+0000 7f655affd640 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a35d044ed0 0x55a35d0b6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f655affd640 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a35d044ed0 0x55a35d0b6c20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=8a7a5916a2f69d97 server_cookie=99cf57940fc27618 in_seq=0 out_seq=0 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f653affd640 10 client.17706 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f653affd640 1 -- 172.21.15.70:0/911762008 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55a35cf97d70 con 0x55a35d044ed0 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f653affd640 10 client.17706 handle_command_reply: tid=0 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 client.17706 shutdown 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 -- 172.21.15.70:0/911762008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 msgr2=0x55a35d03d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d03d420 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7f6550011510 tx=0x7f6550003a60 comp rx=0 tx=0).stop 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 -- 172.21.15.70:0/911762008 shutdown_connections 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55a35d044ed0 0x55a35d0b6c20 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.478 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a35d035370 0x55a35d03a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a35d02bb40 0x55a35d03d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f653affd640 0 client.17706 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:38:51.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 --2- 172.21.15.70:0/911762008 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a35d02a5d0 0x55a35d03d420 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 -- 172.21.15.70:0/911762008 >> 172.21.15.70:0/911762008 conn(0x55a35cff3310 msgr2=0x55a35d025d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:51.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 -- 172.21.15.70:0/911762008 shutdown_connections 2024-09-19T04:38:51.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 1 -- 172.21.15.70:0/911762008 wait complete. 2024-09-19T04:38:51.479 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.471+0000 7f6563de1740 20 client.17706 trim_cache size 0 max 16384 2024-09-19T04:38:51.479 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:51.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 -- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65440a3430 msgr2=0x7f65440a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65440a3430 0x7f65440a58f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f655409c1e0 tx=0x7f6554000f40 comp rx=0 tx=0).stop 2024-09-19T04:38:51.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 -- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 msgr2=0x7f655c19cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:51.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 0x7f655c19cd00 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f655400eb10 tx=0x7f655400c2d0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.480 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 -- 172.21.15.70:0/1938896792 shutdown_connections 2024-09-19T04:38:51.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f65440a3430 0x7f65440a58f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f655c106a80 0x7f655c19cd00 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f655c101420 0x7f655c198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 --2- 172.21.15.70:0/1938896792 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f655c100a80 0x7f655c198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:51.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 -- 172.21.15.70:0/1938896792 >> 172.21.15.70:0/1938896792 conn(0x7f655c0fc7a0 msgr2=0x7f655c104850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:51.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 -- 172.21.15.70:0/1938896792 shutdown_connections 2024-09-19T04:38:51.481 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:51.472+0000 7f6561a08640 1 -- 172.21.15.70:0/1938896792 wait complete. 2024-09-19T04:38:51.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:51 smithi134 ceph-mon[34525]: pgmap v249: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:52.194 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:38:52.439 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:52.877 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:52 smithi070 ceph-mon[30942]: pgmap v250: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 -- 172.21.15.70:0/963226665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 msgr2=0x7ff0c010ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 --2- 172.21.15.70:0/963226665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 0x7ff0c010ea90 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7ff0b8009ca0 tx=0x7ff0b802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 -- 172.21.15.70:0/963226665 shutdown_connections 2024-09-19T04:38:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 --2- 172.21.15.70:0/963226665 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 0x7ff0c010ea90 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 --2- 172.21.15.70:0/963226665 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c0102790 0x7ff0c01067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 --2- 172.21.15.70:0/963226665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0c0101de0 0x7ff0c01021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 -- 172.21.15.70:0/963226665 >> 172.21.15.70:0/963226665 conn(0x7ff0c00fd880 msgr2=0x7ff0c00ffca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 -- 172.21.15.70:0/963226665 shutdown_connections 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.875+0000 7ff0c785b640 1 -- 172.21.15.70:0/963226665 wait complete. 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c785b640 1 Processor -- start 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c785b640 1 -- start start 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c785b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0c0101de0 0x7ff0c00744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c785b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c0102790 0x7ff0c0074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c785b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 0x7ff0c0074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c785b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0111fa0 con 0x7ff0c0106f10 2024-09-19T04:38:52.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c785b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0111e20 con 0x7ff0c0101de0 2024-09-19T04:38:52.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c785b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c0112120 con 0x7ff0c0102790 2024-09-19T04:38:52.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c5df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 0x7ff0c0074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c5df8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 0x7ff0c0074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35126/0 (socket says 172.21.15.70:35126) 2024-09-19T04:38:52.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.876+0000 7ff0c5df8640 1 -- 172.21.15.70:0/2716427413 learned_addr learned my addr 172.21.15.70:0/2716427413 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:52.881 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0c0101de0 0x7ff0c00744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c0102790 0x7ff0c0074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c5df8640 1 -- 172.21.15.70:0/2716427413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c0102790 msgr2=0x7ff0c0074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c5df8640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c0102790 0x7ff0c0074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c5df8640 1 -- 172.21.15.70:0/2716427413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0c0101de0 msgr2=0x7ff0c00744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c5df8640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0c0101de0 0x7ff0c00744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c5df8640 1 -- 172.21.15.70:0/2716427413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0c01a6920 con 0x7ff0c0106f10 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0c0101de0 0x7ff0c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c5df8640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 0x7ff0c0074f70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80097b0 tx=0x7ff0b8003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0b67fc640 1 -- 172.21.15.70:0/2716427413 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b8031890 con 0x7ff0c0106f10 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0b67fc640 1 -- 172.21.15.70:0/2716427413 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff0b8004510 con 0x7ff0c0106f10 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c785b640 1 -- 172.21.15.70:0/2716427413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0c01a6bb0 con 0x7ff0c0106f10 2024-09-19T04:38:52.882 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0b67fc640 1 -- 172.21.15.70:0/2716427413 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b802fd40 con 0x7ff0c0106f10 2024-09-19T04:38:52.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.877+0000 7ff0c785b640 1 -- 172.21.15.70:0/2716427413 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0c01a70f0 con 0x7ff0c0106f10 2024-09-19T04:38:52.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.879+0000 7ff0b67fc640 1 -- 172.21.15.70:0/2716427413 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff0b8004040 con 0x7ff0c0106f10 2024-09-19T04:38:52.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c9c34740 1 Processor -- start 2024-09-19T04:38:52.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c9c34740 1 -- start start 2024-09-19T04:38:52.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d7b40 0x555eb45d6090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d65d0 0x555eb45d6a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45e3760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555eb453c2f0 con 0x555eb45e1370 2024-09-19T04:38:52.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555eb44e3cf0 con 0x555eb45d65d0 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555eb45382b0 con 0x555eb45d7b40 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0b67fc640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0ac0a33b0 0x7ff0ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c4df6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45e3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c4df6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45e3760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35142/0 (socket says 172.21.15.70:35142) 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c4df6640 1 -- 172.21.15.70:0/3235264516 learned_addr learned my addr 172.21.15.70:0/3235264516 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.880+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d7b40 0x555eb45d6090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c5df8640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0ac0a33b0 0x7ff0ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d65d0 0x555eb45d6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0b67fc640 1 -- 172.21.15.70:0/2716427413 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff0b80f1670 con 0x7ff0c0106f10 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c4df6640 1 -- 172.21.15.70:0/3235264516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d7b40 msgr2=0x555eb45d6090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d7b40 0x555eb45d6090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c4df6640 1 -- 172.21.15.70:0/3235264516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d65d0 msgr2=0x555eb45d6a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d65d0 0x555eb45d6a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c4df6640 1 -- 172.21.15.70:0/3235264516 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb44c83a0 con 0x555eb45e1370 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45e3760 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0013910 tx=0x7ff0b000e430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a822819a426fd7d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0c5df8640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0ac0a33b0 0x7ff0ac0a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80b9ec0 tx=0x7ff0b8090890 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0ab7fe640 1 -- 172.21.15.70:0/3235264516 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0004020 con 0x555eb45e1370 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0ab7fe640 1 -- 172.21.15.70:0/3235264516 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff0b000bde0 con 0x555eb45e1370 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.881+0000 7ff0ab7fe640 1 -- 172.21.15.70:0/3235264516 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0003930 con 0x555eb45e1370 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3235264516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 msgr2=0x555eb45e3760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45e3760 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0013910 tx=0x7ff0b000e430 comp rx=0 tx=0).stop 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3235264516 shutdown_connections 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45e3760 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d65d0 0x555eb45d6a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3235264516 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d7b40 0x555eb45d6090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3235264516 >> 172.21.15.70:0/3235264516 conn(0x555eb459f310 msgr2=0x555eb45d2c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3235264516 shutdown_connections 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3235264516 wait complete. 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 -- start start 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.882+0000 7ff0c9c34740 1 Processor -- start 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 0x555eb45e0d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45ddfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45de5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x555eb45e4070 con 0x555eb45e1370 2024-09-19T04:38:52.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x555eb44f7060 con 0x555eb45d7b40 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x555eb45e41f0 con 0x555eb45d65d0 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c9c34740 10 client.0 _ll_register_callbacks cb 0x555eb424a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45de5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45de5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35150/0 (socket says 172.21.15.70:35150) 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 -- 172.21.15.70:0/1426484051 learned_addr learned my addr 172.21.15.70:0/1426484051 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45ddfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 0x555eb45e0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 -- 172.21.15.70:0/1426484051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 msgr2=0x555eb45e0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 0x555eb45e0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 -- 172.21.15.70:0/1426484051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 msgr2=0x555eb45ddfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45ddfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 -- 172.21.15.70:0/1426484051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb42ad3c0 con 0x555eb45e1370 2024-09-19T04:38:52.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45de5d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000bfd0 tx=0x7ff0b0013f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d9ec45fee666ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.883+0000 7ff0a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/1426484051 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0029020 con 0x555eb45e1370 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/1426484051 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff0b001f650 con 0x555eb45e1370 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1426484051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0b000bde0 con 0x555eb45e1370 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/1426484051 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff0b001f850 con 0x555eb45e1370 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 10 client.17718 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1426484051 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555eb45efb00 con 0x555eb45e1370 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/1426484051 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff0b000bde0 con 0x555eb45e1370 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/1426484051 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff0b002c020 con 0x555eb45e1370 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 10 client.17718 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 10 client.17718 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 20 client.17718 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:52.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x555eb45f0ea0 0x555eb45f3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 4 client.17718 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.884+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1426484051 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555eb4549860 con 0x555eb45f0ea0 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.885+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x555eb45f0ea0 0x555eb45f3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.885+0000 7ff0a8ff9640 10 client.17718 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.885+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x555eb45f0ea0 0x555eb45f3290 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c396a9bd226c20bf server_cookie=aa05715bee97942f in_seq=0 out_seq=0 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/1426484051 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x555eb4549860 con 0x555eb45f0ea0 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0a8ff9640 10 client.17718 handle_command_reply: tid=0 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 client.17718 shutdown 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1426484051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 msgr2=0x555eb45de5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45de5d0 secure :-1 s=READY pgs=1154 cs=0 l=1 rev1=1 crypto rx=0x7ff0b000bfd0 tx=0x7ff0b0013f50 comp rx=0 tx=0).stop 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1426484051 shutdown_connections 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x555eb45f0ea0 0x555eb45f3290 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.895 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45de5d0 unknown :-1 s=CLOSED pgs=1154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45ddfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1426484051 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 0x555eb45e0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1426484051 >> 172.21.15.70:0/1426484051 conn(0x555eb459f310 msgr2=0x555eb45d8960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:52.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0a8ff9640 0 client.17718 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:52.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1426484051 shutdown_connections 2024-09-19T04:38:52.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1426484051 wait complete. 2024-09-19T04:38:52.896 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.886+0000 7ff0c9c34740 20 client.17718 trim_cache size 0 max 16384 2024-09-19T04:38:52.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c9c34740 1 Processor -- start 2024-09-19T04:38:52.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c9c34740 1 -- start start 2024-09-19T04:38:52.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45d65d0 0x555eb45dcfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45f62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45e1370 0x555eb45f67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.902 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01b2370 con 0x555eb45d65d0 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01afc40 con 0x555eb45d7b40 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01adab0 con 0x555eb45e1370 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45d65d0 0x555eb45dcfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45d65d0 0x555eb45dcfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35156/0 (socket says 172.21.15.70:35156) 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 -- 172.21.15.70:0/1492748633 learned_addr learned my addr 172.21.15.70:0/1492748633 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 -- 172.21.15.70:0/1492748633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45e1370 msgr2=0x555eb45f67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/1492748633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45e1370 0x555eb45f67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 -- 172.21.15.70:0/1492748633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 msgr2=0x555eb45f62b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/1492748633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45f62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 -- 172.21.15.70:0/1492748633 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555eb45e3ec0 con 0x555eb45d65d0 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.899+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/1492748633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45d65d0 0x555eb45dcfe0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0022d50 tx=0x7ff0b000eb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c43e15957f011780 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0aaffd640 1 -- 172.21.15.70:0/1492748633 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0029070 con 0x555eb45d65d0 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0aaffd640 1 -- 172.21.15.70:0/1492748633 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff0b000e910 con 0x555eb45d65d0 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0aaffd640 1 -- 172.21.15.70:0/1492748633 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b00226b0 con 0x555eb45d65d0 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1492748633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45d65d0 msgr2=0x555eb45dcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1492748633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45d65d0 0x555eb45dcfe0 secure :-1 s=READY pgs=1155 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0022d50 tx=0x7ff0b000eb70 comp rx=0 tx=0).stop 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1492748633 shutdown_connections 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1492748633 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45e1370 0x555eb45f67f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1492748633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45f62b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/1492748633 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45d65d0 0x555eb45dcfe0 unknown :-1 s=CLOSED pgs=1155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.904 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1492748633 >> 172.21.15.70:0/1492748633 conn(0x555eb459f310 msgr2=0x555eb45dc8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:52.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1492748633 shutdown_connections 2024-09-19T04:38:52.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.900+0000 7ff0c9c34740 1 -- 172.21.15.70:0/1492748633 wait complete. 2024-09-19T04:38:52.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 1 -- start start 2024-09-19T04:38:52.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 1 Processor -- start 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 0x555eb45f6820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45f3b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45f40b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01ae100 con 0x555eb45e1370 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01af570 con 0x555eb45d7b40 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff0c01ae7d0 con 0x555eb45d65d0 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c9c34740 10 client.0 _ll_register_callbacks cb 0x7ff0bc0071a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c4df6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45f40b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c4df6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45f40b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:35170/0 (socket says 172.21.15.70:35170) 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c4df6640 1 -- 172.21.15.70:0/3135499164 learned_addr learned my addr 172.21.15.70:0/3135499164 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:52.908 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 0x555eb45f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.901+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45f3b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c4df6640 1 -- 172.21.15.70:0/3135499164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 msgr2=0x555eb45f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 0x555eb45f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c4df6640 1 -- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 msgr2=0x555eb45f3b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45f3b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c4df6640 1 -- 172.21.15.70:0/3135499164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555eb45f46f0 con 0x555eb45e1370 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c4df6640 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45f40b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0005ab0 tx=0x7ff0b0013f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b02d11c17d1fe856 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0a8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/3135499164 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0b0027070 con 0x555eb45e1370 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/3135499164 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff0b0022650 con 0x555eb45e1370 2024-09-19T04:38:52.909 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3135499164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff0b000e910 con 0x555eb45e1370 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/3135499164 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff0b0029070 con 0x555eb45e1370 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c9c34740 10 client.17724 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3135499164 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x555eb465b5f0 con 0x555eb45e1370 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/3135499164 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff0b000e910 con 0x555eb45e1370 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/3135499164 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff0b002c040 con 0x555eb45e1370 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c9c34740 10 client.17724 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c9c34740 10 client.17724 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c9c34740 20 client.17724 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.902+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x555eb465bc00 0x555eb465dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.903+0000 7ff0c9c34740 4 client.17724 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.903+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3135499164 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555eb4543d70 con 0x555eb465bc00 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.903+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x555eb465bc00 0x555eb465dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:52.910 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.903+0000 7ff0a8ff9640 10 client.17724 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.903+0000 7ff0c55f7640 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x555eb465bc00 0x555eb465dff0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b23be6442c281fab server_cookie=d2e1a8c1ee9976e1 in_seq=0 out_seq=0 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.903+0000 7ff0a8ff9640 1 -- 172.21.15.70:0/3135499164 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x555eb4543d70 con 0x555eb465bc00 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.903+0000 7ff0a8ff9640 10 client.17724 handle_command_reply: tid=0 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.903+0000 7ff0c9c34740 1 client.17724 shutdown 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3135499164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 msgr2=0x555eb45f40b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45f40b0 secure :-1 s=READY pgs=1156 cs=0 l=1 rev1=1 crypto rx=0x7ff0b0005ab0 tx=0x7ff0b0013f50 comp rx=0 tx=0).stop 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3135499164 shutdown_connections 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x555eb465bc00 0x555eb465dff0 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x555eb45e1370 0x555eb45f40b0 unknown :-1 s=CLOSED pgs=1156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x555eb45d7b40 0x555eb45f3b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 --2- 172.21.15.70:0/3135499164 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x555eb45d65d0 0x555eb45f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3135499164 >> 172.21.15.70:0/3135499164 conn(0x555eb459f310 msgr2=0x555eb45dd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:52.911 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0a8ff9640 0 client.17724 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:38:52.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3135499164 shutdown_connections 2024-09-19T04:38:52.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 1 -- 172.21.15.70:0/3135499164 wait complete. 2024-09-19T04:38:52.912 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c9c34740 20 client.17724 trim_cache size 0 max 16384 2024-09-19T04:38:52.912 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 -- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0ac0a33b0 msgr2=0x7ff0ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0ac0a33b0 0x7ff0ac0a5870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80b9ec0 tx=0x7ff0b8090890 comp rx=0 tx=0).stop 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 -- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 msgr2=0x7ff0c0074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 0x7ff0c0074f70 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7ff0b80097b0 tx=0x7ff0b8003f30 comp rx=0 tx=0).stop 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 -- 172.21.15.70:0/2716427413 shutdown_connections 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff0ac0a33b0 0x7ff0ac0a5870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff0c0106f10 0x7ff0c0074f70 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff0c0102790 0x7ff0c0074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 --2- 172.21.15.70:0/2716427413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0c0101de0 0x7ff0c00744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 -- 172.21.15.70:0/2716427413 >> 172.21.15.70:0/2716427413 conn(0x7ff0c00fd880 msgr2=0x7ff0c00feb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:52.913 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.904+0000 7ff0c785b640 1 -- 172.21.15.70:0/2716427413 shutdown_connections 2024-09-19T04:38:52.914 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:52.905+0000 7ff0c785b640 1 -- 172.21.15.70:0/2716427413 wait complete. 2024-09-19T04:38:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:52 smithi134 ceph-mon[34525]: pgmap v250: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:53.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:52 smithi167 ceph-mon[34339]: pgmap v250: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:38:53.676 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:38:53.920 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 -- 172.21.15.70:0/1509026294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0106a80 msgr2=0x7f0ba0106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/1509026294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0106a80 0x7f0ba0106e60 secure :-1 s=READY pgs=1157 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c009930 tx=0x7f0b9c02a420 comp rx=0 tx=0).stop 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 -- 172.21.15.70:0/1509026294 shutdown_connections 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/1509026294 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba0101420 0x7f0ba010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/1509026294 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0100a80 0x7f0ba0100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/1509026294 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0106a80 0x7f0ba0106e60 unknown :-1 s=CLOSED pgs=1157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 -- 172.21.15.70:0/1509026294 >> 172.21.15.70:0/1509026294 conn(0x7f0ba00fc7a0 msgr2=0x7f0ba00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 -- 172.21.15.70:0/1509026294 shutdown_connections 2024-09-19T04:38:54.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.380+0000 7f0ba7f47640 1 -- 172.21.15.70:0/1509026294 wait complete. 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba7f47640 1 Processor -- start 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba7f47640 1 -- start start 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba7f47640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0100a80 0x7f0ba0198600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba7f47640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0101420 0x7f0ba0198b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba7f47640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba0106a80 0x7f0ba019ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba7f47640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0110f10 con 0x7f0ba0100a80 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba7f47640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0110d90 con 0x7f0ba0106a80 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba7f47640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba0111090 con 0x7f0ba0101420 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba5ce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0100a80 0x7f0ba0198600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba5ce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0100a80 0x7f0ba0198600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37212/0 (socket says 172.21.15.70:37212) 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/3746429340 learned_addr learned my addr 172.21.15.70:0/3746429340 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:54.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0101420 0x7f0ba0198b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.381+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba0106a80 0x7f0ba019ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/3746429340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0101420 msgr2=0x7f0ba0198b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0101420 0x7f0ba0198b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/3746429340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba0106a80 msgr2=0x7f0ba019ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba0106a80 0x7f0ba019ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/3746429340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0ba019d5b0 con 0x7f0ba0100a80 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba0106a80 0x7f0ba019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0100a80 0x7f0ba0198600 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c005940 tx=0x7f0b9c004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0b96ffd640 1 -- 172.21.15.70:0/3746429340 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c03f030 con 0x7f0ba0100a80 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0b96ffd640 1 -- 172.21.15.70:0/3746429340 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b9c003ac0 con 0x7f0ba0100a80 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba7f47640 1 -- 172.21.15.70:0/3746429340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0ba019d840 con 0x7f0ba0100a80 2024-09-19T04:38:54.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0b96ffd640 1 -- 172.21.15.70:0/3746429340 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c035070 con 0x7f0ba0100a80 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.382+0000 7f0ba7f47640 1 -- 172.21.15.70:0/3746429340 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0ba01a5180 con 0x7f0ba0100a80 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.384+0000 7f0b96ffd640 1 -- 172.21.15.70:0/3746429340 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0b9c042030 con 0x7f0ba0100a80 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.384+0000 7f0baa320740 1 Processor -- start 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0baa320740 1 -- start start 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0baa320740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345def090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0baa320740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345defa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0baa320740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 0x55d345dfc760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0b96ffd640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b8c0a33b0 0x7f0b8c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0baa320740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d345d552f0 con 0x55d345def5d0 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0baa320740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d345cfccf0 con 0x55d345dfa370 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0baa320740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d345d512b0 con 0x55d345df0b40 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba5ce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345defa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b8c0a33b0 0x7f0b8c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba5ce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345defa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37228/0 (socket says 172.21.15.70:37228) 2024-09-19T04:38:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/2943543099 learned_addr learned my addr 172.21.15.70:0/2943543099 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/2943543099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345def090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0b96ffd640 1 -- 172.21.15.70:0/3746429340 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0b9c0f0480 con 0x7f0ba0100a80 2024-09-19T04:38:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/2943543099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 msgr2=0x55d345def090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/2943543099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345def090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/2943543099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 msgr2=0x55d345dfc760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:54.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/2943543099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 0x55d345dfc760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.385+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/2943543099 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d345ce13a0 con 0x55d345def5d0 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.386+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b8c0a33b0 0x7f0b8c0a5870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00fedb0 tx=0x7f0b90009110 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.386+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/2943543099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345defa10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c000c00 tx=0x7f0b9c08f590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a677be2fe4f2002c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.386+0000 7f0b8bfff640 1 -- 172.21.15.70:0/2943543099 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c049020 con 0x55d345def5d0 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.386+0000 7f0b8bfff640 1 -- 172.21.15.70:0/2943543099 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b9c0bce60 con 0x55d345def5d0 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.386+0000 7f0b8bfff640 1 -- 172.21.15.70:0/2943543099 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c0c53d0 con 0x55d345def5d0 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.386+0000 7f0baa320740 1 -- 172.21.15.70:0/2943543099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 msgr2=0x55d345defa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.386+0000 7f0baa320740 1 --2- 172.21.15.70:0/2943543099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345defa10 secure :-1 s=READY pgs=1159 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c000c00 tx=0x7f0b9c08f590 comp rx=0 tx=0).stop 2024-09-19T04:38:54.400 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 -- 172.21.15.70:0/2943543099 shutdown_connections 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 --2- 172.21.15.70:0/2943543099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 0x55d345dfc760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 --2- 172.21.15.70:0/2943543099 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345defa10 unknown :-1 s=CLOSED pgs=1159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 --2- 172.21.15.70:0/2943543099 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345def090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 -- 172.21.15.70:0/2943543099 >> 172.21.15.70:0/2943543099 conn(0x55d345db8310 msgr2=0x55d345debc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 -- 172.21.15.70:0/2943543099 shutdown_connections 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 -- 172.21.15.70:0/2943543099 wait complete. 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 -- start start 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 Processor -- start 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345df9da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345df7050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 0x55d345df77e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d345d552f0 con 0x55d345def5d0 2024-09-19T04:38:54.401 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d345d10060 con 0x55d345dfa370 2024-09-19T04:38:54.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.387+0000 7f0baa320740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d345dfce30 con 0x55d345df0b40 2024-09-19T04:38:54.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0baa320740 10 client.0 _ll_register_callbacks cb 0x55d345a638c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:54.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345df9da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345df9da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37234/0 (socket says 172.21.15.70:37234) 2024-09-19T04:38:54.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/962170651 learned_addr learned my addr 172.21.15.70:0/962170651 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:54.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 0x55d345df77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345df7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.402 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/962170651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 msgr2=0x55d345df7050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345df7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 msgr2=0x55d345df77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 0x55d345df77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 -- 172.21.15.70:0/962170651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d345ac63c0 con 0x55d345def5d0 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 0x55d345df77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345df9da0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0edc80 tx=0x7f0b9c0ee080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=412c8efa240c8bb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0b897fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0b897fa640 1 -- 172.21.15.70:0/962170651 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b9c049040 con 0x55d345def5d0 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0baa320740 1 -- 172.21.15.70:0/962170651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b9c0bce60 con 0x55d345def5d0 2024-09-19T04:38:54.403 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0b897fa640 1 -- 172.21.15.70:0/962170651 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0b9c003c70 con 0x55d345def5d0 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0b897fa640 1 -- 172.21.15.70:0/962170651 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0b9c0c53d0 con 0x55d345def5d0 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0baa320740 10 client.17736 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0baa320740 1 -- 172.21.15.70:0/962170651 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d345e08790 con 0x55d345def5d0 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.388+0000 7f0b897fa640 1 -- 172.21.15.70:0/962170651 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b9c0bce60 con 0x55d345def5d0 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.389+0000 7f0b897fa640 1 -- 172.21.15.70:0/962170651 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0b9c0c4fd0 con 0x55d345def5d0 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.389+0000 7f0baa320740 10 client.17736 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.389+0000 7f0baa320740 10 client.17736 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.389+0000 7f0baa320740 20 client.17736 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.389+0000 7f0baa320740 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d345e09ae0 0x55d345e0bed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.389+0000 7f0baa320740 4 client.17736 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.389+0000 7f0baa320740 1 -- 172.21.15.70:0/962170651 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d345d62860 con 0x55d345e09ae0 2024-09-19T04:38:54.404 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.389+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d345e09ae0 0x55d345e0bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.390+0000 7f0b897fa640 10 client.17736 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.390+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d345e09ae0 0x55d345e0bed0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa872cbf76fba9f7 server_cookie=1b7937b6f88d1dbb in_seq=0 out_seq=0 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.390+0000 7f0b897fa640 1 -- 172.21.15.70:0/962170651 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d345d62860 con 0x55d345e09ae0 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.390+0000 7f0b897fa640 10 client.17736 handle_command_reply: tid=0 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 client.17736 shutdown 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 -- 172.21.15.70:0/962170651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 msgr2=0x55d345df9da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345df9da0 secure :-1 s=READY pgs=1160 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c0edc80 tx=0x7f0b9c0ee080 comp rx=0 tx=0).stop 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 -- 172.21.15.70:0/962170651 shutdown_connections 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d345e09ae0 0x55d345e0bed0 crc :-1 s=READY pgs=192 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.405 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345dfa370 0x55d345df77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345df7050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0b897fa640 0 client.17736 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:54.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 --2- 172.21.15.70:0/962170651 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345def5d0 0x55d345df9da0 unknown :-1 s=CLOSED pgs=1160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 -- 172.21.15.70:0/962170651 >> 172.21.15.70:0/962170651 conn(0x55d345db8310 msgr2=0x55d345df1990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:54.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 -- 172.21.15.70:0/962170651 shutdown_connections 2024-09-19T04:38:54.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 1 -- 172.21.15.70:0/962170651 wait complete. 2024-09-19T04:38:54.406 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.391+0000 7f0baa320740 20 client.17736 trim_cache size 0 max 16384 2024-09-19T04:38:54.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.404+0000 7f0baa320740 1 Processor -- start 2024-09-19T04:38:54.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.404+0000 7f0baa320740 1 -- start start 2024-09-19T04:38:54.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.404+0000 7f0baa320740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345df6140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.412 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.404+0000 7f0baa320740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345df0b40 0x55d345df2120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.404+0000 7f0baa320740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345dfa370 0x55d345df2660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.404+0000 7f0baa320740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01b0250 con 0x55d345df0b40 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.404+0000 7f0baa320740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01adb20 con 0x55d345def5d0 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.404+0000 7f0baa320740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01ab990 con 0x55d345dfa370 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345df0b40 0x55d345df2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345df0b40 0x55d345df2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37248/0 (socket says 172.21.15.70:37248) 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 -- 172.21.15.70:0/2623855522 learned_addr learned my addr 172.21.15.70:0/2623855522 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345df6140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.413 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345dfa370 0x55d345df2660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 -- 172.21.15.70:0/2623855522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345dfa370 msgr2=0x55d345df2660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345dfa370 0x55d345df2660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 -- 172.21.15.70:0/2623855522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 msgr2=0x55d345df6140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345df6140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 -- 172.21.15.70:0/2623855522 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d345df55a0 con 0x55d345df0b40 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345df6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345dfa370 0x55d345df2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345df0b40 0x55d345df2120 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x55d345df8690 tx=0x7f0b90011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69a527528cde49f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0b8b7fe640 1 -- 172.21.15.70:0/2623855522 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90015540 con 0x55d345df0b40 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0b8b7fe640 1 -- 172.21.15.70:0/2623855522 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b9002e070 con 0x55d345df0b40 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.405+0000 7f0b8b7fe640 1 -- 172.21.15.70:0/2623855522 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b90021870 con 0x55d345df0b40 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 -- 172.21.15.70:0/2623855522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345df0b40 msgr2=0x55d345df2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.414 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345df0b40 0x55d345df2120 secure :-1 s=READY pgs=1161 cs=0 l=1 rev1=1 crypto rx=0x55d345df8690 tx=0x7f0b90011000 comp rx=0 tx=0).stop 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 -- 172.21.15.70:0/2623855522 shutdown_connections 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345dfa370 0x55d345df2660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345df0b40 0x55d345df2120 unknown :-1 s=CLOSED pgs=1161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 --2- 172.21.15.70:0/2623855522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345df6140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 -- 172.21.15.70:0/2623855522 >> 172.21.15.70:0/2623855522 conn(0x55d345db8310 msgr2=0x55d345de6a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 -- 172.21.15.70:0/2623855522 shutdown_connections 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 -- 172.21.15.70:0/2623855522 wait complete. 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.406+0000 7f0baa320740 1 -- start start 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0baa320740 1 Processor -- start 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0baa320740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345e025d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0baa320740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345dfd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0baa320740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345dfa370 0x55d345dfde40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0baa320740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01abfe0 con 0x55d345dfa370 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0baa320740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01ad450 con 0x55d345def5d0 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0baa320740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0ba01ac6b0 con 0x55d345df0b40 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0baa320740 10 client.0 _ll_register_callbacks cb 0x7f0b9c0b8340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba64e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345dfa370 0x55d345dfde40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba64e4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345dfa370 0x55d345dfde40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37254/0 (socket says 172.21.15.70:37254) 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba64e4640 1 -- 172.21.15.70:0/1067155121 learned_addr learned my addr 172.21.15.70:0/1067155121 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba54e2640 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345dfd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345e025d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba64e4640 1 -- 172.21.15.70:0/1067155121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 msgr2=0x55d345dfd900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345dfd900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba64e4640 1 -- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 msgr2=0x55d345e025d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345e025d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba64e4640 1 -- 172.21.15.70:0/1067155121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d345dfe400 con 0x55d345dfa370 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.407+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345e025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0ba64e4640 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345dfa370 0x55d345dfde40 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f0b980127d0 tx=0x7f0b98012c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9c09e6fa2c3960b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0b897fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0b897fa640 1 -- 172.21.15.70:0/1067155121 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b98010cf0 con 0x55d345dfa370 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0b897fa640 1 -- 172.21.15.70:0/1067155121 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f0b9801b410 con 0x55d345dfa370 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 1 -- 172.21.15.70:0/1067155121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0b9002e070 con 0x55d345dfa370 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0b897fa640 1 -- 172.21.15.70:0/1067155121 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0b98010e90 con 0x55d345dfa370 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 10 client.17742 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 1 -- 172.21.15.70:0/1067155121 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d345e743b0 con 0x55d345dfa370 2024-09-19T04:38:54.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0b897fa640 1 -- 172.21.15.70:0/1067155121 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b9002e070 con 0x55d345dfa370 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0b897fa640 1 -- 172.21.15.70:0/1067155121 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0b980136b0 con 0x55d345dfa370 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 10 client.17742 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 10 client.17742 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 20 client.17742 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d345e74be0 0x55d345e77000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 4 client.17742 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.408+0000 7f0baa320740 1 -- 172.21.15.70:0/1067155121 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d345d5cd70 con 0x55d345e74be0 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d345e74be0 0x55d345e77000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0b897fa640 10 client.17742 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0ba5ce3640 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d345e74be0 0x55d345e77000 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1639748f5341786e server_cookie=b41e5ab71934a3d8 in_seq=0 out_seq=0 2024-09-19T04:38:54.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0b897fa640 1 -- 172.21.15.70:0/1067155121 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d345d5cd70 con 0x55d345e74be0 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0b897fa640 10 client.17742 handle_command_reply: tid=0 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 client.17742 shutdown 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 -- 172.21.15.70:0/1067155121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345dfa370 msgr2=0x55d345dfde40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345dfa370 0x55d345dfde40 secure :-1 s=READY pgs=1162 cs=0 l=1 rev1=1 crypto rx=0x7f0b980127d0 tx=0x7f0b98012c90 comp rx=0 tx=0).stop 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 -- 172.21.15.70:0/1067155121 shutdown_connections 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d345e74be0 0x55d345e77000 crc :-1 s=READY pgs=193 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d345dfa370 0x55d345dfde40 unknown :-1 s=CLOSED pgs=1162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d345df0b40 0x55d345dfd900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0b897fa640 0 client.17742 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 --2- 172.21.15.70:0/1067155121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d345def5d0 0x55d345e025d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 -- 172.21.15.70:0/1067155121 >> 172.21.15.70:0/1067155121 conn(0x55d345db8310 msgr2=0x55d345df6140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:54.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 -- 172.21.15.70:0/1067155121 shutdown_connections 2024-09-19T04:38:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.409+0000 7f0baa320740 1 -- 172.21.15.70:0/1067155121 wait complete. 2024-09-19T04:38:54.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0baa320740 20 client.17742 trim_cache size 0 max 16384 2024-09-19T04:38:54.420 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 -- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b8c0a33b0 msgr2=0x7f0b8c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b8c0a33b0 0x7f0b8c0a5870 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f0ba00fedb0 tx=0x7f0b90009110 comp rx=0 tx=0).stop 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 -- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0100a80 msgr2=0x7f0ba0198600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0100a80 0x7f0ba0198600 secure :-1 s=READY pgs=1158 cs=0 l=1 rev1=1 crypto rx=0x7f0b9c005940 tx=0x7f0b9c004380 comp rx=0 tx=0).stop 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 -- 172.21.15.70:0/3746429340 shutdown_connections 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b8c0a33b0 0x7f0b8c0a5870 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba0106a80 0x7f0ba019ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0ba0101420 0x7f0ba0198b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 --2- 172.21.15.70:0/3746429340 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0ba0100a80 0x7f0ba0198600 unknown :-1 s=CLOSED pgs=1158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:54.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 -- 172.21.15.70:0/3746429340 >> 172.21.15.70:0/3746429340 conn(0x7f0ba00fc7a0 msgr2=0x7f0ba0104970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:54.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 -- 172.21.15.70:0/3746429340 shutdown_connections 2024-09-19T04:38:54.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:54.410+0000 7f0ba7f47640 1 -- 172.21.15.70:0/3746429340 wait complete. 2024-09-19T04:38:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:54 smithi134 ceph-mon[34525]: pgmap v251: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:55.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:54 smithi070 ceph-mon[30942]: pgmap v251: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:54 smithi167 ceph-mon[34339]: pgmap v251: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:56.208 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:38:56.208 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:38:56.467 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:56.869 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:56 smithi070 ceph-mon[30942]: pgmap v252: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:56.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 -- 172.21.15.70:0/756465257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30102570 msgr2=0x7f8c301029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 --2- 172.21.15.70:0/756465257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30102570 0x7f8c301029b0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f8c18009900 tx=0x7f8c1802a480 comp rx=0 tx=0).stop 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 -- 172.21.15.70:0/756465257 shutdown_connections 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 --2- 172.21.15.70:0/756465257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c30102ef0 0x7f8c3010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 --2- 172.21.15.70:0/756465257 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30102570 0x7f8c301029b0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 --2- 172.21.15.70:0/756465257 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c30100e20 0x7f8c30101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 -- 172.21.15.70:0/756465257 >> 172.21.15.70:0/756465257 conn(0x7f8c300fc7d0 msgr2=0x7f8c300febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 -- 172.21.15.70:0/756465257 shutdown_connections 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.950+0000 7f8c36a51640 1 -- 172.21.15.70:0/756465257 wait complete. 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c36a51640 1 Processor -- start 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c36a51640 1 -- start start 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c36a51640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30100e20 0x7f8c30198510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c36a51640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c30102570 0x7f8c30198a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c36a51640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c30102ef0 0x7f8c3019cde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c36a51640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30112090 con 0x7f8c30100e20 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c36a51640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30111f10 con 0x7f8c30102570 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c36a51640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8c30112210 con 0x7f8c30102ef0 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30100e20 0x7f8c30198510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30100e20 0x7f8c30198510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37282/0 (socket says 172.21.15.70:37282) 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.951+0000 7f8c2ffff640 1 -- 172.21.15.70:0/4247760563 learned_addr learned my addr 172.21.15.70:0/4247760563 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c34fee640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c30102ef0 0x7f8c3019cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c30102570 0x7f8c30198a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2ffff640 1 -- 172.21.15.70:0/4247760563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c30102ef0 msgr2=0x7f8c3019cde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c30102ef0 0x7f8c3019cde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2ffff640 1 -- 172.21.15.70:0/4247760563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c30102570 msgr2=0x7f8c30198a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c30102570 0x7f8c30198a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2ffff640 1 -- 172.21.15.70:0/4247760563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c3019d4c0 con 0x7f8c30100e20 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c30102570 0x7f8c30198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30100e20 0x7f8c30198510 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c890 tx=0x7f8c2000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2d7fa640 1 -- 172.21.15.70:0/4247760563 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20004220 con 0x7f8c30100e20 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2d7fa640 1 -- 172.21.15.70:0/4247760563 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8c200043c0 con 0x7f8c30100e20 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c36a51640 1 -- 172.21.15.70:0/4247760563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c3019d7b0 con 0x7f8c30100e20 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c2d7fa640 1 -- 172.21.15.70:0/4247760563 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20004a00 con 0x7f8c30100e20 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.952+0000 7f8c36a51640 1 -- 172.21.15.70:0/4247760563 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c301a5090 con 0x7f8c30100e20 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.954+0000 7f8c2d7fa640 1 -- 172.21.15.70:0/4247760563 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f8c20004ba0 con 0x7f8c30100e20 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c38e2a740 1 Processor -- start 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c38e2a740 1 -- start start 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc83b60 0x55f33bc83f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8e800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc91130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c2d7fa640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8c1c0a33b0 0x7f8c1c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f33bbe9280 con 0x55f33bc84480 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f33bb90b10 con 0x55f33bc83b60 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f33bbe5240 con 0x55f33bc8ed40 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8e800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c34fee640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8c1c0a33b0 0x7f8c1c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8e800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37296/0 (socket says 172.21.15.70:37296) 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c2ffff640 1 -- 172.21.15.70:0/1000079932 learned_addr learned my addr 172.21.15.70:0/1000079932 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc91130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c2d7fa640 1 -- 172.21.15.70:0/4247760563 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8c200cfb50 con 0x7f8c30100e20 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.955+0000 7f8c34fee640 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc83b60 0x55f33bc83f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c2ffff640 1 -- 172.21.15.70:0/1000079932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 msgr2=0x55f33bc91130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc91130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c2ffff640 1 -- 172.21.15.70:0/1000079932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc83b60 msgr2=0x55f33bc83f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc83b60 0x55f33bc83f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c2ffff640 1 -- 172.21.15.70:0/1000079932 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33bb9d1f0 con 0x55f33bc84480 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8e800 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8c20098800 tx=0x7f8c2006dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3440b4bd3731f02d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c34fee640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8c1c0a33b0 0x7f8c1c0a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800a6b0 tx=0x7f8c2800aab0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c267fc640 1 -- 172.21.15.70:0/1000079932 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2001d030 con 0x55f33bc84480 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c267fc640 1 -- 172.21.15.70:0/1000079932 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8c2009c530 con 0x55f33bc84480 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.956+0000 7f8c267fc640 1 -- 172.21.15.70:0/1000079932 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c20004f60 con 0x55f33bc84480 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1000079932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 msgr2=0x55f33bc8e800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8e800 secure :-1 s=READY pgs=1165 cs=0 l=1 rev1=1 crypto rx=0x7f8c20098800 tx=0x7f8c2006dbb0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1000079932 shutdown_connections 2024-09-19T04:38:56.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc91130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8e800 unknown :-1 s=CLOSED pgs=1165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1000079932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc83b60 0x55f33bc83f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1000079932 >> 172.21.15.70:0/1000079932 conn(0x55f33bc800f0 msgr2=0x55f33bc804d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1000079932 shutdown_connections 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1000079932 wait complete. 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- start start 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 Processor -- start 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bc8bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bc8c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc8c690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f33bc91910 con 0x55f33bc83b60 2024-09-19T04:38:56.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f33bba3f10 con 0x55f33bc84480 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.957+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f33bc91a90 con 0x55f33bc8ed40 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c38e2a740 10 client.0 _ll_register_callbacks cb 0x55f33bb6ca40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bc8bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bc8bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37308/0 (socket says 172.21.15.70:37308) 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 -- 172.21.15.70:0/1516155654 learned_addr learned my addr 172.21.15.70:0/1516155654 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bc8c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c34fee640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc8c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 -- 172.21.15.70:0/1516155654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 msgr2=0x55f33bc8c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc8c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 -- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 msgr2=0x55f33bc8c150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bc8c150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 -- 172.21.15.70:0/1516155654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f33b95a6a0 con 0x55f33bc83b60 2024-09-19T04:38:56.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c34fee640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc8c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bc8c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bc8bc10 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f8c20098290 tx=0x7f8c200a0310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a5f61b3ce926b45 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1516155654 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2001d040 con 0x55f33bc83b60 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1516155654 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8c200984a0 con 0x55f33bc83b60 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1516155654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c2009c530 con 0x55f33bc83b60 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1516155654 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8c2009c090 con 0x55f33bc83b60 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c38e2a740 10 client.17754 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1516155654 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f33bc9d510 con 0x55f33bc83b60 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.958+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1516155654 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8c2009c530 con 0x55f33bc83b60 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1516155654 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8c20077ce0 con 0x55f33bc83b60 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c38e2a740 10 client.17754 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:56.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c38e2a740 10 client.17754 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c38e2a740 20 client.17754 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f33bc9e860 0x55f33bca0c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c38e2a740 4 client.17754 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1516155654 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f33bbf67f0 con 0x55f33bc9e860 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f33bc9e860 0x55f33bca0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c0f7fe640 10 client.17754 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.959+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f33bc9e860 0x55f33bca0c50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9b1eab5d889048f server_cookie=5676c72d46433af1 in_seq=0 out_seq=0 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.960+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/1516155654 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f33bbf67f0 con 0x55f33bc9e860 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.960+0000 7f8c0f7fe640 10 client.17754 handle_command_reply: tid=0 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.960+0000 7f8c38e2a740 1 client.17754 shutdown 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1516155654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 msgr2=0x55f33bc8bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bc8bc10 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f8c20098290 tx=0x7f8c200a0310 comp rx=0 tx=0).stop 2024-09-19T04:38:56.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1516155654 shutdown_connections 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f33bc9e860 0x55f33bca0c50 crc :-1 s=READY pgs=194 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bc8c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c0f7fe640 0 client.17754 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bc8c150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/1516155654 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bc8bc10 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1516155654 >> 172.21.15.70:0/1516155654 conn(0x55f33bc800f0 msgr2=0x55f33bc85e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1516155654 shutdown_connections 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 1 -- 172.21.15.70:0/1516155654 wait complete. 2024-09-19T04:38:56.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.961+0000 7f8c38e2a740 20 client.17754 trim_cache size 0 max 16384 2024-09-19T04:38:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.978+0000 7f8c38e2a740 1 Processor -- start 2024-09-19T04:38:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.978+0000 7f8c38e2a740 1 -- start start 2024-09-19T04:38:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc83b60 0x55f33bc87380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8da70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc8ed40 0x55f33bca3c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.986 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301b01b0 con 0x55f33bc84480 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301ada80 con 0x55f33bc8ed40 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301ab8f0 con 0x55f33bc83b60 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8da70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8da70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37318/0 (socket says 172.21.15.70:37318) 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 -- 172.21.15.70:0/3886256858 learned_addr learned my addr 172.21.15.70:0/3886256858 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc83b60 0x55f33bc87380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c34fee640 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc8ed40 0x55f33bca3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 -- 172.21.15.70:0/3886256858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc83b60 msgr2=0x55f33bc87380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc83b60 0x55f33bc87380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 -- 172.21.15.70:0/3886256858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc8ed40 msgr2=0x55f33bca3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc8ed40 0x55f33bca3c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 -- 172.21.15.70:0/3886256858 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f33bc7ff20 con 0x55f33bc84480 2024-09-19T04:38:56.987 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8da70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c300ffe00 tx=0x7f8c18004310 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf41ca6b739c56f2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c25ffb640 1 -- 172.21.15.70:0/3886256858 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c18035040 con 0x55f33bc84480 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.979+0000 7f8c25ffb640 1 -- 172.21.15.70:0/3886256858 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8c18005510 con 0x55f33bc84480 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c25ffb640 1 -- 172.21.15.70:0/3886256858 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c180035f0 con 0x55f33bc84480 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 -- 172.21.15.70:0/3886256858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 msgr2=0x55f33bc8da70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8da70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f8c300ffe00 tx=0x7f8c18004310 comp rx=0 tx=0).stop 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 -- 172.21.15.70:0/3886256858 shutdown_connections 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc8ed40 0x55f33bca3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc84480 0x55f33bc8da70 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/3886256858 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc83b60 0x55f33bc87380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 -- 172.21.15.70:0/3886256858 >> 172.21.15.70:0/3886256858 conn(0x55f33bc800f0 msgr2=0x55f33bc8d360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 -- 172.21.15.70:0/3886256858 shutdown_connections 2024-09-19T04:38:56.988 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.980+0000 7f8c38e2a740 1 -- 172.21.15.70:0/3886256858 wait complete. 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 1 -- start start 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 1 Processor -- start 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bca40f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bca1440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bca1980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301abf40 con 0x55f33bc83b60 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301ad3b0 con 0x55f33bc84480 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f8c301ac610 con 0x55f33bc8ed40 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c38e2a740 10 client.0 _ll_register_callbacks cb 0x7f8c18009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bca40f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c2ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bca40f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37330/0 (socket says 172.21.15.70:37330) 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c2ffff640 1 -- 172.21.15.70:0/41162496 learned_addr learned my addr 172.21.15.70:0/41162496 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:56.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c34fee640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bca1980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bca1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c2ffff640 1 -- 172.21.15.70:0/41162496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 msgr2=0x55f33bca1980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.981+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bca1980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c2ffff640 1 -- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 msgr2=0x55f33bca1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bca1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c2ffff640 1 -- 172.21.15.70:0/41162496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f33bca1ec0 con 0x55f33bc83b60 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c34fee640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bca1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bca1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c2ffff640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bca40f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8c20097b80 tx=0x7f8c2000a5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=842bdc28a65abd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c0f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/41162496 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8c2001d040 con 0x55f33bc83b60 2024-09-19T04:38:56.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/41162496 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f8c20097df0 con 0x55f33bc83b60 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 1 -- 172.21.15.70:0/41162496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8c18005510 con 0x55f33bc83b60 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/41162496 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f8c2009c530 con 0x55f33bc83b60 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 10 client.17760 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 1 -- 172.21.15.70:0/41162496 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f33bd08ef0 con 0x55f33bc83b60 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/41162496 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f8c18005510 con 0x55f33bc83b60 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/41162496 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f8c2009ad80 con 0x55f33bc83b60 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 10 client.17760 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 10 client.17760 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 20 client.17760 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f33bd09480 0x55f33bd0b870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 4 client.17760 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:38:56.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.982+0000 7f8c38e2a740 1 -- 172.21.15.70:0/41162496 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f33bbf0d00 con 0x55f33bd09480 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.983+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f33bd09480 0x55f33bd0b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.983+0000 7f8c2f7fe640 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f33bd09480 0x55f33bd0b870 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ea5b3e056f20809e server_cookie=4ccc6937ccef6790 in_seq=0 out_seq=0 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.983+0000 7f8c0f7fe640 10 client.17760 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c0f7fe640 1 -- 172.21.15.70:0/41162496 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f33bbf0d00 con 0x55f33bd09480 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c0f7fe640 10 client.17760 handle_command_reply: tid=0 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 client.17760 shutdown 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 -- 172.21.15.70:0/41162496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 msgr2=0x55f33bca40f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bca40f0 secure :-1 s=READY pgs=1168 cs=0 l=1 rev1=1 crypto rx=0x7f8c20097b80 tx=0x7f8c2000a5b0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 -- 172.21.15.70:0/41162496 shutdown_connections 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f33bd09480 0x55f33bd0b870 crc :-1 s=READY pgs=195 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f33bc8ed40 0x55f33bca1980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f33bc84480 0x55f33bca1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 --2- 172.21.15.70:0/41162496 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f33bc83b60 0x55f33bca40f0 unknown :-1 s=CLOSED pgs=1168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c38e2a740 1 -- 172.21.15.70:0/41162496 >> 172.21.15.70:0/41162496 conn(0x55f33bc800f0 msgr2=0x55f33bc7f270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.984+0000 7f8c0f7fe640 0 client.17760 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c38e2a740 1 -- 172.21.15.70:0/41162496 shutdown_connections 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c38e2a740 1 -- 172.21.15.70:0/41162496 wait complete. 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c38e2a740 20 client.17760 trim_cache size 0 max 16384 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:38:56.993 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "37e98c4e-7eb1-47d5-8724-bbf90227517d", 2024-09-19T04:38:56.994 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:38:56.994 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 -- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8c1c0a33b0 msgr2=0x7f8c1c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8c1c0a33b0 0x7f8c1c0a5870 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f8c2800a6b0 tx=0x7f8c2800aab0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 -- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30100e20 msgr2=0x7f8c30198510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:56.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30100e20 0x7f8c30198510 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f8c2000c890 tx=0x7f8c2000cd50 comp rx=0 tx=0).stop 2024-09-19T04:38:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 -- 172.21.15.70:0/4247760563 shutdown_connections 2024-09-19T04:38:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f8c1c0a33b0 0x7f8c1c0a5870 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f8c30102ef0 0x7f8c3019cde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c30102570 0x7f8c30198a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 --2- 172.21.15.70:0/4247760563 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f8c30100e20 0x7f8c30198510 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 -- 172.21.15.70:0/4247760563 >> 172.21.15.70:0/4247760563 conn(0x7f8c300fc7d0 msgr2=0x7f8c300febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 -- 172.21.15.70:0/4247760563 shutdown_connections 2024-09-19T04:38:56.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:56.985+0000 7f8c36a51640 1 -- 172.21.15.70:0/4247760563 wait complete. 2024-09-19T04:38:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:56 smithi134 ceph-mon[34525]: pgmap v252: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:57.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:56 smithi167 ceph-mon[34339]: pgmap v252: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:38:57.689 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:38:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:57 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:38:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:57 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:57 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:38:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:57 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:57.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:57 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:38:57.939 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:57 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:38:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:57 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:57 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:38:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:57 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:58.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:57 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:38:58.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:57 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:38:58.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:57 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:58.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:57 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:38:58.112 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:57 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:38:58.113 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:57 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:38:58.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 -- 172.21.15.70:0/1049144080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 msgr2=0x7fdaf010d130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/1049144080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 0x7fdaf010d130 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fdae8009ca0 tx=0x7fdae802a8c0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 -- 172.21.15.70:0/1049144080 shutdown_connections 2024-09-19T04:38:58.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/1049144080 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 0x7fdaf010d130 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/1049144080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf0100e30 0x7fdaf0104e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/1049144080 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaf0100480 0x7fdaf0100860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 -- 172.21.15.70:0/1049144080 >> 172.21.15.70:0/1049144080 conn(0x7fdaf0077210 msgr2=0x7fdaf00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:58.436 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 -- 172.21.15.70:0/1049144080 shutdown_connections 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 -- 172.21.15.70:0/1049144080 wait complete. 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 Processor -- start 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.414+0000 7fdaf6bce640 1 -- start start 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf6bce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaf0100480 0x7fdaf0198560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf6bce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf0100e30 0x7fdaf0198aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf6bce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 0x7fdaf019ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf6bce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf0112020 con 0x7fdaf01055b0 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf6bce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf0111ea0 con 0x7fdaf0100e30 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf6bce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf01121a0 con 0x7fdaf0100480 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 0x7fdaf019ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 0x7fdaf019ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37356/0 (socket says 172.21.15.70:37356) 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 -- 172.21.15.70:0/40667344 learned_addr learned my addr 172.21.15.70:0/40667344 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:58.437 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf496a640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaf0100480 0x7fdaf0198560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaeffff640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf0100e30 0x7fdaf0198aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 -- 172.21.15.70:0/40667344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaf0100480 msgr2=0x7fdaf0198560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaf0100480 0x7fdaf0198560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 -- 172.21.15.70:0/40667344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf0100e30 msgr2=0x7fdaf0198aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf0100e30 0x7fdaf0198aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 -- 172.21.15.70:0/40667344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdaf019d510 con 0x7fdaf01055b0 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf496a640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaf0100480 0x7fdaf0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaf516b640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 0x7fdaf019ce30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fdae80097b0 tx=0x7fdae8003f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaedffb640 1 -- 172.21.15.70:0/40667344 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae8031890 con 0x7fdaf01055b0 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.415+0000 7fdaedffb640 1 -- 172.21.15.70:0/40667344 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdae8004510 con 0x7fdaf01055b0 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.416+0000 7fdaedffb640 1 -- 172.21.15.70:0/40667344 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae802fd40 con 0x7fdaf01055b0 2024-09-19T04:38:58.438 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.416+0000 7fdaf6bce640 1 -- 172.21.15.70:0/40667344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdaf019d7a0 con 0x7fdaf01055b0 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.416+0000 7fdaf6bce640 1 -- 172.21.15.70:0/40667344 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdaf01a50e0 con 0x7fdaf01055b0 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaedffb640 1 -- 172.21.15.70:0/40667344 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fdae8004040 con 0x7fdaf01055b0 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaf8fa7740 1 Processor -- start 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaf8fa7740 1 -- start start 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaedffb640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdae00a33b0 0x7fdae00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12ba4a0 0x55a3d12ba880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12badc0 0x55a3d12c5140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d12c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3d12202e0 con 0x55a3d12c5680 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a3d11c7ce0 con 0x55a3d12badc0 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.418+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a3d121c2a0 con 0x55a3d12ba4a0 2024-09-19T04:38:58.439 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaeffff640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdae00a33b0 0x7fdae00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d12c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d12c7a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37358/0 (socket says 172.21.15.70:37358) 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 -- 172.21.15.70:0/1164439196 learned_addr learned my addr 172.21.15.70:0/1164439196 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaedffb640 1 -- 172.21.15.70:0/40667344 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fdae80f14e0 con 0x7fdaf01055b0 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf496a640 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12ba4a0 0x55a3d12ba880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 -- 172.21.15.70:0/1164439196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12ba4a0 msgr2=0x55a3d12ba880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaeffff640 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12badc0 0x55a3d12c5140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12ba4a0 0x55a3d12ba880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 -- 172.21.15.70:0/1164439196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12badc0 msgr2=0x55a3d12c5140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12badc0 0x55a3d12c5140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 -- 172.21.15.70:0/1164439196 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d11ac440 con 0x55a3d12c5680 2024-09-19T04:38:58.440 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaeffff640 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12badc0 0x55a3d12c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaeffff640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdae00a33b0 0x7fdae00a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdadc006e10 tx=0x7fdadc009340 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdaf516b640 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d12c7a70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fdae80bd5d0 tx=0x7fdae802ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8e834c5c62464b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdadaffd640 1 -- 172.21.15.70:0/1164439196 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae80bd230 con 0x55a3d12c5680 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdadaffd640 1 -- 172.21.15.70:0/1164439196 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdae80098d0 con 0x55a3d12c5680 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.419+0000 7fdadaffd640 1 -- 172.21.15.70:0/1164439196 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae80a8350 con 0x55a3d12c5680 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1164439196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 msgr2=0x55a3d12c7a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d12c7a70 secure :-1 s=READY pgs=1171 cs=0 l=1 rev1=1 crypto rx=0x7fdae80bd5d0 tx=0x7fdae802ec00 comp rx=0 tx=0).stop 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1164439196 shutdown_connections 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d12c7a70 unknown :-1 s=CLOSED pgs=1171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12badc0 0x55a3d12c5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/1164439196 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12ba4a0 0x55a3d12ba880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1164439196 >> 172.21.15.70:0/1164439196 conn(0x55a3d12b6a30 msgr2=0x55a3d12b6e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:58.441 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1164439196 shutdown_connections 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1164439196 wait complete. 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 -- start start 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.420+0000 7fdaf8fa7740 1 Processor -- start 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12badc0 0x55a3d12c2210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12c5680 0x55a3d12c2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55a3d12202e0 con 0x55a3d12badc0 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55a3d11db050 con 0x55a3d12ba4a0 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55a3d12c8010 con 0x55a3d12c5680 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf8fa7740 10 client.0 _ll_register_callbacks cb 0x55a3d121b160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12badc0 0x55a3d12c2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12badc0 0x55a3d12c2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37360/0 (socket says 172.21.15.70:37360) 2024-09-19T04:38:58.442 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 -- 172.21.15.70:0/839159356 learned_addr learned my addr 172.21.15.70:0/839159356 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf496a640 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf516b640 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12c5680 0x55a3d12c2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 -- 172.21.15.70:0/839159356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12c5680 msgr2=0x55a3d12c2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12c5680 0x55a3d12c2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 -- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 msgr2=0x55a3d12c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c4f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 -- 172.21.15.70:0/839159356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3d0f913c0 con 0x55a3d12badc0 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaf496a640 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdaeffff640 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12badc0 0x55a3d12c2210 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0166b0 tx=0x7fdadc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ded49b66b4fe15d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.421+0000 7fdacffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdacffff640 1 -- 172.21.15.70:0/839159356 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdadc026060 con 0x55a3d12badc0 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdacffff640 1 -- 172.21.15.70:0/839159356 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fdadc014a20 con 0x55a3d12badc0 2024-09-19T04:38:58.443 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/839159356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55a3d122d850 con 0x55a3d12badc0 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdacffff640 1 -- 172.21.15.70:0/839159356 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdadc014c20 con 0x55a3d12badc0 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 10 client.17772 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/839159356 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a3d12d3740 con 0x55a3d12badc0 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdacffff640 1 -- 172.21.15.70:0/839159356 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x55a3d122d850 con 0x55a3d12badc0 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdacffff640 1 -- 172.21.15.70:0/839159356 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdadc029420 con 0x55a3d12badc0 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 10 client.17772 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 10 client.17772 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 20 client.17772 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a3d12d4c00 0x55a3d12d7060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 4 client.17772 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/839159356 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a3d1227d60 con 0x55a3d12d4c00 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.422+0000 7fdaf496a640 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a3d12d4c00 0x55a3d12d7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.423+0000 7fdaf496a640 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a3d12d4c00 0x55a3d12d7060 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=77968ccd1b935d2b server_cookie=940a51b112cb938f in_seq=0 out_seq=0 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.423+0000 7fdacffff640 10 client.17772 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.423+0000 7fdacffff640 1 -- 172.21.15.70:0/839159356 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55a3d1227d60 con 0x55a3d12d4c00 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.423+0000 7fdacffff640 10 client.17772 handle_command_reply: tid=0 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.423+0000 7fdaf8fa7740 1 client.17772 shutdown 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/839159356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12badc0 msgr2=0x55a3d12c2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12badc0 0x55a3d12c2210 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7fdadc0166b0 tx=0x7fdadc0046c0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/839159356 shutdown_connections 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a3d12d4c00 0x55a3d12d7060 crc :-1 s=READY pgs=196 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12c5680 0x55a3d12c2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12badc0 0x55a3d12c2210 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/839159356 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdacffff640 0 client.17772 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:58.445 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/839159356 >> 172.21.15.70:0/839159356 conn(0x55a3d12b6a30 msgr2=0x55a3d12bc760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/839159356 shutdown_connections 2024-09-19T04:38:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/839159356 wait complete. 2024-09-19T04:38:58.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.424+0000 7fdaf8fa7740 20 client.17772 trim_cache size 0 max 16384 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf8fa7740 1 Processor -- start 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf8fa7740 1 -- start start 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12ba4a0 0x55a3d12d1060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 0x55a3d12dc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12c5680 0x55a3d12dce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf01b01f0 con 0x55a3d12ba4a0 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf01adac0 con 0x55a3d12c5680 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf01ab930 con 0x55a3d12badc0 2024-09-19T04:38:58.451 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12ba4a0 0x55a3d12d1060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12ba4a0 0x55a3d12d1060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37376/0 (socket says 172.21.15.70:37376) 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 -- 172.21.15.70:0/1210209342 learned_addr learned my addr 172.21.15.70:0/1210209342 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaeffff640 1 --2- 172.21.15.70:0/1210209342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 0x55a3d12dc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 -- 172.21.15.70:0/1210209342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 msgr2=0x55a3d12dc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 --2- 172.21.15.70:0/1210209342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 0x55a3d12dc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 -- 172.21.15.70:0/1210209342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12c5680 msgr2=0x55a3d12dce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 --2- 172.21.15.70:0/1210209342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12c5680 0x55a3d12dce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 -- 172.21.15.70:0/1210209342 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3d12c52d0 con 0x55a3d12ba4a0 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.441+0000 7fdaf496a640 1 --2- 172.21.15.70:0/1210209342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12ba4a0 0x55a3d12d1060 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x55a3d12d7880 tx=0x7fdae4008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa930b57ad53229a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdada7fc640 1 -- 172.21.15.70:0/1210209342 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae401c250 con 0x55a3d12ba4a0 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdada7fc640 1 -- 172.21.15.70:0/1210209342 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdae401c8c0 con 0x55a3d12ba4a0 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdada7fc640 1 -- 172.21.15.70:0/1210209342 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae40147b0 con 0x55a3d12ba4a0 2024-09-19T04:38:58.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1210209342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12ba4a0 msgr2=0x55a3d12d1060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/1210209342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12ba4a0 0x55a3d12d1060 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x55a3d12d7880 tx=0x7fdae4008040 comp rx=0 tx=0).stop 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1210209342 shutdown_connections 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/1210209342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12c5680 0x55a3d12dce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/1210209342 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 0x55a3d12dc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/1210209342 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12ba4a0 0x55a3d12d1060 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1210209342 >> 172.21.15.70:0/1210209342 conn(0x55a3d12b6a30 msgr2=0x55a3d12c1300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1210209342 shutdown_connections 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.442+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/1210209342 wait complete. 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 1 -- start start 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 1 Processor -- start 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 0x55a3d12c9790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.453 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d1342cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf01abf80 con 0x55a3d12c5680 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf01ad3f0 con 0x55a3d12ba4a0 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fdaf01ac650 con 0x55a3d12badc0 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf8fa7740 10 client.0 _ll_register_callbacks cb 0x7fdadc0096b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf516b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d1342cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf516b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d1342cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37378/0 (socket says 172.21.15.70:37378) 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf516b640 1 -- 172.21.15.70:0/2499462477 learned_addr learned my addr 172.21.15.70:0/2499462477 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaeffff640 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 0x55a3d12c9790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf496a640 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf516b640 1 -- 172.21.15.70:0/2499462477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 msgr2=0x55a3d12c9790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.443+0000 7fdaf516b640 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 0x55a3d12c9790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf516b640 1 -- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 msgr2=0x55a3d12c9250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:38:58.454 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf516b640 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c9250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf516b640 1 -- 172.21.15.70:0/2499462477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3d12ca020 con 0x55a3d12c5680 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf496a640 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf516b640 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d1342cc0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fdae80eedf0 tx=0x7fdae80bd2a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=67a3a9d8b53a94a2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdacffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdacffff640 1 -- 172.21.15.70:0/2499462477 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdae80d6ad0 con 0x55a3d12c5680 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdacffff640 1 -- 172.21.15.70:0/2499462477 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fdae80b9f40 con 0x55a3d12c5680 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/2499462477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdae401c8c0 con 0x55a3d12c5680 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdacffff640 1 -- 172.21.15.70:0/2499462477 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fdae8087050 con 0x55a3d12c5680 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 10 client.17778 fetch_fsmap learned FSMap version 34 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/2499462477 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55a3d13442e0 con 0x55a3d12c5680 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdacffff640 1 -- 172.21.15.70:0/2499462477 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fdae401c8c0 con 0x55a3d12c5680 2024-09-19T04:38:58.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdacffff640 1 -- 172.21.15.70:0/2499462477 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fdae802ec70 con 0x55a3d12c5680 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 10 client.17778 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 10 client.17778 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 20 client.17778 populate_metadata read hostname 'smithi070' 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a3d1344950 0x55a3d1346d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 4 client.17778 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.444+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/2499462477 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55a3d12c2ae0 con 0x55a3d1344950 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf496a640 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a3d1344950 0x55a3d1346d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf496a640 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a3d1344950 0x55a3d1346d40 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=df73cd5ad9926300 server_cookie=b38833ed17f40eda in_seq=0 out_seq=0 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdacffff640 10 client.17778 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdacffff640 1 -- 172.21.15.70:0/2499462477 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55a3d12c2ae0 con 0x55a3d1344950 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdacffff640 10 client.17778 handle_command_reply: tid=0 2024-09-19T04:38:58.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf8fa7740 1 client.17778 shutdown 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/2499462477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 msgr2=0x55a3d1342cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d1342cc0 secure :-1 s=READY pgs=1174 cs=0 l=1 rev1=1 crypto rx=0x7fdae80eedf0 tx=0x7fdae80bd2a0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/2499462477 shutdown_connections 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55a3d1344950 0x55a3d1346d40 crc :-1 s=READY pgs=197 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55a3d12c5680 0x55a3d1342cc0 unknown :-1 s=CLOSED pgs=1174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55a3d12badc0 0x55a3d12c9790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.445+0000 7fdaf8fa7740 1 --2- 172.21.15.70:0/2499462477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55a3d12ba4a0 0x55a3d12c9250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/2499462477 >> 172.21.15.70:0/2499462477 conn(0x55a3d12b6a30 msgr2=0x55a3d12bbef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdacffff640 0 client.17778 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/2499462477 shutdown_connections 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf8fa7740 1 -- 172.21.15.70:0/2499462477 wait complete. 2024-09-19T04:38:58.457 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf8fa7740 20 client.17778 trim_cache size 0 max 16384 2024-09-19T04:38:58.458 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:38:58.458 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:38:58.458 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:38:58.458 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 -- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdae00a33b0 msgr2=0x7fdae00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdae00a33b0 0x7fdae00a5870 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fdadc006e10 tx=0x7fdadc009340 comp rx=0 tx=0).stop 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 -- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 msgr2=0x7fdaf019ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 0x7fdaf019ce30 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fdae80097b0 tx=0x7fdae8003f30 comp rx=0 tx=0).stop 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 -- 172.21.15.70:0/40667344 shutdown_connections 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fdae00a33b0 0x7fdae00a5870 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fdaf01055b0 0x7fdaf019ce30 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdaf0100e30 0x7fdaf0198aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 --2- 172.21.15.70:0/40667344 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fdaf0100480 0x7fdaf0198560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:58.459 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 -- 172.21.15.70:0/40667344 >> 172.21.15.70:0/40667344 conn(0x7fdaf0077210 msgr2=0x7fdaf00fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:58.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.446+0000 7fdaf6bce640 1 -- 172.21.15.70:0/40667344 shutdown_connections 2024-09-19T04:38:58.460 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:58.447+0000 7fdaf6bce640 1 -- 172.21.15.70:0/40667344 wait complete. 2024-09-19T04:38:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:38:58 smithi134 ceph-mon[34525]: pgmap v253: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:59.123 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:38:58 smithi070 ceph-mon[30942]: pgmap v253: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:59.150 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:38:59.150 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:38:59.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:38:58 smithi167 ceph-mon[34339]: pgmap v253: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 7 op/s 2024-09-19T04:38:59.394 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:38:59.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 -- 172.21.15.70:0/3627616143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1008103660 msgr2=0x7f100810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:59.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 --2- 172.21.15.70:0/3627616143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1008103660 0x7f100810bb50 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f0ffc009900 tx=0x7f0ffc02a480 comp rx=0 tx=0).stop 2024-09-19T04:38:59.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 -- 172.21.15.70:0/3627616143 shutdown_connections 2024-09-19T04:38:59.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 --2- 172.21.15.70:0/3627616143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f100810c170 0x7f100810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:59.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 --2- 172.21.15.70:0/3627616143 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1008103660 0x7f100810bb50 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:59.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 --2- 172.21.15.70:0/3627616143 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1008102d40 0x7f1008103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:59.847 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 -- 172.21.15.70:0/3627616143 >> 172.21.15.70:0/3627616143 conn(0x7f10080fc7a0 msgr2=0x7f10080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:38:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 -- 172.21.15.70:0/3627616143 shutdown_connections 2024-09-19T04:38:59.848 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.845+0000 7f100e13b640 1 -- 172.21.15.70:0/3627616143 wait complete. 2024-09-19T04:38:59.849 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.846+0000 7f100e13b640 1 Processor -- start 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.846+0000 7f100e13b640 1 -- start start 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.846+0000 7f100e13b640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1008102d40 0x7f1008198430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.846+0000 7f100e13b640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1008103660 0x7f1008198970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.846+0000 7f100e13b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f100810c170 0x7f100819cd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.846+0000 7f100e13b640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1008111f40 con 0x7f100810c170 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.846+0000 7f100e13b640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1008111dc0 con 0x7f1008103660 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.846+0000 7f100e13b640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f10081120c0 con 0x7f1008102d40 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f100810c170 0x7f100819cd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f100810c170 0x7f100819cd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37384/0 (socket says 172.21.15.70:37384) 2024-09-19T04:38:59.850 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 -- 172.21.15.70:0/996764989 learned_addr learned my addr 172.21.15.70:0/996764989 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1006ffd640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1008103660 0x7f1008198970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f10077fe640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1008102d40 0x7f1008198430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 -- 172.21.15.70:0/996764989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1008102d40 msgr2=0x7f1008198430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1008102d40 0x7f1008198430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 -- 172.21.15.70:0/996764989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1008103660 msgr2=0x7f1008198970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1008103660 0x7f1008198970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 -- 172.21.15.70:0/996764989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f100819d3e0 con 0x7f100810c170 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1007fff640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f100810c170 0x7f100819cd00 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f100000e970 tx=0x7f100000ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1004ff9640 1 -- 172.21.15.70:0/996764989 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f100000ccc0 con 0x7f100810c170 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f100819d6d0 con 0x7f100810c170 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1004ff9640 1 -- 172.21.15.70:0/996764989 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f100000ce60 con 0x7f100810c170 2024-09-19T04:38:59.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f1004ff9640 1 -- 172.21.15.70:0/996764989 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1000010430 con 0x7f100810c170 2024-09-19T04:38:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.847+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10081a4fb0 con 0x7f100810c170 2024-09-19T04:38:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.848+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1008103120 con 0x7f100810c170 2024-09-19T04:38:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.849+0000 7f1004ff9640 1 -- 172.21.15.70:0/996764989 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1000005000 con 0x7f100810c170 2024-09-19T04:38:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.850+0000 7f1004ff9640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a33b0 0x7f0ff00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:38:59.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.850+0000 7f10077fe640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a33b0 0x7f0ff00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:38:59.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.850+0000 7f1004ff9640 1 -- 172.21.15.70:0/996764989 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f10000d0140 con 0x7f100810c170 2024-09-19T04:38:59.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.851+0000 7f10077fe640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a33b0 0x7f0ff00a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8005fd0 tx=0x7f0ff8009870 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:38:59.856 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:38:59.854+0000 7f1004ff9640 1 -- 172.21.15.70:0/996764989 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f100009cb20 con 0x7f100810c170 2024-09-19T04:39:00.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.054+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1008106c50 con 0x7f100810c170 2024-09-19T04:39:00.056 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.055+0000 7f1004ff9640 1 -- 172.21.15.70:0/996764989 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f100009c420 con 0x7f100810c170 2024-09-19T04:39:00.057 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:39:00.057 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:39:00.057 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:39:00.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a33b0 msgr2=0x7f0ff00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:00.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a33b0 0x7f0ff00a5870 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0ff8005fd0 tx=0x7f0ff8009870 comp rx=0 tx=0).stop 2024-09-19T04:39:00.058 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f100810c170 msgr2=0x7f100819cd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f100810c170 0x7f100819cd00 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f100000e970 tx=0x7f100000ed70 comp rx=0 tx=0).stop 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 shutdown_connections 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0ff00a33b0 0x7f0ff00a5870 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f100810c170 0x7f100819cd00 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1008103660 0x7f1008198970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 --2- 172.21.15.70:0/996764989 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1008102d40 0x7f1008198430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 >> 172.21.15.70:0/996764989 conn(0x7f10080fc7a0 msgr2=0x7f10080fdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 shutdown_connections 2024-09-19T04:39:00.059 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:00.057+0000 7f100e13b640 1 -- 172.21.15.70:0/996764989 wait complete. 2024-09-19T04:39:00.347 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:00 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/996764989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:00.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:00 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/996764989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:00.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:00 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/996764989' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:00.726 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:39:00.970 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:01.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:01 smithi070 ceph-mon[30942]: pgmap v254: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:39:01.460 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:01 smithi167 ceph-mon[34339]: pgmap v254: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:39:01.535 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:01 smithi134 ceph-mon[34525]: pgmap v254: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:39:01.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 -- 172.21.15.70:0/3043135612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384100e20 msgr2=0x7ff384101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 --2- 172.21.15.70:0/3043135612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384100e20 0x7ff384101200 secure :-1 s=READY pgs=1177 cs=0 l=1 rev1=1 crypto rx=0x7ff374009900 tx=0x7ff37402a480 comp rx=0 tx=0).stop 2024-09-19T04:39:01.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 -- 172.21.15.70:0/3043135612 shutdown_connections 2024-09-19T04:39:01.553 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 --2- 172.21.15.70:0/3043135612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384102ef0 0x7ff38410da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 --2- 172.21.15.70:0/3043135612 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff384102570 0x7ff3841029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 --2- 172.21.15.70:0/3043135612 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384100e20 0x7ff384101200 unknown :-1 s=CLOSED pgs=1177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 -- 172.21.15.70:0/3043135612 >> 172.21.15.70:0/3043135612 conn(0x7ff3840fc7d0 msgr2=0x7ff3840febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 -- 172.21.15.70:0/3043135612 shutdown_connections 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.406+0000 7ff389edc640 1 -- 172.21.15.70:0/3043135612 wait complete. 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff389edc640 1 Processor -- start 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff389edc640 1 -- start start 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff389edc640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff384100e20 0x7ff384199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff389edc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384102570 0x7ff3841998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff389edc640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384102ef0 0x7ff3841a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff389edc640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff384110f50 con 0x7ff384102570 2024-09-19T04:39:01.554 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff389edc640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff384110dd0 con 0x7ff384102ef0 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff389edc640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841110d0 con 0x7ff384100e20 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff37bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384102570 0x7ff3841998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff37bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384102570 0x7ff3841998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37408/0 (socket says 172.21.15.70:37408) 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff37bfff640 1 -- 172.21.15.70:0/594382842 learned_addr learned my addr 172.21.15.70:0/594382842 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.407+0000 7ff3837fe640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff384100e20 0x7ff384199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff383fff640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384102ef0 0x7ff3841a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff37bfff640 1 -- 172.21.15.70:0/594382842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff384100e20 msgr2=0x7ff384199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff37bfff640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff384100e20 0x7ff384199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff37bfff640 1 -- 172.21.15.70:0/594382842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384102ef0 msgr2=0x7ff3841a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff37bfff640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384102ef0 0x7ff3841a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff37bfff640 1 -- 172.21.15.70:0/594382842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3841a4920 con 0x7ff384102570 2024-09-19T04:39:01.555 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff37bfff640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384102570 0x7ff3841998a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00d770 tx=0x7ff36c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff3817fa640 1 -- 172.21.15.70:0/594382842 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c017070 con 0x7ff384102570 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff3817fa640 1 -- 172.21.15.70:0/594382842 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff36c0054f0 con 0x7ff384102570 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff389edc640 1 -- 172.21.15.70:0/594382842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3841a4af0 con 0x7ff384102570 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff3817fa640 1 -- 172.21.15.70:0/594382842 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c004d60 con 0x7ff384102570 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.408+0000 7ff389edc640 1 -- 172.21.15.70:0/594382842 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3841a4fb0 con 0x7ff384102570 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.410+0000 7ff3817fa640 1 -- 172.21.15.70:0/594382842 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff36c004f00 con 0x7ff384102570 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff38c2b5740 1 Processor -- start 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff38c2b5740 1 -- start start 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 0x56546a182090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a182a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18f760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56546a0e82f0 con 0x56546a18d370 2024-09-19T04:39:01.556 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56546a08fcf0 con 0x56546a1825d0 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56546a0e42b0 con 0x56546a183b40 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff3817fa640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff3700a33b0 0x7ff3700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff37bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18f760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff37bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18f760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37414/0 (socket says 172.21.15.70:37414) 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff37bfff640 1 -- 172.21.15.70:0/832984925 learned_addr learned my addr 172.21.15.70:0/832984925 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.411+0000 7ff383fff640 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 0x56546a182090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff383fff640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff3700a33b0 0x7ff3700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff3837fe640 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a182a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff3817fa640 1 -- 172.21.15.70:0/594382842 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff36c0cf770 con 0x7ff384102570 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff37bfff640 1 -- 172.21.15.70:0/832984925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 msgr2=0x56546a182090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff37bfff640 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 0x56546a182090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.557 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff37bfff640 1 -- 172.21.15.70:0/832984925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 msgr2=0x56546a182a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff37bfff640 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a182a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff37bfff640 1 -- 172.21.15.70:0/832984925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56546a0743a0 con 0x56546a18d370 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff383fff640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff3700a33b0 0x7ff3700a5870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009fd0 tx=0x7ff37c009600 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff37bfff640 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18f760 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009610 tx=0x7ff36c09b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cc4483a21b3e41b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff379ffb640 1 -- 172.21.15.70:0/832984925 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c020070 con 0x56546a18d370 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff379ffb640 1 -- 172.21.15.70:0/832984925 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff36c09f070 con 0x56546a18d370 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.412+0000 7ff379ffb640 1 -- 172.21.15.70:0/832984925 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0a4660 con 0x56546a18d370 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 -- 172.21.15.70:0/832984925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 msgr2=0x56546a18f760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18f760 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7ff36c009610 tx=0x7ff36c09b6e0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 -- 172.21.15.70:0/832984925 shutdown_connections 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18f760 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a182a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.558 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/832984925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 0x56546a182090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 -- 172.21.15.70:0/832984925 >> 172.21.15.70:0/832984925 conn(0x56546a14b310 msgr2=0x56546a17ec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 -- 172.21.15.70:0/832984925 shutdown_connections 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 -- 172.21.15.70:0/832984925 wait complete. 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.413+0000 7ff38c2b5740 1 -- start start 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff38c2b5740 1 Processor -- start 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a18cda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 0x56546a18a050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18a7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56546a190070 con 0x56546a18d370 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56546a0a3060 con 0x56546a1825d0 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56546a1901f0 con 0x56546a183b40 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff38c2b5740 10 client.0 _ll_register_callbacks cb 0x565469df68c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff383fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18a7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.559 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff383fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18a7e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37426/0 (socket says 172.21.15.70:37426) 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff383fff640 1 -- 172.21.15.70:0/1750975286 learned_addr learned my addr 172.21.15.70:0/1750975286 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff3837fe640 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a18cda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff37bfff640 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 0x56546a18a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff383fff640 1 -- 172.21.15.70:0/1750975286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 msgr2=0x56546a18a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff383fff640 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 0x56546a18a050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff383fff640 1 -- 172.21.15.70:0/1750975286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 msgr2=0x56546a18cda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff383fff640 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a18cda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.414+0000 7ff383fff640 1 -- 172.21.15.70:0/1750975286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565469e593c0 con 0x56546a18d370 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff383fff640 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18a7e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00ab90 tx=0x7ff37c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8def2f29ec487d46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff362ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff362ffd640 1 -- 172.21.15.70:0/1750975286 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37c01ebb0 con 0x56546a18d370 2024-09-19T04:39:01.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff362ffd640 1 -- 172.21.15.70:0/1750975286 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff37c01ed50 con 0x56546a18d370 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1750975286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff36c09f070 con 0x56546a18d370 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff362ffd640 1 -- 172.21.15.70:0/1750975286 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff37c004b20 con 0x56546a18d370 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 10 client.17796 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1750975286 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56546a19bb50 con 0x56546a18d370 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff362ffd640 1 -- 172.21.15.70:0/1750975286 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff36c09f070 con 0x56546a18d370 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff362ffd640 1 -- 172.21.15.70:0/1750975286 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff37c00f040 con 0x56546a18d370 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 10 client.17796 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 10 client.17796 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 20 client.17796 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56546a19d010 0x56546a19f490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 4 client.17796 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.415+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1750975286 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56546a0f5860 con 0x56546a19d010 2024-09-19T04:39:01.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.416+0000 7ff3837fe640 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56546a19d010 0x56546a19f490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.416+0000 7ff362ffd640 10 client.17796 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.416+0000 7ff3837fe640 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56546a19d010 0x56546a19f490 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=35caaae6420a149b server_cookie=111fc1403311efb7 in_seq=0 out_seq=0 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff362ffd640 1 -- 172.21.15.70:0/1750975286 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56546a0f5860 con 0x56546a19d010 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff362ffd640 10 client.17796 handle_command_reply: tid=0 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 client.17796 shutdown 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1750975286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 msgr2=0x56546a18a7e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18a7e0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7ff37c00ab90 tx=0x7ff37c004a40 comp rx=0 tx=0).stop 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1750975286 shutdown_connections 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56546a19d010 0x56546a19f490 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a18d370 0x56546a18a7e0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a183b40 0x56546a18a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1750975286 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a18cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff362ffd640 0 client.17796 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1750975286 >> 172.21.15.70:0/1750975286 conn(0x56546a14b310 msgr2=0x56546a184990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1750975286 shutdown_connections 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1750975286 wait complete. 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.417+0000 7ff38c2b5740 20 client.17796 trim_cache size 0 max 16384 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff38c2b5740 1 Processor -- start 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff38c2b5740 1 -- start start 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a1a4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a183b40 0x56546a1a52f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a1872b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841b0120 con 0x56546a183b40 2024-09-19T04:39:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841ad9f0 con 0x56546a1825d0 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841ab860 con 0x56546a18d370 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff37bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a183b40 0x56546a1a52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff37bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a183b40 0x56546a1a52f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37440/0 (socket says 172.21.15.70:37440) 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff37bfff640 1 -- 172.21.15.70:0/1192059460 learned_addr learned my addr 172.21.15.70:0/1192059460 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.430+0000 7ff3837fe640 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a1a4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff37bfff640 1 -- 172.21.15.70:0/1192059460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 msgr2=0x56546a1872b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff383fff640 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a1872b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff37bfff640 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a1872b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff37bfff640 1 -- 172.21.15.70:0/1192059460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 msgr2=0x56546a1a4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff37bfff640 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a1a4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff37bfff640 1 -- 172.21.15.70:0/1192059460 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56546a1997f0 con 0x56546a183b40 2024-09-19T04:39:01.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff3837fe640 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a1a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff383fff640 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a1872b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff37bfff640 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a183b40 0x56546a1a52f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff36c09b7a0 tx=0x7ff36c097d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a5b834272a05c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff3797fa640 1 -- 172.21.15.70:0/1192059460 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c0b3070 con 0x56546a183b40 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff3797fa640 1 -- 172.21.15.70:0/1192059460 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff36c09f040 con 0x56546a183b40 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff3797fa640 1 -- 172.21.15.70:0/1192059460 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff36c020040 con 0x56546a183b40 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1192059460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a183b40 msgr2=0x56546a1a52f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a183b40 0x56546a1a52f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7ff36c09b7a0 tx=0x7ff36c097d80 comp rx=0 tx=0).stop 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1192059460 shutdown_connections 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a1872b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a183b40 0x56546a1a52f0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/1192059460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a1825d0 0x56546a1a4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1192059460 >> 172.21.15.70:0/1192059460 conn(0x56546a14b310 msgr2=0x56546a188920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:01.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.431+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1192059460 shutdown_connections 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 -- 172.21.15.70:0/1192059460 wait complete. 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 -- start start 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 Processor -- start 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a1825d0 0x56546a1911f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a183b40 0x56546a191730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a191c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841abeb0 con 0x56546a1825d0 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841ad320 con 0x56546a183b40 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff3841ac580 con 0x56546a18d370 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff38c2b5740 10 client.0 _ll_register_callbacks cb 0x7ff37c012760 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff3837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a1825d0 0x56546a1911f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff3837fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a1825d0 0x56546a1911f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37448/0 (socket says 172.21.15.70:37448) 2024-09-19T04:39:01.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff3837fe640 1 -- 172.21.15.70:0/3946487995 learned_addr learned my addr 172.21.15.70:0/3946487995 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff37bfff640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a183b40 0x56546a191730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.432+0000 7ff383fff640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a191c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff3837fe640 1 -- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 msgr2=0x56546a191c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff3837fe640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a191c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff3837fe640 1 -- 172.21.15.70:0/3946487995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a183b40 msgr2=0x56546a191730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff3837fe640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a183b40 0x56546a191730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff3837fe640 1 -- 172.21.15.70:0/3946487995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56546a20b1c0 con 0x56546a1825d0 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff37bfff640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a183b40 0x56546a191730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff383fff640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a191c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff3837fe640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a1825d0 0x56546a1911f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ff37402a9a0 tx=0x7ff374031e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b12deae3b6869d6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff362ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:01.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff362ffd640 1 -- 172.21.15.70:0/3946487995 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff37404a030 con 0x56546a1825d0 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff362ffd640 1 -- 172.21.15.70:0/3946487995 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7ff374004410 con 0x56546a1825d0 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff38c2b5740 1 -- 172.21.15.70:0/3946487995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff36c09f040 con 0x56546a1825d0 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff362ffd640 1 -- 172.21.15.70:0/3946487995 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff374054050 con 0x56546a1825d0 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff38c2b5740 10 client.17802 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff38c2b5740 1 -- 172.21.15.70:0/3946487995 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56546a20c450 con 0x56546a1825d0 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.433+0000 7ff362ffd640 1 -- 172.21.15.70:0/3946487995 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff36c09f040 con 0x56546a1825d0 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff362ffd640 1 -- 172.21.15.70:0/3946487995 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff3740047a0 con 0x56546a1825d0 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff38c2b5740 10 client.17802 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff38c2b5740 10 client.17802 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff38c2b5740 20 client.17802 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56546a20cba0 0x56546a20efe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:01.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff38c2b5740 4 client.17802 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff38c2b5740 1 -- 172.21.15.70:0/3946487995 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56546a0efd70 con 0x56546a20cba0 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff37bfff640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56546a20cba0 0x56546a20efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff362ffd640 10 client.17802 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff37bfff640 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56546a20cba0 0x56546a20efe0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=9e0216593e0caffe server_cookie=fbce091b383b88e0 in_seq=0 out_seq=0 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff362ffd640 1 -- 172.21.15.70:0/3946487995 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56546a0efd70 con 0x56546a20cba0 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff362ffd640 10 client.17802 handle_command_reply: tid=0 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.434+0000 7ff38c2b5740 1 client.17802 shutdown 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 -- 172.21.15.70:0/3946487995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a1825d0 msgr2=0x56546a1911f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a1825d0 0x56546a1911f0 secure :-1 s=READY pgs=1182 cs=0 l=1 rev1=1 crypto rx=0x7ff37402a9a0 tx=0x7ff374031e00 comp rx=0 tx=0).stop 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 -- 172.21.15.70:0/3946487995 shutdown_connections 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56546a20cba0 0x56546a20efe0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56546a18d370 0x56546a191c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff362ffd640 0 client.17802 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:01.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56546a183b40 0x56546a191730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 --2- 172.21.15.70:0/3946487995 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56546a1825d0 0x56546a1911f0 unknown :-1 s=CLOSED pgs=1182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 -- 172.21.15.70:0/3946487995 >> 172.21.15.70:0/3946487995 conn(0x56546a14b310 msgr2=0x56546a188d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:01.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 -- 172.21.15.70:0/3946487995 shutdown_connections 2024-09-19T04:39:01.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 1 -- 172.21.15.70:0/3946487995 wait complete. 2024-09-19T04:39:01.570 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff38c2b5740 20 client.17802 trim_cache size 0 max 16384 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 -- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff3700a33b0 msgr2=0x7ff3700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff3700a33b0 0x7ff3700a5870 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff37c009fd0 tx=0x7ff37c009600 comp rx=0 tx=0).stop 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 -- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384102570 msgr2=0x7ff3841998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384102570 0x7ff3841998a0 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7ff36c00d770 tx=0x7ff36c00dc30 comp rx=0 tx=0).stop 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 -- 172.21.15.70:0/594382842 shutdown_connections 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff3700a33b0 0x7ff3700a5870 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff384102ef0 0x7ff3841a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff384102570 0x7ff3841998a0 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 --2- 172.21.15.70:0/594382842 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff384100e20 0x7ff384199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 -- 172.21.15.70:0/594382842 >> 172.21.15.70:0/594382842 conn(0x7ff3840fc7d0 msgr2=0x7ff3840febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:01.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 -- 172.21.15.70:0/594382842 shutdown_connections 2024-09-19T04:39:01.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:01.435+0000 7ff389edc640 1 -- 172.21.15.70:0/594382842 wait complete. 2024-09-19T04:39:02.375 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:39:02.630 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:03.028 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:02 smithi070 ceph-mon[30942]: pgmap v255: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:39:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:02 smithi134 ceph-mon[34525]: pgmap v255: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:39:03.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.107+0000 7fd07d439640 1 -- 172.21.15.70:0/3183380493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 msgr2=0x7fd078103170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.107+0000 7fd07d439640 1 --2- 172.21.15.70:0/3183380493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 0x7fd078103170 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7fd068009900 tx=0x7fd06802a480 comp rx=0 tx=0).stop 2024-09-19T04:39:03.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.107+0000 7fd07d439640 1 -- 172.21.15.70:0/3183380493 shutdown_connections 2024-09-19T04:39:03.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.107+0000 7fd07d439640 1 --2- 172.21.15.70:0/3183380493 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07810c170 0x7fd07810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.107+0000 7fd07d439640 1 --2- 172.21.15.70:0/3183380493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0781036b0 0x7fd07810bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.107+0000 7fd07d439640 1 --2- 172.21.15.70:0/3183380493 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 0x7fd078103170 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.107+0000 7fd07d439640 1 -- 172.21.15.70:0/3183380493 >> 172.21.15.70:0/3183380493 conn(0x7fd0780fc7d0 msgr2=0x7fd0780febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:03.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.108+0000 7fd07d439640 1 -- 172.21.15.70:0/3183380493 shutdown_connections 2024-09-19T04:39:03.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.108+0000 7fd07d439640 1 -- 172.21.15.70:0/3183380493 wait complete. 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.108+0000 7fd07d439640 1 Processor -- start 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.108+0000 7fd07d439640 1 -- start start 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd07d439640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 0x7fd078198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd07d439640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0781036b0 0x7fd078198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd07d439640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07810c170 0x7fd07819ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd07d439640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd078111fa0 con 0x7fd078102d90 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd07d439640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd078111e20 con 0x7fd0781036b0 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd07d439640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd078112120 con 0x7fd07810c170 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 0x7fd078198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 0x7fd078198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37458/0 (socket says 172.21.15.70:37458) 2024-09-19T04:39:03.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 -- 172.21.15.70:0/2768315990 learned_addr learned my addr 172.21.15.70:0/2768315990 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd0767fc640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0781036b0 0x7fd078198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd0777fe640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07810c170 0x7fd07819ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 -- 172.21.15.70:0/2768315990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07810c170 msgr2=0x7fd07819ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07810c170 0x7fd07819ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 -- 172.21.15.70:0/2768315990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0781036b0 msgr2=0x7fd078198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0781036b0 0x7fd078198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 -- 172.21.15.70:0/2768315990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd07819d3d0 con 0x7fd078102d90 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd0767fc640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0781036b0 0x7fd078198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd076ffd640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 0x7fd078198420 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd068009a20 tx=0x7fd0680043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd05ffff640 1 -- 172.21.15.70:0/2768315990 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06803f030 con 0x7fd078102d90 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd07d439640 1 -- 172.21.15.70:0/2768315990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd07819d660 con 0x7fd078102d90 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd05ffff640 1 -- 172.21.15.70:0/2768315990 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd068031b80 con 0x7fd078102d90 2024-09-19T04:39:03.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.109+0000 7fd05ffff640 1 -- 172.21.15.70:0/2768315990 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd068035070 con 0x7fd078102d90 2024-09-19T04:39:03.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.110+0000 7fd07d439640 1 -- 172.21.15.70:0/2768315990 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0781a4fa0 con 0x7fd078102d90 2024-09-19T04:39:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.112+0000 7fd05ffff640 1 -- 172.21.15.70:0/2768315990 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd0680035f0 con 0x7fd078102d90 2024-09-19T04:39:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.112+0000 7fd07f812740 1 Processor -- start 2024-09-19T04:39:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd07f812740 1 -- start start 2024-09-19T04:39:03.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd07f812740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940ab090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd07f812740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940aba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd07f812740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd07f812740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5622940112f0 con 0x5622940ab5d0 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd07f812740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562293fb8cf0 con 0x5622940acb40 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd07f812740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56229400d2b0 con 0x5622940b6370 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940aba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940aba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37474/0 (socket says 172.21.15.70:37474) 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd076ffd640 1 -- 172.21.15.70:0/189691988 learned_addr learned my addr 172.21.15.70:0/189691988 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd05ffff640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd0600a33b0 0x7fd0600a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd0767fc640 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd0777fe640 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940ab090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd076ffd640 1 -- 172.21.15.70:0/189691988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 msgr2=0x5622940b8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:03.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd076ffd640 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd076ffd640 1 -- 172.21.15.70:0/189691988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 msgr2=0x5622940ab090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd076ffd640 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940ab090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd076ffd640 1 -- 172.21.15.70:0/189691988 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562293f9d3a0 con 0x5622940ab5d0 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd0767fc640 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd0777fe640 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd0777fe640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd0600a33b0 0x7fd0600a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.113+0000 7fd05ffff640 1 -- 172.21.15.70:0/2768315990 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd0680f08e0 con 0x7fd078102d90 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.114+0000 7fd076ffd640 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940aba10 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd0680edfa0 tx=0x7fd06804b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c566a74e9aceaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.114+0000 7fd05d7fa640 1 -- 172.21.15.70:0/189691988 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680bc700 con 0x5622940ab5d0 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.114+0000 7fd05d7fa640 1 -- 172.21.15.70:0/189691988 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd0680047a0 con 0x5622940ab5d0 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.114+0000 7fd05d7fa640 1 -- 172.21.15.70:0/189691988 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680bc520 con 0x5622940ab5d0 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.114+0000 7fd07f812740 1 -- 172.21.15.70:0/189691988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 msgr2=0x5622940aba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.114+0000 7fd0777fe640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd0600a33b0 0x7fd0600a5870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd070009f80 tx=0x7fd07000e040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.114+0000 7fd07f812740 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940aba10 secure :-1 s=READY pgs=1185 cs=0 l=1 rev1=1 crypto rx=0x7fd0680edfa0 tx=0x7fd06804b000 comp rx=0 tx=0).stop 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 -- 172.21.15.70:0/189691988 shutdown_connections 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940aba10 unknown :-1 s=CLOSED pgs=1185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 --2- 172.21.15.70:0/189691988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940ab090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 -- 172.21.15.70:0/189691988 >> 172.21.15.70:0/189691988 conn(0x562294074310 msgr2=0x5622940a7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 -- 172.21.15.70:0/189691988 shutdown_connections 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 -- 172.21.15.70:0/189691988 wait complete. 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 -- start start 2024-09-19T04:39:03.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 Processor -- start 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940b5d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940b3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b3600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5622940b8e30 con 0x5622940ab5d0 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x562293fcc060 con 0x5622940acb40 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5622940b8fb0 con 0x5622940b6370 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940b5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd07f812740 10 client.0 _ll_register_callbacks cb 0x562293d1f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:03.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940b5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37484/0 (socket says 172.21.15.70:37484) 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.115+0000 7fd076ffd640 1 -- 172.21.15.70:0/4101926722 learned_addr learned my addr 172.21.15.70:0/4101926722 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd0777fe640 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b3600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd0767fc640 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940b3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd076ffd640 1 -- 172.21.15.70:0/4101926722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 msgr2=0x5622940b3600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd076ffd640 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b3600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd076ffd640 1 -- 172.21.15.70:0/4101926722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 msgr2=0x5622940b3010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd076ffd640 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940b3010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd076ffd640 1 -- 172.21.15.70:0/4101926722 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562293d823c0 con 0x5622940ab5d0 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd076ffd640 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940b5d60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd0680c5300 tx=0x7fd068003cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5080bcdaa5dbbfd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd05aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd05aff5640 1 -- 172.21.15.70:0/4101926722 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680bc520 con 0x5622940ab5d0 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd05aff5640 1 -- 172.21.15.70:0/4101926722 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd0680baec0 con 0x5622940ab5d0 2024-09-19T04:39:03.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd07f812740 1 -- 172.21.15.70:0/4101926722 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd0680047a0 con 0x5622940ab5d0 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd05aff5640 1 -- 172.21.15.70:0/4101926722 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd068049020 con 0x5622940ab5d0 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd07f812740 10 client.17814 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd07f812740 1 -- 172.21.15.70:0/4101926722 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5622940b8e30 con 0x5622940ab5d0 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.116+0000 7fd05aff5640 1 -- 172.21.15.70:0/4101926722 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd0680047a0 con 0x5622940ab5d0 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd05aff5640 1 -- 172.21.15.70:0/4101926722 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd0680ee2b0 con 0x5622940ab5d0 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd07f812740 10 client.17814 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd07f812740 10 client.17814 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd07f812740 20 client.17814 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd07f812740 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5622940c59c0 0x5622940c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd07f812740 4 client.17814 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd07f812740 1 -- 172.21.15.70:0/4101926722 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56229401e860 con 0x5622940c59c0 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd0767fc640 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5622940c59c0 0x5622940c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd05aff5640 10 client.17814 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.117+0000 7fd0767fc640 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5622940c59c0 0x5622940c7db0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=360617a8bbdf0c91 server_cookie=4469ea95f9a9de3 in_seq=0 out_seq=0 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd05aff5640 1 -- 172.21.15.70:0/4101926722 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56229401e860 con 0x5622940c59c0 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd05aff5640 10 client.17814 handle_command_reply: tid=0 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 client.17814 shutdown 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 -- 172.21.15.70:0/4101926722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 msgr2=0x5622940b5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940b5d60 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fd0680c5300 tx=0x7fd068003cc0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 -- 172.21.15.70:0/4101926722 shutdown_connections 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5622940c59c0 0x5622940c7db0 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940b6370 0x5622940b3600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940acb40 0x5622940b3010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd05aff5640 0 client.17814 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 --2- 172.21.15.70:0/4101926722 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940b5d60 unknown :-1 s=CLOSED pgs=1186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 -- 172.21.15.70:0/4101926722 >> 172.21.15.70:0/4101926722 conn(0x562294074310 msgr2=0x5622940ad930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:03.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 -- 172.21.15.70:0/4101926722 shutdown_connections 2024-09-19T04:39:03.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.118+0000 7fd07f812740 1 -- 172.21.15.70:0/4101926722 wait complete. 2024-09-19T04:39:03.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.119+0000 7fd07f812740 20 client.17814 trim_cache size 0 max 16384 2024-09-19T04:39:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.131+0000 7fd07f812740 1 Processor -- start 2024-09-19T04:39:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.131+0000 7fd07f812740 1 -- start start 2024-09-19T04:39:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd07f812740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940ab5d0 0x5622940c2000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd07f812740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940acb40 0x5622940b1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd07f812740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 0x5622940cd6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd07f812740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781b00f0 con 0x5622940acb40 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd07f812740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ad9c0 con 0x5622940b6370 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd07f812740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ab830 con 0x5622940ab5d0 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940acb40 0x5622940b1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940acb40 0x5622940b1ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37488/0 (socket says 172.21.15.70:37488) 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 -- 172.21.15.70:0/2952371694 learned_addr learned my addr 172.21.15.70:0/2952371694 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0777fe640 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 0x5622940cd6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd076ffd640 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940ab5d0 0x5622940c2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 -- 172.21.15.70:0/2952371694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940ab5d0 msgr2=0x5622940c2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940ab5d0 0x5622940c2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 -- 172.21.15.70:0/2952371694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 msgr2=0x5622940cd6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:03.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 0x5622940cd6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 -- 172.21.15.70:0/2952371694 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622940ae120 con 0x5622940acb40 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd076ffd640 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940ab5d0 0x5622940c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd0767fc640 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940acb40 0x5622940b1ff0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd06c005fd0 tx=0x7fd06c004410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b97a9a7b5bdfb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.132+0000 7fd05cff9640 1 -- 172.21.15.70:0/2952371694 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c003de0 con 0x5622940acb40 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd05cff9640 1 -- 172.21.15.70:0/2952371694 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd06c01f070 con 0x5622940acb40 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd05cff9640 1 -- 172.21.15.70:0/2952371694 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd06c01a5d0 con 0x5622940acb40 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 -- 172.21.15.70:0/2952371694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940acb40 msgr2=0x5622940b1ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940acb40 0x5622940b1ff0 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fd06c005fd0 tx=0x7fd06c004410 comp rx=0 tx=0).stop 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 -- 172.21.15.70:0/2952371694 shutdown_connections 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 0x5622940cd6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940acb40 0x5622940b1ff0 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 --2- 172.21.15.70:0/2952371694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940ab5d0 0x5622940c2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 -- 172.21.15.70:0/2952371694 >> 172.21.15.70:0/2952371694 conn(0x562294074310 msgr2=0x5622940b18e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 -- 172.21.15.70:0/2952371694 shutdown_connections 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 -- 172.21.15.70:0/2952371694 wait complete. 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.133+0000 7fd07f812740 1 -- start start 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd07f812740 1 Processor -- start 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd07f812740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940be810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd07f812740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940acb40 0x5622940b9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd07f812740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 0x5622940ba0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd07f812740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781abe80 con 0x5622940ab5d0 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd07f812740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ad2f0 con 0x5622940b6370 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd07f812740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd0781ac550 con 0x5622940acb40 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd07f812740 10 client.0 _ll_register_callbacks cb 0x7fd0680b8d20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940be810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.142 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940be810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:37494/0 (socket says 172.21.15.70:37494) 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 -- 172.21.15.70:0/1182692510 learned_addr learned my addr 172.21.15.70:0/1182692510 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd0777fe640 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 0x5622940ba0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd0767fc640 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940acb40 0x5622940b9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 -- 172.21.15.70:0/1182692510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940acb40 msgr2=0x5622940b9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940acb40 0x5622940b9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 -- 172.21.15.70:0/1182692510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 msgr2=0x5622940ba0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 0x5622940ba0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 -- 172.21.15.70:0/1182692510 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622940ba900 con 0x5622940ab5d0 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd076ffd640 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940be810 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd068005ab0 tx=0x7fd0680b92c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2232ca35602838b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.134+0000 7fd05aff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd05aff5640 1 -- 172.21.15.70:0/1182692510 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0680bc700 con 0x5622940ab5d0 2024-09-19T04:39:03.143 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd05aff5640 1 -- 172.21.15.70:0/1182692510 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fd0680c53a0 con 0x5622940ab5d0 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 1 -- 172.21.15.70:0/1182692510 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd06c01f070 con 0x5622940ab5d0 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd05aff5640 1 -- 172.21.15.70:0/1182692510 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd0680bc520 con 0x5622940ab5d0 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 10 client.17820 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 1 -- 172.21.15.70:0/1182692510 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5622940ba900 con 0x5622940ab5d0 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd05aff5640 1 -- 172.21.15.70:0/1182692510 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd06c01f070 con 0x5622940ab5d0 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd05aff5640 1 -- 172.21.15.70:0/1182692510 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd0680bce20 con 0x5622940ab5d0 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 10 client.17820 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 10 client.17820 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 20 client.17820 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5622941308d0 0x562294132cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 4 client.17820 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:03.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd07f812740 1 -- 172.21.15.70:0/1182692510 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x562294018d70 con 0x5622941308d0 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.135+0000 7fd0767fc640 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5622941308d0 0x562294132cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd0767fc640 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5622941308d0 0x562294132cc0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=22a538d10fd60640 server_cookie=10dbf968f037264c in_seq=0 out_seq=0 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd05aff5640 10 client.17820 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd05aff5640 1 -- 172.21.15.70:0/1182692510 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x562294018d70 con 0x5622941308d0 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd05aff5640 10 client.17820 handle_command_reply: tid=0 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 client.17820 shutdown 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 -- 172.21.15.70:0/1182692510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 msgr2=0x5622940be810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940be810 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7fd068005ab0 tx=0x7fd0680b92c0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 -- 172.21.15.70:0/1182692510 shutdown_connections 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5622941308d0 0x562294132cc0 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5622940b6370 0x5622940ba0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5622940acb40 0x5622940b9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 --2- 172.21.15.70:0/1182692510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5622940ab5d0 0x5622940be810 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 -- 172.21.15.70:0/1182692510 >> 172.21.15.70:0/1182692510 conn(0x562294074310 msgr2=0x5622940a64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd05aff5640 0 client.17820 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 -- 172.21.15.70:0/1182692510 shutdown_connections 2024-09-19T04:39:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 1 -- 172.21.15.70:0/1182692510 wait complete. 2024-09-19T04:39:03.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.136+0000 7fd07f812740 20 client.17820 trim_cache size 0 max 16384 2024-09-19T04:39:03.146 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 -- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd0600a33b0 msgr2=0x7fd0600a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd0600a33b0 0x7fd0600a5870 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7fd070009f80 tx=0x7fd07000e040 comp rx=0 tx=0).stop 2024-09-19T04:39:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 -- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 msgr2=0x7fd078198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 0x7fd078198420 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7fd068009a20 tx=0x7fd0680043b0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 -- 172.21.15.70:0/2768315990 shutdown_connections 2024-09-19T04:39:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd0600a33b0 0x7fd0600a5870 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd07810c170 0x7fd07819ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd0781036b0 0x7fd078198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 --2- 172.21.15.70:0/2768315990 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd078102d90 0x7fd078198420 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 -- 172.21.15.70:0/2768315990 >> 172.21.15.70:0/2768315990 conn(0x7fd0780fc7d0 msgr2=0x7fd0780fdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 -- 172.21.15.70:0/2768315990 shutdown_connections 2024-09-19T04:39:03.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:03.137+0000 7fd07d439640 1 -- 172.21.15.70:0/2768315990 wait complete. 2024-09-19T04:39:03.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:02 smithi167 ceph-mon[34339]: pgmap v255: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:39:03.864 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:39:04.111 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:04.629 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.573+0000 7fb95ea4d640 1 -- 172.21.15.70:0/2602964184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 msgr2=0x7fb9581029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.573+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/2602964184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 0x7fb9581029b0 secure :-1 s=READY pgs=1189 cs=0 l=1 rev1=1 crypto rx=0x7fb94c009900 tx=0x7fb94c02a480 comp rx=0 tx=0).stop 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.573+0000 7fb95ea4d640 1 -- 172.21.15.70:0/2602964184 shutdown_connections 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.573+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/2602964184 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb958102ef0 0x7fb95810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.573+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/2602964184 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 0x7fb9581029b0 unknown :-1 s=CLOSED pgs=1189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.573+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/2602964184 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958100e20 0x7fb958101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.573+0000 7fb95ea4d640 1 -- 172.21.15.70:0/2602964184 >> 172.21.15.70:0/2602964184 conn(0x7fb9580fc7d0 msgr2=0x7fb9580febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.574+0000 7fb95ea4d640 1 -- 172.21.15.70:0/2602964184 shutdown_connections 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.574+0000 7fb95ea4d640 1 -- 172.21.15.70:0/2602964184 wait complete. 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.574+0000 7fb95ea4d640 1 Processor -- start 2024-09-19T04:39:04.630 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.574+0000 7fb95ea4d640 1 -- start start 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb95ea4d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb958100e20 0x7fb958199360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb95ea4d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 0x7fb9581998a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb95ea4d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958102ef0 0x7fb9581a43e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb95ea4d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb958110f50 con 0x7fb958102570 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb95ea4d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb958110dd0 con 0x7fb958102ef0 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb95ea4d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9581110d0 con 0x7fb958100e20 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 0x7fb9581998a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 0x7fb9581998a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52364/0 (socket says 172.21.15.70:52364) 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb9577fe640 1 -- 172.21.15.70:0/1388639779 learned_addr learned my addr 172.21.15.70:0/1388639779 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb957fff640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb958100e20 0x7fb958199360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb95cfea640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958102ef0 0x7fb9581a43e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb9577fe640 1 -- 172.21.15.70:0/1388639779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb958100e20 msgr2=0x7fb958199360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.631 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb9577fe640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb958100e20 0x7fb958199360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb9577fe640 1 -- 172.21.15.70:0/1388639779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958102ef0 msgr2=0x7fb9581a43e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb9577fe640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958102ef0 0x7fb9581a43e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.575+0000 7fb9577fe640 1 -- 172.21.15.70:0/1388639779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9581a4920 con 0x7fb958102570 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.576+0000 7fb9577fe640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 0x7fb9581998a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb94c005940 tx=0x7fb94c0040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.576+0000 7fb9557fa640 1 -- 172.21.15.70:0/1388639779 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c03f030 con 0x7fb958102570 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.576+0000 7fb9557fa640 1 -- 172.21.15.70:0/1388639779 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb94c0044c0 con 0x7fb958102570 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.576+0000 7fb95ea4d640 1 -- 172.21.15.70:0/1388639779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9581a4af0 con 0x7fb958102570 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.576+0000 7fb9557fa640 1 -- 172.21.15.70:0/1388639779 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c035070 con 0x7fb958102570 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.576+0000 7fb95ea4d640 1 -- 172.21.15.70:0/1388639779 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9581a4fa0 con 0x7fb958102570 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.578+0000 7fb9557fa640 1 -- 172.21.15.70:0/1388639779 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fb94c042030 con 0x7fb958102570 2024-09-19T04:39:04.632 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.579+0000 7fb9557fa640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb9400a33b0 0x7fb9400a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.579+0000 7fb957fff640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb9400a33b0 0x7fb9400a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.579+0000 7fb9557fa640 1 -- 172.21.15.70:0/1388639779 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb94c0f0120 con 0x7fb958102570 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.579+0000 7fb957fff640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb9400a33b0 0x7fb9400a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb948009bd0 tx=0x7fb948005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.579+0000 7fb960e26740 1 Processor -- start 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.579+0000 7fb960e26740 1 -- start start 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb960e26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065628090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb960e26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 0x55d065628a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb960e26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d065635760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb960e26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d06558e2f0 con 0x55d065629b40 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb960e26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d065535cf0 con 0x55d065633370 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb960e26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d06558a2b0 con 0x55d0656285d0 2024-09-19T04:39:04.633 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065628090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065628090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52372/0 (socket says 172.21.15.70:52372) 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 -- 172.21.15.70:0/3638236122 learned_addr learned my addr 172.21.15.70:0/3638236122 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb9577fe640 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 0x55d065628a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb95cfea640 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d065635760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 -- 172.21.15.70:0/3638236122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 msgr2=0x55d065628a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 0x55d065628a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 -- 172.21.15.70:0/3638236122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 msgr2=0x55d065635760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d065635760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 -- 172.21.15.70:0/3638236122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d06551a3a0 con 0x55d065629b40 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.580+0000 7fb957fff640 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065628090 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb94800e630 tx=0x7fb948014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb0c00d1361eea7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:04.634 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.581+0000 7fb93e7fc640 1 -- 172.21.15.70:0/3638236122 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948004020 con 0x55d065629b40 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.581+0000 7fb93e7fc640 1 -- 172.21.15.70:0/3638236122 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb9480041c0 con 0x55d065629b40 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.581+0000 7fb93e7fc640 1 -- 172.21.15.70:0/3638236122 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94801c6d0 con 0x55d065629b40 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 -- 172.21.15.70:0/3638236122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 msgr2=0x55d065628090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065628090 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7fb94800e630 tx=0x7fb948014000 comp rx=0 tx=0).stop 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 -- 172.21.15.70:0/3638236122 shutdown_connections 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d065635760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 0x55d065628a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 --2- 172.21.15.70:0/3638236122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065628090 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 -- 172.21.15.70:0/3638236122 >> 172.21.15.70:0/3638236122 conn(0x55d0655f1310 msgr2=0x55d065624c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 -- 172.21.15.70:0/3638236122 shutdown_connections 2024-09-19T04:39:04.635 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 -- 172.21.15.70:0/3638236122 wait complete. 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 -- start start 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.582+0000 7fb960e26740 1 Processor -- start 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb960e26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0656285d0 0x55d065632d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb960e26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065630000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb960e26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065633370 0x55d0656305d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb960e26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d065636070 con 0x55d065629b40 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb960e26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d065549060 con 0x55d0656285d0 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb960e26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d0656361f0 con 0x55d065633370 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb960e26740 10 client.0 _ll_register_callbacks cb 0x55d06529c8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065630000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065630000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52378/0 (socket says 172.21.15.70:52378) 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 -- 172.21.15.70:0/3499034690 learned_addr learned my addr 172.21.15.70:0/3499034690 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:04.636 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb95cfea640 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065633370 0x55d0656305d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb957fff640 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0656285d0 0x55d065632d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 -- 172.21.15.70:0/3499034690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065633370 msgr2=0x55d0656305d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065633370 0x55d0656305d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 -- 172.21.15.70:0/3499034690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0656285d0 msgr2=0x55d065632d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0656285d0 0x55d065632d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 -- 172.21.15.70:0/3499034690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0652ff3c0 con 0x55d065629b40 2024-09-19T04:39:04.637 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9577fe640 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065630000 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0bc1b0 tx=0x7fb94c003ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a8f3cd8998b0f09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.583+0000 7fb9377fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb9377fe640 1 -- 172.21.15.70:0/3499034690 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c049070 con 0x55d065629b40 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb9377fe640 1 -- 172.21.15.70:0/3499034690 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb94c0c4be0 con 0x55d065629b40 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 1 -- 172.21.15.70:0/3499034690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb9480041c0 con 0x55d065629b40 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb9377fe640 1 -- 172.21.15.70:0/3499034690 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb94c0c5070 con 0x55d065629b40 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 10 client.17832 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 1 -- 172.21.15.70:0/3499034690 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d065641af0 con 0x55d065629b40 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb9377fe640 1 -- 172.21.15.70:0/3499034690 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb9480041c0 con 0x55d065629b40 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb9377fe640 1 -- 172.21.15.70:0/3499034690 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb94c0b8200 con 0x55d065629b40 2024-09-19T04:39:04.638 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 10 client.17832 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 10 client.17832 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 20 client.17832 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d065642f50 0x55d065645340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 4 client.17832 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb960e26740 1 -- 172.21.15.70:0/3499034690 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d06559b860 con 0x55d065642f50 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.584+0000 7fb957fff640 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d065642f50 0x55d065645340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.585+0000 7fb9377fe640 10 client.17832 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.585+0000 7fb957fff640 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d065642f50 0x55d065645340 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b7ac3680b7ae8de2 server_cookie=fa48b9610fe60be7 in_seq=0 out_seq=0 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.585+0000 7fb9377fe640 1 -- 172.21.15.70:0/3499034690 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d06559b860 con 0x55d065642f50 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.585+0000 7fb9377fe640 10 client.17832 handle_command_reply: tid=0 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 client.17832 shutdown 2024-09-19T04:39:04.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 -- 172.21.15.70:0/3499034690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 msgr2=0x55d065630000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065630000 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0bc1b0 tx=0x7fb94c003ef0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 -- 172.21.15.70:0/3499034690 shutdown_connections 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d065642f50 0x55d065645340 crc :-1 s=READY pgs=198 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065633370 0x55d0656305d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065630000 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 --2- 172.21.15.70:0/3499034690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d0656285d0 0x55d065632d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb9377fe640 0 client.17832 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 -- 172.21.15.70:0/3499034690 >> 172.21.15.70:0/3499034690 conn(0x55d0655f1310 msgr2=0x55d06562a960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 -- 172.21.15.70:0/3499034690 shutdown_connections 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 1 -- 172.21.15.70:0/3499034690 wait complete. 2024-09-19T04:39:04.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.586+0000 7fb960e26740 20 client.17832 trim_cache size 0 max 16384 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb960e26740 1 Processor -- start 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb960e26740 1 -- start start 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb960e26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0656285d0 0x55d06563f310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb960e26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065629b40 0x55d06564ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb960e26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d06564b150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb960e26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9581b0050 con 0x55d0656285d0 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb960e26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9581ad920 con 0x55d065633370 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb960e26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9581ab790 con 0x55d065629b40 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb957fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0656285d0 0x55d06563f310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb957fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0656285d0 0x55d06563f310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52382/0 (socket says 172.21.15.70:52382) 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb957fff640 1 -- 172.21.15.70:0/3764528073 learned_addr learned my addr 172.21.15.70:0/3764528073 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:04.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb9577fe640 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065629b40 0x55d06564ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb95cfea640 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d06564b150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb957fff640 1 -- 172.21.15.70:0/3764528073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065629b40 msgr2=0x55d06564ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb957fff640 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065629b40 0x55d06564ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb957fff640 1 -- 172.21.15.70:0/3764528073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 msgr2=0x55d06564b150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb957fff640 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d06564b150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.599+0000 7fb957fff640 1 -- 172.21.15.70:0/3764528073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d0656456b0 con 0x55d0656285d0 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.600+0000 7fb957fff640 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0656285d0 0x55d06563f310 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb94800e5d0 tx=0x7fb948004080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204d5bd76c5c3594 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.600+0000 7fb93dffb640 1 -- 172.21.15.70:0/3764528073 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9480035f0 con 0x55d0656285d0 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.600+0000 7fb93dffb640 1 -- 172.21.15.70:0/3764528073 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb948003c60 con 0x55d0656285d0 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.600+0000 7fb93dffb640 1 -- 172.21.15.70:0/3764528073 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb948034910 con 0x55d0656285d0 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 -- 172.21.15.70:0/3764528073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0656285d0 msgr2=0x55d06563f310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0656285d0 0x55d06563f310 secure :-1 s=READY pgs=1193 cs=0 l=1 rev1=1 crypto rx=0x7fb94800e5d0 tx=0x7fb948004080 comp rx=0 tx=0).stop 2024-09-19T04:39:04.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 -- 172.21.15.70:0/3764528073 shutdown_connections 2024-09-19T04:39:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d06564b150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d065629b40 0x55d06564ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 --2- 172.21.15.70:0/3764528073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d0656285d0 0x55d06563f310 unknown :-1 s=CLOSED pgs=1193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 -- 172.21.15.70:0/3764528073 >> 172.21.15.70:0/3764528073 conn(0x55d0655f1310 msgr2=0x55d06562ffc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 -- 172.21.15.70:0/3764528073 shutdown_connections 2024-09-19T04:39:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 -- 172.21.15.70:0/3764528073 wait complete. 2024-09-19T04:39:04.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 -- start start 2024-09-19T04:39:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.601+0000 7fb960e26740 1 Processor -- start 2024-09-19T04:39:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb960e26740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 0x55d065637150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb960e26740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065637690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb960e26740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d065637bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb960e26740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fb9581abde0 con 0x55d065629b40 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb960e26740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fb9581ad250 con 0x55d065633370 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb960e26740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fb9581ac4b0 con 0x55d0656285d0 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb960e26740 10 client.0 _ll_register_callbacks cb 0x7fb94c0b87f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065637690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065637690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52386/0 (socket says 172.21.15.70:52386) 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 -- 172.21.15.70:0/752970061 learned_addr learned my addr 172.21.15.70:0/752970061 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb957fff640 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 0x55d065637150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb95cfea640 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d065637bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 -- 172.21.15.70:0/752970061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 msgr2=0x55d065637150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:04.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 0x55d065637150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 -- 172.21.15.70:0/752970061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 msgr2=0x55d065637bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d065637bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 -- 172.21.15.70:0/752970061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d0656acbe0 con 0x55d065629b40 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9577fe640 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065637690 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0eefd0 tx=0x7fb94c0b8410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a00673ee0f32fe22 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9377fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9377fe640 1 -- 172.21.15.70:0/752970061 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb94c049040 con 0x55d065629b40 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb9377fe640 1 -- 172.21.15.70:0/752970061 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7fb94c0d5140 con 0x55d065629b40 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.602+0000 7fb960e26740 1 -- 172.21.15.70:0/752970061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb948003c60 con 0x55d065629b40 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb9377fe640 1 -- 172.21.15.70:0/752970061 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fb94c0bbe10 con 0x55d065629b40 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb960e26740 10 client.17838 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb960e26740 1 -- 172.21.15.70:0/752970061 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d0656ade40 con 0x55d065629b40 2024-09-19T04:39:04.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb9377fe640 1 -- 172.21.15.70:0/752970061 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fb948003c60 con 0x55d065629b40 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb9377fe640 1 -- 172.21.15.70:0/752970061 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fb94c0bb370 con 0x55d065629b40 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb960e26740 10 client.17838 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb960e26740 10 client.17838 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb960e26740 20 client.17838 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb960e26740 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d065642f50 0x55d0656b04c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb960e26740 4 client.17838 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb960e26740 1 -- 172.21.15.70:0/752970061 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d065595d70 con 0x55d065642f50 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.603+0000 7fb957fff640 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d065642f50 0x55d0656b04c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb9377fe640 10 client.17838 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb957fff640 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d065642f50 0x55d0656b04c0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=13217ef0aba4184b server_cookie=b99936de8d608362 in_seq=0 out_seq=0 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb9377fe640 1 -- 172.21.15.70:0/752970061 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d065595d70 con 0x55d065642f50 2024-09-19T04:39:04.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb9377fe640 10 client.17838 handle_command_reply: tid=0 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 client.17838 shutdown 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 -- 172.21.15.70:0/752970061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 msgr2=0x55d065637690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065637690 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0eefd0 tx=0x7fb94c0b8410 comp rx=0 tx=0).stop 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 -- 172.21.15.70:0/752970061 shutdown_connections 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d065642f50 0x55d0656b04c0 crc :-1 s=READY pgs=199 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d065633370 0x55d065637bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d065629b40 0x55d065637690 unknown :-1 s=CLOSED pgs=1194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 --2- 172.21.15.70:0/752970061 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d0656285d0 0x55d065637150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb9377fe640 0 client.17838 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 -- 172.21.15.70:0/752970061 >> 172.21.15.70:0/752970061 conn(0x55d0655f1310 msgr2=0x55d065632080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 -- 172.21.15.70:0/752970061 shutdown_connections 2024-09-19T04:39:04.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 1 -- 172.21.15.70:0/752970061 wait complete. 2024-09-19T04:39:04.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.604+0000 7fb960e26740 20 client.17838 trim_cache size 0 max 16384 2024-09-19T04:39:04.649 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:04.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 -- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb9400a33b0 msgr2=0x7fb9400a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb9400a33b0 0x7fb9400a5870 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fb948009bd0 tx=0x7fb948005f90 comp rx=0 tx=0).stop 2024-09-19T04:39:04.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 -- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 msgr2=0x7fb9581998a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 0x7fb9581998a0 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7fb94c005940 tx=0x7fb94c0040c0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 -- 172.21.15.70:0/1388639779 shutdown_connections 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fb9400a33b0 0x7fb9400a5870 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb958102ef0 0x7fb9581a43e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fb958102570 0x7fb9581998a0 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 --2- 172.21.15.70:0/1388639779 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fb958100e20 0x7fb958199360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 -- 172.21.15.70:0/1388639779 >> 172.21.15.70:0/1388639779 conn(0x7fb9580fc7d0 msgr2=0x7fb9580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 -- 172.21.15.70:0/1388639779 shutdown_connections 2024-09-19T04:39:04.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:04.605+0000 7fb95ea4d640 1 -- 172.21.15.70:0/1388639779 wait complete. 2024-09-19T04:39:04.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:04 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:04.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:04 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:04 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:39:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:05 smithi070 ceph-mon[30942]: pgmap v256: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:39:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:05 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:39:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:05 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:39:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:05 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:39:05.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:05 smithi167 ceph-mon[34339]: pgmap v256: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:39:05.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:05 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:39:05.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:05 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:39:05.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:05 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:39:06.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:05 smithi134 ceph-mon[34525]: pgmap v256: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:39:06.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:05 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:39:06.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:05 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:39:06.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:05 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:39:06.344 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:39:06.344 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:39:06.602 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:06.977 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:06 smithi070 ceph-mon[30942]: pgmap v257: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:39:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:06 smithi134 ceph-mon[34525]: pgmap v257: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:39:07.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- 172.21.15.70:0/3867812886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2450101df0 msgr2=0x7f24501021d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 --2- 172.21.15.70:0/3867812886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2450101df0 0x7f24501021d0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7f2440009900 tx=0x7f244002a410 comp rx=0 tx=0).stop 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- 172.21.15.70:0/3867812886 shutdown_connections 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 --2- 172.21.15.70:0/3867812886 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2450106f20 0x7f245010eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 --2- 172.21.15.70:0/3867812886 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f24501027a0 0x7f24501067f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 --2- 172.21.15.70:0/3867812886 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2450101df0 0x7f24501021d0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- 172.21.15.70:0/3867812886 >> 172.21.15.70:0/3867812886 conn(0x7f24500fd8b0 msgr2=0x7f24500ffcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- 172.21.15.70:0/3867812886 shutdown_connections 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- 172.21.15.70:0/3867812886 wait complete. 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 Processor -- start 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- start start 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2450101df0 0x7f2450198540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501027a0 0x7f2450198a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2450106f20 0x7f245019ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2450112010 con 0x7f24501027a0 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2450111e90 con 0x7f2450106f20 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.058+0000 7f24568ea640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2450112190 con 0x7f2450101df0 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501027a0 0x7f2450198a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501027a0 0x7f2450198a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52410/0 (socket says 172.21.15.70:52410) 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 -- 172.21.15.70:0/869560545 learned_addr learned my addr 172.21.15.70:0/869560545 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2454e87640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2450106f20 0x7f245019ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f244ffff640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2450101df0 0x7f2450198540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 -- 172.21.15.70:0/869560545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2450101df0 msgr2=0x7f2450198540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2450101df0 0x7f2450198540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 -- 172.21.15.70:0/869560545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2450106f20 msgr2=0x7f245019ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2450106f20 0x7f245019ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 -- 172.21.15.70:0/869560545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f245019d4f0 con 0x7f24501027a0 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f2447fff640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501027a0 0x7f2450198a80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f243800b4a0 tx=0x7f243800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f244dffb640 1 -- 172.21.15.70:0/869560545 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438014070 con 0x7f24501027a0 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f244dffb640 1 -- 172.21.15.70:0/869560545 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2438010ae0 con 0x7f24501027a0 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f24568ea640 1 -- 172.21.15.70:0/869560545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f245019d7e0 con 0x7f24501027a0 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f244dffb640 1 -- 172.21.15.70:0/869560545 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2438017c70 con 0x7f24501027a0 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.059+0000 7f24568ea640 1 -- 172.21.15.70:0/869560545 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24501a50c0 con 0x7f24501027a0 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f244dffb640 1 -- 172.21.15.70:0/869560545 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2438017070 con 0x7f24501027a0 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2458cc3740 1 Processor -- start 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2458cc3740 1 -- start start 2024-09-19T04:39:07.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676eeaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 0x558676ef5800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef8130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2458cc3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558676e50280 con 0x558676eeab60 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2454e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676eeaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2454e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676eeaf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52416/0 (socket says 172.21.15.70:52416) 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2454e87640 1 -- 172.21.15.70:0/2202921004 learned_addr learned my addr 172.21.15.70:0/2202921004 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f244ffff640 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 0x558676ef5800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.062+0000 7f2458cc3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558676df7b10 con 0x558676ef5d40 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2447fff640 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef8130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2458cc3740 1 -- 172.21.15.70:0/2202921004 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558676e4c240 con 0x558676eeb480 2024-09-19T04:39:07.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f244dffb640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f243c0a33b0 0x7f243c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2454e87640 1 -- 172.21.15.70:0/2202921004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 msgr2=0x558676ef5800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2454e87640 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 0x558676ef5800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2454e87640 1 -- 172.21.15.70:0/2202921004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 msgr2=0x558676ef8130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2454e87640 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef8130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2454e87640 1 -- 172.21.15.70:0/2202921004 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558676e041f0 con 0x558676eeab60 2024-09-19T04:39:07.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2454e87640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f243c0a33b0 0x7f243c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f244dffb640 1 -- 172.21.15.70:0/869560545 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f24380cefb0 con 0x7f24501027a0 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f2454e87640 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676eeaf40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f244800a430 tx=0x7f2448009650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6e068e51a8ba9129 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f24467fc640 1 -- 172.21.15.70:0/2202921004 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448010c10 con 0x558676eeab60 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f24467fc640 1 -- 172.21.15.70:0/2202921004 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2448014dd0 con 0x558676eeab60 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.063+0000 7f24467fc640 1 -- 172.21.15.70:0/2202921004 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244801f5a0 con 0x558676eeab60 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 -- 172.21.15.70:0/2202921004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 msgr2=0x558676eeaf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676eeaf40 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7f244800a430 tx=0x7f2448009650 comp rx=0 tx=0).stop 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2454e87640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f243c0a33b0 0x7f243c0a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f244801e000 tx=0x7f244801f000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 -- 172.21.15.70:0/2202921004 shutdown_connections 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef8130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 0x558676ef5800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 --2- 172.21.15.70:0/2202921004 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676eeaf40 unknown :-1 s=CLOSED pgs=1197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 -- 172.21.15.70:0/2202921004 >> 172.21.15.70:0/2202921004 conn(0x558676ee70f0 msgr2=0x558676ee74d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 -- 172.21.15.70:0/2202921004 shutdown_connections 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.064+0000 7f2458cc3740 1 -- 172.21.15.70:0/2202921004 wait complete. 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 1 -- start start 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 1 Processor -- start 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676ef2c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 0x558676ef3170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558676ef8910 con 0x558676eeab60 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558676e0af10 con 0x558676ef5d40 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558676ef8a90 con 0x558676eeb480 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2458cc3740 10 client.0 _ll_register_callbacks cb 0x558676dd3a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f244ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676ef2c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f244ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676ef2c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52420/0 (socket says 172.21.15.70:52420) 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f244ffff640 1 -- 172.21.15.70:0/1521253420 learned_addr learned my addr 172.21.15.70:0/1521253420 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2447fff640 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 0x558676ef3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f2454e87640 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f244ffff640 1 -- 172.21.15.70:0/1521253420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 msgr2=0x558676ef3170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f244ffff640 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 0x558676ef3170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f244ffff640 1 -- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 msgr2=0x558676ef36b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f244ffff640 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef36b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.065+0000 7f244ffff640 1 -- 172.21.15.70:0/1521253420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558676bc16a0 con 0x558676eeab60 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2454e87640 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f244ffff640 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676ef2c30 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2440033000 tx=0x7f2440031880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8506dfbe787d7c90 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f242f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f242f7fe640 1 -- 172.21.15.70:0/1521253420 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2440035040 con 0x558676eeab60 2024-09-19T04:39:07.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f242f7fe640 1 -- 172.21.15.70:0/1521253420 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2440004460 con 0x558676eeab60 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2458cc3740 1 -- 172.21.15.70:0/1521253420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2448014dd0 con 0x558676eeab60 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f242f7fe640 1 -- 172.21.15.70:0/1521253420 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2440005020 con 0x558676eeab60 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2458cc3740 10 client.17850 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2458cc3740 1 -- 172.21.15.70:0/1521253420 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558676f04520 con 0x558676eeab60 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f242f7fe640 1 -- 172.21.15.70:0/1521253420 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2448014dd0 con 0x558676eeab60 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f242f7fe640 1 -- 172.21.15.70:0/1521253420 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f24400035f0 con 0x558676eeab60 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2458cc3740 10 client.17850 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2458cc3740 10 client.17850 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2458cc3740 20 client.17850 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558676f05930 0x558676f07d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.066+0000 7f2458cc3740 4 client.17850 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.067+0000 7f2458cc3740 1 -- 172.21.15.70:0/1521253420 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558676e5d7f0 con 0x558676f05930 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.067+0000 7f2447fff640 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558676f05930 0x558676f07d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.067+0000 7f242f7fe640 10 client.17850 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.067+0000 7f2447fff640 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558676f05930 0x558676f07d20 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d69b323373904a02 server_cookie=7be670d2bc5a5d54 in_seq=0 out_seq=0 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f242f7fe640 1 -- 172.21.15.70:0/1521253420 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x558676e5d7f0 con 0x558676f05930 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f242f7fe640 10 client.17850 handle_command_reply: tid=0 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 client.17850 shutdown 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 -- 172.21.15.70:0/1521253420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 msgr2=0x558676ef2c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676ef2c30 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7f2440033000 tx=0x7f2440031880 comp rx=0 tx=0).stop 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 -- 172.21.15.70:0/1521253420 shutdown_connections 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558676f05930 0x558676f07d20 crc :-1 s=READY pgs=200 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676ef5d40 0x558676ef36b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f242f7fe640 0 client.17850 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeb480 0x558676ef3170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1521253420 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676eeab60 0x558676ef2c30 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 -- 172.21.15.70:0/1521253420 >> 172.21.15.70:0/1521253420 conn(0x558676ee70f0 msgr2=0x558676ee6270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 -- 172.21.15.70:0/1521253420 shutdown_connections 2024-09-19T04:39:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 1 -- 172.21.15.70:0/1521253420 wait complete. 2024-09-19T04:39:07.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.068+0000 7f2458cc3740 20 client.17850 trim_cache size 0 max 16384 2024-09-19T04:39:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.085+0000 7f2458cc3740 1 Processor -- start 2024-09-19T04:39:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.085+0000 7f2458cc3740 1 -- start start 2024-09-19T04:39:07.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.085+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676eed5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 0x558676ee6160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676f0d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2458cc3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24501b01f0 con 0x558676ef5d40 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2458cc3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f24501adac0 con 0x558676eeb480 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2458cc3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ab930 con 0x558676eeab60 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676f0d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676f0d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52424/0 (socket says 172.21.15.70:52424) 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 -- 172.21.15.70:0/103477711 learned_addr learned my addr 172.21.15.70:0/103477711 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2447fff640 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 0x558676ee6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f244ffff640 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676eed5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 -- 172.21.15.70:0/103477711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 msgr2=0x558676eed5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676eed5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 -- 172.21.15.70:0/103477711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 msgr2=0x558676ee6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 0x558676ee6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 -- 172.21.15.70:0/103477711 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558676f08090 con 0x558676ef5d40 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f244ffff640 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676eed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2454e87640 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676f0d5f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f244800a430 tx=0x7f2448021f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68620d1d590f54b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2445ffb640 1 -- 172.21.15.70:0/103477711 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448010830 con 0x558676ef5d40 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2445ffb640 1 -- 172.21.15.70:0/103477711 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2448021900 con 0x558676ef5d40 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.086+0000 7f2445ffb640 1 -- 172.21.15.70:0/103477711 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f244802c460 con 0x558676ef5d40 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 -- 172.21.15.70:0/103477711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 msgr2=0x558676f0d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676f0d5f0 secure :-1 s=READY pgs=1199 cs=0 l=1 rev1=1 crypto rx=0x7f244800a430 tx=0x7f2448021f90 comp rx=0 tx=0).stop 2024-09-19T04:39:07.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 -- 172.21.15.70:0/103477711 shutdown_connections 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676f0d5f0 unknown :-1 s=CLOSED pgs=1199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 0x558676ee6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 --2- 172.21.15.70:0/103477711 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676eed5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 -- 172.21.15.70:0/103477711 >> 172.21.15.70:0/103477711 conn(0x558676ee70f0 msgr2=0x558676ee5a50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 -- 172.21.15.70:0/103477711 shutdown_connections 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 -- 172.21.15.70:0/103477711 wait complete. 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.087+0000 7f2458cc3740 1 -- start start 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2458cc3740 1 Processor -- start 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676efdfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 0x558676efe520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2458cc3740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676efada0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2458cc3740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f24501abf80 con 0x558676ef5d40 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2458cc3740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ad3f0 con 0x558676eeb480 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2458cc3740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f24501ac650 con 0x558676eeab60 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2454e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676efada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2454e87640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676efada0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52430/0 (socket says 172.21.15.70:52430) 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2458cc3740 10 client.0 _ll_register_callbacks cb 0x7f2440009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2454e87640 1 -- 172.21.15.70:0/1297308440 learned_addr learned my addr 172.21.15.70:0/1297308440 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2447fff640 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 0x558676efe520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f244ffff640 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676efdfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2454e87640 1 -- 172.21.15.70:0/1297308440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 msgr2=0x558676efdfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2454e87640 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676efdfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2454e87640 1 -- 172.21.15.70:0/1297308440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 msgr2=0x558676efe520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:07.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2454e87640 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 0x558676efe520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.088+0000 7f2454e87640 1 -- 172.21.15.70:0/1297308440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558676efb570 con 0x558676ef5d40 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2454e87640 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676efada0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2448004a80 tx=0x7f24480097e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf159cb14b982d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f242f7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f242f7fe640 1 -- 172.21.15.70:0/1297308440 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2448021ab0 con 0x558676ef5d40 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f242f7fe640 1 -- 172.21.15.70:0/1297308440 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(88..88 src has 1..88) ==== 8527+0+0 (secure 0 0 0) 0x7f2448021c50 con 0x558676ef5d40 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 1 -- 172.21.15.70:0/1297308440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2448021900 con 0x558676ef5d40 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f242f7fe640 1 -- 172.21.15.70:0/1297308440 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2448021430 con 0x558676ef5d40 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 10 client.17856 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 1 -- 172.21.15.70:0/1297308440 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558676f71120 con 0x558676ef5d40 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f242f7fe640 1 -- 172.21.15.70:0/1297308440 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2448021900 con 0x558676ef5d40 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f242f7fe640 1 -- 172.21.15.70:0/1297308440 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2448047c90 con 0x558676ef5d40 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 10 client.17856 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:07.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 10 client.17856 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 20 client.17856 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558676f71630 0x558676f73a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 4 client.17856 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.089+0000 7f2458cc3740 1 -- 172.21.15.70:0/1297308440 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x558676e57d00 con 0x558676f71630 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.090+0000 7f244ffff640 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558676f71630 0x558676f73a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.090+0000 7f242f7fe640 10 client.17856 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.090+0000 7f244ffff640 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558676f71630 0x558676f73a20 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=395c0eb93025ec42 server_cookie=7062365c3e36861d in_seq=0 out_seq=0 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f242f7fe640 1 -- 172.21.15.70:0/1297308440 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x558676e57d00 con 0x558676f71630 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f242f7fe640 10 client.17856 handle_command_reply: tid=0 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 client.17856 shutdown 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 -- 172.21.15.70:0/1297308440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 msgr2=0x558676efada0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676efada0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f2448004a80 tx=0x7f24480097e0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 -- 172.21.15.70:0/1297308440 shutdown_connections 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x558676f71630 0x558676f73a20 crc :-1 s=READY pgs=201 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558676ef5d40 0x558676efada0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558676eeb480 0x558676efe520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 --2- 172.21.15.70:0/1297308440 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558676eeab60 0x558676efdfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f242f7fe640 0 client.17856 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 -- 172.21.15.70:0/1297308440 >> 172.21.15.70:0/1297308440 conn(0x558676ee70f0 msgr2=0x558676ef33f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 -- 172.21.15.70:0/1297308440 shutdown_connections 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 1 -- 172.21.15.70:0/1297308440 wait complete. 2024-09-19T04:39:07.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.091+0000 7f2458cc3740 20 client.17856 trim_cache size 0 max 16384 2024-09-19T04:39:07.108 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:39:07.108 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:39:07.108 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "699bd304-06bf-45c6-a30e-e177ae0057c1", 2024-09-19T04:39:07.108 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:39:07.108 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:39:07.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 -- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f243c0a33b0 msgr2=0x7f243c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f243c0a33b0 0x7f243c0a5870 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f244801e000 tx=0x7f244801f000 comp rx=0 tx=0).stop 2024-09-19T04:39:07.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 -- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501027a0 msgr2=0x7f2450198a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:07.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501027a0 0x7f2450198a80 secure :-1 s=READY pgs=1196 cs=0 l=1 rev1=1 crypto rx=0x7f243800b4a0 tx=0x7f243800b960 comp rx=0 tx=0).stop 2024-09-19T04:39:07.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 -- 172.21.15.70:0/869560545 shutdown_connections 2024-09-19T04:39:07.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f243c0a33b0 0x7f243c0a5870 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2450106f20 0x7f245019ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f24501027a0 0x7f2450198a80 unknown :-1 s=CLOSED pgs=1196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 --2- 172.21.15.70:0/869560545 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2450101df0 0x7f2450198540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:07.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 -- 172.21.15.70:0/869560545 >> 172.21.15.70:0/869560545 conn(0x7f24500fd8b0 msgr2=0x7f24500fed10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:07.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 -- 172.21.15.70:0/869560545 shutdown_connections 2024-09-19T04:39:07.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:07.092+0000 7f24568ea640 1 -- 172.21.15.70:0/869560545 wait complete. 2024-09-19T04:39:07.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:06 smithi167 ceph-mon[34339]: pgmap v257: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:39:07.801 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:39:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:07 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:39:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:07 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:07 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:39:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:07 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:08.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:07 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:39:08.148 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:07 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:39:08.148 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:07 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:08.148 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:07 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:39:08.148 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:07 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:08.149 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:07 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:39:08.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:07 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:39:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:07 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:07 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:39:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:07 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:08.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:07 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:39:08.222 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:08.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 -- 172.21.15.70:0/2026783984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 msgr2=0x7ff8481067f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 --2- 172.21.15.70:0/2026783984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 0x7ff8481067f0 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7ff830009900 tx=0x7ff83002a410 comp rx=0 tx=0).stop 2024-09-19T04:39:08.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 -- 172.21.15.70:0/2026783984 shutdown_connections 2024-09-19T04:39:08.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 --2- 172.21.15.70:0/2026783984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff848106f20 0x7ff84810eaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 --2- 172.21.15.70:0/2026783984 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 0x7ff8481067f0 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.788 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 --2- 172.21.15.70:0/2026783984 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff848101df0 0x7ff8481021d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 -- 172.21.15.70:0/2026783984 >> 172.21.15.70:0/2026783984 conn(0x7ff8480fd8f0 msgr2=0x7ff8480ffd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 -- 172.21.15.70:0/2026783984 shutdown_connections 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.776+0000 7ff84e643640 1 -- 172.21.15.70:0/2026783984 wait complete. 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84e643640 1 Processor -- start 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84e643640 1 -- start start 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84e643640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff848101df0 0x7ff8481984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84e643640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 0x7ff848198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84e643640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff848106f20 0x7ff84819cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84e643640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff848111f50 con 0x7ff8481027a0 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84e643640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff848111dd0 con 0x7ff848101df0 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84e643640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8481120d0 con 0x7ff848106f20 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff83ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 0x7ff848198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.789 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff83ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 0x7ff848198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52446/0 (socket says 172.21.15.70:52446) 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff83ffff640 1 -- 172.21.15.70:0/1967037549 learned_addr learned my addr 172.21.15.70:0/1967037549 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff847fff640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff848101df0 0x7ff8481984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff848106f20 0x7ff84819cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff83ffff640 1 -- 172.21.15.70:0/1967037549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff848106f20 msgr2=0x7ff84819cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff83ffff640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff848106f20 0x7ff84819cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff83ffff640 1 -- 172.21.15.70:0/1967037549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff848101df0 msgr2=0x7ff8481984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff83ffff640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff848101df0 0x7ff8481984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff83ffff640 1 -- 172.21.15.70:0/1967037549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff84819d4a0 con 0x7ff8481027a0 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.777+0000 7ff847fff640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff848101df0 0x7ff8481984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.778+0000 7ff83ffff640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 0x7ff848198a30 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff830009230 tx=0x7ff830004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.778+0000 7ff845ffb640 1 -- 172.21.15.70:0/1967037549 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83003f030 con 0x7ff8481027a0 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.778+0000 7ff845ffb640 1 -- 172.21.15.70:0/1967037549 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff830003ac0 con 0x7ff8481027a0 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.778+0000 7ff845ffb640 1 -- 172.21.15.70:0/1967037549 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830035070 con 0x7ff8481027a0 2024-09-19T04:39:08.790 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.778+0000 7ff84e643640 1 -- 172.21.15.70:0/1967037549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff84819d730 con 0x7ff8481027a0 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.778+0000 7ff84e643640 1 -- 172.21.15.70:0/1967037549 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff84819dbc0 con 0x7ff8481027a0 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.780+0000 7ff845ffb640 1 -- 172.21.15.70:0/1967037549 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff830042030 con 0x7ff8481027a0 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.780+0000 7ff850a1c740 1 Processor -- start 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.780+0000 7ff850a1c740 1 -- start start 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 0x55ebad417740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad426550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad428e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff850a1c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ebad37d2e0 con 0x55ebad417c80 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff850a1c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ebad324ce0 con 0x55ebad426a90 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff845ffb640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff8340a3430 0x7ff8340a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.791 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff850a1c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ebad3792a0 con 0x55ebad417360 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff847fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad426550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff847fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad426550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52450/0 (socket says 172.21.15.70:52450) 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff847fff640 1 -- 172.21.15.70:0/3146715592 learned_addr learned my addr 172.21.15.70:0/3146715592 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff8340a3430 0x7ff8340a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff83ffff640 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad428e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 0x55ebad417740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff845ffb640 1 -- 172.21.15.70:0/1967037549 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7ff8300f0460 con 0x7ff8481027a0 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff847fff640 1 -- 172.21.15.70:0/3146715592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 msgr2=0x55ebad417740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff847fff640 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 0x55ebad417740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff847fff640 1 -- 172.21.15.70:0/3146715592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 msgr2=0x55ebad428e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff847fff640 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad428e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.792 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff847fff640 1 -- 172.21.15.70:0/3146715592 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebad309440 con 0x55ebad417c80 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.781+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff8340a3430 0x7ff8340a58f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff840009270 tx=0x7ff840009b20 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff847fff640 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad426550 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff83800cca0 tx=0x7ff83800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90a8a2a91bfddfc7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff83e7fc640 1 -- 172.21.15.70:0/3146715592 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838005220 con 0x55ebad417c80 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff83e7fc640 1 -- 172.21.15.70:0/3146715592 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff838004c70 con 0x55ebad417c80 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff83e7fc640 1 -- 172.21.15.70:0/3146715592 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff838010830 con 0x55ebad417c80 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff850a1c740 1 -- 172.21.15.70:0/3146715592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 msgr2=0x55ebad426550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff850a1c740 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad426550 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7ff83800cca0 tx=0x7ff83800e720 comp rx=0 tx=0).stop 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff850a1c740 1 -- 172.21.15.70:0/3146715592 shutdown_connections 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff850a1c740 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad428e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff850a1c740 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad426550 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff850a1c740 1 --2- 172.21.15.70:0/3146715592 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 0x55ebad417740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff850a1c740 1 -- 172.21.15.70:0/3146715592 >> 172.21.15.70:0/3146715592 conn(0x55ebad413a30 msgr2=0x55ebad413e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:08.793 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.782+0000 7ff850a1c740 1 -- 172.21.15.70:0/3146715592 shutdown_connections 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 -- 172.21.15.70:0/3146715592 wait complete. 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 -- start start 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 Processor -- start 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417360 0x55ebad4263e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417c80 0x55ebad423690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad423bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ebad429660 con 0x55ebad417360 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ebad338050 con 0x55ebad426a90 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ebad4297e0 con 0x55ebad417c80 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff850a1c740 10 client.0 _ll_register_callbacks cb 0x55ebad378160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff847fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417360 0x55ebad4263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff847fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417360 0x55ebad4263e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52466/0 (socket says 172.21.15.70:52466) 2024-09-19T04:39:08.794 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.783+0000 7ff847fff640 1 -- 172.21.15.70:0/939816535 learned_addr learned my addr 172.21.15.70:0/939816535 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad423bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff83ffff640 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417c80 0x55ebad423690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff847fff640 1 -- 172.21.15.70:0/939816535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417c80 msgr2=0x55ebad423690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff847fff640 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417c80 0x55ebad423690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff847fff640 1 -- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 msgr2=0x55ebad423bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff847fff640 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad423bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff847fff640 1 -- 172.21.15.70:0/939816535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebad0ee3c0 con 0x55ebad417360 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad423bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff847fff640 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417360 0x55ebad4263e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff838005d60 tx=0x7ff83800cfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=527bc40a2d192418 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff8277fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff8277fe640 1 -- 172.21.15.70:0/939816535 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff83802a060 con 0x55ebad417360 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff8277fe640 1 -- 172.21.15.70:0/939816535 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7ff838004e20 con 0x55ebad417360 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff850a1c740 1 -- 172.21.15.70:0/939816535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff838004c70 con 0x55ebad417360 2024-09-19T04:39:08.795 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff8277fe640 1 -- 172.21.15.70:0/939816535 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff8380048d0 con 0x55ebad417360 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff850a1c740 10 client.17868 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.784+0000 7ff850a1c740 1 -- 172.21.15.70:0/939816535 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ebad435070 con 0x55ebad417360 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff8277fe640 1 -- 172.21.15.70:0/939816535 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff838004c70 con 0x55ebad417360 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff8277fe640 1 -- 172.21.15.70:0/939816535 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff838025590 con 0x55ebad417360 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff850a1c740 10 client.17868 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff850a1c740 10 client.17868 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff850a1c740 20 client.17868 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff850a1c740 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ebad436470 0x55ebad438860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff850a1c740 4 client.17868 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff850a1c740 1 -- 172.21.15.70:0/939816535 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ebad38a850 con 0x55ebad436470 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff83ffff640 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ebad436470 0x55ebad438860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff8277fe640 10 client.17868 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:08.796 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.785+0000 7ff83ffff640 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ebad436470 0x55ebad438860 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dadd42fefd414bb3 server_cookie=44b37d14b4e4f27e in_seq=0 out_seq=0 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff8277fe640 1 -- 172.21.15.70:0/939816535 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ebad38a850 con 0x55ebad436470 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff8277fe640 10 client.17868 handle_command_reply: tid=0 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 client.17868 shutdown 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 -- 172.21.15.70:0/939816535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417360 msgr2=0x55ebad4263e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417360 0x55ebad4263e0 secure :-1 s=READY pgs=1204 cs=0 l=1 rev1=1 crypto rx=0x7ff838005d60 tx=0x7ff83800cfa0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 -- 172.21.15.70:0/939816535 shutdown_connections 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ebad436470 0x55ebad438860 crc :-1 s=READY pgs=202 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad426a90 0x55ebad423bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff8277fe640 0 client.17868 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417c80 0x55ebad423690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 --2- 172.21.15.70:0/939816535 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417360 0x55ebad4263e0 unknown :-1 s=CLOSED pgs=1204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.797 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 -- 172.21.15.70:0/939816535 >> 172.21.15.70:0/939816535 conn(0x55ebad413a30 msgr2=0x55ebad419790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 -- 172.21.15.70:0/939816535 shutdown_connections 2024-09-19T04:39:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.786+0000 7ff850a1c740 1 -- 172.21.15.70:0/939816535 wait complete. 2024-09-19T04:39:08.798 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.787+0000 7ff850a1c740 20 client.17868 trim_cache size 0 max 16384 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.803+0000 7ff850a1c740 1 Processor -- start 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.803+0000 7ff850a1c740 1 -- start start 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.803+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 0x55ebad432900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.803+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417c80 0x55ebad43de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.803+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad426a90 0x55ebad43e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.803+0000 7ff850a1c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8481adf40 con 0x55ebad426a90 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.803+0000 7ff850a1c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8481ab810 con 0x55ebad417c80 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.803+0000 7ff850a1c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8481a96a0 con 0x55ebad417360 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad426a90 0x55ebad43e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad426a90 0x55ebad43e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52478/0 (socket says 172.21.15.70:52478) 2024-09-19T04:39:08.806 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 -- 172.21.15.70:0/2623546585 learned_addr learned my addr 172.21.15.70:0/2623546585 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff847fff640 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 0x55ebad432900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff83ffff640 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417c80 0x55ebad43de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 -- 172.21.15.70:0/2623546585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 msgr2=0x55ebad432900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 0x55ebad432900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 -- 172.21.15.70:0/2623546585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417c80 msgr2=0x55ebad43de30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417c80 0x55ebad43de30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 -- 172.21.15.70:0/2623546585 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ebad421be0 con 0x55ebad426a90 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad426a90 0x55ebad43e370 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff840013fd0 tx=0x7ff840009500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6db0fc4f46726b3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff83dffb640 1 -- 172.21.15.70:0/2623546585 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff840010dd0 con 0x55ebad426a90 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff83dffb640 1 -- 172.21.15.70:0/2623546585 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff840003d40 con 0x55ebad426a90 2024-09-19T04:39:08.807 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.804+0000 7ff83dffb640 1 -- 172.21.15.70:0/2623546585 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff84001fc20 con 0x55ebad426a90 2024-09-19T04:39:08.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 -- 172.21.15.70:0/2623546585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad426a90 msgr2=0x55ebad43e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad426a90 0x55ebad43e370 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7ff840013fd0 tx=0x7ff840009500 comp rx=0 tx=0).stop 2024-09-19T04:39:08.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 -- 172.21.15.70:0/2623546585 shutdown_connections 2024-09-19T04:39:08.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad426a90 0x55ebad43e370 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417c80 0x55ebad43de30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.811 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2623546585 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad417360 0x55ebad432900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 -- 172.21.15.70:0/2623546585 >> 172.21.15.70:0/2623546585 conn(0x55ebad413a30 msgr2=0x55ebad422780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 -- 172.21.15.70:0/2623546585 shutdown_connections 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 -- 172.21.15.70:0/2623546585 wait complete. 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.805+0000 7ff850a1c740 1 -- start start 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff850a1c740 1 Processor -- start 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417360 0x55ebad42eef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad42a220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff850a1c740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad426a90 0x55ebad42a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff850a1c740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff8481a9cf0 con 0x55ebad417c80 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff850a1c740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff8481ab140 con 0x55ebad417360 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff850a1c740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff8481aa3a0 con 0x55ebad426a90 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff850a1c740 10 client.0 _ll_register_callbacks cb 0x7ff838014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:08.812 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad42a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad42a220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52494/0 (socket says 172.21.15.70:52494) 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 -- 172.21.15.70:0/2927808064 learned_addr learned my addr 172.21.15.70:0/2927808064 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad426a90 0x55ebad42a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff847fff640 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417360 0x55ebad42eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 -- 172.21.15.70:0/2927808064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad426a90 msgr2=0x55ebad42a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad426a90 0x55ebad42a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 -- 172.21.15.70:0/2927808064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417360 msgr2=0x55ebad42eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417360 0x55ebad42eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 -- 172.21.15.70:0/2927808064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ebad42aca0 con 0x55ebad417c80 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff84cbe0640 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad426a90 0x55ebad42a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff83ffff640 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad42a220 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff8300edc30 tx=0x7ff830047000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70aebfed7ebbbefb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.806+0000 7ff8277fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:08.813 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff8277fe640 1 -- 172.21.15.70:0/2927808064 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff830049040 con 0x55ebad417c80 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff8277fe640 1 -- 172.21.15.70:0/2927808064 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7ff830003c70 con 0x55ebad417c80 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 1 -- 172.21.15.70:0/2927808064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff840003d40 con 0x55ebad417c80 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff8277fe640 1 -- 172.21.15.70:0/2927808064 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ff83003b460 con 0x55ebad417c80 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 10 client.17874 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 1 -- 172.21.15.70:0/2927808064 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ebad4a0bd0 con 0x55ebad417c80 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff8277fe640 1 -- 172.21.15.70:0/2927808064 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff840003d40 con 0x55ebad417c80 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff8277fe640 1 -- 172.21.15.70:0/2927808064 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ff83009c020 con 0x55ebad417c80 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 10 client.17874 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 10 client.17874 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 20 client.17874 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ebad4a1300 0x55ebad4a3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 4 client.17874 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff850a1c740 1 -- 172.21.15.70:0/2927808064 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55ebad384d60 con 0x55ebad4a1300 2024-09-19T04:39:08.814 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.807+0000 7ff847fff640 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ebad4a1300 0x55ebad4a3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff8277fe640 10 client.17874 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff847fff640 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ebad4a1300 0x55ebad4a3720 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=845e86c6224c9a8e server_cookie=632ed94324b9c459 in_seq=0 out_seq=0 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff8277fe640 1 -- 172.21.15.70:0/2927808064 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55ebad384d60 con 0x55ebad4a1300 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff8277fe640 10 client.17874 handle_command_reply: tid=0 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 client.17874 shutdown 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 -- 172.21.15.70:0/2927808064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 msgr2=0x55ebad42a220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad42a220 secure :-1 s=READY pgs=1206 cs=0 l=1 rev1=1 crypto rx=0x7ff8300edc30 tx=0x7ff830047000 comp rx=0 tx=0).stop 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 -- 172.21.15.70:0/2927808064 shutdown_connections 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55ebad4a1300 0x55ebad4a3720 crc :-1 s=READY pgs=203 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ebad426a90 0x55ebad42a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ebad417c80 0x55ebad42a220 unknown :-1 s=CLOSED pgs=1206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff8277fe640 0 client.17874 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:08.815 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 --2- 172.21.15.70:0/2927808064 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ebad417360 0x55ebad42eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 -- 172.21.15.70:0/2927808064 >> 172.21.15.70:0/2927808064 conn(0x55ebad413a30 msgr2=0x55ebad412350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:08.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 -- 172.21.15.70:0/2927808064 shutdown_connections 2024-09-19T04:39:08.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 1 -- 172.21.15.70:0/2927808064 wait complete. 2024-09-19T04:39:08.816 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.808+0000 7ff850a1c740 20 client.17874 trim_cache size 0 max 16384 2024-09-19T04:39:08.816 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:39:08.816 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:39:08.816 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:39:08.816 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:39:08.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 -- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff8340a3430 msgr2=0x7ff8340a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff8340a3430 0x7ff8340a58f0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff840009270 tx=0x7ff840009b20 comp rx=0 tx=0).stop 2024-09-19T04:39:08.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 -- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 msgr2=0x7ff848198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:08.817 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 0x7ff848198a30 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7ff830009230 tx=0x7ff830004270 comp rx=0 tx=0).stop 2024-09-19T04:39:08.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 -- 172.21.15.70:0/1967037549 shutdown_connections 2024-09-19T04:39:08.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff8340a3430 0x7ff8340a58f0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff848106f20 0x7ff84819cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff8481027a0 0x7ff848198a30 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 --2- 172.21.15.70:0/1967037549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff848101df0 0x7ff8481984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:08.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 -- 172.21.15.70:0/1967037549 >> 172.21.15.70:0/1967037549 conn(0x7ff8480fd8f0 msgr2=0x7ff8480fed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:08.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 -- 172.21.15.70:0/1967037549 shutdown_connections 2024-09-19T04:39:08.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:08.809+0000 7ff84e643640 1 -- 172.21.15.70:0/1967037549 wait complete. 2024-09-19T04:39:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:08 smithi134 ceph-mon[34525]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:39:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:08 smithi134 ceph-mon[34525]: pgmap v259: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:39:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:08 smithi070 ceph-mon[30942]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:39:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:08 smithi070 ceph-mon[30942]: pgmap v259: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:39:09.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:08 smithi167 ceph-mon[34339]: osdmap e89: 12 total, 12 up, 12 in 2024-09-19T04:39:09.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:08 smithi167 ceph-mon[34339]: pgmap v259: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:39:09.535 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:39:09.535 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:39:09.780 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 -- 172.21.15.70:0/3254828416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 msgr2=0x7f9b08100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3254828416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 0x7f9b08100ee0 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7f9af8009cd0 tx=0x7f9af802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.237 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 -- 172.21.15.70:0/3254828416 shutdown_connections 2024-09-19T04:39:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3254828416 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b08101420 0x7f9b0810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3254828416 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 0x7f9b08100ee0 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3254828416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b08106a80 0x7f9b08106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 -- 172.21.15.70:0/3254828416 >> 172.21.15.70:0/3254828416 conn(0x7f9b080fc7a0 msgr2=0x7f9b080febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:10.238 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 -- 172.21.15.70:0/3254828416 shutdown_connections 2024-09-19T04:39:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 -- 172.21.15.70:0/3254828416 wait complete. 2024-09-19T04:39:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 Processor -- start 2024-09-19T04:39:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.205+0000 7f9b0f113640 1 -- start start 2024-09-19T04:39:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0f113640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 0x7f9b081984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0f113640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b08101420 0x7f9b08198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:10.239 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0f113640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b08106a80 0x7f9b0819cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0f113640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08110eb0 con 0x7f9b08100a80 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0f113640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08110d30 con 0x7f9b08101420 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0f113640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9b08111030 con 0x7f9b08106a80 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 0x7f9b081984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 0x7f9b081984c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52506/0 (socket says 172.21.15.70:52506) 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 -- 172.21.15.70:0/3542426968 learned_addr learned my addr 172.21.15.70:0/3542426968 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b07fff640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b08101420 0x7f9b08198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0d6b0640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b08106a80 0x7f9b0819cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:10.240 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 -- 172.21.15.70:0/3542426968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b08106a80 msgr2=0x7f9b0819cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b08106a80 0x7f9b0819cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 -- 172.21.15.70:0/3542426968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b08101420 msgr2=0x7f9b08198a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b08101420 0x7f9b08198a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 -- 172.21.15.70:0/3542426968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b0819d470 con 0x7f9b08100a80 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0d6b0640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b08106a80 0x7f9b0819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b07fff640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b08101420 0x7f9b08198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0ceaf640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 0x7f9b081984c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f9af000b4a0 tx=0x7f9af000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b05ffb640 1 -- 172.21.15.70:0/3542426968 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0014070 con 0x7f9b08100a80 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b0819d760 con 0x7f9b08100a80 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b05ffb640 1 -- 172.21.15.70:0/3542426968 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9af0010ae0 con 0x7f9b08100a80 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.206+0000 7f9b05ffb640 1 -- 172.21.15.70:0/3542426968 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9af0017c70 con 0x7f9b08100a80 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.207+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b081a5040 con 0x7f9b08100a80 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.208+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b08100ee0 con 0x7f9b08100a80 2024-09-19T04:39:10.241 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.209+0000 7f9b05ffb640 1 -- 172.21.15.70:0/3542426968 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9af0017070 con 0x7f9b08100a80 2024-09-19T04:39:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.209+0000 7f9b05ffb640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9af40a33b0 0x7f9af40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.209+0000 7f9b05ffb640 1 -- 172.21.15.70:0/3542426968 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7f9af00cf090 con 0x7f9b08100a80 2024-09-19T04:39:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.209+0000 7f9b07fff640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9af40a33b0 0x7f9af40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.210+0000 7f9b07fff640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9af40a33b0 0x7f9af40a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9af8000f80 tx=0x7f9af8005ef0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:10.242 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.213+0000 7f9b05ffb640 1 -- 172.21.15.70:0/3542426968 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f9af009bb50 con 0x7f9b08100a80 2024-09-19T04:39:10.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.414+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9b08199820 con 0x7f9b08100a80 2024-09-19T04:39:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.414+0000 7f9b05ffb640 1 -- 172.21.15.70:0/3542426968 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f9af009b450 con 0x7f9b08100a80 2024-09-19T04:39:10.416 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:39:10.416 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:39:10.416 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:39:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9af40a33b0 msgr2=0x7f9af40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9af40a33b0 0x7f9af40a5870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f9af8000f80 tx=0x7f9af8005ef0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 msgr2=0x7f9b081984c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 0x7f9b081984c0 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7f9af000b4a0 tx=0x7f9af000b960 comp rx=0 tx=0).stop 2024-09-19T04:39:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 shutdown_connections 2024-09-19T04:39:10.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9af40a33b0 0x7f9af40a5870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9b08106a80 0x7f9b0819cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b08101420 0x7f9b08198a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 --2- 172.21.15.70:0/3542426968 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9b08100a80 0x7f9b081984c0 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.416+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 >> 172.21.15.70:0/3542426968 conn(0x7f9b080fc7a0 msgr2=0x7f9b08104890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.417+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 shutdown_connections 2024-09-19T04:39:10.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:10.417+0000 7f9b0f113640 1 -- 172.21.15.70:0/3542426968 wait complete. 2024-09-19T04:39:10.781 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:10 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3542426968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:10.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:10 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3542426968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:10.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:10 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3542426968' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:11.052 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:39:11.296 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:11.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:11 smithi134 ceph-mon[34525]: pgmap v260: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:39:11.885 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:11 smithi070 ceph-mon[30942]: pgmap v260: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:39:11.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:11 smithi167 ceph-mon[34339]: pgmap v260: 97 pgs: 97 active+clean; 261 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:39:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 -- 172.21.15.70:0/1283105025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8106a80 msgr2=0x7f43b8106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 --2- 172.21.15.70:0/1283105025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8106a80 0x7f43b8106e60 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7f43b4009930 tx=0x7f43b402a420 comp rx=0 tx=0).stop 2024-09-19T04:39:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 -- 172.21.15.70:0/1283105025 shutdown_connections 2024-09-19T04:39:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 --2- 172.21.15.70:0/1283105025 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b8101420 0x7f43b810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 --2- 172.21.15.70:0/1283105025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8100a80 0x7f43b8100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 --2- 172.21.15.70:0/1283105025 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8106a80 0x7f43b8106e60 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 -- 172.21.15.70:0/1283105025 >> 172.21.15.70:0/1283105025 conn(0x7f43b80fc7a0 msgr2=0x7f43b80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 -- 172.21.15.70:0/1283105025 shutdown_connections 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.964+0000 7f43bf49d640 1 -- 172.21.15.70:0/1283105025 wait complete. 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bf49d640 1 Processor -- start 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bf49d640 1 -- start start 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bf49d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8100a80 0x7f43b81992e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bf49d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b8101420 0x7f43b8199820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bf49d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8106a80 0x7f43b81a4360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bf49d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8110e10 con 0x7f43b8100a80 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bf49d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8110c90 con 0x7f43b8106a80 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bf49d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43b8110f90 con 0x7f43b8101420 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bd239640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8100a80 0x7f43b81992e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bd239640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8100a80 0x7f43b81992e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52536/0 (socket says 172.21.15.70:52536) 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.965+0000 7f43bd239640 1 -- 172.21.15.70:0/2821751694 learned_addr learned my addr 172.21.15.70:0/2821751694 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bda3a640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8106a80 0x7f43b81a4360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bca38640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b8101420 0x7f43b8199820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bd239640 1 -- 172.21.15.70:0/2821751694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b8101420 msgr2=0x7f43b8199820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bd239640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b8101420 0x7f43b8199820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bd239640 1 -- 172.21.15.70:0/2821751694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8106a80 msgr2=0x7f43b81a4360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bd239640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8106a80 0x7f43b81a4360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bd239640 1 -- 172.21.15.70:0/2821751694 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43b81a48a0 con 0x7f43b8100a80 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bd239640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8100a80 0x7f43b81992e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f43b4005940 tx=0x7f43b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:11.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43aa7fc640 1 -- 172.21.15.70:0/2821751694 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b403f030 con 0x7f43b8100a80 2024-09-19T04:39:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43aa7fc640 1 -- 172.21.15.70:0/2821751694 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f43b4003ac0 con 0x7f43b8100a80 2024-09-19T04:39:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bf49d640 1 -- 172.21.15.70:0/2821751694 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43b81a4a70 con 0x7f43b8100a80 2024-09-19T04:39:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43aa7fc640 1 -- 172.21.15.70:0/2821751694 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4035070 con 0x7f43b8100a80 2024-09-19T04:39:11.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.966+0000 7f43bf49d640 1 -- 172.21.15.70:0/2821751694 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43b81a4f20 con 0x7f43b8100a80 2024-09-19T04:39:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.968+0000 7f43aa7fc640 1 -- 172.21.15.70:0/2821751694 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f43b4042030 con 0x7f43b8100a80 2024-09-19T04:39:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43c1876740 1 Processor -- start 2024-09-19T04:39:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43c1876740 1 -- start start 2024-09-19T04:39:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43c1876740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862005090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43c1876740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x563862005a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43c1876740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862016b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43c1876740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563861f6b2f0 con 0x5638620055d0 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43c1876740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563861f12cf0 con 0x563862006b40 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43c1876740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563861f672b0 con 0x563862014780 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43aa7fc640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43a40a3430 0x7f43a40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.969+0000 7f43bd239640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x563862005a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bd239640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x563862005a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52546/0 (socket says 172.21.15.70:52546) 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bd239640 1 -- 172.21.15.70:0/4056032305 learned_addr learned my addr 172.21.15.70:0/4056032305 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:11.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bda3a640 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862005090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bda3a640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43a40a3430 0x7f43a40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bca38640 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862016b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bd239640 1 -- 172.21.15.70:0/4056032305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 msgr2=0x563862016b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bd239640 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862016b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bd239640 1 -- 172.21.15.70:0/4056032305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 msgr2=0x563862005090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bd239640 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862005090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bd239640 1 -- 172.21.15.70:0/4056032305 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563861ef73a0 con 0x5638620055d0 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43aa7fc640 1 -- 172.21.15.70:0/2821751694 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7f43b40f0250 con 0x7f43b8100a80 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bda3a640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43a40a3430 0x7f43a40a58f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f43b0005c40 tx=0x7f43b0005bd0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43bd239640 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x563862005a10 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f43b40bc6c0 tx=0x7f43b4000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710825f157c7487f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43a37fe640 1 -- 172.21.15.70:0/4056032305 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4049070 con 0x5638620055d0 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43a37fe640 1 -- 172.21.15.70:0/4056032305 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f43b40047a0 con 0x5638620055d0 2024-09-19T04:39:11.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.970+0000 7f43a37fe640 1 -- 172.21.15.70:0/4056032305 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b40c08b0 con 0x5638620055d0 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 -- 172.21.15.70:0/4056032305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 msgr2=0x563862005a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x563862005a10 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7f43b40bc6c0 tx=0x7f43b4000bc0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 -- 172.21.15.70:0/4056032305 shutdown_connections 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862016b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x563862005a10 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 --2- 172.21.15.70:0/4056032305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862005090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 -- 172.21.15.70:0/4056032305 >> 172.21.15.70:0/4056032305 conn(0x563861fce310 msgr2=0x563862001c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 -- 172.21.15.70:0/4056032305 shutdown_connections 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 -- 172.21.15.70:0/4056032305 wait complete. 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.971+0000 7f43c1876740 1 -- start start 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43c1876740 1 Processor -- start 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43c1876740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x563862014140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43c1876740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x5638620113f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43c1876740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x5638620119e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43c1876740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x563862017240 con 0x563862006b40 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43c1876740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563861f26060 con 0x5638620055d0 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43c1876740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5638620173c0 con 0x563862014780 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43c1876740 10 client.0 _ll_register_callbacks cb 0x563861c798c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43bca38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x5638620113f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43bca38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x5638620113f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52558/0 (socket says 172.21.15.70:52558) 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43bca38640 1 -- 172.21.15.70:0/1305982957 learned_addr learned my addr 172.21.15.70:0/1305982957 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43bda3a640 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x5638620119e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.972+0000 7f43bd239640 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x563862014140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43bca38640 1 -- 172.21.15.70:0/1305982957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 msgr2=0x5638620119e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43bca38640 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x5638620119e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43bca38640 1 -- 172.21.15.70:0/1305982957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 msgr2=0x563862014140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43bca38640 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x563862014140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43bca38640 1 -- 172.21.15.70:0/1305982957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563861cdc3c0 con 0x563862006b40 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43bd239640 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x563862014140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43bca38640 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x5638620113f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00f6a0 tx=0x7f43ac00faa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52c825425916f4f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43a0ff9640 1 -- 172.21.15.70:0/1305982957 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac016070 con 0x563862006b40 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43a0ff9640 1 -- 172.21.15.70:0/1305982957 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7f43ac005220 con 0x563862006b40 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43c1876740 1 -- 172.21.15.70:0/1305982957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43b40047a0 con 0x563862006b40 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43a0ff9640 1 -- 172.21.15.70:0/1305982957 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f43ac005420 con 0x563862006b40 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43c1876740 10 client.17892 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43c1876740 1 -- 172.21.15.70:0/1305982957 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563862022cd0 con 0x563862006b40 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43a0ff9640 1 -- 172.21.15.70:0/1305982957 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f43b40047a0 con 0x563862006b40 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43a0ff9640 1 -- 172.21.15.70:0/1305982957 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f43ac004d00 con 0x563862006b40 2024-09-19T04:39:11.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43c1876740 10 client.17892 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43c1876740 10 client.17892 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:39:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43c1876740 20 client.17892 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.973+0000 7f43c1876740 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x563862024230 0x563862026690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.974+0000 7f43c1876740 4 client.17892 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.974+0000 7f43c1876740 1 -- 172.21.15.70:0/1305982957 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563861f78860 con 0x563862024230 2024-09-19T04:39:11.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.974+0000 7f43bd239640 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x563862024230 0x563862026690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.974+0000 7f43bd239640 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x563862024230 0x563862026690 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3c6a947c00ccac server_cookie=44a2c469a1900fff in_seq=0 out_seq=0 2024-09-19T04:39:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.974+0000 7f43a0ff9640 10 client.17892 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43a0ff9640 1 -- 172.21.15.70:0/1305982957 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563861f78860 con 0x563862024230 2024-09-19T04:39:11.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43a0ff9640 10 client.17892 handle_command_reply: tid=0 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 client.17892 shutdown 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 -- 172.21.15.70:0/1305982957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 msgr2=0x5638620113f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x5638620113f0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7f43ac00f6a0 tx=0x7f43ac00faa0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 -- 172.21.15.70:0/1305982957 shutdown_connections 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x563862024230 0x563862026690 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x5638620119e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x5638620113f0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43a0ff9640 0 client.17892 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 --2- 172.21.15.70:0/1305982957 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x563862014140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 -- 172.21.15.70:0/1305982957 >> 172.21.15.70:0/1305982957 conn(0x563861fce310 msgr2=0x563862007990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 -- 172.21.15.70:0/1305982957 shutdown_connections 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 1 -- 172.21.15.70:0/1305982957 wait complete. 2024-09-19T04:39:11.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.975+0000 7f43c1876740 20 client.17892 trim_cache size 0 max 16384 2024-09-19T04:39:11.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43c1876740 1 Processor -- start 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43c1876740 1 -- start start 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43c1876740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x5638620204a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43c1876740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x563862010cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43c1876740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x56386202bf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43c1876740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81adf90 con 0x563862006b40 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43c1876740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81ab860 con 0x5638620055d0 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43c1876740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81a96f0 con 0x563862014780 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43bca38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x563862010cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43bca38640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x563862010cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52564/0 (socket says 172.21.15.70:52564) 2024-09-19T04:39:11.998 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.988+0000 7f43bca38640 1 -- 172.21.15.70:0/3160183890 learned_addr learned my addr 172.21.15.70:0/3160183890 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43bd239640 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x5638620204a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43bda3a640 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x56386202bf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43bca38640 1 -- 172.21.15.70:0/3160183890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 msgr2=0x56386202bf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43bca38640 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x56386202bf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43bca38640 1 -- 172.21.15.70:0/3160183890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 msgr2=0x5638620204a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43bca38640 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x5638620204a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43bca38640 1 -- 172.21.15.70:0/3160183890 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563862002960 con 0x563862006b40 2024-09-19T04:39:11.999 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43bca38640 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x563862010cb0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0225f0 tx=0x7f43ac000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78035044630a880 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43a2ffd640 1 -- 172.21.15.70:0/3160183890 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac016050 con 0x563862006b40 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43a2ffd640 1 -- 172.21.15.70:0/3160183890 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f43ac00bd00 con 0x563862006b40 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.989+0000 7f43a2ffd640 1 -- 172.21.15.70:0/3160183890 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43ac02c6a0 con 0x563862006b40 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 -- 172.21.15.70:0/3160183890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 msgr2=0x563862010cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x563862010cb0 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7f43ac0225f0 tx=0x7f43ac000bc0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 -- 172.21.15.70:0/3160183890 shutdown_connections 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x56386202bf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563862006b40 0x563862010cb0 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 --2- 172.21.15.70:0/3160183890 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5638620055d0 0x5638620204a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 -- 172.21.15.70:0/3160183890 >> 172.21.15.70:0/3160183890 conn(0x563861fce310 msgr2=0x56386200fcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:12.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 -- 172.21.15.70:0/3160183890 shutdown_connections 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 -- 172.21.15.70:0/3160183890 wait complete. 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 -- start start 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 Processor -- start 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x56386201ce30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862018160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.990+0000 7f43c1876740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862018700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43c1876740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81a9d40 con 0x5638620055d0 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43c1876740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81ab190 con 0x563862006b40 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43c1876740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f43b81aa3f0 con 0x563862014780 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x56386201ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:12.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x56386201ce30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52568/0 (socket says 172.21.15.70:52568) 2024-09-19T04:39:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43c1876740 10 client.0 _ll_register_callbacks cb 0x7f43ac00d340 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 -- 172.21.15.70:0/2811739622 learned_addr learned my addr 172.21.15.70:0/2811739622 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bda3a640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862018700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bca38640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862018160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 -- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 msgr2=0x563862018700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862018700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 -- 172.21.15.70:0/2811739622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 msgr2=0x563862018160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862018160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 -- 172.21.15.70:0/2811739622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563862018f30 con 0x5638620055d0 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bda3a640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862018700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bca38640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862018160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43bd239640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x56386201ce30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f43b40b8ed0 tx=0x7f43b4005bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df7df3898e0b79a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43a0ff9640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43a0ff9640 1 -- 172.21.15.70:0/2811739622 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43b4049040 con 0x5638620055d0 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43c1876740 1 -- 172.21.15.70:0/2811739622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f43ac00bd00 con 0x5638620055d0 2024-09-19T04:39:12.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43a0ff9640 1 -- 172.21.15.70:0/2811739622 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7f43b40ba800 con 0x5638620055d0 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43a0ff9640 1 -- 172.21.15.70:0/2811739622 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f43b40047a0 con 0x5638620055d0 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43c1876740 10 client.17898 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.991+0000 7f43c1876740 1 -- 172.21.15.70:0/2811739622 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56386208f000 con 0x5638620055d0 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43a0ff9640 1 -- 172.21.15.70:0/2811739622 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f43ac00bd00 con 0x5638620055d0 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43a0ff9640 1 -- 172.21.15.70:0/2811739622 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f43b40edbf0 con 0x5638620055d0 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43c1876740 10 client.17898 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43c1876740 10 client.17898 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43c1876740 20 client.17898 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:12.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43c1876740 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56386208f660 0x563862091a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43c1876740 4 client.17898 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43c1876740 1 -- 172.21.15.70:0/2811739622 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563861f72d70 con 0x56386208f660 2024-09-19T04:39:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.992+0000 7f43bca38640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56386208f660 0x563862091a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43a0ff9640 10 client.17898 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43bca38640 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56386208f660 0x563862091a80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=10dca9c7caaabec3 server_cookie=f6a5c9cd22340b64 in_seq=0 out_seq=0 2024-09-19T04:39:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43a0ff9640 1 -- 172.21.15.70:0/2811739622 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563861f72d70 con 0x56386208f660 2024-09-19T04:39:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43a0ff9640 10 client.17898 handle_command_reply: tid=0 2024-09-19T04:39:12.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 client.17898 shutdown 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 -- 172.21.15.70:0/2811739622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 msgr2=0x56386201ce30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x56386201ce30 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7f43b40b8ed0 tx=0x7f43b4005bd0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 -- 172.21.15.70:0/2811739622 shutdown_connections 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56386208f660 0x563862091a80 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563862014780 0x563862018700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43a0ff9640 0 client.17898 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563862006b40 0x563862018160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 --2- 172.21.15.70:0/2811739622 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5638620055d0 0x56386201ce30 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 -- 172.21.15.70:0/2811739622 >> 172.21.15.70:0/2811739622 conn(0x563861fce310 msgr2=0x563862013470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 -- 172.21.15.70:0/2811739622 shutdown_connections 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 1 -- 172.21.15.70:0/2811739622 wait complete. 2024-09-19T04:39:12.006 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.993+0000 7f43c1876740 20 client.17898 trim_cache size 0 max 16384 2024-09-19T04:39:12.007 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:12.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 -- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43a40a3430 msgr2=0x7f43a40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43a40a3430 0x7f43a40a58f0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f43b0005c40 tx=0x7f43b0005bd0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 -- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8100a80 msgr2=0x7f43b81992e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8100a80 0x7f43b81992e0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7f43b4005940 tx=0x7f43b40042f0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 -- 172.21.15.70:0/2821751694 shutdown_connections 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f43a40a3430 0x7f43a40a58f0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43b8106a80 0x7f43b81a4360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f43b8101420 0x7f43b8199820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 --2- 172.21.15.70:0/2821751694 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f43b8100a80 0x7f43b81992e0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 -- 172.21.15.70:0/2821751694 >> 172.21.15.70:0/2821751694 conn(0x7f43b80fc7a0 msgr2=0x7f43b80fcf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 -- 172.21.15.70:0/2821751694 shutdown_connections 2024-09-19T04:39:12.008 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:11.994+0000 7f43bf49d640 1 -- 172.21.15.70:0/2821751694 wait complete. 2024-09-19T04:39:12.624 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:39:12.871 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:12.992 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:12 smithi070 ceph-mon[30942]: pgmap v261: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:12 smithi134 ceph-mon[34525]: pgmap v261: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:13.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:12 smithi167 ceph-mon[34339]: pgmap v261: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.379+0000 7fe22ac89640 1 -- 172.21.15.70:0/976903215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224105560 msgr2=0x7fe22410d0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.379+0000 7fe22ac89640 1 --2- 172.21.15.70:0/976903215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224105560 0x7fe22410d0e0 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009900 tx=0x7fe21c02a410 comp rx=0 tx=0).stop 2024-09-19T04:39:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.379+0000 7fe22ac89640 1 -- 172.21.15.70:0/976903215 shutdown_connections 2024-09-19T04:39:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 --2- 172.21.15.70:0/976903215 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224105560 0x7fe22410d0e0 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 --2- 172.21.15.70:0/976903215 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224100de0 0x7fe224104e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 --2- 172.21.15.70:0/976903215 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224100430 0x7fe224100810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 -- 172.21.15.70:0/976903215 >> 172.21.15.70:0/976903215 conn(0x7fe224077230 msgr2=0x7fe2240fe640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:13.383 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 -- 172.21.15.70:0/976903215 shutdown_connections 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 -- 172.21.15.70:0/976903215 wait complete. 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 Processor -- start 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 -- start start 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100430 0x7fe2241961e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224100de0 0x7fe224196720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224105560 0x7fe22419aab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe22410fd40 con 0x7fe224100430 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe22410fbc0 con 0x7fe224100de0 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.380+0000 7fe22ac89640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe22410fec0 con 0x7fe224105560 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100430 0x7fe2241961e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100430 0x7fe2241961e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52524/0 (socket says 172.21.15.70:52524) 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 -- 172.21.15.70:0/3748244172 learned_addr learned my addr 172.21.15.70:0/3748244172 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe223fff640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224100de0 0x7fe224196720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 -- 172.21.15.70:0/3748244172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224105560 msgr2=0x7fe22419aab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224105560 0x7fe22419aab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 -- 172.21.15.70:0/3748244172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224100de0 msgr2=0x7fe224196720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224100de0 0x7fe224196720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 -- 172.21.15.70:0/3748244172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22419b190 con 0x7fe224100430 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe223fff640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224100de0 0x7fe224196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe228a25640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100430 0x7fe2241961e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00df40 tx=0x7fe20c00df70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe221ffb640 1 -- 172.21.15.70:0/3748244172 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c00ea60 con 0x7fe224100430 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe221ffb640 1 -- 172.21.15.70:0/3748244172 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe20c00ec00 con 0x7fe224100430 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe22ac89640 1 -- 172.21.15.70:0/3748244172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22419b420 con 0x7fe224100430 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe221ffb640 1 -- 172.21.15.70:0/3748244172 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c016760 con 0x7fe224100430 2024-09-19T04:39:13.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.381+0000 7fe22ac89640 1 -- 172.21.15.70:0/3748244172 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2241a2d60 con 0x7fe224100430 2024-09-19T04:39:13.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe221ffb640 1 -- 172.21.15.70:0/3748244172 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe20c009580 con 0x7fe224100430 2024-09-19T04:39:13.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe22d062740 1 Processor -- start 2024-09-19T04:39:13.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe22d062740 1 -- start start 2024-09-19T04:39:13.390 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe221ffb640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe22d062740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a34090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe22d062740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 0x558410a34a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe22d062740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a41760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe221ffb640 1 -- 172.21.15.70:0/3748244172 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7fe20c0d1400 con 0x7fe224100430 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe22d062740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55841099a2f0 con 0x558410a3f370 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe22d062740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558410941cf0 con 0x558410a35b40 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe22d062740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5584109962b0 con 0x558410a345d0 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.384+0000 7fe229226640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a41760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a41760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52538/0 (socket says 172.21.15.70:52538) 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 -- 172.21.15.70:0/1402687808 learned_addr learned my addr 172.21.15.70:0/1402687808 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:13.391 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe228a25640 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a34090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe223fff640 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 0x558410a34a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe21c033000 tx=0x7fe21c032ee0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 -- 172.21.15.70:0/1402687808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 msgr2=0x558410a34a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 0x558410a34a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 -- 172.21.15.70:0/1402687808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 msgr2=0x558410a34090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a34090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 -- 172.21.15.70:0/1402687808 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584109263a0 con 0x558410a3f370 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe228a25640 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a34090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe229226640 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a41760 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe21c031940 tx=0x7fe21c045000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=321aa9ac2088c669 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe21affd640 1 -- 172.21.15.70:0/1402687808 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c04d070 con 0x558410a3f370 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe21affd640 1 -- 172.21.15.70:0/1402687808 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe21c005520 con 0x558410a3f370 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.385+0000 7fe21affd640 1 -- 172.21.15.70:0/1402687808 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c035070 con 0x558410a3f370 2024-09-19T04:39:13.392 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 -- 172.21.15.70:0/1402687808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 msgr2=0x558410a41760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a41760 secure :-1 s=READY pgs=1217 cs=0 l=1 rev1=1 crypto rx=0x7fe21c031940 tx=0x7fe21c045000 comp rx=0 tx=0).stop 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 -- 172.21.15.70:0/1402687808 shutdown_connections 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a41760 unknown :-1 s=CLOSED pgs=1217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 0x558410a34a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 --2- 172.21.15.70:0/1402687808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a34090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 -- 172.21.15.70:0/1402687808 >> 172.21.15.70:0/1402687808 conn(0x5584109fd310 msgr2=0x558410a30c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 -- 172.21.15.70:0/1402687808 shutdown_connections 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 -- 172.21.15.70:0/1402687808 wait complete. 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.386+0000 7fe22d062740 1 -- start start 2024-09-19T04:39:13.393 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe22d062740 1 Processor -- start 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe22d062740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 0x558410a3edd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe22d062740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a3c080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe22d062740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a3c810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe22d062740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x558410a42010 con 0x558410a3f370 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe22d062740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x558410955060 con 0x558410a35b40 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe22d062740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x558410a42190 con 0x558410a345d0 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe22d062740 10 client.0 _ll_register_callbacks cb 0x5584106a88c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe229226640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a3c810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe229226640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a3c810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52552/0 (socket says 172.21.15.70:52552) 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe229226640 1 -- 172.21.15.70:0/3321795754 learned_addr learned my addr 172.21.15.70:0/3321795754 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe228a25640 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 0x558410a3edd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe223fff640 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a3c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.394 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe229226640 1 -- 172.21.15.70:0/3321795754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 msgr2=0x558410a3edd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe229226640 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 0x558410a3edd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe229226640 1 -- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 msgr2=0x558410a3c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe229226640 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a3c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe229226640 1 -- 172.21.15.70:0/3321795754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841070b3c0 con 0x558410a3f370 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.387+0000 7fe223fff640 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a3c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe229226640 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a3c810 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe21c04b040 tx=0x7fe21c0048f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5865293951851d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe203fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe203fff640 1 -- 172.21.15.70:0/3321795754 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c035070 con 0x558410a3f370 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe203fff640 1 -- 172.21.15.70:0/3321795754 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7fe21c004300 con 0x558410a3f370 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 1 -- 172.21.15.70:0/3321795754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c005520 con 0x558410a3f370 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe203fff640 1 -- 172.21.15.70:0/3321795754 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe21c05e050 con 0x558410a3f370 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 10 client.17910 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 1 -- 172.21.15.70:0/3321795754 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558410a42010 con 0x558410a3f370 2024-09-19T04:39:13.395 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe203fff640 1 -- 172.21.15.70:0/3321795754 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe21c005520 con 0x558410a3f370 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe203fff640 1 -- 172.21.15.70:0/3321795754 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe21c059030 con 0x558410a3f370 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 10 client.17910 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 10 client.17910 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 20 client.17910 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558410a4ecb0 0x558410a510a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 4 client.17910 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.388+0000 7fe22d062740 1 -- 172.21.15.70:0/3321795754 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5584109a7860 con 0x558410a4ecb0 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.389+0000 7fe228a25640 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558410a4ecb0 0x558410a510a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.389+0000 7fe203fff640 10 client.17910 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:13.396 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.389+0000 7fe228a25640 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558410a4ecb0 0x558410a510a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=4f7b42fb8ce96753 server_cookie=7d30f8bbbf71e301 in_seq=0 out_seq=0 2024-09-19T04:39:13.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe203fff640 1 -- 172.21.15.70:0/3321795754 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5584109a7860 con 0x558410a4ecb0 2024-09-19T04:39:13.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe203fff640 10 client.17910 handle_command_reply: tid=0 2024-09-19T04:39:13.397 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 client.17910 shutdown 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 -- 172.21.15.70:0/3321795754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 msgr2=0x558410a3c810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a3c810 secure :-1 s=READY pgs=1218 cs=0 l=1 rev1=1 crypto rx=0x7fe21c04b040 tx=0x7fe21c0048f0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 -- 172.21.15.70:0/3321795754 shutdown_connections 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558410a4ecb0 0x558410a510a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a3f370 0x558410a3c810 unknown :-1 s=CLOSED pgs=1218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe203fff640 0 client.17910 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a35b40 0x558410a3c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 --2- 172.21.15.70:0/3321795754 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a345d0 0x558410a3edd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 -- 172.21.15.70:0/3321795754 >> 172.21.15.70:0/3321795754 conn(0x5584109fd310 msgr2=0x558410a36960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:13.398 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 -- 172.21.15.70:0/3321795754 shutdown_connections 2024-09-19T04:39:13.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 1 -- 172.21.15.70:0/3321795754 wait complete. 2024-09-19T04:39:13.399 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.390+0000 7fe22d062740 20 client.17910 trim_cache size 0 max 16384 2024-09-19T04:39:13.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe22d062740 1 Processor -- start 2024-09-19T04:39:13.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe22d062740 1 -- start start 2024-09-19T04:39:13.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe22d062740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a3b940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe22d062740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 0x558410a56830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.415 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe22d062740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a3f370 0x558410a56d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe22d062740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241adf50 con 0x558410a345d0 2024-09-19T04:39:13.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe22d062740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ab820 con 0x558410a3f370 2024-09-19T04:39:13.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe22d062740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241a9690 con 0x558410a35b40 2024-09-19T04:39:13.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe228a25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a3b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.416 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe228a25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a3b940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52566/0 (socket says 172.21.15.70:52566) 2024-09-19T04:39:13.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe228a25640 1 -- 172.21.15.70:0/1980883497 learned_addr learned my addr 172.21.15.70:0/1980883497 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:13.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe223fff640 1 --2- 172.21.15.70:0/1980883497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 0x558410a56830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe228a25640 1 -- 172.21.15.70:0/1980883497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 msgr2=0x558410a56830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:13.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe228a25640 1 --2- 172.21.15.70:0/1980883497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 0x558410a56830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe228a25640 1 -- 172.21.15.70:0/1980883497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a3f370 msgr2=0x558410a56d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:13.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe228a25640 1 --2- 172.21.15.70:0/1980883497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a3f370 0x558410a56d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.403+0000 7fe228a25640 1 -- 172.21.15.70:0/1980883497 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558410a3a5d0 con 0x558410a345d0 2024-09-19T04:39:13.417 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe228a25640 1 --2- 172.21.15.70:0/1980883497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a3b940 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fe20c09d550 tx=0x7fe20c004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb06d53b2f205c6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe21a7fc640 1 -- 172.21.15.70:0/1980883497 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0a6430 con 0x558410a345d0 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe21a7fc640 1 -- 172.21.15.70:0/1980883497 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe20c09b8f0 con 0x558410a345d0 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe21a7fc640 1 -- 172.21.15.70:0/1980883497 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c009870 con 0x558410a345d0 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 -- 172.21.15.70:0/1980883497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 msgr2=0x558410a3b940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 --2- 172.21.15.70:0/1980883497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a3b940 secure :-1 s=READY pgs=1219 cs=0 l=1 rev1=1 crypto rx=0x7fe20c09d550 tx=0x7fe20c004b50 comp rx=0 tx=0).stop 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 -- 172.21.15.70:0/1980883497 shutdown_connections 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 --2- 172.21.15.70:0/1980883497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a3f370 0x558410a56d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 --2- 172.21.15.70:0/1980883497 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 0x558410a56830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 --2- 172.21.15.70:0/1980883497 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a3b940 unknown :-1 s=CLOSED pgs=1219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 -- 172.21.15.70:0/1980883497 >> 172.21.15.70:0/1980883497 conn(0x5584109fd310 msgr2=0x558410a2ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 -- 172.21.15.70:0/1980883497 shutdown_connections 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.404+0000 7fe22d062740 1 -- 172.21.15.70:0/1980883497 wait complete. 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 1 -- start start 2024-09-19T04:39:13.418 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 1 Processor -- start 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a47c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 0x558410a42f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a3f370 0x558410a434c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241a9ce0 con 0x558410a345d0 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ab150 con 0x558410a3f370 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241aa3b0 con 0x558410a35b40 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe22d062740 10 client.0 _ll_register_callbacks cb 0x7fe21c04b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe228a25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a47c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe228a25640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a47c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52570/0 (socket says 172.21.15.70:52570) 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe228a25640 1 -- 172.21.15.70:0/3334315973 learned_addr learned my addr 172.21.15.70:0/3334315973 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe223fff640 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 0x558410a42f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe228a25640 1 -- 172.21.15.70:0/3334315973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 msgr2=0x558410a42f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:13.419 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe228a25640 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 0x558410a42f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe228a25640 1 -- 172.21.15.70:0/3334315973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a3f370 msgr2=0x558410a434c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe228a25640 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a3f370 0x558410a434c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.405+0000 7fe228a25640 1 -- 172.21.15.70:0/3334315973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558410a43cf0 con 0x558410a345d0 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe228a25640 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a47c10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00b0a0 tx=0x7fe20c0880b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8d172e5da5a5760 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe203fff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe203fff640 1 -- 172.21.15.70:0/3334315973 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0ba070 con 0x558410a345d0 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe203fff640 1 -- 172.21.15.70:0/3334315973 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 8571+0+0 (secure 0 0 0) 0x7fe20c00edb0 con 0x558410a345d0 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 1 -- 172.21.15.70:0/3334315973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe20c09b8f0 con 0x558410a345d0 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe203fff640 1 -- 172.21.15.70:0/3334315973 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe20c0b5030 con 0x558410a345d0 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 10 client.17916 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 1 -- 172.21.15.70:0/3334315973 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x558410ab98a0 con 0x558410a345d0 2024-09-19T04:39:13.420 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe203fff640 1 -- 172.21.15.70:0/3334315973 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe20c09b8f0 con 0x558410a345d0 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe203fff640 1 -- 172.21.15.70:0/3334315973 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe20c0b1ce0 con 0x558410a345d0 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 10 client.17916 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 10 client.17916 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 20 client.17916 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558410a4ecb0 0x558410abbf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 4 client.17916 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.406+0000 7fe22d062740 1 -- 172.21.15.70:0/3334315973 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5584109a1d70 con 0x558410a4ecb0 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe223fff640 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558410a4ecb0 0x558410abbf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe223fff640 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558410a4ecb0 0x558410abbf20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=9835e06d916d4fd3 server_cookie=a468b7169bf825d6 in_seq=0 out_seq=0 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe203fff640 10 client.17916 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe203fff640 1 -- 172.21.15.70:0/3334315973 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5584109a1d70 con 0x558410a4ecb0 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe203fff640 10 client.17916 handle_command_reply: tid=0 2024-09-19T04:39:13.421 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 client.17916 shutdown 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 -- 172.21.15.70:0/3334315973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 msgr2=0x558410a47c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a47c10 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00b0a0 tx=0x7fe20c0880b0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 -- 172.21.15.70:0/3334315973 shutdown_connections 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x558410a4ecb0 0x558410abbf20 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe203fff640 0 client.17916 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x558410a3f370 0x558410a434c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x558410a35b40 0x558410a42f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 --2- 172.21.15.70:0/3334315973 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x558410a345d0 0x558410a47c10 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.407+0000 7fe22d062740 1 -- 172.21.15.70:0/3334315973 >> 172.21.15.70:0/3334315973 conn(0x5584109fd310 msgr2=0x558410a3e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22d062740 1 -- 172.21.15.70:0/3334315973 shutdown_connections 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22d062740 1 -- 172.21.15.70:0/3334315973 wait complete. 2024-09-19T04:39:13.422 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22d062740 20 client.17916 trim_cache size 0 max 16384 2024-09-19T04:39:13.423 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:13.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 -- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 msgr2=0x7fe2100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fe21c033000 tx=0x7fe21c032ee0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 -- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100430 msgr2=0x7fe2241961e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:13.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100430 0x7fe2241961e0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7fe20c00df40 tx=0x7fe20c00df70 comp rx=0 tx=0).stop 2024-09-19T04:39:13.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 -- 172.21.15.70:0/3748244172 shutdown_connections 2024-09-19T04:39:13.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224105560 0x7fe22419aab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.424 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224100de0 0x7fe224196720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 --2- 172.21.15.70:0/3748244172 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100430 0x7fe2241961e0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 -- 172.21.15.70:0/3748244172 >> 172.21.15.70:0/3748244172 conn(0x7fe224077230 msgr2=0x7fe224103800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 -- 172.21.15.70:0/3748244172 shutdown_connections 2024-09-19T04:39:13.425 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:13.408+0000 7fe22ac89640 1 -- 172.21.15.70:0/3748244172 wait complete. 2024-09-19T04:39:14.222 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:39:14.473 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 -- 172.21.15.70:0/2495455079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c10c180 msgr2=0x7fe05c10e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 --2- 172.21.15.70:0/2495455079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c10c180 0x7fe05c10e600 secure :-1 s=READY pgs=1221 cs=0 l=1 rev1=1 crypto rx=0x7fe054009ca0 tx=0x7fe05402a950 comp rx=0 tx=0).stop 2024-09-19T04:39:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 -- 172.21.15.70:0/2495455079 shutdown_connections 2024-09-19T04:39:15.076 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 --2- 172.21.15.70:0/2495455079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c10c180 0x7fe05c10e600 unknown :-1 s=CLOSED pgs=1221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 --2- 172.21.15.70:0/2495455079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c1036c0 0x7fe05c10bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 --2- 172.21.15.70:0/2495455079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c102da0 0x7fe05c103180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 -- 172.21.15.70:0/2495455079 >> 172.21.15.70:0/2495455079 conn(0x7fe05c0fc7a0 msgr2=0x7fe05c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:15.077 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 -- 172.21.15.70:0/2495455079 shutdown_connections 2024-09-19T04:39:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 -- 172.21.15.70:0/2495455079 wait complete. 2024-09-19T04:39:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.055+0000 7fe064013640 1 Processor -- start 2024-09-19T04:39:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe064013640 1 -- start start 2024-09-19T04:39:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe064013640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102da0 0x7fe05c198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe064013640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c1036c0 0x7fe05c198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.078 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe064013640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c10c180 0x7fe05c19cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe064013640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c111f10 con 0x7fe05c102da0 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe064013640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c111d90 con 0x7fe05c10c180 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe064013640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c112090 con 0x7fe05c1036c0 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102da0 0x7fe05c198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102da0 0x7fe05c198350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52586/0 (socket says 172.21.15.70:52586) 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 -- 172.21.15.70:0/3081582930 learned_addr learned my addr 172.21.15.70:0/3081582930 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c10c180 0x7fe05c19cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe0615ae640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c1036c0 0x7fe05c198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.079 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 -- 172.21.15.70:0/3081582930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c1036c0 msgr2=0x7fe05c198890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c1036c0 0x7fe05c198890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 -- 172.21.15.70:0/3081582930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c10c180 msgr2=0x7fe05c19cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.080 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c10c180 0x7fe05c19cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 -- 172.21.15.70:0/3081582930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c19d300 con 0x7fe05c102da0 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe0615ae640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c1036c0 0x7fe05c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c10c180 0x7fe05c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe061daf640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102da0 0x7fe05c198350 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c920 tx=0x7fe05800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.056+0000 7fe052ffd640 1 -- 172.21.15.70:0/3081582930 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058007c70 con 0x7fe05c102da0 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.057+0000 7fe064013640 1 -- 172.21.15.70:0/3081582930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05c19d5f0 con 0x7fe05c102da0 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.057+0000 7fe052ffd640 1 -- 172.21.15.70:0/3081582930 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe058007e10 con 0x7fe05c102da0 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.057+0000 7fe052ffd640 1 -- 172.21.15.70:0/3081582930 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058018800 con 0x7fe05c102da0 2024-09-19T04:39:15.081 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.057+0000 7fe064013640 1 -- 172.21.15.70:0/3081582930 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05c1a4ed0 con 0x7fe05c102da0 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.059+0000 7fe052ffd640 1 -- 172.21.15.70:0/3081582930 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe058018ae0 con 0x7fe05c102da0 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.059+0000 7fe0663ec740 1 Processor -- start 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0663ec740 1 -- start start 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9de090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 0x56100a9dea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9e9370 0x56100a9eb760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0663ec740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56100a9442f0 con 0x56100a9dfb40 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0663ec740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56100a8ebcf0 con 0x56100a9e9370 2024-09-19T04:39:15.082 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0663ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56100a9402b0 con 0x56100a9de5d0 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0625b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9de090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0625b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9de090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52602/0 (socket says 172.21.15.70:52602) 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0625b0640 1 -- 172.21.15.70:0/3232646614 learned_addr learned my addr 172.21.15.70:0/3232646614 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe061daf640 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 0x56100a9dea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0615ae640 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9e9370 0x56100a9eb760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe052ffd640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a33b0 0x7fe0480a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0625b0640 1 -- 172.21.15.70:0/3232646614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 msgr2=0x56100a9dea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 0x56100a9dea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.083 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0625b0640 1 -- 172.21.15.70:0/3232646614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9e9370 msgr2=0x56100a9eb760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9e9370 0x56100a9eb760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.060+0000 7fe0625b0640 1 -- 172.21.15.70:0/3232646614 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100a8d03a0 con 0x56100a9dfb40 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.061+0000 7fe052ffd640 1 -- 172.21.15.70:0/3081582930 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe0580cff40 con 0x7fe05c102da0 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.061+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a33b0 0x7fe0480a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.061+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9de090 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe05402ff00 tx=0x7fe05402ff30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=378196095b3cf77b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.061+0000 7fe047fff640 1 -- 172.21.15.70:0/3232646614 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054034040 con 0x56100a9dfb40 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.061+0000 7fe047fff640 1 -- 172.21.15.70:0/3232646614 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe054003e40 con 0x56100a9dfb40 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.061+0000 7fe047fff640 1 -- 172.21.15.70:0/3232646614 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe0540046e0 con 0x56100a9dfb40 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 -- 172.21.15.70:0/3232646614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 msgr2=0x56100a9de090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.084 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a33b0 0x7fe0480a5870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe054049000 tx=0x7fe05404c000 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9de090 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7fe05402ff00 tx=0x7fe05402ff30 comp rx=0 tx=0).stop 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 -- 172.21.15.70:0/3232646614 shutdown_connections 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9e9370 0x56100a9eb760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 0x56100a9dea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 --2- 172.21.15.70:0/3232646614 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9de090 unknown :-1 s=CLOSED pgs=1223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 -- 172.21.15.70:0/3232646614 >> 172.21.15.70:0/3232646614 conn(0x56100a9a7310 msgr2=0x56100a9dac60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 -- 172.21.15.70:0/3232646614 shutdown_connections 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 -- 172.21.15.70:0/3232646614 wait complete. 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 -- start start 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.062+0000 7fe0663ec740 1 Processor -- start 2024-09-19T04:39:15.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 0x56100a9e8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9e6010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9e9370 0x56100a9e6600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0663ec740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56100a9ec070 con 0x56100a9dfb40 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0663ec740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56100a8ff060 con 0x56100a9de5d0 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0663ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56100a9ec1f0 con 0x56100a9e9370 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0663ec740 10 client.0 _ll_register_callbacks cb 0x56100a6528c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9e6010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9e6010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52614/0 (socket says 172.21.15.70:52614) 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 -- 172.21.15.70:0/2725823833 learned_addr learned my addr 172.21.15.70:0/2725823833 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:15.086 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe061daf640 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 0x56100a9e8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 -- 172.21.15.70:0/2725823833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9e9370 msgr2=0x56100a9e6600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9e9370 0x56100a9e6600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 -- 172.21.15.70:0/2725823833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 msgr2=0x56100a9e8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 0x56100a9e8d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 -- 172.21.15.70:0/2725823833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100a6b53c0 con 0x56100a9dfb40 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0615ae640 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9e6010 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00dd70 tx=0x7fe04c00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0d5066e3fe17c15 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0457fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0457fa640 1 -- 172.21.15.70:0/2725823833 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe04c005020 con 0x56100a9dfb40 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0457fa640 1 -- 172.21.15.70:0/2725823833 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe04c0051c0 con 0x56100a9dfb40 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.063+0000 7fe0663ec740 1 -- 172.21.15.70:0/2725823833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56100a951860 con 0x56100a9dfb40 2024-09-19T04:39:15.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0457fa640 1 -- 172.21.15.70:0/2725823833 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe04c0053c0 con 0x56100a9dfb40 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0663ec740 10 client.17928 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0663ec740 1 -- 172.21.15.70:0/2725823833 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56100a9f7b70 con 0x56100a9dfb40 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0457fa640 1 -- 172.21.15.70:0/2725823833 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x56100a951860 con 0x56100a9dfb40 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0457fa640 1 -- 172.21.15.70:0/2725823833 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe04c011650 con 0x56100a9dfb40 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0663ec740 10 client.17928 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0663ec740 10 client.17928 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0663ec740 20 client.17928 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0663ec740 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56100a9f90d0 0x56100a9fb570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0663ec740 4 client.17928 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe0663ec740 1 -- 172.21.15.70:0/2725823833 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56100a94bd70 con 0x56100a9f90d0 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.064+0000 7fe061daf640 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56100a9f90d0 0x56100a9fb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.065+0000 7fe061daf640 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56100a9f90d0 0x56100a9fb570 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d63aa1bd6dba2583 server_cookie=3850d3c623bc87f2 in_seq=0 out_seq=0 2024-09-19T04:39:15.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.065+0000 7fe0457fa640 10 client.17928 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.065+0000 7fe0457fa640 1 -- 172.21.15.70:0/2725823833 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56100a94bd70 con 0x56100a9f90d0 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.065+0000 7fe0457fa640 10 client.17928 handle_command_reply: tid=0 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.065+0000 7fe0663ec740 1 client.17928 shutdown 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 -- 172.21.15.70:0/2725823833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 msgr2=0x56100a9e6010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9e6010 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7fe04c00dd70 tx=0x7fe04c00f730 comp rx=0 tx=0).stop 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 -- 172.21.15.70:0/2725823833 shutdown_connections 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56100a9f90d0 0x56100a9fb570 crc :-1 s=READY pgs=204 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9e9370 0x56100a9e6600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9dfb40 0x56100a9e6010 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 --2- 172.21.15.70:0/2725823833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 0x56100a9e8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0457fa640 0 client.17928 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:15.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 -- 172.21.15.70:0/2725823833 >> 172.21.15.70:0/2725823833 conn(0x56100a9a7310 msgr2=0x56100a9e0960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:15.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 -- 172.21.15.70:0/2725823833 shutdown_connections 2024-09-19T04:39:15.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 1 -- 172.21.15.70:0/2725823833 wait complete. 2024-09-19T04:39:15.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.066+0000 7fe0663ec740 20 client.17928 trim_cache size 0 max 16384 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0663ec740 1 Processor -- start 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0663ec740 1 -- start start 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 0x56100a9f5310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9dfb40 0x56100a9e7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100aa00e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0663ec740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1b00b0 con 0x56100a9e9370 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0663ec740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1ad980 con 0x56100a9de5d0 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0663ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1ab7f0 con 0x56100a9dfb40 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0625b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100aa00e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0625b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100aa00e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52616/0 (socket says 172.21.15.70:52616) 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0615ae640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9dfb40 0x56100a9e7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0625b0640 1 -- 172.21.15.70:0/3298584001 learned_addr learned my addr 172.21.15.70:0/3298584001 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe061daf640 1 --2- 172.21.15.70:0/3298584001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 0x56100a9f5310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0625b0640 1 -- 172.21.15.70:0/3298584001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9dfb40 msgr2=0x56100a9e7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3298584001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9dfb40 0x56100a9e7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0625b0640 1 -- 172.21.15.70:0/3298584001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 msgr2=0x56100a9f5310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3298584001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 0x56100a9f5310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.079+0000 7fe0625b0640 1 -- 172.21.15.70:0/3298584001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56100a9f5850 con 0x56100a9e9370 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0625b0640 1 --2- 172.21.15.70:0/3298584001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100aa00e40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fe05402ae70 tx=0x7fe05402fe80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6de48513b7e219 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0477fe640 1 -- 172.21.15.70:0/3298584001 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054034040 con 0x56100a9e9370 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0477fe640 1 -- 172.21.15.70:0/3298584001 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe054004000 con 0x56100a9e9370 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0477fe640 1 -- 172.21.15.70:0/3298584001 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054030440 con 0x56100a9e9370 2024-09-19T04:39:15.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 -- 172.21.15.70:0/3298584001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 msgr2=0x56100aa00e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 --2- 172.21.15.70:0/3298584001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100aa00e40 secure :-1 s=READY pgs=1225 cs=0 l=1 rev1=1 crypto rx=0x7fe05402ae70 tx=0x7fe05402fe80 comp rx=0 tx=0).stop 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 -- 172.21.15.70:0/3298584001 shutdown_connections 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 --2- 172.21.15.70:0/3298584001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100aa00e40 unknown :-1 s=CLOSED pgs=1225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 --2- 172.21.15.70:0/3298584001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9dfb40 0x56100a9e7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 --2- 172.21.15.70:0/3298584001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9de5d0 0x56100a9f5310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 -- 172.21.15.70:0/3298584001 >> 172.21.15.70:0/3298584001 conn(0x56100a9a7310 msgr2=0x56100a9e7870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 -- 172.21.15.70:0/3298584001 shutdown_connections 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.080+0000 7fe0663ec740 1 -- 172.21.15.70:0/3298584001 wait complete. 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 1 -- start start 2024-09-19T04:39:15.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 1 Processor -- start 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 0x56100a9f1480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9dfb40 0x56100a9f19c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100a9ee450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1abe40 con 0x56100a9e9370 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1ad2b0 con 0x56100a9dfb40 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1ac510 con 0x56100a9de5d0 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0663ec740 10 client.0 _ll_register_callbacks cb 0x7fe04c00d2e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0625b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100a9ee450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0625b0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100a9ee450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52626/0 (socket says 172.21.15.70:52626) 2024-09-19T04:39:15.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.081+0000 7fe0625b0640 1 -- 172.21.15.70:0/1708802009 learned_addr learned my addr 172.21.15.70:0/1708802009 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe061daf640 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 0x56100a9f1480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0615ae640 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9dfb40 0x56100a9f19c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0625b0640 1 -- 172.21.15.70:0/1708802009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 msgr2=0x56100a9f1480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0625b0640 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 0x56100a9f1480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0625b0640 1 -- 172.21.15.70:0/1708802009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9dfb40 msgr2=0x56100a9f19c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0625b0640 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9dfb40 0x56100a9f19c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0625b0640 1 -- 172.21.15.70:0/1708802009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56100a9ee990 con 0x56100a9e9370 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0625b0640 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100a9ee450 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fe0540049d0 tx=0x7fe0540043e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf7c307066b263a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:15.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0457fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:15.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0457fa640 1 -- 172.21.15.70:0/1708802009 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe054034070 con 0x56100a9e9370 2024-09-19T04:39:15.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0457fa640 1 -- 172.21.15.70:0/1708802009 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe054040040 con 0x56100a9e9370 2024-09-19T04:39:15.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0663ec740 1 -- 172.21.15.70:0/1708802009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe054004000 con 0x56100a9e9370 2024-09-19T04:39:15.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0457fa640 1 -- 172.21.15.70:0/1708802009 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe054004580 con 0x56100a9e9370 2024-09-19T04:39:15.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0663ec740 10 client.17934 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:15.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0663ec740 1 -- 172.21.15.70:0/1708802009 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56100aa64500 con 0x56100a9e9370 2024-09-19T04:39:15.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.082+0000 7fe0457fa640 1 -- 172.21.15.70:0/1708802009 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe054004000 con 0x56100a9e9370 2024-09-19T04:39:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.083+0000 7fe0457fa640 1 -- 172.21.15.70:0/1708802009 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe054030c50 con 0x56100a9e9370 2024-09-19T04:39:15.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.083+0000 7fe0663ec740 10 client.17934 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.083+0000 7fe0663ec740 10 client.17934 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.083+0000 7fe0663ec740 20 client.17934 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.083+0000 7fe0663ec740 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56100aa64780 0x56100aa66b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.083+0000 7fe0663ec740 4 client.17934 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:15.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.083+0000 7fe0663ec740 1 -- 172.21.15.70:0/1708802009 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56100a8c8170 con 0x56100aa64780 2024-09-19T04:39:15.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.083+0000 7fe061daf640 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56100aa64780 0x56100aa66b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0457fa640 10 client.17934 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe061daf640 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56100aa64780 0x56100aa66b70 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b054d406610a31a server_cookie=a8f77c86fc45ce88 in_seq=0 out_seq=0 2024-09-19T04:39:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0457fa640 1 -- 172.21.15.70:0/1708802009 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56100a8c8170 con 0x56100aa64780 2024-09-19T04:39:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0457fa640 10 client.17934 handle_command_reply: tid=0 2024-09-19T04:39:15.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 client.17934 shutdown 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 -- 172.21.15.70:0/1708802009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 msgr2=0x56100a9ee450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100a9ee450 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7fe0540049d0 tx=0x7fe0540043e0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 -- 172.21.15.70:0/1708802009 shutdown_connections 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x56100aa64780 0x56100aa66b70 crc :-1 s=READY pgs=205 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x56100a9e9370 0x56100a9ee450 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x56100a9dfb40 0x56100a9f19c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0457fa640 0 client.17934 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 --2- 172.21.15.70:0/1708802009 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x56100a9de5d0 0x56100a9f1480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 -- 172.21.15.70:0/1708802009 >> 172.21.15.70:0/1708802009 conn(0x56100a9a7310 msgr2=0x56100a9e8090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 -- 172.21.15.70:0/1708802009 shutdown_connections 2024-09-19T04:39:15.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 1 -- 172.21.15.70:0/1708802009 wait complete. 2024-09-19T04:39:15.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.084+0000 7fe0663ec740 20 client.17934 trim_cache size 0 max 16384 2024-09-19T04:39:15.110 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 -- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a33b0 msgr2=0x7fe0480a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a33b0 0x7fe0480a5870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe054049000 tx=0x7fe05404c000 comp rx=0 tx=0).stop 2024-09-19T04:39:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 -- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102da0 msgr2=0x7fe05c198350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102da0 0x7fe05c198350 secure :-1 s=READY pgs=1222 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c920 tx=0x7fe05800cde0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 -- 172.21.15.70:0/3081582930 shutdown_connections 2024-09-19T04:39:15.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a33b0 0x7fe0480a5870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c10c180 0x7fe05c19cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c1036c0 0x7fe05c198890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 --2- 172.21.15.70:0/3081582930 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102da0 0x7fe05c198350 unknown :-1 s=CLOSED pgs=1222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 -- 172.21.15.70:0/3081582930 >> 172.21.15.70:0/3081582930 conn(0x7fe05c0fc7a0 msgr2=0x7fe05c0fde80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 -- 172.21.15.70:0/3081582930 shutdown_connections 2024-09-19T04:39:15.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:15.085+0000 7fe064013640 1 -- 172.21.15.70:0/3081582930 wait complete. 2024-09-19T04:39:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:15 smithi134 ceph-mon[34525]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:39:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:15 smithi134 ceph-mon[34525]: pgmap v263: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:39:15.855 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:15 smithi070 ceph-mon[30942]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:39:15.856 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:15 smithi070 ceph-mon[30942]: pgmap v263: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:39:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:15 smithi167 ceph-mon[34339]: osdmap e90: 12 total, 12 up, 12 in 2024-09-19T04:39:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:15 smithi167 ceph-mon[34339]: pgmap v263: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 255 B/s wr, 8 op/s 2024-09-19T04:39:16.889 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:39:16.889 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:39:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:16 smithi134 ceph-mon[34525]: pgmap v264: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:39:17.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:16 smithi070 ceph-mon[30942]: pgmap v264: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:39:17.156 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:17.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:16 smithi167 ceph-mon[34339]: pgmap v264: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 114 B/s wr, 3 op/s 2024-09-19T04:39:17.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.566+0000 7f18a8876640 1 -- 172.21.15.70:0/2914464460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4106f10 msgr2=0x7f18a410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.566+0000 7f18a8876640 1 --2- 172.21.15.70:0/2914464460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4106f10 0x7f18a410ea90 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f189c009ca0 tx=0x7f189c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 -- 172.21.15.70:0/2914464460 shutdown_connections 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 --2- 172.21.15.70:0/2914464460 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4106f10 0x7f18a410ea90 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 --2- 172.21.15.70:0/2914464460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4102790 0x7f18a41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 --2- 172.21.15.70:0/2914464460 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a4101de0 0x7f18a41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 -- 172.21.15.70:0/2914464460 >> 172.21.15.70:0/2914464460 conn(0x7f18a40fd8c0 msgr2=0x7f18a40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 -- 172.21.15.70:0/2914464460 shutdown_connections 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 -- 172.21.15.70:0/2914464460 wait complete. 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 Processor -- start 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.567+0000 7f18a8876640 1 -- start start 2024-09-19T04:39:17.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a8876640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4101de0 0x7f18a4198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a8876640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4102790 0x7f18a4198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a8876640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a4106f10 0x7f18a419ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a8876640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4111f40 con 0x7f18a4102790 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a8876640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18a4111dc0 con 0x7f18a4101de0 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a8876640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41120c0 con 0x7f18a4106f10 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4102790 0x7f18a4198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4102790 0x7f18a4198960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52640/0 (socket says 172.21.15.70:52640) 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 -- 172.21.15.70:0/2126424776 learned_addr learned my addr 172.21.15.70:0/2126424776 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a4106f10 0x7f18a419ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a259c640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4101de0 0x7f18a4198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 -- 172.21.15.70:0/2126424776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a4106f10 msgr2=0x7f18a419ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a4106f10 0x7f18a419ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 -- 172.21.15.70:0/2126424776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4101de0 msgr2=0x7f18a4198420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4101de0 0x7f18a4198420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 -- 172.21.15.70:0/2126424776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18a419d3d0 con 0x7f18a4102790 2024-09-19T04:39:17.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18a1d9b640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4102790 0x7f18a4198960 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f189800d950 tx=0x7f189800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.568+0000 7f18937fe640 1 -- 172.21.15.70:0/2126424776 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898017070 con 0x7f18a4102790 2024-09-19T04:39:17.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.569+0000 7f18937fe640 1 -- 172.21.15.70:0/2126424776 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1898009c30 con 0x7f18a4102790 2024-09-19T04:39:17.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.569+0000 7f18a8876640 1 -- 172.21.15.70:0/2126424776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18a419d6c0 con 0x7f18a4102790 2024-09-19T04:39:17.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.569+0000 7f18937fe640 1 -- 172.21.15.70:0/2126424776 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189800f6b0 con 0x7f18a4102790 2024-09-19T04:39:17.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.569+0000 7f18a8876640 1 -- 172.21.15.70:0/2126424776 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18a41a4fa0 con 0x7f18a4102790 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.571+0000 7f18937fe640 1 -- 172.21.15.70:0/2126424776 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1898010a50 con 0x7f18a4102790 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18aac4f740 1 Processor -- start 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18aac4f740 1 -- start start 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249d3800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d6130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18aac4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f52492e280 con 0x55f5249d3d40 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18aac4f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f5248d5b10 con 0x55f5249c8b60 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18aac4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f52492a240 con 0x55f5249c9480 2024-09-19T04:39:17.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18a1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d6130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18a259c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249d3800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18a1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d6130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52656/0 (socket says 172.21.15.70:52656) 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18a1d9b640 1 -- 172.21.15.70:0/2157052375 learned_addr learned my addr 172.21.15.70:0/2157052375 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.572+0000 7f18937fe640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f188c0a3430 0x7f188c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a259c640 1 -- 172.21.15.70:0/2157052375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 msgr2=0x55f5249c8f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a259c640 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249c8f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a259c640 1 -- 172.21.15.70:0/2157052375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 msgr2=0x55f5249d6130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a259c640 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d6130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a259c640 1 -- 172.21.15.70:0/2157052375 --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5248e21f0 con 0x55f5249c9480 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a1d9b640 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:39:17.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f188c0a3430 0x7f188c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18937fe640 1 -- 172.21.15.70:0/2126424776 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f18980cf7a0 con 0x7f18a4102790 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a259c640 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249d3800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1894004630 tx=0x7f189400bb20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae996be2fa9118e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f188c0a3430 0x7f188c0a58f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f189c009430 tx=0x7f189c0095c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f1890ff9640 1 -- 172.21.15.70:0/2157052375 <== mon.1 v2:172.21.15.167:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894003bd0 con 0x55f5249c9480 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f1890ff9640 1 -- 172.21.15.70:0/2157052375 <== mon.1 v2:172.21.15.167:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1894015070 con 0x55f5249c9480 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.573+0000 7f1890ff9640 1 -- 172.21.15.70:0/2157052375 <== mon.1 v2:172.21.15.167:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894004d60 con 0x55f5249c9480 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 -- 172.21.15.70:0/2157052375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 msgr2=0x55f5249d3800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249d3800 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f1894004630 tx=0x7f189400bb20 comp rx=0 tx=0).stop 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 -- 172.21.15.70:0/2157052375 shutdown_connections 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d6130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249d3800 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 --2- 172.21.15.70:0/2157052375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249c8f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 -- 172.21.15.70:0/2157052375 >> 172.21.15.70:0/2157052375 conn(0x55f5249c50f0 msgr2=0x55f5249c54d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 -- 172.21.15.70:0/2157052375 shutdown_connections 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 -- 172.21.15.70:0/2157052375 wait complete. 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.574+0000 7f18aac4f740 1 -- start start 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18aac4f740 1 Processor -- start 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249d0bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c9480 0x55f5249d1100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 0x55f5249d1640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18aac4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55f5249d6910 con 0x55f5249c9480 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18aac4f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55f5248e8f10 con 0x55f5249c8b60 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18aac4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55f5249d6a90 con 0x55f5249d3d40 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18aac4f740 10 client.0 _ll_register_callbacks cb 0x55f5248b1a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c9480 0x55f5249d1100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c9480 0x55f5249d1100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52662/0 (socket says 172.21.15.70:52662) 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 -- 172.21.15.70:0/3072515593 learned_addr learned my addr 172.21.15.70:0/3072515593 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 0x55f5249d1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a259c640 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249d0bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 -- 172.21.15.70:0/3072515593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 msgr2=0x55f5249d1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 0x55f5249d1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 -- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 msgr2=0x55f5249d0bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249d0bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 -- 172.21.15.70:0/3072515593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f52469f6a0 con 0x55f5249c9480 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a259c640 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f18a1d9b640 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c9480 0x55f5249d1100 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f18980ccfa0 tx=0x7f189800bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df1c355c6d793795 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.575+0000 7f1889ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f1889ffb640 1 -- 172.21.15.70:0/3072515593 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1898020070 con 0x55f5249c9480 2024-09-19T04:39:17.584 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f1889ffb640 1 -- 172.21.15.70:0/3072515593 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f18980981a0 con 0x55f5249c9480 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 1 -- 172.21.15.70:0/3072515593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1894015070 con 0x55f5249c9480 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f1889ffb640 1 -- 172.21.15.70:0/3072515593 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f189809b490 con 0x55f5249c9480 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 10 client.17946 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 1 -- 172.21.15.70:0/3072515593 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f5249e24c0 con 0x55f5249c9480 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f1889ffb640 1 -- 172.21.15.70:0/3072515593 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1894015070 con 0x55f5249c9480 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f1889ffb640 1 -- 172.21.15.70:0/3072515593 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f18980860b0 con 0x55f5249c9480 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 10 client.17946 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 10 client.17946 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 20 client.17946 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f5249e3980 0x55f5249e5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 4 client.17946 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18aac4f740 1 -- 172.21.15.70:0/3072515593 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f52493b7f0 con 0x55f5249e3980 2024-09-19T04:39:17.585 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.576+0000 7f18a259c640 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f5249e3980 0x55f5249e5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.577+0000 7f1889ffb640 10 client.17946 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.577+0000 7f18a259c640 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f5249e3980 0x55f5249e5df0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9a9a46d6a2dae947 server_cookie=287f093a3672059a in_seq=0 out_seq=0 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f1889ffb640 1 -- 172.21.15.70:0/3072515593 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55f52493b7f0 con 0x55f5249e3980 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f1889ffb640 10 client.17946 handle_command_reply: tid=0 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 client.17946 shutdown 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 -- 172.21.15.70:0/3072515593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c9480 msgr2=0x55f5249d1100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c9480 0x55f5249d1100 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7f18980ccfa0 tx=0x7f189800bf60 comp rx=0 tx=0).stop 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 -- 172.21.15.70:0/3072515593 shutdown_connections 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f5249e3980 0x55f5249e5df0 crc :-1 s=READY pgs=206 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 0x55f5249d1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c9480 0x55f5249d1100 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 --2- 172.21.15.70:0/3072515593 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249d0bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.586 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 -- 172.21.15.70:0/3072515593 >> 172.21.15.70:0/3072515593 conn(0x55f5249c50f0 msgr2=0x55f5249cadd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:17.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f1889ffb640 0 client.17946 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:17.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 -- 172.21.15.70:0/3072515593 shutdown_connections 2024-09-19T04:39:17.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 1 -- 172.21.15.70:0/3072515593 wait complete. 2024-09-19T04:39:17.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.578+0000 7f18aac4f740 20 client.17946 trim_cache size 0 max 16384 2024-09-19T04:39:17.600 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18aac4f740 1 Processor -- start 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18aac4f740 1 -- start start 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c8b60 0x55f5249d2a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c9480 0x55f5249eb6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 0x55f5249ebc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18aac4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41b0160 con 0x55f5249c8b60 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18aac4f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41ada30 con 0x55f5249c9480 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18aac4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41ab8a0 con 0x55f5249d3d40 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c8b60 0x55f5249d2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a259c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c8b60 0x55f5249d2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52676/0 (socket says 172.21.15.70:52676) 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a259c640 1 -- 172.21.15.70:0/2559412837 learned_addr learned my addr 172.21.15.70:0/2559412837 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/2559412837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 0x55f5249ebc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a259c640 1 -- 172.21.15.70:0/2559412837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 msgr2=0x55f5249ebc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a259c640 1 --2- 172.21.15.70:0/2559412837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 0x55f5249ebc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a259c640 1 -- 172.21.15.70:0/2559412837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c9480 msgr2=0x55f5249eb6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a259c640 1 --2- 172.21.15.70:0/2559412837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c9480 0x55f5249eb6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.595+0000 7f18a259c640 1 -- 172.21.15.70:0/2559412837 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f5249cf150 con 0x55f5249c8b60 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18a259c640 1 --2- 172.21.15.70:0/2559412837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c8b60 0x55f5249d2a20 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f189400c010 tx=0x7f18940039c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af7e426fd6814594 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f188bfff640 1 -- 172.21.15.70:0/2559412837 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894003bd0 con 0x55f5249c8b60 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f188bfff640 1 -- 172.21.15.70:0/2559412837 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1894015070 con 0x55f5249c8b60 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f188bfff640 1 -- 172.21.15.70:0/2559412837 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1894011d70 con 0x55f5249c8b60 2024-09-19T04:39:17.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 -- 172.21.15.70:0/2559412837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c8b60 msgr2=0x55f5249d2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 --2- 172.21.15.70:0/2559412837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c8b60 0x55f5249d2a20 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7f189400c010 tx=0x7f18940039c0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 -- 172.21.15.70:0/2559412837 shutdown_connections 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 --2- 172.21.15.70:0/2559412837 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249d3d40 0x55f5249ebc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 --2- 172.21.15.70:0/2559412837 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c9480 0x55f5249eb6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 --2- 172.21.15.70:0/2559412837 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249c8b60 0x55f5249d2a20 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 -- 172.21.15.70:0/2559412837 >> 172.21.15.70:0/2559412837 conn(0x55f5249c50f0 msgr2=0x55f5249d2310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 -- 172.21.15.70:0/2559412837 shutdown_connections 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.596+0000 7f18aac4f740 1 -- 172.21.15.70:0/2559412837 wait complete. 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 1 -- start start 2024-09-19T04:39:17.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 1 Processor -- start 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249dc050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249dc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d8f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41abef0 con 0x55f5249d3d40 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41ad360 con 0x55f5249c8b60 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f18a41ac5c0 con 0x55f5249c9480 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18aac4f740 10 client.0 _ll_register_callbacks cb 0x7f189800df40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a2d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52690/0 (socket says 172.21.15.70:52690) 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a2d9d640 1 -- 172.21.15.70:0/90735060 learned_addr learned my addr 172.21.15.70:0/90735060 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a1d9b640 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249dc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a259c640 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249dc050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a2d9d640 1 -- 172.21.15.70:0/90735060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 msgr2=0x55f5249dc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249dc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a2d9d640 1 -- 172.21.15.70:0/90735060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 msgr2=0x55f5249dc050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249dc050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.597+0000 7f18a2d9d640 1 -- 172.21.15.70:0/90735060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f5249d9700 con 0x55f5249d3d40 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18a2d9d640 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d8f00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f189c02ade0 tx=0x7f189c02a8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cea44208c949160e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f1889ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f1889ffb640 1 -- 172.21.15.70:0/90735060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f189c05a060 con 0x55f5249d3d40 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f1889ffb640 1 -- 172.21.15.70:0/90735060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f189c004240 con 0x55f5249d3d40 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 1 -- 172.21.15.70:0/90735060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1894015070 con 0x55f5249d3d40 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f1889ffb640 1 -- 172.21.15.70:0/90735060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f189c004480 con 0x55f5249d3d40 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 10 client.17952 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:17.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 1 -- 172.21.15.70:0/90735060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55f524a4f2e0 con 0x55f5249d3d40 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f1889ffb640 1 -- 172.21.15.70:0/90735060 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1894015070 con 0x55f5249d3d40 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f1889ffb640 1 -- 172.21.15.70:0/90735060 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f189c0305c0 con 0x55f5249d3d40 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 10 client.17952 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 10 client.17952 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 20 client.17952 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f524a4fa60 0x55f524a51e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 4 client.17952 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.598+0000 7f18aac4f740 1 -- 172.21.15.70:0/90735060 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55f524935d00 con 0x55f524a4fa60 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.599+0000 7f18a259c640 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f524a4fa60 0x55f524a51e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.599+0000 7f1889ffb640 10 client.17952 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:17.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.599+0000 7f18a259c640 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f524a4fa60 0x55f524a51e80 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=551e823f377cd84 server_cookie=45a8da3b8a7cd5c0 in_seq=0 out_seq=0 2024-09-19T04:39:17.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f1889ffb640 1 -- 172.21.15.70:0/90735060 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55f524935d00 con 0x55f524a4fa60 2024-09-19T04:39:17.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f1889ffb640 10 client.17952 handle_command_reply: tid=0 2024-09-19T04:39:17.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 client.17952 shutdown 2024-09-19T04:39:17.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 -- 172.21.15.70:0/90735060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 msgr2=0x55f5249d8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d8f00 secure :-1 s=READY pgs=1231 cs=0 l=1 rev1=1 crypto rx=0x7f189c02ade0 tx=0x7f189c02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 -- 172.21.15.70:0/90735060 shutdown_connections 2024-09-19T04:39:17.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55f524a4fa60 0x55f524a51e80 crc :-1 s=READY pgs=207 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55f5249d3d40 0x55f5249d8f00 unknown :-1 s=CLOSED pgs=1231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55f5249c9480 0x55f5249dc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 --2- 172.21.15.70:0/90735060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55f5249c8b60 0x55f5249dc050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.608 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f1889ffb640 0 client.17952 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:17.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.600+0000 7f18aac4f740 1 -- 172.21.15.70:0/90735060 >> 172.21.15.70:0/90735060 conn(0x55f5249c50f0 msgr2=0x55f5249c4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:17.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18aac4f740 1 -- 172.21.15.70:0/90735060 shutdown_connections 2024-09-19T04:39:17.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18aac4f740 1 -- 172.21.15.70:0/90735060 wait complete. 2024-09-19T04:39:17.609 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18aac4f740 20 client.17952 trim_cache size 0 max 16384 2024-09-19T04:39:17.609 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:39:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:39:17.609 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "3ea2ce23-8b00-4cc6-8c27-c4e2dfb6b4de", 2024-09-19T04:39:17.610 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:39:17.610 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:39:17.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 -- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f188c0a3430 msgr2=0x7f188c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f188c0a3430 0x7f188c0a58f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f189c009430 tx=0x7f189c0095c0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 -- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4102790 msgr2=0x7f18a4198960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:17.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4102790 0x7f18a4198960 secure :-1 s=READY pgs=1228 cs=0 l=1 rev1=1 crypto rx=0x7f189800d950 tx=0x7f189800de10 comp rx=0 tx=0).stop 2024-09-19T04:39:17.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 -- 172.21.15.70:0/2126424776 shutdown_connections 2024-09-19T04:39:17.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f188c0a3430 0x7f188c0a58f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f18a4106f10 0x7f18a419ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f18a4102790 0x7f18a4198960 unknown :-1 s=CLOSED pgs=1228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 --2- 172.21.15.70:0/2126424776 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f18a4101de0 0x7f18a4198420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:17.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 -- 172.21.15.70:0/2126424776 >> 172.21.15.70:0/2126424776 conn(0x7f18a40fd8c0 msgr2=0x7f18a40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:17.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 -- 172.21.15.70:0/2126424776 shutdown_connections 2024-09-19T04:39:17.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:17.601+0000 7f18a8876640 1 -- 172.21.15.70:0/2126424776 wait complete. 2024-09-19T04:39:17.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:17 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:39:17.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:17 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:17.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:17 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:39:17.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:17 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:17 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:39:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:17 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:17 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:39:18.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:17 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:18.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:17 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:39:18.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:17 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:17 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:39:18.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:17 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:18.365 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:39:18.614 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:18.992 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:18 smithi070 ceph-mon[30942]: pgmap v265: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:19.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:18 smithi134 ceph-mon[34525]: pgmap v265: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:19.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 -- 172.21.15.70:0/3488837889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0102e00 msgr2=0x7f40e01031e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/3488837889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0102e00 0x7f40e01031e0 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f40d0009900 tx=0x7f40d002a480 comp rx=0 tx=0).stop 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 -- 172.21.15.70:0/3488837889 shutdown_connections 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/3488837889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40e010c1a0 0x7f40e010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/3488837889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e0103720 0x7f40e010bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/3488837889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0102e00 0x7f40e01031e0 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 -- 172.21.15.70:0/3488837889 >> 172.21.15.70:0/3488837889 conn(0x7f40e00fc7a0 msgr2=0x7f40e00febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 -- 172.21.15.70:0/3488837889 shutdown_connections 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.072+0000 7f40e4b9a640 1 -- 172.21.15.70:0/3488837889 wait complete. 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40e4b9a640 1 Processor -- start 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40e4b9a640 1 -- start start 2024-09-19T04:39:19.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40e4b9a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40e0102e00 0x7f40e0100a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40e4b9a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0103720 0x7f40e0100fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40e4b9a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e010c1a0 0x7f40e01014e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40e4b9a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0111f40 con 0x7f40e0103720 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40e4b9a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40e0111dc0 con 0x7f40e0102e00 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40e4b9a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01120c0 con 0x7f40e010c1a0 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0103720 0x7f40e0100fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0103720 0x7f40e0100fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52710/0 (socket says 172.21.15.70:52710) 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.073+0000 7f40d7fff640 1 -- 172.21.15.70:0/313975045 learned_addr learned my addr 172.21.15.70:0/313975045 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40de59c640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40e0102e00 0x7f40e0100a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d7fff640 1 -- 172.21.15.70:0/313975045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e010c1a0 msgr2=0x7f40e01014e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40ded9d640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e010c1a0 0x7f40e01014e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d7fff640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e010c1a0 0x7f40e01014e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d7fff640 1 -- 172.21.15.70:0/313975045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40e0102e00 msgr2=0x7f40e0100a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d7fff640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40e0102e00 0x7f40e0100a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d7fff640 1 -- 172.21.15.70:0/313975045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f40e01a68a0 con 0x7f40e0103720 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40de59c640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40e0102e00 0x7f40e0100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d7fff640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0103720 0x7f40e0100fa0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f40c800d770 tx=0x7f40c800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d77fe640 1 -- 172.21.15.70:0/313975045 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8017070 con 0x7f40e0103720 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40e4b9a640 1 -- 172.21.15.70:0/313975045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f40e01a6b90 con 0x7f40e0103720 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d77fe640 1 -- 172.21.15.70:0/313975045 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f40c80054f0 con 0x7f40e0103720 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40d77fe640 1 -- 172.21.15.70:0/313975045 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8004d60 con 0x7f40e0103720 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.074+0000 7f40e4b9a640 1 -- 172.21.15.70:0/313975045 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f40e01a70d0 con 0x7f40e0103720 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.077+0000 7f40d77fe640 1 -- 172.21.15.70:0/313975045 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f40c8004f00 con 0x7f40e0103720 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.077+0000 7f40e6f73740 1 Processor -- start 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.077+0000 7f40e6f73740 1 -- start start 2024-09-19T04:39:19.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b18880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b23140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b25a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40e6f73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e763a7e2e0 con 0x55e763b23680 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40e6f73740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e763a25ce0 con 0x55e763b18dc0 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40e6f73740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e763a7a2a0 con 0x55e763b184a0 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b25a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b25a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52724/0 (socket says 172.21.15.70:52724) 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 -- 172.21.15.70:0/3717021669 learned_addr learned my addr 172.21.15.70:0/3717021669 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d77fe640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40cc0a33b0 0x7f40cc0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40de59c640 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b23140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40ded9d640 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b18880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 -- 172.21.15.70:0/3717021669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 msgr2=0x55e763b18880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:19.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b18880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 -- 172.21.15.70:0/3717021669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 msgr2=0x55e763b23140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b23140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 -- 172.21.15.70:0/3717021669 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e763a0a440 con 0x55e763b23680 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40ded9d640 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b18880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40de59c640 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b23140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40ded9d640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40cc0a33b0 0x7f40cc0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d77fe640 1 -- 172.21.15.70:0/313975045 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f40c80cf880 con 0x7f40e0103720 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.078+0000 7f40d7fff640 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b25a70 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ccf40 tx=0x7f40c8022000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f038b386745e1f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40d4ff9640 1 -- 172.21.15.70:0/3717021669 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c8084e60 con 0x55e763b23680 2024-09-19T04:39:19.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40ded9d640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40cc0a33b0 0x7f40cc0a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f40d800ad90 tx=0x7f40d8004a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40d4ff9640 1 -- 172.21.15.70:0/3717021669 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f40c80056a0 con 0x55e763b23680 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40d4ff9640 1 -- 172.21.15.70:0/3717021669 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c809c260 con 0x55e763b23680 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40e6f73740 1 -- 172.21.15.70:0/3717021669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 msgr2=0x55e763b25a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b25a70 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f40c80ccf40 tx=0x7f40c8022000 comp rx=0 tx=0).stop 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40e6f73740 1 -- 172.21.15.70:0/3717021669 shutdown_connections 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b25a70 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b23140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3717021669 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b18880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.079+0000 7f40e6f73740 1 -- 172.21.15.70:0/3717021669 >> 172.21.15.70:0/3717021669 conn(0x55e763b14a30 msgr2=0x55e763b14e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 -- 172.21.15.70:0/3717021669 shutdown_connections 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 -- 172.21.15.70:0/3717021669 wait complete. 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 -- start start 2024-09-19T04:39:19.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 Processor -- start 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b22f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b18dc0 0x55e763b20240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b23680 0x55e763b20780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55e763b261f0 con 0x55e763b18dc0 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55e763a39050 con 0x55e763b23680 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55e763b26370 con 0x55e763b184a0 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40e6f73740 10 client.0 _ll_register_callbacks cb 0x55e763a79160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b18dc0 0x55e763b20240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40d7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b18dc0 0x55e763b20240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52734/0 (socket says 172.21.15.70:52734) 2024-09-19T04:39:19.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40d7fff640 1 -- 172.21.15.70:0/568932449 learned_addr learned my addr 172.21.15.70:0/568932449 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.080+0000 7f40de59c640 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b22f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40ded9d640 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b23680 0x55e763b20780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40d7fff640 1 -- 172.21.15.70:0/568932449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 msgr2=0x55e763b22f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40d7fff640 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b22f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40d7fff640 1 -- 172.21.15.70:0/568932449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b23680 msgr2=0x55e763b20780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40d7fff640 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b23680 0x55e763b20780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40d7fff640 1 -- 172.21.15.70:0/568932449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e7637ef3c0 con 0x55e763b18dc0 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40de59c640 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b22f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40d7fff640 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b18dc0 0x55e763b20240 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f40c8097fc0 tx=0x7f40c80ccf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8d3e16bb9a290d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40c5ffb640 1 -- 172.21.15.70:0/568932449 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40c80b3060 con 0x55e763b18dc0 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40c5ffb640 1 -- 172.21.15.70:0/568932449 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f40c80051f0 con 0x55e763b18dc0 2024-09-19T04:39:19.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40e6f73740 1 -- 172.21.15.70:0/568932449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40c80056a0 con 0x55e763b18dc0 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40c5ffb640 1 -- 172.21.15.70:0/568932449 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f40c8084e60 con 0x55e763b18dc0 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40e6f73740 10 client.17964 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40e6f73740 1 -- 172.21.15.70:0/568932449 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e763b31b10 con 0x55e763b18dc0 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40c5ffb640 1 -- 172.21.15.70:0/568932449 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f40c80056a0 con 0x55e763b18dc0 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40c5ffb640 1 -- 172.21.15.70:0/568932449 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f40c80cd250 con 0x55e763b18dc0 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40e6f73740 10 client.17964 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.081+0000 7f40e6f73740 10 client.17964 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.082+0000 7f40e6f73740 20 client.17964 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.082+0000 7f40e6f73740 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e763b32e60 0x55e763b35250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.082+0000 7f40e6f73740 4 client.17964 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.082+0000 7f40e6f73740 1 -- 172.21.15.70:0/568932449 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e763a8b850 con 0x55e763b32e60 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.082+0000 7f40de59c640 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e763b32e60 0x55e763b35250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.082+0000 7f40c5ffb640 10 client.17964 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.082+0000 7f40de59c640 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e763b32e60 0x55e763b35250 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19f738638351938c server_cookie=855b6944d34ccfa2 in_seq=0 out_seq=0 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40c5ffb640 1 -- 172.21.15.70:0/568932449 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55e763a8b850 con 0x55e763b32e60 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40c5ffb640 10 client.17964 handle_command_reply: tid=0 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 client.17964 shutdown 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 -- 172.21.15.70:0/568932449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b18dc0 msgr2=0x55e763b20240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b18dc0 0x55e763b20240 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f40c8097fc0 tx=0x7f40c80ccf40 comp rx=0 tx=0).stop 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 -- 172.21.15.70:0/568932449 shutdown_connections 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e763b32e60 0x55e763b35250 crc :-1 s=READY pgs=208 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b23680 0x55e763b20780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40c5ffb640 0 client.17964 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b18dc0 0x55e763b20240 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 --2- 172.21.15.70:0/568932449 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b22f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 -- 172.21.15.70:0/568932449 >> 172.21.15.70:0/568932449 conn(0x55e763b14a30 msgr2=0x55e763b1a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 -- 172.21.15.70:0/568932449 shutdown_connections 2024-09-19T04:39:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 1 -- 172.21.15.70:0/568932449 wait complete. 2024-09-19T04:39:19.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.083+0000 7f40e6f73740 20 client.17964 trim_cache size 0 max 16384 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.100+0000 7f40e6f73740 1 Processor -- start 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40e6f73740 1 -- start start 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b2f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b1eb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b221b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40e6f73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01b21b0 con 0x55e763b23680 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40e6f73740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01afa80 con 0x55e763b18dc0 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40e6f73740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01ad8f0 con 0x55e763b184a0 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b221b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b221b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52744/0 (socket says 172.21.15.70:52744) 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 -- 172.21.15.70:0/2506195760 learned_addr learned my addr 172.21.15.70:0/2506195760 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40de59c640 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b2f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40d7fff640 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b1eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 -- 172.21.15.70:0/2506195760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 msgr2=0x55e763b2f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b2f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 -- 172.21.15.70:0/2506195760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 msgr2=0x55e763b1eb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b1eb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 -- 172.21.15.70:0/2506195760 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e763b18bf0 con 0x55e763b23680 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.101+0000 7f40ded9d640 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b221b0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f40d80105c0 tx=0x7f40d8011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=258d96a64f0527cd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40c7fff640 1 -- 172.21.15.70:0/2506195760 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d8014070 con 0x55e763b23680 2024-09-19T04:39:19.119 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40c7fff640 1 -- 172.21.15.70:0/2506195760 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f40d8021030 con 0x55e763b23680 2024-09-19T04:39:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40c7fff640 1 -- 172.21.15.70:0/2506195760 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d801ce50 con 0x55e763b23680 2024-09-19T04:39:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 -- 172.21.15.70:0/2506195760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 msgr2=0x55e763b221b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b221b0 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f40d80105c0 tx=0x7f40d8011000 comp rx=0 tx=0).stop 2024-09-19T04:39:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 -- 172.21.15.70:0/2506195760 shutdown_connections 2024-09-19T04:39:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b23680 0x55e763b221b0 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b1eb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 --2- 172.21.15.70:0/2506195760 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b184a0 0x55e763b2f480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 -- 172.21.15.70:0/2506195760 >> 172.21.15.70:0/2506195760 conn(0x55e763b14a30 msgr2=0x55e763b21aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 -- 172.21.15.70:0/2506195760 shutdown_connections 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.102+0000 7f40e6f73740 1 -- 172.21.15.70:0/2506195760 wait complete. 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 1 -- start start 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 1 Processor -- start 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b184a0 0x55e763b1d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b1d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b23680 0x55e763b1ddf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01adf40 con 0x55e763b184a0 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01af3b0 con 0x55e763b18dc0 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f40e01ae610 con 0x55e763b23680 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40e6f73740 10 client.0 _ll_register_callbacks cb 0x7f40c8097cc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:19.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40de59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b184a0 0x55e763b1d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40de59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b184a0 0x55e763b1d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:52760/0 (socket says 172.21.15.70:52760) 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40de59c640 1 -- 172.21.15.70:0/3117738670 learned_addr learned my addr 172.21.15.70:0/3117738670 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40d7fff640 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b1d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40ded9d640 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b23680 0x55e763b1ddf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40de59c640 1 -- 172.21.15.70:0/3117738670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b23680 msgr2=0x55e763b1ddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40de59c640 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b23680 0x55e763b1ddf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40de59c640 1 -- 172.21.15.70:0/3117738670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 msgr2=0x55e763b1d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40de59c640 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b1d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40de59c640 1 -- 172.21.15.70:0/3117738670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e763b9c900 con 0x55e763b184a0 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.103+0000 7f40ded9d640 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b23680 0x55e763b1ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40de59c640 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b184a0 0x55e763b1d370 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f40d00092a0 tx=0x7f40d0009680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f9d8cf7c2af105d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40c5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:19.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40c5ffb640 1 -- 172.21.15.70:0/3117738670 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40d0035040 con 0x55e763b184a0 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40c5ffb640 1 -- 172.21.15.70:0/3117738670 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f40d0005240 con 0x55e763b184a0 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 1 -- 172.21.15.70:0/3117738670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40d8021030 con 0x55e763b184a0 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40c5ffb640 1 -- 172.21.15.70:0/3117738670 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f40d0005440 con 0x55e763b184a0 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 10 client.17970 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 1 -- 172.21.15.70:0/3117738670 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55e763b9dc50 con 0x55e763b184a0 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40c5ffb640 1 -- 172.21.15.70:0/3117738670 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f40d8021030 con 0x55e763b184a0 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40c5ffb640 1 -- 172.21.15.70:0/3117738670 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f40d0031840 con 0x55e763b184a0 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 10 client.17970 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 10 client.17970 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 20 client.17970 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e763b32e60 0x55e763ba03c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 4 client.17970 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.104+0000 7f40e6f73740 1 -- 172.21.15.70:0/3117738670 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55e763a85d60 con 0x55e763b32e60 2024-09-19T04:39:19.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40d7fff640 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e763b32e60 0x55e763ba03c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40c5ffb640 10 client.17970 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40d7fff640 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e763b32e60 0x55e763ba03c0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b6f220d6c8ce4bff server_cookie=5c7489c15c2f3bde in_seq=0 out_seq=0 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40c5ffb640 1 -- 172.21.15.70:0/3117738670 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55e763a85d60 con 0x55e763b32e60 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40c5ffb640 10 client.17970 handle_command_reply: tid=0 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 client.17970 shutdown 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 -- 172.21.15.70:0/3117738670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b184a0 msgr2=0x55e763b1d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b184a0 0x55e763b1d370 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f40d00092a0 tx=0x7f40d0009680 comp rx=0 tx=0).stop 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 -- 172.21.15.70:0/3117738670 shutdown_connections 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55e763b32e60 0x55e763ba03c0 crc :-1 s=READY pgs=209 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55e763b23680 0x55e763b1ddf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55e763b18dc0 0x55e763b1d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40c5ffb640 0 client.17970 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 --2- 172.21.15.70:0/3117738670 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55e763b184a0 0x55e763b1d370 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 -- 172.21.15.70:0/3117738670 >> 172.21.15.70:0/3117738670 conn(0x55e763b14a30 msgr2=0x55e763b21aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 -- 172.21.15.70:0/3117738670 shutdown_connections 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.105+0000 7f40e6f73740 1 -- 172.21.15.70:0/3117738670 wait complete. 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e6f73740 20 client.17970 trim_cache size 0 max 16384 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:39:19.125 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:39:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:39:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "3ea2ce23-8b00-4cc6-8c27-c4e2dfb6b4de": { 2024-09-19T04:39:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:39:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "3ea2ce23-8b00-4cc6-8c27-c4e2dfb6b4de", 2024-09-19T04:39:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:39:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:39:19.126 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:39:19.126 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 -- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40cc0a33b0 msgr2=0x7f40cc0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40cc0a33b0 0x7f40cc0a5870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f40d800ad90 tx=0x7f40d8004a40 comp rx=0 tx=0).stop 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 -- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0103720 msgr2=0x7f40e0100fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0103720 0x7f40e0100fa0 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f40c800d770 tx=0x7f40c800dc30 comp rx=0 tx=0).stop 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 -- 172.21.15.70:0/313975045 shutdown_connections 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f40cc0a33b0 0x7f40cc0a5870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f40e010c1a0 0x7f40e01014e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f40e0103720 0x7f40e0100fa0 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 --2- 172.21.15.70:0/313975045 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40e0102e00 0x7f40e0100a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:19.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 -- 172.21.15.70:0/313975045 >> 172.21.15.70:0/313975045 conn(0x7f40e00fc7a0 msgr2=0x7f40e00fd4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:19.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 -- 172.21.15.70:0/313975045 shutdown_connections 2024-09-19T04:39:19.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:19.106+0000 7f40e4b9a640 1 -- 172.21.15.70:0/313975045 wait complete. 2024-09-19T04:39:19.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:18 smithi167 ceph-mon[34339]: pgmap v265: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:19.891 INFO:tasks.cephfs.filesystem:scrub status for tag:3ea2ce23-8b00-4cc6-8c27-c4e2dfb6b4de - {'path': '/', 'tag': '3ea2ce23-8b00-4cc6-8c27-c4e2dfb6b4de', 'options': 'recursive,force'} 2024-09-19T04:39:21.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:20 smithi134 ceph-mon[34525]: pgmap v266: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:21.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:20 smithi070 ceph-mon[30942]: pgmap v266: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:21.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:20 smithi167 ceph-mon[34339]: pgmap v266: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:39:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:22 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:39:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:22 smithi134 ceph-mon[34525]: pgmap v267: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:39:23.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:22 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:39:23.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:22 smithi070 ceph-mon[30942]: pgmap v267: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:39:23.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:22 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:39:23.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:22 smithi167 ceph-mon[34339]: pgmap v267: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:39:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:24 smithi134 ceph-mon[34525]: pgmap v268: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:39:25.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:24 smithi070 ceph-mon[30942]: pgmap v268: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:39:25.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:24 smithi167 ceph-mon[34339]: pgmap v268: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:39:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:26 smithi134 ceph-mon[34525]: pgmap v269: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:39:27.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:26 smithi070 ceph-mon[30942]: pgmap v269: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:39:27.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:26 smithi167 ceph-mon[34339]: pgmap v269: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:39:29.012 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:28 smithi167 ceph-mon[34339]: pgmap v270: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:39:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:28 smithi134 ceph-mon[34525]: pgmap v270: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:39:29.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:28 smithi070 ceph-mon[30942]: pgmap v270: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:39:31.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:30 smithi134 ceph-mon[34525]: pgmap v271: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:39:31.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:30 smithi070 ceph-mon[30942]: pgmap v271: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:39:31.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:30 smithi167 ceph-mon[34339]: pgmap v271: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:39:33.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:32 smithi134 ceph-mon[34525]: pgmap v272: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T04:39:33.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:32 smithi070 ceph-mon[30942]: pgmap v272: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T04:39:33.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:32 smithi167 ceph-mon[34339]: pgmap v272: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 7 op/s 2024-09-19T04:39:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:34 smithi134 ceph-mon[34525]: pgmap v273: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:35.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:34 smithi070 ceph-mon[30942]: pgmap v273: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:35.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:34 smithi167 ceph-mon[34339]: pgmap v273: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:36 smithi134 ceph-mon[34525]: pgmap v274: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:37.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:36 smithi070 ceph-mon[30942]: pgmap v274: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:37.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:36 smithi167 ceph-mon[34339]: pgmap v274: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:38 smithi134 ceph-mon[34525]: pgmap v275: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:39.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:38 smithi070 ceph-mon[30942]: pgmap v275: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:39.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:38 smithi167 ceph-mon[34339]: pgmap v275: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:40 smithi134 ceph-mon[34525]: pgmap v276: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:41.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:40 smithi070 ceph-mon[30942]: pgmap v276: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:41.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:40 smithi167 ceph-mon[34339]: pgmap v276: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:39:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:42 smithi134 ceph-mon[34525]: pgmap v277: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:43.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:42 smithi070 ceph-mon[30942]: pgmap v277: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:43.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:42 smithi167 ceph-mon[34339]: pgmap v277: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:44 smithi134 ceph-mon[34525]: pgmap v278: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:45.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:44 smithi070 ceph-mon[30942]: pgmap v278: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:45.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:44 smithi167 ceph-mon[34339]: pgmap v278: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:46 smithi134 ceph-mon[34525]: pgmap v279: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:47.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:46 smithi070 ceph-mon[30942]: pgmap v279: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:47.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:46 smithi167 ceph-mon[34339]: pgmap v279: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:48 smithi134 ceph-mon[34525]: pgmap v280: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:49.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:48 smithi070 ceph-mon[30942]: pgmap v280: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:49.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:48 smithi167 ceph-mon[34339]: pgmap v280: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:49.892 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:39:50.154 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:50.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 -- 172.21.15.70:0/536250510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8106f10 msgr2=0x7f68e810ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 --2- 172.21.15.70:0/536250510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8106f10 0x7f68e810ea90 secure :-1 s=READY pgs=1238 cs=0 l=1 rev1=1 crypto rx=0x7f68e0009ca0 tx=0x7f68e002a8c0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 -- 172.21.15.70:0/536250510 shutdown_connections 2024-09-19T04:39:50.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 --2- 172.21.15.70:0/536250510 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8106f10 0x7f68e810ea90 unknown :-1 s=CLOSED pgs=1238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.639 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 --2- 172.21.15.70:0/536250510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68e8102790 0x7f68e81067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 --2- 172.21.15.70:0/536250510 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68e8101de0 0x7f68e81021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 -- 172.21.15.70:0/536250510 >> 172.21.15.70:0/536250510 conn(0x7f68e80fd8c0 msgr2=0x7f68e80ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 -- 172.21.15.70:0/536250510 shutdown_connections 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.617+0000 7f68ee894640 1 -- 172.21.15.70:0/536250510 wait complete. 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ee894640 1 Processor -- start 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ee894640 1 -- start start 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ee894640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8101de0 0x7f68e8198400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ee894640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68e8102790 0x7f68e8198940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ee894640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68e8106f10 0x7f68e819ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ee894640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68e8111f40 con 0x7f68e8101de0 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ee894640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f68e8111dc0 con 0x7f68e8102790 2024-09-19T04:39:50.640 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ee894640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68e81120c0 con 0x7f68e8106f10 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8101de0 0x7f68e8198400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8101de0 0x7f68e8198400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55792/0 (socket says 172.21.15.70:55792) 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68e7fff640 1 -- 172.21.15.70:0/1733720207 learned_addr learned my addr 172.21.15.70:0/1733720207 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68dffff640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68e8102790 0x7f68e8198940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68ece31640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68e8106f10 0x7f68e819ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68e7fff640 1 -- 172.21.15.70:0/1733720207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68e8106f10 msgr2=0x7f68e819ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68e7fff640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68e8106f10 0x7f68e819ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68e7fff640 1 -- 172.21.15.70:0/1733720207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68e8102790 msgr2=0x7f68e8198940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68e7fff640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68e8102790 0x7f68e8198940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68e7fff640 1 -- 172.21.15.70:0/1733720207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68e819d3b0 con 0x7f68e8101de0 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.618+0000 7f68dffff640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68e8102790 0x7f68e8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.619+0000 7f68e7fff640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8101de0 0x7f68e8198400 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f68d800c920 tx=0x7f68d800cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:50.641 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.619+0000 7f68e5ffb640 1 -- 172.21.15.70:0/1733720207 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8007c70 con 0x7f68e8101de0 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.619+0000 7f68ee894640 1 -- 172.21.15.70:0/1733720207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68e819d6a0 con 0x7f68e8101de0 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.619+0000 7f68e5ffb640 1 -- 172.21.15.70:0/1733720207 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f68d8007e10 con 0x7f68e8101de0 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.619+0000 7f68e5ffb640 1 -- 172.21.15.70:0/1733720207 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d8018850 con 0x7f68e8101de0 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.619+0000 7f68ee894640 1 -- 172.21.15.70:0/1733720207 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68e81a4f80 con 0x7f68e8101de0 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68e5ffb640 1 -- 172.21.15.70:0/1733720207 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f68d8018a30 con 0x7f68e8101de0 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68f0c6d740 1 Processor -- start 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68f0c6d740 1 -- start start 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474d4a0 0x5642a474d880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4758140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a475aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5642a46b32e0 con 0x5642a4758680 2024-09-19T04:39:50.642 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5642a465ace0 con 0x5642a474ddc0 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.621+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5642a46af2a0 con 0x5642a474d4a0 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a475aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a475aa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55800/0 (socket says 172.21.15.70:55800) 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 -- 172.21.15.70:0/384564083 learned_addr learned my addr 172.21.15.70:0/384564083 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68e7fff640 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4758140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68ece31640 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474d4a0 0x5642a474d880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 -- 172.21.15.70:0/384564083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474d4a0 msgr2=0x5642a474d880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474d4a0 0x5642a474d880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 -- 172.21.15.70:0/384564083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 msgr2=0x5642a4758140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4758140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 -- 172.21.15.70:0/384564083 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642a463f440 con 0x5642a4758680 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68e7fff640 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4758140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:50.643 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68ece31640 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474d4a0 0x5642a474d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68e5ffb640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68d40a33b0 0x7f68d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68dffff640 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a475aa70 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f68d000bcb0 tx=0x7f68d000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a3113272efd1c70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68ece31640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68d40a33b0 0x7f68d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68e5ffb640 1 -- 172.21.15.70:0/1733720207 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f68d80cff40 con 0x7f68e8101de0 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68de7fc640 1 -- 172.21.15.70:0/384564083 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0015070 con 0x5642a4758680 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68de7fc640 1 -- 172.21.15.70:0/384564083 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f68d0011910 con 0x5642a4758680 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.622+0000 7f68de7fc640 1 -- 172.21.15.70:0/384564083 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d0010920 con 0x5642a4758680 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 -- 172.21.15.70:0/384564083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 msgr2=0x5642a475aa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68ece31640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68d40a33b0 0x7f68d40a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005cc0 tx=0x7f68e0005f80 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a475aa70 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f68d000bcb0 tx=0x7f68d000f730 comp rx=0 tx=0).stop 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 -- 172.21.15.70:0/384564083 shutdown_connections 2024-09-19T04:39:50.644 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a475aa70 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4758140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/384564083 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474d4a0 0x5642a474d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 -- 172.21.15.70:0/384564083 >> 172.21.15.70:0/384564083 conn(0x5642a4749a30 msgr2=0x5642a4749e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 -- 172.21.15.70:0/384564083 shutdown_connections 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 -- 172.21.15.70:0/384564083 wait complete. 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.623+0000 7f68f0c6d740 1 -- start start 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68f0c6d740 1 Processor -- start 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4757f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.645 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4755210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a4755750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5642a475b250 con 0x5642a474d4a0 2024-09-19T04:39:50.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5642a466e050 con 0x5642a474ddc0 2024-09-19T04:39:50.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5642a475b3d0 con 0x5642a4758680 2024-09-19T04:39:50.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68f0c6d740 10 client.0 _ll_register_callbacks cb 0x5642a46ae160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:50.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4757f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.646 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4757f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55810/0 (socket says 172.21.15.70:55810) 2024-09-19T04:39:50.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 -- 172.21.15.70:0/180919439 learned_addr learned my addr 172.21.15.70:0/180919439 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:50.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68dffff640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4755210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68ece31640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a4755750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 -- 172.21.15.70:0/180919439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 msgr2=0x5642a4755750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:50.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a4755750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 -- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 msgr2=0x5642a4755210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:50.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4755210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.647 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 -- 172.21.15.70:0/180919439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642a44243c0 con 0x5642a474d4a0 2024-09-19T04:39:50.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68ece31640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a4755750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:50.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68dffff640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4755210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:50.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68e7fff640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4757f60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f68d8098680 tx=0x7f68d8098580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88e5cbe929c78451 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:50.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:50.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.624+0000 7f68c77fe640 1 -- 172.21.15.70:0/180919439 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d80bae60 con 0x5642a474d4a0 2024-09-19T04:39:50.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68c77fe640 1 -- 172.21.15.70:0/180919439 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f68d80d2070 con 0x5642a474d4a0 2024-09-19T04:39:50.648 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 1 -- 172.21.15.70:0/180919439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68d0011910 con 0x5642a474d4a0 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68c77fe640 1 -- 172.21.15.70:0/180919439 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f68d80d2270 con 0x5642a474d4a0 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 10 client.17982 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 1 -- 172.21.15.70:0/180919439 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5642a4766b90 con 0x5642a474d4a0 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68c77fe640 1 -- 172.21.15.70:0/180919439 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f68d0011910 con 0x5642a474d4a0 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68c77fe640 1 -- 172.21.15.70:0/180919439 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f68d80bc0b0 con 0x5642a474d4a0 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 10 client.17982 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 10 client.17982 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 20 client.17982 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5642a4768050 0x5642a476a460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 4 client.17982 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68f0c6d740 1 -- 172.21.15.70:0/180919439 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5642a46c0850 con 0x5642a4768050 2024-09-19T04:39:50.649 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.625+0000 7f68dffff640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5642a4768050 0x5642a476a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.626+0000 7f68c77fe640 10 client.17982 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:50.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.626+0000 7f68dffff640 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5642a4768050 0x5642a476a460 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=71da80ca39129711 server_cookie=bbf4b37b8c96e22f in_seq=0 out_seq=0 2024-09-19T04:39:50.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68c77fe640 1 -- 172.21.15.70:0/180919439 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5642a46c0850 con 0x5642a4768050 2024-09-19T04:39:50.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68c77fe640 10 client.17982 handle_command_reply: tid=0 2024-09-19T04:39:50.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 client.17982 shutdown 2024-09-19T04:39:50.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 -- 172.21.15.70:0/180919439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 msgr2=0x5642a4757f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4757f60 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7f68d8098680 tx=0x7f68d8098580 comp rx=0 tx=0).stop 2024-09-19T04:39:50.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 -- 172.21.15.70:0/180919439 shutdown_connections 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5642a4768050 0x5642a476a460 crc :-1 s=READY pgs=210 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a4755750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a4755210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68c77fe640 0 client.17982 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/180919439 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4757f60 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 -- 172.21.15.70:0/180919439 >> 172.21.15.70:0/180919439 conn(0x5642a4749a30 msgr2=0x5642a474f710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 -- 172.21.15.70:0/180919439 shutdown_connections 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 1 -- 172.21.15.70:0/180919439 wait complete. 2024-09-19T04:39:50.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.627+0000 7f68f0c6d740 20 client.17982 trim_cache size 0 max 16384 2024-09-19T04:39:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68f0c6d740 1 Processor -- start 2024-09-19T04:39:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68f0c6d740 1 -- start start 2024-09-19T04:39:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474d4a0 0x5642a47644b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474ddc0 0x5642a476fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a4770270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68e81affa0 con 0x5642a4758680 2024-09-19T04:39:50.657 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f68e81ad870 con 0x5642a474d4a0 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68e81ab6e0 con 0x5642a474ddc0 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68ece31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a4770270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68ece31640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a4770270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55822/0 (socket says 172.21.15.70:55822) 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68ece31640 1 -- 172.21.15.70:0/1043095128 learned_addr learned my addr 172.21.15.70:0/1043095128 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68dffff640 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474ddc0 0x5642a476fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68ece31640 1 -- 172.21.15.70:0/1043095128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474ddc0 msgr2=0x5642a476fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68ece31640 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474ddc0 0x5642a476fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68ece31640 1 -- 172.21.15.70:0/1043095128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474d4a0 msgr2=0x5642a47644b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:50.658 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.644+0000 7f68e7fff640 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474d4a0 0x5642a47644b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68ece31640 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474d4a0 0x5642a47644b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68ece31640 1 -- 172.21.15.70:0/1043095128 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5642a4749860 con 0x5642a4758680 2024-09-19T04:39:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68ece31640 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a4770270 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f68e0031f40 tx=0x7f68e003f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cce56e3aa1c8b94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68ddffb640 1 -- 172.21.15.70:0/1043095128 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0031950 con 0x5642a4758680 2024-09-19T04:39:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68ddffb640 1 -- 172.21.15.70:0/1043095128 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f68e0036070 con 0x5642a4758680 2024-09-19T04:39:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68ddffb640 1 -- 172.21.15.70:0/1043095128 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68e0004510 con 0x5642a4758680 2024-09-19T04:39:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68f0c6d740 1 -- 172.21.15.70:0/1043095128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 msgr2=0x5642a4770270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.659 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a4770270 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7f68e0031f40 tx=0x7f68e003f000 comp rx=0 tx=0).stop 2024-09-19T04:39:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.645+0000 7f68f0c6d740 1 -- 172.21.15.70:0/1043095128 shutdown_connections 2024-09-19T04:39:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a4758680 0x5642a4770270 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a474ddc0 0x5642a476fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/1043095128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474d4a0 0x5642a47644b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 -- 172.21.15.70:0/1043095128 >> 172.21.15.70:0/1043095128 conn(0x5642a4749a30 msgr2=0x5642a4753ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 -- 172.21.15.70:0/1043095128 shutdown_connections 2024-09-19T04:39:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 -- 172.21.15.70:0/1043095128 wait complete. 2024-09-19T04:39:50.660 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 -- start start 2024-09-19T04:39:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 Processor -- start 2024-09-19T04:39:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4760f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a475c270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a475ca00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f68e81abd30 con 0x5642a474d4a0 2024-09-19T04:39:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f68e81ad1a0 con 0x5642a474ddc0 2024-09-19T04:39:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f68e81ac400 con 0x5642a4758680 2024-09-19T04:39:50.661 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68f0c6d740 10 client.0 _ll_register_callbacks cb 0x7f68d800c870 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.646+0000 7f68e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4760f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68e7fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4760f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55834/0 (socket says 172.21.15.70:55834) 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68e7fff640 1 -- 172.21.15.70:0/3686061641 learned_addr learned my addr 172.21.15.70:0/3686061641 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68dffff640 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a475c270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68ece31640 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a475ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68e7fff640 1 -- 172.21.15.70:0/3686061641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 msgr2=0x5642a475ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68e7fff640 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a475ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68e7fff640 1 -- 172.21.15.70:0/3686061641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 msgr2=0x5642a475c270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:50.662 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68e7fff640 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a475c270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68e7fff640 1 -- 172.21.15.70:0/3686061641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5642a47d1d00 con 0x5642a474d4a0 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68ece31640 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a475ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68e7fff640 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4760f40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f68d8098630 tx=0x7f68d80d35a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6b34f1b7153af3a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68c77fe640 1 -- 172.21.15.70:0/3686061641 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68d80bae60 con 0x5642a474d4a0 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68c77fe640 1 -- 172.21.15.70:0/3686061641 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f68d80a0350 con 0x5642a474d4a0 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68f0c6d740 1 -- 172.21.15.70:0/3686061641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f68e0036070 con 0x5642a474d4a0 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68c77fe640 1 -- 172.21.15.70:0/3686061641 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f68d800fb90 con 0x5642a474d4a0 2024-09-19T04:39:50.663 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68f0c6d740 10 client.17988 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68f0c6d740 1 -- 172.21.15.70:0/3686061641 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5642a47d2ef0 con 0x5642a474d4a0 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.647+0000 7f68c77fe640 1 -- 172.21.15.70:0/3686061641 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f68e0036070 con 0x5642a474d4a0 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68c77fe640 1 -- 172.21.15.70:0/3686061641 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f68d80a4a70 con 0x5642a474d4a0 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68f0c6d740 10 client.17988 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68f0c6d740 10 client.17988 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68f0c6d740 20 client.17988 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5642a47d3430 0x5642a47d5820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68f0c6d740 4 client.17988 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68f0c6d740 1 -- 172.21.15.70:0/3686061641 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x5642a46bad60 con 0x5642a47d3430 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68dffff640 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5642a47d3430 0x5642a47d5820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68c77fe640 10 client.17988 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:50.664 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.648+0000 7f68dffff640 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5642a47d3430 0x5642a47d5820 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=87fe88b98f8cc929 server_cookie=fc1dcbb71fdf9e4a in_seq=0 out_seq=0 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68c77fe640 1 -- 172.21.15.70:0/3686061641 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x5642a46bad60 con 0x5642a47d3430 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68c77fe640 10 client.17988 handle_command_reply: tid=0 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 client.17988 shutdown 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 -- 172.21.15.70:0/3686061641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 msgr2=0x5642a4760f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4760f40 secure :-1 s=READY pgs=1243 cs=0 l=1 rev1=1 crypto rx=0x7f68d8098630 tx=0x7f68d80d35a0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 -- 172.21.15.70:0/3686061641 shutdown_connections 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5642a47d3430 0x5642a47d5820 crc :-1 s=READY pgs=211 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5642a4758680 0x5642a475ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5642a474ddc0 0x5642a475c270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 --2- 172.21.15.70:0/3686061641 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5642a474d4a0 0x5642a4760f40 unknown :-1 s=CLOSED pgs=1243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68c77fe640 0 client.17988 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:50.665 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 -- 172.21.15.70:0/3686061641 >> 172.21.15.70:0/3686061641 conn(0x5642a4749a30 msgr2=0x5642a474eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:50.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 -- 172.21.15.70:0/3686061641 shutdown_connections 2024-09-19T04:39:50.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 1 -- 172.21.15.70:0/3686061641 wait complete. 2024-09-19T04:39:50.666 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.649+0000 7f68f0c6d740 20 client.17988 trim_cache size 0 max 16384 2024-09-19T04:39:50.666 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:39:50.666 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:39:50.666 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:39:50.666 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:39:50.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 -- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68d40a33b0 msgr2=0x7f68d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68d40a33b0 0x7f68d40a5870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f68e0005cc0 tx=0x7f68e0005f80 comp rx=0 tx=0).stop 2024-09-19T04:39:50.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 -- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8101de0 msgr2=0x7f68e8198400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:50.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8101de0 0x7f68e8198400 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f68d800c920 tx=0x7f68d800cde0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 -- 172.21.15.70:0/1733720207 shutdown_connections 2024-09-19T04:39:50.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f68d40a33b0 0x7f68d40a5870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.667 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f68e8106f10 0x7f68e819ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f68e8102790 0x7f68e8198940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 --2- 172.21.15.70:0/1733720207 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f68e8101de0 0x7f68e8198400 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:50.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 -- 172.21.15.70:0/1733720207 >> 172.21.15.70:0/1733720207 conn(0x7f68e80fd8c0 msgr2=0x7f68e80febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:50.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 -- 172.21.15.70:0/1733720207 shutdown_connections 2024-09-19T04:39:50.668 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:50.650+0000 7f68ee894640 1 -- 172.21.15.70:0/1733720207 wait complete. 2024-09-19T04:39:50.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:50 smithi070 ceph-mon[30942]: pgmap v281: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:50 smithi134 ceph-mon[34525]: pgmap v281: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:51.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:50 smithi167 ceph-mon[34339]: pgmap v281: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:51.488 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:39:51.488 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:39:51.734 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:52.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 -- 172.21.15.70:0/2558604725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618102ef0 msgr2=0x7fc61810da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:52.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 --2- 172.21.15.70:0/2558604725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618102ef0 0x7fc61810da40 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7fc610009ca0 tx=0x7fc61002a950 comp rx=0 tx=0).stop 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 -- 172.21.15.70:0/2558604725 shutdown_connections 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 --2- 172.21.15.70:0/2558604725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618102ef0 0x7fc61810da40 unknown :-1 s=CLOSED pgs=1244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 --2- 172.21.15.70:0/2558604725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc618102570 0x7fc6181029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 --2- 172.21.15.70:0/2558604725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc618100e20 0x7fc618101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 -- 172.21.15.70:0/2558604725 >> 172.21.15.70:0/2558604725 conn(0x7fc6180fc7d0 msgr2=0x7fc6180febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 -- 172.21.15.70:0/2558604725 shutdown_connections 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.148+0000 7fc61f892640 1 -- 172.21.15.70:0/2558604725 wait complete. 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61f892640 1 Processor -- start 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61f892640 1 -- start start 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61f892640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618100e20 0x7fc618197490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61f892640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc618102570 0x7fc6181979d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:52.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61f892640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc618102ef0 0x7fc61819bd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61f892640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc618110f50 con 0x7fc618100e20 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61f892640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc618110dd0 con 0x7fc618102570 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61f892640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc6181110d0 con 0x7fc618102ef0 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61d62e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618100e20 0x7fc618197490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61d62e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618100e20 0x7fc618197490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:55848/0 (socket says 172.21.15.70:55848) 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61d62e640 1 -- 172.21.15.70:0/230926079 learned_addr learned my addr 172.21.15.70:0/230926079 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61ce2d640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc618102570 0x7fc6181979d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61de2f640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc618102ef0 0x7fc61819bd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61d62e640 1 -- 172.21.15.70:0/230926079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc618102ef0 msgr2=0x7fc61819bd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61d62e640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc618102ef0 0x7fc61819bd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61d62e640 1 -- 172.21.15.70:0/230926079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc618102570 msgr2=0x7fc6181979d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61d62e640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc618102570 0x7fc6181979d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.153 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61d62e640 1 -- 172.21.15.70:0/230926079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc61819c440 con 0x7fc618100e20 2024-09-19T04:39:52.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.149+0000 7fc61ce2d640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc618102570 0x7fc6181979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:52.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.150+0000 7fc61d62e640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618100e20 0x7fc618197490 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc61400d950 tx=0x7fc61400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:52.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.150+0000 7fc60e7fc640 1 -- 172.21.15.70:0/230926079 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc614017070 con 0x7fc618100e20 2024-09-19T04:39:52.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.150+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc61819c730 con 0x7fc618100e20 2024-09-19T04:39:52.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.150+0000 7fc60e7fc640 1 -- 172.21.15.70:0/230926079 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc614009c30 con 0x7fc618100e20 2024-09-19T04:39:52.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.150+0000 7fc60e7fc640 1 -- 172.21.15.70:0/230926079 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc61400f6b0 con 0x7fc618100e20 2024-09-19T04:39:52.154 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.150+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc618069f70 con 0x7fc618100e20 2024-09-19T04:39:52.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.151+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc618101200 con 0x7fc618100e20 2024-09-19T04:39:52.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.152+0000 7fc60e7fc640 1 -- 172.21.15.70:0/230926079 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc614010a50 con 0x7fc618100e20 2024-09-19T04:39:52.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.153+0000 7fc60e7fc640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc6040a33b0 0x7fc6040a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:52.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.153+0000 7fc61ce2d640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc6040a33b0 0x7fc6040a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:52.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.153+0000 7fc60e7fc640 1 -- 172.21.15.70:0/230926079 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fc6140cf960 con 0x7fc618100e20 2024-09-19T04:39:52.155 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.153+0000 7fc61ce2d640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc6040a33b0 0x7fc6040a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc608005fd0 tx=0x7fc608005850 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:52.157 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.156+0000 7fc60e7fc640 1 -- 172.21.15.70:0/230926079 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fc614009de0 con 0x7fc618100e20 2024-09-19T04:39:52.355 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.354+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fc6181987f0 con 0x7fc618100e20 2024-09-19T04:39:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.354+0000 7fc60e7fc640 1 -- 172.21.15.70:0/230926079 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7fc61409c340 con 0x7fc618100e20 2024-09-19T04:39:52.356 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:39:52.356 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:39:52.356 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:39:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc6040a33b0 msgr2=0x7fc6040a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc6040a33b0 0x7fc6040a5870 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fc608005fd0 tx=0x7fc608005850 comp rx=0 tx=0).stop 2024-09-19T04:39:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618100e20 msgr2=0x7fc618197490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618100e20 0x7fc618197490 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7fc61400d950 tx=0x7fc61400de10 comp rx=0 tx=0).stop 2024-09-19T04:39:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 shutdown_connections 2024-09-19T04:39:52.358 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc6040a33b0 0x7fc6040a5870 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc618102ef0 0x7fc61819bd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc618102570 0x7fc6181979d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 --2- 172.21.15.70:0/230926079 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc618100e20 0x7fc618197490 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 >> 172.21.15.70:0/230926079 conn(0x7fc6180fc7d0 msgr2=0x7fc6180febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 shutdown_connections 2024-09-19T04:39:52.359 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:52.356+0000 7fc61f892640 1 -- 172.21.15.70:0/230926079 wait complete. 2024-09-19T04:39:52.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:52 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/230926079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:52.725 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:52 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/230926079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:52.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:52 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/230926079' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:39:52.995 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:39:53.240 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:53.637 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:53 smithi070 ceph-mon[30942]: pgmap v282: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:53.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:53 smithi167 ceph-mon[34339]: pgmap v282: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 -- 172.21.15.70:0/696076909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798100a80 msgr2=0x7fe798100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 --2- 172.21.15.70:0/696076909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798100a80 0x7fe798100ee0 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7fe780009930 tx=0x7fe78002a420 comp rx=0 tx=0).stop 2024-09-19T04:39:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 -- 172.21.15.70:0/696076909 shutdown_connections 2024-09-19T04:39:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 --2- 172.21.15.70:0/696076909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798101420 0x7fe79810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 --2- 172.21.15.70:0/696076909 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798100a80 0x7fe798100ee0 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 --2- 172.21.15.70:0/696076909 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe798106a80 0x7fe798106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 -- 172.21.15.70:0/696076909 >> 172.21.15.70:0/696076909 conn(0x7fe7980fc7a0 msgr2=0x7fe7980febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:53.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 -- 172.21.15.70:0/696076909 shutdown_connections 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.717+0000 7fe79dec5640 1 -- 172.21.15.70:0/696076909 wait complete. 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe79dec5640 1 Processor -- start 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe79dec5640 1 -- start start 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe79dec5640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe798100a80 0x7fe798197380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe79dec5640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798101420 0x7fe7981978c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe79dec5640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798106a80 0x7fe79819bc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe79dec5640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe798110e50 con 0x7fe798101420 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe79dec5640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe798110cd0 con 0x7fe798106a80 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe79dec5640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe798110fd0 con 0x7fe798100a80 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798101420 0x7fe7981978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798101420 0x7fe7981978c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47872/0 (socket says 172.21.15.70:47872) 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 -- 172.21.15.70:0/3310162658 learned_addr learned my addr 172.21.15.70:0/3310162658 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:53.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe7977fe640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe798100a80 0x7fe798197380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe797fff640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798106a80 0x7fe79819bc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 -- 172.21.15.70:0/3310162658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe798100a80 msgr2=0x7fe798197380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe798100a80 0x7fe798197380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 -- 172.21.15.70:0/3310162658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798106a80 msgr2=0x7fe79819bc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798106a80 0x7fe79819bc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 -- 172.21.15.70:0/3310162658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe79819c330 con 0x7fe798101420 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe7977fe640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe798100a80 0x7fe798197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.718+0000 7fe78ffff640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798101420 0x7fe7981978c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe780005940 tx=0x7fe7800042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.719+0000 7fe7957fa640 1 -- 172.21.15.70:0/3310162658 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe78003f030 con 0x7fe798101420 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.719+0000 7fe79dec5640 1 -- 172.21.15.70:0/3310162658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe79819c5c0 con 0x7fe798101420 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.719+0000 7fe7957fa640 1 -- 172.21.15.70:0/3310162658 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe780003ac0 con 0x7fe798101420 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.719+0000 7fe7957fa640 1 -- 172.21.15.70:0/3310162658 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780035070 con 0x7fe798101420 2024-09-19T04:39:53.724 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.719+0000 7fe79dec5640 1 -- 172.21.15.70:0/3310162658 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7981a3f00 con 0x7fe798101420 2024-09-19T04:39:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.721+0000 7fe7957fa640 1 -- 172.21.15.70:0/3310162658 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe780042030 con 0x7fe798101420 2024-09-19T04:39:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.721+0000 7fe7a029e740 1 Processor -- start 2024-09-19T04:39:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7a029e740 1 -- start start 2024-09-19T04:39:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147109d50 0x5631471082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x563147108c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147113580 0x563147115970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7a029e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56314706c2f0 con 0x563147113580 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7a029e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563147013cf0 con 0x5631471087e0 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7a029e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5631470682b0 con 0x563147109d50 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147113580 0x563147115970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147113580 0x563147115970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47880/0 (socket says 172.21.15.70:47880) 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe78ffff640 1 -- 172.21.15.70:0/3509321999 learned_addr learned my addr 172.21.15.70:0/3509321999 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7957fa640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe7840a33b0 0x7fe7840a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe7977fe640 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x563147108c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe797fff640 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147109d50 0x5631471082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe797fff640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe7840a33b0 0x7fe7840a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe78ffff640 1 -- 172.21.15.70:0/3509321999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147109d50 msgr2=0x5631471082a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:53.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe78ffff640 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147109d50 0x5631471082a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe78ffff640 1 -- 172.21.15.70:0/3509321999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 msgr2=0x563147108c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe78ffff640 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x563147108c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe78ffff640 1 -- 172.21.15.70:0/3509321999 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563146ff83a0 con 0x563147113580 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.722+0000 7fe797fff640 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147109d50 0x5631471082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.723+0000 7fe7957fa640 1 -- 172.21.15.70:0/3310162658 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe7800f0350 con 0x7fe798101420 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.723+0000 7fe78ffff640 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147113580 0x563147115970 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe7800bc2d0 tx=0x7fe78007c3b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d05a725702aaf85b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.723+0000 7fe78dffb640 1 -- 172.21.15.70:0/3509321999 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780049070 con 0x563147113580 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.723+0000 7fe78dffb640 1 -- 172.21.15.70:0/3509321999 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe7800047a0 con 0x563147113580 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.723+0000 7fe797fff640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe7840a33b0 0x7fe7840a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe79000bfd0 tx=0x7fe790007220 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.723+0000 7fe78dffb640 1 -- 172.21.15.70:0/3509321999 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7800bc5d0 con 0x563147113580 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 -- 172.21.15.70:0/3509321999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147113580 msgr2=0x563147115970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147113580 0x563147115970 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7fe7800bc2d0 tx=0x7fe78007c3b0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 -- 172.21.15.70:0/3509321999 shutdown_connections 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147113580 0x563147115970 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x563147108c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 --2- 172.21.15.70:0/3509321999 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147109d50 0x5631471082a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 -- 172.21.15.70:0/3509321999 >> 172.21.15.70:0/3509321999 conn(0x5631470cf310 msgr2=0x563147104e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 -- 172.21.15.70:0/3509321999 shutdown_connections 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 -- 172.21.15.70:0/3509321999 wait complete. 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 -- start start 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.724+0000 7fe7a029e740 1 Processor -- start 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x563147113010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x56314710e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314710ea30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7a029e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56314706c2f0 con 0x563147109d50 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7a029e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x563147027060 con 0x563147113580 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7a029e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x563147102630 con 0x5631471087e0 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7a029e740 10 client.0 _ll_register_callbacks cb 0x563146d7a8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x56314710e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x56314710e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47884/0 (socket says 172.21.15.70:47884) 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 -- 172.21.15.70:0/872808746 learned_addr learned my addr 172.21.15.70:0/872808746 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7977fe640 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x563147113010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe797fff640 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314710ea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 -- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 msgr2=0x563147113010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x563147113010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 -- 172.21.15.70:0/872808746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 msgr2=0x56314710ea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314710ea30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 -- 172.21.15.70:0/872808746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563146ddd3c0 con 0x563147109d50 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7977fe640 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x563147113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe78ffff640 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x56314710e2a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fe7800bc560 tx=0x7fe78002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9804a2e250db65a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe776ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe776ffd640 1 -- 172.21.15.70:0/872808746 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe780049070 con 0x563147109d50 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe776ffd640 1 -- 172.21.15.70:0/872808746 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe7800edcc0 con 0x563147109d50 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.725+0000 7fe7a029e740 1 -- 172.21.15.70:0/872808746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7800047a0 con 0x563147109d50 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe776ffd640 1 -- 172.21.15.70:0/872808746 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe7800edec0 con 0x563147109d50 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7a029e740 10 client.18006 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7a029e740 1 -- 172.21.15.70:0/872808746 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x563147123b30 con 0x563147109d50 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe776ffd640 1 -- 172.21.15.70:0/872808746 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe7800047a0 con 0x563147109d50 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe776ffd640 1 -- 172.21.15.70:0/872808746 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe7800b5bc0 con 0x563147109d50 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7a029e740 10 client.18006 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:53.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7a029e740 10 client.18006 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7a029e740 20 client.18006 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7a029e740 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x563147124e80 0x563147127270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7a029e740 4 client.18006 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7a029e740 1 -- 172.21.15.70:0/872808746 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563147079860 con 0x563147124e80 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.726+0000 7fe7977fe640 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x563147124e80 0x563147127270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.727+0000 7fe7977fe640 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x563147124e80 0x563147127270 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=fe459ab09e4b211f server_cookie=25f946e40955d428 in_seq=0 out_seq=0 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.727+0000 7fe776ffd640 10 client.18006 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe776ffd640 1 -- 172.21.15.70:0/872808746 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x563147079860 con 0x563147124e80 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe776ffd640 10 client.18006 handle_command_reply: tid=0 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 client.18006 shutdown 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 -- 172.21.15.70:0/872808746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 msgr2=0x56314710e2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x56314710e2a0 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7fe7800bc560 tx=0x7fe78002a420 comp rx=0 tx=0).stop 2024-09-19T04:39:53.738 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 -- 172.21.15.70:0/872808746 shutdown_connections 2024-09-19T04:39:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x563147124e80 0x563147127270 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314710ea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x56314710e2a0 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.739 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 --2- 172.21.15.70:0/872808746 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x563147113010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 -- 172.21.15.70:0/872808746 >> 172.21.15.70:0/872808746 conn(0x5631470cf310 msgr2=0x56314710ab70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe776ffd640 0 client.18006 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 -- 172.21.15.70:0/872808746 shutdown_connections 2024-09-19T04:39:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 1 -- 172.21.15.70:0/872808746 wait complete. 2024-09-19T04:39:53.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.728+0000 7fe7a029e740 20 client.18006 trim_cache size 0 max 16384 2024-09-19T04:39:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7a029e740 1 Processor -- start 2024-09-19T04:39:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7a029e740 1 -- start start 2024-09-19T04:39:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x5631471156b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147114070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314712caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7a029e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe7981aded0 con 0x563147109d50 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7a029e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe7981ab7a0 con 0x563147113580 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7a029e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe7981a9610 con 0x5631471087e0 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147114070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147114070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47890/0 (socket says 172.21.15.70:47890) 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 -- 172.21.15.70:0/2533858267 learned_addr learned my addr 172.21.15.70:0/2533858267 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe7977fe640 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x5631471156b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 -- 172.21.15.70:0/2533858267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 msgr2=0x5631471156b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x5631471156b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 -- 172.21.15.70:0/2533858267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 msgr2=0x56314712caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe797fff640 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314712caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314712caf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 -- 172.21.15.70:0/2533858267 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56314710c7f0 con 0x563147109d50 2024-09-19T04:39:53.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe797fff640 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314712caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.741+0000 7fe78ffff640 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147114070 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fe7800bc0a0 tx=0x7fe7800b8270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85b1af0191ecaf9d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe78d7fa640 1 -- 172.21.15.70:0/2533858267 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7800047a0 con 0x563147109d50 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe78d7fa640 1 -- 172.21.15.70:0/2533858267 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe7800c0980 con 0x563147109d50 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe78d7fa640 1 -- 172.21.15.70:0/2533858267 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7800b5bc0 con 0x563147109d50 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 -- 172.21.15.70:0/2533858267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 msgr2=0x563147114070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147114070 secure :-1 s=READY pgs=1250 cs=0 l=1 rev1=1 crypto rx=0x7fe7800bc0a0 tx=0x7fe7800b8270 comp rx=0 tx=0).stop 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 -- 172.21.15.70:0/2533858267 shutdown_connections 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x563147113580 0x56314712caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147114070 unknown :-1 s=CLOSED pgs=1250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 --2- 172.21.15.70:0/2533858267 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5631471087e0 0x5631471156b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 -- 172.21.15.70:0/2533858267 >> 172.21.15.70:0/2533858267 conn(0x5631470cf310 msgr2=0x563147113960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 -- 172.21.15.70:0/2533858267 shutdown_connections 2024-09-19T04:39:53.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.742+0000 7fe7a029e740 1 -- 172.21.15.70:0/2533858267 wait complete. 2024-09-19T04:39:53.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 1 -- start start 2024-09-19T04:39:53.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 1 Processor -- start 2024-09-19T04:39:53.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x5631471209c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147120f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147113580 0x56314711df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe7981a9c60 con 0x563147109d50 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe7981ab0d0 con 0x5631471087e0 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe7981aa330 con 0x563147113580 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7a029e740 10 client.0 _ll_register_callbacks cb 0x7fe78800b420 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147120f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe78ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147120f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47904/0 (socket says 172.21.15.70:47904) 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe78ffff640 1 -- 172.21.15.70:0/1405762169 learned_addr learned my addr 172.21.15.70:0/1405762169 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe797fff640 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147113580 0x56314711df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7977fe640 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x5631471209c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe78ffff640 1 -- 172.21.15.70:0/1405762169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147113580 msgr2=0x56314711df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe78ffff640 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147113580 0x56314711df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.751 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe78ffff640 1 -- 172.21.15.70:0/1405762169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 msgr2=0x5631471209c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe78ffff640 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x5631471209c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe78ffff640 1 -- 172.21.15.70:0/1405762169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56314711e790 con 0x563147109d50 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.743+0000 7fe7977fe640 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x5631471209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe78ffff640 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147120f00 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fe780004650 tx=0x7fe7800c4fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=53f0508c3cb14fd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe776ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe776ffd640 1 -- 172.21.15.70:0/1405762169 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7800eded0 con 0x563147109d50 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe776ffd640 1 -- 172.21.15.70:0/1405762169 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe780031b30 con 0x563147109d50 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 1 -- 172.21.15.70:0/1405762169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe7800c0980 con 0x563147109d50 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe776ffd640 1 -- 172.21.15.70:0/1405762169 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe7800047a0 con 0x563147109d50 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 10 client.18012 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 1 -- 172.21.15.70:0/1405762169 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56314711e790 con 0x563147109d50 2024-09-19T04:39:53.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe776ffd640 1 -- 172.21.15.70:0/1405762169 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe7800c0980 con 0x563147109d50 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe776ffd640 1 -- 172.21.15.70:0/1405762169 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe7800d0af0 con 0x563147109d50 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 10 client.18012 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 10 client.18012 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 20 client.18012 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56314718f9a0 0x563147191d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 4 client.18012 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.744+0000 7fe7a029e740 1 -- 172.21.15.70:0/1405762169 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x563147073d70 con 0x56314718f9a0 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7977fe640 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56314718f9a0 0x563147191d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe776ffd640 10 client.18012 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7977fe640 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56314718f9a0 0x563147191d90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1589559c0081ead6 server_cookie=565366f121ca73cf in_seq=0 out_seq=0 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe776ffd640 1 -- 172.21.15.70:0/1405762169 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x563147073d70 con 0x56314718f9a0 2024-09-19T04:39:53.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe776ffd640 10 client.18012 handle_command_reply: tid=0 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 client.18012 shutdown 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 -- 172.21.15.70:0/1405762169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 msgr2=0x563147120f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147120f00 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7fe780004650 tx=0x7fe7800c4fe0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 -- 172.21.15.70:0/1405762169 shutdown_connections 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x56314718f9a0 0x563147191d90 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x563147113580 0x56314711df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x563147109d50 0x563147120f00 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 --2- 172.21.15.70:0/1405762169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5631471087e0 0x5631471209c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe776ffd640 0 client.18012 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 -- 172.21.15.70:0/1405762169 >> 172.21.15.70:0/1405762169 conn(0x5631470cf310 msgr2=0x5631471155a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 -- 172.21.15.70:0/1405762169 shutdown_connections 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.745+0000 7fe7a029e740 1 -- 172.21.15.70:0/1405762169 wait complete. 2024-09-19T04:39:53.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe7a029e740 20 client.18012 trim_cache size 0 max 16384 2024-09-19T04:39:53.755 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 -- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe7840a33b0 msgr2=0x7fe7840a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe7840a33b0 0x7fe7840a5870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7fe79000bfd0 tx=0x7fe790007220 comp rx=0 tx=0).stop 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 -- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798101420 msgr2=0x7fe7981978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798101420 0x7fe7981978c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7fe780005940 tx=0x7fe7800042f0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 -- 172.21.15.70:0/3310162658 shutdown_connections 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe7840a33b0 0x7fe7840a5870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe798106a80 0x7fe79819bc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe798101420 0x7fe7981978c0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 --2- 172.21.15.70:0/3310162658 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe798100a80 0x7fe798197380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 -- 172.21.15.70:0/3310162658 >> 172.21.15.70:0/3310162658 conn(0x7fe7980fc7a0 msgr2=0x7fe7980fd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 -- 172.21.15.70:0/3310162658 shutdown_connections 2024-09-19T04:39:53.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:53.746+0000 7fe79dec5640 1 -- 172.21.15.70:0/3310162658 wait complete. 2024-09-19T04:39:53.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:53 smithi134 ceph-mon[34525]: pgmap v282: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:54.380 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:39:54.669 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:54 smithi134 ceph-mon[34525]: pgmap v283: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:55.035 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:54 smithi070 ceph-mon[30942]: pgmap v283: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2312726547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28101220 msgr2=0x7f1e28101660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2312726547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28101220 0x7f1e28101660 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1e1c009900 tx=0x7f1e1c02a410 comp rx=0 tx=0).stop 2024-09-19T04:39:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2312726547 shutdown_connections 2024-09-19T04:39:55.120 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2312726547 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e28101ba0 0x7f1e2810d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2312726547 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28101220 0x7f1e28101660 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2312726547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e28105a70 0x7f1e28105e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2312726547 >> 172.21.15.70:0/2312726547 conn(0x7f1e280fbee0 msgr2=0x7f1e280fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2312726547 shutdown_connections 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.113+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2312726547 wait complete. 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e2cc3a640 1 Processor -- start 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e2cc3a640 1 -- start start 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e2cc3a640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e28101220 0x7f1e281984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e2cc3a640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e28101ba0 0x7f1e28198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e2cc3a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28105a70 0x7f1e2819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e2cc3a640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28110f20 con 0x7f1e28105a70 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e2cc3a640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e28110da0 con 0x7f1e28101220 2024-09-19T04:39:55.121 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e2cc3a640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281110a0 con 0x7f1e28101ba0 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e26d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28105a70 0x7f1e2819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e26d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28105a70 0x7f1e2819cdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47926/0 (socket says 172.21.15.70:47926) 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.114+0000 7f1e26d9d640 1 -- 172.21.15.70:0/2882400975 learned_addr learned my addr 172.21.15.70:0/2882400975 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e28101ba0 0x7f1e28198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e2659c640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e28101220 0x7f1e281984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e26d9d640 1 -- 172.21.15.70:0/2882400975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e28101ba0 msgr2=0x7f1e28198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e26d9d640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e28101ba0 0x7f1e28198a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e26d9d640 1 -- 172.21.15.70:0/2882400975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e28101220 msgr2=0x7f1e281984e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e26d9d640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e28101220 0x7f1e281984e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e26d9d640 1 -- 172.21.15.70:0/2882400975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1e2819d490 con 0x7f1e28105a70 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e26d9d640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28105a70 0x7f1e2819cdb0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000eaa0 tx=0x7f1e2000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e177fe640 1 -- 172.21.15.70:0/2882400975 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e2000cdb0 con 0x7f1e28105a70 2024-09-19T04:39:55.122 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e177fe640 1 -- 172.21.15.70:0/2882400975 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1e20005020 con 0x7f1e28105a70 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2882400975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1e2819d780 con 0x7f1e28105a70 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e177fe640 1 -- 172.21.15.70:0/2882400975 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e200116b0 con 0x7f1e28105a70 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.115+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2882400975 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1e281a5060 con 0x7f1e28105a70 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.117+0000 7f1e177fe640 1 -- 172.21.15.70:0/2882400975 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1e200051d0 con 0x7f1e28105a70 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2f013740 1 Processor -- start 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2f013740 1 -- start start 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6eb40 0x564026f6d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6d5d0 0x564026f6da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f7a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2f013740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564026ed32f0 con 0x564026f6d5d0 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2f013740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564026e7acf0 con 0x564026f78370 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2f013740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564026ecf2b0 con 0x564026f6eb40 2024-09-19T04:39:55.123 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6d5d0 0x564026f6da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6d5d0 0x564026f6da10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47938/0 (socket says 172.21.15.70:47938) 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e2659c640 1 -- 172.21.15.70:0/4118218089 learned_addr learned my addr 172.21.15.70:0/4118218089 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e177fe640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e100a33b0 0x7f1e100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.118+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6eb40 0x564026f6d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f7a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e26d9d640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e100a33b0 0x7f1e100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e2659c640 1 -- 172.21.15.70:0/4118218089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6eb40 msgr2=0x564026f6d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e2659c640 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6eb40 0x564026f6d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e2659c640 1 -- 172.21.15.70:0/4118218089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 msgr2=0x564026f7a760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e2659c640 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f7a760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e2659c640 1 -- 172.21.15.70:0/4118218089 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564026e5f3a0 con 0x564026f6d5d0 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f7a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:55.124 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e177fe640 1 -- 172.21.15.70:0/2882400975 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f1e200d0060 con 0x7f1e28105a70 2024-09-19T04:39:55.125 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e2659c640 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6d5d0 0x564026f6da10 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800bcb0 tx=0x7f1e1800f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91c43fb90f58778a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:55.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e14ff9640 1 -- 172.21.15.70:0/4118218089 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18015070 con 0x564026f6d5d0 2024-09-19T04:39:55.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e14ff9640 1 -- 172.21.15.70:0/4118218089 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1e1801a930 con 0x564026f6d5d0 2024-09-19T04:39:55.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.119+0000 7f1e14ff9640 1 -- 172.21.15.70:0/4118218089 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18011a40 con 0x564026f6d5d0 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 -- 172.21.15.70:0/4118218089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6d5d0 msgr2=0x564026f6da10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6d5d0 0x564026f6da10 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800bcb0 tx=0x7f1e1800f730 comp rx=0 tx=0).stop 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e26d9d640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e100a33b0 0x7f1e100a5870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1e2009c270 tx=0x7f1e20066c20 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 -- 172.21.15.70:0/4118218089 shutdown_connections 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f7a760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6d5d0 0x564026f6da10 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4118218089 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6eb40 0x564026f6d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 -- 172.21.15.70:0/4118218089 >> 172.21.15.70:0/4118218089 conn(0x564026f36310 msgr2=0x564026f69c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 -- 172.21.15.70:0/4118218089 shutdown_connections 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 -- 172.21.15.70:0/4118218089 wait complete. 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 -- start start 2024-09-19T04:39:55.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.120+0000 7f1e2f013740 1 Processor -- start 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 0x564026f77d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f75000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f755d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2f013740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564026f7b070 con 0x564026f6eb40 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2f013740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564026e8e060 con 0x564026f78370 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2f013740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564026f7b1f0 con 0x564026f6d5d0 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2f013740 10 client.0 _ll_register_callbacks cb 0x564026be18c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f75000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f75000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47944/0 (socket says 172.21.15.70:47944) 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 -- 172.21.15.70:0/4216404714 learned_addr learned my addr 172.21.15.70:0/4216404714 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f755d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.130 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 0x564026f77d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 -- 172.21.15.70:0/4216404714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 msgr2=0x564026f77d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 0x564026f77d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 -- 172.21.15.70:0/4216404714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 msgr2=0x564026f755d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f755d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 -- 172.21.15.70:0/4216404714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564026c443c0 con 0x564026f6eb40 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2659c640 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f75000 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800b9f0 tx=0x7f1e1800b3a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbee0c88a33c8890 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e0dffb640 1 -- 172.21.15.70:0/4216404714 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18015070 con 0x564026f6eb40 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e0dffb640 1 -- 172.21.15.70:0/4216404714 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f1e1801a670 con 0x564026f6eb40 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.121+0000 7f1e2f013740 1 -- 172.21.15.70:0/4216404714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e1801a930 con 0x564026f6eb40 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e0dffb640 1 -- 172.21.15.70:0/4216404714 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1e1801aae0 con 0x564026f6eb40 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e2f013740 10 client.18024 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:55.131 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e2f013740 1 -- 172.21.15.70:0/4216404714 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564026f86af0 con 0x564026f6eb40 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e0dffb640 1 -- 172.21.15.70:0/4216404714 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1e1801a930 con 0x564026f6eb40 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e0dffb640 1 -- 172.21.15.70:0/4216404714 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1e18011820 con 0x564026f6eb40 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e2f013740 10 client.18024 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e2f013740 10 client.18024 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e2f013740 20 client.18024 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564026f87ef0 0x564026f8a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e2f013740 4 client.18024 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e2f013740 1 -- 172.21.15.70:0/4216404714 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564026ee0860 con 0x564026f87ef0 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.122+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564026f87ef0 0x564026f8a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.123+0000 7f1e0dffb640 10 client.18024 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.123+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564026f87ef0 0x564026f8a2e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ce7629a5257adcf6 server_cookie=47f4f88227fbabfc in_seq=0 out_seq=0 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e0dffb640 1 -- 172.21.15.70:0/4216404714 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564026ee0860 con 0x564026f87ef0 2024-09-19T04:39:55.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e0dffb640 10 client.18024 handle_command_reply: tid=0 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 client.18024 shutdown 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 -- 172.21.15.70:0/4216404714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 msgr2=0x564026f75000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f75000 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f1e1800b9f0 tx=0x7f1e1800b3a0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 -- 172.21.15.70:0/4216404714 shutdown_connections 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564026f87ef0 0x564026f8a2e0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f755d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f75000 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 --2- 172.21.15.70:0/4216404714 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 0x564026f77d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 -- 172.21.15.70:0/4216404714 >> 172.21.15.70:0/4216404714 conn(0x564026f36310 msgr2=0x564026f6f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e0dffb640 0 client.18024 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 -- 172.21.15.70:0/4216404714 shutdown_connections 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 1 -- 172.21.15.70:0/4216404714 wait complete. 2024-09-19T04:39:55.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.124+0000 7f1e2f013740 20 client.18024 trim_cache size 0 max 16384 2024-09-19T04:39:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2f013740 1 Processor -- start 2024-09-19T04:39:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2f013740 1 -- start start 2024-09-19T04:39:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f6d5d0 0x564026f84310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f70120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f78370 0x564026f70660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2f013740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281b0210 con 0x564026f6eb40 2024-09-19T04:39:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2f013740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281adae0 con 0x564026f6d5d0 2024-09-19T04:39:55.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2f013740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281ab950 con 0x564026f78370 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f70120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f70120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47952/0 (socket says 172.21.15.70:47952) 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2659c640 1 -- 172.21.15.70:0/295042078 learned_addr learned my addr 172.21.15.70:0/295042078 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f78370 0x564026f70660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2659c640 1 -- 172.21.15.70:0/295042078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f78370 msgr2=0x564026f70660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2659c640 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f78370 0x564026f70660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2659c640 1 -- 172.21.15.70:0/295042078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f6d5d0 msgr2=0x564026f84310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2659c640 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f6d5d0 0x564026f84310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e2659c640 1 -- 172.21.15.70:0/295042078 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564026f73570 con 0x564026f6eb40 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.137+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f78370 0x564026f70660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:55.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2659c640 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f70120 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f1e18000c00 tx=0x7f1e180059b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=691e0343be5a3014 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:55.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e0ffff640 1 -- 172.21.15.70:0/295042078 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18015070 con 0x564026f6eb40 2024-09-19T04:39:55.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e0ffff640 1 -- 172.21.15.70:0/295042078 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1e1801a670 con 0x564026f6eb40 2024-09-19T04:39:55.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e0ffff640 1 -- 172.21.15.70:0/295042078 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e1802cc00 con 0x564026f6eb40 2024-09-19T04:39:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 -- 172.21.15.70:0/295042078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 msgr2=0x564026f70120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.144 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f70120 secure :-1 s=READY pgs=1256 cs=0 l=1 rev1=1 crypto rx=0x7f1e18000c00 tx=0x7f1e180059b0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 -- 172.21.15.70:0/295042078 shutdown_connections 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f78370 0x564026f70660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f70120 unknown :-1 s=CLOSED pgs=1256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 --2- 172.21.15.70:0/295042078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f6d5d0 0x564026f84310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 -- 172.21.15.70:0/295042078 >> 172.21.15.70:0/295042078 conn(0x564026f36310 msgr2=0x564026f74110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 -- 172.21.15.70:0/295042078 shutdown_connections 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.138+0000 7f1e2f013740 1 -- 172.21.15.70:0/295042078 wait complete. 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 1 -- start start 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 1 Processor -- start 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 0x564026f80710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f80c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f71910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.145 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281abfa0 con 0x564026f6eb40 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281ad410 con 0x564026f78370 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1e281ac670 con 0x564026f6d5d0 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2f013740 10 client.0 _ll_register_callbacks cb 0x7f1e1800bb00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f80c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f80c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47956/0 (socket says 172.21.15.70:47956) 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2659c640 1 -- 172.21.15.70:0/1878296993 learned_addr learned my addr 172.21.15.70:0/1878296993 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 0x564026f80710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f71910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2659c640 1 -- 172.21.15.70:0/1878296993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 msgr2=0x564026f80710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2659c640 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 0x564026f80710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2659c640 1 -- 172.21.15.70:0/1878296993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 msgr2=0x564026f71910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2659c640 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f71910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.146 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.139+0000 7f1e2659c640 1 -- 172.21.15.70:0/1878296993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564026f72140 con 0x564026f6eb40 2024-09-19T04:39:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2659c640 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f80c50 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f1e1801d040 tx=0x7f1e1802cbd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e45c7a9d55ad7a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e0dffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e0dffb640 1 -- 172.21.15.70:0/1878296993 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1e18015040 con 0x564026f6eb40 2024-09-19T04:39:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e0dffb640 1 -- 172.21.15.70:0/1878296993 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f1e18011440 con 0x564026f6eb40 2024-09-19T04:39:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 1 -- 172.21.15.70:0/1878296993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1e1801a670 con 0x564026f6eb40 2024-09-19T04:39:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e0dffb640 1 -- 172.21.15.70:0/1878296993 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f1e1801a930 con 0x564026f6eb40 2024-09-19T04:39:55.147 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 10 client.18030 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 1 -- 172.21.15.70:0/1878296993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564026ff2370 con 0x564026f6eb40 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e0dffb640 1 -- 172.21.15.70:0/1878296993 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1e1801a670 con 0x564026f6eb40 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e0dffb640 1 -- 172.21.15.70:0/1878296993 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f1e1803b020 con 0x564026f6eb40 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 10 client.18030 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 10 client.18030 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 20 client.18030 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564026ff2900 0x564026ff4d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 4 client.18030 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.140+0000 7f1e2f013740 1 -- 172.21.15.70:0/1878296993 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564026edad70 con 0x564026ff2900 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564026ff2900 0x564026ff4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e25d9b640 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564026ff2900 0x564026ff4d20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ef30c20497642a49 server_cookie=325a53ac46ee2c50 in_seq=0 out_seq=0 2024-09-19T04:39:55.148 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e0dffb640 10 client.18030 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e0dffb640 1 -- 172.21.15.70:0/1878296993 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564026edad70 con 0x564026ff2900 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e0dffb640 10 client.18030 handle_command_reply: tid=0 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 client.18030 shutdown 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 -- 172.21.15.70:0/1878296993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 msgr2=0x564026f80c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f80c50 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7f1e1801d040 tx=0x7f1e1802cbd0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 -- 172.21.15.70:0/1878296993 shutdown_connections 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x564026ff2900 0x564026ff4d20 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564026f78370 0x564026f71910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564026f6eb40 0x564026f80c50 unknown :-1 s=CLOSED pgs=1257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 --2- 172.21.15.70:0/1878296993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564026f6d5d0 0x564026f80710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e2f013740 1 -- 172.21.15.70:0/1878296993 >> 172.21.15.70:0/1878296993 conn(0x564026f36310 msgr2=0x564026f684e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.141+0000 7f1e0dffb640 0 client.18030 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:39:55.149 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2f013740 1 -- 172.21.15.70:0/1878296993 shutdown_connections 2024-09-19T04:39:55.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2f013740 1 -- 172.21.15.70:0/1878296993 wait complete. 2024-09-19T04:39:55.150 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2f013740 20 client.18030 trim_cache size 0 max 16384 2024-09-19T04:39:55.150 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e100a33b0 msgr2=0x7f1e100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e100a33b0 0x7f1e100a5870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f1e2009c270 tx=0x7f1e20066c20 comp rx=0 tx=0).stop 2024-09-19T04:39:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28105a70 msgr2=0x7f1e2819cdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28105a70 0x7f1e2819cdb0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f1e2000eaa0 tx=0x7f1e2000ef60 comp rx=0 tx=0).stop 2024-09-19T04:39:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2882400975 shutdown_connections 2024-09-19T04:39:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1e100a33b0 0x7f1e100a5870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1e28105a70 0x7f1e2819cdb0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.151 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1e28101ba0 0x7f1e28198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 --2- 172.21.15.70:0/2882400975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1e28101220 0x7f1e281984e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:55.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2882400975 >> 172.21.15.70:0/2882400975 conn(0x7f1e280fbee0 msgr2=0x7f1e28100350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:55.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2882400975 shutdown_connections 2024-09-19T04:39:55.152 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:55.142+0000 7f1e2cc3a640 1 -- 172.21.15.70:0/2882400975 wait complete. 2024-09-19T04:39:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:54 smithi167 ceph-mon[34339]: pgmap v283: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:55.836 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:39:56.083 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:56.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.538+0000 7fe22a902640 1 -- 172.21.15.70:0/2337396251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 msgr2=0x7fe224100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.538+0000 7fe22a902640 1 --2- 172.21.15.70:0/2337396251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 0x7fe224100ee0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009930 tx=0x7fe20c02a420 comp rx=0 tx=0).stop 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.538+0000 7fe22a902640 1 -- 172.21.15.70:0/2337396251 shutdown_connections 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.538+0000 7fe22a902640 1 --2- 172.21.15.70:0/2337396251 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224101420 0x7fe22410d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.538+0000 7fe22a902640 1 --2- 172.21.15.70:0/2337396251 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 0x7fe224100ee0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 --2- 172.21.15.70:0/2337396251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224106a80 0x7fe224106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 -- 172.21.15.70:0/2337396251 >> 172.21.15.70:0/2337396251 conn(0x7fe2240fc7a0 msgr2=0x7fe2240febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 -- 172.21.15.70:0/2337396251 shutdown_connections 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 -- 172.21.15.70:0/2337396251 wait complete. 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 Processor -- start 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 -- start start 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 0x7fe224198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224101420 0x7fe2241989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224106a80 0x7fe22419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe224110e90 con 0x7fe224100a80 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe224110d10 con 0x7fe224101420 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe22a902640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe224111010 con 0x7fe224106a80 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe223fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 0x7fe224198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe223fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 0x7fe224198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47970/0 (socket says 172.21.15.70:47970) 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.539+0000 7fe223fff640 1 -- 172.21.15.70:0/1403295993 learned_addr learned my addr 172.21.15.70:0/1403295993 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe21bfff640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224101420 0x7fe2241989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe228e9f640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224106a80 0x7fe22419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe223fff640 1 -- 172.21.15.70:0/1403295993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224106a80 msgr2=0x7fe22419cd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe223fff640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224106a80 0x7fe22419cd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe223fff640 1 -- 172.21.15.70:0/1403295993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224101420 msgr2=0x7fe2241989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe223fff640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224101420 0x7fe2241989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe223fff640 1 -- 172.21.15.70:0/1403295993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe22419d410 con 0x7fe224100a80 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe21bfff640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224101420 0x7fe2241989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe223fff640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 0x7fe224198460 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe21400d950 tx=0x7fe21400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe221ffb640 1 -- 172.21.15.70:0/1403295993 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe214017070 con 0x7fe224100a80 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe22a902640 1 -- 172.21.15.70:0/1403295993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe22419d700 con 0x7fe224100a80 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe221ffb640 1 -- 172.21.15.70:0/1403295993 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe214009c30 con 0x7fe224100a80 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe221ffb640 1 -- 172.21.15.70:0/1403295993 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21400f6b0 con 0x7fe224100a80 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.540+0000 7fe22a902640 1 -- 172.21.15.70:0/1403295993 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2241a4fe0 con 0x7fe224100a80 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.542+0000 7fe221ffb640 1 -- 172.21.15.70:0/1403295993 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe214010a50 con 0x7fe224100a80 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe22ccdb740 1 Processor -- start 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe22ccdb740 1 -- start start 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 0x55613fb0d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb0da10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb1a760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55613fa732f0 con 0x55613fb18370 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55613fa1acf0 con 0x55613fb0d5d0 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55613fa6f2b0 con 0x55613fb0eb40 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe21bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb1a760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe221ffb640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe21bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb1a760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47978/0 (socket says 172.21.15.70:47978) 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe21bfff640 1 -- 172.21.15.70:0/1778027431 learned_addr learned my addr 172.21.15.70:0/1778027431 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe228e9f640 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 0x55613fb0d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe223fff640 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb0da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe228e9f640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe21bfff640 1 -- 172.21.15.70:0/1778027431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 msgr2=0x55613fb0d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe221ffb640 1 -- 172.21.15.70:0/1403295993 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe2140cfa30 con 0x7fe224100a80 2024-09-19T04:39:56.564 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe21bfff640 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 0x55613fb0d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe21bfff640 1 -- 172.21.15.70:0/1778027431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 msgr2=0x55613fb0da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe21bfff640 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb0da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe21bfff640 1 -- 172.21.15.70:0/1778027431 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55613f9ff3a0 con 0x55613fb18370 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.543+0000 7fe223fff640 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb0da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.544+0000 7fe21bfff640 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb1a760 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009230 tx=0x7fe20c031d40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d925b8cf127cc810 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.544+0000 7fe228e9f640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009fd0 tx=0x7fe21c004a40 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.544+0000 7fe21a7fc640 1 -- 172.21.15.70:0/1778027431 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c035030 con 0x55613fb18370 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.544+0000 7fe21a7fc640 1 -- 172.21.15.70:0/1778027431 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe20c031710 con 0x55613fb18370 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.544+0000 7fe21a7fc640 1 -- 172.21.15.70:0/1778027431 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c0046c0 con 0x55613fb18370 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.544+0000 7fe22ccdb740 1 -- 172.21.15.70:0/1778027431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 msgr2=0x55613fb1a760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.544+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb1a760 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7fe20c009230 tx=0x7fe20c031d40 comp rx=0 tx=0).stop 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 -- 172.21.15.70:0/1778027431 shutdown_connections 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb1a760 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.565 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb0da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/1778027431 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 0x55613fb0d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 -- 172.21.15.70:0/1778027431 >> 172.21.15.70:0/1778027431 conn(0x55613fad6310 msgr2=0x55613fb09c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 -- 172.21.15.70:0/1778027431 shutdown_connections 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 -- 172.21.15.70:0/1778027431 wait complete. 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 -- start start 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 Processor -- start 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb17d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0eb40 0x55613fb14fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 0x55613fb15530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55613fb1b010 con 0x55613fb0eb40 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55613fa2e060 con 0x55613fb0d5d0 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55613fb1b190 con 0x55613fb18370 2024-09-19T04:39:56.566 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.545+0000 7fe22ccdb740 10 client.0 _ll_register_callbacks cb 0x55613f7818c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0eb40 0x55613fb14fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0eb40 0x55613fb14fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47988/0 (socket says 172.21.15.70:47988) 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 -- 172.21.15.70:0/727417740 learned_addr learned my addr 172.21.15.70:0/727417740 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe223fff640 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb17d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe228e9f640 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 0x55613fb15530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 -- 172.21.15.70:0/727417740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 msgr2=0x55613fb15530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 0x55613fb15530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 -- 172.21.15.70:0/727417740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 msgr2=0x55613fb17d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb17d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 -- 172.21.15.70:0/727417740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55613f7e43c0 con 0x55613fb0eb40 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe21bfff640 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0eb40 0x55613fb14fb0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe20c02a460 tx=0x7fe20c031600 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b960cef51fe63ecf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe2037fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:56.567 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe2037fe640 1 -- 172.21.15.70:0/727417740 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c04c070 con 0x55613fb0eb40 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe2037fe640 1 -- 172.21.15.70:0/727417740 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe20c004ad0 con 0x55613fb0eb40 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe22ccdb740 1 -- 172.21.15.70:0/727417740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe20c031710 con 0x55613fb0eb40 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe2037fe640 1 -- 172.21.15.70:0/727417740 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe20c058050 con 0x55613fb0eb40 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe22ccdb740 10 client.18042 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.546+0000 7fe22ccdb740 1 -- 172.21.15.70:0/727417740 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55613fb269b0 con 0x55613fb0eb40 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe2037fe640 1 -- 172.21.15.70:0/727417740 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe20c031710 con 0x55613fb0eb40 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe2037fe640 1 -- 172.21.15.70:0/727417740 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe20c03cb60 con 0x55613fb0eb40 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe22ccdb740 10 client.18042 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe22ccdb740 10 client.18042 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe22ccdb740 20 client.18042 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55613fb27d00 0x55613fb2a0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe22ccdb740 4 client.18042 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:56.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe22ccdb740 1 -- 172.21.15.70:0/727417740 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55613fa80860 con 0x55613fb27d00 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe223fff640 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55613fb27d00 0x55613fb2a0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe223fff640 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55613fb27d00 0x55613fb2a0f0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e66892549d1f4867 server_cookie=7cbfcf0d36678a9c in_seq=0 out_seq=0 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.547+0000 7fe2037fe640 10 client.18042 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe2037fe640 1 -- 172.21.15.70:0/727417740 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55613fa80860 con 0x55613fb27d00 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe2037fe640 10 client.18042 handle_command_reply: tid=0 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 client.18042 shutdown 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 -- 172.21.15.70:0/727417740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0eb40 msgr2=0x55613fb14fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0eb40 0x55613fb14fb0 secure :-1 s=READY pgs=1261 cs=0 l=1 rev1=1 crypto rx=0x7fe20c02a460 tx=0x7fe20c031600 comp rx=0 tx=0).stop 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 -- 172.21.15.70:0/727417740 shutdown_connections 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55613fb27d00 0x55613fb2a0f0 crc :-1 s=READY pgs=212 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe2037fe640 0 client.18042 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 0x55613fb15530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0eb40 0x55613fb14fb0 unknown :-1 s=CLOSED pgs=1261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/727417740 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb17d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 -- 172.21.15.70:0/727417740 >> 172.21.15.70:0/727417740 conn(0x55613fad6310 msgr2=0x55613fb0f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:56.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 -- 172.21.15.70:0/727417740 shutdown_connections 2024-09-19T04:39:56.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.548+0000 7fe22ccdb740 1 -- 172.21.15.70:0/727417740 wait complete. 2024-09-19T04:39:56.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.549+0000 7fe22ccdb740 20 client.18042 trim_cache size 0 max 16384 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.561+0000 7fe22ccdb740 1 Processor -- start 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe22ccdb740 1 -- start start 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb09e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 0x55613fb2d110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb2d650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241b0080 con 0x55613fb18370 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ad950 con 0x55613fb0d5d0 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ab7c0 con 0x55613fb0eb40 2024-09-19T04:39:56.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb2d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb2d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:47998/0 (socket says 172.21.15.70:47998) 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 -- 172.21.15.70:0/2677975868 learned_addr learned my addr 172.21.15.70:0/2677975868 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe223fff640 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb09e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe21bfff640 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 0x55613fb2d110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 -- 172.21.15.70:0/2677975868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 msgr2=0x55613fb2d110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 0x55613fb2d110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 -- 172.21.15.70:0/2677975868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 msgr2=0x55613fb09e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb09e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 -- 172.21.15.70:0/2677975868 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55613fb13580 con 0x55613fb18370 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.562+0000 7fe228e9f640 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb2d650 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00f040 tx=0x7fe21c0098d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41dda49b754e2ff6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe219ffb640 1 -- 172.21.15.70:0/2677975868 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c015050 con 0x55613fb18370 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe219ffb640 1 -- 172.21.15.70:0/2677975868 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe21c016040 con 0x55613fb18370 2024-09-19T04:39:56.575 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe219ffb640 1 -- 172.21.15.70:0/2677975868 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe21c00a780 con 0x55613fb18370 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 -- 172.21.15.70:0/2677975868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 msgr2=0x55613fb2d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb2d650 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fe21c00f040 tx=0x7fe21c0098d0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 -- 172.21.15.70:0/2677975868 shutdown_connections 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb18370 0x55613fb2d650 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb0eb40 0x55613fb2d110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/2677975868 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0d5d0 0x55613fb09e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 -- 172.21.15.70:0/2677975868 >> 172.21.15.70:0/2677975868 conn(0x55613fad6310 msgr2=0x55613fb09700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 -- 172.21.15.70:0/2677975868 shutdown_connections 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.563+0000 7fe22ccdb740 1 -- 172.21.15.70:0/2677975868 wait complete. 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 1 -- start start 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 1 Processor -- start 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0d5d0 0x55613fb2d1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0eb40 0x55613fb2d720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 0x55613fb2a690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241abe10 con 0x55613fb0d5d0 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ad280 con 0x55613fb0eb40 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe2241ac4e0 con 0x55613fb18370 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe22ccdb740 10 client.0 _ll_register_callbacks cb 0x7fe21c009730 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe223fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0d5d0 0x55613fb2d1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe21bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0eb40 0x55613fb2d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe21bfff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0eb40 0x55613fb2d720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:44044/0 (socket says 172.21.15.70:44044) 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe223fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0d5d0 0x55613fb2d1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48000/0 (socket says 172.21.15.70:48000) 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe21bfff640 1 -- 172.21.15.70:0/604358844 learned_addr learned my addr 172.21.15.70:0/604358844 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.564+0000 7fe228e9f640 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 0x55613fb2a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe21bfff640 1 -- 172.21.15.70:0/604358844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 msgr2=0x55613fb2a690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe21bfff640 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 0x55613fb2a690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe21bfff640 1 -- 172.21.15.70:0/604358844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0d5d0 msgr2=0x55613fb2d1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe21bfff640 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0d5d0 0x55613fb2d1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe21bfff640 1 -- 172.21.15.70:0/604358844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55613fb2aec0 con 0x55613fb0eb40 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe223fff640 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0d5d0 0x55613fb2d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe21bfff640 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0eb40 0x55613fb2d720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe20c000c00 tx=0x7fe20c031920 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1017b717c98c8719 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe2037fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe2037fe640 1 -- 172.21.15.70:0/604358844 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe20c055020 con 0x55613fb0eb40 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe22ccdb740 1 -- 172.21.15.70:0/604358844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe21c016040 con 0x55613fb0eb40 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe2037fe640 1 -- 172.21.15.70:0/604358844 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe20c03c850 con 0x55613fb0eb40 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe2037fe640 1 -- 172.21.15.70:0/604358844 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe20c04c070 con 0x55613fb0eb40 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe22ccdb740 10 client.26648 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:56.578 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe22ccdb740 1 -- 172.21.15.70:0/604358844 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55613fb96530 con 0x55613fb0eb40 2024-09-19T04:39:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.565+0000 7fe2037fe640 1 -- 172.21.15.70:0/604358844 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe21c016040 con 0x55613fb0eb40 2024-09-19T04:39:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe2037fe640 1 -- 172.21.15.70:0/604358844 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe20c044b50 con 0x55613fb0eb40 2024-09-19T04:39:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe22ccdb740 10 client.26648 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe22ccdb740 10 client.26648 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe22ccdb740 20 client.26648 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55613fb27d00 0x55613fb98d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe22ccdb740 4 client.26648 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:39:56.579 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe22ccdb740 1 -- 172.21.15.70:0/604358844 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55613fa7ad70 con 0x55613fb27d00 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe223fff640 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55613fb27d00 0x55613fb98d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe223fff640 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55613fb27d00 0x55613fb98d10 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42ed57c2cc86fc9 server_cookie=40682289e7c7a0e8 in_seq=0 out_seq=0 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.566+0000 7fe2037fe640 10 client.26648 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe2037fe640 1 -- 172.21.15.70:0/604358844 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55613fa7ad70 con 0x55613fb27d00 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe2037fe640 10 client.26648 handle_command_reply: tid=0 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 client.26648 shutdown 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 -- 172.21.15.70:0/604358844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0eb40 msgr2=0x55613fb2d720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0eb40 0x55613fb2d720 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fe20c000c00 tx=0x7fe20c031920 comp rx=0 tx=0).stop 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 -- 172.21.15.70:0/604358844 shutdown_connections 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55613fb27d00 0x55613fb98d10 crc :-1 s=READY pgs=213 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55613fb18370 0x55613fb2a690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.580 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe2037fe640 0 client.26648 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55613fb0eb40 0x55613fb2d720 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 --2- 172.21.15.70:0/604358844 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55613fb0d5d0 0x55613fb2d1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 -- 172.21.15.70:0/604358844 >> 172.21.15.70:0/604358844 conn(0x55613fad6310 msgr2=0x55613fb13900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 -- 172.21.15.70:0/604358844 shutdown_connections 2024-09-19T04:39:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 1 -- 172.21.15.70:0/604358844 wait complete. 2024-09-19T04:39:56.581 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22ccdb740 20 client.26648 trim_cache size 0 max 16384 2024-09-19T04:39:56.581 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:39:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22a902640 1 -- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 msgr2=0x7fe2100a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22a902640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fe21c009fd0 tx=0x7fe21c004a40 comp rx=0 tx=0).stop 2024-09-19T04:39:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22a902640 1 -- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 msgr2=0x7fe224198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.567+0000 7fe22a902640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 0x7fe224198460 secure :-1 s=READY pgs=1259 cs=0 l=1 rev1=1 crypto rx=0x7fe21400d950 tx=0x7fe21400de10 comp rx=0 tx=0).stop 2024-09-19T04:39:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.568+0000 7fe22a902640 1 -- 172.21.15.70:0/1403295993 shutdown_connections 2024-09-19T04:39:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.568+0000 7fe22a902640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe2100a33b0 0x7fe2100a5870 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.582 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.568+0000 7fe22a902640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe224106a80 0x7fe22419cd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.568+0000 7fe22a902640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe224101420 0x7fe2241989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.568+0000 7fe22a902640 1 --2- 172.21.15.70:0/1403295993 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe224100a80 0x7fe224198460 unknown :-1 s=CLOSED pgs=1259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:56.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.568+0000 7fe22a902640 1 -- 172.21.15.70:0/1403295993 >> 172.21.15.70:0/1403295993 conn(0x7fe2240fc7a0 msgr2=0x7fe22406aa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:56.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.568+0000 7fe22a902640 1 -- 172.21.15.70:0/1403295993 shutdown_connections 2024-09-19T04:39:56.583 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:56.568+0000 7fe22a902640 1 -- 172.21.15.70:0/1403295993 wait complete. 2024-09-19T04:39:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:56 smithi134 ceph-mon[34525]: pgmap v284: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:57.131 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:56 smithi070 ceph-mon[30942]: pgmap v284: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:57.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:56 smithi167 ceph-mon[34339]: pgmap v284: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:39:58.157 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:39:58.176 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:39:58.432 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:39:58.851 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:58 smithi070 ceph-mon[30942]: pgmap v285: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:58.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 -- 172.21.15.70:0/1792557177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244101420 msgr2=0x7f124410d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1792557177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244101420 0x7f124410d950 secure :-1 s=READY pgs=1263 cs=0 l=1 rev1=1 crypto rx=0x7f123c009cd0 tx=0x7f123c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 -- 172.21.15.70:0/1792557177 shutdown_connections 2024-09-19T04:39:58.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1792557177 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244101420 0x7f124410d950 unknown :-1 s=CLOSED pgs=1263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1792557177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1244100a80 0x7f1244100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1792557177 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1244106a80 0x7f1244106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.937 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 -- 172.21.15.70:0/1792557177 >> 172.21.15.70:0/1792557177 conn(0x7f12440fc7a0 msgr2=0x7f12440febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 -- 172.21.15.70:0/1792557177 shutdown_connections 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.933+0000 7f1249ed8640 1 -- 172.21.15.70:0/1792557177 wait complete. 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1249ed8640 1 Processor -- start 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1249ed8640 1 -- start start 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1249ed8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1244100a80 0x7f1244198490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1249ed8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1244101420 0x7f12441989d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1249ed8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244106a80 0x7f124419cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1249ed8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1244110ea0 con 0x7f1244106a80 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1249ed8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1244110d20 con 0x7f1244100a80 2024-09-19T04:39:58.938 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1249ed8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1244111020 con 0x7f1244101420 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1243fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244106a80 0x7f124419cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1243fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244106a80 0x7f124419cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48028/0 (socket says 172.21.15.70:48028) 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1243fff640 1 -- 172.21.15.70:0/1030054073 learned_addr learned my addr 172.21.15.70:0/1030054073 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f12437fe640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1244100a80 0x7f1244198490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f123bfff640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1244101420 0x7f12441989d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1243fff640 1 -- 172.21.15.70:0/1030054073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1244101420 msgr2=0x7f12441989d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1243fff640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1244101420 0x7f12441989d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1243fff640 1 -- 172.21.15.70:0/1030054073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1244100a80 msgr2=0x7f1244198490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.939 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1243fff640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1244100a80 0x7f1244198490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.934+0000 7f1243fff640 1 -- 172.21.15.70:0/1030054073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f124419d440 con 0x7f1244106a80 2024-09-19T04:39:58.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.935+0000 7f1243fff640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244106a80 0x7f124419cd60 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f123c006010 tx=0x7f123c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:58.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.935+0000 7f12417fa640 1 -- 172.21.15.70:0/1030054073 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c004040 con 0x7f1244106a80 2024-09-19T04:39:58.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.935+0000 7f12417fa640 1 -- 172.21.15.70:0/1030054073 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f123c0046b0 con 0x7f1244106a80 2024-09-19T04:39:58.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.935+0000 7f12417fa640 1 -- 172.21.15.70:0/1030054073 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f123c045410 con 0x7f1244106a80 2024-09-19T04:39:58.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.935+0000 7f1249ed8640 1 -- 172.21.15.70:0/1030054073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f124419d6d0 con 0x7f1244106a80 2024-09-19T04:39:58.940 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.935+0000 7f1249ed8640 1 -- 172.21.15.70:0/1030054073 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12441a5010 con 0x7f1244106a80 2024-09-19T04:39:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.937+0000 7f12417fa640 1 -- 172.21.15.70:0/1030054073 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f123c043020 con 0x7f1244106a80 2024-09-19T04:39:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.937+0000 7f124c2b1740 1 Processor -- start 2024-09-19T04:39:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.937+0000 7f124c2b1740 1 -- start start 2024-09-19T04:39:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 0x55982927be00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x55982928ac10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x55982928d540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f124c2b1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5598291e1280 con 0x55982928b150 2024-09-19T04:39:58.947 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f124c2b1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x559829188b10 con 0x55982927c340 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f124c2b1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5598291dd240 con 0x55982927ba20 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f12417fa640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f12300a33b0 0x7f12300a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x55982928d540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x55982928d540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48044/0 (socket says 172.21.15.70:48044) 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 -- 172.21.15.70:0/3534017071 learned_addr learned my addr 172.21.15.70:0/3534017071 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 0x55982927be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f12437fe640 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x55982928ac10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f1243fff640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f12300a33b0 0x7f12300a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.948 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 -- 172.21.15.70:0/3534017071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 msgr2=0x55982927be00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 0x55982927be00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 -- 172.21.15.70:0/3534017071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 msgr2=0x55982928ac10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x55982928ac10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 -- 172.21.15.70:0/3534017071 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598291951f0 con 0x55982928b150 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f12417fa640 1 -- 172.21.15.70:0/1030054073 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f123c02e030 con 0x7f1244106a80 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f123bfff640 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x55982928d540 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f122c0127c0 tx=0x7f122c00b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68f8a7d595f5b4b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.938+0000 7f1243fff640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f12300a33b0 0x7f12300a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f123c0ee430 tx=0x7f123c0b8bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f1239ffb640 1 -- 172.21.15.70:0/3534017071 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c012e00 con 0x55982928b150 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f1239ffb640 1 -- 172.21.15.70:0/3534017071 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f122c010c40 con 0x55982928b150 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f1239ffb640 1 -- 172.21.15.70:0/3534017071 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c01eae0 con 0x55982928b150 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 -- 172.21.15.70:0/3534017071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 msgr2=0x55982928d540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.949 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x55982928d540 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f122c0127c0 tx=0x7f122c00b7c0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 -- 172.21.15.70:0/3534017071 shutdown_connections 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x55982928d540 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x55982928ac10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 --2- 172.21.15.70:0/3534017071 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 0x55982927be00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 -- 172.21.15.70:0/3534017071 >> 172.21.15.70:0/3534017071 conn(0x5598292780f0 msgr2=0x5598292784d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 -- 172.21.15.70:0/3534017071 shutdown_connections 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.939+0000 7f124c2b1740 1 -- 172.21.15.70:0/3534017071 wait complete. 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 1 -- start start 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 1 Processor -- start 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927ba20 0x5598292880a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927c340 0x5598292885e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.950 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x559829288b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55982928dd20 con 0x55982928b150 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55982919bf10 con 0x55982927ba20 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55982928dea0 con 0x55982927c340 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f124c2b1740 10 client.0 _ll_register_callbacks cb 0x559829164a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f123bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x559829288b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f123bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x559829288b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48058/0 (socket says 172.21.15.70:48058) 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f123bfff640 1 -- 172.21.15.70:0/518880977 learned_addr learned my addr 172.21.15.70:0/518880977 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f12437fe640 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927c340 0x5598292885e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.940+0000 7f123bfff640 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927ba20 0x5598292880a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f123bfff640 1 -- 172.21.15.70:0/518880977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927c340 msgr2=0x5598292885e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f123bfff640 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927c340 0x5598292885e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.951 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f123bfff640 1 -- 172.21.15.70:0/518880977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927ba20 msgr2=0x5598292880a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f123bfff640 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927ba20 0x5598292880a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f123bfff640 1 -- 172.21.15.70:0/518880977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559828f526a0 con 0x55982928b150 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f12437fe640 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927c340 0x5598292885e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f123bfff640 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x559829288b20 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f122c01e7a0 tx=0x7f122c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e75fbc535f0ea875 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f1222ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f1222ffd640 1 -- 172.21.15.70:0/518880977 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c012e00 con 0x55982928b150 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f1222ffd640 1 -- 172.21.15.70:0/518880977 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f122c010770 con 0x55982928b150 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f124c2b1740 1 -- 172.21.15.70:0/518880977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f122c010c40 con 0x55982928b150 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f1222ffd640 1 -- 172.21.15.70:0/518880977 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f122c010970 con 0x55982928b150 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f124c2b1740 10 client.18060 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:58.952 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f124c2b1740 1 -- 172.21.15.70:0/518880977 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5598292999e0 con 0x55982928b150 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f1222ffd640 1 -- 172.21.15.70:0/518880977 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f122c010c40 con 0x55982928b150 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.941+0000 7f1222ffd640 1 -- 172.21.15.70:0/518880977 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f122c027030 con 0x55982928b150 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f124c2b1740 10 client.18060 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f124c2b1740 10 client.18060 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f124c2b1740 20 client.18060 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f124c2b1740 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55982929ad30 0x55982929d120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f124c2b1740 4 client.18060 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f124c2b1740 1 -- 172.21.15.70:0/518880977 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5598291ee7f0 con 0x55982929ad30 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f12437fe640 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55982929ad30 0x55982929d120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f12437fe640 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55982929ad30 0x55982929d120 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=856faaeeb6c8f8 server_cookie=81de07fea847dbd2 in_seq=0 out_seq=0 2024-09-19T04:39:58.953 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.942+0000 7f1222ffd640 10 client.18060 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f1222ffd640 1 -- 172.21.15.70:0/518880977 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5598291ee7f0 con 0x55982929ad30 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f1222ffd640 10 client.18060 handle_command_reply: tid=0 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 client.18060 shutdown 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 -- 172.21.15.70:0/518880977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 msgr2=0x559829288b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x559829288b20 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f122c01e7a0 tx=0x7f122c005c50 comp rx=0 tx=0).stop 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 -- 172.21.15.70:0/518880977 shutdown_connections 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55982929ad30 0x55982929d120 crc :-1 s=READY pgs=214 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x559829288b20 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927c340 0x5598292885e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f1222ffd640 0 client.18060 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:58.954 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 --2- 172.21.15.70:0/518880977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927ba20 0x5598292880a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 -- 172.21.15.70:0/518880977 >> 172.21.15.70:0/518880977 conn(0x5598292780f0 msgr2=0x559829277270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 -- 172.21.15.70:0/518880977 shutdown_connections 2024-09-19T04:39:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.943+0000 7f124c2b1740 1 -- 172.21.15.70:0/518880977 wait complete. 2024-09-19T04:39:58.955 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.944+0000 7f124c2b1740 20 client.18060 trim_cache size 0 max 16384 2024-09-19T04:39:58.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.960+0000 7f124c2b1740 1 Processor -- start 2024-09-19T04:39:58.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f124c2b1740 1 -- start start 2024-09-19T04:39:58.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 0x559829289f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.968 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x5598292a2890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x5598292a2dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f124c2b1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12441adef0 con 0x55982928b150 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f124c2b1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12441ab7c0 con 0x55982927c340 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f124c2b1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12441a9630 con 0x55982927ba20 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x5598292a2dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x5598292a2dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48064/0 (socket says 172.21.15.70:48064) 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 -- 172.21.15.70:0/2257764032 learned_addr learned my addr 172.21.15.70:0/2257764032 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f12437fe640 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x5598292a2890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 -- 172.21.15.70:0/2257764032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 msgr2=0x559829289f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:58.969 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 0x559829289f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 -- 172.21.15.70:0/2257764032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 msgr2=0x5598292a2890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x5598292a2890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 -- 172.21.15.70:0/2257764032 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55982928d880 con 0x55982928b150 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f12437fe640 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x5598292a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f123bfff640 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x5598292a2dd0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f122c00b820 tx=0x7f122c012500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81d8d22dfc3c9c08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f12397fa640 1 -- 172.21.15.70:0/2257764032 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c012e00 con 0x55982928b150 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f12397fa640 1 -- 172.21.15.70:0/2257764032 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f122c010c40 con 0x55982928b150 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.961+0000 7f12397fa640 1 -- 172.21.15.70:0/2257764032 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c02b690 con 0x55982928b150 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 -- 172.21.15.70:0/2257764032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 msgr2=0x5598292a2dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x5598292a2dd0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f122c00b820 tx=0x7f122c012500 comp rx=0 tx=0).stop 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 -- 172.21.15.70:0/2257764032 shutdown_connections 2024-09-19T04:39:58.970 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982928b150 0x5598292a2dd0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x5598292a2890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2257764032 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982927ba20 0x559829289f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 -- 172.21.15.70:0/2257764032 >> 172.21.15.70:0/2257764032 conn(0x5598292780f0 msgr2=0x5598292897f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 -- 172.21.15.70:0/2257764032 shutdown_connections 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 -- 172.21.15.70:0/2257764032 wait complete. 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.962+0000 7f124c2b1740 1 -- start start 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f124c2b1740 1 Processor -- start 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982927ba20 0x5598292938e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x559829284e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.971 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f124c2b1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982928b150 0x559829285360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f124c2b1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f12441a9c80 con 0x55982927ba20 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f124c2b1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f12441ab0f0 con 0x55982927c340 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f124c2b1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f12441aa350 con 0x55982928b150 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f124c2b1740 10 client.0 _ll_register_callbacks cb 0x7f1234009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982927ba20 0x5598292938e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982927ba20 0x5598292938e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48072/0 (socket says 172.21.15.70:48072) 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 -- 172.21.15.70:0/2804797002 learned_addr learned my addr 172.21.15.70:0/2804797002 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982928b150 0x559829285360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f12437fe640 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x559829284e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 -- 172.21.15.70:0/2804797002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982928b150 msgr2=0x559829285360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982928b150 0x559829285360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 -- 172.21.15.70:0/2804797002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 msgr2=0x559829284e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x559829284e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 -- 172.21.15.70:0/2804797002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559829285b90 con 0x55982927ba20 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f123bfff640 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982927ba20 0x5598292938e0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f122c0125d0 tx=0x7f122c005c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3f1cfdc4146b102 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.963+0000 7f1222ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f1222ffd640 1 -- 172.21.15.70:0/2804797002 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f122c012e00 con 0x55982927ba20 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 1 -- 172.21.15.70:0/2804797002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f122c010c40 con 0x55982927ba20 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f1222ffd640 1 -- 172.21.15.70:0/2804797002 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7f122c01e7a0 con 0x55982927ba20 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f1222ffd640 1 -- 172.21.15.70:0/2804797002 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f122c01e9a0 con 0x55982927ba20 2024-09-19T04:39:58.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 10 client.18066 fetch_fsmap learned FSMap version 34 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 1 -- 172.21.15.70:0/2804797002 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x559829305900 con 0x55982927ba20 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f1222ffd640 1 -- 172.21.15.70:0/2804797002 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f122c010c40 con 0x55982927ba20 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f1222ffd640 1 -- 172.21.15.70:0/2804797002 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f122c027070 con 0x55982927ba20 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 10 client.18066 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 10 client.18066 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 20 client.18066 populate_metadata read hostname 'smithi070' 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559829305eb0 0x5598293082a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 4 client.18066 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f124c2b1740 1 -- 172.21.15.70:0/2804797002 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5598291e8d00 con 0x559829305eb0 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.964+0000 7f12437fe640 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559829305eb0 0x5598293082a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:39:58.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.965+0000 7f12437fe640 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559829305eb0 0x5598293082a0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bc45f2c63779616 server_cookie=de25027b26fb5e8e in_seq=0 out_seq=0 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.965+0000 7f1222ffd640 10 client.18066 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f1222ffd640 1 -- 172.21.15.70:0/2804797002 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5598291e8d00 con 0x559829305eb0 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f1222ffd640 10 client.18066 handle_command_reply: tid=0 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 client.18066 shutdown 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 -- 172.21.15.70:0/2804797002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982927ba20 msgr2=0x5598292938e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982927ba20 0x5598292938e0 secure :-1 s=READY pgs=1268 cs=0 l=1 rev1=1 crypto rx=0x7f122c0125d0 tx=0x7f122c005c50 comp rx=0 tx=0).stop 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 -- 172.21.15.70:0/2804797002 shutdown_connections 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x559829305eb0 0x5598293082a0 crc :-1 s=READY pgs=215 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55982928b150 0x559829285360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55982927c340 0x559829284e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f1222ffd640 0 client.18066 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:39:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 --2- 172.21.15.70:0/2804797002 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55982927ba20 0x5598292938e0 unknown :-1 s=CLOSED pgs=1268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 -- 172.21.15.70:0/2804797002 >> 172.21.15.70:0/2804797002 conn(0x5598292780f0 msgr2=0x559829289f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 -- 172.21.15.70:0/2804797002 shutdown_connections 2024-09-19T04:39:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 1 -- 172.21.15.70:0/2804797002 wait complete. 2024-09-19T04:39:58.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.966+0000 7f124c2b1740 20 client.18066 trim_cache size 0 max 16384 2024-09-19T04:39:58.976 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:39:58.977 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:39:58.977 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "af897769-c828-4de3-8ba8-bc48557ff303", 2024-09-19T04:39:58.977 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:39:58.977 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 -- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f12300a33b0 msgr2=0x7f12300a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f12300a33b0 0x7f12300a5870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f123c0ee430 tx=0x7f123c0b8bc0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 -- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244106a80 msgr2=0x7f124419cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244106a80 0x7f124419cd60 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f123c006010 tx=0x7f123c003970 comp rx=0 tx=0).stop 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 -- 172.21.15.70:0/1030054073 shutdown_connections 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f12300a33b0 0x7f12300a5870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1244106a80 0x7f124419cd60 unknown :-1 s=CLOSED pgs=1264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1244101420 0x7f12441989d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 --2- 172.21.15.70:0/1030054073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1244100a80 0x7f1244198490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:39:58.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 -- 172.21.15.70:0/1030054073 >> 172.21.15.70:0/1030054073 conn(0x7f12440fc7a0 msgr2=0x7f124406aa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:39:58.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 -- 172.21.15.70:0/1030054073 shutdown_connections 2024-09-19T04:39:58.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:39:58.967+0000 7f1249ed8640 1 -- 172.21.15.70:0/1030054073 wait complete. 2024-09-19T04:39:59.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:58 smithi134 ceph-mon[34525]: pgmap v285: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:59.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:58 smithi167 ceph-mon[34339]: pgmap v285: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:39:59.683 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:39:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:59 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:39:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:59 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:39:59.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:39:59 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:39:59.927 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:59 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:40:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:59 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:40:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:39:59 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:00.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:59 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:40:00.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:00.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:59 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:40:00.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:39:59 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 -- 172.21.15.70:0/1211633127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c101de0 msgr2=0x7fe05c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 --2- 172.21.15.70:0/1211633127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c101de0 0x7fe05c1021c0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe050009900 tx=0x7fe05002a410 comp rx=0 tx=0).stop 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 -- 172.21.15.70:0/1211633127 shutdown_connections 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 --2- 172.21.15.70:0/1211633127 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c106f10 0x7fe05c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 --2- 172.21.15.70:0/1211633127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c102790 0x7fe05c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 --2- 172.21.15.70:0/1211633127 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c101de0 0x7fe05c1021c0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 -- 172.21.15.70:0/1211633127 >> 172.21.15.70:0/1211633127 conn(0x7fe05c0fd8c0 msgr2=0x7fe05c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 -- 172.21.15.70:0/1211633127 shutdown_connections 2024-09-19T04:40:00.493 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.471+0000 7fe0640ef640 1 -- 172.21.15.70:0/1211633127 wait complete. 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe0640ef640 1 Processor -- start 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe0640ef640 1 -- start start 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe0640ef640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c101de0 0x7fe05c1984c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe0640ef640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102790 0x7fe05c198a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe0640ef640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c106f10 0x7fe05c19cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe0640ef640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c111f40 con 0x7fe05c102790 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe0640ef640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c111dc0 con 0x7fe05c106f10 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe0640ef640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1120c0 con 0x7fe05c101de0 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06168a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102790 0x7fe05c198a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06168a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102790 0x7fe05c198a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48084/0 (socket says 172.21.15.70:48084) 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06168a640 1 -- 172.21.15.70:0/3287763122 learned_addr learned my addr 172.21.15.70:0/3287763122 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:00.494 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c101de0 0x7fe05c1984c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06268c640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c106f10 0x7fe05c19cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06168a640 1 -- 172.21.15.70:0/3287763122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c101de0 msgr2=0x7fe05c1984c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06168a640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c101de0 0x7fe05c1984c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06168a640 1 -- 172.21.15.70:0/3287763122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c106f10 msgr2=0x7fe05c19cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06168a640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c106f10 0x7fe05c19cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06168a640 1 -- 172.21.15.70:0/3287763122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe05c19d470 con 0x7fe05c102790 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.472+0000 7fe06268c640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c106f10 0x7fe05c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.473+0000 7fe06168a640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102790 0x7fe05c198a00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c890 tx=0x7fe05800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.473+0000 7fe04effd640 1 -- 172.21.15.70:0/3287763122 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058004220 con 0x7fe05c102790 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.473+0000 7fe04effd640 1 -- 172.21.15.70:0/3287763122 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe0580043c0 con 0x7fe05c102790 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.473+0000 7fe04effd640 1 -- 172.21.15.70:0/3287763122 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe058004a00 con 0x7fe05c102790 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.473+0000 7fe0640ef640 1 -- 172.21.15.70:0/3287763122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe05c19d760 con 0x7fe05c102790 2024-09-19T04:40:00.495 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.473+0000 7fe0640ef640 1 -- 172.21.15.70:0/3287763122 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe05c1a5040 con 0x7fe05c102790 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.475+0000 7fe04effd640 1 -- 172.21.15.70:0/3287763122 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe058004ba0 con 0x7fe05c102790 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.475+0000 7fe0664c8740 1 Processor -- start 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.475+0000 7fe0664c8740 1 -- start start 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c61f54a0 0x55d3c61f5880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f5dc0 0x55d3c6200140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c6200680 0x55d3c6202a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe0664c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d3c615b2e0 con 0x55d3c61f5dc0 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe0664c8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d3c6102ce0 con 0x55d3c61f54a0 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe0664c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d3c61572a0 con 0x55d3c6200680 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f5dc0 0x55d3c6200140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f5dc0 0x55d3c6200140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48096/0 (socket says 172.21.15.70:48096) 2024-09-19T04:40:00.496 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 -- 172.21.15.70:0/3591079744 learned_addr learned my addr 172.21.15.70:0/3591079744 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe04effd640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a3430 0x7fe0480a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe06168a640 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c6200680 0x55d3c6202a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe06268c640 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c61f54a0 0x55d3c61f5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe06268c640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a3430 0x7fe0480a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 -- 172.21.15.70:0/3591079744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c6200680 msgr2=0x55d3c6202a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c6200680 0x55d3c6202a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 -- 172.21.15.70:0/3591079744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c61f54a0 msgr2=0x55d3c61f5880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c61f54a0 0x55d3c61f5880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 -- 172.21.15.70:0/3591079744 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c60e7440 con 0x55d3c61f5dc0 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe06168a640 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c6200680 0x55d3c6202a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:00.497 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe06268c640 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c61f54a0 0x55d3c61f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe04effd640 1 -- 172.21.15.70:0/3287763122 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe0580cfa00 con 0x7fe05c102790 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.476+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f5dc0 0x55d3c6200140 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe050009900 tx=0x7fe050032cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7caab44363d0d8d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe06268c640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a3430 0x7fe0480a58f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe054005c40 tx=0x7fe054009280 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe047fff640 1 -- 172.21.15.70:0/3591079744 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050040070 con 0x55d3c61f5dc0 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe047fff640 1 -- 172.21.15.70:0/3591079744 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe050031710 con 0x55d3c61f5dc0 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe047fff640 1 -- 172.21.15.70:0/3591079744 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050035040 con 0x55d3c61f5dc0 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 -- 172.21.15.70:0/3591079744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f5dc0 msgr2=0x55d3c6200140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f5dc0 0x55d3c6200140 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7fe050009900 tx=0x7fe050032cc0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 -- 172.21.15.70:0/3591079744 shutdown_connections 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c6200680 0x55d3c6202a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f5dc0 0x55d3c6200140 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.498 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3591079744 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c61f54a0 0x55d3c61f5880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 -- 172.21.15.70:0/3591079744 >> 172.21.15.70:0/3591079744 conn(0x55d3c61f1a30 msgr2=0x55d3c61f1e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 -- 172.21.15.70:0/3591079744 shutdown_connections 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.477+0000 7fe0664c8740 1 -- 172.21.15.70:0/3591079744 wait complete. 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 1 -- start start 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 1 Processor -- start 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c61fff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c61fd220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c61fd760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d3c6203250 con 0x55d3c61f54a0 2024-09-19T04:40:00.499 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d3c6116050 con 0x55d3c6200680 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d3c62033d0 con 0x55d3c61f5dc0 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe0664c8740 10 client.0 _ll_register_callbacks cb 0x55d3c6156160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe061e8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c61fff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe061e8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c61fff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48108/0 (socket says 172.21.15.70:48108) 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.478+0000 7fe061e8b640 1 -- 172.21.15.70:0/3659183695 learned_addr learned my addr 172.21.15.70:0/3659183695 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe06168a640 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c61fd220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe06268c640 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c61fd760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe061e8b640 1 -- 172.21.15.70:0/3659183695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 msgr2=0x55d3c61fd220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c61fd220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe061e8b640 1 -- 172.21.15.70:0/3659183695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 msgr2=0x55d3c61fd760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c61fd760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe061e8b640 1 -- 172.21.15.70:0/3659183695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c5ecc3c0 con 0x55d3c61f54a0 2024-09-19T04:40:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c61fff70 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe05002a930 tx=0x7fe050005420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acac278e82041900 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0457fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0457fa640 1 -- 172.21.15.70:0/3659183695 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe05004b070 con 0x55d3c61f54a0 2024-09-19T04:40:00.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0457fa640 1 -- 172.21.15.70:0/3659183695 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe05003c850 con 0x55d3c61f54a0 2024-09-19T04:40:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0664c8740 1 -- 172.21.15.70:0/3659183695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe050031710 con 0x55d3c61f54a0 2024-09-19T04:40:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0457fa640 1 -- 172.21.15.70:0/3659183695 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe050057050 con 0x55d3c61f54a0 2024-09-19T04:40:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0664c8740 10 client.18078 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0664c8740 1 -- 172.21.15.70:0/3659183695 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d3c620eb30 con 0x55d3c61f54a0 2024-09-19T04:40:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0457fa640 1 -- 172.21.15.70:0/3659183695 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe050031710 con 0x55d3c61f54a0 2024-09-19T04:40:00.502 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.479+0000 7fe0457fa640 1 -- 172.21.15.70:0/3659183695 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe050004e00 con 0x55d3c61f54a0 2024-09-19T04:40:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe0664c8740 10 client.18078 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe0664c8740 10 client.18078 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe0664c8740 20 client.18078 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d3c620fe80 0x55d3c6212270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe0664c8740 4 client.18078 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:40:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe0664c8740 1 -- 172.21.15.70:0/3659183695 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d3c6168850 con 0x55d3c620fe80 2024-09-19T04:40:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe06168a640 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d3c620fe80 0x55d3c6212270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe0457fa640 10 client.18078 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.480+0000 7fe06168a640 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d3c620fe80 0x55d3c6212270 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ba9c5d6ff50e53c server_cookie=cc37bb1b8cde48d in_seq=0 out_seq=0 2024-09-19T04:40:00.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0457fa640 1 -- 172.21.15.70:0/3659183695 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d3c6168850 con 0x55d3c620fe80 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0457fa640 10 client.18078 handle_command_reply: tid=0 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 client.18078 shutdown 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 -- 172.21.15.70:0/3659183695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 msgr2=0x55d3c61fff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c61fff70 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7fe05002a930 tx=0x7fe050005420 comp rx=0 tx=0).stop 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 -- 172.21.15.70:0/3659183695 shutdown_connections 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d3c620fe80 0x55d3c6212270 crc :-1 s=READY pgs=216 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c61fd760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c61fd220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3659183695 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c61fff70 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0457fa640 0 client.18078 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 -- 172.21.15.70:0/3659183695 >> 172.21.15.70:0/3659183695 conn(0x55d3c61f1a30 msgr2=0x55d3c61f0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 -- 172.21.15.70:0/3659183695 shutdown_connections 2024-09-19T04:40:00.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 1 -- 172.21.15.70:0/3659183695 wait complete. 2024-09-19T04:40:00.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.481+0000 7fe0664c8740 20 client.18078 trim_cache size 0 max 16384 2024-09-19T04:40:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.498+0000 7fe0664c8740 1 Processor -- start 2024-09-19T04:40:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.498+0000 7fe0664c8740 1 -- start start 2024-09-19T04:40:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.498+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6217840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6217d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.511 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c61fa480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe0664c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1b0130 con 0x55d3c61f54a0 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe0664c8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1ada00 con 0x55d3c6200680 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe0664c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1ab870 con 0x55d3c61f5dc0 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6217840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6217840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48110/0 (socket says 172.21.15.70:48110) 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 -- 172.21.15.70:0/1954343872 learned_addr learned my addr 172.21.15.70:0/1954343872 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe06168a640 1 --2- 172.21.15.70:0/1954343872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6217d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 -- 172.21.15.70:0/1954343872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 msgr2=0x55d3c6217d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 --2- 172.21.15.70:0/1954343872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6217d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 -- 172.21.15.70:0/1954343872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 msgr2=0x55d3c61fa480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:00.512 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 --2- 172.21.15.70:0/1954343872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c61fa480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 -- 172.21.15.70:0/1954343872 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d3c61f14d0 con 0x55d3c61f54a0 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe061e8b640 1 --2- 172.21.15.70:0/1954343872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6217840 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe050000c00 tx=0x7fe05002ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=596f934e72a32287 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe0477fe640 1 -- 172.21.15.70:0/1954343872 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050054020 con 0x55d3c61f54a0 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe0477fe640 1 -- 172.21.15.70:0/1954343872 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe050031710 con 0x55d3c61f54a0 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.499+0000 7fe0477fe640 1 -- 172.21.15.70:0/1954343872 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050000e60 con 0x55d3c61f54a0 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 -- 172.21.15.70:0/1954343872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 msgr2=0x55d3c6217840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 --2- 172.21.15.70:0/1954343872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6217840 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7fe050000c00 tx=0x7fe05002ab90 comp rx=0 tx=0).stop 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 -- 172.21.15.70:0/1954343872 shutdown_connections 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 --2- 172.21.15.70:0/1954343872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c61fa480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 --2- 172.21.15.70:0/1954343872 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6217d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.513 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 --2- 172.21.15.70:0/1954343872 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6217840 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 -- 172.21.15.70:0/1954343872 >> 172.21.15.70:0/1954343872 conn(0x55d3c61f1a30 msgr2=0x55d3c61f0b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 -- 172.21.15.70:0/1954343872 shutdown_connections 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 -- 172.21.15.70:0/1954343872 wait complete. 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 -- start start 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.500+0000 7fe0664c8740 1 Processor -- start 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6208cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6206010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe0664c8740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c6206550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe0664c8740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1abec0 con 0x55d3c61f54a0 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe0664c8740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1ad330 con 0x55d3c6200680 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe0664c8740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe05c1ac590 con 0x55d3c61f5dc0 2024-09-19T04:40:00.514 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe0664c8740 10 client.0 _ll_register_callbacks cb 0x7fe050032b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6208cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6208cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:48114/0 (socket says 172.21.15.70:48114) 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 -- 172.21.15.70:0/3374208209 learned_addr learned my addr 172.21.15.70:0/3374208209 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe06168a640 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6206010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 -- 172.21.15.70:0/3374208209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 msgr2=0x55d3c6206010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6206010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 -- 172.21.15.70:0/3374208209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 msgr2=0x55d3c6206550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c6206550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 -- 172.21.15.70:0/3374208209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d3c6206d80 con 0x55d3c61f54a0 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe06168a640 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6206010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:00.515 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe061e8b640 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6208cc0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe0500314b0 tx=0x7fe05003c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f815d62ee2edc732 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.501+0000 7fe0457fa640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0457fa640 1 -- 172.21.15.70:0/3374208209 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe050054070 con 0x55d3c61f54a0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 1 -- 172.21.15.70:0/3374208209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe050031710 con 0x55d3c61f54a0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0457fa640 1 -- 172.21.15.70:0/3374208209 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 8527+0+0 (secure 0 0 0) 0x7fe050004760 con 0x55d3c61f54a0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0457fa640 1 -- 172.21.15.70:0/3374208209 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fe05006b050 con 0x55d3c61f54a0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 10 client.18084 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 1 -- 172.21.15.70:0/3374208209 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d3c627a7a0 con 0x55d3c61f54a0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0457fa640 1 -- 172.21.15.70:0/3374208209 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe050031710 con 0x55d3c61f54a0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0457fa640 1 -- 172.21.15.70:0/3374208209 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fe0500447e0 con 0x55d3c61f54a0 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 10 client.18084 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:00.516 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 10 client.18084 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 20 client.18084 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d3c627ae50 0x55d3c627d260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 4 client.18084 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.502+0000 7fe0664c8740 1 -- 172.21.15.70:0/3374208209 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55d3c6162d60 con 0x55d3c627ae50 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.503+0000 7fe06168a640 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d3c627ae50 0x55d3c627d260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.503+0000 7fe06168a640 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d3c627ae50 0x55d3c627d260 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e3f0660fe7bdbb7 server_cookie=5eb25f5ba65d0c54 in_seq=0 out_seq=0 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.503+0000 7fe0457fa640 10 client.18084 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.503+0000 7fe0457fa640 1 -- 172.21.15.70:0/3374208209 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55d3c6162d60 con 0x55d3c627ae50 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.503+0000 7fe0457fa640 10 client.18084 handle_command_reply: tid=0 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.503+0000 7fe0664c8740 1 client.18084 shutdown 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.503+0000 7fe0664c8740 1 -- 172.21.15.70:0/3374208209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 msgr2=0x55d3c6208cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.503+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6208cc0 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7fe0500314b0 tx=0x7fe05003c880 comp rx=0 tx=0).stop 2024-09-19T04:40:00.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 1 -- 172.21.15.70:0/3374208209 shutdown_connections 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d3c627ae50 0x55d3c627d260 crc :-1 s=READY pgs=217 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d3c6200680 0x55d3c6206550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d3c61f5dc0 0x55d3c6206010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 1 --2- 172.21.15.70:0/3374208209 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d3c61f54a0 0x55d3c6208cc0 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0457fa640 0 client.18084 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 1 -- 172.21.15.70:0/3374208209 >> 172.21.15.70:0/3374208209 conn(0x55d3c61f1a30 msgr2=0x55d3c61fea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 1 -- 172.21.15.70:0/3374208209 shutdown_connections 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 1 -- 172.21.15.70:0/3374208209 wait complete. 2024-09-19T04:40:00.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0664c8740 20 client.18084 trim_cache size 0 max 16384 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout: "af897769-c828-4de3-8ba8-bc48557ff303": { 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "af897769-c828-4de3-8ba8-bc48557ff303", 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:40:00.519 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:40:00.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 -- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a3430 msgr2=0x7fe0480a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a3430 0x7fe0480a58f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fe054005c40 tx=0x7fe054009280 comp rx=0 tx=0).stop 2024-09-19T04:40:00.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 -- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102790 msgr2=0x7fe05c198a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:00.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102790 0x7fe05c198a00 secure :-1 s=READY pgs=1270 cs=0 l=1 rev1=1 crypto rx=0x7fe05800c890 tx=0x7fe05800cd50 comp rx=0 tx=0).stop 2024-09-19T04:40:00.520 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 -- 172.21.15.70:0/3287763122 shutdown_connections 2024-09-19T04:40:00.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe0480a3430 0x7fe0480a58f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe05c106f10 0x7fe05c19cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe05c102790 0x7fe05c198a00 unknown :-1 s=CLOSED pgs=1270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 --2- 172.21.15.70:0/3287763122 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe05c101de0 0x7fe05c1984c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:00.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.504+0000 7fe0640ef640 1 -- 172.21.15.70:0/3287763122 >> 172.21.15.70:0/3287763122 conn(0x7fe05c0fd8c0 msgr2=0x7fe05c0fecd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:00.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.505+0000 7fe0640ef640 1 -- 172.21.15.70:0/3287763122 shutdown_connections 2024-09-19T04:40:00.521 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:00.505+0000 7fe0640ef640 1 -- 172.21.15.70:0/3287763122 wait complete. 2024-09-19T04:40:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:00 smithi134 ceph-mon[34525]: overall HEALTH_OK 2024-09-19T04:40:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:00 smithi134 ceph-mon[34525]: pgmap v286: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:01.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:00 smithi070 ceph-mon[30942]: overall HEALTH_OK 2024-09-19T04:40:01.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:00 smithi070 ceph-mon[30942]: pgmap v286: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:01.186 INFO:tasks.cephfs.filesystem:scrub status for tag:af897769-c828-4de3-8ba8-bc48557ff303 - {'path': '/', 'tag': 'af897769-c828-4de3-8ba8-bc48557ff303', 'options': 'recursive,force'} 2024-09-19T04:40:01.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:00 smithi167 ceph-mon[34339]: overall HEALTH_OK 2024-09-19T04:40:01.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:00 smithi167 ceph-mon[34339]: pgmap v286: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:02 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:40:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:02 smithi134 ceph-mon[34525]: pgmap v287: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:40:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:02 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:40:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:02 smithi070 ceph-mon[30942]: pgmap v287: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:40:03.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:02 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:40:03.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:02 smithi167 ceph-mon[34339]: pgmap v287: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:40:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:04 smithi134 ceph-mon[34525]: pgmap v288: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:40:05.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:04 smithi070 ceph-mon[30942]: pgmap v288: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:40:05.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:04 smithi167 ceph-mon[34339]: pgmap v288: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:40:06.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:05 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:06.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:05 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:06.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:05 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:06.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:05 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:40:06.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:05 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:06.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:05 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:06.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:05 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:06.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:05 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:40:06.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:05 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:40:06.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:05 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:40:06.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:05 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:40:06.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:05 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:40:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:06 smithi134 ceph-mon[34525]: pgmap v289: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:40:07.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:06 smithi070 ceph-mon[30942]: pgmap v289: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:40:07.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:06 smithi167 ceph-mon[34339]: pgmap v289: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 44 KiB/s wr, 22 op/s 2024-09-19T04:40:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:08 smithi134 ceph-mon[34525]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:40:09.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:08 smithi134 ceph-mon[34525]: pgmap v291: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:40:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:08 smithi070 ceph-mon[30942]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:40:09.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:08 smithi070 ceph-mon[30942]: pgmap v291: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:40:09.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:08 smithi167 ceph-mon[34339]: osdmap e91: 12 total, 12 up, 12 in 2024-09-19T04:40:09.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:08 smithi167 ceph-mon[34339]: pgmap v291: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:40:11.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:10 smithi134 ceph-mon[34525]: pgmap v292: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:40:11.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:10 smithi070 ceph-mon[30942]: pgmap v292: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:40:11.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:10 smithi167 ceph-mon[34339]: pgmap v292: 97 pgs: 97 active+clean; 241 MiB data, 1.3 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 26 op/s 2024-09-19T04:40:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:12 smithi134 ceph-mon[34525]: pgmap v293: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:13.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:12 smithi070 ceph-mon[30942]: pgmap v293: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:13.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:12 smithi167 ceph-mon[34339]: pgmap v293: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:15 smithi134 ceph-mon[34525]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T04:40:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:15 smithi134 ceph-mon[34525]: pgmap v295: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T04:40:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:15 smithi070 ceph-mon[30942]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T04:40:15.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:15 smithi070 ceph-mon[30942]: pgmap v295: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T04:40:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:15 smithi167 ceph-mon[34339]: osdmap e92: 12 total, 12 up, 12 in 2024-09-19T04:40:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:15 smithi167 ceph-mon[34339]: pgmap v295: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T04:40:17.038 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:16 smithi134 ceph-mon[34525]: pgmap v296: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2024-09-19T04:40:17.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:16 smithi070 ceph-mon[30942]: pgmap v296: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2024-09-19T04:40:17.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:16 smithi167 ceph-mon[34339]: pgmap v296: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 KiB/s rd, 115 B/s wr, 3 op/s 2024-09-19T04:40:19.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:18 smithi134 ceph-mon[34525]: pgmap v297: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:19.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:18 smithi070 ceph-mon[30942]: pgmap v297: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:19.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:18 smithi167 ceph-mon[34339]: pgmap v297: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:21.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:20 smithi134 ceph-mon[34525]: pgmap v298: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:21.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:20 smithi070 ceph-mon[30942]: pgmap v298: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:21.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:20 smithi167 ceph-mon[34339]: pgmap v298: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:40:23.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:22 smithi134 ceph-mon[34525]: pgmap v299: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:40:23.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:22 smithi070 ceph-mon[30942]: pgmap v299: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:40:23.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:22 smithi167 ceph-mon[34339]: pgmap v299: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:40:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:24 smithi134 ceph-mon[34525]: pgmap v300: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:40:25.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:24 smithi070 ceph-mon[30942]: pgmap v300: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:40:25.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:24 smithi167 ceph-mon[34339]: pgmap v300: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:40:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:26 smithi134 ceph-mon[34525]: pgmap v301: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:40:27.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:26 smithi070 ceph-mon[30942]: pgmap v301: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:40:27.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:26 smithi167 ceph-mon[34339]: pgmap v301: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:40:29.013 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:28 smithi167 ceph-mon[34339]: pgmap v302: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:40:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:28 smithi134 ceph-mon[34525]: pgmap v302: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:40:29.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:28 smithi070 ceph-mon[30942]: pgmap v302: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:40:31.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:30 smithi134 ceph-mon[34525]: pgmap v303: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:31.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:30 smithi070 ceph-mon[30942]: pgmap v303: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:31.186 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:40:31.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:30 smithi167 ceph-mon[34339]: pgmap v303: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:31.444 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/891422346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68106a80 msgr2=0x7f0a68106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/891422346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68106a80 0x7f0a68106e60 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7f0a58009930 tx=0x7f0a5802a420 comp rx=0 tx=0).stop 2024-09-19T04:40:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/891422346 shutdown_connections 2024-09-19T04:40:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/891422346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a68101420 0x7f0a6810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.972 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/891422346 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a68100a80 0x7f0a68100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/891422346 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68106a80 0x7f0a68106e60 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/891422346 >> 172.21.15.70:0/891422346 conn(0x7f0a680fc7a0 msgr2=0x7f0a680febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/891422346 shutdown_connections 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/891422346 wait complete. 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.951+0000 7f0a6d9d8640 1 Processor -- start 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a6d9d8640 1 -- start start 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a6d9d8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68100a80 0x7f0a68199320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a6d9d8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a68101420 0x7f0a68199860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a6d9d8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a68106a80 0x7f0a681a43a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.973 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a6d9d8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68110e50 con 0x7f0a68100a80 2024-09-19T04:40:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a6d9d8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68110cd0 con 0x7f0a68101420 2024-09-19T04:40:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a6d9d8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0a68110fd0 con 0x7f0a68106a80 2024-09-19T04:40:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a66ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68100a80 0x7f0a68199320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a66ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68100a80 0x7f0a68199320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36726/0 (socket says 172.21.15.70:36726) 2024-09-19T04:40:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a66ffd640 1 -- 172.21.15.70:0/3065641266 learned_addr learned my addr 172.21.15.70:0/3065641266 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:31.974 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a677fe640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a68106a80 0x7f0a681a43a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a68101420 0x7f0a68199860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a66ffd640 1 -- 172.21.15.70:0/3065641266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a68106a80 msgr2=0x7f0a681a43a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a68106a80 0x7f0a681a43a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a66ffd640 1 -- 172.21.15.70:0/3065641266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a68101420 msgr2=0x7f0a68199860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a68101420 0x7f0a68199860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a66ffd640 1 -- 172.21.15.70:0/3065641266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0a681a48e0 con 0x7f0a68100a80 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.952+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a68101420 0x7f0a68199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.953+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68100a80 0x7f0a68199320 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0a58005940 tx=0x7f0a580042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:31.975 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.953+0000 7f0a6c9d6640 1 -- 172.21.15.70:0/3065641266 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5803f030 con 0x7f0a68100a80 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.953+0000 7f0a6c9d6640 1 -- 172.21.15.70:0/3065641266 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0a58003ac0 con 0x7f0a68100a80 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.953+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/3065641266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0a681a4ab0 con 0x7f0a68100a80 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.953+0000 7f0a6c9d6640 1 -- 172.21.15.70:0/3065641266 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a58035070 con 0x7f0a68100a80 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.953+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/3065641266 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0a681a4f00 con 0x7f0a68100a80 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.955+0000 7f0a6c9d6640 1 -- 172.21.15.70:0/3065641266 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0a58042030 con 0x7f0a68100a80 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6fdb1740 1 Processor -- start 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6fdb1740 1 -- start start 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac664a0 0x560aaac66880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 0x560aaac71140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac71680 0x560aaac73a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.976 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560aaabcc2e0 con 0x560aaac71680 2024-09-19T04:40:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560aaab73ce0 con 0x560aaac664a0 2024-09-19T04:40:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560aaabc82a0 con 0x560aaac66dc0 2024-09-19T04:40:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6c9d6640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0a540a33b0 0x7f0a540a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a5e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac71680 0x560aaac73a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.977 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a5e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac71680 0x560aaac73a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36728/0 (socket says 172.21.15.70:36728) 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/3019252799 learned_addr learned my addr 172.21.15.70:0/3019252799 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a677fe640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0a540a33b0 0x7f0a540a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a677fe640 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac664a0 0x560aaac66880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a6c9d6640 1 -- 172.21.15.70:0/3065641266 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f0a580f0220 con 0x7f0a68100a80 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 0x560aaac71140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/3019252799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 msgr2=0x560aaac71140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 0x560aaac71140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/3019252799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac664a0 msgr2=0x560aaac66880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac664a0 0x560aaac66880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.956+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/3019252799 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aaab58440 con 0x560aaac71680 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.957+0000 7f0a677fe640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0a540a33b0 0x7f0a540a5870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a600098b0 tx=0x7f0a60009d90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:31.978 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.957+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac71680 0x560aaac73a70 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009c20 tx=0x7f0a5000e6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0380cfb9edc3bbd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.957+0000 7f0a5dffb640 1 -- 172.21.15.70:0/3019252799 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50016070 con 0x560aaac71680 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.957+0000 7f0a5dffb640 1 -- 172.21.15.70:0/3019252799 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0a50011940 con 0x560aaac71680 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.957+0000 7f0a5dffb640 1 -- 172.21.15.70:0/3019252799 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50010750 con 0x560aaac71680 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.957+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3019252799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac71680 msgr2=0x560aaac73a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.957+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac71680 0x560aaac73a70 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009c20 tx=0x7f0a5000e6c0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3019252799 shutdown_connections 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac71680 0x560aaac73a70 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 0x560aaac71140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3019252799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac664a0 0x560aaac66880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3019252799 >> 172.21.15.70:0/3019252799 conn(0x560aaac62a30 msgr2=0x560aaac62e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3019252799 shutdown_connections 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3019252799 wait complete. 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 -- start start 2024-09-19T04:40:31.979 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 Processor -- start 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac664a0 0x560aaac70fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 0x560aaac6e250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac6e790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x560aaac74250 con 0x560aaac664a0 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x560aaab87050 con 0x560aaac71680 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x560aaac743d0 con 0x560aaac66dc0 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a6fdb1740 10 client.0 _ll_register_callbacks cb 0x560aaabc7160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.958+0000 7f0a66ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac664a0 0x560aaac70fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.980 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a66ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac664a0 0x560aaac70fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36742/0 (socket says 172.21.15.70:36742) 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a66ffd640 1 -- 172.21.15.70:0/951375983 learned_addr learned my addr 172.21.15.70:0/951375983 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a677fe640 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac6e790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 0x560aaac6e250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a66ffd640 1 -- 172.21.15.70:0/951375983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 msgr2=0x560aaac6e250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 0x560aaac6e250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a66ffd640 1 -- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 msgr2=0x560aaac6e790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac6e790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a66ffd640 1 -- 172.21.15.70:0/951375983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aaa93d3c0 con 0x560aaac664a0 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a677fe640 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac6e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac664a0 0x560aaac70fa0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f0a580bc1a0 tx=0x7f0a580bbfe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=84b2f6236fb1a46c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:31.981 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a46ffd640 1 -- 172.21.15.70:0/951375983 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a580d5060 con 0x560aaac664a0 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/951375983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a50011940 con 0x560aaac664a0 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a46ffd640 1 -- 172.21.15.70:0/951375983 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f0a580edb90 con 0x560aaac664a0 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a46ffd640 1 -- 172.21.15.70:0/951375983 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0a58049040 con 0x560aaac664a0 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a6fdb1740 10 client.18096 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/951375983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560aaac7fbd0 con 0x560aaac664a0 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.959+0000 7f0a46ffd640 1 -- 172.21.15.70:0/951375983 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0a50011940 con 0x560aaac664a0 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a46ffd640 1 -- 172.21.15.70:0/951375983 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0a580c4c80 con 0x560aaac664a0 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a6fdb1740 10 client.18096 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a6fdb1740 10 client.18096 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a6fdb1740 20 client.18096 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560aaac81030 0x560aaac834a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a6fdb1740 4 client.18096 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/951375983 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560aaabd9850 con 0x560aaac81030 2024-09-19T04:40:31.982 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560aaac81030 0x560aaac834a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a46ffd640 10 client.18096 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.960+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560aaac81030 0x560aaac834a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a979701b217af3d5 server_cookie=4322a71e2389f43 in_seq=0 out_seq=0 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a46ffd640 1 -- 172.21.15.70:0/951375983 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x560aaabd9850 con 0x560aaac81030 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a46ffd640 10 client.18096 handle_command_reply: tid=0 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 client.18096 shutdown 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/951375983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac664a0 msgr2=0x560aaac70fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac664a0 0x560aaac70fa0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f0a580bc1a0 tx=0x7f0a580bbfe0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/951375983 shutdown_connections 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560aaac81030 0x560aaac834a0 crc :-1 s=READY pgs=218 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac6e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac66dc0 0x560aaac6e250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.983 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/951375983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac664a0 0x560aaac70fa0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a46ffd640 0 client.18096 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:31.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/951375983 >> 172.21.15.70:0/951375983 conn(0x560aaac62a30 msgr2=0x560aaac68710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:31.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/951375983 shutdown_connections 2024-09-19T04:40:31.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/951375983 wait complete. 2024-09-19T04:40:31.984 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.961+0000 7f0a6fdb1740 20 client.18096 trim_cache size 0 max 16384 2024-09-19T04:40:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a6fdb1740 1 Processor -- start 2024-09-19T04:40:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a6fdb1740 1 -- start start 2024-09-19T04:40:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaac7d4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaac79a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.989 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac79f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681b0060 con 0x560aaac66dc0 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681ad930 con 0x560aaac71680 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681ab7a0 con 0x560aaac664a0 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaac79a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaac79a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36744/0 (socket says 172.21.15.70:36744) 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/1877103001 learned_addr learned my addr 172.21.15.70:0/1877103001 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/1877103001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 msgr2=0x560aaac7d4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaac7d4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a677fe640 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac79f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaac7d4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.990 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/1877103001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 msgr2=0x560aaac79f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac79f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/1877103001 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560aaac83b20 con 0x560aaac66dc0 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaac7d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a677fe640 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac79f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.979+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaac79a00 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000ebc0 tx=0x7f0a500098f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa2fa21431b92a31 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a5d7fa640 1 -- 172.21.15.70:0/1877103001 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5002c020 con 0x560aaac66dc0 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a5d7fa640 1 -- 172.21.15.70:0/1877103001 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0a50004620 con 0x560aaac66dc0 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a5d7fa640 1 -- 172.21.15.70:0/1877103001 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a50016040 con 0x560aaac66dc0 2024-09-19T04:40:31.991 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/1877103001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 msgr2=0x560aaac79a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaac79a00 secure :-1 s=READY pgs=1279 cs=0 l=1 rev1=1 crypto rx=0x7f0a5000ebc0 tx=0x7f0a500098f0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/1877103001 shutdown_connections 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaac79f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaac79a00 unknown :-1 s=CLOSED pgs=1279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/1877103001 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaac7d4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/1877103001 >> 172.21.15.70:0/1877103001 conn(0x560aaac62a30 msgr2=0x560aaac6cb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/1877103001 shutdown_connections 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.980+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/1877103001 wait complete. 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 1 -- start start 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 1 Processor -- start 2024-09-19T04:40:31.992 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaace3d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaace4240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaace47c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681abdf0 con 0x560aaac66dc0 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681ad260 con 0x560aaac71680 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0a681ac4c0 con 0x560aaac664a0 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a6fdb1740 10 client.0 _ll_register_callbacks cb 0x7f0a58005b70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a5e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaace4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a5e7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaace4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:36760/0 (socket says 172.21.15.70:36760) 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/3429644803 learned_addr learned my addr 172.21.15.70:0/3429644803 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaace3d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.981+0000 7f0a677fe640 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaace47c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.993 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/3429644803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 msgr2=0x560aaace3d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaace3d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/3429644803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 msgr2=0x560aaace47c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaace47c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a5e7fc640 1 -- 172.21.15.70:0/3429644803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560aaacef070 con 0x560aaac66dc0 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a5e7fc640 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaace4240 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009f80 tx=0x7f0a50009760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60a4999eaa322eb1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a46ffd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a46ffd640 1 -- 172.21.15.70:0/3429644803 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0a5002c050 con 0x560aaac66dc0 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a46ffd640 1 -- 172.21.15.70:0/3429644803 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f0a50005450 con 0x560aaac66dc0 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3429644803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0a50004620 con 0x560aaac66dc0 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a46ffd640 1 -- 172.21.15.70:0/3429644803 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f0a5003f050 con 0x560aaac66dc0 2024-09-19T04:40:31.994 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a6fdb1740 10 client.18102 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:31.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3429644803 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x560aaacf02f0 con 0x560aaac66dc0 2024-09-19T04:40:31.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a46ffd640 1 -- 172.21.15.70:0/3429644803 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0a50004620 con 0x560aaac66dc0 2024-09-19T04:40:31.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.982+0000 7f0a46ffd640 1 -- 172.21.15.70:0/3429644803 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f0a5000f040 con 0x560aaac66dc0 2024-09-19T04:40:31.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a6fdb1740 10 client.18102 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:31.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a6fdb1740 10 client.18102 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:31.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a6fdb1740 20 client.18102 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:31.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560aaacf0840 0x560aaacf2c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:31.995 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a6fdb1740 4 client.18102 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3429644803 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x560aaabd3d60 con 0x560aaacf0840 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560aaacf0840 0x560aaacf2c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a46ffd640 10 client.18102 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a66ffd640 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560aaacf0840 0x560aaacf2c60 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c3b1104eac8a3b69 server_cookie=ddb437d3cead132f in_seq=0 out_seq=0 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a46ffd640 1 -- 172.21.15.70:0/3429644803 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x560aaabd3d60 con 0x560aaacf0840 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a46ffd640 10 client.18102 handle_command_reply: tid=0 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.983+0000 7f0a6fdb1740 1 client.18102 shutdown 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3429644803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 msgr2=0x560aaace4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaace4240 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f0a50009f80 tx=0x7f0a50009760 comp rx=0 tx=0).stop 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3429644803 shutdown_connections 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x560aaacf0840 0x560aaacf2c60 crc :-1 s=READY pgs=219 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x560aaac71680 0x560aaace47c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.996 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a46ffd640 0 client.18102 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:31.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x560aaac66dc0 0x560aaace4240 unknown :-1 s=CLOSED pgs=1280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 --2- 172.21.15.70:0/3429644803 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x560aaac664a0 0x560aaace3d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:31.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3429644803 >> 172.21.15.70:0/3429644803 conn(0x560aaac62a30 msgr2=0x560aaac61350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:31.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3429644803 shutdown_connections 2024-09-19T04:40:31.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 1 -- 172.21.15.70:0/3429644803 wait complete. 2024-09-19T04:40:31.997 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6fdb1740 20 client.18102 trim_cache size 0 max 16384 2024-09-19T04:40:31.997 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:40:31.998 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:40:31.998 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:40:31.998 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:40:32.000 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0a540a33b0 msgr2=0x7f0a540a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0a540a33b0 0x7f0a540a5870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f0a600098b0 tx=0x7f0a60009d90 comp rx=0 tx=0).stop 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68100a80 msgr2=0x7f0a68199320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68100a80 0x7f0a68199320 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7f0a58005940 tx=0x7f0a580042f0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/3065641266 shutdown_connections 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0a540a33b0 0x7f0a540a5870 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0a68106a80 0x7f0a681a43a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0a68101420 0x7f0a68199860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 --2- 172.21.15.70:0/3065641266 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0a68100a80 0x7f0a68199320 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.984+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/3065641266 >> 172.21.15.70:0/3065641266 conn(0x7f0a680fc7a0 msgr2=0x7f0a680fd0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.985+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/3065641266 shutdown_connections 2024-09-19T04:40:32.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:31.985+0000 7f0a6d9d8640 1 -- 172.21.15.70:0/3065641266 wait complete. 2024-09-19T04:40:32.741 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:40:32.742 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:40:32.988 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:33.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:32 smithi134 ceph-mon[34525]: pgmap v304: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:33.108 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:32 smithi070 ceph-mon[30942]: pgmap v304: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:33.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:32 smithi167 ceph-mon[34339]: pgmap v304: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:33.500 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 -- 172.21.15.70:0/768140596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8102570 msgr2=0x7f45e81029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:33.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 --2- 172.21.15.70:0/768140596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8102570 0x7f45e81029b0 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f45d0009900 tx=0x7f45d002a480 comp rx=0 tx=0).stop 2024-09-19T04:40:33.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 -- 172.21.15.70:0/768140596 shutdown_connections 2024-09-19T04:40:33.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 --2- 172.21.15.70:0/768140596 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45e8102ef0 0x7f45e810da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 --2- 172.21.15.70:0/768140596 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8102570 0x7f45e81029b0 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 --2- 172.21.15.70:0/768140596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e8100e20 0x7f45e8101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 -- 172.21.15.70:0/768140596 >> 172.21.15.70:0/768140596 conn(0x7f45e80fc7d0 msgr2=0x7f45e80febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:33.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 -- 172.21.15.70:0/768140596 shutdown_connections 2024-09-19T04:40:33.501 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 -- 172.21.15.70:0/768140596 wait complete. 2024-09-19T04:40:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.499+0000 7f45ed608640 1 Processor -- start 2024-09-19T04:40:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45ed608640 1 -- start start 2024-09-19T04:40:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45ed608640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8100e20 0x7f45e81984e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45ed608640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e8102570 0x7f45e8198a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45ed608640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45e8102ef0 0x7f45e819cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:33.503 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45ed608640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f45e8110f50 con 0x7f45e8100e20 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45ed608640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f45e8110dd0 con 0x7f45e8102570 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45ed608640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f45e81110d0 con 0x7f45e8102ef0 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8100e20 0x7f45e81984e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e6ffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8100e20 0x7f45e81984e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43826/0 (socket says 172.21.15.70:43826) 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e6ffd640 1 -- 172.21.15.70:0/2046960679 learned_addr learned my addr 172.21.15.70:0/2046960679 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e77fe640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45e8102ef0 0x7f45e819cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e67fc640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e8102570 0x7f45e8198a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e6ffd640 1 -- 172.21.15.70:0/2046960679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45e8102ef0 msgr2=0x7f45e819cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e6ffd640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45e8102ef0 0x7f45e819cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e6ffd640 1 -- 172.21.15.70:0/2046960679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e8102570 msgr2=0x7f45e8198a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e6ffd640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e8102570 0x7f45e8198a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.504 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.500+0000 7f45e6ffd640 1 -- 172.21.15.70:0/2046960679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45e819d490 con 0x7f45e8100e20 2024-09-19T04:40:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.501+0000 7f45e6ffd640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8100e20 0x7f45e81984e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f45e000cce0 tx=0x7f45e000a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.501+0000 7f45dffff640 1 -- 172.21.15.70:0/2046960679 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e0004b20 con 0x7f45e8100e20 2024-09-19T04:40:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.501+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45e819d780 con 0x7f45e8100e20 2024-09-19T04:40:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.501+0000 7f45dffff640 1 -- 172.21.15.70:0/2046960679 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f45e0004cc0 con 0x7f45e8100e20 2024-09-19T04:40:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.501+0000 7f45dffff640 1 -- 172.21.15.70:0/2046960679 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45e000f740 con 0x7f45e8100e20 2024-09-19T04:40:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.501+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45e80fcbb0 con 0x7f45e8100e20 2024-09-19T04:40:33.505 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.502+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45e8101200 con 0x7f45e8100e20 2024-09-19T04:40:33.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.503+0000 7f45dffff640 1 -- 172.21.15.70:0/2046960679 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f45e0005020 con 0x7f45e8100e20 2024-09-19T04:40:33.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.503+0000 7f45dffff640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45d40a33b0 0x7f45d40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:33.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.504+0000 7f45e67fc640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45d40a33b0 0x7f45d40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:33.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.504+0000 7f45dffff640 1 -- 172.21.15.70:0/2046960679 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f45e00cfd80 con 0x7f45e8100e20 2024-09-19T04:40:33.506 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.504+0000 7f45e67fc640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45d40a33b0 0x7f45d40a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45d002a9a0 tx=0x7f45d0000bc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:33.509 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.508+0000 7f45dffff640 1 -- 172.21.15.70:0/2046960679 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f45e0014030 con 0x7f45e8100e20 2024-09-19T04:40:33.709 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.708+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f45e80fced0 con 0x7f45e8100e20 2024-09-19T04:40:33.710 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.709+0000 7f45dffff640 1 -- 172.21.15.70:0/2046960679 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f45e009c760 con 0x7f45e8100e20 2024-09-19T04:40:33.710 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:40:33.711 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:40:33.711 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:40:33.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45d40a33b0 msgr2=0x7f45d40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:33.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45d40a33b0 0x7f45d40a5870 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f45d002a9a0 tx=0x7f45d0000bc0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.712 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8100e20 msgr2=0x7f45e81984e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8100e20 0x7f45e81984e0 secure :-1 s=READY pgs=1282 cs=0 l=1 rev1=1 crypto rx=0x7f45e000cce0 tx=0x7f45e000a620 comp rx=0 tx=0).stop 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 shutdown_connections 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f45d40a33b0 0x7f45d40a5870 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f45e8102ef0 0x7f45e819cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45e8102570 0x7f45e8198a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 --2- 172.21.15.70:0/2046960679 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f45e8100e20 0x7f45e81984e0 unknown :-1 s=CLOSED pgs=1282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 >> 172.21.15.70:0/2046960679 conn(0x7f45e80fc7d0 msgr2=0x7f45e8069f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 shutdown_connections 2024-09-19T04:40:33.713 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:33.711+0000 7f45ed608640 1 -- 172.21.15.70:0/2046960679 wait complete. 2024-09-19T04:40:34.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:33 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2046960679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:40:34.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:33 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2046960679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:40:34.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:33 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2046960679' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:40:34.346 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:40:34.591 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:34.995 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:34 smithi070 ceph-mon[30942]: pgmap v305: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:35.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:34 smithi134 ceph-mon[34525]: pgmap v305: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:35.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 -- 172.21.15.70:0/2900490629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 msgr2=0x7f3450106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.087 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 --2- 172.21.15.70:0/2900490629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 0x7f3450106e60 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7f344c009930 tx=0x7f344c02a420 comp rx=0 tx=0).stop 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 -- 172.21.15.70:0/2900490629 shutdown_connections 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 --2- 172.21.15.70:0/2900490629 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3450101420 0x7f345010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 --2- 172.21.15.70:0/2900490629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3450100a80 0x7f3450100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 --2- 172.21.15.70:0/2900490629 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 0x7f3450106e60 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 -- 172.21.15.70:0/2900490629 >> 172.21.15.70:0/2900490629 conn(0x7f34500fc7a0 msgr2=0x7f34500febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 -- 172.21.15.70:0/2900490629 shutdown_connections 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.072+0000 7f3456d1d640 1 -- 172.21.15.70:0/2900490629 wait complete. 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3456d1d640 1 Processor -- start 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3456d1d640 1 -- start start 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3456d1d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3450100a80 0x7f3450197330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3456d1d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3450101420 0x7f3450197870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.088 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3456d1d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 0x7f345019bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3456d1d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3450110e10 con 0x7f3450106a80 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3456d1d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3450110c90 con 0x7f3450100a80 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3456d1d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3450110f90 con 0x7f3450101420 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f34552ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 0x7f345019bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f34552ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 0x7f345019bc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43844/0 (socket says 172.21.15.70:43844) 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f34552ba640 1 -- 172.21.15.70:0/4112731309 learned_addr learned my addr 172.21.15.70:0/4112731309 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.073+0000 7f3447fff640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3450101420 0x7f3450197870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f3454ab9640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3450100a80 0x7f3450197330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f34552ba640 1 -- 172.21.15.70:0/4112731309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3450101420 msgr2=0x7f3450197870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f34552ba640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3450101420 0x7f3450197870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f34552ba640 1 -- 172.21.15.70:0/4112731309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3450100a80 msgr2=0x7f3450197330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.089 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f34552ba640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3450100a80 0x7f3450197330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f34552ba640 1 -- 172.21.15.70:0/4112731309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f345019c2e0 con 0x7f3450106a80 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f34552ba640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 0x7f345019bc00 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f344800eaa0 tx=0x7f344800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f3445ffb640 1 -- 172.21.15.70:0/4112731309 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344800cdb0 con 0x7f3450106a80 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f3445ffb640 1 -- 172.21.15.70:0/4112731309 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f3448005020 con 0x7f3450106a80 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f3445ffb640 1 -- 172.21.15.70:0/4112731309 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480116b0 con 0x7f3450106a80 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f3456d1d640 1 -- 172.21.15.70:0/4112731309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f345019c5d0 con 0x7f3450106a80 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.074+0000 7f3456d1d640 1 -- 172.21.15.70:0/4112731309 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f345006a790 con 0x7f3450106a80 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.076+0000 7f3445ffb640 1 -- 172.21.15.70:0/4112731309 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f34480051d0 con 0x7f3450106a80 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34590f6740 1 Processor -- start 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34590f6740 1 -- start start 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34590f6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52c7090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f3445ffb640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34380a33b0 0x7f34380a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.090 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34590f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c75d0 0x5633f52c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34590f6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52d2370 0x5633f52d4760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34590f6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5633f522d2f0 con 0x5633f52d2370 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34590f6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5633f51d4cf0 con 0x5633f52c8b40 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34590f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5633f52292b0 con 0x5633f52c75d0 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34552ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52d2370 0x5633f52d4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f3454ab9640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34380a33b0 0x7f34380a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34552ba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52d2370 0x5633f52d4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43856/0 (socket says 172.21.15.70:43856) 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34552ba640 1 -- 172.21.15.70:0/20911860 learned_addr learned my addr 172.21.15.70:0/20911860 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f3445ffb640 1 -- 172.21.15.70:0/4112731309 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f34480cff80 con 0x7f3450106a80 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f3447fff640 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f3447fff640 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c75d0 0x5633f52c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.091 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34552ba640 1 -- 172.21.15.70:0/20911860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c75d0 msgr2=0x5633f52c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34552ba640 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c75d0 0x5633f52c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34552ba640 1 -- 172.21.15.70:0/20911860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 msgr2=0x5633f52c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34552ba640 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f34552ba640 1 -- 172.21.15.70:0/20911860 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f51b93a0 con 0x5633f52d2370 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.077+0000 7f3447fff640 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c75d0 0x5633f52c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.078+0000 7f3454ab9640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34380a33b0 0x7f34380a5870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f344c000c00 tx=0x7f344c005a20 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.078+0000 7f34552ba640 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52d2370 0x5633f52d4760 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f34480092f0 tx=0x7f344806be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9519f7f3e365ed04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.078+0000 7f3436ffd640 1 -- 172.21.15.70:0/20911860 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34480aef20 con 0x5633f52d2370 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.078+0000 7f3436ffd640 1 -- 172.21.15.70:0/20911860 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f34480055d0 con 0x5633f52d2370 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.078+0000 7f3436ffd640 1 -- 172.21.15.70:0/20911860 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344801e170 con 0x5633f52d2370 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.078+0000 7f34590f6740 1 -- 172.21.15.70:0/20911860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52d2370 msgr2=0x5633f52d4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.092 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.078+0000 7f34590f6740 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52d2370 0x5633f52d4760 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f34480092f0 tx=0x7f344806be20 comp rx=0 tx=0).stop 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 -- 172.21.15.70:0/20911860 shutdown_connections 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52d2370 0x5633f52d4760 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c75d0 0x5633f52c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 --2- 172.21.15.70:0/20911860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 -- 172.21.15.70:0/20911860 >> 172.21.15.70:0/20911860 conn(0x5633f5290310 msgr2=0x5633f52c3c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 -- 172.21.15.70:0/20911860 shutdown_connections 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 -- 172.21.15.70:0/20911860 wait complete. 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 -- start start 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 Processor -- start 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52d1d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 0x5633f52cf5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5633f52d4fb0 con 0x5633f52c75d0 2024-09-19T04:40:35.093 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5633f51e8060 con 0x5633f52c8b40 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5633f52d5130 con 0x5633f52d2370 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f34590f6740 10 client.0 _ll_register_callbacks cb 0x5633f4f3b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f3454ab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52d1d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f3454ab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52d1d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43872/0 (socket says 172.21.15.70:43872) 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.079+0000 7f3454ab9640 1 -- 172.21.15.70:0/288885777 learned_addr learned my addr 172.21.15.70:0/288885777 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f3447fff640 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f34552ba640 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 0x5633f52cf5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f3454ab9640 1 -- 172.21.15.70:0/288885777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 msgr2=0x5633f52cf5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f3454ab9640 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 0x5633f52cf5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f3454ab9640 1 -- 172.21.15.70:0/288885777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 msgr2=0x5633f52cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f3454ab9640 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.094 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f3454ab9640 1 -- 172.21.15.70:0/288885777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f4f9e3c0 con 0x5633f52c75d0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f3447fff640 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f3454ab9640 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52d1d30 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f344c033000 tx=0x7f344c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=47d7dbf3b9f47f2d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f342ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f342ffff640 1 -- 172.21.15.70:0/288885777 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c04b070 con 0x5633f52c75d0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f342ffff640 1 -- 172.21.15.70:0/288885777 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f344c003af0 con 0x5633f52c75d0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f34590f6740 1 -- 172.21.15.70:0/288885777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5633f523a860 con 0x5633f52c75d0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f342ffff640 1 -- 172.21.15.70:0/288885777 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f344c057050 con 0x5633f52c75d0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f34590f6740 10 client.18120 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.080+0000 7f34590f6740 1 -- 172.21.15.70:0/288885777 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633f52e0a10 con 0x5633f52c75d0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f342ffff640 1 -- 172.21.15.70:0/288885777 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x5633f523a860 con 0x5633f52c75d0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f342ffff640 1 -- 172.21.15.70:0/288885777 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f344c047bf0 con 0x5633f52c75d0 2024-09-19T04:40:35.095 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f34590f6740 10 client.18120 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f34590f6740 10 client.18120 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f34590f6740 20 client.18120 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f34590f6740 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5633f52e1e70 0x5633f52e42b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f34590f6740 4 client.18120 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f34590f6740 1 -- 172.21.15.70:0/288885777 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5633f5234d70 con 0x5633f52e1e70 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.081+0000 7f3447fff640 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5633f52e1e70 0x5633f52e42b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.082+0000 7f342ffff640 10 client.18120 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.082+0000 7f3447fff640 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5633f52e1e70 0x5633f52e42b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=e8a8357253fc89bc server_cookie=6372d2c4810d288e in_seq=0 out_seq=0 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.082+0000 7f342ffff640 1 -- 172.21.15.70:0/288885777 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x5633f5234d70 con 0x5633f52e1e70 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.082+0000 7f342ffff640 10 client.18120 handle_command_reply: tid=0 2024-09-19T04:40:35.096 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.082+0000 7f34590f6740 1 client.18120 shutdown 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.082+0000 7f34590f6740 1 -- 172.21.15.70:0/288885777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 msgr2=0x5633f52d1d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52d1d30 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f344c033000 tx=0x7f344c009260 comp rx=0 tx=0).stop 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 -- 172.21.15.70:0/288885777 shutdown_connections 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5633f52e1e70 0x5633f52e42b0 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 0x5633f52cf5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f52cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 --2- 172.21.15.70:0/288885777 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52d1d30 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f342ffff640 0 client.18120 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:40:35.097 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 -- 172.21.15.70:0/288885777 >> 172.21.15.70:0/288885777 conn(0x5633f5290310 msgr2=0x5633f52c9990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 -- 172.21.15.70:0/288885777 shutdown_connections 2024-09-19T04:40:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 1 -- 172.21.15.70:0/288885777 wait complete. 2024-09-19T04:40:35.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.083+0000 7f34590f6740 20 client.18120 trim_cache size 0 max 16384 2024-09-19T04:40:35.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34590f6740 1 Processor -- start 2024-09-19T04:40:35.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34590f6740 1 -- start start 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34590f6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52cefb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34590f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c8b40 0x5633f52de250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34590f6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52d2370 0x5633f52e9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34590f6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34501b0200 con 0x5633f52c75d0 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34590f6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34501adad0 con 0x5633f52d2370 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34590f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34501ab940 con 0x5633f52c8b40 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52cefb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52cefb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43878/0 (socket says 172.21.15.70:43878) 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 -- 172.21.15.70:0/1685298647 learned_addr learned my addr 172.21.15.70:0/1685298647 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3447fff640 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c8b40 0x5633f52de250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 -- 172.21.15.70:0/1685298647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c8b40 msgr2=0x5633f52de250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:35.104 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c8b40 0x5633f52de250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34552ba640 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52d2370 0x5633f52e9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 -- 172.21.15.70:0/1685298647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52d2370 msgr2=0x5633f52e9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52d2370 0x5633f52e9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 -- 172.21.15.70:0/1685298647 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5633f52d2060 con 0x5633f52c75d0 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3447fff640 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c8b40 0x5633f52de250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f34552ba640 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52d2370 0x5633f52e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.096+0000 7f3454ab9640 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52cefb0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f344c02a460 tx=0x7f344c009520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36ef7d3c6e522cf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34367fc640 1 -- 172.21.15.70:0/1685298647 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c04b040 con 0x5633f52c75d0 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34367fc640 1 -- 172.21.15.70:0/1685298647 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f344c03b5f0 con 0x5633f52c75d0 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34367fc640 1 -- 172.21.15.70:0/1685298647 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c035050 con 0x5633f52c75d0 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 -- 172.21.15.70:0/1685298647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 msgr2=0x5633f52cefb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.105 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52cefb0 secure :-1 s=READY pgs=1287 cs=0 l=1 rev1=1 crypto rx=0x7f344c02a460 tx=0x7f344c009520 comp rx=0 tx=0).stop 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 -- 172.21.15.70:0/1685298647 shutdown_connections 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52d2370 0x5633f52e9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52c8b40 0x5633f52de250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 --2- 172.21.15.70:0/1685298647 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f52cefb0 unknown :-1 s=CLOSED pgs=1287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 -- 172.21.15.70:0/1685298647 >> 172.21.15.70:0/1685298647 conn(0x5633f5290310 msgr2=0x5633f52ce8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 -- 172.21.15.70:0/1685298647 shutdown_connections 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.097+0000 7f34590f6740 1 -- 172.21.15.70:0/1685298647 wait complete. 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 1 -- start start 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 1 Processor -- start 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f53452b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f53457f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 0x5633f52d93b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.106 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f34501abf90 con 0x5633f52c75d0 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f34501ad400 con 0x5633f52c8b40 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f34501ac660 con 0x5633f52d2370 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f3454ab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f53452b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f34590f6740 10 client.0 _ll_register_callbacks cb 0x7f344c0318d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f3454ab9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f53452b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43888/0 (socket says 172.21.15.70:43888) 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f3454ab9640 1 -- 172.21.15.70:0/3923900889 learned_addr learned my addr 172.21.15.70:0/3923900889 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.098+0000 7f3447fff640 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f53457f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f34552ba640 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 0x5633f52d93b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f3454ab9640 1 -- 172.21.15.70:0/3923900889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 msgr2=0x5633f52d93b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f3454ab9640 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 0x5633f52d93b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f3454ab9640 1 -- 172.21.15.70:0/3923900889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 msgr2=0x5633f53457f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f3454ab9640 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f53457f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f3454ab9640 1 -- 172.21.15.70:0/3923900889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5633f52d9970 con 0x5633f52c75d0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f3454ab9640 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f53452b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f344c031ae0 tx=0x7f344c003e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d749ae4cef9adb7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f342ffff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f342ffff640 1 -- 172.21.15.70:0/3923900889 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f344c035040 con 0x5633f52c75d0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f34590f6740 1 -- 172.21.15.70:0/3923900889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f344c03b5f0 con 0x5633f52c75d0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f342ffff640 1 -- 172.21.15.70:0/3923900889 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f344c03b9a0 con 0x5633f52c75d0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f342ffff640 1 -- 172.21.15.70:0/3923900889 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f344c071050 con 0x5633f52c75d0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f34590f6740 10 client.18126 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f34590f6740 1 -- 172.21.15.70:0/3923900889 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5633f52dabc0 con 0x5633f52c75d0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.099+0000 7f342ffff640 1 -- 172.21.15.70:0/3923900889 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f344c03b5f0 con 0x5633f52c75d0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f342ffff640 1 -- 172.21.15.70:0/3923900889 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f344c06c030 con 0x5633f52c75d0 2024-09-19T04:40:35.108 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f34590f6740 10 client.18126 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f34590f6740 10 client.18126 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f34590f6740 20 client.18126 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f34590f6740 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5633f5350fb0 0x5633f53533a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f34590f6740 4 client.18126 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f34590f6740 1 -- 172.21.15.70:0/3923900889 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x5633f51b1170 con 0x5633f5350fb0 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f3447fff640 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5633f5350fb0 0x5633f53533a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f342ffff640 10 client.18126 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.100+0000 7f3447fff640 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5633f5350fb0 0x5633f53533a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=46afc998e2fa9eaf server_cookie=49583136d4ae6f15 in_seq=0 out_seq=0 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f342ffff640 1 -- 172.21.15.70:0/3923900889 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x5633f51b1170 con 0x5633f5350fb0 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f342ffff640 10 client.18126 handle_command_reply: tid=0 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 client.18126 shutdown 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 -- 172.21.15.70:0/3923900889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 msgr2=0x5633f53452b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f53452b0 secure :-1 s=READY pgs=1288 cs=0 l=1 rev1=1 crypto rx=0x7f344c031ae0 tx=0x7f344c003e70 comp rx=0 tx=0).stop 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 -- 172.21.15.70:0/3923900889 shutdown_connections 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x5633f5350fb0 0x5633f53533a0 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5633f52d2370 0x5633f52d93b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5633f52c8b40 0x5633f53457f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 --2- 172.21.15.70:0/3923900889 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5633f52c75d0 0x5633f53452b0 unknown :-1 s=CLOSED pgs=1288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f342ffff640 0 client.18126 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 -- 172.21.15.70:0/3923900889 >> 172.21.15.70:0/3923900889 conn(0x5633f5290310 msgr2=0x5633f52c9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 -- 172.21.15.70:0/3923900889 shutdown_connections 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 1 -- 172.21.15.70:0/3923900889 wait complete. 2024-09-19T04:40:35.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.101+0000 7f34590f6740 20 client.18126 trim_cache size 0 max 16384 2024-09-19T04:40:35.111 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:40:35.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 -- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34380a33b0 msgr2=0x7f34380a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34380a33b0 0x7f34380a5870 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f344c000c00 tx=0x7f344c005a20 comp rx=0 tx=0).stop 2024-09-19T04:40:35.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 -- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 msgr2=0x7f345019bc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:35.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 0x7f345019bc00 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7f344800eaa0 tx=0x7f344800ef60 comp rx=0 tx=0).stop 2024-09-19T04:40:35.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 -- 172.21.15.70:0/4112731309 shutdown_connections 2024-09-19T04:40:35.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34380a33b0 0x7f34380a5870 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3450106a80 0x7f345019bc00 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3450101420 0x7f3450197870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 --2- 172.21.15.70:0/4112731309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3450100a80 0x7f3450197330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:35.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 -- 172.21.15.70:0/4112731309 >> 172.21.15.70:0/4112731309 conn(0x7f34500fc7a0 msgr2=0x7f34500fcfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:35.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 -- 172.21.15.70:0/4112731309 shutdown_connections 2024-09-19T04:40:35.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:35.102+0000 7f3456d1d640 1 -- 172.21.15.70:0/4112731309 wait complete. 2024-09-19T04:40:35.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:34 smithi167 ceph-mon[34339]: pgmap v305: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:35.829 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:40:36.076 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:36.560 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 -- 172.21.15.70:0/4098203574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38100a80 msgr2=0x7ffb38100ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 --2- 172.21.15.70:0/4098203574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38100a80 0x7ffb38100ee0 secure :-1 s=READY pgs=1289 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c009930 tx=0x7ffb2c02a420 comp rx=0 tx=0).stop 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 -- 172.21.15.70:0/4098203574 shutdown_connections 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 --2- 172.21.15.70:0/4098203574 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb38101420 0x7ffb3810d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 --2- 172.21.15.70:0/4098203574 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38100a80 0x7ffb38100ee0 unknown :-1 s=CLOSED pgs=1289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 --2- 172.21.15.70:0/4098203574 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb38106a80 0x7ffb38106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 -- 172.21.15.70:0/4098203574 >> 172.21.15.70:0/4098203574 conn(0x7ffb380fc7a0 msgr2=0x7ffb380febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 -- 172.21.15.70:0/4098203574 shutdown_connections 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.557+0000 7ffb3e907640 1 -- 172.21.15.70:0/4098203574 wait complete. 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3e907640 1 Processor -- start 2024-09-19T04:40:36.561 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3e907640 1 -- start start 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3e907640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb38100a80 0x7ffb380fce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3e907640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb38101420 0x7ffb380fd390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3e907640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38106a80 0x7ffb380fd8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3e907640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb38110f10 con 0x7ffb38106a80 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3e907640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb38110d90 con 0x7ffb38100a80 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3e907640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb38111090 con 0x7ffb38101420 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3cea4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38106a80 0x7ffb380fd8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3cea4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38106a80 0x7ffb380fd8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43906/0 (socket says 172.21.15.70:43906) 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb3cea4640 1 -- 172.21.15.70:0/3621281775 learned_addr learned my addr 172.21.15.70:0/3621281775 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb37fff640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb38100a80 0x7ffb380fce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.558+0000 7ffb377fe640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb38101420 0x7ffb380fd390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.562 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb3cea4640 1 -- 172.21.15.70:0/3621281775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb38101420 msgr2=0x7ffb380fd390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb3cea4640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb38101420 0x7ffb380fd390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb3cea4640 1 -- 172.21.15.70:0/3621281775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb38100a80 msgr2=0x7ffb380fce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb3cea4640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb38100a80 0x7ffb380fce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb3cea4640 1 -- 172.21.15.70:0/3621281775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb381a6a90 con 0x7ffb38106a80 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb3cea4640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38106a80 0x7ffb380fd8d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000b970 tx=0x7ffb3000bd70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb357fa640 1 -- 172.21.15.70:0/3621281775 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb30019070 con 0x7ffb38106a80 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb3e907640 1 -- 172.21.15.70:0/3621281775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb381a6d80 con 0x7ffb38106a80 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb357fa640 1 -- 172.21.15.70:0/3621281775 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ffb30014440 con 0x7ffb38106a80 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb357fa640 1 -- 172.21.15.70:0/3621281775 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb300075d0 con 0x7ffb38106a80 2024-09-19T04:40:36.563 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.559+0000 7ffb3e907640 1 -- 172.21.15.70:0/3621281775 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb381a7290 con 0x7ffb38106a80 2024-09-19T04:40:36.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.561+0000 7ffb357fa640 1 -- 172.21.15.70:0/3621281775 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ffb3001c070 con 0x7ffb38106a80 2024-09-19T04:40:36.568 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb40ce0740 1 Processor -- start 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb40ce0740 1 -- start start 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x564840086090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648400865d0 0x564840086a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840091370 0x564840093760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x56483ffec2f0 con 0x564840091370 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56483ff93cf0 con 0x5648400865d0 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x56483ffe82b0 con 0x564840087b40 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840091370 0x564840093760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840091370 0x564840093760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43922/0 (socket says 172.21.15.70:43922) 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb377fe640 1 -- 172.21.15.70:0/4234674383 learned_addr learned my addr 172.21.15.70:0/4234674383 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb357fa640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ffb200a33b0 0x7ffb200a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.569 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb37fff640 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648400865d0 0x564840086a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb377fe640 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x564840086090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.562+0000 7ffb3cea4640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ffb200a33b0 0x7ffb200a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb377fe640 1 -- 172.21.15.70:0/4234674383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 msgr2=0x564840086090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb377fe640 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x564840086090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb377fe640 1 -- 172.21.15.70:0/4234674383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648400865d0 msgr2=0x564840086a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb377fe640 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648400865d0 0x564840086a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb377fe640 1 -- 172.21.15.70:0/4234674383 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56483ff783a0 con 0x564840091370 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb357fa640 1 -- 172.21.15.70:0/3621281775 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7ffb300cf0e0 con 0x7ffb38106a80 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb37fff640 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648400865d0 0x564840086a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb377fe640 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840091370 0x564840093760 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c006010 tx=0x7ffb2c005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef058a2f6d54078b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb3cea4640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ffb200a33b0 0x7ffb200a5870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffb30097980 tx=0x7ffb3006e350 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:36.570 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb1e7fc640 1 -- 172.21.15.70:0/4234674383 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c035070 con 0x564840091370 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb1e7fc640 1 -- 172.21.15.70:0/4234674383 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ffb2c031980 con 0x564840091370 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.563+0000 7ffb1e7fc640 1 -- 172.21.15.70:0/4234674383 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c004b20 con 0x564840091370 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 -- 172.21.15.70:0/4234674383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840091370 msgr2=0x564840093760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840091370 0x564840093760 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c006010 tx=0x7ffb2c005c00 comp rx=0 tx=0).stop 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 -- 172.21.15.70:0/4234674383 shutdown_connections 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840091370 0x564840093760 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5648400865d0 0x564840086a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/4234674383 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x564840086090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 -- 172.21.15.70:0/4234674383 >> 172.21.15.70:0/4234674383 conn(0x56484004f310 msgr2=0x564840082c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 -- 172.21.15.70:0/4234674383 shutdown_connections 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 -- 172.21.15.70:0/4234674383 wait complete. 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 -- start start 2024-09-19T04:40:36.571 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.564+0000 7ffb40ce0740 1 Processor -- start 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840090d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x56484008dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x56484008e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564840094010 con 0x5648400865d0 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x56483ffa7060 con 0x564840091370 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564840094190 con 0x564840087b40 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb40ce0740 10 client.0 _ll_register_callbacks cb 0x56483fcfa8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840090d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840090d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43926/0 (socket says 172.21.15.70:43926) 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 -- 172.21.15.70:0/3152685062 learned_addr learned my addr 172.21.15.70:0/3152685062 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:36.572 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x56484008e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 -- 172.21.15.70:0/3152685062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 msgr2=0x56484008dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x56484008dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 -- 172.21.15.70:0/3152685062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 msgr2=0x56484008e5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x56484008e5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 -- 172.21.15.70:0/3152685062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56483fd5d3c0 con 0x5648400865d0 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb377fe640 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840090d30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c004650 tx=0x7ffb2c004590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=410e28e20d04c0a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb177fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.565+0000 7ffb177fe640 1 -- 172.21.15.70:0/3152685062 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c056060 con 0x5648400865d0 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb177fe640 1 -- 172.21.15.70:0/3152685062 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7ffb2c03eba0 con 0x5648400865d0 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3152685062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb2c031980 con 0x5648400865d0 2024-09-19T04:40:36.573 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb177fe640 1 -- 172.21.15.70:0/3152685062 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffb2c035070 con 0x5648400865d0 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 10 client.18138 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3152685062 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564840094010 con 0x5648400865d0 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb177fe640 1 -- 172.21.15.70:0/3152685062 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ffb2c031980 con 0x5648400865d0 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb177fe640 1 -- 172.21.15.70:0/3152685062 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffb2c048020 con 0x5648400865d0 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 10 client.18138 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 10 client.18138 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 20 client.18138 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5648400a0c20 0x5648400a3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 4 client.18138 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.566+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3152685062 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56483fff9860 con 0x5648400a0c20 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.567+0000 7ffb37fff640 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5648400a0c20 0x5648400a3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.567+0000 7ffb37fff640 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5648400a0c20 0x5648400a3010 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ec8dfcdc09737060 server_cookie=e5dbffef05930600 in_seq=0 out_seq=0 2024-09-19T04:40:36.574 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.567+0000 7ffb177fe640 10 client.18138 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb177fe640 1 -- 172.21.15.70:0/3152685062 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x56483fff9860 con 0x5648400a0c20 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb177fe640 10 client.18138 handle_command_reply: tid=0 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 client.18138 shutdown 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3152685062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 msgr2=0x564840090d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840090d30 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c004650 tx=0x7ffb2c004590 comp rx=0 tx=0).stop 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3152685062 shutdown_connections 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x5648400a0c20 0x5648400a3010 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x56484008e5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x56484008dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.576 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3152685062 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840090d30 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3152685062 >> 172.21.15.70:0/3152685062 conn(0x56484004f310 msgr2=0x564840088960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:36.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb177fe640 0 client.18138 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:40:36.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3152685062 shutdown_connections 2024-09-19T04:40:36.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3152685062 wait complete. 2024-09-19T04:40:36.577 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.568+0000 7ffb40ce0740 20 client.18138 trim_cache size 0 max 16384 2024-09-19T04:40:36.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb40ce0740 1 Processor -- start 2024-09-19T04:40:36.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb40ce0740 1 -- start start 2024-09-19T04:40:36.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648400865d0 0x56484009d2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840087b40 0x56484008cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x5648400a8730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381b2410 con 0x564840087b40 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381afce0 con 0x564840091370 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381adb50 con 0x5648400865d0 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb37fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840087b40 0x56484008cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb37fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840087b40 0x56484008cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43930/0 (socket says 172.21.15.70:43930) 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb37fff640 1 -- 172.21.15.70:0/3785457595 learned_addr learned my addr 172.21.15.70:0/3785457595 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb377fe640 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648400865d0 0x56484009d2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.581+0000 7ffb37fff640 1 -- 172.21.15.70:0/3785457595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648400865d0 msgr2=0x56484009d2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb37fff640 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648400865d0 0x56484009d2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb37fff640 1 -- 172.21.15.70:0/3785457595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 msgr2=0x5648400a8730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb37fff640 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x5648400a8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb37fff640 1 -- 172.21.15.70:0/3785457595 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56484008c550 con 0x564840087b40 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb377fe640 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648400865d0 0x56484009d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb37fff640 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840087b40 0x56484008cfe0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ffb28004810 tx=0x7ffb28006eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a13039f245bc222 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb1dffb640 1 -- 172.21.15.70:0/3785457595 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb280169a0 con 0x564840087b40 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb1dffb640 1 -- 172.21.15.70:0/3785457595 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ffb28016b40 con 0x564840087b40 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb1dffb640 1 -- 172.21.15.70:0/3785457595 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb28014610 con 0x564840087b40 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3785457595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840087b40 msgr2=0x56484008cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.582+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840087b40 0x56484008cfe0 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7ffb28004810 tx=0x7ffb28006eb0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3785457595 shutdown_connections 2024-09-19T04:40:36.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x5648400a8730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564840087b40 0x56484008cfe0 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/3785457595 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5648400865d0 0x56484009d2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3785457595 >> 172.21.15.70:0/3785457595 conn(0x56484004f310 msgr2=0x56484008c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3785457595 shutdown_connections 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 -- 172.21.15.70:0/3785457595 wait complete. 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 -- start start 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 Processor -- start 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840099a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x56484008ac00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x56484008b140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381ae1a0 con 0x5648400865d0 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381af610 con 0x564840091370 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ffb381ae870 con 0x564840087b40 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.583+0000 7ffb40ce0740 10 client.0 _ll_register_callbacks cb 0x7ffb2c032e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840099a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840099a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43934/0 (socket says 172.21.15.70:43934) 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 -- 172.21.15.70:0/2988289579 learned_addr learned my addr 172.21.15.70:0/2988289579 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb37fff640 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x56484008ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 -- 172.21.15.70:0/2988289579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 msgr2=0x56484008ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x56484008ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 -- 172.21.15.70:0/2988289579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 msgr2=0x56484008b140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x56484008b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 -- 172.21.15.70:0/2988289579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56484008b830 con 0x5648400865d0 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb377fe640 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840099a20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0095d0 tx=0x7ffb2c03c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d578aee6f6662f3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb177fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb177fe640 1 -- 172.21.15.70:0/2988289579 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb2c056050 con 0x5648400865d0 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb177fe640 1 -- 172.21.15.70:0/2988289579 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7ffb2c0318d0 con 0x5648400865d0 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb40ce0740 1 -- 172.21.15.70:0/2988289579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb28016b40 con 0x5648400865d0 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb177fe640 1 -- 172.21.15.70:0/2988289579 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7ffb2c069050 con 0x5648400865d0 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb40ce0740 10 client.18144 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.584+0000 7ffb40ce0740 1 -- 172.21.15.70:0/2988289579 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x56484010b570 con 0x5648400865d0 2024-09-19T04:40:36.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb177fe640 1 -- 172.21.15.70:0/2988289579 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ffb28016b40 con 0x5648400865d0 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb177fe640 1 -- 172.21.15.70:0/2988289579 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7ffb2c062060 con 0x5648400865d0 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb40ce0740 10 client.18144 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb40ce0740 10 client.18144 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb40ce0740 20 client.18144 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x56484010bc60 0x56484010e080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb40ce0740 4 client.18144 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb40ce0740 1 -- 172.21.15.70:0/2988289579 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x56483fff3d70 con 0x56484010bc60 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb37fff640 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x56484010bc60 0x56484010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb177fe640 10 client.18144 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.585+0000 7ffb37fff640 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x56484010bc60 0x56484010e080 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=420d2719d2d0a438 server_cookie=7cea9322a51b397f in_seq=0 out_seq=0 2024-09-19T04:40:36.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb177fe640 1 -- 172.21.15.70:0/2988289579 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x56483fff3d70 con 0x56484010bc60 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb177fe640 10 client.18144 handle_command_reply: tid=0 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 client.18144 shutdown 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 -- 172.21.15.70:0/2988289579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 msgr2=0x564840099a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840099a20 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7ffb2c0095d0 tx=0x7ffb2c03c4c0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 -- 172.21.15.70:0/2988289579 shutdown_connections 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x56484010bc60 0x56484010e080 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564840091370 0x56484008b140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564840087b40 0x56484008ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb177fe640 0 client.18144 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 --2- 172.21.15.70:0/2988289579 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5648400865d0 0x564840099a20 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 -- 172.21.15.70:0/2988289579 >> 172.21.15.70:0/2988289579 conn(0x56484004f310 msgr2=0x56484008d0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 -- 172.21.15.70:0/2988289579 shutdown_connections 2024-09-19T04:40:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 1 -- 172.21.15.70:0/2988289579 wait complete. 2024-09-19T04:40:36.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb40ce0740 20 client.18144 trim_cache size 0 max 16384 2024-09-19T04:40:36.597 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:40:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb3e907640 1 -- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ffb200a33b0 msgr2=0x7ffb200a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.586+0000 7ffb3e907640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ffb200a33b0 0x7ffb200a5870 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7ffb30097980 tx=0x7ffb3006e350 comp rx=0 tx=0).stop 2024-09-19T04:40:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 -- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38106a80 msgr2=0x7ffb380fd8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:36.598 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38106a80 0x7ffb380fd8d0 secure :-1 s=READY pgs=1290 cs=0 l=1 rev1=1 crypto rx=0x7ffb3000b970 tx=0x7ffb3000bd70 comp rx=0 tx=0).stop 2024-09-19T04:40:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 -- 172.21.15.70:0/3621281775 shutdown_connections 2024-09-19T04:40:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ffb200a33b0 0x7ffb200a5870 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ffb38106a80 0x7ffb380fd8d0 unknown :-1 s=CLOSED pgs=1290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ffb38101420 0x7ffb380fd390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 --2- 172.21.15.70:0/3621281775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb38100a80 0x7ffb380fce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 -- 172.21.15.70:0/3621281775 >> 172.21.15.70:0/3621281775 conn(0x7ffb380fc7a0 msgr2=0x7ffb3806aad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 -- 172.21.15.70:0/3621281775 shutdown_connections 2024-09-19T04:40:36.599 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:36.587+0000 7ffb3e907640 1 -- 172.21.15.70:0/3621281775 wait complete. 2024-09-19T04:40:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:36 smithi134 ceph-mon[34525]: pgmap v306: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:37.141 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:36 smithi070 ceph-mon[30942]: pgmap v306: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:37.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:36 smithi167 ceph-mon[34339]: pgmap v306: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:37.452 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:40:37.697 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:38.161 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.148+0000 7f2a243c9640 1 -- 172.21.15.70:0/1655107065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c101420 msgr2=0x7f2a1c10d950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.148+0000 7f2a243c9640 1 --2- 172.21.15.70:0/1655107065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c101420 0x7f2a1c10d950 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7f2a14009cd0 tx=0x7f2a1402a8f0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.148+0000 7f2a243c9640 1 -- 172.21.15.70:0/1655107065 shutdown_connections 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.148+0000 7f2a243c9640 1 --2- 172.21.15.70:0/1655107065 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c101420 0x7f2a1c10d950 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.148+0000 7f2a243c9640 1 --2- 172.21.15.70:0/1655107065 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c100a80 0x7f2a1c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.148+0000 7f2a243c9640 1 --2- 172.21.15.70:0/1655107065 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a1c106a80 0x7f2a1c106e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.148+0000 7f2a243c9640 1 -- 172.21.15.70:0/1655107065 >> 172.21.15.70:0/1655107065 conn(0x7f2a1c0fc7a0 msgr2=0x7f2a1c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 -- 172.21.15.70:0/1655107065 shutdown_connections 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 -- 172.21.15.70:0/1655107065 wait complete. 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 Processor -- start 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 -- start start 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c100a80 0x7f2a1c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.162 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a1c101420 0x7f2a1c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c106a80 0x7f2a1c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c110e50 con 0x7f2a1c106a80 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c110cd0 con 0x7f2a1c100a80 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a243c9640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c110fd0 con 0x7f2a1c101420 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a22966640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c106a80 0x7f2a1c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a22966640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c106a80 0x7f2a1c19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43952/0 (socket says 172.21.15.70:43952) 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.149+0000 7f2a22966640 1 -- 172.21.15.70:0/3399399764 learned_addr learned my addr 172.21.15.70:0/3399399764 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a21964640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a1c101420 0x7f2a1c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a22165640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c100a80 0x7f2a1c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a22966640 1 -- 172.21.15.70:0/3399399764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a1c101420 msgr2=0x7f2a1c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a22966640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a1c101420 0x7f2a1c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a22966640 1 -- 172.21.15.70:0/3399399764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c100a80 msgr2=0x7f2a1c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.163 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a22966640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c100a80 0x7f2a1c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a22966640 1 -- 172.21.15.70:0/3399399764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a1c19d290 con 0x7f2a1c106a80 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a22966640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c106a80 0x7f2a1c19cbb0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2a14031670 tx=0x7f2a140316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a137fe640 1 -- 172.21.15.70:0/3399399764 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14003b70 con 0x7f2a1c106a80 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a243c9640 1 -- 172.21.15.70:0/3399399764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a1c19d520 con 0x7f2a1c106a80 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a137fe640 1 -- 172.21.15.70:0/3399399764 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a14030e80 con 0x7f2a1c106a80 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a137fe640 1 -- 172.21.15.70:0/3399399764 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a14004760 con 0x7f2a1c106a80 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.150+0000 7f2a243c9640 1 -- 172.21.15.70:0/3399399764 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a1c1a4e60 con 0x7f2a1c106a80 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.153+0000 7f2a137fe640 1 -- 172.21.15.70:0/3399399764 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2a140318c0 con 0x7f2a1c106a80 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.153+0000 7f2a267a2740 1 Processor -- start 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.153+0000 7f2a267a2740 1 -- start start 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ca090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0caa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0d5370 0x55d92b0d7760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.164 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a267a2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d92b0302f0 con 0x55d92b0d5370 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a267a2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d92afd7cf0 con 0x55d92b0cbb40 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a267a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d92b02c2b0 con 0x55d92b0ca5d0 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0d5370 0x55d92b0d7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0d5370 0x55d92b0d7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43956/0 (socket says 172.21.15.70:43956) 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 -- 172.21.15.70:0/1109099748 learned_addr learned my addr 172.21.15.70:0/1109099748 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ca090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a22165640 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0caa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a137fe640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a080a33b0 0x7f2a080a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 -- 172.21.15.70:0/1109099748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 msgr2=0x55d92b0caa10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0caa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 -- 172.21.15.70:0/1109099748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 msgr2=0x55d92b0ca090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:38.165 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ca090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 -- 172.21.15.70:0/1109099748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d92afbc3a0 con 0x55d92b0d5370 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a22966640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a080a33b0 0x7f2a080a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a21964640 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0d5370 0x55d92b0d7760 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00a580 tx=0x7f2a0c00a810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea6f65a0c5384480 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a137fe640 1 -- 172.21.15.70:0/3399399764 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f2a140f0e60 con 0x7f2a1c106a80 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.154+0000 7f2a10dea640 1 -- 172.21.15.70:0/1109099748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c005220 con 0x55d92b0d5370 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a10dea640 1 -- 172.21.15.70:0/1109099748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a0c004c70 con 0x55d92b0d5370 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a10dea640 1 -- 172.21.15.70:0/1109099748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00fb90 con 0x55d92b0d5370 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 -- 172.21.15.70:0/1109099748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0d5370 msgr2=0x55d92b0d7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0d5370 0x55d92b0d7760 secure :-1 s=READY pgs=1297 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00a580 tx=0x7f2a0c00a810 comp rx=0 tx=0).stop 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a22966640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a080a33b0 0x7f2a080a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2a140eebb0 tx=0x7f2a1408c0c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 -- 172.21.15.70:0/1109099748 shutdown_connections 2024-09-19T04:40:38.166 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0d5370 0x55d92b0d7760 unknown :-1 s=CLOSED pgs=1297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0caa10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1109099748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ca090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 -- 172.21.15.70:0/1109099748 >> 172.21.15.70:0/1109099748 conn(0x55d92b093310 msgr2=0x55d92b0c6c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 -- 172.21.15.70:0/1109099748 shutdown_connections 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.155+0000 7f2a267a2740 1 -- 172.21.15.70:0/1109099748 wait complete. 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 1 -- start start 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 1 Processor -- start 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0d4db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0d2060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 0x55d92b0d27f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55d92b0d8070 con 0x55d92b0cbb40 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55d92afeb060 con 0x55d92b0d5370 2024-09-19T04:40:38.167 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55d92b0d81f0 con 0x55d92b0ca5d0 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a22165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0d2060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a267a2740 10 client.0 _ll_register_callbacks cb 0x55d92ad3e8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a22165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0d2060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43962/0 (socket says 172.21.15.70:43962) 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a22165640 1 -- 172.21.15.70:0/1933461631 learned_addr learned my addr 172.21.15.70:0/1933461631 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a21964640 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0d4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a21964640 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 0x55d92b0d27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a22165640 1 -- 172.21.15.70:0/1933461631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 msgr2=0x55d92b0d4db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a22165640 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0d4db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a22165640 1 -- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 msgr2=0x55d92b0d27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a22165640 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 0x55d92b0d27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a22165640 1 -- 172.21.15.70:0/1933461631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d92ada13c0 con 0x55d92b0cbb40 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.156+0000 7f2a21964640 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 0x55d92b0d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:38.168 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a22165640 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0d2060 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f2a180116d0 tx=0x7f2a18011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dafbfe4cbffc5a5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a05ffb640 1 -- 172.21.15.70:0/1933461631 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1801f060 con 0x55d92b0cbb40 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a05ffb640 1 -- 172.21.15.70:0/1933461631 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f2a1800fb40 con 0x55d92b0cbb40 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 1 -- 172.21.15.70:0/1933461631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a0c004c70 con 0x55d92b0cbb40 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a05ffb640 1 -- 172.21.15.70:0/1933461631 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2a1800fd40 con 0x55d92b0cbb40 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 10 client.18156 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 1 -- 172.21.15.70:0/1933461631 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d92b0e3c10 con 0x55d92b0cbb40 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a05ffb640 1 -- 172.21.15.70:0/1933461631 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a0c004c70 con 0x55d92b0cbb40 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a05ffb640 1 -- 172.21.15.70:0/1933461631 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2a1801a510 con 0x55d92b0cbb40 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 10 client.18156 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 10 client.18156 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 20 client.18156 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d92b0e5120 0x55d92b0e7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.169 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 4 client.18156 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.157+0000 7f2a267a2740 1 -- 172.21.15.70:0/1933461631 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d92b03d860 con 0x55d92b0e5120 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.158+0000 7f2a21964640 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d92b0e5120 0x55d92b0e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.158+0000 7f2a21964640 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d92b0e5120 0x55d92b0e7540 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eb86a5c2fbc27718 server_cookie=f6ed6fd760e16a37 in_seq=0 out_seq=0 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.158+0000 7f2a05ffb640 10 client.18156 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a05ffb640 1 -- 172.21.15.70:0/1933461631 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55d92b03d860 con 0x55d92b0e5120 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a05ffb640 10 client.18156 handle_command_reply: tid=0 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 client.18156 shutdown 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 -- 172.21.15.70:0/1933461631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 msgr2=0x55d92b0d2060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0d2060 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7f2a180116d0 tx=0x7f2a18011b90 comp rx=0 tx=0).stop 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 -- 172.21.15.70:0/1933461631 shutdown_connections 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d92b0e5120 0x55d92b0e7540 crc :-1 s=READY pgs=220 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 0x55d92b0d27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0d2060 unknown :-1 s=CLOSED pgs=1298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.170 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a05ffb640 0 client.18156 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 --2- 172.21.15.70:0/1933461631 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0d4db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 -- 172.21.15.70:0/1933461631 >> 172.21.15.70:0/1933461631 conn(0x55d92b093310 msgr2=0x55d92b0cc960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 -- 172.21.15.70:0/1933461631 shutdown_connections 2024-09-19T04:40:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 1 -- 172.21.15.70:0/1933461631 wait complete. 2024-09-19T04:40:38.171 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.159+0000 7f2a267a2740 20 client.18156 trim_cache size 0 max 16384 2024-09-19T04:40:38.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a267a2740 1 Processor -- start 2024-09-19T04:40:38.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a267a2740 1 -- start start 2024-09-19T04:40:38.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0d2030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0cb300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 0x55d92b0ece10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a267a2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c1affa0 con 0x55d92b0cbb40 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a267a2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c1ad870 con 0x55d92b0d5370 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a267a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c1ab6e0 con 0x55d92b0ca5d0 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a22165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a22165640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0cb300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43966/0 (socket says 172.21.15.70:43966) 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a22165640 1 -- 172.21.15.70:0/139618519 learned_addr learned my addr 172.21.15.70:0/139618519 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a21964640 1 --2- 172.21.15.70:0/139618519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0d2030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.179 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a22165640 1 -- 172.21.15.70:0/139618519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 msgr2=0x55d92b0d2030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a22165640 1 --2- 172.21.15.70:0/139618519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0d2030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a22165640 1 -- 172.21.15.70:0/139618519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 msgr2=0x55d92b0ece10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a22165640 1 --2- 172.21.15.70:0/139618519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 0x55d92b0ece10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.172+0000 7f2a22165640 1 -- 172.21.15.70:0/139618519 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d92b0e78b0 con 0x55d92b0cbb40 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a22165640 1 --2- 172.21.15.70:0/139618519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0cb300 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800ac20 tx=0x7f2a1800aed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94f5dcd4df14f75 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a07fff640 1 -- 172.21.15.70:0/139618519 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1801ada0 con 0x55d92b0cbb40 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a07fff640 1 -- 172.21.15.70:0/139618519 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a18005d60 con 0x55d92b0cbb40 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a07fff640 1 -- 172.21.15.70:0/139618519 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1801a6a0 con 0x55d92b0cbb40 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 -- 172.21.15.70:0/139618519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 msgr2=0x55d92b0cb300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 --2- 172.21.15.70:0/139618519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0cb300 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7f2a1800ac20 tx=0x7f2a1800aed0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 -- 172.21.15.70:0/139618519 shutdown_connections 2024-09-19T04:40:38.180 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 --2- 172.21.15.70:0/139618519 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0d5370 0x55d92b0ece10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 --2- 172.21.15.70:0/139618519 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0cbb40 0x55d92b0cb300 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 --2- 172.21.15.70:0/139618519 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0ca5d0 0x55d92b0d2030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 -- 172.21.15.70:0/139618519 >> 172.21.15.70:0/139618519 conn(0x55d92b093310 msgr2=0x55d92b0d1920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 -- 172.21.15.70:0/139618519 shutdown_connections 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.173+0000 7f2a267a2740 1 -- 172.21.15.70:0/139618519 wait complete. 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 1 -- start start 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 1 Processor -- start 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0ca5d0 0x55d92b0dd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ddd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0d5370 0x55d92b0d8d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c1abd30 con 0x55d92b0ca5d0 2024-09-19T04:40:38.181 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c1ad1a0 con 0x55d92b0cbb40 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2a1c1ac400 con 0x55d92b0d5370 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a267a2740 10 client.0 _ll_register_callbacks cb 0x7f2a1800a630 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0ca5d0 0x55d92b0dd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0ca5d0 0x55d92b0dd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43974/0 (socket says 172.21.15.70:43974) 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 -- 172.21.15.70:0/3124403725 learned_addr learned my addr 172.21.15.70:0/3124403725 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a22165640 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ddd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0d5370 0x55d92b0d8d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 -- 172.21.15.70:0/3124403725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0d5370 msgr2=0x55d92b0d8d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0d5370 0x55d92b0d8d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 -- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 msgr2=0x55d92b0ddd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ddd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.182 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.174+0000 7f2a21964640 1 -- 172.21.15.70:0/3124403725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d92b0d95c0 con 0x55d92b0ca5d0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a22165640 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ddd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a21964640 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0ca5d0 0x55d92b0dd810 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00f740 tx=0x7f2a0c00f7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2aaf2151f4d7d87 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a05ffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a05ffb640 1 -- 172.21.15.70:0/3124403725 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a0c00fb60 con 0x55d92b0ca5d0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a05ffb640 1 -- 172.21.15.70:0/3124403725 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f2a0c0293b0 con 0x55d92b0ca5d0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 1 -- 172.21.15.70:0/3124403725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2a18005d60 con 0x55d92b0ca5d0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a05ffb640 1 -- 172.21.15.70:0/3124403725 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2a0c0295b0 con 0x55d92b0ca5d0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 10 client.18162 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 1 -- 172.21.15.70:0/3124403725 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55d92b14fa40 con 0x55d92b0ca5d0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a05ffb640 1 -- 172.21.15.70:0/3124403725 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2a18005d60 con 0x55d92b0ca5d0 2024-09-19T04:40:38.183 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a05ffb640 1 -- 172.21.15.70:0/3124403725 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2a0c03ca10 con 0x55d92b0ca5d0 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 10 client.18162 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 10 client.18162 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 20 client.18162 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d92b0e5120 0x55d92b151fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 4 client.18162 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.175+0000 7f2a267a2740 1 -- 172.21.15.70:0/3124403725 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55d92b037d70 con 0x55d92b0e5120 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a22165640 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d92b0e5120 0x55d92b151fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a22165640 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d92b0e5120 0x55d92b151fe0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1c3bf79559077054 server_cookie=b551d2874864f8d9 in_seq=0 out_seq=0 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a05ffb640 10 client.18162 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a05ffb640 1 -- 172.21.15.70:0/3124403725 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55d92b037d70 con 0x55d92b0e5120 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a05ffb640 10 client.18162 handle_command_reply: tid=0 2024-09-19T04:40:38.184 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 client.18162 shutdown 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 -- 172.21.15.70:0/3124403725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0ca5d0 msgr2=0x55d92b0dd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0ca5d0 0x55d92b0dd810 secure :-1 s=READY pgs=1300 cs=0 l=1 rev1=1 crypto rx=0x7f2a0c00f740 tx=0x7f2a0c00f7e0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 -- 172.21.15.70:0/3124403725 shutdown_connections 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55d92b0e5120 0x55d92b151fe0 crc :-1 s=READY pgs=221 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55d92b0d5370 0x55d92b0d8d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55d92b0cbb40 0x55d92b0ddd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a05ffb640 0 client.18162 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 --2- 172.21.15.70:0/3124403725 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55d92b0ca5d0 0x55d92b0dd810 unknown :-1 s=CLOSED pgs=1300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 -- 172.21.15.70:0/3124403725 >> 172.21.15.70:0/3124403725 conn(0x55d92b093310 msgr2=0x55d92b0d40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 -- 172.21.15.70:0/3124403725 shutdown_connections 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.176+0000 7f2a267a2740 1 -- 172.21.15.70:0/3124403725 wait complete. 2024-09-19T04:40:38.185 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a267a2740 20 client.18162 trim_cache size 0 max 16384 2024-09-19T04:40:38.186 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:40:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 -- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a080a33b0 msgr2=0x7f2a080a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.186 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a080a33b0 0x7f2a080a5870 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f2a140eebb0 tx=0x7f2a1408c0c0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 -- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c106a80 msgr2=0x7f2a1c19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c106a80 0x7f2a1c19cbb0 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7f2a14031670 tx=0x7f2a140316a0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 -- 172.21.15.70:0/3399399764 shutdown_connections 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2a080a33b0 0x7f2a080a5870 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2a1c106a80 0x7f2a1c19cbb0 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2a1c101420 0x7f2a1c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 --2- 172.21.15.70:0/3399399764 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a1c100a80 0x7f2a1c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 -- 172.21.15.70:0/3399399764 >> 172.21.15.70:0/3399399764 conn(0x7f2a1c0fc7a0 msgr2=0x7f2a1c06a8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 -- 172.21.15.70:0/3399399764 shutdown_connections 2024-09-19T04:40:38.187 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:38.177+0000 7f2a243c9640 1 -- 172.21.15.70:0/3399399764 wait complete. 2024-09-19T04:40:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:38 smithi134 ceph-mon[34525]: pgmap v307: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:39.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:38 smithi070 ceph-mon[30942]: pgmap v307: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:39.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:38 smithi167 ceph-mon[34339]: pgmap v307: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:39.860 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-09-19T04:40:39.860 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-09-19T04:40:40.119 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:40.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- 172.21.15.70:0/920382532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102570 msgr2=0x7f9d5c1029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/920382532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102570 0x7f9d5c1029b0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009900 tx=0x7f9d4802a480 comp rx=0 tx=0).stop 2024-09-19T04:40:40.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- 172.21.15.70:0/920382532 shutdown_connections 2024-09-19T04:40:40.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/920382532 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d5c102ef0 0x7f9d5c10da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/920382532 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102570 0x7f9d5c1029b0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.587 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/920382532 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5c100e20 0x7f9d5c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- 172.21.15.70:0/920382532 >> 172.21.15.70:0/920382532 conn(0x7f9d5c0fc7d0 msgr2=0x7f9d5c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- 172.21.15.70:0/920382532 shutdown_connections 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- 172.21.15.70:0/920382532 wait complete. 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 Processor -- start 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- start start 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d5c100e20 0x7f9d5c198470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5c102570 0x7f9d5c1989b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102ef0 0x7f9d5c19cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c112070 con 0x7f9d5c102ef0 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c111ef0 con 0x7f9d5c100e20 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.575+0000 7f9d62cdb640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c1121f0 con 0x7f9d5c102570 2024-09-19T04:40:40.588 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102ef0 0x7f9d5c19cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102ef0 0x7f9d5c19cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43982/0 (socket says 172.21.15.70:43982) 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 -- 172.21.15.70:0/1869433832 learned_addr learned my addr 172.21.15.70:0/1869433832 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d60a77640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d5c100e20 0x7f9d5c198470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5c102570 0x7f9d5c1989b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 -- 172.21.15.70:0/1869433832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5c102570 msgr2=0x7f9d5c1989b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5c102570 0x7f9d5c1989b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 -- 172.21.15.70:0/1869433832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d5c100e20 msgr2=0x7f9d5c198470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d5c100e20 0x7f9d5c198470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 -- 172.21.15.70:0/1869433832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d5c19d420 con 0x7f9d5c102ef0 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d61278640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102ef0 0x7f9d5c19cd40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400cce0 tx=0x7f9d5400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:40.589 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d59ffb640 1 -- 172.21.15.70:0/1869433832 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5400f450 con 0x7f9d5c102ef0 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d59ffb640 1 -- 172.21.15.70:0/1869433832 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9d5400fac0 con 0x7f9d5c102ef0 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d62cdb640 1 -- 172.21.15.70:0/1869433832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d5c19d710 con 0x7f9d5c102ef0 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d59ffb640 1 -- 172.21.15.70:0/1869433832 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d54018b10 con 0x7f9d5c102ef0 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.576+0000 7f9d62cdb640 1 -- 172.21.15.70:0/1869433832 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d5c1a4ff0 con 0x7f9d5c102ef0 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.578+0000 7f9d59ffb640 1 -- 172.21.15.70:0/1869433832 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f9d5400fc70 con 0x7f9d5c102ef0 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d650b4740 1 Processor -- start 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d650b4740 1 -- start start 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d59ffb640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9d4c0a33b0 0x7f9d4c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a482e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a483340 0x55837a491c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.590 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a492150 0x55837a494540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d650b4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55837a3e8280 con 0x55837a482a20 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d650b4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55837a38fb10 con 0x55837a492150 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d650b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55837a3e4240 con 0x55837a483340 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d59ffb640 1 -- 172.21.15.70:0/1869433832 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f9d540d0150 con 0x7f9d5c102ef0 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9d4c0a33b0 0x7f9d4c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d60a77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a482e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d60a77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a482e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43984/0 (socket says 172.21.15.70:43984) 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.579+0000 7f9d60a77640 1 -- 172.21.15.70:0/1833005794 learned_addr learned my addr 172.21.15.70:0/1833005794 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a483340 0x55837a491c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d61278640 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a492150 0x55837a494540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.591 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d60a77640 1 -- 172.21.15.70:0/1833005794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a483340 msgr2=0x55837a491c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d60a77640 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a483340 0x55837a491c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d60a77640 1 -- 172.21.15.70:0/1833005794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a492150 msgr2=0x55837a494540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d60a77640 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a492150 0x55837a494540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d60a77640 1 -- 172.21.15.70:0/1833005794 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837a39c1f0 con 0x55837a482a20 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9d4c0a33b0 0x7f9d4c0a5870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0fec30 tx=0x7f9d480314a0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d60a77640 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a482e00 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000ad00 tx=0x7f9d5000f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8eeee95b92a843f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d46ffd640 1 -- 172.21.15.70:0/1833005794 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5001d070 con 0x55837a482a20 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d46ffd640 1 -- 172.21.15.70:0/1833005794 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9d50018b10 con 0x55837a482a20 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.580+0000 7f9d46ffd640 1 -- 172.21.15.70:0/1833005794 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50010b80 con 0x55837a482a20 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 -- 172.21.15.70:0/1833005794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 msgr2=0x55837a482e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.592 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a482e00 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7f9d5000ad00 tx=0x7f9d5000f790 comp rx=0 tx=0).stop 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 -- 172.21.15.70:0/1833005794 shutdown_connections 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a492150 0x55837a494540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a483340 0x55837a491c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1833005794 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a482e00 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 -- 172.21.15.70:0/1833005794 >> 172.21.15.70:0/1833005794 conn(0x55837a47f0f0 msgr2=0x55837a47f4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 -- 172.21.15.70:0/1833005794 shutdown_connections 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 -- 172.21.15.70:0/1833005794 wait complete. 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 -- start start 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.581+0000 7f9d650b4740 1 Processor -- start 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a48f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.593 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a483340 0x55837a48f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a48fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d650b4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55837a494d20 con 0x55837a482a20 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d650b4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55837a3a2f10 con 0x55837a483340 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d650b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55837a494ea0 con 0x55837a492150 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d650b4740 10 client.0 _ll_register_callbacks cb 0x55837a36ba40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a48f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a48f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:43998/0 (socket says 172.21.15.70:43998) 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 -- 172.21.15.70:0/3393386312 learned_addr learned my addr 172.21.15.70:0/3393386312 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 -- 172.21.15.70:0/3393386312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 msgr2=0x55837a48fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a48fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 -- 172.21.15.70:0/3393386312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a483340 msgr2=0x55837a48f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:40.594 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a483340 0x55837a48f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 -- 172.21.15.70:0/3393386312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837a1596a0 con 0x55837a482a20 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d60a77640 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a48f060 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9d500107e0 tx=0x7f9d500186f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9f3b7c697811285 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d3bfff640 1 -- 172.21.15.70:0/3393386312 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d50026020 con 0x55837a482a20 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d3bfff640 1 -- 172.21.15.70:0/3393386312 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f9d50010a80 con 0x55837a482a20 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.582+0000 7f9d650b4740 1 -- 172.21.15.70:0/3393386312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d50018b10 con 0x55837a482a20 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d3bfff640 1 -- 172.21.15.70:0/3393386312 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9d50031050 con 0x55837a482a20 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d650b4740 10 client.18174 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d650b4740 1 -- 172.21.15.70:0/3393386312 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55837a4a0990 con 0x55837a482a20 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d3bfff640 1 -- 172.21.15.70:0/3393386312 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9d50018b10 con 0x55837a482a20 2024-09-19T04:40:40.595 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d3bfff640 1 -- 172.21.15.70:0/3393386312 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9d50004780 con 0x55837a482a20 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d650b4740 10 client.18174 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d650b4740 10 client.18174 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d650b4740 20 client.18174 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55837a4a1d90 0x55837a4a4180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d650b4740 4 client.18174 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d650b4740 1 -- 172.21.15.70:0/3393386312 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55837a3f57f0 con 0x55837a4a1d90 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.583+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55837a4a1d90 0x55837a4a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.584+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55837a4a1d90 0x55837a4a4180 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4bc57379f12c2396 server_cookie=68b3ffd25ff3e7f in_seq=0 out_seq=0 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.584+0000 7f9d3bfff640 10 client.18174 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d3bfff640 1 -- 172.21.15.70:0/3393386312 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55837a3f57f0 con 0x55837a4a1d90 2024-09-19T04:40:40.596 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d3bfff640 10 client.18174 handle_command_reply: tid=0 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 client.18174 shutdown 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 -- 172.21.15.70:0/3393386312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 msgr2=0x55837a48f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a48f060 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7f9d500107e0 tx=0x7f9d500186f0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 -- 172.21.15.70:0/3393386312 shutdown_connections 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55837a4a1d90 0x55837a4a4180 crc :-1 s=READY pgs=222 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a48fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a483340 0x55837a48f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d3bfff640 0 client.18174 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3393386312 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a482a20 0x55837a48f060 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 -- 172.21.15.70:0/3393386312 >> 172.21.15.70:0/3393386312 conn(0x55837a47f0f0 msgr2=0x55837a484e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 -- 172.21.15.70:0/3393386312 shutdown_connections 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 1 -- 172.21.15.70:0/3393386312 wait complete. 2024-09-19T04:40:40.597 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.585+0000 7f9d650b4740 20 client.18174 trim_cache size 0 max 16384 2024-09-19T04:40:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.602+0000 7f9d650b4740 1 Processor -- start 2024-09-19T04:40:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.602+0000 7f9d650b4740 1 -- start start 2024-09-19T04:40:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a47e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a48e940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a4a9810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d650b4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c1aded0 con 0x55837a483340 2024-09-19T04:40:40.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d650b4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c1ab7a0 con 0x55837a482a20 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d650b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c1a9610 con 0x55837a492150 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a48e940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a48e940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44008/0 (socket says 172.21.15.70:44008) 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 -- 172.21.15.70:0/3411394303 learned_addr learned my addr 172.21.15.70:0/3411394303 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d60a77640 1 --2- 172.21.15.70:0/3411394303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a47e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 -- 172.21.15.70:0/3411394303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 msgr2=0x55837a4a9810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/3411394303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a4a9810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 -- 172.21.15.70:0/3411394303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 msgr2=0x55837a47e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/3411394303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a47e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 -- 172.21.15.70:0/3411394303 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55837a479680 con 0x55837a483340 2024-09-19T04:40:40.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/3411394303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a48e940 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009900 tx=0x7f9d48046000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1910e412e54508 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:40.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d467fc640 1 -- 172.21.15.70:0/3411394303 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48035050 con 0x55837a483340 2024-09-19T04:40:40.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d467fc640 1 -- 172.21.15.70:0/3411394303 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9d48004490 con 0x55837a483340 2024-09-19T04:40:40.607 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.603+0000 7f9d467fc640 1 -- 172.21.15.70:0/3411394303 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4803db50 con 0x55837a483340 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 -- 172.21.15.70:0/3411394303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 msgr2=0x55837a48e940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3411394303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a48e940 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009900 tx=0x7f9d48046000 comp rx=0 tx=0).stop 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 -- 172.21.15.70:0/3411394303 shutdown_connections 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3411394303 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a4a9810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3411394303 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a48e940 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 --2- 172.21.15.70:0/3411394303 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a47e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 -- 172.21.15.70:0/3411394303 >> 172.21.15.70:0/3411394303 conn(0x55837a47f0f0 msgr2=0x55837a48f840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 -- 172.21.15.70:0/3411394303 shutdown_connections 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.604+0000 7f9d650b4740 1 -- 172.21.15.70:0/3411394303 wait complete. 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 1 -- start start 2024-09-19T04:40:40.611 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 1 Processor -- start 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a495e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a4963d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a496910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c1a9c60 con 0x55837a483340 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c1ab0d0 con 0x55837a482a20 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f9d5c1aa330 con 0x55837a492150 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d650b4740 10 client.0 _ll_register_callbacks cb 0x7f9d5001b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a4963d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d5bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a4963d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44016/0 (socket says 172.21.15.70:44016) 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d5bfff640 1 -- 172.21.15.70:0/1925353499 learned_addr learned my addr 172.21.15.70:0/1925353499 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d60a77640 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a495e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.605+0000 7f9d61278640 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a496910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.612 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d5bfff640 1 -- 172.21.15.70:0/1925353499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 msgr2=0x55837a496910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a496910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d5bfff640 1 -- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 msgr2=0x55837a495e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a495e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d5bfff640 1 -- 172.21.15.70:0/1925353499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55837a50b7e0 con 0x55837a483340 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d60a77640 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a495e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d5bfff640 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a4963d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009850 tx=0x7f9d480092b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b909a3d16ba05a0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d3bfff640 1 -- 172.21.15.70:0/1925353499 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4803dad0 con 0x55837a483340 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d3bfff640 1 -- 172.21.15.70:0/1925353499 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f9d4803dc70 con 0x55837a483340 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d650b4740 1 -- 172.21.15.70:0/1925353499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9d48004490 con 0x55837a483340 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d3bfff640 1 -- 172.21.15.70:0/1925353499 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f9d48065050 con 0x55837a483340 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d650b4740 10 client.18180 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:40.613 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d650b4740 1 -- 172.21.15.70:0/1925353499 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55837a50cb00 con 0x55837a483340 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.606+0000 7f9d3bfff640 1 -- 172.21.15.70:0/1925353499 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f9d48004490 con 0x55837a483340 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d3bfff640 1 -- 172.21.15.70:0/1925353499 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f9d48052070 con 0x55837a483340 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d650b4740 10 client.18180 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d650b4740 10 client.18180 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d650b4740 20 client.18180 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55837a50d240 0x55837a50f660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d650b4740 4 client.18180 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d650b4740 1 -- 172.21.15.70:0/1925353499 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55837a3efd00 con 0x55837a50d240 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d60a77640 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55837a50d240 0x55837a50f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d3bfff640 10 client.18180 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.607+0000 7f9d60a77640 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55837a50d240 0x55837a50f660 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a249a7e89a42301 server_cookie=2e2fe3c9db68e911 in_seq=0 out_seq=0 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.608+0000 7f9d3bfff640 1 -- 172.21.15.70:0/1925353499 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55837a3efd00 con 0x55837a50d240 2024-09-19T04:40:40.614 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.608+0000 7f9d3bfff640 10 client.18180 handle_command_reply: tid=0 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 client.18180 shutdown 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 -- 172.21.15.70:0/1925353499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 msgr2=0x55837a4963d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a4963d0 secure :-1 s=READY pgs=1306 cs=0 l=1 rev1=1 crypto rx=0x7f9d48009850 tx=0x7f9d480092b0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 -- 172.21.15.70:0/1925353499 shutdown_connections 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55837a50d240 0x55837a50f660 crc :-1 s=READY pgs=223 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55837a492150 0x55837a496910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55837a483340 0x55837a4963d0 unknown :-1 s=CLOSED pgs=1306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 --2- 172.21.15.70:0/1925353499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55837a482a20 0x55837a495e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 -- 172.21.15.70:0/1925353499 >> 172.21.15.70:0/1925353499 conn(0x55837a47f0f0 msgr2=0x55837a48f000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d3bfff640 0 client.18180 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 -- 172.21.15.70:0/1925353499 shutdown_connections 2024-09-19T04:40:40.615 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 1 -- 172.21.15.70:0/1925353499 wait complete. 2024-09-19T04:40:40.616 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.609+0000 7f9d650b4740 20 client.18180 trim_cache size 0 max 16384 2024-09-19T04:40:40.616 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:40:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "return_code": 0, 2024-09-19T04:40:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "scrub_tag": "fcce3516-1045-4e24-8e13-4a5cfea3d940", 2024-09-19T04:40:40.616 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": "asynchronous" 2024-09-19T04:40:40.616 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:40:40.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 -- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9d4c0a33b0 msgr2=0x7f9d4c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9d4c0a33b0 0x7f9d4c0a5870 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c0fec30 tx=0x7f9d480314a0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 -- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102ef0 msgr2=0x7f9d5c19cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:40.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102ef0 0x7f9d5c19cd40 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f9d5400cce0 tx=0x7f9d5400a620 comp rx=0 tx=0).stop 2024-09-19T04:40:40.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 -- 172.21.15.70:0/1869433832 shutdown_connections 2024-09-19T04:40:40.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f9d4c0a33b0 0x7f9d4c0a5870 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f9d5c102ef0 0x7f9d5c19cd40 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.617 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f9d5c102570 0x7f9d5c1989b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 --2- 172.21.15.70:0/1869433832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9d5c100e20 0x7f9d5c198470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:40.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 -- 172.21.15.70:0/1869433832 >> 172.21.15.70:0/1869433832 conn(0x7f9d5c0fc7d0 msgr2=0x7f9d5c106830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:40.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 -- 172.21.15.70:0/1869433832 shutdown_connections 2024-09-19T04:40:40.618 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:40.610+0000 7f9d62cdb640 1 -- 172.21.15.70:0/1869433832 wait complete. 2024-09-19T04:40:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:40 smithi070 ceph-mon[30942]: scrub queued for path: / 2024-09-19T04:40:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:40 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:40 smithi070 ceph-mon[30942]: scrub summary: active paths [/] 2024-09-19T04:40:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:40 smithi070 ceph-mon[30942]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:40.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:40 smithi070 ceph-mon[30942]: pgmap v308: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:40 smithi134 ceph-mon[34525]: scrub queued for path: / 2024-09-19T04:40:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:40 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:40 smithi134 ceph-mon[34525]: scrub summary: active paths [/] 2024-09-19T04:40:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:40 smithi134 ceph-mon[34525]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:40 smithi134 ceph-mon[34525]: pgmap v308: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:41.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:40 smithi167 ceph-mon[34339]: scrub queued for path: / 2024-09-19T04:40:41.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:40 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:41.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:40 smithi167 ceph-mon[34339]: scrub summary: active paths [/] 2024-09-19T04:40:41.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:40 smithi167 ceph-mon[34339]: scrub summary: idle+waiting paths [/] 2024-09-19T04:40:41.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:40 smithi167 ceph-mon[34339]: pgmap v308: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:41.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:40:41.665 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:40:42.098 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.096+0000 7fc03252e640 1 -- 172.21.15.70:0/651463753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c101de0 msgr2=0x7fc02c1021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.096+0000 7fc03252e640 1 --2- 172.21.15.70:0/651463753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c101de0 0x7fc02c1021c0 secure :-1 s=READY pgs=1307 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009900 tx=0x7fc01c02a410 comp rx=0 tx=0).stop 2024-09-19T04:40:42.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.096+0000 7fc03252e640 1 -- 172.21.15.70:0/651463753 shutdown_connections 2024-09-19T04:40:42.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.096+0000 7fc03252e640 1 --2- 172.21.15.70:0/651463753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc02c106f10 0x7fc02c10ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.096+0000 7fc03252e640 1 --2- 172.21.15.70:0/651463753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc02c102790 0x7fc02c1067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.096+0000 7fc03252e640 1 --2- 172.21.15.70:0/651463753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c101de0 0x7fc02c1021c0 unknown :-1 s=CLOSED pgs=1307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.096+0000 7fc03252e640 1 -- 172.21.15.70:0/651463753 >> 172.21.15.70:0/651463753 conn(0x7fc02c0fd8c0 msgr2=0x7fc02c0ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:42.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.097+0000 7fc03252e640 1 -- 172.21.15.70:0/651463753 shutdown_connections 2024-09-19T04:40:42.099 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.097+0000 7fc03252e640 1 -- 172.21.15.70:0/651463753 wait complete. 2024-09-19T04:40:42.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.097+0000 7fc03252e640 1 Processor -- start 2024-09-19T04:40:42.100 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.097+0000 7fc03252e640 1 -- start start 2024-09-19T04:40:42.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.097+0000 7fc03252e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc02c101de0 0x7fc02c0744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.097+0000 7fc03252e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc02c102790 0x7fc02c074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.097+0000 7fc03252e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c106f10 0x7fc02c074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.097+0000 7fc03252e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c111f40 con 0x7fc02c106f10 2024-09-19T04:40:42.101 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc03252e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c111dc0 con 0x7fc02c102790 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc03252e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1120c0 con 0x7fc02c101de0 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c106f10 0x7fc02c074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c106f10 0x7fc02c074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44032/0 (socket says 172.21.15.70:44032) 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 -- 172.21.15.70:0/3162684863 learned_addr learned my addr 172.21.15.70:0/3162684863 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc02c102790 0x7fc02c074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc02bfff640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc02c101de0 0x7fc02c0744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 -- 172.21.15.70:0/3162684863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc02c101de0 msgr2=0x7fc02c0744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc02c101de0 0x7fc02c0744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 -- 172.21.15.70:0/3162684863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc02c102790 msgr2=0x7fc02c074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.102 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc02c102790 0x7fc02c074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 -- 172.21.15.70:0/3162684863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc02c1a68b0 con 0x7fc02c106f10 2024-09-19T04:40:42.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc030acb640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c106f10 0x7fc02c074f70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fc02400cce0 tx=0x7fc02400a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:42.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc0297fa640 1 -- 172.21.15.70:0/3162684863 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc02400f450 con 0x7fc02c106f10 2024-09-19T04:40:42.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc03252e640 1 -- 172.21.15.70:0/3162684863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc02c1a6ba0 con 0x7fc02c106f10 2024-09-19T04:40:42.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc0297fa640 1 -- 172.21.15.70:0/3162684863 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc02400fac0 con 0x7fc02c106f10 2024-09-19T04:40:42.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc0297fa640 1 -- 172.21.15.70:0/3162684863 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc024018be0 con 0x7fc02c106f10 2024-09-19T04:40:42.103 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.098+0000 7fc03252e640 1 -- 172.21.15.70:0/3162684863 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc02c1a7090 con 0x7fc02c106f10 2024-09-19T04:40:42.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc0297fa640 1 -- 172.21.15.70:0/3162684863 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fc02400fc70 con 0x7fc02c106f10 2024-09-19T04:40:42.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc034907740 1 Processor -- start 2024-09-19T04:40:42.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc034907740 1 -- start start 2024-09-19T04:40:42.109 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc034907740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 0x5627219b2880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc034907740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b2dc0 0x5627219bd140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc034907740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219bd680 0x5627219bfa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc034907740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5627219182e0 con 0x5627219bd680 2024-09-19T04:40:42.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc034907740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5627218bfce0 con 0x5627219b24a0 2024-09-19T04:40:42.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc034907740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5627219142a0 con 0x5627219b2dc0 2024-09-19T04:40:42.110 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc02b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219bd680 0x5627219bfa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.111 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc0297fa640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0140a33b0 0x7fc0140a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc02b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219bd680 0x5627219bfa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44048/0 (socket says 172.21.15.70:44048) 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc02b7fe640 1 -- 172.21.15.70:0/635253116 learned_addr learned my addr 172.21.15.70:0/635253116 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.101+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 0x5627219b2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc02bfff640 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b2dc0 0x5627219bd140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc030acb640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0140a33b0 0x7fc0140a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc0297fa640 1 -- 172.21.15.70:0/3162684863 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7fc0240d0460 con 0x7fc02c106f10 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc02b7fe640 1 -- 172.21.15.70:0/635253116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b2dc0 msgr2=0x5627219bd140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b2dc0 0x5627219bd140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc02b7fe640 1 -- 172.21.15.70:0/635253116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 msgr2=0x5627219b2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 0x5627219b2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc02b7fe640 1 -- 172.21.15.70:0/635253116 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627218a4440 con 0x5627219bd680 2024-09-19T04:40:42.112 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219bd680 0x5627219bfa70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fc0200149c0 tx=0x7fc02000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ffaef7c0f15f3931 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc030acb640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0140a33b0 0x7fc0140a5870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc02409c440 tx=0x7fc024051980 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc0127fc640 1 -- 172.21.15.70:0/635253116 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc0200142d0 con 0x5627219bd680 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc0127fc640 1 -- 172.21.15.70:0/635253116 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc02000fc30 con 0x5627219bd680 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.102+0000 7fc0127fc640 1 -- 172.21.15.70:0/635253116 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc020012b20 con 0x5627219bd680 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 -- 172.21.15.70:0/635253116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219bd680 msgr2=0x5627219bfa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219bd680 0x5627219bfa70 secure :-1 s=READY pgs=1309 cs=0 l=1 rev1=1 crypto rx=0x7fc0200149c0 tx=0x7fc02000c4d0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 -- 172.21.15.70:0/635253116 shutdown_connections 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219bd680 0x5627219bfa70 unknown :-1 s=CLOSED pgs=1309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b2dc0 0x5627219bd140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 --2- 172.21.15.70:0/635253116 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 0x5627219b2880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.113 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 -- 172.21.15.70:0/635253116 >> 172.21.15.70:0/635253116 conn(0x5627219aea30 msgr2=0x5627219aee10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 -- 172.21.15.70:0/635253116 shutdown_connections 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 -- 172.21.15.70:0/635253116 wait complete. 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.103+0000 7fc034907740 1 -- start start 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc034907740 1 Processor -- start 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc034907740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 0x5627219bd010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc034907740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219ba2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc034907740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219ba840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc034907740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x5627219c0250 con 0x5627219b2dc0 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc034907740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x5627218d3050 con 0x5627219bd680 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc034907740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x5627219c03d0 con 0x5627219b24a0 2024-09-19T04:40:42.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc034907740 10 client.0 _ll_register_callbacks cb 0x562721913160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219ba2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219ba2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44054/0 (socket says 172.21.15.70:44054) 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 -- 172.21.15.70:0/3891464380 learned_addr learned my addr 172.21.15.70:0/3891464380 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 0x5627219bd010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219ba840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 -- 172.21.15.70:0/3891464380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 msgr2=0x5627219bd010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 0x5627219bd010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 -- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 msgr2=0x5627219ba840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219ba840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 -- 172.21.15.70:0/3891464380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627216893c0 con 0x5627219b2dc0 2024-09-19T04:40:42.115 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc00b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.104+0000 7fc02bfff640 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219ba2c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009900 tx=0x7fc01c0318f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ec757ef67a0618c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc00b7fe640 1 -- 172.21.15.70:0/3891464380 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c035040 con 0x5627219b2dc0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc00b7fe640 1 -- 172.21.15.70:0/3891464380 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7fc01c004240 con 0x5627219b2dc0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 1 -- 172.21.15.70:0/3891464380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc02000fc30 con 0x5627219b2dc0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc00b7fe640 1 -- 172.21.15.70:0/3891464380 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc01c004440 con 0x5627219b2dc0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 10 client.18192 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 1 -- 172.21.15.70:0/3891464380 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x5627219cbc40 con 0x5627219b2dc0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc00b7fe640 1 -- 172.21.15.70:0/3891464380 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc02000fc30 con 0x5627219b2dc0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc00b7fe640 1 -- 172.21.15.70:0/3891464380 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc01c004bf0 con 0x5627219b2dc0 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 10 client.18192 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 10 client.18192 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:42.116 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 20 client.18192 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5627219cd0a0 0x5627219cf4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 4 client.18192 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.105+0000 7fc034907740 1 -- 172.21.15.70:0/3891464380 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562721925850 con 0x5627219cd0a0 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.106+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5627219cd0a0 0x5627219cf4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.106+0000 7fc00b7fe640 10 client.18192 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.106+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5627219cd0a0 0x5627219cf4c0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19e10482a05ab311 server_cookie=ffe60d57b157bc10 in_seq=0 out_seq=0 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc00b7fe640 1 -- 172.21.15.70:0/3891464380 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x562721925850 con 0x5627219cd0a0 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc00b7fe640 10 client.18192 handle_command_reply: tid=0 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 client.18192 shutdown 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 -- 172.21.15.70:0/3891464380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 msgr2=0x5627219ba2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219ba2c0 secure :-1 s=READY pgs=1310 cs=0 l=1 rev1=1 crypto rx=0x7fc01c009900 tx=0x7fc01c0318f0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 -- 172.21.15.70:0/3891464380 shutdown_connections 2024-09-19T04:40:42.117 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x5627219cd0a0 0x5627219cf4c0 crc :-1 s=READY pgs=224 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219ba840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219ba2c0 unknown :-1 s=CLOSED pgs=1310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 --2- 172.21.15.70:0/3891464380 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 0x5627219bd010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 -- 172.21.15.70:0/3891464380 >> 172.21.15.70:0/3891464380 conn(0x5627219aea30 msgr2=0x5627219b4710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:42.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc00b7fe640 0 client.18192 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:42.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 -- 172.21.15.70:0/3891464380 shutdown_connections 2024-09-19T04:40:42.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 1 -- 172.21.15.70:0/3891464380 wait complete. 2024-09-19T04:40:42.118 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.107+0000 7fc034907740 20 client.18192 trim_cache size 0 max 16384 2024-09-19T04:40:42.126 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc034907740 1 Processor -- start 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc034907740 1 -- start start 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc034907740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 0x5627219c94b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc034907740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219b92a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc034907740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219bd680 0x5627219d4d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc034907740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1b2250 con 0x5627219b2dc0 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc034907740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1afb20 con 0x5627219b24a0 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc034907740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1ad990 con 0x5627219bd680 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219b92a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.127 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219b92a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44068/0 (socket says 172.21.15.70:44068) 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.124+0000 7fc02bfff640 1 -- 172.21.15.70:0/2848240605 learned_addr learned my addr 172.21.15.70:0/2848240605 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219bd680 0x5627219d4d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc02bfff640 1 -- 172.21.15.70:0/2848240605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219bd680 msgr2=0x5627219d4d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc02bfff640 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219bd680 0x5627219d4d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc02bfff640 1 -- 172.21.15.70:0/2848240605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 msgr2=0x5627219c94b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc02bfff640 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 0x5627219c94b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc02bfff640 1 -- 172.21.15.70:0/2848240605 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627219bd380 con 0x5627219b2dc0 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219bd680 0x5627219d4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:42.128 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc02bfff640 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219b92a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fc01c000c00 tx=0x7fc01c003ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b0a0a3df42613e7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc011ffb640 1 -- 172.21.15.70:0/2848240605 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c035040 con 0x5627219b2dc0 2024-09-19T04:40:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc011ffb640 1 -- 172.21.15.70:0/2848240605 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc01c003c50 con 0x5627219b2dc0 2024-09-19T04:40:42.129 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.125+0000 7fc011ffb640 1 -- 172.21.15.70:0/2848240605 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c031960 con 0x5627219b2dc0 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 -- 172.21.15.70:0/2848240605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 msgr2=0x5627219b92a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219b92a0 secure :-1 s=READY pgs=1311 cs=0 l=1 rev1=1 crypto rx=0x7fc01c000c00 tx=0x7fc01c003ac0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 -- 172.21.15.70:0/2848240605 shutdown_connections 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219bd680 0x5627219d4d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219b92a0 unknown :-1 s=CLOSED pgs=1311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 --2- 172.21.15.70:0/2848240605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219b24a0 0x5627219c94b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 -- 172.21.15.70:0/2848240605 >> 172.21.15.70:0/2848240605 conn(0x5627219aea30 msgr2=0x5627219b8b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 -- 172.21.15.70:0/2848240605 shutdown_connections 2024-09-19T04:40:42.133 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 -- 172.21.15.70:0/2848240605 wait complete. 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 -- start start 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 Processor -- start 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 0x5627219c5df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219c1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219c1680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.126+0000 7fc034907740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1adfe0 con 0x5627219b2dc0 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc034907740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1af450 con 0x5627219bd680 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc034907740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fc02c1ae6b0 con 0x5627219b24a0 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc034907740 10 client.0 _ll_register_callbacks cb 0x7fc01c031580 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219c1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219c1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:44072/0 (socket says 172.21.15.70:44072) 2024-09-19T04:40:42.134 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 -- 172.21.15.70:0/2115612400 learned_addr learned my addr 172.21.15.70:0/2115612400 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 0x5627219c5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 -- 172.21.15.70:0/2115612400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 msgr2=0x5627219c5df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219c1680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 0x5627219c5df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 -- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 msgr2=0x5627219c1680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219c1680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 -- 172.21.15.70:0/2115612400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627219c1eb0 con 0x5627219b2dc0 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219c1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc02bfff640 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219c1120 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fc01c006010 tx=0x7fc01c004030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e01944e3b5ad3b0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc00b7fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc00b7fe640 1 -- 172.21.15.70:0/2115612400 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc01c035050 con 0x5627219b2dc0 2024-09-19T04:40:42.135 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc034907740 1 -- 172.21.15.70:0/2115612400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc01c003c50 con 0x5627219b2dc0 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc00b7fe640 1 -- 172.21.15.70:0/2115612400 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7fc01c005000 con 0x5627219b2dc0 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc00b7fe640 1 -- 172.21.15.70:0/2115612400 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fc01c066050 con 0x5627219b2dc0 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc034907740 10 client.18198 fetch_fsmap learned FSMap version 34 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.127+0000 7fc034907740 1 -- 172.21.15.70:0/2115612400 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x562721a40580 con 0x5627219b2dc0 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc00b7fe640 1 -- 172.21.15.70:0/2115612400 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fc01c003c50 con 0x5627219b2dc0 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc00b7fe640 1 -- 172.21.15.70:0/2115612400 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fc01c04e480 con 0x5627219b2dc0 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc034907740 10 client.18198 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc034907740 10 client.18198 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:40:42.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc034907740 20 client.18198 populate_metadata read hostname 'smithi070' 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc034907740 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562721a40bb0 0x562721a42fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc034907740 4 client.18198 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc034907740 1 -- 172.21.15.70:0/2115612400 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56272191fd60 con 0x562721a40bb0 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.128+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562721a40bb0 0x562721a42fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc00b7fe640 10 client.18198 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc02b7fe640 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562721a40bb0 0x562721a42fd0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=58631d7dc4bf61af server_cookie=da2e64b84ef6f71f in_seq=0 out_seq=0 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc00b7fe640 1 -- 172.21.15.70:0/2115612400 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x56272191fd60 con 0x562721a40bb0 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc00b7fe640 10 client.18198 handle_command_reply: tid=0 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 client.18198 shutdown 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 -- 172.21.15.70:0/2115612400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 msgr2=0x5627219c1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219c1120 secure :-1 s=READY pgs=1312 cs=0 l=1 rev1=1 crypto rx=0x7fc01c006010 tx=0x7fc01c004030 comp rx=0 tx=0).stop 2024-09-19T04:40:42.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 -- 172.21.15.70:0/2115612400 shutdown_connections 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x562721a40bb0 0x562721a42fd0 crc :-1 s=READY pgs=225 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x5627219bd680 0x5627219c1680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x5627219b2dc0 0x5627219c1120 unknown :-1 s=CLOSED pgs=1312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 --2- 172.21.15.70:0/2115612400 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x5627219b24a0 0x5627219c5df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc00b7fe640 0 client.18198 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 -- 172.21.15.70:0/2115612400 >> 172.21.15.70:0/2115612400 conn(0x5627219aea30 msgr2=0x5627219ad220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 -- 172.21.15.70:0/2115612400 shutdown_connections 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 1 -- 172.21.15.70:0/2115612400 wait complete. 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.129+0000 7fc034907740 20 client.18198 trim_cache size 0 max 16384 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:40:42.138 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "IDLE (waiting for more scrubs)", 2024-09-19T04:40:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": { 2024-09-19T04:40:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "fcce3516-1045-4e24-8e13-4a5cfea3d940": { 2024-09-19T04:40:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "path": "/", 2024-09-19T04:40:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tag": "fcce3516-1045-4e24-8e13-4a5cfea3d940", 2024-09-19T04:40:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: "options": "recursive,force" 2024-09-19T04:40:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:40:42.139 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:40:42.139 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 -- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0140a33b0 msgr2=0x7fc0140a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0140a33b0 0x7fc0140a5870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fc02409c440 tx=0x7fc024051980 comp rx=0 tx=0).stop 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 -- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c106f10 msgr2=0x7fc02c074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c106f10 0x7fc02c074f70 secure :-1 s=READY pgs=1308 cs=0 l=1 rev1=1 crypto rx=0x7fc02400cce0 tx=0x7fc02400a620 comp rx=0 tx=0).stop 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 -- 172.21.15.70:0/3162684863 shutdown_connections 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fc0140a33b0 0x7fc0140a5870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fc02c106f10 0x7fc02c074f70 unknown :-1 s=CLOSED pgs=1308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc02c102790 0x7fc02c074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 --2- 172.21.15.70:0/3162684863 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fc02c101de0 0x7fc02c0744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:42.140 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 -- 172.21.15.70:0/3162684863 >> 172.21.15.70:0/3162684863 conn(0x7fc02c0fd8c0 msgr2=0x7fc02c0fec00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 -- 172.21.15.70:0/3162684863 shutdown_connections 2024-09-19T04:40:42.141 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:42.130+0000 7fc03252e640 1 -- 172.21.15.70:0/3162684863 wait complete. 2024-09-19T04:40:42.913 INFO:tasks.cephfs.filesystem:scrub status for tag:fcce3516-1045-4e24-8e13-4a5cfea3d940 - {'path': '/', 'tag': 'fcce3516-1045-4e24-8e13-4a5cfea3d940', 'options': 'recursive,force'} 2024-09-19T04:40:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:42 smithi134 ceph-mon[34525]: scrub summary: idle 2024-09-19T04:40:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:42 smithi134 ceph-mon[34525]: pgmap v309: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:43.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:42 smithi070 ceph-mon[30942]: scrub summary: idle 2024-09-19T04:40:43.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:42 smithi070 ceph-mon[30942]: pgmap v309: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:43.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:42 smithi167 ceph-mon[34339]: scrub summary: idle 2024-09-19T04:40:43.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:42 smithi167 ceph-mon[34339]: pgmap v309: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:44 smithi134 ceph-mon[34525]: pgmap v310: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:45.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:44 smithi070 ceph-mon[30942]: pgmap v310: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:45.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:44 smithi167 ceph-mon[34339]: pgmap v310: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:46 smithi134 ceph-mon[34525]: pgmap v311: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:47.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:46 smithi070 ceph-mon[30942]: pgmap v311: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:47.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:46 smithi167 ceph-mon[34339]: pgmap v311: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:48 smithi134 ceph-mon[34525]: pgmap v312: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:49.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:48 smithi070 ceph-mon[30942]: pgmap v312: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:49.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:48 smithi167 ceph-mon[34339]: pgmap v312: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:50 smithi134 ceph-mon[34525]: pgmap v313: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:51.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:50 smithi070 ceph-mon[30942]: pgmap v313: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:51.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:50 smithi167 ceph-mon[34339]: pgmap v313: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-09-19T04:40:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:52 smithi134 ceph-mon[34525]: pgmap v314: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:53.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:52 smithi070 ceph-mon[30942]: pgmap v314: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:53.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:52 smithi167 ceph-mon[34339]: pgmap v314: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 7 op/s 2024-09-19T04:40:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:54 smithi134 ceph-mon[34525]: pgmap v315: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:55.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:54 smithi070 ceph-mon[30942]: pgmap v315: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:54 smithi167 ceph-mon[34339]: pgmap v315: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:56 smithi134 ceph-mon[34525]: pgmap v316: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:57.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:56 smithi070 ceph-mon[30942]: pgmap v316: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:57.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:56 smithi167 ceph-mon[34339]: pgmap v316: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:40:58.569 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-09-19T04:40:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.681+0000 7f5d47406640 1 -- 172.21.15.70:0/1083515903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40107b80 msgr2=0x7f5d40107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.681+0000 7f5d47406640 1 --2- 172.21.15.70:0/1083515903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40107b80 0x7f5d40107f60 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f5d30009cd0 tx=0x7f5d3002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.681+0000 7f5d47406640 1 -- 172.21.15.70:0/1083515903 shutdown_connections 2024-09-19T04:40:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.681+0000 7f5d47406640 1 --2- 172.21.15.70:0/1083515903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d40102480 0x7f5d4010e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.681+0000 7f5d47406640 1 --2- 172.21.15.70:0/1083515903 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d40101ae0 0x7f5d40101f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.681+0000 7f5d47406640 1 --2- 172.21.15.70:0/1083515903 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40107b80 0x7f5d40107f60 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.685 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.681+0000 7f5d47406640 1 -- 172.21.15.70:0/1083515903 >> 172.21.15.70:0/1083515903 conn(0x7f5d400fd7e0 msgr2=0x7f5d400ffc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 -- 172.21.15.70:0/1083515903 shutdown_connections 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 -- 172.21.15.70:0/1083515903 wait complete. 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 Processor -- start 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 -- start start 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d40101ae0 0x7f5d401984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40102480 0x7f5d40198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d40107b80 0x7f5d4019cdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40111f80 con 0x7f5d40102480 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40111e00 con 0x7f5d40101ae0 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d47406640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5d40112100 con 0x7f5d40107b80 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.682+0000 7f5d449a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40102480 0x7f5d40198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d449a1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40102480 0x7f5d40198a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40860/0 (socket says 172.21.15.70:40860) 2024-09-19T04:40:58.686 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d449a1640 1 -- 172.21.15.70:0/979521925 learned_addr learned my addr 172.21.15.70:0/979521925 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d451a2640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d40101ae0 0x7f5d401984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d459a3640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d40107b80 0x7f5d4019cdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d449a1640 1 -- 172.21.15.70:0/979521925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d40107b80 msgr2=0x7f5d4019cdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d449a1640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d40107b80 0x7f5d4019cdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d449a1640 1 -- 172.21.15.70:0/979521925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d40101ae0 msgr2=0x7f5d401984f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d449a1640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d40101ae0 0x7f5d401984f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d449a1640 1 -- 172.21.15.70:0/979521925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5d4019d4e0 con 0x7f5d40102480 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d449a1640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40102480 0x7f5d40198a30 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b4a0 tx=0x7f5d3400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d3e7fc640 1 -- 172.21.15.70:0/979521925 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34014070 con 0x7f5d40102480 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d3e7fc640 1 -- 172.21.15.70:0/979521925 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5d34010ae0 con 0x7f5d40102480 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5d4019d7d0 con 0x7f5d40102480 2024-09-19T04:40:58.687 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d3e7fc640 1 -- 172.21.15.70:0/979521925 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5d34017c70 con 0x7f5d40102480 2024-09-19T04:40:58.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.683+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5d401a5060 con 0x7f5d40102480 2024-09-19T04:40:58.688 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.684+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5d40101fc0 con 0x7f5d40102480 2024-09-19T04:40:58.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.686+0000 7f5d3e7fc640 1 -- 172.21.15.70:0/979521925 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5d34017070 con 0x7f5d40102480 2024-09-19T04:40:58.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.686+0000 7f5d3e7fc640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5d280a3460 0x7f5d280a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:58.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.686+0000 7f5d451a2640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5d280a3460 0x7f5d280a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:58.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.686+0000 7f5d3e7fc640 1 -- 172.21.15.70:0/979521925 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f5d340cf720 con 0x7f5d40102480 2024-09-19T04:40:58.689 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.687+0000 7f5d451a2640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5d280a3460 0x7f5d280a5920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d30006010 tx=0x7f5d30009900 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:58.691 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.689+0000 7f5d3e7fc640 1 -- 172.21.15.70:0/979521925 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5d3409c210 con 0x7f5d40102480 2024-09-19T04:40:58.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.876+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f5d40062630 con 0x7f5d280a3460 2024-09-19T04:40:58.885 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.884+0000 7f5d3e7fc640 1 -- 172.21.15.70:0/979521925 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f5d40062630 con 0x7f5d280a3460 2024-09-19T04:40:58.885 INFO:teuthology.orchestra.run.smithi070.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-09-19T00:00:00", "created": "2024-09-19T04:30:57", "first": "2024-09-19T04:31:00", "last": "2024-09-19T04:40:00", "last_pruned": "2024-09-19T04:40:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-09-19T04:40:58.887 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5d280a3460 msgr2=0x7f5d280a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5d280a3460 0x7f5d280a5920 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f5d30006010 tx=0x7f5d30009900 comp rx=0 tx=0).stop 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40102480 msgr2=0x7f5d40198a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40102480 0x7f5d40198a30 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f5d3400b4a0 tx=0x7f5d3400b960 comp rx=0 tx=0).stop 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 shutdown_connections 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5d280a3460 0x7f5d280a5920 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5d40107b80 0x7f5d4019cdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5d40102480 0x7f5d40198a30 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 --2- 172.21.15.70:0/979521925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d40101ae0 0x7f5d401984f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 >> 172.21.15.70:0/979521925 conn(0x7f5d400fd7e0 msgr2=0x7f5d400fdf90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:58.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 shutdown_connections 2024-09-19T04:40:58.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.886+0000 7f5d47406640 1 -- 172.21.15.70:0/979521925 wait complete. 2024-09-19T04:40:58.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:58 smithi070 ceph-mon[30942]: pgmap v317: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:58.898 DEBUG:teuthology.orchestra.run.smithi070:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-09-19T04:40:59.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.997+0000 7f578bc4c640 1 -- 172.21.15.70:0/813964734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5784103640 msgr2=0x7f578410bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:59.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.997+0000 7f578bc4c640 1 --2- 172.21.15.70:0/813964734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5784103640 0x7f578410bb20 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f5778009900 tx=0x7f577802a480 comp rx=0 tx=0).stop 2024-09-19T04:40:59.001 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 -- 172.21.15.70:0/813964734 shutdown_connections 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 --2- 172.21.15.70:0/813964734 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f578410c0f0 0x7f578410e560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 --2- 172.21.15.70:0/813964734 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5784103640 0x7f578410bb20 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 --2- 172.21.15.70:0/813964734 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5784102d20 0x7f5784103100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 -- 172.21.15.70:0/813964734 >> 172.21.15.70:0/813964734 conn(0x7f5784077990 msgr2=0x7f57840fed20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 -- 172.21.15.70:0/813964734 shutdown_connections 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 -- 172.21.15.70:0/813964734 wait complete. 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 Processor -- start 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 -- start start 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5784102d20 0x7f57841982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5784103640 0x7f5784198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f578410c0f0 0x7f578419cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:59.002 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5784111e90 con 0x7f578410c0f0 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5784111d10 con 0x7f5784103640 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.998+0000 7f578bc4c640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5784112010 con 0x7f5784102d20 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f578410c0f0 0x7f578419cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f578410c0f0 0x7f578419cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:40872/0 (socket says 172.21.15.70:40872) 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 -- 172.21.15.70:0/3292975683 learned_addr learned my addr 172.21.15.70:0/3292975683 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f57891e7640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5784103640 0x7f5784198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f57899e8640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5784102d20 0x7f57841982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 -- 172.21.15.70:0/3292975683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5784102d20 msgr2=0x7f57841982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5784102d20 0x7f57841982e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 -- 172.21.15.70:0/3292975683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5784103640 msgr2=0x7f5784198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5784103640 0x7f5784198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 -- 172.21.15.70:0/3292975683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f578419d2d0 con 0x7f578410c0f0 2024-09-19T04:40:59.003 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578a1e9640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f578410c0f0 0x7f578419cba0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f577400eaa0 tx=0x7f577400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:59.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f5782ffd640 1 -- 172.21.15.70:0/3292975683 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f577400cdb0 con 0x7f578410c0f0 2024-09-19T04:40:59.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f5782ffd640 1 -- 172.21.15.70:0/3292975683 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5774005020 con 0x7f578410c0f0 2024-09-19T04:40:59.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f578419d5c0 con 0x7f578410c0f0 2024-09-19T04:40:59.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f5782ffd640 1 -- 172.21.15.70:0/3292975683 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57740116b0 con 0x7f578410c0f0 2024-09-19T04:40:59.004 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:58.999+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57841a4e50 con 0x7f578410c0f0 2024-09-19T04:40:59.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.000+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5784103100 con 0x7f578410c0f0 2024-09-19T04:40:59.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.001+0000 7f5782ffd640 1 -- 172.21.15.70:0/3292975683 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f57740051d0 con 0x7f578410c0f0 2024-09-19T04:40:59.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.002+0000 7f5782ffd640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f576c0a3460 0x7f576c0a5920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:40:59.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.002+0000 7f57899e8640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f576c0a3460 0x7f576c0a5920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:40:59.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.002+0000 7f5782ffd640 1 -- 172.21.15.70:0/3292975683 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(92..92 src has 1..92) ==== 8527+0+0 (secure 0 0 0) 0x7f57740cfed0 con 0x7f578410c0f0 2024-09-19T04:40:59.005 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.002+0000 7f57899e8640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f576c0a3460 0x7f576c0a5920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f577c00ba40 tx=0x7f577c005cc0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:40:59.007 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.006+0000 7f5782ffd640 1 -- 172.21.15.70:0/3292975683 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5774016030 con 0x7f578410c0f0 2024-09-19T04:40:59.013 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:58 smithi167 ceph-mon[34339]: pgmap v317: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:59.037 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:58 smithi134 ceph-mon[34525]: pgmap v317: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:40:59.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.193+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 --> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f57840fd730 con 0x7f576c0a3460 2024-09-19T04:40:59.201 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.200+0000 7f5782ffd640 1 -- 172.21.15.70:0/3292975683 <== mgr.15138 v2:172.21.15.70:6800/4033699978 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f57840fd730 con 0x7f576c0a3460 2024-09-19T04:40:59.202 INFO:teuthology.orchestra.run.smithi070.stdout:/ 1m 6m3h 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f576c0a3460 msgr2=0x7f576c0a5920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f576c0a3460 0x7f576c0a5920 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f577c00ba40 tx=0x7f577c005cc0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f578410c0f0 msgr2=0x7f578419cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f578410c0f0 0x7f578419cba0 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f577400eaa0 tx=0x7f577400ef60 comp rx=0 tx=0).stop 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 shutdown_connections 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f576c0a3460 0x7f576c0a5920 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f578410c0f0 0x7f578419cba0 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5784103640 0x7f5784198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 --2- 172.21.15.70:0/3292975683 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5784102d20 0x7f57841982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 >> 172.21.15.70:0/3292975683 conn(0x7f5784077990 msgr2=0x7f57840fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:40:59.204 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 shutdown_connections 2024-09-19T04:40:59.205 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:40:59.202+0000 7f578bc4c640 1 -- 172.21.15.70:0/3292975683 wait complete. 2024-09-19T04:40:59.214 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-09-19T04:40:59.225 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-09-19T04:41:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:59 smithi134 ceph-mon[34525]: from='client.18204 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:00.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:40:59 smithi134 ceph-mon[34525]: from='client.18210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:00.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:59 smithi070 ceph-mon[30942]: from='client.18204 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:00.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:40:59 smithi070 ceph-mon[30942]: from='client.18210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:00.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:59 smithi167 ceph-mon[34339]: from='client.18204 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:00.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:40:59 smithi167 ceph-mon[34339]: from='client.18210 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-09-19T04:41:01.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:00 smithi134 ceph-mon[34525]: pgmap v318: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:01.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:00 smithi070 ceph-mon[30942]: pgmap v318: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:01.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:00 smithi167 ceph-mon[34339]: pgmap v318: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:03.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:02 smithi134 ceph-mon[34525]: pgmap v319: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-19T04:41:03.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:02 smithi070 ceph-mon[30942]: pgmap v319: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-19T04:41:03.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:02 smithi167 ceph-mon[34339]: pgmap v319: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-09-19T04:41:05.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:04 smithi134 ceph-mon[34525]: pgmap v320: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:41:05.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:04 smithi070 ceph-mon[30942]: pgmap v320: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:41:05.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:04 smithi167 ceph-mon[34339]: pgmap v320: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:41:06.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:05 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:06.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:05 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:06.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:05 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-09-19T04:41:07.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:06 smithi134 ceph-mon[34525]: pgmap v321: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:41:07.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:06 smithi070 ceph-mon[30942]: pgmap v321: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:41:07.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:06 smithi167 ceph-mon[34339]: pgmap v321: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 24 op/s 2024-09-19T04:41:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.285 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: Unable to set osd_memory_target on smithi167 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T04:41:08.286 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: Unable to set osd_memory_target on smithi070 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: Unable to set osd_memory_target on smithi134 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T04:41:08.287 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:08.288 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:08.288 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:08 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.395 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: Unable to set osd_memory_target on smithi167 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-19T04:41:08.396 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: Unable to set osd_memory_target on smithi070 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: Unable to set osd_memory_target on smithi134 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:08.397 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:08 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:08.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.461 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi167 to 176.0M 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: Unable to set osd_memory_target on smithi167 to 184581017: error parsing value: Value '184581017' is below minimum 939524096 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi070 to 176.0M 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: Unable to set osd_memory_target on smithi070 to 184560947: error parsing value: Value '184560947' is below minimum 939524096 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.462 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-09-19T04:41:08.463 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: Adjusting osd_memory_target on smithi134 to 176.0M 2024-09-19T04:41:08.463 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: Unable to set osd_memory_target on smithi134 to 184585318: error parsing value: Value '184585318' is below minimum 939524096 2024-09-19T04:41:08.463 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-09-19T04:41:08.463 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-09-19T04:41:08.463 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:08 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' 2024-09-19T04:41:09.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:09 smithi134 ceph-mon[34525]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T04:41:09.787 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:09 smithi134 ceph-mon[34525]: pgmap v323: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T04:41:09.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:09 smithi070 ceph-mon[30942]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T04:41:09.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:09 smithi070 ceph-mon[30942]: pgmap v323: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T04:41:09.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:09 smithi167 ceph-mon[34339]: osdmap e93: 12 total, 12 up, 12 in 2024-09-19T04:41:09.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:09 smithi167 ceph-mon[34339]: pgmap v323: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T04:41:11.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:10 smithi134 ceph-mon[34525]: pgmap v324: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T04:41:11.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:10 smithi070 ceph-mon[30942]: pgmap v324: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T04:41:11.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:10 smithi167 ceph-mon[34339]: pgmap v324: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 17 KiB/s rd, 53 KiB/s wr, 29 op/s 2024-09-19T04:41:12.914 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-09-19T04:41:13.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:12 smithi134 ceph-mon[34525]: pgmap v325: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:13.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:12 smithi070 ceph-mon[30942]: pgmap v325: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:13.173 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:13.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:12 smithi167 ceph-mon[34339]: pgmap v325: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 -- 172.21.15.70:0/3087694208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c102ef0 msgr2=0x7f670c10da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 --2- 172.21.15.70:0/3087694208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c102ef0 0x7f670c10da40 secure :-1 s=READY pgs=1317 cs=0 l=1 rev1=1 crypto rx=0x7f6704009ca0 tx=0x7f670402a950 comp rx=0 tx=0).stop 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 -- 172.21.15.70:0/3087694208 shutdown_connections 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 --2- 172.21.15.70:0/3087694208 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c102ef0 0x7f670c10da40 unknown :-1 s=CLOSED pgs=1317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 --2- 172.21.15.70:0/3087694208 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f670c102570 0x7f670c1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 --2- 172.21.15.70:0/3087694208 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c100e20 0x7f670c101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 -- 172.21.15.70:0/3087694208 >> 172.21.15.70:0/3087694208 conn(0x7f670c0fc7d0 msgr2=0x7f670c0febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 -- 172.21.15.70:0/3087694208 shutdown_connections 2024-09-19T04:41:13.719 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 -- 172.21.15.70:0/3087694208 wait complete. 2024-09-19T04:41:13.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 Processor -- start 2024-09-19T04:41:13.720 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.717+0000 7f67113c8640 1 -- start start 2024-09-19T04:41:13.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f67113c8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c100e20 0x7f670c1984f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f67113c8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f670c102570 0x7f670c198a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.721 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f67113c8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c102ef0 0x7f670c19cdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f67113c8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f670c110f90 con 0x7f670c100e20 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f67113c8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f670c110e10 con 0x7f670c102ef0 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f67113c8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f670c111110 con 0x7f670c102570 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c100e20 0x7f670c1984f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c100e20 0x7f670c1984f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41258/0 (socket says 172.21.15.70:41258) 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 -- 172.21.15.70:0/3674289748 learned_addr learned my addr 172.21.15.70:0/3674289748 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670a7fc640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f670c102570 0x7f670c198a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670b7fe640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c102ef0 0x7f670c19cdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 -- 172.21.15.70:0/3674289748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f670c102570 msgr2=0x7f670c198a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f670c102570 0x7f670c198a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 -- 172.21.15.70:0/3674289748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c102ef0 msgr2=0x7f670c19cdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c102ef0 0x7f670c19cdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.722 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 -- 172.21.15.70:0/3674289748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f670c19d4a0 con 0x7f670c100e20 2024-09-19T04:41:13.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f670affd640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c100e20 0x7f670c1984f0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00d950 tx=0x7f66fc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:13.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.718+0000 7f66f3fff640 1 -- 172.21.15.70:0/3674289748 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc017070 con 0x7f670c100e20 2024-09-19T04:41:13.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.719+0000 7f66f3fff640 1 -- 172.21.15.70:0/3674289748 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f66fc00de80 con 0x7f670c100e20 2024-09-19T04:41:13.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.719+0000 7f66f3fff640 1 -- 172.21.15.70:0/3674289748 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc00f620 con 0x7f670c100e20 2024-09-19T04:41:13.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.719+0000 7f67113c8640 1 -- 172.21.15.70:0/3674289748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f670c19d790 con 0x7f670c100e20 2024-09-19T04:41:13.723 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.719+0000 7f67113c8640 1 -- 172.21.15.70:0/3674289748 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f670c1a5070 con 0x7f670c100e20 2024-09-19T04:41:13.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f66f3fff640 1 -- 172.21.15.70:0/3674289748 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f66fc009c30 con 0x7f670c100e20 2024-09-19T04:41:13.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f67137a1740 1 Processor -- start 2024-09-19T04:41:13.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f67137a1740 1 -- start start 2024-09-19T04:41:13.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f67137a1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef297780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f67137a1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2a6550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f67137a1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2a8e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f67137a1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55baef1fd2e0 con 0x55baef297cc0 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f67137a1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55baef1a4ce0 con 0x55baef2973a0 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f67137a1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55baef1f92a0 con 0x55baef2a6a90 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f66f3fff640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f66f40a33b0 0x7f66f40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.721+0000 7f670affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2a6550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2a6550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41264/0 (socket says 172.21.15.70:41264) 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670affd640 1 -- 172.21.15.70:0/533373765 learned_addr learned my addr 172.21.15.70:0/533373765 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670b7fe640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f66f40a33b0 0x7f66f40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670a7fc640 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2a8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f66f3fff640 1 -- 172.21.15.70:0/3674289748 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f66fc0cfa00 con 0x7f670c100e20 2024-09-19T04:41:13.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670b7fe640 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef297780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670affd640 1 -- 172.21.15.70:0/533373765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 msgr2=0x55baef2a8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670affd640 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2a8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670affd640 1 -- 172.21.15.70:0/533373765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 msgr2=0x55baef297780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670affd640 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef297780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670affd640 1 -- 172.21.15.70:0/533373765 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baef189440 con 0x55baef297cc0 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670affd640 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2a6550 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f66fc09bc40 tx=0x7f66fc06eae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aa16d42cd9441ee server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f670b7fe640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f66f40a33b0 0x7f66f40a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6704005e30 tx=0x7f6704005d80 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f66f17fa640 1 -- 172.21.15.70:0/533373765 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc020040 con 0x55baef297cc0 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f66f17fa640 1 -- 172.21.15.70:0/533373765 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f66fc09c3b0 con 0x55baef297cc0 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.722+0000 7f66f17fa640 1 -- 172.21.15.70:0/533373765 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc0a4920 con 0x55baef297cc0 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 -- 172.21.15.70:0/533373765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 msgr2=0x55baef2a6550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2a6550 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7f66fc09bc40 tx=0x7f66fc06eae0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 -- 172.21.15.70:0/533373765 shutdown_connections 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2a8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2a6550 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 --2- 172.21.15.70:0/533373765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef297780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 -- 172.21.15.70:0/533373765 >> 172.21.15.70:0/533373765 conn(0x55baef293a30 msgr2=0x55baef293e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 -- 172.21.15.70:0/533373765 shutdown_connections 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 -- 172.21.15.70:0/533373765 wait complete. 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 -- start start 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.723+0000 7f67137a1740 1 Processor -- start 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f67137a1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2973a0 0x55baef2a6450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f67137a1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 0x55baef2a3700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f67137a1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2a3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f67137a1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55baef2a9600 con 0x55baef2973a0 2024-09-19T04:41:13.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f67137a1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55baef1b8050 con 0x55baef297cc0 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f67137a1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55baef2a9780 con 0x55baef2a6a90 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f67137a1740 10 client.0 _ll_register_callbacks cb 0x55baef1f8160 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2973a0 0x55baef2a6450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2973a0 0x55baef2a6450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41278/0 (socket says 172.21.15.70:41278) 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 -- 172.21.15.70:0/42028424 learned_addr learned my addr 172.21.15.70:0/42028424 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670a7fc640 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 0x55baef2a3700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670b7fe640 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2a3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 -- 172.21.15.70:0/42028424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 msgr2=0x55baef2a3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2a3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 -- 172.21.15.70:0/42028424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 msgr2=0x55baef2a3700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 0x55baef2a3700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 -- 172.21.15.70:0/42028424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baeef6e3c0 con 0x55baef2973a0 2024-09-19T04:41:13.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f670affd640 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2973a0 0x55baef2a6450 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f66fc098680 tx=0x7f66fc09a1c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74a04a453c58c877 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f66eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f66eeff5640 1 -- 172.21.15.70:0/42028424 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66fc014030 con 0x55baef2973a0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f67137a1740 1 -- 172.21.15.70:0/42028424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66fc09c3b0 con 0x55baef2973a0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f66eeff5640 1 -- 172.21.15.70:0/42028424 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f66fc066760 con 0x55baef2973a0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.724+0000 7f66eeff5640 1 -- 172.21.15.70:0/42028424 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f66fc020070 con 0x55baef2973a0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f67137a1740 10 client.18222 fetch_fsmap learned FSMap version 34 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f67137a1740 1 -- 172.21.15.70:0/42028424 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55baef2b5060 con 0x55baef2973a0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f66eeff5640 1 -- 172.21.15.70:0/42028424 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f66fc09c3b0 con 0x55baef2973a0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f66eeff5640 1 -- 172.21.15.70:0/42028424 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f66fc0cd3a0 con 0x55baef2973a0 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f67137a1740 10 client.18222 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f67137a1740 10 client.18222 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f67137a1740 20 client.18222 populate_metadata read hostname 'smithi070' 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f67137a1740 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55baef2b63b0 0x55baef2b87a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f67137a1740 4 client.18222 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f67137a1740 1 -- 172.21.15.70:0/42028424 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55baef20a850 con 0x55baef2b63b0 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.725+0000 7f670a7fc640 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55baef2b63b0 0x55baef2b87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f670a7fc640 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55baef2b63b0 0x55baef2b87a0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e9df926f02ac465 server_cookie=555517223570b59a in_seq=0 out_seq=0 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f66eeff5640 10 client.18222 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f66eeff5640 1 -- 172.21.15.70:0/42028424 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55baef20a850 con 0x55baef2b63b0 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f66eeff5640 10 client.18222 handle_command_reply: tid=0 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 client.18222 shutdown 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 -- 172.21.15.70:0/42028424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2973a0 msgr2=0x55baef2a6450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2973a0 0x55baef2a6450 secure :-1 s=READY pgs=1320 cs=0 l=1 rev1=1 crypto rx=0x7f66fc098680 tx=0x7f66fc09a1c0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 -- 172.21.15.70:0/42028424 shutdown_connections 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55baef2b63b0 0x55baef2b87a0 crc :-1 s=READY pgs=226 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2a3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f66eeff5640 0 client.18222 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:41:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 0x55baef2a3700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 --2- 172.21.15.70:0/42028424 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2973a0 0x55baef2a6450 unknown :-1 s=CLOSED pgs=1320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.726+0000 7f67137a1740 1 -- 172.21.15.70:0/42028424 >> 172.21.15.70:0/42028424 conn(0x55baef293a30 msgr2=0x55baef299790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.727+0000 7f67137a1740 1 -- 172.21.15.70:0/42028424 shutdown_connections 2024-09-19T04:41:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.727+0000 7f67137a1740 1 -- 172.21.15.70:0/42028424 wait complete. 2024-09-19T04:41:13.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.727+0000 7f67137a1740 20 client.18222 trim_cache size 0 max 16384 2024-09-19T04:41:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f67137a1740 1 Processor -- start 2024-09-19T04:41:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f67137a1740 1 -- start start 2024-09-19T04:41:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f67137a1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef2b28a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f67137a1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2bdd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f67137a1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2be280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f67137a1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1adfb0 con 0x55baef297cc0 2024-09-19T04:41:13.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f67137a1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1ab880 con 0x55baef2973a0 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f67137a1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1a96d0 con 0x55baef2a6a90 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f670a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2bdd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f670a7fc640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2bdd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41280/0 (socket says 172.21.15.70:41280) 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.743+0000 7f670a7fc640 1 -- 172.21.15.70:0/2747479762 learned_addr learned my addr 172.21.15.70:0/2747479762 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670b7fe640 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2be280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670a7fc640 1 -- 172.21.15.70:0/2747479762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 msgr2=0x55baef2be280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670a7fc640 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2be280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670a7fc640 1 -- 172.21.15.70:0/2747479762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 msgr2=0x55baef2b28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:13.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670affd640 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef2b28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670a7fc640 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef2b28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670a7fc640 1 -- 172.21.15.70:0/2747479762 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55baef2a4060 con 0x55baef297cc0 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670affd640 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef2b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670b7fe640 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f670a7fc640 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2bdd40 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f6700009bb0 tx=0x7f6700009110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5793e094fcac8a80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f66f0ff9640 1 -- 172.21.15.70:0/2747479762 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700015a10 con 0x55baef297cc0 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f66f0ff9640 1 -- 172.21.15.70:0/2747479762 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6700025070 con 0x55baef297cc0 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.744+0000 7f66f0ff9640 1 -- 172.21.15.70:0/2747479762 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6700014670 con 0x55baef297cc0 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- 172.21.15.70:0/2747479762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 msgr2=0x55baef2bdd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2bdd40 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f6700009bb0 tx=0x7f6700009110 comp rx=0 tx=0).stop 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- 172.21.15.70:0/2747479762 shutdown_connections 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2a6a90 0x55baef2be280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef297cc0 0x55baef2bdd40 unknown :-1 s=CLOSED pgs=1321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 --2- 172.21.15.70:0/2747479762 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef2973a0 0x55baef2b28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- 172.21.15.70:0/2747479762 >> 172.21.15.70:0/2747479762 conn(0x55baef293a30 msgr2=0x55baef2a27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- 172.21.15.70:0/2747479762 shutdown_connections 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- 172.21.15.70:0/2747479762 wait complete. 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- start start 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 Processor -- start 2024-09-19T04:41:13.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2973a0 0x55baef319070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 0x55baef3195b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2a6a90 0x55baef2a9fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1a9d40 con 0x55baef2a6a90 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1ab1b0 con 0x55baef297cc0 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f670c1aa410 con 0x55baef2973a0 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f67137a1740 10 client.0 _ll_register_callbacks cb 0x7f6704009b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.745+0000 7f670b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2a6a90 0x55baef2a9fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670b7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2a6a90 0x55baef2a9fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41288/0 (socket says 172.21.15.70:41288) 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670b7fe640 1 -- 172.21.15.70:0/3127301797 learned_addr learned my addr 172.21.15.70:0/3127301797 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:13.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670affd640 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2973a0 0x55baef319070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670a7fc640 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 0x55baef3195b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670b7fe640 1 -- 172.21.15.70:0/3127301797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2973a0 msgr2=0x55baef319070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670b7fe640 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2973a0 0x55baef319070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670b7fe640 1 -- 172.21.15.70:0/3127301797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 msgr2=0x55baef3195b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670b7fe640 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 0x55baef3195b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670b7fe640 1 -- 172.21.15.70:0/3127301797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55baef2aa7b0 con 0x55baef2a6a90 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f670b7fe640 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2a6a90 0x55baef2a9fb0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f670402fa10 tx=0x7f670402a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9f6eb436bc3aabfb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f66eeff5640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f66eeff5640 1 -- 172.21.15.70:0/3127301797 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6704034040 con 0x55baef2a6a90 2024-09-19T04:41:13.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f66eeff5640 1 -- 172.21.15.70:0/3127301797 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(93..93 src has 1..93) ==== 8571+0+0 (secure 0 0 0) 0x7f6704004100 con 0x55baef2a6a90 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f67137a1740 1 -- 172.21.15.70:0/3127301797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6700025070 con 0x55baef2a6a90 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f66eeff5640 1 -- 172.21.15.70:0/3127301797 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f6704004300 con 0x55baef2a6a90 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f67137a1740 10 client.18228 fetch_fsmap learned FSMap version 34 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.746+0000 7f67137a1740 1 -- 172.21.15.70:0/3127301797 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55baef320790 con 0x55baef2a6a90 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f66eeff5640 1 -- 172.21.15.70:0/3127301797 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f6700025070 con 0x55baef2a6a90 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f66eeff5640 1 -- 172.21.15.70:0/3127301797 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f6704030b50 con 0x55baef2a6a90 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f67137a1740 10 client.18228 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f67137a1740 10 client.18228 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:41:13.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f67137a1740 20 client.18228 populate_metadata read hostname 'smithi070' 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f67137a1740 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55baef320f60 0x55baef323380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f67137a1740 4 client.18228 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f67137a1740 1 -- 172.21.15.70:0/3127301797 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55baef204d60 con 0x55baef320f60 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.747+0000 7f670affd640 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55baef320f60 0x55baef323380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f66eeff5640 10 client.18228 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f670affd640 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55baef320f60 0x55baef323380 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=93b4a75623dbc3e9 server_cookie=3c3ee82c9afee51b in_seq=0 out_seq=0 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f66eeff5640 1 -- 172.21.15.70:0/3127301797 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x55baef204d60 con 0x55baef320f60 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f66eeff5640 10 client.18228 handle_command_reply: tid=0 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 client.18228 shutdown 2024-09-19T04:41:13.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 -- 172.21.15.70:0/3127301797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2a6a90 msgr2=0x55baef2a9fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2a6a90 0x55baef2a9fb0 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f670402fa10 tx=0x7f670402a950 comp rx=0 tx=0).stop 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 -- 172.21.15.70:0/3127301797 shutdown_connections 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x55baef320f60 0x55baef323380 crc :-1 s=READY pgs=227 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f66eeff5640 0 client.18228 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55baef2a6a90 0x55baef2a9fb0 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55baef297cc0 0x55baef3195b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 --2- 172.21.15.70:0/3127301797 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55baef2973a0 0x55baef319070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 -- 172.21.15.70:0/3127301797 >> 172.21.15.70:0/3127301797 conn(0x55baef293a30 msgr2=0x55baef29e4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 -- 172.21.15.70:0/3127301797 shutdown_connections 2024-09-19T04:41:13.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 1 -- 172.21.15.70:0/3127301797 wait complete. 2024-09-19T04:41:13.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.748+0000 7f67137a1740 20 client.18228 trim_cache size 0 max 16384 2024-09-19T04:41:13.761 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:41:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "status": "no active scrubs running", 2024-09-19T04:41:13.761 INFO:teuthology.orchestra.run.smithi070.stdout: "scrubs": {} 2024-09-19T04:41:13.761 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:41:13.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 -- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f66f40a33b0 msgr2=0x7f66f40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f66f40a33b0 0x7f66f40a5870 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f6704005e30 tx=0x7f6704005d80 comp rx=0 tx=0).stop 2024-09-19T04:41:13.762 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 -- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c100e20 msgr2=0x7f670c1984f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c100e20 0x7f670c1984f0 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7f66fc00d950 tx=0x7f66fc00dd50 comp rx=0 tx=0).stop 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 -- 172.21.15.70:0/3674289748 shutdown_connections 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f66f40a33b0 0x7f66f40a5870 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f670c102ef0 0x7f670c19cdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f670c102570 0x7f670c198a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 --2- 172.21.15.70:0/3674289748 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f670c100e20 0x7f670c1984f0 unknown :-1 s=CLOSED pgs=1318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 -- 172.21.15.70:0/3674289748 >> 172.21.15.70:0/3674289748 conn(0x7f670c0fc7d0 msgr2=0x7f670c06a1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 -- 172.21.15.70:0/3674289748 shutdown_connections 2024-09-19T04:41:13.763 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:13.749+0000 7f67113c8640 1 -- 172.21.15.70:0/3674289748 wait complete. 2024-09-19T04:41:14.513 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-09-19T04:41:14.513 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:41:14.762 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 -- 172.21.15.70:0/370725371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 msgr2=0x7f1ab410ea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 --2- 172.21.15.70:0/370725371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 0x7f1ab410ea90 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7f1aac009ca0 tx=0x7f1aac02a8c0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 -- 172.21.15.70:0/370725371 shutdown_connections 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 --2- 172.21.15.70:0/370725371 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 0x7f1ab410ea90 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 --2- 172.21.15.70:0/370725371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab4102790 0x7f1ab41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 --2- 172.21.15.70:0/370725371 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab4101de0 0x7f1ab41021c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 -- 172.21.15.70:0/370725371 >> 172.21.15.70:0/370725371 conn(0x7f1ab40fd8c0 msgr2=0x7f1ab40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 -- 172.21.15.70:0/370725371 shutdown_connections 2024-09-19T04:41:15.228 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.219+0000 7f1ab990e640 1 -- 172.21.15.70:0/370725371 wait complete. 2024-09-19T04:41:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab990e640 1 Processor -- start 2024-09-19T04:41:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab990e640 1 -- start start 2024-09-19T04:41:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab990e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab4101de0 0x7f1ab40744f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab990e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab4102790 0x7f1ab4074a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab990e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 0x7f1ab4074f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:15.229 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab990e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4111f40 con 0x7f1ab4106f10 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab990e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab4111dc0 con 0x7f1ab4101de0 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab990e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f1ab41120c0 con 0x7f1ab4102790 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 0x7f1ab4074f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 0x7f1ab4074f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41308/0 (socket says 172.21.15.70:41308) 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab37fe640 1 -- 172.21.15.70:0/3909058970 learned_addr learned my addr 172.21.15.70:0/3909058970 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1aabfff640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab4102790 0x7f1ab4074a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.220+0000 7f1ab2ffd640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab4101de0 0x7f1ab40744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab37fe640 1 -- 172.21.15.70:0/3909058970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab4102790 msgr2=0x7f1ab4074a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab37fe640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab4102790 0x7f1ab4074a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab37fe640 1 -- 172.21.15.70:0/3909058970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab4101de0 msgr2=0x7f1ab40744f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:15.233 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab37fe640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab4101de0 0x7f1ab40744f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab37fe640 1 -- 172.21.15.70:0/3909058970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ab41a68e0 con 0x7f1ab4106f10 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab2ffd640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab4101de0 0x7f1ab40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab37fe640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 0x7f1ab4074f70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f1aac033040 tx=0x7f1aac003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab890c640 1 -- 172.21.15.70:0/3909058970 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac0316d0 con 0x7f1ab4106f10 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab890c640 1 -- 172.21.15.70:0/3909058970 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f1aac031870 con 0x7f1ab4106f10 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ab41a6b70 con 0x7f1ab4106f10 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab890c640 1 -- 172.21.15.70:0/3909058970 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1aac02fc30 con 0x7f1ab4106f10 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.221+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ab41a7100 con 0x7f1ab4106f10 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.222+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1ab41021c0 con 0x7f1ab4106f10 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.224+0000 7f1ab890c640 1 -- 172.21.15.70:0/3909058970 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f1aac004040 con 0x7f1ab4106f10 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.225+0000 7f1ab890c640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1aa00a3430 0x7f1aa00a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.225+0000 7f1ab2ffd640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1aa00a3430 0x7f1aa00a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:15.234 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.225+0000 7f1ab890c640 1 -- 172.21.15.70:0/3909058970 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f1aac0f1460 con 0x7f1ab4106f10 2024-09-19T04:41:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.225+0000 7f1ab2ffd640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1aa00a3430 0x7f1aa00a58f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009b40 tx=0x7f1aa4005e50 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:15.235 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.228+0000 7f1ab890c640 1 -- 172.21.15.70:0/3909058970 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f1aac0bdf50 con 0x7f1ab4106f10 2024-09-19T04:41:15.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.429+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1ab4075a20 con 0x7f1ab4106f10 2024-09-19T04:41:15.431 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.430+0000 7f1ab890c640 1 -- 172.21.15.70:0/3909058970 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f1ab4075a20 con 0x7f1ab4106f10 2024-09-19T04:41:15.432 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:41:15.432 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:41:15.432 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1aa00a3430 msgr2=0x7f1aa00a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1aa00a3430 0x7f1aa00a58f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f1aa4009b40 tx=0x7f1aa4005e50 comp rx=0 tx=0).stop 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 msgr2=0x7f1ab4074f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 0x7f1ab4074f70 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7f1aac033040 tx=0x7f1aac003f10 comp rx=0 tx=0).stop 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 shutdown_connections 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f1aa00a3430 0x7f1aa00a58f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f1ab4106f10 0x7f1ab4074f70 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f1ab4102790 0x7f1ab4074a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 --2- 172.21.15.70:0/3909058970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ab4101de0 0x7f1ab40744f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 >> 172.21.15.70:0/3909058970 conn(0x7f1ab40fd8c0 msgr2=0x7f1ab40febe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 shutdown_connections 2024-09-19T04:41:15.434 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:15.432+0000 7f1ab990e640 1 -- 172.21.15.70:0/3909058970 wait complete. 2024-09-19T04:41:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:15 smithi134 ceph-mon[34525]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T04:41:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:15 smithi134 ceph-mon[34525]: pgmap v327: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T04:41:15.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:15 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3909058970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:15.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:15 smithi070 ceph-mon[30942]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T04:41:15.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:15 smithi070 ceph-mon[30942]: pgmap v327: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T04:41:15.886 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:15 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3909058970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:15 smithi167 ceph-mon[34339]: osdmap e94: 12 total, 12 up, 12 in 2024-09-19T04:41:15.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:15 smithi167 ceph-mon[34339]: pgmap v327: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 255 B/s wr, 7 op/s 2024-09-19T04:41:15.961 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:15 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3909058970' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:16.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-09-19T04:41:16.270 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:16.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 -- 172.21.15.70:0/3098587969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8106f50 msgr2=0x7f2ff810eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/3098587969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8106f50 0x7f2ff810eaf0 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0009cd0 tx=0x7f2ff002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 -- 172.21.15.70:0/3098587969 shutdown_connections 2024-09-19T04:41:16.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/3098587969 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8106f50 0x7f2ff810eaf0 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/3098587969 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff8100d00 0x7f2ff8106840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/3098587969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff8100350 0x7f2ff8100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 -- 172.21.15.70:0/3098587969 >> 172.21.15.70:0/3098587969 conn(0x7f2ff8077210 msgr2=0x7f2ff80fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 -- 172.21.15.70:0/3098587969 shutdown_connections 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.739+0000 7f2ffce5e640 1 -- 172.21.15.70:0/3098587969 wait complete. 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ffce5e640 1 Processor -- start 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ffce5e640 1 -- start start 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ffce5e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff8100350 0x7f2ff81012d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ffce5e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8100d00 0x7f2ff8101810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ffce5e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff8106f50 0x7f2ff8101d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ffce5e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8112010 con 0x7f2ff8100d00 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ffce5e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8111e90 con 0x7f2ff8100350 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ffce5e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff8112190 con 0x7f2ff8106f50 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2fedd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8100d00 0x7f2ff8101810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2fedd9b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8100d00 0x7f2ff8101810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41336/0 (socket says 172.21.15.70:41336) 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2fedd9b640 1 -- 172.21.15.70:0/2383374866 learned_addr learned my addr 172.21.15.70:0/2383374866 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.740+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff8106f50 0x7f2ff8101d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2ff659c640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff8100350 0x7f2ff81012d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2fedd9b640 1 -- 172.21.15.70:0/2383374866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff8106f50 msgr2=0x7f2ff8101d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2fedd9b640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff8106f50 0x7f2ff8101d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2fedd9b640 1 -- 172.21.15.70:0/2383374866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff8100350 msgr2=0x7f2ff81012d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2fedd9b640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff8100350 0x7f2ff81012d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2fedd9b640 1 -- 172.21.15.70:0/2383374866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2ff81a6a20 con 0x7f2ff8100d00 2024-09-19T04:41:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2fedd9b640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8100d00 0x7f2ff8101810 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000d740 tx=0x7f2fe000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2feffff640 1 -- 172.21.15.70:0/2383374866 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0017070 con 0x7f2ff8100d00 2024-09-19T04:41:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2ffce5e640 1 -- 172.21.15.70:0/2383374866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2ff81a6d10 con 0x7f2ff8100d00 2024-09-19T04:41:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2feffff640 1 -- 172.21.15.70:0/2383374866 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2fe000de50 con 0x7f2ff8100d00 2024-09-19T04:41:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2feffff640 1 -- 172.21.15.70:0/2383374866 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe0004e00 con 0x7f2ff8100d00 2024-09-19T04:41:16.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.741+0000 7f2ffce5e640 1 -- 172.21.15.70:0/2383374866 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2ff81a71f0 con 0x7f2ff8100d00 2024-09-19T04:41:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2feffff640 1 -- 172.21.15.70:0/2383374866 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2fe0004fa0 con 0x7f2ff8100d00 2024-09-19T04:41:16.752 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2fff237740 1 Processor -- start 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2fff237740 1 -- start start 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2fff237740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf050090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2fff237740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf0505d0 0x55addf050a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2fff237740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf05b370 0x55addf05d760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2fff237740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55addefb62f0 con 0x55addf0505d0 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2fff237740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55addef5dcf0 con 0x55addf05b370 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.744+0000 7f2fff237740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55addefb22b0 con 0x55addf051b40 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf0505d0 0x55addf050a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf0505d0 0x55addf050a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41340/0 (socket says 172.21.15.70:41340) 2024-09-19T04:41:16.753 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 -- 172.21.15.70:0/1284240624 learned_addr learned my addr 172.21.15.70:0/1284240624 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2fedd9b640 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf05b370 0x55addf05d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2feffff640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2fe40a33b0 0x7f2fe40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf050090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 -- 172.21.15.70:0/1284240624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 msgr2=0x55addf050090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf050090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 -- 172.21.15.70:0/1284240624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf05b370 msgr2=0x55addf05d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf05b370 0x55addf05d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 -- 172.21.15.70:0/1284240624 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addef423a0 con 0x55addf0505d0 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf050090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:16.754 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2fe40a33b0 0x7f2fe40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2feffff640 1 -- 172.21.15.70:0/2383374866 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f2fe00cf6f0 con 0x7f2ff8100d00 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2ff659c640 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf0505d0 0x55addf050a10 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800b820 tx=0x7f2fe800bce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d428c73931bf6d3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2fecd99640 1 -- 172.21.15.70:0/1284240624 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe800d950 con 0x55addf0505d0 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2fecd99640 1 -- 172.21.15.70:0/1284240624 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2fe8019070 con 0x55addf0505d0 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.745+0000 7f2fecd99640 1 -- 172.21.15.70:0/1284240624 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2fe80123e0 con 0x55addf0505d0 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 -- 172.21.15.70:0/1284240624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf0505d0 msgr2=0x55addf050a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf0505d0 0x55addf050a10 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7f2fe800b820 tx=0x7f2fe800bce0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2fe40a33b0 0x7f2fe40a5870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0004ab0 tx=0x7f2ff00095c0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 -- 172.21.15.70:0/1284240624 shutdown_connections 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf05b370 0x55addf05d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf0505d0 0x55addf050a10 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 --2- 172.21.15.70:0/1284240624 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf050090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.755 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 -- 172.21.15.70:0/1284240624 >> 172.21.15.70:0/1284240624 conn(0x55addf019310 msgr2=0x55addf04cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 -- 172.21.15.70:0/1284240624 shutdown_connections 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.746+0000 7f2fff237740 1 -- 172.21.15.70:0/1284240624 wait complete. 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 1 -- start start 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 1 Processor -- start 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf0505d0 0x55addf05acc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf051b40 0x55addf057f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf0584d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55addf05e070 con 0x55addf05b370 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55addef71060 con 0x55addf051b40 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55addf05e1f0 con 0x55addf0505d0 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fff237740 10 client.0 _ll_register_callbacks cb 0x55addecc48c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:41:16.756 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf0584d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf0584d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41356/0 (socket says 172.21.15.70:41356) 2024-09-19T04:41:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/1493454435 learned_addr learned my addr 172.21.15.70:0/1493454435 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff659c640 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf0505d0 0x55addf05acc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2fedd9b640 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf051b40 0x55addf057f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf0505d0 msgr2=0x55addf05acc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf0505d0 0x55addf05acc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/1493454435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf051b40 msgr2=0x55addf057f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:16.757 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf051b40 0x55addf057f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/1493454435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55added273c0 con 0x55addf05b370 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.747+0000 7f2ff659c640 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf0505d0 0x55addf05acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf0584d0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0035000 tx=0x7f2ff002a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa3753da03e986ce server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fddffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fddffb640 1 -- 172.21.15.70:0/1493454435 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff004c070 con 0x55addf05b370 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fddffb640 1 -- 172.21.15.70:0/1493454435 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f2ff00305a0 con 0x55addf05b370 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 1 -- 172.21.15.70:0/1493454435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2fe8019070 con 0x55addf05b370 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fddffb640 1 -- 172.21.15.70:0/1493454435 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2ff00307a0 con 0x55addf05b370 2024-09-19T04:41:16.758 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 10 client.18246 fetch_fsmap learned FSMap version 34 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 1 -- 172.21.15.70:0/1493454435 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55addf0699f0 con 0x55addf05b370 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fddffb640 1 -- 172.21.15.70:0/1493454435 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2fe8019070 con 0x55addf05b370 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fddffb640 1 -- 172.21.15.70:0/1493454435 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2ff0030070 con 0x55addf05b370 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 10 client.18246 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 10 client.18246 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 20 client.18246 populate_metadata read hostname 'smithi070' 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55addf06ae00 0x55addf06d250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 4 client.18246 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.748+0000 7f2fff237740 1 -- 172.21.15.70:0/1493454435 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55addefc3860 con 0x55addf06ae00 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.749+0000 7f2ff659c640 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55addf06ae00 0x55addf06d250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.749+0000 7f2ff659c640 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55addf06ae00 0x55addf06d250 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=3a6b6834595fbbe6 server_cookie=9edc393b9cf4add7 in_seq=0 out_seq=0 2024-09-19T04:41:16.759 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.749+0000 7f2fddffb640 10 client.18246 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fddffb640 1 -- 172.21.15.70:0/1493454435 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55addefc3860 con 0x55addf06ae00 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fddffb640 10 client.18246 handle_command_reply: tid=0 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 client.18246 shutdown 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 -- 172.21.15.70:0/1493454435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 msgr2=0x55addf0584d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf0584d0 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0035000 tx=0x7f2ff002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 -- 172.21.15.70:0/1493454435 shutdown_connections 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55addf06ae00 0x55addf06d250 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf0584d0 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fddffb640 0 client.18246 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf051b40 0x55addf057f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 --2- 172.21.15.70:0/1493454435 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf0505d0 0x55addf05acc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.760 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 -- 172.21.15.70:0/1493454435 >> 172.21.15.70:0/1493454435 conn(0x55addf019310 msgr2=0x55addf052960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 -- 172.21.15.70:0/1493454435 shutdown_connections 2024-09-19T04:41:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 1 -- 172.21.15.70:0/1493454435 wait complete. 2024-09-19T04:41:16.761 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.750+0000 7f2fff237740 20 client.18246 trim_cache size 0 max 16384 2024-09-19T04:41:16.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.763+0000 7f2fff237740 1 Processor -- start 2024-09-19T04:41:16.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.763+0000 7f2fff237740 1 -- start start 2024-09-19T04:41:16.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.763+0000 7f2fff237740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf067310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.763+0000 7f2fff237740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf04fc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.763+0000 7f2fff237740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf05c760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.763+0000 7f2fff237740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff81b23e0 con 0x55addf05b370 2024-09-19T04:41:16.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.763+0000 7f2fff237740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff81afcb0 con 0x55addf0505d0 2024-09-19T04:41:16.766 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.763+0000 7f2fff237740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff81adb20 con 0x55addf051b40 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf05c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf05c760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41364/0 (socket says 172.21.15.70:41364) 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/2701429323 learned_addr learned my addr 172.21.15.70:0/2701429323 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2fedd9b640 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf04fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff659c640 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf067310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/2701429323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 msgr2=0x55addf04fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf04fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/2701429323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 msgr2=0x55addf067310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:16.767 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf067310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/2701429323 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55addf058750 con 0x55addf05b370 2024-09-19T04:41:16.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf05c760 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0004510 tx=0x7f2ff0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd1dc94b68a0a180 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:16.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2fdffff640 1 -- 172.21.15.70:0/2701429323 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff004c040 con 0x55addf05b370 2024-09-19T04:41:16.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2fdffff640 1 -- 172.21.15.70:0/2701429323 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2ff005d070 con 0x55addf05b370 2024-09-19T04:41:16.768 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.764+0000 7f2fdffff640 1 -- 172.21.15.70:0/2701429323 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff0030ba0 con 0x55addf05b370 2024-09-19T04:41:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 -- 172.21.15.70:0/2701429323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 msgr2=0x55addf05c760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf05c760 secure :-1 s=READY pgs=1329 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0004510 tx=0x7f2ff0004a40 comp rx=0 tx=0).stop 2024-09-19T04:41:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 -- 172.21.15.70:0/2701429323 shutdown_connections 2024-09-19T04:41:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf05c760 unknown :-1 s=CLOSED pgs=1329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf04fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 --2- 172.21.15.70:0/2701429323 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf067310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 -- 172.21.15.70:0/2701429323 >> 172.21.15.70:0/2701429323 conn(0x55addf019310 msgr2=0x55addf056840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:16.772 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 -- 172.21.15.70:0/2701429323 shutdown_connections 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 -- 172.21.15.70:0/2701429323 wait complete. 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 -- start start 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.765+0000 7f2fff237740 1 Processor -- start 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fff237740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf072680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fff237740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf072bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fff237740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf073100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fff237740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff81ae170 con 0x55addf05b370 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fff237740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff81af5e0 con 0x55addf0505d0 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fff237740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2ff81ae840 con 0x55addf051b40 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fff237740 10 client.0 _ll_register_callbacks cb 0x7f2ff0031f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:41:16.773 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf073100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf073100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41374/0 (socket says 172.21.15.70:41374) 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/3132950056 learned_addr learned my addr 172.21.15.70:0/3132950056 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fedd9b640 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf072bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff659c640 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf072680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/3132950056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 msgr2=0x55addf072bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf072bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/3132950056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 msgr2=0x55addf072680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf072680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 -- 172.21.15.70:0/3132950056 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55addf0618f0 con 0x55addf05b370 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff659c640 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2ff6d9d640 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf073100 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2ff002a920 tx=0x7f2ff0004d70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aff89dc4169ba859 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:16.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.766+0000 7f2fddffb640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fddffb640 1 -- 172.21.15.70:0/3132950056 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2ff004c040 con 0x55addf05b370 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fddffb640 1 -- 172.21.15.70:0/3132950056 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f2ff0058630 con 0x55addf05b370 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 1 -- 172.21.15.70:0/3132950056 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2ff005d070 con 0x55addf05b370 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fddffb640 1 -- 172.21.15.70:0/3132950056 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f2ff0070050 con 0x55addf05b370 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 10 client.18252 fetch_fsmap learned FSMap version 34 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 1 -- 172.21.15.70:0/3132950056 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55addf0d5d50 con 0x55addf05b370 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fddffb640 1 -- 172.21.15.70:0/3132950056 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2ff005d070 con 0x55addf05b370 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fddffb640 1 -- 172.21.15.70:0/3132950056 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f2ff0062a40 con 0x55addf05b370 2024-09-19T04:41:16.775 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 10 client.18252 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 10 client.18252 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.i 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 20 client.18252 populate_metadata read hostname 'smithi070' 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55addf06ae00 0x55addf0d8360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 4 client.18252 mds_command: new command op to 24433 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2fff237740 1 -- 172.21.15.70:0/3132950056 --> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55addefbdd70 con 0x55addf06ae00 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.767+0000 7f2ff659c640 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55addf06ae00 0x55addf0d8360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fddffb640 10 client.18252 ms_handle_connect on v2:172.21.15.167:6838/2148889748 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2ff659c640 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55addf06ae00 0x55addf0d8360 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=d5bf794a446d9ac7 server_cookie=9390d11e42e1713a in_seq=0 out_seq=0 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fddffb640 1 -- 172.21.15.70:0/3132950056 <== mds.2 v2:172.21.15.167:6838/2148889748 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55addefbdd70 con 0x55addf06ae00 2024-09-19T04:41:16.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fddffb640 10 client.18252 handle_command_reply: tid=0 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 client.18252 shutdown 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 -- 172.21.15.70:0/3132950056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 msgr2=0x55addf073100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf073100 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7f2ff002a920 tx=0x7f2ff0004d70 comp rx=0 tx=0).stop 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 -- 172.21.15.70:0/3132950056 shutdown_connections 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.167:6838/2148889748,v1:172.21.15.167:6839/2148889748] conn(0x55addf06ae00 0x55addf0d8360 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55addf05b370 0x55addf073100 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fddffb640 0 client.18252 ms_handle_reset on v2:172.21.15.167:6838/2148889748 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55addf051b40 0x55addf072bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 --2- 172.21.15.70:0/3132950056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55addf0505d0 0x55addf072680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 -- 172.21.15.70:0/3132950056 >> 172.21.15.70:0/3132950056 conn(0x55addf019310 msgr2=0x55addf04b4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 -- 172.21.15.70:0/3132950056 shutdown_connections 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 1 -- 172.21.15.70:0/3132950056 wait complete. 2024-09-19T04:41:16.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.768+0000 7f2fff237740 20 client.18252 trim_cache size 0 max 16384 2024-09-19T04:41:16.778 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:41:16.778 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 -- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2fe40a33b0 msgr2=0x7f2fe40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2fe40a33b0 0x7f2fe40a5870 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f2ff0004ab0 tx=0x7f2ff00095c0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 -- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8100d00 msgr2=0x7f2ff8101810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8100d00 0x7f2ff8101810 secure :-1 s=READY pgs=1326 cs=0 l=1 rev1=1 crypto rx=0x7f2fe000d740 tx=0x7f2fe000dc00 comp rx=0 tx=0).stop 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 -- 172.21.15.70:0/2383374866 shutdown_connections 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2fe40a33b0 0x7f2fe40a5870 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2ff8106f50 0x7f2ff8101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2ff8100d00 0x7f2ff8101810 unknown :-1 s=CLOSED pgs=1326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 --2- 172.21.15.70:0/2383374866 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ff8100350 0x7f2ff81012d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 -- 172.21.15.70:0/2383374866 >> 172.21.15.70:0/2383374866 conn(0x7f2ff8077210 msgr2=0x7f2ff8105250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 -- 172.21.15.70:0/2383374866 shutdown_connections 2024-09-19T04:41:16.779 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:16.769+0000 7f2ffce5e640 1 -- 172.21.15.70:0/2383374866 wait complete. 2024-09-19T04:41:17.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:16 smithi134 ceph-mon[34525]: pgmap v328: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 124 B/s wr, 3 op/s 2024-09-19T04:41:17.080 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:16 smithi070 ceph-mon[30942]: pgmap v328: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 124 B/s wr, 3 op/s 2024-09-19T04:41:17.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:16 smithi167 ceph-mon[34339]: pgmap v328: 97 pgs: 97 active+clean; 121 MiB data, 958 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s rd, 124 B/s wr, 3 op/s 2024-09-19T04:41:17.563 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-09-19T04:41:17.807 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 -- 172.21.15.70:0/3339387696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 msgr2=0x7fd5c410da40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.250 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/3339387696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 0x7fd5c410da40 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc009ca0 tx=0x7fd5bc02a950 comp rx=0 tx=0).stop 2024-09-19T04:41:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 -- 172.21.15.70:0/3339387696 shutdown_connections 2024-09-19T04:41:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/3339387696 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 0x7fd5c410da40 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/3339387696 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4102570 0x7fd5c41029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/3339387696 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c4100e20 0x7fd5c4101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 -- 172.21.15.70:0/3339387696 >> 172.21.15.70:0/3339387696 conn(0x7fd5c40fc7d0 msgr2=0x7fd5c40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 -- 172.21.15.70:0/3339387696 shutdown_connections 2024-09-19T04:41:18.251 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 -- 172.21.15.70:0/3339387696 wait complete. 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 Processor -- start 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.249+0000 7fd5ca5be640 1 -- start start 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5ca5be640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c4100e20 0x7fd5c41993c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5ca5be640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4102570 0x7fd5c4199900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5ca5be640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 0x7fd5c41a4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5ca5be640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4110f90 con 0x7fd5c4102ef0 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5ca5be640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4110e10 con 0x7fd5c4102570 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5ca5be640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c4111110 con 0x7fd5c4100e20 2024-09-19T04:41:18.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c8b5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 0x7fd5c41a4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c8b5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 0x7fd5c41a4440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41388/0 (socket says 172.21.15.70:41388) 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c8b5b640 1 -- 172.21.15.70:0/937543555 learned_addr learned my addr 172.21.15.70:0/937543555 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c4100e20 0x7fd5c41993c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4102570 0x7fd5c4199900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c8b5b640 1 -- 172.21.15.70:0/937543555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c4100e20 msgr2=0x7fd5c41993c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c8b5b640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c4100e20 0x7fd5c41993c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c8b5b640 1 -- 172.21.15.70:0/937543555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4102570 msgr2=0x7fd5c4199900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c8b5b640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4102570 0x7fd5c4199900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.250+0000 7fd5c8b5b640 1 -- 172.21.15.70:0/937543555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd5c41a4980 con 0x7fd5c4102ef0 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.251+0000 7fd5c8b5b640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 0x7fd5c41a4440 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc005cc0 tx=0x7fd5bc02f6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.251+0000 7fd5c17fa640 1 -- 172.21.15.70:0/937543555 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc003d80 con 0x7fd5c4102ef0 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.251+0000 7fd5c17fa640 1 -- 172.21.15.70:0/937543555 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd5bc030910 con 0x7fd5c4102ef0 2024-09-19T04:41:18.254 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.251+0000 7fd5c17fa640 1 -- 172.21.15.70:0/937543555 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5bc039680 con 0x7fd5c4102ef0 2024-09-19T04:41:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.251+0000 7fd5ca5be640 1 -- 172.21.15.70:0/937543555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd5c41a4b50 con 0x7fd5c4102ef0 2024-09-19T04:41:18.255 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.251+0000 7fd5ca5be640 1 -- 172.21.15.70:0/937543555 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd5c41a4f40 con 0x7fd5c4102ef0 2024-09-19T04:41:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.253+0000 7fd5c17fa640 1 -- 172.21.15.70:0/937543555 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fd5bc037020 con 0x7fd5c4102ef0 2024-09-19T04:41:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5cc997740 1 Processor -- start 2024-09-19T04:41:18.256 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5cc997740 1 -- start start 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5c17fa640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd5ac0a33b0 0x7fd5ac0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd5ac0a33b0 0x7fd5ac0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 0x55ea56cfb090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56cfba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5c17fa640 1 -- 172.21.15.70:0/937543555 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7fd5bc0f0900 con 0x7fd5c4102ef0 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 0x55ea56d0cb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5cc997740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ea56c612f0 con 0x55ea56cfb5d0 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5cc997740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ea56c08cf0 con 0x55ea56cfcb40 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5cc997740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea56c5d2b0 con 0x55ea56d0a780 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5c37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56cfba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5c37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56cfba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41390/0 (socket says 172.21.15.70:41390) 2024-09-19T04:41:18.257 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5c37fe640 1 -- 172.21.15.70:0/260900450 learned_addr learned my addr 172.21.15.70:0/260900450 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 0x55ea56cfb090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.254+0000 7fd5c8b5b640 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 0x55ea56d0cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd5ac0a33b0 0x7fd5ac0a5870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80123f0 tx=0x7fd5b80127f0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5c37fe640 1 -- 172.21.15.70:0/260900450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 msgr2=0x55ea56d0cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 0x55ea56d0cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5c37fe640 1 -- 172.21.15.70:0/260900450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 msgr2=0x55ea56cfb090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 0x55ea56cfb090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5c37fe640 1 -- 172.21.15.70:0/260900450 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea56bed3a0 con 0x55ea56cfb5d0 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56cfba10 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800a9a0 tx=0x7fd5b801c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58deb1f4a5713194 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5aa7fc640 1 -- 172.21.15.70:0/260900450 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b801e700 con 0x55ea56cfb5d0 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5aa7fc640 1 -- 172.21.15.70:0/260900450 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd5b801ed70 con 0x55ea56cfb5d0 2024-09-19T04:41:18.258 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.255+0000 7fd5aa7fc640 1 -- 172.21.15.70:0/260900450 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b801de40 con 0x55ea56cfb5d0 2024-09-19T04:41:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 -- 172.21.15.70:0/260900450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 msgr2=0x55ea56cfba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56cfba10 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7fd5b800a9a0 tx=0x7fd5b801c000 comp rx=0 tx=0).stop 2024-09-19T04:41:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 -- 172.21.15.70:0/260900450 shutdown_connections 2024-09-19T04:41:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 0x55ea56d0cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56cfba10 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 --2- 172.21.15.70:0/260900450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 0x55ea56cfb090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 -- 172.21.15.70:0/260900450 >> 172.21.15.70:0/260900450 conn(0x55ea56cc4310 msgr2=0x55ea56cf7c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:18.263 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 -- 172.21.15.70:0/260900450 shutdown_connections 2024-09-19T04:41:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 -- 172.21.15.70:0/260900450 wait complete. 2024-09-19T04:41:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 -- start start 2024-09-19T04:41:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 Processor -- start 2024-09-19T04:41:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.256+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0a110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfcb40 0x55ea56d073c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56d0a780 0x55ea56d07940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5cc997740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x55ea56d0d420 con 0x55ea56d0a780 2024-09-19T04:41:18.264 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5cc997740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x55ea56c1c060 con 0x55ea56cfb5d0 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5cc997740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x55ea56d0d5a0 con 0x55ea56cfcb40 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5cc997740 10 client.0 _ll_register_callbacks cb 0x55ea5696f8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c8b5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56d0a780 0x55ea56d07940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c8b5b640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56d0a780 0x55ea56d07940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41394/0 (socket says 172.21.15.70:41394) 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c8b5b640 1 -- 172.21.15.70:0/1776986542 learned_addr learned my addr 172.21.15.70:0/1776986542 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0a110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfcb40 0x55ea56d073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c3fff640 1 -- 172.21.15.70:0/1776986542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfcb40 msgr2=0x55ea56d073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfcb40 0x55ea56d073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c3fff640 1 -- 172.21.15.70:0/1776986542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56d0a780 msgr2=0x55ea56d07940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56d0a780 0x55ea56d07940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c3fff640 1 -- 172.21.15.70:0/1776986542 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea569d23c0 con 0x55ea56cfb5d0 2024-09-19T04:41:18.265 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfcb40 0x55ea56d073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c8b5b640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56d0a780 0x55ea56d07940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0a110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4010500 tx=0x7fd5b40109c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4510b95785aea73c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.134:3300/0 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.257+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1776986542 <== mon.2 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b401a020 con 0x55ea56cfb5d0 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 1 -- 172.21.15.70:0/1776986542 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5b801ed70 con 0x55ea56cfb5d0 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1776986542 <== mon.2 v2:172.21.15.134:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7fd5b4016750 con 0x55ea56cfb5d0 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1776986542 <== mon.2 v2:172.21.15.134:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd5b4025050 con 0x55ea56cfb5d0 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 10 client.26774 fetch_fsmap learned FSMap version 34 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 1 -- 172.21.15.70:0/1776986542 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ea56d18f00 con 0x55ea56cfb5d0 2024-09-19T04:41:18.266 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1776986542 <== mon.2 v2:172.21.15.134:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd5b801ed70 con 0x55ea56cfb5d0 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1776986542 <== mon.2 v2:172.21.15.134:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd5b4014a30 con 0x55ea56cfb5d0 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 10 client.26774 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 10 client.26774 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 20 client.26774 populate_metadata read hostname 'smithi070' 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ea56d1a310 0x55ea56d1c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 4 client.26774 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.258+0000 7fd5cc997740 1 -- 172.21.15.70:0/1776986542 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ea56c6e860 con 0x55ea56d1a310 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.259+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ea56d1a310 0x55ea56d1c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.259+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ea56d1a310 0x55ea56d1c700 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=d4c6d835c2218c5b server_cookie=dbe59b2d0eca540e in_seq=0 out_seq=0 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.259+0000 7fd5a37fe640 10 client.26774 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:41:18.267 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1776986542 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x55ea56c6e860 con 0x55ea56d1a310 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5a37fe640 10 client.26774 handle_command_reply: tid=0 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 client.26774 shutdown 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 -- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfb5d0 msgr2=0x55ea56d0a110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0a110 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4010500 tx=0x7fd5b40109c0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 -- 172.21.15.70:0/1776986542 shutdown_connections 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ea56d1a310 0x55ea56d1c700 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56d0a780 0x55ea56d07940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfcb40 0x55ea56d073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5a37fe640 0 client.26774 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:41:18.268 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1776986542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0a110 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 -- 172.21.15.70:0/1776986542 >> 172.21.15.70:0/1776986542 conn(0x55ea56cc4310 msgr2=0x55ea56cfd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:18.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 -- 172.21.15.70:0/1776986542 shutdown_connections 2024-09-19T04:41:18.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 1 -- 172.21.15.70:0/1776986542 wait complete. 2024-09-19T04:41:18.269 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.260+0000 7fd5cc997740 20 client.26774 trim_cache size 0 max 16384 2024-09-19T04:41:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.273+0000 7fd5cc997740 1 Processor -- start 2024-09-19T04:41:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.273+0000 7fd5cc997740 1 -- start start 2024-09-19T04:41:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.273+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56d166c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.273+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 0x55ea56cfc300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.273+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 0x55ea56cf7700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.273+0000 7fd5cc997740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41adee0 con 0x55ea56cfb5d0 2024-09-19T04:41:18.276 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5cc997740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41ab7b0 con 0x55ea56cfcb40 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5cc997740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41a9620 con 0x55ea56d0a780 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56d166c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56d166c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41408/0 (socket says 172.21.15.70:41408) 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 -- 172.21.15.70:0/2202616931 learned_addr learned my addr 172.21.15.70:0/2202616931 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 0x55ea56cfc300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c8b5b640 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 0x55ea56cf7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 -- 172.21.15.70:0/2202616931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 msgr2=0x55ea56cf7700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 0x55ea56cf7700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 -- 172.21.15.70:0/2202616931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 msgr2=0x55ea56cfc300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 0x55ea56cfc300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 -- 172.21.15.70:0/2202616931 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ea56d0a480 con 0x55ea56cfb5d0 2024-09-19T04:41:18.277 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56d166c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4004810 tx=0x7fd5b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e41f60457f5920b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5a9ffb640 1 -- 172.21.15.70:0/2202616931 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b401a050 con 0x55ea56cfb5d0 2024-09-19T04:41:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5a9ffb640 1 -- 172.21.15.70:0/2202616931 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd5b400bcc0 con 0x55ea56cfb5d0 2024-09-19T04:41:18.278 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.274+0000 7fd5a9ffb640 1 -- 172.21.15.70:0/2202616931 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b4012bf0 con 0x55ea56cfb5d0 2024-09-19T04:41:18.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 -- 172.21.15.70:0/2202616931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 msgr2=0x55ea56d166c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56d166c0 secure :-1 s=READY pgs=1334 cs=0 l=1 rev1=1 crypto rx=0x7fd5b4004810 tx=0x7fd5b40046c0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 -- 172.21.15.70:0/2202616931 shutdown_connections 2024-09-19T04:41:18.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56d0a780 0x55ea56cf7700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.282 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56cfcb40 0x55ea56cfc300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 --2- 172.21.15.70:0/2202616931 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfb5d0 0x55ea56d166c0 unknown :-1 s=CLOSED pgs=1334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 -- 172.21.15.70:0/2202616931 >> 172.21.15.70:0/2202616931 conn(0x55ea56cc4310 msgr2=0x55ea56cf2a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 -- 172.21.15.70:0/2202616931 shutdown_connections 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 -- 172.21.15.70:0/2202616931 wait complete. 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.275+0000 7fd5cc997740 1 -- start start 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5cc997740 1 Processor -- start 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfcb40 0x55ea56d0e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5cc997740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56d0a780 0x55ea56d7cf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5cc997740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41a9c70 con 0x55ea56cfcb40 2024-09-19T04:41:18.283 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5cc997740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41ab0e0 con 0x55ea56d0a780 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5cc997740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fd5c41aa340 con 0x55ea56cfb5d0 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5cc997740 10 client.0 _ll_register_callbacks cb 0x7fd5b400b520 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfcb40 0x55ea56d0e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c37fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfcb40 0x55ea56d0e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41418/0 (socket says 172.21.15.70:41418) 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c37fe640 1 -- 172.21.15.70:0/1941661454 learned_addr learned my addr 172.21.15.70:0/1941661454 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c8b5b640 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56d0a780 0x55ea56d7cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c37fe640 1 -- 172.21.15.70:0/1941661454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfb5d0 msgr2=0x55ea56d0df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c37fe640 1 -- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56d0a780 msgr2=0x55ea56d7cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56d0a780 0x55ea56d7cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.284 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c37fe640 1 -- 172.21.15.70:0/1941661454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ea56d7d550 con 0x55ea56cfcb40 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.276+0000 7fd5c8b5b640 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56d0a780 0x55ea56d7cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5c37fe640 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfcb40 0x55ea56d0e4b0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd5b801dad0 tx=0x7fd5b800ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44845c1d899da51 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1941661454 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd5b8005040 con 0x55ea56cfcb40 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1941661454 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7fd5b80051e0 con 0x55ea56cfcb40 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 1 -- 172.21.15.70:0/1941661454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd5b400bcc0 con 0x55ea56cfcb40 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1941661454 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7fd5b80053e0 con 0x55ea56cfcb40 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 10 client.18270 fetch_fsmap learned FSMap version 34 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 1 -- 172.21.15.70:0/1941661454 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x55ea56d848b0 con 0x55ea56cfcb40 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1941661454 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fd5b400bcc0 con 0x55ea56cfcb40 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1941661454 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7fd5b801e500 con 0x55ea56cfcb40 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 10 client.18270 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:41:18.285 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 10 client.18270 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.h 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 20 client.18270 populate_metadata read hostname 'smithi070' 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ea56d84da0 0x55ea56d871c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 4 client.18270 mds_command: new command op to 24452 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.277+0000 7fd5cc997740 1 -- 172.21.15.70:0/1941661454 --> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ea56c68d70 con 0x55ea56d84da0 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ea56d84da0 0x55ea56d871c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5a37fe640 10 client.18270 ms_handle_connect on v2:172.21.15.134:6836/2308950233 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5c3fff640 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ea56d84da0 0x55ea56d871c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=98382d063f49bf10 server_cookie=cbe4fd911e2c3f in_seq=0 out_seq=0 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5a37fe640 1 -- 172.21.15.70:0/1941661454 <== mds.1 v2:172.21.15.134:6836/2308950233 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ea56c68d70 con 0x55ea56d84da0 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5a37fe640 10 client.18270 handle_command_reply: tid=0 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 client.18270 shutdown 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 -- 172.21.15.70:0/1941661454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfcb40 msgr2=0x55ea56d0e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfcb40 0x55ea56d0e4b0 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fd5b801dad0 tx=0x7fd5b800ace0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 -- 172.21.15.70:0/1941661454 shutdown_connections 2024-09-19T04:41:18.286 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:6836/2308950233,v1:172.21.15.134:6837/2308950233] conn(0x55ea56d84da0 0x55ea56d871c0 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x55ea56d0a780 0x55ea56d7cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5a37fe640 0 client.18270 ms_handle_reset on v2:172.21.15.134:6836/2308950233 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x55ea56cfcb40 0x55ea56d0e4b0 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 --2- 172.21.15.70:0/1941661454 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x55ea56cfb5d0 0x55ea56d0df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.278+0000 7fd5cc997740 1 -- 172.21.15.70:0/1941661454 >> 172.21.15.70:0/1941661454 conn(0x55ea56cc4310 msgr2=0x55ea56cfc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5cc997740 1 -- 172.21.15.70:0/1941661454 shutdown_connections 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5cc997740 1 -- 172.21.15.70:0/1941661454 wait complete. 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5cc997740 20 client.18270 trim_cache size 0 max 16384 2024-09-19T04:41:18.287 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:41:18.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 -- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd5ac0a33b0 msgr2=0x7fd5ac0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd5ac0a33b0 0x7fd5ac0a5870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fd5b80123f0 tx=0x7fd5b80127f0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 -- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 msgr2=0x7fd5c41a4440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:18.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 0x7fd5c41a4440 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7fd5bc005cc0 tx=0x7fd5bc02f6a0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.288 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 -- 172.21.15.70:0/937543555 shutdown_connections 2024-09-19T04:41:18.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fd5ac0a33b0 0x7fd5ac0a5870 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fd5c4102ef0 0x7fd5c41a4440 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd5c4102570 0x7fd5c4199900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 --2- 172.21.15.70:0/937543555 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fd5c4100e20 0x7fd5c41993c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:18.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 -- 172.21.15.70:0/937543555 >> 172.21.15.70:0/937543555 conn(0x7fd5c40fc7d0 msgr2=0x7fd5c40febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:18.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.279+0000 7fd5ca5be640 1 -- 172.21.15.70:0/937543555 shutdown_connections 2024-09-19T04:41:18.289 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:18.280+0000 7fd5ca5be640 1 -- 172.21.15.70:0/937543555 wait complete. 2024-09-19T04:41:18.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:18 smithi070 ceph-mon[30942]: pgmap v329: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:19.032 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-09-19T04:41:19.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:18 smithi134 ceph-mon[34525]: pgmap v329: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:19.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:18 smithi167 ceph-mon[34339]: pgmap v329: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:19.279 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:19.728 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 -- 172.21.15.70:0/2775310253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc100ca0 msgr2=0x7f7bbc106840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 --2- 172.21.15.70:0/2775310253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc100ca0 0x7f7bbc106840 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0009930 tx=0x7f7bb002a420 comp rx=0 tx=0).stop 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 -- 172.21.15.70:0/2775310253 shutdown_connections 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 --2- 172.21.15.70:0/2775310253 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bbc106f50 0x7f7bbc10eaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 --2- 172.21.15.70:0/2775310253 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc100ca0 0x7f7bbc106840 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 --2- 172.21.15.70:0/2775310253 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bbc1002f0 0x7f7bbc1006d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 -- 172.21.15.70:0/2775310253 >> 172.21.15.70:0/2775310253 conn(0x7f7bbc077210 msgr2=0x7f7bbc0fe5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 -- 172.21.15.70:0/2775310253 shutdown_connections 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.691+0000 7f7bc218d640 1 -- 172.21.15.70:0/2775310253 wait complete. 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bc218d640 1 Processor -- start 2024-09-19T04:41:19.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bc218d640 1 -- start start 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bc218d640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bbc1002f0 0x7f7bbc1a05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bc218d640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bbc100ca0 0x7f7bbc1a0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bc218d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc106f50 0x7f7bbc19a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bc218d640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc112050 con 0x7f7bbc106f50 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bc218d640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc111ed0 con 0x7f7bbc1002f0 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bc218d640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc1121d0 con 0x7f7bbc100ca0 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.692+0000 7f7bbbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc106f50 0x7f7bbc19a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbbfff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc106f50 0x7f7bbc19a6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41438/0 (socket says 172.21.15.70:41438) 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbbfff640 1 -- 172.21.15.70:0/1856288310 learned_addr learned my addr 172.21.15.70:0/1856288310 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bbc1002f0 0x7f7bbc1a05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bbc100ca0 0x7f7bbc1a0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbbfff640 1 -- 172.21.15.70:0/1856288310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bbc100ca0 msgr2=0x7f7bbc1a0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbbfff640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bbc100ca0 0x7f7bbc1a0b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbbfff640 1 -- 172.21.15.70:0/1856288310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bbc1002f0 msgr2=0x7f7bbc1a05d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbbfff640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bbc1002f0 0x7f7bbc1a05d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbbfff640 1 -- 172.21.15.70:0/1856288310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7bbc19af10 con 0x7f7bbc106f50 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bbbfff640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc106f50 0x7f7bbc19a6a0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009fd0 tx=0x7f7bb400b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bb8ff9640 1 -- 172.21.15.70:0/1856288310 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb4011830 con 0x7f7bbc106f50 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bb8ff9640 1 -- 172.21.15.70:0/1856288310 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7bb4016070 con 0x7f7bbc106f50 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bc218d640 1 -- 172.21.15.70:0/1856288310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7bbc19b200 con 0x7f7bbc106f50 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bb8ff9640 1 -- 172.21.15.70:0/1856288310 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb400f2e0 con 0x7f7bbc106f50 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.693+0000 7f7bc218d640 1 -- 172.21.15.70:0/1856288310 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7bbc1a7550 con 0x7f7bbc106f50 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bc4566740 1 Processor -- start 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bb8ff9640 1 -- 172.21.15.70:0/1856288310 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7bb40119d0 con 0x7f7bbc106f50 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bc4566740 1 -- start start 2024-09-19T04:41:19.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e27090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 0x564006e27a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 0x564006e34760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bc4566740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564006d8d2f0 con 0x564006e28b40 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bc4566740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564006d34cf0 con 0x564006e32370 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bc4566740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564006d892b0 con 0x564006e275d0 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e27090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bbaffd640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e27090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41440/0 (socket says 172.21.15.70:41440) 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.696+0000 7f7bbaffd640 1 -- 172.21.15.70:0/2663483758 learned_addr learned my addr 172.21.15.70:0/2663483758 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/2663483758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 0x564006e27a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bbaffd640 1 -- 172.21.15.70:0/2663483758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 msgr2=0x564006e27a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/2663483758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 0x564006e27a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bbaffd640 1 -- 172.21.15.70:0/2663483758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 msgr2=0x564006e34760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bb8ff9640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ba40a3430 0x7f7ba40a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/2663483758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 0x564006e34760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bbaffd640 1 -- 172.21.15.70:0/2663483758 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564006d193a0 con 0x564006e28b40 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bbbfff640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ba40a3430 0x7f7ba40a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/2663483758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e27090 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0000c00 tx=0x7f7bb0005c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eada3e8391171f8c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7bb8ff9640 1 -- 172.21.15.70:0/1856288310 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f7bb40cf1e0 con 0x7f7bbc106f50 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7ba1ffb640 1 -- 172.21.15.70:0/2663483758 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb0035040 con 0x564006e28b40 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7ba1ffb640 1 -- 172.21.15.70:0/2663483758 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7bb0031710 con 0x564006e28b40 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.697+0000 7f7ba1ffb640 1 -- 172.21.15.70:0/2663483758 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bb00047a0 con 0x564006e28b40 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 -- 172.21.15.70:0/2663483758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 msgr2=0x564006e27090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bbbfff640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ba40a3430 0x7f7ba40a58f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40ccaf0 tx=0x7f7bb406e400 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:19.733 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2663483758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e27090 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f7bb0000c00 tx=0x7f7bb0005c00 comp rx=0 tx=0).stop 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 -- 172.21.15.70:0/2663483758 shutdown_connections 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2663483758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 0x564006e34760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2663483758 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 0x564006e27a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2663483758 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e27090 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 -- 172.21.15.70:0/2663483758 >> 172.21.15.70:0/2663483758 conn(0x564006df0310 msgr2=0x564006e23c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 -- 172.21.15.70:0/2663483758 shutdown_connections 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 -- 172.21.15.70:0/2663483758 wait complete. 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.698+0000 7f7bc4566740 1 -- start start 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 1 Processor -- start 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e31d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e2efb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 0x564006e2f530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x564006e35010 con 0x564006e28b40 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x564006d48060 con 0x564006e275d0 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x564006e35190 con 0x564006e32370 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 10 client.0 _ll_register_callbacks cb 0x564006a9b8c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e2efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e2efb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41454/0 (socket says 172.21.15.70:41454) 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/2271101498 learned_addr learned my addr 172.21.15.70:0/2271101498 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e31d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 0x564006e2f530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/2271101498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 msgr2=0x564006e2f530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 0x564006e2f530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 msgr2=0x564006e31d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e31d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.735 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/2271101498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564006afe3c0 con 0x564006e28b40 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e31d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e2efb0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00ab60 tx=0x7f7bac011580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf89ca8a40b455d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7b9affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7b9affd640 1 -- 172.21.15.70:0/2271101498 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac01a070 con 0x564006e28b40 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7b9affd640 1 -- 172.21.15.70:0/2271101498 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f7bac016450 con 0x564006e28b40 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.699+0000 7f7bc4566740 1 -- 172.21.15.70:0/2271101498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bb0031710 con 0x564006e28b40 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7b9affd640 1 -- 172.21.15.70:0/2271101498 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7bac026050 con 0x564006e28b40 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7bc4566740 10 client.18282 fetch_fsmap learned FSMap version 34 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7bc4566740 1 -- 172.21.15.70:0/2271101498 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564006e40b00 con 0x564006e28b40 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7b9affd640 1 -- 172.21.15.70:0/2271101498 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7bb0031710 con 0x564006e28b40 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7b9affd640 1 -- 172.21.15.70:0/2271101498 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7bac01e730 con 0x564006e28b40 2024-09-19T04:41:19.736 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7bc4566740 10 client.18282 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7bc4566740 10 client.18282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7bc4566740 20 client.18282 populate_metadata read hostname 'smithi070' 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564006e41fd0 0x564006e443f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7bc4566740 4 client.18282 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.700+0000 7f7bc4566740 1 -- 172.21.15.70:0/2271101498 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564006d9a860 con 0x564006e41fd0 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.701+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564006e41fd0 0x564006e443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.701+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564006e41fd0 0x564006e443f0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dedfda037948449d server_cookie=18d19b27eefcacac in_seq=0 out_seq=0 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.701+0000 7f7b9affd640 10 client.18282 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7b9affd640 1 -- 172.21.15.70:0/2271101498 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24171 (crc 0 0 0) 0x564006d9a860 con 0x564006e41fd0 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7b9affd640 10 client.18282 handle_command_reply: tid=0 2024-09-19T04:41:19.737 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 client.18282 shutdown 2024-09-19T04:41:19.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 -- 172.21.15.70:0/2271101498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 msgr2=0x564006e2efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e2efb0 secure :-1 s=READY pgs=1339 cs=0 l=1 rev1=1 crypto rx=0x7f7bac00ab60 tx=0x7f7bac011580 comp rx=0 tx=0).stop 2024-09-19T04:41:19.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 -- 172.21.15.70:0/2271101498 shutdown_connections 2024-09-19T04:41:19.740 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564006e41fd0 0x564006e443f0 crc :-1 s=READY pgs=228 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 0x564006e2f530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.741 INFO:teuthology.orchestra.run.smithi070.stdout:[] 2024-09-19T04:41:19.741 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e2efb0 unknown :-1 s=CLOSED pgs=1339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7b9affd640 0 client.18282 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 --2- 172.21.15.70:0/2271101498 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e31d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 -- 172.21.15.70:0/2271101498 >> 172.21.15.70:0/2271101498 conn(0x564006df0310 msgr2=0x564006e29930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 -- 172.21.15.70:0/2271101498 shutdown_connections 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 1 -- 172.21.15.70:0/2271101498 wait complete. 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.702+0000 7f7bc4566740 20 client.18282 trim_cache size 0 max 16384 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bc4566740 1 Processor -- start 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bc4566740 1 -- start start 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 0x564006e3e310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e49cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 0x564006e4a200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.742 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bc4566740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc1b2440 con 0x564006e28b40 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bc4566740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc1afd10 con 0x564006e32370 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bc4566740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc1adb80 con 0x564006e275d0 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e49cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e49cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41462/0 (socket says 172.21.15.70:41462) 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/239787060 learned_addr learned my addr 172.21.15.70:0/239787060 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 0x564006e3e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 0x564006e4a200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/239787060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 msgr2=0x564006e3e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 0x564006e3e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/239787060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 msgr2=0x564006e4a200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 0x564006e4a200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/239787060 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564006e24960 con 0x564006e28b40 2024-09-19T04:41:19.743 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 0x564006e4a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.715+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e49cc0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f7bac01eb00 tx=0x7f7bac004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b570f0773dc92f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7ba17fa640 1 -- 172.21.15.70:0/239787060 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac02f070 con 0x564006e28b40 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7ba17fa640 1 -- 172.21.15.70:0/239787060 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7bac01e880 con 0x564006e28b40 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7ba17fa640 1 -- 172.21.15.70:0/239787060 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac01a040 con 0x564006e28b40 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 -- 172.21.15.70:0/239787060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 msgr2=0x564006e49cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e49cc0 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f7bac01eb00 tx=0x7f7bac004a40 comp rx=0 tx=0).stop 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 -- 172.21.15.70:0/239787060 shutdown_connections 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e32370 0x564006e4a200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e49cc0 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 --2- 172.21.15.70:0/239787060 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e275d0 0x564006e3e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 -- 172.21.15.70:0/239787060 >> 172.21.15.70:0/239787060 conn(0x564006df0310 msgr2=0x564006e2e0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:19.744 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 -- 172.21.15.70:0/239787060 shutdown_connections 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.716+0000 7f7bc4566740 1 -- 172.21.15.70:0/239787060 wait complete. 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 1 -- start start 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 1 Processor -- start 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e3aa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e35d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 0x564006e36270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc1ae1d0 con 0x564006e28b40 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc1af640 con 0x564006e275d0 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7bbc1ae8a0 con 0x564006e32370 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bc4566740 10 client.0 _ll_register_callbacks cb 0x7f7bac009b40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-09-19T04:41:19.745 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e35d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbb7fe640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e35d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41464/0 (socket says 172.21.15.70:41464) 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/4242733795 learned_addr learned my addr 172.21.15.70:0/4242733795 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e3aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 0x564006e36270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/4242733795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 msgr2=0x564006e36270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 0x564006e36270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 msgr2=0x564006e3aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e3aa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbb7fe640 1 -- 172.21.15.70:0/4242733795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564006e2a120 con 0x564006e28b40 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.717+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e3aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bbb7fe640 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e35d30 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7bac01ec70 tx=0x7f7bac009380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9269afe56791aa91 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:19.746 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7b9affd640 10 client.0 ms_handle_connect on v2:172.21.15.70:3300/0 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7b9affd640 1 -- 172.21.15.70:0/4242733795 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7bac02f030 con 0x564006e28b40 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7b9affd640 1 -- 172.21.15.70:0/4242733795 <== mon.0 v2:172.21.15.70:3300/0 2 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f7bac00ac50 con 0x564006e28b40 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 1 -- 172.21.15.70:0/4242733795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7bac01e880 con 0x564006e28b40 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7b9affd640 1 -- 172.21.15.70:0/4242733795 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_get_version_reply(handle=1 version=34) ==== 24+0+0 (secure 0 0 0) 0x7f7bac01a040 con 0x564006e28b40 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 10 client.18288 fetch_fsmap learned FSMap version 34 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 1 -- 172.21.15.70:0/4242733795 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,fsmap=34,monmap=4+}) -- 0x564006eac860 con 0x564006e28b40 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7b9affd640 1 -- 172.21.15.70:0/4242733795 <== mon.0 v2:172.21.15.70:3300/0 4 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7bac01e880 con 0x564006e28b40 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7b9affd640 1 -- 172.21.15.70:0/4242733795 <== mon.0 v2:172.21.15.70:3300/0 5 ==== fsmap(e 34) ==== 8346+0+0 (secure 0 0 0) 0x7f7bac03d740 con 0x564006e28b40 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 10 client.18288 fetch_fsmap finished waiting for FSMap version 34 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 10 client.18288 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 20 client.18288 populate_metadata read hostname 'smithi070' 2024-09-19T04:41:19.747 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564006eace10 0x564006eaf200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 4 client.18288 mds_command: new command op to 24470 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.718+0000 7f7bc4566740 1 -- 172.21.15.70:0/4242733795 --> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564006d94d70 con 0x564006eace10 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564006eace10 0x564006eaf200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7b9affd640 10 client.18288 ms_handle_connect on v2:172.21.15.134:6838/1808608891 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bbaffd640 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564006eace10 0x564006eaf200 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f98d7abe88b8c8ae server_cookie=4aa00cdff8dbabe5 in_seq=0 out_seq=0 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7b9affd640 1 -- 172.21.15.70:0/4242733795 <== mds.0 v2:172.21.15.134:6838/1808608891 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564006d94d70 con 0x564006eace10 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7b9affd640 10 client.18288 handle_command_reply: tid=0 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 client.18288 shutdown 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 -- 172.21.15.70:0/4242733795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 msgr2=0x564006e35d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e35d30 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f7bac01ec70 tx=0x7f7bac009380 comp rx=0 tx=0).stop 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 -- 172.21.15.70:0/4242733795 shutdown_connections 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:6838/1808608891,v1:172.21.15.134:6839/1808608891] conn(0x564006eace10 0x564006eaf200 crc :-1 s=READY pgs=229 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.748 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x564006e32370 0x564006e36270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7b9affd640 0 client.18288 ms_handle_reset on v2:172.21.15.134:6838/1808608891 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x564006e28b40 0x564006e35d30 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 --2- 172.21.15.70:0/4242733795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x564006e275d0 0x564006e3aa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 -- 172.21.15.70:0/4242733795 >> 172.21.15.70:0/4242733795 conn(0x564006df0310 msgr2=0x564006e30810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 -- 172.21.15.70:0/4242733795 shutdown_connections 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.719+0000 7f7bc4566740 1 -- 172.21.15.70:0/4242733795 wait complete. 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc4566740 20 client.18288 trim_cache size 0 max 16384 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 -- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ba40a3430 msgr2=0x7f7ba40a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ba40a3430 0x7f7ba40a58f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f7bb40ccaf0 tx=0x7f7bb406e400 comp rx=0 tx=0).stop 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 -- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc106f50 msgr2=0x7f7bbc19a6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:19.749 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc106f50 0x7f7bbc19a6a0 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f7bb4009fd0 tx=0x7f7bb400b8e0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 -- 172.21.15.70:0/1856288310 shutdown_connections 2024-09-19T04:41:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ba40a3430 0x7f7ba40a58f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7bbc106f50 0x7f7bbc19a6a0 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7bbc100ca0 0x7f7bbc1a0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 --2- 172.21.15.70:0/1856288310 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7bbc1002f0 0x7f7bbc1a05d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 -- 172.21.15.70:0/1856288310 >> 172.21.15.70:0/1856288310 conn(0x7f7bbc077210 msgr2=0x7f7bbc105560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 -- 172.21.15.70:0/1856288310 shutdown_connections 2024-09-19T04:41:19.750 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:19.720+0000 7f7bc218d640 1 -- 172.21.15.70:0/1856288310 wait complete. 2024-09-19T04:41:20.608 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/fwd_scrub.py", line 49, in do_scrub self.sleep_unless_stopped(self.sleep_between_iterations) File "/home/teuthworker/src/git.ceph.com_ceph_6fad5dd73c93545e52f57f681e140a9c3529c11e/qa/tasks/thrasher.py", line 47, in sleep_unless_stopped raise self.Stopped() tasks.thrasher.ThrasherGreenlet.Stopped 2024-09-19T04:41:20.609 INFO:tasks.fwd_scrub:done joining 2024-09-19T04:41:20.609 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-09-19T04:41:20.620 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T04:41:20.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 -- 172.21.15.70:0/3130254661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944102440 msgr2=0x7f794410e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:20.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 --2- 172.21.15.70:0/3130254661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944102440 0x7f794410e970 secure :-1 s=READY pgs=1342 cs=0 l=1 rev1=1 crypto rx=0x7f793c009cd0 tx=0x7f793c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 -- 172.21.15.70:0/3130254661 shutdown_connections 2024-09-19T04:41:20.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 --2- 172.21.15.70:0/3130254661 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944102440 0x7f794410e970 unknown :-1 s=CLOSED pgs=1342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.726 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 --2- 172.21.15.70:0/3130254661 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7944101aa0 0x7f7944101f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 --2- 172.21.15.70:0/3130254661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944107ab0 0x7f7944107e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 -- 172.21.15.70:0/3130254661 >> 172.21.15.70:0/3130254661 conn(0x7f79440fd7c0 msgr2=0x7f79440ffbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:20.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 -- 172.21.15.70:0/3130254661 shutdown_connections 2024-09-19T04:41:20.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.724+0000 7f794a942640 1 -- 172.21.15.70:0/3130254661 wait complete. 2024-09-19T04:41:20.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f794a942640 1 Processor -- start 2024-09-19T04:41:20.727 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f794a942640 1 -- start start 2024-09-19T04:41:20.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f794a942640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944101aa0 0x7f79441982f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:20.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f794a942640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7944102440 0x7f7944198830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:20.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f794a942640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944107ab0 0x7f794419cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:20.729 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f794a942640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7944111ec0 con 0x7f7944107ab0 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f794a942640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7944111d40 con 0x7f7944101aa0 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f794a942640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7944112040 con 0x7f7944102440 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f7948edf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944107ab0 0x7f794419cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f7948edf640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944107ab0 0x7f794419cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41482/0 (socket says 172.21.15.70:41482) 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f7948edf640 1 -- 172.21.15.70:0/785444230 learned_addr learned my addr 172.21.15.70:0/785444230 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f79437fe640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7944102440 0x7f7944198830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.725+0000 7f7943fff640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944101aa0 0x7f79441982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f7948edf640 1 -- 172.21.15.70:0/785444230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7944102440 msgr2=0x7f7944198830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f7948edf640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7944102440 0x7f7944198830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f7948edf640 1 -- 172.21.15.70:0/785444230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944101aa0 msgr2=0x7f79441982f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f7948edf640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944101aa0 0x7f79441982f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.730 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f7948edf640 1 -- 172.21.15.70:0/785444230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f794419d2e0 con 0x7f7944107ab0 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f7943fff640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944101aa0 0x7f79441982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f7948edf640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944107ab0 0x7f794419cbb0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f793c0097b0 tx=0x7f793c003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f79417fa640 1 -- 172.21.15.70:0/785444230 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c004040 con 0x7f7944107ab0 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f79417fa640 1 -- 172.21.15.70:0/785444230 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f793c0046b0 con 0x7f7944107ab0 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f794419d570 con 0x7f7944107ab0 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f79417fa640 1 -- 172.21.15.70:0/785444230 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f793c046480 con 0x7f7944107ab0 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.726+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79441a4e60 con 0x7f7944107ab0 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.727+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7944101f00 con 0x7f7944107ab0 2024-09-19T04:41:20.731 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.728+0000 7f79417fa640 1 -- 172.21.15.70:0/785444230 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f793c030730 con 0x7f7944107ab0 2024-09-19T04:41:20.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.729+0000 7f79417fa640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f792c0a33c0 0x7f792c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:20.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.729+0000 7f7943fff640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f792c0a33c0 0x7f792c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:20.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.729+0000 7f79417fa640 1 -- 172.21.15.70:0/785444230 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f793c02e030 con 0x7f7944107ab0 2024-09-19T04:41:20.732 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.729+0000 7f7943fff640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f792c0a33c0 0x7f792c0a5880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7934005e10 tx=0x7f7934005da0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:20.734 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.733+0000 7f79417fa640 1 -- 172.21.15.70:0/785444230 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f793c04b060 con 0x7f7944107ab0 2024-09-19T04:41:20.901 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.900+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f79441a5090 con 0x7f7944107ab0 2024-09-19T04:41:20.903 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.902+0000 7f79417fa640 1 -- 172.21.15.70:0/785444230 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+23207 (secure 0 0 0) 0x7f793c0bdf70 con 0x7f7944107ab0 2024-09-19T04:41:20.903 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:41:20.903 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":94,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:41:14.516771+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/4212188848":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/3933277587":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/544441745":"2024-09-20T04:30:46.484972+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/999804527":"2024-09-20T04:30:46.484972+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/4212188848":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/2420707462":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/3999565316":"2024-09-20T04:30:46.484972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:41:20.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.903+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f792c0a33c0 msgr2=0x7f792c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:20.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.903+0000 7f794a942640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f792c0a33c0 0x7f792c0a5880 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f7934005e10 tx=0x7f7934005da0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.903+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944107ab0 msgr2=0x7f794419cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:20.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.903+0000 7f794a942640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944107ab0 0x7f794419cbb0 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f793c0097b0 tx=0x7f793c003970 comp rx=0 tx=0).stop 2024-09-19T04:41:20.905 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.904+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 shutdown_connections 2024-09-19T04:41:20.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.904+0000 7f794a942640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f792c0a33c0 0x7f792c0a5880 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.904+0000 7f794a942640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7944107ab0 0x7f794419cbb0 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.904+0000 7f794a942640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7944102440 0x7f7944198830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.904+0000 7f794a942640 1 --2- 172.21.15.70:0/785444230 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7944101aa0 0x7f79441982f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:20.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.904+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 >> 172.21.15.70:0/785444230 conn(0x7f79440fd7c0 msgr2=0x7f79440fde40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:20.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.904+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 shutdown_connections 2024-09-19T04:41:20.906 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:20.904+0000 7f794a942640 1 -- 172.21.15.70:0/785444230 wait complete. 2024-09-19T04:41:20.915 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:20 smithi070 ceph-mon[30942]: pgmap v330: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:20.916 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-09-19T04:24:31.609825+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-09-19T04:28:59.024148+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-09-19T04:29:01.143246+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'is_stretch_pool': False, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '93', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 17, 'snap_epoch': 93, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-09-19T04:41:20.917 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 -- 172.21.15.70:0/3122353915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b70101330 msgr2=0x7f0b7010d860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/3122353915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b70101330 0x7f0b7010d860 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009cd0 tx=0x7f0b6802a8e0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 -- 172.21.15.70:0/3122353915 shutdown_connections 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/3122353915 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b70101330 0x7f0b7010d860 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/3122353915 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b70100990 0x7f0b70100df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/3122353915 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b701069a0 0x7f0b70106d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 -- 172.21.15.70:0/3122353915 >> 172.21.15.70:0/3122353915 conn(0x7f0b700fc6b0 msgr2=0x7f0b700fead0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 -- 172.21.15.70:0/3122353915 shutdown_connections 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.018+0000 7f0b74ff1640 1 -- 172.21.15.70:0/3122353915 wait complete. 2024-09-19T04:41:21.022 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b74ff1640 1 Processor -- start 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b74ff1640 1 -- start start 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b74ff1640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b70100990 0x7f0b701991e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b74ff1640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70101330 0x7f0b70199720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b74ff1640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b701069a0 0x7f0b701a4260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b74ff1640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70110db0 con 0x7f0b701069a0 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b74ff1640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70110c30 con 0x7f0b70100990 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b74ff1640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f0b70110f30 con 0x7f0b70101330 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b701069a0 0x7f0b701a4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b701069a0 0x7f0b701a4260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41500/0 (socket says 172.21.15.70:41500) 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 -- 172.21.15.70:0/1323748778 learned_addr learned my addr 172.21.15.70:0/1323748778 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6e59c640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b70100990 0x7f0b701991e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6dd9b640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70101330 0x7f0b70199720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.023 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 -- 172.21.15.70:0/1323748778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70101330 msgr2=0x7f0b70199720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70101330 0x7f0b70199720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 -- 172.21.15.70:0/1323748778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b70100990 msgr2=0x7f0b701991e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b70100990 0x7f0b701991e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 -- 172.21.15.70:0/1323748778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b701a47a0 con 0x7f0b701069a0 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.019+0000 7f0b6ed9d640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b701069a0 0x7f0b701a4260 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097b0 tx=0x7f0b68003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.020+0000 7f0b677fe640 1 -- 172.21.15.70:0/1323748778 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68004040 con 0x7f0b701069a0 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.020+0000 7f0b677fe640 1 -- 172.21.15.70:0/1323748778 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f0b680046b0 con 0x7f0b701069a0 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.020+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b701a4970 con 0x7f0b701069a0 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.020+0000 7f0b677fe640 1 -- 172.21.15.70:0/1323748778 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b68046480 con 0x7f0b701069a0 2024-09-19T04:41:21.024 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.020+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b701a4e30 con 0x7f0b701069a0 2024-09-19T04:41:21.025 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.021+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b70100df0 con 0x7f0b701069a0 2024-09-19T04:41:21.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.022+0000 7f0b677fe640 1 -- 172.21.15.70:0/1323748778 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f0b68030730 con 0x7f0b701069a0 2024-09-19T04:41:21.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.022+0000 7f0b677fe640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b5c0a33c0 0x7f0b5c0a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.023+0000 7f0b6e59c640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b5c0a33c0 0x7f0b5c0a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.023+0000 7f0b677fe640 1 -- 172.21.15.70:0/1323748778 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f0b6802e030 con 0x7f0b701069a0 2024-09-19T04:41:21.026 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.023+0000 7f0b6e59c640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b5c0a33c0 0x7f0b5c0a5880 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0b60005fd0 tx=0x7f0b6000b510 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:21.028 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.026+0000 7f0b677fe640 1 -- 172.21.15.70:0/1323748778 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f0b6804b060 con 0x7f0b701069a0 2024-09-19T04:41:21.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:20 smithi134 ceph-mon[34525]: pgmap v330: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:21.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.192+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f0b70108f00 con 0x7f0b701069a0 2024-09-19T04:41:21.194 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.193+0000 7f0b677fe640 1 -- 172.21.15.70:0/1323748778 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v94) ==== 93+0+10 (secure 0 0 0) 0x7f0b680be000 con 0x7f0b701069a0 2024-09-19T04:41:21.195 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 1 2024-09-19T04:41:21.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b5c0a33c0 msgr2=0x7f0b5c0a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.196 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b5c0a33c0 0x7f0b5c0a5880 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f0b60005fd0 tx=0x7f0b6000b510 comp rx=0 tx=0).stop 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b701069a0 msgr2=0x7f0b701a4260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b701069a0 0x7f0b701a4260 secure :-1 s=READY pgs=1345 cs=0 l=1 rev1=1 crypto rx=0x7f0b680097b0 tx=0x7f0b68003970 comp rx=0 tx=0).stop 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 shutdown_connections 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f0b5c0a33c0 0x7f0b5c0a5880 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f0b701069a0 0x7f0b701a4260 unknown :-1 s=CLOSED pgs=1345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f0b70101330 0x7f0b70199720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 --2- 172.21.15.70:0/1323748778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0b70100990 0x7f0b701991e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 >> 172.21.15.70:0/1323748778 conn(0x7f0b700fc6b0 msgr2=0x7f0b700fcea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 shutdown_connections 2024-09-19T04:41:21.197 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.195+0000 7f0b74ff1640 1 -- 172.21.15.70:0/1323748778 wait complete. 2024-09-19T04:41:21.207 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-09-19T04:41:21.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:20 smithi167 ceph-mon[34339]: pgmap v330: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 6 op/s 2024-09-19T04:41:21.311 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- 172.21.15.70:0/649874739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa4101350 msgr2=0x7f2fa410d880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/649874739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa4101350 0x7f2fa410d880 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f2f9c009cd0 tx=0x7f2f9c02a8e0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- 172.21.15.70:0/649874739 shutdown_connections 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/649874739 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa4101350 0x7f2fa410d880 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/649874739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa41009b0 0x7f2fa4100e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/649874739 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa41069c0 0x7f2fa4106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- 172.21.15.70:0/649874739 >> 172.21.15.70:0/649874739 conn(0x7f2fa40fc690 msgr2=0x7f2fa40feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- 172.21.15.70:0/649874739 shutdown_connections 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- 172.21.15.70:0/649874739 wait complete. 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 Processor -- start 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- start start 2024-09-19T04:41:21.312 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa41009b0 0x7f2fa41972e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa4101350 0x7f2fa4197820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa41069c0 0x7f2fa419bba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4110dd0 con 0x7f2fa41009b0 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4110c50 con 0x7f2fa4101350 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.308+0000 7f2fabdc6640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f2fa4110f50 con 0x7f2fa41069c0 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa41009b0 0x7f2fa41972e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa41009b0 0x7f2fa41972e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41528/0 (socket says 172.21.15.70:41528) 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 -- 172.21.15.70:0/2083131339 learned_addr learned my addr 172.21.15.70:0/2083131339 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9361640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa4101350 0x7f2fa4197820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2faa363640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa41069c0 0x7f2fa419bba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 -- 172.21.15.70:0/2083131339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa41069c0 msgr2=0x7f2fa419bba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa41069c0 0x7f2fa419bba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.313 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 -- 172.21.15.70:0/2083131339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa4101350 msgr2=0x7f2fa4197820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa4101350 0x7f2fa4197820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 -- 172.21.15.70:0/2083131339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fa419c2d0 con 0x7f2fa41009b0 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fa9b62640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa41009b0 0x7f2fa41972e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800b4a0 tx=0x7f2f9800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2f96ffd640 1 -- 172.21.15.70:0/2083131339 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98015020 con 0x7f2fa41009b0 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2f96ffd640 1 -- 172.21.15.70:0/2083131339 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f2f98011d00 con 0x7f2fa41009b0 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fa419c5c0 con 0x7f2fa41009b0 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2f96ffd640 1 -- 172.21.15.70:0/2083131339 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f98010e50 con 0x7f2fa41009b0 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.309+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fa41a3e50 con 0x7f2fa41009b0 2024-09-19T04:41:21.314 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.310+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fa4100e10 con 0x7f2fa41009b0 2024-09-19T04:41:21.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.312+0000 7f2f96ffd640 1 -- 172.21.15.70:0/2083131339 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f2f98018020 con 0x7f2fa41009b0 2024-09-19T04:41:21.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.312+0000 7f2f96ffd640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f900a35e0 0x7f2f900a5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.312+0000 7f2fa9361640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f900a35e0 0x7f2f900a5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.312+0000 7f2f96ffd640 1 -- 172.21.15.70:0/2083131339 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f2f980cfa20 con 0x7f2fa41009b0 2024-09-19T04:41:21.315 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.313+0000 7f2fa9361640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f900a35e0 0x7f2f900a5aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40fd4b0 tx=0x7f2fa000a2d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:21.317 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.315+0000 7f2f96ffd640 1 -- 172.21.15.70:0/2083131339 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f2f9801f020 con 0x7f2fa41009b0 2024-09-19T04:41:21.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.481+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f2fa402d7c0 con 0x7f2fa41009b0 2024-09-19T04:41:21.483 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.482+0000 7f2f96ffd640 1 -- 172.21.15.70:0/2083131339 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v94) ==== 104+0+11 (secure 0 0 0) 0x7f2f9809c510 con 0x7f2fa41009b0 2024-09-19T04:41:21.484 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 32 2024-09-19T04:41:21.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f900a35e0 msgr2=0x7f2f900a5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f900a35e0 0x7f2f900a5aa0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f2fa40fd4b0 tx=0x7f2fa000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa41009b0 msgr2=0x7f2fa41972e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa41009b0 0x7f2fa41972e0 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f2f9800b4a0 tx=0x7f2f9800b8a0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 shutdown_connections 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f2f900a35e0 0x7f2f900a5aa0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f2fa41069c0 0x7f2fa419bba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fa4101350 0x7f2fa4197820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 --2- 172.21.15.70:0/2083131339 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f2fa41009b0 0x7f2fa41972e0 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 >> 172.21.15.70:0/2083131339 conn(0x7f2fa40fc690 msgr2=0x7f2fa40fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 shutdown_connections 2024-09-19T04:41:21.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.484+0000 7f2fabdc6640 1 -- 172.21.15.70:0/2083131339 wait complete. 2024-09-19T04:41:21.496 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-09-19T04:41:21.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 -- 172.21.15.70:0/3076434494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c1009b0 msgr2=0x7f347c100e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 --2- 172.21.15.70:0/3076434494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c1009b0 0x7f347c100e10 secure :-1 s=READY pgs=1348 cs=0 l=1 rev1=1 crypto rx=0x7f346c009930 tx=0x7f346c02a420 comp rx=0 tx=0).stop 2024-09-19T04:41:21.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 -- 172.21.15.70:0/3076434494 shutdown_connections 2024-09-19T04:41:21.601 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 --2- 172.21.15.70:0/3076434494 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c101350 0x7f347c10d880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 --2- 172.21.15.70:0/3076434494 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c1009b0 0x7f347c100e10 unknown :-1 s=CLOSED pgs=1348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 --2- 172.21.15.70:0/3076434494 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f347c1069c0 0x7f347c106da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 -- 172.21.15.70:0/3076434494 >> 172.21.15.70:0/3076434494 conn(0x7f347c0fc690 msgr2=0x7f347c0feab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 -- 172.21.15.70:0/3076434494 shutdown_connections 2024-09-19T04:41:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.597+0000 7f3482af8640 1 -- 172.21.15.70:0/3076434494 wait complete. 2024-09-19T04:41:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3482af8640 1 Processor -- start 2024-09-19T04:41:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3482af8640 1 -- start start 2024-09-19T04:41:21.602 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3482af8640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f347c1009b0 0x7f347c1992f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3482af8640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c101350 0x7f347c199830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3482af8640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1069c0 0x7f347c1a4370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3482af8640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f347c110dd0 con 0x7f347c101350 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3482af8640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f347c110c50 con 0x7f347c1069c0 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3482af8640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f347c110f50 con 0x7f347c1009b0 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c101350 0x7f347c199830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c101350 0x7f347c199830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41556/0 (socket says 172.21.15.70:41556) 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 -- 172.21.15.70:0/1261528700 learned_addr learned my addr 172.21.15.70:0/1261528700 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:21.603 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3481095640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1069c0 0x7f347c1a4370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3480894640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f347c1009b0 0x7f347c1992f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 -- 172.21.15.70:0/1261528700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f347c1009b0 msgr2=0x7f347c1992f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f347c1009b0 0x7f347c1992f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 -- 172.21.15.70:0/1261528700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1069c0 msgr2=0x7f347c1a4370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1069c0 0x7f347c1a4370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 -- 172.21.15.70:0/1261528700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f347c1a48b0 con 0x7f347c101350 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3481095640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1069c0 0x7f347c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.598+0000 7f3473fff640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c101350 0x7f347c199830 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f346c005940 tx=0x7f346c0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.599+0000 7f3471ffb640 1 -- 172.21.15.70:0/1261528700 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c03f030 con 0x7f347c101350 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.599+0000 7f3471ffb640 1 -- 172.21.15.70:0/1261528700 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f346c003ac0 con 0x7f347c101350 2024-09-19T04:41:21.604 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.599+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f347c1a4a80 con 0x7f347c101350 2024-09-19T04:41:21.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.599+0000 7f3471ffb640 1 -- 172.21.15.70:0/1261528700 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f346c035070 con 0x7f347c101350 2024-09-19T04:41:21.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.599+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f347c1a4ee0 con 0x7f347c101350 2024-09-19T04:41:21.605 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.600+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f347c100e10 con 0x7f347c101350 2024-09-19T04:41:21.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.601+0000 7f3471ffb640 1 -- 172.21.15.70:0/1261528700 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f346c042030 con 0x7f347c101350 2024-09-19T04:41:21.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.601+0000 7f3471ffb640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34640a33c0 0x7f34640a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.602+0000 7f3480894640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34640a33c0 0x7f34640a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.602+0000 7f3471ffb640 1 -- 172.21.15.70:0/1261528700 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f346c0f0680 con 0x7f347c101350 2024-09-19T04:41:21.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.602+0000 7f3480894640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34640a33c0 0x7f34640a5880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34780058c0 tx=0x7f3478005be0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:21.606 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.605+0000 7f3471ffb640 1 -- 172.21.15.70:0/1261528700 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f346c0bd060 con 0x7f347c101350 2024-09-19T04:41:21.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.772+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f347c108f40 con 0x7f347c101350 2024-09-19T04:41:21.774 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.773+0000 7f3471ffb640 1 -- 172.21.15.70:0/1261528700 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v94) ==== 100+0+11 (secure 0 0 0) 0x7f346c0bc960 con 0x7f347c101350 2024-09-19T04:41:21.774 INFO:teuthology.orchestra.run.smithi070.stdout:pg_num: 64 2024-09-19T04:41:21.776 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34640a33c0 msgr2=0x7f34640a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34640a33c0 0x7f34640a5880 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34780058c0 tx=0x7f3478005be0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c101350 msgr2=0x7f347c199830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c101350 0x7f347c199830 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f346c005940 tx=0x7f346c0042f0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 shutdown_connections 2024-09-19T04:41:21.777 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f34640a33c0 0x7f34640a5880 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f347c1069c0 0x7f347c1a4370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f347c101350 0x7f347c199830 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 --2- 172.21.15.70:0/1261528700 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f347c1009b0 0x7f347c1992f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 >> 172.21.15.70:0/1261528700 conn(0x7f347c0fc690 msgr2=0x7f347c0fcfe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 shutdown_connections 2024-09-19T04:41:21.781 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.775+0000 7f3482af8640 1 -- 172.21.15.70:0/1261528700 wait complete. 2024-09-19T04:41:21.787 DEBUG:teuthology.orchestra.run.smithi070:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-09-19T04:41:21.888 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.884+0000 7f7ae0e42640 1 -- 172.21.15.70:0/405406451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 msgr2=0x7f7adc103110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.884+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/405406451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 0x7f7adc103110 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009900 tx=0x7f7ad002a480 comp rx=0 tx=0).stop 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.884+0000 7f7ae0e42640 1 -- 172.21.15.70:0/405406451 shutdown_connections 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.884+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/405406451 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7adc10c100 0x7f7adc10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.884+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/405406451 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc103650 0x7f7adc10bb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.884+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/405406451 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 0x7f7adc103110 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.884+0000 7f7ae0e42640 1 -- 172.21.15.70:0/405406451 >> 172.21.15.70:0/405406451 conn(0x7f7adc0fc6a0 msgr2=0x7f7adc0feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 -- 172.21.15.70:0/405406451 shutdown_connections 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 -- 172.21.15.70:0/405406451 wait complete. 2024-09-19T04:41:21.889 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 Processor -- start 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 -- start start 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 0x7f7adc198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7adc103650 0x7f7adc1989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc10c100 0x7f7adc19cd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc111ea0 con 0x7f7adc102d30 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc111d20 con 0x7f7adc103650 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.885+0000 7f7ae0e42640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f7adc112020 con 0x7f7adc10c100 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 0x7f7adc198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 0x7f7adc198460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:41584/0 (socket says 172.21.15.70:41584) 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 -- 172.21.15.70:0/3733534960 learned_addr learned my addr 172.21.15.70:0/3733534960 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ad9d9b640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7adc103650 0x7f7adc1989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7adad9d640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc10c100 0x7f7adc19cd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.890 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 -- 172.21.15.70:0/3733534960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc10c100 msgr2=0x7f7adc19cd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc10c100 0x7f7adc19cd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 -- 172.21.15.70:0/3733534960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7adc103650 msgr2=0x7f7adc1989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7adc103650 0x7f7adc1989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 -- 172.21.15.70:0/3733534960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7adc19d450 con 0x7f7adc102d30 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7adad9d640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc10c100 0x7f7adc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ada59c640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 0x7f7adc198460 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009230 tx=0x7f7ad0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7acb7fe640 1 -- 172.21.15.70:0/3733534960 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad003f030 con 0x7f7adc102d30 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7acb7fe640 1 -- 172.21.15.70:0/3733534960 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f7ad0031910 con 0x7f7adc102d30 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7adc19d6e0 con 0x7f7adc102d30 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7acb7fe640 1 -- 172.21.15.70:0/3733534960 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0035070 con 0x7f7adc102d30 2024-09-19T04:41:21.891 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.886+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7adc1a4fd0 con 0x7f7adc102d30 2024-09-19T04:41:21.892 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.887+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7adc103110 con 0x7f7adc102d30 2024-09-19T04:41:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.888+0000 7f7acb7fe640 1 -- 172.21.15.70:0/3733534960 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f7ad0042030 con 0x7f7adc102d30 2024-09-19T04:41:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.889+0000 7f7acb7fe640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ac40a33c0 0x7f7ac40a5880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.889+0000 7f7ad9d9b640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ac40a33c0 0x7f7ac40a5880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.889+0000 7f7acb7fe640 1 -- 172.21.15.70:0/3733534960 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f7ad00f03a0 con 0x7f7adc102d30 2024-09-19T04:41:21.893 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.889+0000 7f7ad9d9b640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ac40a33c0 0x7f7ac40a5880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0fed30 tx=0x7f7acc00b390 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:21.894 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:21.893+0000 7f7acb7fe640 1 -- 172.21.15.70:0/3733534960 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f7ad00bcd80 con 0x7f7adc102d30 2024-09-19T04:41:22.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:21 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/785444230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:41:22.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:21 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1323748778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:41:22.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:21 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2083131339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:41:22.107 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.105+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f7adc1071b0 con 0x7f7adc102d30 2024-09-19T04:41:22.114 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.113+0000 7f7acb7fe640 1 -- 172.21.15.70:0/3733534960 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v25) ==== 81+0+742873 (secure 0 0 0) 0x7f7ad00bc680 con 0x7f7adc102d30 2024-09-19T04:41:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:41:22.124 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:41:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "epoch": 25, 2024-09-19T04:41:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "active_gid": 15138, 2024-09-19T04:41:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "active_name": "x", 2024-09-19T04:41:22.124 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addrs": { 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6800", 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4033699978 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v1", 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:6801", 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4033699978 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.125 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "active_addr": "172.21.15.70:6801/4033699978", 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "active_change": "2024-09-19T04:30:46.485275+0000", 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "active_mgr_features": 4540701547738038271, 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "available": true, 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "standbys": [ 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24713, 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "y", 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540701547738038271, 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.128 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.129 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.130 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.131 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.132 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.133 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.134 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.136 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-19T04:41:22.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-19T04:41:22.140 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.142 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.143 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.144 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.145 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.148 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.149 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.150 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.151 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.152 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.153 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.155 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.156 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-19T04:41:22.157 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.158 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.159 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.160 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.162 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.163 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.164 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.165 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.166 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.167 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.169 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-19T04:41:22.170 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-19T04:41:22.171 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-19T04:41:22.172 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.173 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.174 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-19T04:41:22.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-19T04:41:22.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.177 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.178 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:41:22.180 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-19T04:41:22.181 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.182 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.184 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-19T04:41:22.189 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-19T04:41:22.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:41:22.192 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.193 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.194 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.195 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.196 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.197 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.198 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.199 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.200 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.201 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-19T04:41:22.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-19T04:41:22.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.204 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.205 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.206 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.207 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.208 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.210 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:41:22.212 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.213 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.216 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-19T04:41:22.217 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-19T04:41:22.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:41:22.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.220 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.223 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.224 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:41:22.225 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.226 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.227 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.228 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.229 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.230 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.232 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-19T04:41:22.233 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.234 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.237 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.238 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:41:22.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.242 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:41:22.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:41:22.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:41:22.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.247 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.248 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.249 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.250 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.251 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.253 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.256 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.257 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.261 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.262 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.263 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.264 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.265 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.266 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.270 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.272 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.273 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.274 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.276 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.277 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:41:22.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:41:22.279 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:41:22.280 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:41:22.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:41:22.282 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:41:22.283 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.284 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.286 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.287 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.288 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.289 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.291 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.292 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.294 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.295 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.296 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.298 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-19T04:41:22.302 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-19T04:41:22.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-19T04:41:22.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.305 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.306 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.310 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.311 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-19T04:41:22.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-19T04:41:22.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-19T04:41:22.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-19T04:41:22.315 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.316 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.319 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.323 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.324 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-19T04:41:22.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-19T04:41:22.326 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.327 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-19T04:41:22.328 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:41:22.329 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.330 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.331 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-19T04:41:22.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.333 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.336 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.340 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.341 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.343 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.344 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.348 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.349 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.350 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.351 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.353 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.354 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.355 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.358 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.359 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.361 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.366 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.368 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.371 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.372 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.373 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.376 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.377 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.380 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.382 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.384 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-19T04:41:22.386 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.387 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.390 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.392 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.393 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.394 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.395 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.399 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.401 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.402 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.403 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.404 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.406 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.407 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.410 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.412 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.413 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.414 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.417 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.418 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.419 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-19T04:41:22.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.424 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.428 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.431 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.432 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.434 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.435 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.436 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.437 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.439 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.440 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-19T04:41:22.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.443 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:22.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.446 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-19T04:41:22.448 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-19T04:41:22.450 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.451 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.452 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.453 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.454 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.455 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.461 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.463 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.470 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.471 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.472 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.475 INFO:teuthology.orchestra.run.smithi070.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.478 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.484 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.485 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.494 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.496 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.497 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.498 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-19T04:41:22.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-19T04:41:22.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.501 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.502 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.505 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.506 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.507 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.508 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.509 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.510 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.511 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.512 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.513 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.514 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.515 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.516 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.517 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.518 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.519 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.520 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.521 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.522 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.523 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:22.524 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.525 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.526 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.527 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.528 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.529 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.530 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.531 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-19T04:41:22.532 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-19T04:41:22.533 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-19T04:41:22.534 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-19T04:41:22.535 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.536 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.537 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.538 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.539 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.540 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.541 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.542 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.543 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.544 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.545 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.546 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.547 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.548 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.549 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.550 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.551 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.552 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.553 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.554 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.555 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.556 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.557 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.558 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.559 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.560 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.561 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.562 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.563 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.564 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.565 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.566 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.567 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.568 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.569 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.570 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.571 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.572 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.573 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.574 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.575 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.576 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.577 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.578 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-19T04:41:22.579 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.580 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.581 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.582 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "gid": 24724, 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "z", 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "mgr_features": 4540701547738038271, 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.583 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.584 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.585 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.586 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.587 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.588 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.589 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.590 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-19T04:41:22.591 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-19T04:41:22.592 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-19T04:41:22.593 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.594 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.595 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.596 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:41:22.597 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-19T04:41:22.598 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-19T04:41:22.599 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-19T04:41:22.600 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.601 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.602 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.603 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.604 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.605 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:41:22.606 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:41:22.607 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.608 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.609 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.610 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.611 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.612 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.613 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.614 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.615 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.616 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.617 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.618 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.619 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.620 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.621 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.622 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:41:22.623 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.624 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.625 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.626 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.627 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.628 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.629 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.630 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.631 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.632 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.633 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:41:22.634 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.635 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.636 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.637 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:41:22.638 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-19T04:41:22.639 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.640 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.641 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.642 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.643 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-19T04:41:22.644 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:22.645 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.646 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.647 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:41:22.648 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.649 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.650 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.651 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:41:22.652 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.653 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.654 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.655 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.656 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.657 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.658 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.659 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.660 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.661 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.662 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.663 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.664 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.665 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.666 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.667 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.668 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.669 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.670 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.671 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-19T04:41:22.672 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-19T04:41:22.673 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.674 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:41:22.675 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:41:22.676 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.677 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.678 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.679 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.680 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.681 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-19T04:41:22.682 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-19T04:41:22.683 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.684 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.685 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.686 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.687 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.688 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:41:22.689 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.690 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.691 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.692 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.693 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.694 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.695 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.696 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-19T04:41:22.697 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.698 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.699 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.700 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.701 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.702 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.703 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.704 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.705 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.706 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.707 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:41:22.708 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:41:22.709 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.710 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.711 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.712 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.713 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.714 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.715 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.716 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.717 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.718 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.719 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.720 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.721 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:41:22.722 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:41:22.723 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.724 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.725 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.726 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.727 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.728 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.729 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.730 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.731 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.732 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.733 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.734 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.735 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:41:22.736 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.737 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.738 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.739 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.740 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.741 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.742 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.743 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.744 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.745 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.746 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.747 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-19T04:41:22.748 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.749 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.750 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.751 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.753 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.754 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.755 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.756 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.757 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.758 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-19T04:41:22.759 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.761 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.762 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.763 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.764 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.765 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-19T04:41:22.766 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.767 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-19T04:41:22.768 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.769 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.770 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.771 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.772 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.773 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.774 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.775 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.776 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.777 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.778 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:41:22.779 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.780 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.781 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.782 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.783 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.784 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.785 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.786 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.787 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.788 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.789 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.790 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-19T04:41:22.791 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-19T04:41:22.792 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.793 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.794 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-19T04:41:22.795 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.796 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-19T04:41:22.797 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:22.798 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.799 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.800 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.801 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.802 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.803 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.804 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.805 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.806 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.807 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.808 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.809 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.810 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.811 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.812 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.813 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.814 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.815 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.816 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.817 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.818 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.819 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.820 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.821 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.822 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.823 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:41:22.824 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.825 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.826 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.827 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.828 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.829 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.830 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.831 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.832 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.833 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.834 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.835 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.836 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.837 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.838 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-19T04:41:22.839 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.840 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.841 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:41:22.842 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.843 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.844 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.845 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.846 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.847 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.848 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.849 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.850 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.851 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.852 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.853 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.854 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.855 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.856 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.857 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.858 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.859 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.860 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.861 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.862 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.863 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.864 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.865 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.866 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.867 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-19T04:41:22.868 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.869 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.870 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.871 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.872 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.873 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.874 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.875 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.876 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.877 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.878 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.879 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.880 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.881 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.882 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.883 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.884 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.885 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.886 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.887 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-19T04:41:22.888 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.889 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.890 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.891 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.892 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.893 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.894 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.895 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.896 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-19T04:41:22.897 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:22.898 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.899 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.900 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.901 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.902 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.903 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.904 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.905 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.906 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.907 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.908 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.909 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.910 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.911 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.912 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-19T04:41:22.913 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.914 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-19T04:41:22.915 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.916 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.917 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.918 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.919 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.920 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.921 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:41:22.922 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:41:22.923 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.924 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.925 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.926 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.927 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.928 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.929 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.930 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.931 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.932 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.933 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.934 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.935 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.936 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.937 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.938 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.939 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.940 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.941 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:41:22.942 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.943 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.944 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.945 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.946 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.947 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.948 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-19T04:41:22.949 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.950 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.951 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.952 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.953 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.954 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.955 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.956 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-19T04:41:22.957 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.958 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.959 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:22.960 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-19T04:41:22.961 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.962 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.963 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.964 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.965 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.966 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.967 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.968 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-19T04:41:22.969 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-19T04:41:22.970 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.971 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.972 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.973 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.974 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.975 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.976 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.977 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.978 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.979 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.980 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.981 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.982 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.983 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.984 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.985 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.986 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.987 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.988 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.989 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.990 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.991 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.992 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.993 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:22.994 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.995 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.996 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.997 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.998 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:22.999 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-19T04:41:23.000 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-19T04:41:23.001 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.002 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.003 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.004 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.005 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.006 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.007 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.008 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.009 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.010 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.011 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.012 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.013 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.014 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.015 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.016 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.017 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.018 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.019 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.020 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.021 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.022 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.023 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.024 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.025 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.026 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.027 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.028 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.029 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.030 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.031 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.032 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.033 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.034 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:23.035 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.036 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-19T04:41:23.037 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.038 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.039 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.040 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.041 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.042 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.043 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.044 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.045 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.046 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.047 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-19T04:41:23.048 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.049 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "modules": [ 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard", 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "iostat", 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "nfs", 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "restful", 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: "snap_schedule" 2024-09-19T04:41:23.050 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "available_modules": [ 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "alerts", 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:23.051 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How frequently to reexamine health status", 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.052 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.053 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.054 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.055 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.056 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.057 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_destination": { 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_destination", 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email address to send alerts to", 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.058 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_from_name": { 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_from_name", 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "Ceph", 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Email From: name", 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.059 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_host": { 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_host", 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP server", 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.060 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_password": { 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_password", 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Password to authenticate with", 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.061 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_port": { 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_port", 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "465", 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP port", 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.062 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_sender": { 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_sender", 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SMTP envelope sender", 2024-09-19T04:41:23.063 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_ssl": { 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_ssl", 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use SSL to connect to SMTP server", 2024-09-19T04:41:23.064 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "smtp_user": { 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "smtp_user", 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.065 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "User to authenticate as", 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "balancer", 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.066 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "active": { 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "active", 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically balance PGs across cluster", 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.067 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_time": { 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_time", 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0000", 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "beginning time of day to automatically balance", 2024-09-19T04:41:23.068 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "begin_weekday": { 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "begin_weekday", 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-09-19T04:41:23.069 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_max_iterations": { 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_max_iterations", 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "25", 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "250", 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-09-19T04:41:23.070 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_metrics": { 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_metrics", 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "pgs,objects,bytes", 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.071 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "crush_compat_step": { 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crush_compat_step", 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.5", 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0.001", 2024-09-19T04:41:23.072 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "0.999", 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "aggressiveness of optimization", 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "end_time": { 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_time", 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2359", 2024-09-19T04:41:23.073 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ending time of day to automatically balance", 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "end_weekday": { 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "end_weekday", 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.074 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "0", 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "6", 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.075 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.076 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.077 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.078 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.079 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "min_score": { 2024-09-19T04:41:23.080 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_score", 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-19T04:41:23.081 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "upmap", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "crush-compat", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "none", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "read", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap", 2024-09-19T04:41:23.082 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap-read" 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Balancer mode", 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_ids": { 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_ids", 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.083 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.084 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_deviation": { 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_deviation", 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.085 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "deviation below which no optimization is attempted", 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "upmap_max_optimizations": { 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "upmap_max_optimizations", 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:23.086 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.087 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm", 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_down_multiplier": { 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_down_multiplier", 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.088 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_refresh_rate": { 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_refresh_rate", 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "20", 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.089 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "agent_starting_port": { 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "agent_starting_port", 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4721", 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.090 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_ptrace": { 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_ptrace", 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.091 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_interval": { 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_interval", 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.092 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to autotune daemon memory", 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "autotune_memory_target_ratio": { 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "autotune_memory_target_ratio", 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:23.093 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0.7", 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm_log_destination": { 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cephadm_log_destination", 2024-09-19T04:41:23.094 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "file", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "file,syslog", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "syslog" 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.095 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "cgroups_split": { 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cgroups_split", 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-09-19T04:41:23.096 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "config_checks_enabled": { 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_checks_enabled", 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-09-19T04:41:23.097 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "config_dashboard": { 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_dashboard", 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.098 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_alertmanager": { 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_alertmanager", 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.099 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_base": { 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_base", 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/ceph", 2024-09-19T04:41:23.100 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Container image name, without the tag", 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_elasticsearch": { 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_elasticsearch", 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-09-19T04:41:23.101 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "elasticsearch container image", 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_grafana": { 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_grafana", 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.102 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_haproxy": { 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_haproxy", 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.103 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "HAproxy container image", 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_agent": { 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_agent", 2024-09-19T04:41:23.104 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger agent container image", 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.105 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_collector": { 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_collector", 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger collector container image", 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.106 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_jaeger_query": { 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_jaeger_query", 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Jaeger query container image", 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.107 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_keepalived": { 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_keepalived", 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Keepalived container image", 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.108 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_loki": { 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_loki", 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Loki container image", 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.109 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_node_exporter": { 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_node_exporter", 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.110 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_nvmeof": { 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_nvmeof", 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Nvme-of container image", 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.111 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_prometheus": { 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_prometheus", 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Prometheus container image", 2024-09-19T04:41:23.112 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_promtail": { 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_promtail", 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.113 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Promtail container image", 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_samba": { 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_samba", 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.114 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Samba/SMB container image", 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "container_image_snmp_gateway": { 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_image_snmp_gateway", 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.115 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "SNMP Gateway container image", 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "container_init": { 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "container_init", 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.116 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Run podman/docker with `--init`", 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "daemon_cache_timeout": { 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "daemon_cache_timeout", 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.117 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "default_cephadm_command_timeout": { 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_cephadm_command_timeout", 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.118 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "900", 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "default_registry": { 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "default_registry", 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.119 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "docker.io", 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "device_cache_timeout": { 2024-09-19T04:41:23.120 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_cache_timeout", 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1800", 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache device inventory", 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.121 INFO:teuthology.orchestra.run.smithi070.stdout: "device_enhanced_scan": { 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_enhanced_scan", 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use libstoragemgmt during device scans", 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.122 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "facts_cache_timeout": { 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "facts_cache_timeout", 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "seconds to cache host facts data", 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.123 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "grafana_dashboards_path": { 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "grafana_dashboards_path", 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.124 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "host_check_interval": { 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "host_check_interval", 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to perform a host check", 2024-09-19T04:41:23.125 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "hw_monitoring": { 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hw_monitoring", 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.126 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "inventory_list_all": { 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "inventory_list_all", 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.127 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.128 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.129 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "log_refresh_metadata": { 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_refresh_metadata", 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.130 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-09-19T04:41:23.131 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.132 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.133 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.134 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf": { 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.135 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "*", 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-09-19T04:41:23.136 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max_count_per_host": { 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_count_per_host", 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.137 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of daemons per service per host", 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "max_osd_draining_count": { 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_osd_draining_count", 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.138 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "migration_current": { 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "migration_current", 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.139 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "internal - do not modify", 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "mode": { 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mode", 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "root", 2024-09-19T04:41:23.140 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm-package", 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "root" 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "mode for remote execution of cephadm", 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "oob_default_addr": { 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "oob_default_addr", 2024-09-19T04:41:23.141 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "169.254.1.1", 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Default address for RedFish API (oob management).", 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "prometheus_alerts_path": { 2024-09-19T04:41:23.142 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus_alerts_path", 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_insecure": { 2024-09-19T04:41:23.143 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_insecure", 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.144 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_password": { 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_password", 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.145 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_url": { 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_url", 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-09-19T04:41:23.146 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "registry_username": { 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "registry_username", 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.147 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "secure_monitoring_stack": { 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secure_monitoring_stack", 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.148 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "service_discovery_port": { 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "service_discovery_port", 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8765", 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.149 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "cephadm service discovery port", 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "ssh_config_file": { 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssh_config_file", 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.150 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "use_agent": { 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_agent", 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.151 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "use_repo_digest": { 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "use_repo_digest", 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.152 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_failed_host_check": { 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_failed_host_check", 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.153 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if the host check fails", 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_daemons": { 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_daemons", 2024-09-19T04:41:23.154 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_on_stray_hosts": { 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_on_stray_hosts", 2024-09-19T04:41:23.155 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.156 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crash", 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.157 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.158 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.159 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.160 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.161 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "retain_interval": { 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retain_interval", 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.162 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "31536000", 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain crashes before pruning them", 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_recent_interval": { 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_recent_interval", 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.163 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1209600", 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "time interval in which to warn about recent crashes", 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.164 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dashboard", 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.165 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_HOST": { 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_HOST", 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.166 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.167 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_ENABLED": { 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_ENABLED", 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.168 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.169 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "ENABLE_BROWSABLE_API": { 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ENABLE_BROWSABLE_API", 2024-09-19T04:41:23.170 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-09-19T04:41:23.171 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.172 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.173 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.174 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.175 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_NFS": { 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.176 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RBD": { 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.177 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "FEATURE_TOGGLE_RGW": { 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.178 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.179 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_PASSWORD": { 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_PASSWORD", 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.180 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.181 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_URL": { 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_URL", 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.182 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_API_USERNAME": { 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_API_USERNAME", 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:23.183 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.184 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.185 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-09-19T04:41:23.186 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "ISSUE_TRACKER_API_KEY": { 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-09-19T04:41:23.187 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.188 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_HOST": { 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_HOST", 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.189 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.190 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.191 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.192 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.193 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.194 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.195 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.196 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.197 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_ENABLED": { 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_ENABLED", 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.198 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-09-19T04:41:23.199 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:23.200 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.201 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8", 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "REST_REQUESTS_TIMEOUT": { 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.202 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "45", 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ACCESS_KEY": { 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ACCESS_KEY", 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.203 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-09-19T04:41:23.204 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "admin", 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SECRET_KEY": { 2024-09-19T04:41:23.205 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SECRET_KEY", 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.206 INFO:teuthology.orchestra.run.smithi070.stdout: "RGW_API_SSL_VERIFY": { 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "RGW_API_SSL_VERIFY", 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.207 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.208 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.209 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.210 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "cross_origin_url": { 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cross_origin_url", 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.211 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "crt_file": { 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "crt_file", 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.212 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "debug": { 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "debug", 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.213 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Enable/disable debug options", 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "jwt_token_ttl": { 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "jwt_token_ttl", 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "28800", 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.214 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.215 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.216 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.217 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.218 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.219 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.220 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.221 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "motd": { 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "motd", 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "The message of the day", 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.222 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect_resolve_ip_addr": { 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "redirect_resolve_ip_addr", 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.223 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.224 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8080", 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.225 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.226 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl_server_port": { 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl_server_port", 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8443", 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.227 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "redirect", 2024-09-19T04:41:23.228 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "redirect" 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-19T04:41:23.229 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "url_prefix": { 2024-09-19T04:41:23.230 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url_prefix", 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.231 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_monitoring": { 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_monitoring", 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.232 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "monitor device health metrics", 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.233 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.234 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.235 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.236 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.237 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "mark_out_threshold": { 2024-09-19T04:41:23.238 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mark_out_threshold", 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "2419200", 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.239 INFO:teuthology.orchestra.run.smithi070.stdout: "pool_name": { 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pool_name", 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "device_health_metrics", 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name of pool in which to store device health metrics", 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.240 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "retention_period": { 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "retention_period", 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15552000", 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long to retain device health metrics", 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.241 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_frequency": { 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_frequency", 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to scrape device health metrics", 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.242 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "self_heal": { 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "self_heal", 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-09-19T04:41:23.243 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.244 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how frequently to wake up and check device health", 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "warn_threshold": { 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "warn_threshold", 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7257600", 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.245 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "diskprediction_local", 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.246 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.247 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.248 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.249 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.250 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.251 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "predict_interval": { 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predict_interval", 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "86400", 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.252 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "predictor_model": { 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "predictor_model", 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "prophetstor", 2024-09-19T04:41:23.253 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "600", 2024-09-19T04:41:23.254 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "influx", 2024-09-19T04:41:23.255 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": false, 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "influxdb python module not found", 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "batch_size": { 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "batch_size", 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5000", 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-09-19T04:41:23.256 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "database": { 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "database", 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "ceph", 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.257 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "hostname": { 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "hostname", 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.258 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server hostname", 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "30", 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "5", 2024-09-19T04:41:23.259 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.260 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.261 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.262 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.263 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.264 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "password": { 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "password", 2024-09-19T04:41:23.265 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "password of InfluxDB server user", 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "port": { 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "port", 2024-09-19T04:41:23.266 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "8086", 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "InfluxDB server port", 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "ssl": { 2024-09-19T04:41:23.267 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ssl", 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "false", 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.268 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "threads": { 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threads", 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "32", 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.269 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "username": { 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "username", 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "username of InfluxDB server user", 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.270 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "verify_ssl": { 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "verify_ssl", 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "true", 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.271 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "insights", 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.272 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.273 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.274 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.275 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.276 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.277 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "iostat", 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.278 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.279 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.280 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.281 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.282 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.283 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "k8sevents", 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "ceph_event_retention_days": { 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "ceph_event_retention_days", 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "7", 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.284 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Days to hold ceph event information within local cache", 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "config_check_secs": { 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "config_check_secs", 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "10", 2024-09-19T04:41:23.285 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.286 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.287 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.288 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.289 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.290 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.291 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "localpool", 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "failure_domain": { 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "failure_domain", 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "host", 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.292 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "failure domain for any created local pool", 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.293 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.295 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.296 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.297 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "min_size": { 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "min_size", 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.298 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default min_size for any created local pool", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "num_rep": { 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "num_rep", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.299 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3", 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default replica count for any created local pool", 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_num": { 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_num", 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.300 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "128", 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "default pg_num for any created local pool", 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "prefix": { 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prefix", 2024-09-19T04:41:23.301 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "name prefix for any created local pool", 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "subtree": { 2024-09-19T04:41:23.302 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "subtree", 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "rack", 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "CRUSH level for which to create a local pool", 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mds_autoscaler", 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.304 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.305 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.306 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.307 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.308 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.309 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirroring", 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.310 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.311 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.312 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.313 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.314 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "nfs", 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.315 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.316 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.317 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.318 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.319 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.320 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "fail_fs": { 2024-09-19T04:41:23.321 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "fail_fs", 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.322 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.323 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.324 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.325 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.326 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.327 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator": { 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "orchestrator", 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.328 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "cephadm", 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "rook", 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "test_orchestrator" 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Orchestrator backend", 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.329 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_perf_query", 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.330 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.331 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.332 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.333 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.334 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "osd_support", 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.335 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.336 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.337 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.338 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.339 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.340 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "pg_autoscaler", 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.341 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.342 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.343 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.344 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.345 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.346 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.347 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "threshold": { 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "threshold", 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "3.0", 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1.0", 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "scaling threshold", 2024-09-19T04:41:23.348 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "progress", 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_pg_recovery_event": { 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_pg_recovery_event", 2024-09-19T04:41:23.349 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow the module to show pg recovery progress", 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-19T04:41:23.350 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.351 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.352 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.353 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.354 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.355 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.356 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max_completed_events": { 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_completed_events", 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "50", 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "number of past completed events to remember", 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.357 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "sleep_interval": { 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "sleep_interval", 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "how long the module is going to sleep", 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.358 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "prometheus", 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "cache": { 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "cache", 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.359 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "exclude_perf_counters": { 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "exclude_perf_counters", 2024-09-19T04:41:23.360 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.361 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.362 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.363 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.364 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.365 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.366 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools": { 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools", 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.367 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_stats_pools_refresh_interval": { 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "300", 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.368 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "scrape_interval": { 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "scrape_interval", 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15.0", 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.369 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "::", 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.370 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "9283", 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.371 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "stale_cache_strategy": { 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stale_cache_strategy", 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "log", 2024-09-19T04:41:23.372 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_behaviour": { 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_behaviour", 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.373 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "default", 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "default", 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "error" 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.374 INFO:teuthology.orchestra.run.smithi070.stdout: "standby_error_status_code": { 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "standby_error_status_code", 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "500", 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "400", 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "599", 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.375 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.376 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.377 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.378 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.379 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.380 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_snap_create": { 2024-09-19T04:41:23.381 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_snap_create", 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10", 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "mirror_snapshot_schedule": { 2024-09-19T04:41:23.382 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "mirror_snapshot_schedule", 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.383 INFO:teuthology.orchestra.run.smithi070.stdout: "trash_purge_schedule": { 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "trash_purge_schedule", 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.384 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "restful", 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "enable_auth": { 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enable_auth", 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.385 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "key_file": { 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "key_file", 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.386 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.387 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.388 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.389 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.390 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.391 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.392 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "server_addr": { 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_addr", 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.393 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "server_port": { 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "server_port", 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.394 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rgw", 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.395 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.396 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.397 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.398 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.399 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.400 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "secondary_zone_period_retry_limit": { 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "secondary_zone_period_retry_limit", 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "5", 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "RGW module period update retry limit for secondary site", 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.401 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rook", 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.402 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.403 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.404 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.405 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.406 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.407 INFO:teuthology.orchestra.run.smithi070.stdout: "storage_class": { 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "storage_class", 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "local", 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.408 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "selftest", 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.409 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.410 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.411 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.412 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.413 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "roption1": { 2024-09-19T04:41:23.414 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption1", 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.415 INFO:teuthology.orchestra.run.smithi070.stdout: "roption2": { 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "roption2", 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "xyz", 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.416 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption1": { 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption1", 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.417 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption2": { 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption2", 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.418 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption3": { 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption3", 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "float", 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.419 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption4": { 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption4", 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.420 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption5": { 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption5", 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.421 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption6": { 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption6", 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.422 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "rwoption7": { 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rwoption7", 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "1", 2024-09-19T04:41:23.423 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "42", 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "testkey": { 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testkey", 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.424 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "testlkey": { 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testlkey", 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.425 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "testnewline": { 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "testnewline", 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.426 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.427 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "allow_m_granularity": { 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "allow_m_granularity", 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "allow minute scheduled snapshots", 2024-09-19T04:41:23.428 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "dump_on_update": { 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "dump_on_update", 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.429 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "dump database to debug log on update", 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.430 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.431 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.432 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.433 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.434 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.435 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "stats", 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.436 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.437 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.438 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.439 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.440 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.441 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "status", 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.442 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.443 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.444 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.445 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.446 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telegraf", 2024-09-19T04:41:23.447 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "address": { 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "address", 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.448 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "15", 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.449 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.450 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.451 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.452 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.453 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.454 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "telemetry", 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.455 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_basic": { 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_basic", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share basic cluster information (size, version)", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.456 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_crash": { 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_crash", 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.457 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_device": { 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_device", 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-09-19T04:41:23.458 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_ident": { 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_ident", 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-09-19T04:41:23.459 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "channel_perf": { 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "channel_perf", 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.460 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Share various performance metrics of a cluster", 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "contact": { 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "contact", 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.461 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "description": { 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "description", 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.462 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "device_url": { 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "device_url", 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.463 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "enabled": { 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "enabled", 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.464 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.465 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "24", 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "8", 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "last_opt_revision": { 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "last_opt_revision", 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.466 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "1", 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard": { 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard", 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.467 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "leaderboard_description": { 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "leaderboard_description", 2024-09-19T04:41:23.468 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.469 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.470 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.471 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.472 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.473 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.474 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "organization": { 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "organization", 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.475 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "proxy": { 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "proxy", 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.476 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "url": { 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "url", 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.477 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "test_orchestrator", 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.478 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.479 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.480 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.481 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.482 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.483 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.484 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.485 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.486 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.487 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.488 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.489 INFO:teuthology.orchestra.run.smithi070.stdout: "max_concurrent_clones": { 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "max_concurrent_clones", 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "4", 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Number of asynchronous cloner threads", 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.490 INFO:teuthology.orchestra.run.smithi070.stdout: "periodic_async_work": { 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "periodic_async_work", 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Periodically check for async work", 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.491 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_delay": { 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_delay", 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "0", 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.492 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "snapshot_clone_no_wait": { 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snapshot_clone_no_wait", 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "True", 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.493 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix", 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "can_run": true, 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "error_string": "", 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "module_options": { 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "discovery_interval": { 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "discovery_interval", 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "uint", 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.494 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "100", 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "identifier": { 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "identifier", 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.495 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "interval": { 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "interval", 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "secs", 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.496 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "60", 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "log_level": { 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_level", 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.497 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.498 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster": { 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster", 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.499 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_cluster_level": { 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_cluster_level", 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "info", 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [ 2024-09-19T04:41:23.500 INFO:teuthology.orchestra.run.smithi070.stdout: "", 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "critical", 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "debug", 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "error", 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "info", 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "warning" 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "log_to_file": { 2024-09-19T04:41:23.501 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "log_to_file", 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "bool", 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 1, 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "False", 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_host": { 2024-09-19T04:41:23.502 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_host", 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "", 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.503 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_port": { 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_port", 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "int", 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "10051", 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.504 INFO:teuthology.orchestra.run.smithi070.stdout: "zabbix_sender": { 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "zabbix_sender", 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "str", 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "level": "advanced", 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "flags": 0, 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "min": "", 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "max": "", 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "enum_allowed": [], 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "desc": "", 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "long_desc": "", 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "tags": [], 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: "see_also": [] 2024-09-19T04:41:23.505 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "services": { 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "dashboard": "https://172.21.15.70:8443/" 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "always_on_modules": { 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "octopus": [ 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-19T04:41:23.506 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "pacific": [ 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-19T04:41:23.507 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "quincy": [ 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-19T04:41:23.508 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "reef": [ 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-19T04:41:23.509 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: ], 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "squid": [ 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "balancer", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "crash", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "devicehealth", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "orchestrator", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "pg_autoscaler", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "progress", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "rbd_support", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "status", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "telemetry", 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: "volumes" 2024-09-19T04:41:23.510 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "last_failure_osd_epoch": 84, 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "active_clients": [ 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "devicehealth", 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2353535764 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.511 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "libcephsqlite", 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 4047843633 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "rbd_support", 2024-09-19T04:41:23.512 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2983250838 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-19T04:41:23.513 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 1016969755 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "snap_schedule", 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 3533888740 2024-09-19T04:41:23.514 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "name": "volumes", 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "addrvec": [ 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: { 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "type": "v2", 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "addr": "172.21.15.70:0", 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: "nonce": 2168204260 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout: ] 2024-09-19T04:41:23.515 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:41:23.517 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:22 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/1261528700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:41:23.517 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:22 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3733534960' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:41:23.517 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:22 smithi134 ceph-mon[34525]: pgmap v331: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:41:23.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ac40a33c0 msgr2=0x7f7ac40a5880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:23.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ac40a33c0 0x7f7ac40a5880 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f7adc0fed30 tx=0x7f7acc00b390 comp rx=0 tx=0).stop 2024-09-19T04:41:23.517 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 msgr2=0x7f7adc198460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 0x7f7adc198460 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7f7ad0009230 tx=0x7f7ad0004270 comp rx=0 tx=0).stop 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 shutdown_connections 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f7ac40a33c0 0x7f7ac40a5880 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f7adc10c100 0x7f7adc19cd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7adc103650 0x7f7adc1989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 --2- 172.21.15.70:0/3733534960 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f7adc102d30 0x7f7adc198460 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 >> 172.21.15.70:0/3733534960 conn(0x7f7adc0fc6a0 msgr2=0x7f7adc0fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 shutdown_connections 2024-09-19T04:41:23.518 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:22.118+0000 7f7ae0e42640 1 -- 172.21.15.70:0/3733534960 wait complete. 2024-09-19T04:41:23.518 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:21 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/785444230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:41:23.519 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:21 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1323748778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:41:23.519 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:21 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2083131339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:41:23.519 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:22 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/1261528700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:41:23.519 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:22 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3733534960' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:41:23.519 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:22 smithi167 ceph-mon[34339]: pgmap v331: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:41:23.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:21 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/785444230' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:41:23.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:21 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1323748778' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-09-19T04:41:23.519 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:21 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2083131339' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-09-19T04:41:23.573 DEBUG:tasks.check_counter:Getting stats from a 2024-09-19T04:41:23.573 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.a perf dump 2024-09-19T04:41:23.574 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:22 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/1261528700' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-09-19T04:41:23.574 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:22 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3733534960' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-09-19T04:41:23.574 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:22 smithi070 ceph-mon[30942]: pgmap v331: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 6 op/s 2024-09-19T04:41:23.830 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 217, 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 205, 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1449136, 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 125152, 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.040368728, 2024-09-19T04:41:24.288 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.013914981, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.037144811, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 205, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.014105734, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000068808 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1449136, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 125152 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 2, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 156, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 320, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 184720, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.012302853, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.008405290, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.002071381, 2024-09-19T04:41:24.290 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 153, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.008699688, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000056860 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 184720 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.291 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.000286552, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000218806, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:24.292 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-19T04:41:24.293 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:24.294 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:24.295 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:24.296 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 149017, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 31, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-09-19T04:41:24.297 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-19T04:41:24.298 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 215, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1416059, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 215, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 215, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1416059, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:24.299 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:24.300 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:24.300 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:41:25.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:24 smithi134 ceph-mon[34525]: pgmap v332: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:41:25.084 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:24 smithi070 ceph-mon[30942]: pgmap v332: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:41:25.111 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-09-19T04:41:25.111 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-09-19T04:41:25.111 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.a 2024-09-19T04:41:25.111 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.a 2024-09-19T04:41:25.111 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-09-19T04:41:25.111 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-09-19T04:41:25.112 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-09-19T04:41:25.112 DEBUG:tasks.check_counter:Getting stats from d 2024-09-19T04:41:25.112 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.d perf dump 2024-09-19T04:41:25.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:24 smithi167 ceph-mon[34339]: pgmap v332: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 100 B/s wr, 6 op/s 2024-09-19T04:41:25.357 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:25.845 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:41:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 218, 2024-09-19T04:41:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 208, 2024-09-19T04:41:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1447456, 2024-09-19T04:41:25.845 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 127904, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.036561361, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.013038047, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.034445557, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 207, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.009859943, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000047632 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:25.846 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1447456, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 127904 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 2, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 159, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 320, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 185248, 2024-09-19T04:41:25.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.012019190, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.007955906, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.002062100, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 156, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.012131087, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000077763 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:25.848 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 185248 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 4, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 4, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3040, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 448, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.002366137, 2024-09-19T04:41:25.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000039898, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.002310173, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 3, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.003979042, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.001326347 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-19T04:41:25.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:25.851 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:25.852 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-19T04:41:25.853 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 149034, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 32, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:25.854 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:25.855 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 220, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1416709, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 220, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 220, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1416709, 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-19T04:41:25.856 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:25.857 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:25.857 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:41:26.580 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-09-19T04:41:26.580 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-09-19T04:41:26.580 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.d 2024-09-19T04:41:26.580 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.d 2024-09-19T04:41:26.580 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-09-19T04:41:26.580 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-09-19T04:41:26.580 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-09-19T04:41:26.580 DEBUG:tasks.check_counter:Getting stats from g 2024-09-19T04:41:26.581 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.g perf dump 2024-09-19T04:41:26.829 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:26.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:26 smithi070 ceph-mon[30942]: pgmap v333: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:41:27.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:26 smithi134 ceph-mon[34525]: pgmap v333: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:41:27.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:26 smithi167 ceph-mon[34339]: pgmap v333: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-09-19T04:41:27.288 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:41:27.288 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 215, 2024-09-19T04:41:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 205, 2024-09-19T04:41:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1446640, 2024-09-19T04:41:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 125984, 2024-09-19T04:41:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-19T04:41:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-09-19T04:41:27.289 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.036676583, 2024-09-19T04:41:27.292 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.012718526, 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.034222271, 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 204, 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.009725873, 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000047675 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:27.293 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1446640, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 125984 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 6, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 158, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3360, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 185168, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.014638786, 2024-09-19T04:41:27.294 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.008706638, 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.003842921, 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 156, 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.015344949, 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000098365 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:27.295 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 185168 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.000345196, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T04:41:27.296 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000272412, 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.297 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:27.298 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:27.299 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:27.300 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 148977, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 30, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-19T04:41:27.301 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-09-19T04:41:27.302 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 217, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1416319, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 217, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-19T04:41:27.303 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-19T04:41:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 217, 2024-09-19T04:41:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1416319, 2024-09-19T04:41:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-19T04:41:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:27.304 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:27.305 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:41:28.119 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-09-19T04:41:28.119 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-09-19T04:41:28.119 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.g 2024-09-19T04:41:28.119 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.g 2024-09-19T04:41:28.119 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-09-19T04:41:28.120 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-09-19T04:41:28.120 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-09-19T04:41:28.120 DEBUG:tasks.check_counter:Getting stats from j 2024-09-19T04:41:28.120 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.j perf dump 2024-09-19T04:41:28.364 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:28.847 INFO:teuthology.orchestra.run.smithi070.stdout:{ 2024-09-19T04:41:28.847 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:28.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 0, 2024-09-19T04:41:28.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 2, 2024-09-19T04:41:28.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 0, 2024-09-19T04:41:28.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 0, 2024-09-19T04:41:28.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 4, 2024-09-19T04:41:28.847 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 0, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.001574417, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.000338535, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:28.848 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 6, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 163, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 3360, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 186048, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 5, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 3, 2024-09-19T04:41:28.849 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.014798607, 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.009037238, 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.003827380, 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 161, 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.016579136, 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000102976 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:28.850 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 186048 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_messages": 220, 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages": 210, 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_bytes": 1448000, 2024-09-19T04:41:28.851 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_bytes": 129184, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_created_connections": 2, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_active_connections": 1, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_total_time": 0.039301337, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_send_time": 0.014239586, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_recv_time": 0.037419274, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 209, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.010751033, 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000051440 2024-09-19T04:41:28.852 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_recv_encrypted_bytes": 1448000, 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "msgr_send_encrypted_bytes": 129184 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "cct": { 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "total_workers": 0, 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: "unhealthy_workers": 0 2024-09-19T04:41:28.853 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "mempool": { 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:28.854 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:28.855 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_items": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:28.856 INFO:teuthology.orchestra.run.smithi070.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_bytes": 149034, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_anon_items": 32, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_bytes": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_items": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_bytes": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_items": 0, 2024-09-19T04:41:28.857 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "pgmap_items": 0, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_bytes": 928, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "mds_co_items": 2, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_1_items": 0, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "unittest_2_items": 0 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: }, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "val": 0, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "max": 104857600, 2024-09-19T04:41:28.858 INFO:teuthology.orchestra.run.smithi070.stdout: "get_started": 0, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "get": 222, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "get_sum": 1416969, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "get_or_fail_success": 222, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "take": 0, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "take_sum": 0, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "put": 222, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "put_sum": 1416969, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "wait": { 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "avgcount": 0, 2024-09-19T04:41:28.859 INFO:teuthology.orchestra.run.smithi070.stdout: "sum": 0.000000000, 2024-09-19T04:41:28.860 INFO:teuthology.orchestra.run.smithi070.stdout: "avgtime": 0.000000000 2024-09-19T04:41:28.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:28.860 INFO:teuthology.orchestra.run.smithi070.stdout: } 2024-09-19T04:41:28.860 INFO:teuthology.orchestra.run.smithi070.stdout:} 2024-09-19T04:41:29.013 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:28 smithi167 ceph-mon[34339]: pgmap v334: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:41:29.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:28 smithi134 ceph-mon[34525]: pgmap v334: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:41:29.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:28 smithi070 ceph-mon[30942]: pgmap v334: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 85 B/s wr, 7 op/s 2024-09-19T04:41:29.642 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-09-19T04:41:29.642 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-09-19T04:41:29.642 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.j 2024-09-19T04:41:29.642 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.j 2024-09-19T04:41:29.642 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-09-19T04:41:29.642 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-09-19T04:41:29.642 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-09-19T04:41:29.642 DEBUG:tasks.check_counter:Getting stats from b 2024-09-19T04:41:29.643 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.b perf dump 2024-09-19T04:41:29.895 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 19507, 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 10893, 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 10539879, 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 2447788, 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 15, 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 5, 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.871357409, 2024-09-19T04:41:30.389 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.311619455, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.695508028, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.041474639, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 10892, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.650190465, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000059694 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 28858, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.003884205, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000134 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.390 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 1880864, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 270176 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 916, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 824, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 282452, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 2947841, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 202, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.131616852, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.023760747, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.078738165, 2024-09-19T04:41:30.391 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.021272421, 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 820, 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.193909393, 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000236474 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 577, 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000078406, 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000135 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 140912, 2024-09-19T04:41:30.392 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 480400 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 3751, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 3232, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 1323964, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 2754699, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 13, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.295428333, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.104215163, 2024-09-19T04:41:30.393 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.149330028, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.058672953, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3231, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.536033646, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000165903 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5407, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000928226, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000171 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 44672, 2024-09-19T04:41:30.394 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 2864 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 895, 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.252599537, 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000282234 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.395 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 243, 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.010451267, 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000043009 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 917, 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 704, 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 704, 2024-09-19T04:41:30.396 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 3.297431981, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.004683852 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 213, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 12, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 65, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 6, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 37, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 22, 2024-09-19T04:41:30.397 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 53, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 1321, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 3, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 3, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 5, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 2952, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 1909, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 212, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 608, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-19T04:41:30.398 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 13, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 138, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 17, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 81, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 402, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 6, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 402, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 214, 2024-09-19T04:41:30.399 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 29, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 185, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 188, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 4, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 402, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 156, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 548, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 94, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 35, 2024-09-19T04:41:30.400 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 229 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 37, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 1971, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 1281, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 1351, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 58, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 6, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 96, 2024-09-19T04:41:30.401 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 90, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 29, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 13, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:41:30.402 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 575, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 575, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 2, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-19T04:41:30.403 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 5501830, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 243, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.411871091, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001694942 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-09-19T04:41:30.404 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 53, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 862, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 809, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 45, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 857, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 812, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 65, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 1476, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 1411, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 3, 2024-09-19T04:41:30.405 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 143, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 140, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 56876, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 231712 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 2230, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 58, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 917, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 35, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 584, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 23, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.039790802, 2024-09-19T04:41:30.406 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001730034 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 108, 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1.649875273, 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.015276622 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.407 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 409, 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1.224907478, 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002994883 2024-09-19T04:41:30.408 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.409 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-19T04:41:30.409 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.409 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.409 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.409 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.409 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-19T04:41:30.409 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.409 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.410 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 11, 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.001581570, 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000143779 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-19T04:41:30.411 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 8, 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.012461429, 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001557678 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 11, 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.056305420, 2024-09-19T04:41:30.412 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.005118674 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 22, 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.009612385, 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000436926 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2, 2024-09-19T04:41:30.413 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.002019363, 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001009681 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.414 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 6, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.045161552, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.007526925 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.021493209, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.004298641 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.415 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1, 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000720058, 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000720058 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.416 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 8, 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.022389086, 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002798635 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.417 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 90, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.211114356, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002345715 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.418 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 2, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 6, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 4, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 2, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 30, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 15, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 634, 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-19T04:41:30.419 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:30.420 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:30.421 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-19T04:41:30.422 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 394338, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 141, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 176, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 2, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:30.423 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 8096, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 178, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 273433, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 2128, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-19T04:41:30.424 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 1494, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 1353163, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 37, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 1494, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1494, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 18.531558748, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.012403988 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.425 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1494, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1603 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 1494, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 486, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 1008, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 0, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 11, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 55, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 269, 2024-09-19T04:41:30.426 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 44, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 602, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 431, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 22, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-19T04:41:30.427 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-19T04:41:30.428 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 94, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-19T04:41:30.429 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 13, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 12, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 12, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 122, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 47 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-19T04:41:30.430 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 10, 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 90, 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 90, 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-19T04:41:30.431 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 24170, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 9897672, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 24170, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 24170, 2024-09-19T04:41:30.432 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 9897672, 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-19T04:41:30.433 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 1494, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 1362829, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1494, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1362829, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-19T04:41:30.434 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:30.598 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-19T04:41:30.598 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:30.598 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-19T04:41:30.598 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-19T04:41:30.598 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:30.598 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:30.598 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 1494, 2024-09-19T04:41:30.598 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 1494, 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1494, 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1494, 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:41:30.599 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 90, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 9666, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 90, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 26, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 9666, 2024-09-19T04:41:30.600 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55e036836960": { 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 575, 2024-09-19T04:41:30.601 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1307526, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 575, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 243, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1307526, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.602 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:30.603 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-19T04:41:31.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:30 smithi134 ceph-mon[34525]: pgmap v335: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:31.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:30 smithi070 ceph-mon[30942]: pgmap v335: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:31.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:30 smithi167 ceph-mon[34339]: pgmap v335: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:31.346 INFO:tasks.check_counter:Daemon mds.b mds.exported=13 2024-09-19T04:41:31.346 INFO:tasks.check_counter:Daemon mds.b mds.imported=17 2024-09-19T04:41:31.347 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update=37 2024-09-19T04:41:31.347 INFO:tasks.check_counter:Daemon mds.b mds_cache.dir_update_receipt=1971 2024-09-19T04:41:31.347 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-09-19T04:41:31.347 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-09-19T04:41:31.347 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-09-19T04:41:31.347 DEBUG:tasks.check_counter:Getting stats from e 2024-09-19T04:41:31.347 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.e perf dump 2024-09-19T04:41:31.596 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 1827, 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 1805, 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 3295956, 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 633314, 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.177497146, 2024-09-19T04:41:32.115 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.069399047, 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.072928159, 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.037316799, 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1804, 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.071160857, 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000039446 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:32.116 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 1521568, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 131824 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 10, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 166, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 5016, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 443322, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 7, 2024-09-19T04:41:32.117 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 5, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.012155408, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.006192388, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.004251772, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000094096, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 164, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.019611691, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000119583 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.118 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 3360, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 441984 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 733, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 735, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 180424, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 233101, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-09-19T04:41:32.119 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.062740112, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.017506132, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.015211052, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.024492838, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 733, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.022493723, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000030687 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.120 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3883, 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.092161625, 2024-09-19T04:41:32.121 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000023734 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 0, 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 0, 2024-09-19T04:41:32.122 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 0, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 0, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 0, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 134, 2024-09-19T04:41:32.123 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 134, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 134, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 2, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:41:32.124 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 6, 2024-09-19T04:41:32.125 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:41:32.126 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 0, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 0, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 0, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 0 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 0, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 0, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 0, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 0, 2024-09-19T04:41:32.127 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:41:32.128 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-19T04:41:32.129 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 575, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 0, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 2, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 5501830, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 5501718, 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-19T04:41:32.130 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 575 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 30, 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 232, 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 202, 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 15, 2024-09-19T04:41:32.131 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 80, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 65, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 134, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 320, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 186, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 0, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 0, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 0, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 48752, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 215328 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 0, 2024-09-19T04:41:32.132 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 0, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 0, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 0, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 0, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.133 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.134 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.135 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.136 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-19T04:41:32.136 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.136 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.136 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.136 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.137 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-19T04:41:32.137 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.137 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.137 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.137 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.137 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.138 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-19T04:41:32.139 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.139 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.139 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.139 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.139 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-19T04:41:32.139 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.139 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.140 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-19T04:41:32.141 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-19T04:41:32.142 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.143 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.144 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.145 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:41:32.146 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 2, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 6, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 4, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 5, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-19T04:41:32.147 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 0, 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 0, 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 5700, 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:32.148 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:32.149 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:32.150 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 189427, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 53, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-19T04:41:32.151 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 8096, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 178, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 203825, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 1644, 2024-09-19T04:41:32.152 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 2314, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 26, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 4, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 2314, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2314, 2024-09-19T04:41:32.153 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.840979985, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000363431 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 2314, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 2315 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 2314, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 2314, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 0, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 1469, 2024-09-19T04:41:32.154 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 842, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 2, 2024-09-19T04:41:32.155 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-19T04:41:32.156 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-19T04:41:32.157 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 94, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 13, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 5, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 5, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 0, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 2, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 0 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-19T04:41:32.158 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 0, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 0, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 0, 2024-09-19T04:41:32.159 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 0, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 2566, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 3234638, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 2566, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:32.160 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 2566, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 3234638, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-19T04:41:32.161 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 2314, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 1307536, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 2314, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1307536, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-19T04:41:32.162 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 2314, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 2314, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 2314, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 2314, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.163 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-19T04:41:32.164 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x558b59e50b40": { 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-19T04:41:32.165 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 0, 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 0, 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:32.166 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-19T04:41:32.911 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-09-19T04:41:32.911 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-09-19T04:41:32.911 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update=0 2024-09-19T04:41:32.911 INFO:tasks.check_counter:Daemon mds.e mds_cache.dir_update_receipt=0 2024-09-19T04:41:32.911 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=6 2024-09-19T04:41:32.911 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-09-19T04:41:32.911 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T04:41:32.911 DEBUG:tasks.check_counter:Getting stats from h 2024-09-19T04:41:32.912 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.h perf dump 2024-09-19T04:41:33.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:32 smithi134 ceph-mon[34525]: pgmap v336: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:33.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:32 smithi070 ceph-mon[30942]: pgmap v336: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:33.155 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:41:33.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:32 smithi167 ceph-mon[34339]: pgmap v336: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:33.613 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-19T04:41:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 674, 2024-09-19T04:41:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 810, 2024-09-19T04:41:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 164160, 2024-09-19T04:41:33.613 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 3743375, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 70, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 9, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.073778888, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.020524339, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.031166017, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.012036319, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 806, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.047393838, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000058801 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:33.614 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 73, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000006752, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000092 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 5040, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 325136 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 2428, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 3460, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 800413, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 1746714, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 10, 2024-09-19T04:41:33.615 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 5, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.179015658, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.079010141, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.109907818, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.008254602, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3460, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.090540873, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000026167 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5042, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000792393, 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000157 2024-09-19T04:41:33.616 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 2336, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 125952 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 16980, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 10759, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 9231060, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 3111293, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 12, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 6, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.691078289, 2024-09-19T04:41:33.617 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.261137289, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.593291742, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.006229342, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 10758, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.175043415, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000016270 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 26441, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.003205008, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000121 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 1536832, 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 143872 2024-09-19T04:41:33.618 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 1, 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-MDSRank": { 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 920, 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.383255224, 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000416581 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "finisher-PurgeQueue": { 2024-09-19T04:41:33.619 INFO:teuthology.orchestra.run.smithi134.stdout: "queue_len": 0, 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "complete_latency": { 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 679, 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.033937656, 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000049981 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "mds": { 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "request": 772, 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "reply": 634, 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "reply_latency": { 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 634, 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1.051559891, 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001658611 2024-09-19T04:41:33.620 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_reply": 0, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "forward": 138, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_complete": 0, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_fetch_keys": 0, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_commit": 20, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_split": 1, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_merge": 0, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes": 53, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_top": 7, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_bottom": 6, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pin_tail": 40, 2024-09-19T04:41:33.621 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_pinned": 43, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_expired": 1560, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "inodes_with_caps": 3, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "caps": 3, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "subtrees": 4, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse": 3187, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_hit": 1558, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_forward": 135, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_discover": 619, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_remote_ino": 0, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "traverse_lock": 0, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "load_cent": 0, 2024-09-19T04:41:33.622 INFO:teuthology.orchestra.run.smithi134.stdout: "q": 0, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "exported": 30, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "exported_inodes": 486, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "imported": 23, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "imported_inodes": 265, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_dir_fetch": 0, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_backtrace_fetch": 179, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "openino_peer_discover": 0, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rfiles": 4, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rbytes": 234, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "root_rsnaps": 6, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_fetch": 179, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_set_tag": 0, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:41:33.623 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_inodes": 2, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_dirfrag_rstats": 2, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "scrub_file_inodes": 177, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_revoke": 52, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_grant": 425, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps": 543, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_caps_dirty": 299, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_cap_release": 33, 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: "process_request_cap_release": 714 2024-09-19T04:41:33.624 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_cache": { 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update": 59, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_update_receipt": 1939, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_try_discover": 1264, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_send_discover": 1315, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "dir_handle_discover": 68, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays": 4, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_delayed": 0, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_created": 320, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_enqueued": 316, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_reintegrated": 0, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "strays_migrated": 0, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_processing": 0, 2024-09-19T04:41:33.625 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_started": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "recovery_completed": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_exportdir": 30, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_flush": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragmentdir": 1, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_fragstats": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ireq_inodestats": 0 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_log": { 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "evlrg": 0, 2024-09-19T04:41:33.626 INFO:teuthology.orchestra.run.smithi134.stdout: "evadd": 1398, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "evex": 0, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "evtrm": 0, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "ev": 1398, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "evexg": 0, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "evexd": 0, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "segadd": 3, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "segex": 0, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "segtrm": 0, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "seg": 3, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "segmjr": 2, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "segexg": 0, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "segexd": 0, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "expos": 4194304, 2024-09-19T04:41:33.627 INFO:teuthology.orchestra.run.smithi134.stdout: "wrpos": 6707691, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "rdpos": 0, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "jlat": { 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 351, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.763735189, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002175883 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "replayed": 0 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_mem": { 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "ino": 45, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "ino+": 1243, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "ino-": 1198, 2024-09-19T04:41:33.628 INFO:teuthology.orchestra.run.smithi134.stdout: "dir": 38, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "dir+": 858, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "dir-": 820, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "dn": 53, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "dn+": 1929, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "dn-": 1876, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "cap": 3, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "cap+": 365, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "cap-": 362, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "rss": 58116, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "heap": 223520 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_server": { 2024-09-19T04:41:33.629 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_client_request": 1998, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "dispatch_server_request": 60, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_request": 772, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_client_session": 22, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "handle_peer_request": 546, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "req_create_latency": { 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 73, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.215608883, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002953546 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getattr_latency": { 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 5, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.002168267, 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000433653 2024-09-19T04:41:33.630 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getfilelock_latency": { 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "req_link_latency": { 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookup_latency": { 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 194, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.077934599, 2024-09-19T04:41:33.631 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000401724 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookuphash_latency": { 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupino_latency": { 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.632 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupname_latency": { 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupparent_latency": { 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lookupsnap_latency": { 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.633 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "req_lssnap_latency": { 2024-09-19T04:41:33.634 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mkdir_latency": { 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mknod_latency": { 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.635 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "req_mksnap_latency": { 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "req_open_latency": { 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "req_readdir_latency": { 2024-09-19T04:41:33.636 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 42, 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.023044396, 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000548676 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rename_latency": { 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "req_renamesnap_latency": { 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.637 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "req_snapdiff_latency": { 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmdir_latency": { 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 4, 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.035781325, 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.008945331 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmsnap_latency": { 2024-09-19T04:41:33.638 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "req_rmxattr_latency": { 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setattr_latency": { 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setdirlayout_latency": { 2024-09-19T04:41:33.639 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setfilelock_latency": { 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setlayout_latency": { 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.640 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "req_setxattr_latency": { 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "req_symlink_latency": { 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "req_unlink_latency": { 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 316, 2024-09-19T04:41:33.641 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.697022421, 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.002205767 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "req_getvxattr_latency": { 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_sessions": { 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "session_count": 1, 2024-09-19T04:41:33.642 INFO:teuthology.orchestra.run.smithi134.stdout: "session_add": 4, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "session_remove": 3, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_open": 1, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "sessions_stale": 0, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "total_load": 469, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "average_load": 469, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "avg_session_uptime": 646, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "mdthresh_evicted": 0 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:33.643 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:33.644 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:33.645 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 308854, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 125, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-19T04:41:33.646 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 8096, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 178, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 220098, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 1471, 2024-09-19T04:41:33.647 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "objecter": { 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "op_active": 0, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "op_laggy": 0, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send": 1084, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "op_send_bytes": 2713064, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "op_resend": 33, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "op_reply": 1084, 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "op_latency": { 2024-09-19T04:41:33.648 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1084, 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1.862955553, 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001718593 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "op_inflight": 0, 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "oplen_avg": { 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 1084, 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 1196 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "op": 1084, 2024-09-19T04:41:33.649 INFO:teuthology.orchestra.run.smithi134.stdout: "op_r": 225, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "op_w": 859, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "op_rmw": 0, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "op_pg": 0, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_stat": 0, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_create": 10, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_read": 46, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_write": 397, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writefull": 40, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_writesame": 0, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_append": 0, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_zero": 0, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_truncate": 1, 2024-09-19T04:41:33.650 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_delete": 328, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_mapext": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_sparse_read": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_clonerange": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_getxattr": 179, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_setxattr": 20, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_rmxattr": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_call": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_watch": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_notify": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:41:33.651 INFO:teuthology.orchestra.run.smithi134.stdout: "osdop_other": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_active": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_send": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_resend": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "linger_ping": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_active": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_send": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "poolop_resend": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_active": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_send": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "poolstat_resend": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_active": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_send": 0, 2024-09-19T04:41:33.652 INFO:teuthology.orchestra.run.smithi134.stdout: "statfs_resend": 0, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "command_active": 0, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "command_send": 0, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "command_resend": 0, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "map_epoch": 94, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "map_full": 0, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "map_inc": 13, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_sessions": 12, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_open": 12, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_session_close": 0, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_laggy": 0, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_wr": 129, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_rd": 0, 2024-09-19T04:41:33.653 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_del": 46 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "oft": { 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_objs": 1, 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_updates": 0, 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "omap_total_removes": 0 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "osd-slow-ops": { 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "slow_ops_count": 0 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "purge_queue": { 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops": 0, 2024-09-19T04:41:33.654 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_ops_high_water": 10, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing": 0, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executing_high_water": 10, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed_ops": 316, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_executed": 316, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "pq_item_in_journal": 0 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 20078, 2024-09-19T04:41:33.655 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 8370297, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 20078, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 20078, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 8370297, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.656 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_bytes": { 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 1084, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 2746924, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1084, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 2746924, 2024-09-19T04:41:33.657 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-objecter_ops": { 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 1024, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 0, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 0, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:33.658 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 1084, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 1084, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 1084, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1084, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:33.659 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 316, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 33860, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 316, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 46, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 33860, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.660 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-write_buf_throttle-0x55921b934960": { 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 3758096384, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 1398, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 2513387, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 1398, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 351, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 2513387, 2024-09-19T04:41:33.661 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.662 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:33.662 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-19T04:41:34.434 INFO:tasks.check_counter:Daemon mds.h mds.exported=30 2024-09-19T04:41:34.434 INFO:tasks.check_counter:Daemon mds.h mds.imported=23 2024-09-19T04:41:34.434 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update=59 2024-09-19T04:41:34.434 INFO:tasks.check_counter:Daemon mds.h mds_cache.dir_update_receipt=1939 2024-09-19T04:41:34.434 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-09-19T04:41:34.434 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-09-19T04:41:34.435 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T04:41:34.435 DEBUG:tasks.check_counter:Getting stats from k 2024-09-19T04:41:34.435 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.k perf dump 2024-09-19T04:41:34.680 INFO:teuthology.orchestra.run.smithi134.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.b/config 2024-09-19T04:41:35.156 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-09-19T04:41:35.156 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:35.157 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 4, 2024-09-19T04:41:35.157 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 4, 2024-09-19T04:41:35.157 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 3040, 2024-09-19T04:41:35.157 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 448, 2024-09-19T04:41:35.157 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 4, 2024-09-19T04:41:35.158 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 0, 2024-09-19T04:41:35.158 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.003057932, 2024-09-19T04:41:35.158 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.000040122, 2024-09-19T04:41:35.158 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.002244249, 2024-09-19T04:41:35.158 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:35.158 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:35.159 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 3, 2024-09-19T04:41:35.159 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.003955014, 2024-09-19T04:41:35.159 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.001318338 2024-09-19T04:41:35.159 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.159 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:35.160 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:35.160 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:35.160 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:35.160 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-19T04:41:35.160 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:41:35.161 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.161 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:35.161 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 2, 2024-09-19T04:41:35.161 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 163, 2024-09-19T04:41:35.161 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 320, 2024-09-19T04:41:35.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 185952, 2024-09-19T04:41:35.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 5, 2024-09-19T04:41:35.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 3, 2024-09-19T04:41:35.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.012310162, 2024-09-19T04:41:35.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.008420183, 2024-09-19T04:41:35.162 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.001706287, 2024-09-19T04:41:35.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:35.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:35.163 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 160, 2024-09-19T04:41:35.163 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.012162300, 2024-09-19T04:41:35.163 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000076014 2024-09-19T04:41:35.163 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.163 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:35.164 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:35.164 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:35.164 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:35.164 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T04:41:35.164 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 185952 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_messages": 222, 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages": 212, 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_bytes": 1448544, 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_bytes": 130464, 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_created_connections": 2, 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_active_connections": 1, 2024-09-19T04:41:35.165 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_total_time": 0.042157307, 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_send_time": 0.015870560, 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_recv_time": 0.039650031, 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 211, 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.013050415, 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000061850 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:35.166 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_recv_encrypted_bytes": 1448544, 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "msgr_send_encrypted_bytes": 130464 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "cct": { 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "total_workers": 0, 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "unhealthy_workers": 0 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "mempool": { 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:35.167 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:35.168 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:35.169 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_items": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_bytes": 148994, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_anon_items": 31, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_bytes": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_items": 0, 2024-09-19T04:41:35.170 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_bytes": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_items": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "pgmap_items": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_bytes": 928, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_co_items": 2, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:35.171 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_1_items": 0, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "unittest_2_items": 0 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "val": 0, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "max": 104857600, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "get_started": 0, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "get": 224, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "get_sum": 1417229, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:35.172 INFO:teuthology.orchestra.run.smithi134.stdout: "get_or_fail_success": 224, 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: "take": 0, 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: "take_sum": 0, 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: "put": 224, 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: "put_sum": 1417229, 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: "wait": { 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: "avgcount": 0, 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: "sum": 0.000000000, 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: "avgtime": 0.000000000 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-09-19T04:41:35.173 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-09-19T04:41:35.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:35 smithi134 ceph-mon[34525]: pgmap v337: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:35.845 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-09-19T04:41:35.845 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-09-19T04:41:35.845 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.k 2024-09-19T04:41:35.845 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.k 2024-09-19T04:41:35.845 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-09-19T04:41:35.845 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-09-19T04:41:35.845 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-09-19T04:41:35.845 DEBUG:tasks.check_counter:Getting stats from c 2024-09-19T04:41:35.846 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.c perf dump 2024-09-19T04:41:35.874 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:35 smithi167 ceph-mon[34339]: pgmap v337: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:35.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:35 smithi070 ceph-mon[30942]: pgmap v337: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:36.107 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:41:36.577 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-19T04:41:36.577 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:36.577 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 2196, 2024-09-19T04:41:36.577 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 2196, 2024-09-19T04:41:36.577 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 3135040, 2024-09-19T04:41:36.577 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 697511, 2024-09-19T04:41:36.577 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 6, 2024-09-19T04:41:36.577 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 2, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.186709475, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.060799643, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.049660235, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.061614081, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2195, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.086832538, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000039559 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.578 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 251, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 229, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1521964, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 132362, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 3, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 2, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.042167526, 2024-09-19T04:41:36.579 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.015606593, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.039136998, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000056556, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 228, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.014411318, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000063207 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1521408, 2024-09-19T04:41:36.580 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 131664 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 3, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 161, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 588, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 443470, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 6, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 4, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.009958699, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.006067274, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.002275444, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000019053, 2024-09-19T04:41:36.581 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 158, 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.011778472, 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000074547 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 443152 2024-09-19T04:41:36.582 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3729, 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.097606365, 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000026174 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.583 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 0, 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 0, 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.584 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 0, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 0, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 348, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 0, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 348, 2024-09-19T04:41:36.585 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 348, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 1, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-09-19T04:41:36.586 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:41:36.587 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 0, 2024-09-19T04:41:36.588 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 0 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-09-19T04:41:36.589 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-09-19T04:41:36.590 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 1398, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 3, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 2, 2024-09-19T04:41:36.591 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 6707691, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 6704140, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 1398 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.592 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 22, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 663, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 641, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 7, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 120, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 113, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 348, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 923, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 575, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 0, 2024-09-19T04:41:36.593 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 0, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 50548, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 215328 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 0, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 0, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 0, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 0, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.594 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-09-19T04:41:36.595 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.596 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.597 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.598 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-09-19T04:41:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-09-19T04:41:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.599 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.600 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.601 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.602 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-09-19T04:41:36.603 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.604 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.605 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 1, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 4, 2024-09-19T04:41:36.606 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 3, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 4, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 0, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 0, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 4900, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:36.607 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:36.608 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:36.609 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 181313, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 47, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:36.610 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8096, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 178, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 309293, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 2112, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.611 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 2195, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 21, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 3, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 2195, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2195, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.010982385, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000460584 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2195, 2024-09-19T04:41:36.612 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2196 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 2195, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 2195, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 1393, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 800, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-19T04:41:36.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 1, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-19T04:41:36.614 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-19T04:41:36.615 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 94, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 13, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 4, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 4, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-19T04:41:36.616 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 2, 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 0, 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-09-19T04:41:36.617 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 0, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 0, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 0, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 2446, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 4421680, 2024-09-19T04:41:36.618 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 2446, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2446, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 4421680, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:36.619 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2195, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2513392, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2195, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2513392, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.620 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2195, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2195, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2195, 2024-09-19T04:41:36.621 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2195, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:36.622 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x558c34442b40": { 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-19T04:41:36.623 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.624 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:36.625 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-19T04:41:36.834 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:36 smithi167 ceph-mon[34339]: pgmap v338: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:37.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:36 smithi134 ceph-mon[34525]: pgmap v338: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:37.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:36 smithi070 ceph-mon[30942]: pgmap v338: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:37.633 INFO:tasks.check_counter:Daemon mds.c mds.exported=0 2024-09-19T04:41:37.633 INFO:tasks.check_counter:Daemon mds.c mds.imported=0 2024-09-19T04:41:37.633 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update=0 2024-09-19T04:41:37.634 INFO:tasks.check_counter:Daemon mds.c mds_cache.dir_update_receipt=0 2024-09-19T04:41:37.634 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=0 2024-09-19T04:41:37.634 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-09-19T04:41:37.634 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T04:41:37.634 DEBUG:tasks.check_counter:Getting stats from f 2024-09-19T04:41:37.634 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.f perf dump 2024-09-19T04:41:37.928 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:41:38.436 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 797, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 775, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 34323569, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 306256, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 6, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 2, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.107639596, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.034215635, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.069898318, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.011707697, 2024-09-19T04:41:38.437 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 774, 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.036178196, 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000046741 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1521680, 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 132304 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.438 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 295, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 455, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 50408192, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 538299, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 8, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.053759400, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.013004361, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.029528694, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.007391623, 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:38.439 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 452, 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.022576301, 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000049947 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T04:41:38.440 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 445120 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 1545, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 1545, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 38209404, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 490544, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 6, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.168056904, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.044993100, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.059585241, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.049872524, 2024-09-19T04:41:38.441 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1544, 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.066196073, 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000042873 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.442 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3040, 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 448 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 3918, 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.103923318, 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000026524 2024-09-19T04:41:38.443 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.444 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.444 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-09-19T04:41:38.444 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-19T04:41:38.444 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-19T04:41:38.444 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.444 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.444 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.444 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 0, 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 0, 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 0, 2024-09-19T04:41:38.445 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 0, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 0, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 27399, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 39, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 27360, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 0, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 27343, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 0, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2024-09-19T04:41:38.446 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 1, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 0, 2024-09-19T04:41:38.447 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 0, 2024-09-19T04:41:38.448 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 0, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 0 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.449 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-09-19T04:41:38.450 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-09-19T04:41:38.451 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 51139, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-09-19T04:41:38.452 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 70, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 6, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 124933267, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 124925319, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 51139 2024-09-19T04:41:38.453 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 8029, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 19115, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 11086, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 772, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 814, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 42, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 27399, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 27756, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 357, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 0, 2024-09-19T04:41:38.454 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 0, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 96952, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 215328 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 0, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 0, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 0, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 0, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 0, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.455 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.456 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.457 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.458 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.459 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.460 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-09-19T04:41:38.460 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.460 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.460 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.460 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-09-19T04:41:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-09-19T04:41:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.461 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.462 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.463 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-09-19T04:41:38.464 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.465 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-09-19T04:41:38.466 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.467 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:41:38.468 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 2, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 5, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 3, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 4, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-09-19T04:41:38.469 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 0, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 0, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 2774, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:38.470 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:38.471 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-19T04:41:38.472 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 222497, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 69, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:38.473 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8096, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 178, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 37678212, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 331829, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.474 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 2381, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 21, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 3, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 2381, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2381, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.384975815, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000581678 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.475 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2381, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2382 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 2381, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 2381, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 0, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 1511, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 0, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 868, 2024-09-19T04:41:38.476 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 1, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:41:38.477 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-19T04:41:38.478 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 94, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-19T04:41:38.479 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 13, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 9, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 9, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 0, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 2, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 0 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 0, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-09-19T04:41:38.480 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 0, 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 0, 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 0, 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 0, 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-09-19T04:41:38.481 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 2633, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 122688371, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 2633, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2633, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 122688371, 2024-09-19T04:41:38.482 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:38.483 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2381, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 120747949, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2381, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 120747949, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.484 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 2381, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 2381, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2381, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 2381, 2024-09-19T04:41:38.485 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:38.486 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x55f1d128ab40": { 2024-09-19T04:41:38.487 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:38.488 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:38.489 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:38.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.489 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:38.489 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-19T04:41:39.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:38 smithi134 ceph-mon[34525]: pgmap v339: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:39.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:38 smithi070 ceph-mon[30942]: pgmap v339: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:39.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:38 smithi167 ceph-mon[34339]: pgmap v339: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:39.265 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-09-19T04:41:39.265 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-09-19T04:41:39.265 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update=0 2024-09-19T04:41:39.265 INFO:tasks.check_counter:Daemon mds.f mds_cache.dir_update_receipt=0 2024-09-19T04:41:39.266 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-09-19T04:41:39.266 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-09-19T04:41:39.266 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T04:41:39.266 DEBUG:tasks.check_counter:Getting stats from i 2024-09-19T04:41:39.266 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.i perf dump 2024-09-19T04:41:39.513 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 15991, 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 22212, 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 4157434, 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 40524911, 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 12, 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 5, 2024-09-19T04:41:40.042 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 1.043904948, 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.392862442, 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.438922201, 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.190514391, 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 22210, 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.611670642, 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000027540 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 25940, 2024-09-19T04:41:40.043 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.003650541, 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000140 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 3920, 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 8208 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 58531, 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 98751, 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 20007737, 2024-09-19T04:41:40.044 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 117845059, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 73, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 9, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 3.746312245, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 1.731267790, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 1.883377277, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.300549048, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 98748, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.338271719, 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000023679 2024-09-19T04:41:40.045 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 126896, 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.017710747, 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000139 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 2016, 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 125008 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:40.046 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 15945, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 24052, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 6101193, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 18239909, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 7, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 6, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 1.030568866, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.398183532, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.491395655, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.138467815, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 24052, 2024-09-19T04:41:40.047 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.660181539, 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000027448 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 27210, 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.004326867, 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000159 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1535088, 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 462800 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-19T04:41:40.048 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 1, 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-MDSRank": { 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 8245, 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 20.390609056, 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002473087 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "finisher-PurgeQueue": { 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "queue_len": 0, 2024-09-19T04:41:40.049 INFO:teuthology.orchestra.run.smithi167.stdout: "complete_latency": { 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 16169, 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 2.040080011, 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000126172 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "mds": { 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "request": 25439, 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "reply": 25282, 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "reply_latency": { 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 25282, 2024-09-19T04:41:40.050 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 50.752721372, 2024-09-19T04:41:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.002007464 2024-09-19T04:41:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_reply": 0, 2024-09-19T04:41:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "forward": 157, 2024-09-19T04:41:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_complete": 0, 2024-09-19T04:41:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_fetch_keys": 0, 2024-09-19T04:41:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_commit": 199, 2024-09-19T04:41:40.051 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_split": 21, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_merge": 0, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes": 16609, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_top": 366, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_bottom": 15475, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pin_tail": 768, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_pinned": 16084, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_expired": 531, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "inodes_with_caps": 0, 2024-09-19T04:41:40.052 INFO:teuthology.orchestra.run.smithi167.stdout: "caps": 0, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "subtrees": 28, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse": 28363, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_hit": 26494, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_forward": 68, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_discover": 10, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_dir_fetch": 0, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_remote_ino": 0, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "traverse_lock": 0, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "load_cent": 0, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "q": 0, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "exported": 40, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "exported_inodes": 346, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "imported": 43, 2024-09-19T04:41:40.053 INFO:teuthology.orchestra.run.smithi167.stdout: "imported_inodes": 624, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_dir_fetch": 0, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_backtrace_fetch": 7702, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "openino_peer_discover": 0, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rfiles": 4, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rbytes": 234, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "root_rsnaps": 6, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_fetch": 7702, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_set_tag": 0, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_backtrace_repaired": 0, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_inotable_repaired": 0, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_inodes": 602, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dir_base_inodes": 0, 2024-09-19T04:41:40.054 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_dirfrag_rstats": 602, 2024-09-19T04:41:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "scrub_file_inodes": 7100, 2024-09-19T04:41:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_inode_file_caps": 14, 2024-09-19T04:41:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_revoke": 3110, 2024-09-19T04:41:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_grant": 24040, 2024-09-19T04:41:40.055 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_trunc": 0, 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "ceph_cap_op_flush_ack": 0, 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps": 23152, 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_caps_dirty": 12890, 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_cap_release": 57, 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "process_request_cap_release": 34410 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_cache": { 2024-09-19T04:41:40.056 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update": 1277, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_update_receipt": 24, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_try_discover": 16, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_send_discover": 19, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "dir_handle_discover": 2559, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays": 607, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_delayed": 0, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "num_strays_enqueuing": 0, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_created": 11345, 2024-09-19T04:41:40.057 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_enqueued": 10738, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_reintegrated": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "strays_migrated": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_processing": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_enqueued": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "num_recovering_prioritized": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_started": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "recovery_completed": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_path": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_quiesce_inode": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_enqueue_scrub": 0, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_exportdir": 40, 2024-09-19T04:41:40.058 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_flush": 0, 2024-09-19T04:41:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragmentdir": 21, 2024-09-19T04:41:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_fragstats": 0, 2024-09-19T04:41:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "ireq_inodestats": 0 2024-09-19T04:41:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_log": { 2024-09-19T04:41:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "evlrg": 0, 2024-09-19T04:41:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "evadd": 51139, 2024-09-19T04:41:40.059 INFO:teuthology.orchestra.run.smithi167.stdout: "evex": 0, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "evtrm": 0, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "ev": 51139, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "evexg": 0, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "evexd": 0, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "segadd": 70, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "segex": 0, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "segtrm": 0, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "seg": 70, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "segmjr": 6, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "segexg": 0, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "segexd": 0, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "expos": 4194304, 2024-09-19T04:41:40.060 INFO:teuthology.orchestra.run.smithi167.stdout: "wrpos": 124933267, 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "rdpos": 0, 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "jlat": { 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 2034, 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 37.147528838, 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.018263288 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "replayed": 0 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.061 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_mem": { 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "ino": 7979, 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "ino+": 19154, 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "ino-": 11175, 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "dir": 782, 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "dir+": 822, 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "dir-": 40, 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "dn": 16609, 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "dn+": 27878, 2024-09-19T04:41:40.062 INFO:teuthology.orchestra.run.smithi167.stdout: "dn-": 11269, 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "cap": 0, 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "cap+": 11712, 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "cap-": 11712, 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "rss": 124136, 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "heap": 223520 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_server": { 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_client_request": 32556, 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "dispatch_server_request": 882, 2024-09-19T04:41:40.063 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_request": 25439, 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_client_session": 65, 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "handle_peer_request": 1974, 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "req_create_latency": { 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 11052, 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 20.480426417, 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001853096 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getattr_latency": { 2024-09-19T04:41:40.064 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 15, 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.007851340, 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000523422 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getfilelock_latency": { 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "req_link_latency": { 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.065 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookup_latency": { 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1133, 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 4.062007947, 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.003585179 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookuphash_latency": { 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.066 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupino_latency": { 2024-09-19T04:41:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.067 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupname_latency": { 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupparent_latency": { 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lookupsnap_latency": { 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.068 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "req_lssnap_latency": { 2024-09-19T04:41:40.069 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mkdir_latency": { 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 615, 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.498350680, 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000810326 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mknod_latency": { 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.070 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "req_mksnap_latency": { 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "req_open_latency": { 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1, 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000524780, 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000524780 2024-09-19T04:41:40.071 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "req_readdir_latency": { 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 1101, 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 1.572428138, 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001428181 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rename_latency": { 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "req_renamesnap_latency": { 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.072 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "req_snapdiff_latency": { 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmdir_latency": { 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 607, 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 9.378415420, 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.015450437 2024-09-19T04:41:40.073 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmsnap_latency": { 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "req_rmxattr_latency": { 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setattr_latency": { 2024-09-19T04:41:40.074 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 20, 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.031390457, 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001569522 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setdirlayout_latency": { 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setfilelock_latency": { 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.075 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setlayout_latency": { 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "req_setxattr_latency": { 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.076 INFO:teuthology.orchestra.run.smithi167.stdout: "req_symlink_latency": { 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "req_unlink_latency": { 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 10738, 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 14.721326193, 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001370956 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_revoke_eviction": 0, 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "cap_acquisition_throttle": 0, 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "req_getvxattr_latency": { 2024-09-19T04:41:40.077 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_sessions": { 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "session_count": 2, 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "session_add": 5, 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "session_remove": 3, 2024-09-19T04:41:40.078 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_open": 2, 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "sessions_stale": 0, 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "total_load": 15688, 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "average_load": 7844, 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "avg_session_uptime": 645, 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "mdthresh_evicted": 0 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:40.079 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:40.080 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:40.081 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:40.082 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 5158327, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 1338, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:40.083 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 8096, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 178, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 30500793, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 350469, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:40.084 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "objecter": { 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "op_active": 0, 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "op_laggy": 0, 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send": 21222, 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "op_send_bytes": 126321718, 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "op_resend": 28, 2024-09-19T04:41:40.085 INFO:teuthology.orchestra.run.smithi167.stdout: "op_reply": 21222, 2024-09-19T04:41:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "op_latency": { 2024-09-19T04:41:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 21222, 2024-09-19T04:41:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 42.398255187, 2024-09-19T04:41:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.001997844 2024-09-19T04:41:40.086 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "op_inflight": 0, 2024-09-19T04:41:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "oplen_avg": { 2024-09-19T04:41:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 21222, 2024-09-19T04:41:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 21618 2024-09-19T04:41:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "op": 21222, 2024-09-19T04:41:40.087 INFO:teuthology.orchestra.run.smithi167.stdout: "op_r": 7845, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "op_w": 13377, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "op_rmw": 0, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "op_pg": 0, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_stat": 0, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_create": 10, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_read": 143, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_write": 2177, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writefull": 66, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_writesame": 0, 2024-09-19T04:41:40.088 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_append": 0, 2024-09-19T04:41:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_zero": 0, 2024-09-19T04:41:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_truncate": 21, 2024-09-19T04:41:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_delete": 10802, 2024-09-19T04:41:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_mapext": 0, 2024-09-19T04:41:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_sparse_read": 0, 2024-09-19T04:41:40.089 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_clonerange": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_getxattr": 7702, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_setxattr": 20, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_cmpxattr": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_rmxattr": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_resetxattrs": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_call": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_watch": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_notify": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_src_cmpxattr": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_pgls_filter": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "osdop_other": 0, 2024-09-19T04:41:40.090 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_active": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_send": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_resend": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "linger_ping": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_active": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_send": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "poolop_resend": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_active": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_send": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "poolstat_resend": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_active": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_send": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "statfs_resend": 0, 2024-09-19T04:41:40.091 INFO:teuthology.orchestra.run.smithi167.stdout: "command_active": 0, 2024-09-19T04:41:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "command_send": 0, 2024-09-19T04:41:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "command_resend": 0, 2024-09-19T04:41:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "map_epoch": 94, 2024-09-19T04:41:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "map_full": 0, 2024-09-19T04:41:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "map_inc": 13, 2024-09-19T04:41:40.092 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_sessions": 12, 2024-09-19T04:41:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_open": 12, 2024-09-19T04:41:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_session_close": 0, 2024-09-19T04:41:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_laggy": 0, 2024-09-19T04:41:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_wr": 572, 2024-09-19T04:41:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_rd": 0, 2024-09-19T04:41:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_del": 105 2024-09-19T04:41:40.093 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "oft": { 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_objs": 1, 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_kv_pairs": 0, 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_updates": 0, 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "omap_total_removes": 0 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "osd-slow-ops": { 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: "slow_ops_count": 0 2024-09-19T04:41:40.094 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "purge_queue": { 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops": 0, 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_ops_high_water": 20, 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing": 0, 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executing_high_water": 10, 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed_ops": 10762, 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_executed": 10738, 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: "pq_item_in_journal": 0 2024-09-19T04:41:40.095 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 90463, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 22106307, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 90463, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 90463, 2024-09-19T04:41:40.096 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 22106307, 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_bytes": { 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:40.097 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 21222, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 127463200, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 21222, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 127463200, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.098 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-objecter_ops": { 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 1024, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 0, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 0, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 0, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 21222, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 21222, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 21222, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 21222, 2024-09-19T04:41:40.099 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle": { 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 10738, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 1141482, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:40.100 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 10738, 2024-09-19T04:41:40.101 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:40.101 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:40.101 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 143, 2024-09-19T04:41:40.101 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 1141482, 2024-09-19T04:41:40.101 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:40.101 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.101 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.101 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-write_buf_throttle-0x55a1a5dc8960": { 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 3758096384, 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 51139, 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 120738963, 2024-09-19T04:41:40.102 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:40.103 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 51139, 2024-09-19T04:41:40.103 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:40.103 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:40.103 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 2034, 2024-09-19T04:41:40.103 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 120738963, 2024-09-19T04:41:40.103 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:40.104 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:40.104 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:40.104 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:40.104 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.104 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:40.104 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-19T04:41:40.841 INFO:tasks.check_counter:Daemon mds.i mds.exported=40 2024-09-19T04:41:40.841 INFO:tasks.check_counter:Daemon mds.i mds.imported=43 2024-09-19T04:41:40.841 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update=1277 2024-09-19T04:41:40.841 INFO:tasks.check_counter:Daemon mds.i mds_cache.dir_update_receipt=24 2024-09-19T04:41:40.841 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=6 2024-09-19T04:41:40.842 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-09-19T04:41:40.842 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-09-19T04:41:40.842 DEBUG:tasks.check_counter:Getting stats from l 2024-09-19T04:41:40.842 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph daemon mds.l perf dump 2024-09-19T04:41:40.960 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:40 smithi167 ceph-mon[34339]: pgmap v340: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:41.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:40 smithi134 ceph-mon[34525]: pgmap v340: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:41.087 INFO:teuthology.orchestra.run.smithi167.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.c/config 2024-09-19T04:41:41.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:40 smithi070 ceph-mon[30942]: pgmap v340: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 4 op/s 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout:{ 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-0": { 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 228, 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 216, 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 1452128, 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 132192, 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 4, 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 0, 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.047743029, 2024-09-19T04:41:41.604 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.015430745, 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.044290694, 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 216, 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.017413017, 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000080615 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:41.605 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 1452128, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 132192 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-1": { 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 2, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 164, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 320, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 186128, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 5, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 3, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.011204523, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.007446831, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.001570418, 2024-09-19T04:41:41.606 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 161, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.016786282, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000104262 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 320, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 186128 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.607 INFO:teuthology.orchestra.run.smithi167.stdout: "AsyncMessenger::Worker-2": { 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_messages": 0, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages": 2, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_bytes": 0, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_bytes": 0, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_created_connections": 2, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_active_connections": 1, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_total_time": 0.000348359, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_send_time": 0.000000000, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_recv_time": 0.000284703, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_messages_queue_lat": { 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:41.608 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_handle_ack_lat": { 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_recv_encrypted_bytes": 0, 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "msgr_send_encrypted_bytes": 0 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "cct": { 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "total_workers": 0, 2024-09-19T04:41:41.609 INFO:teuthology.orchestra.run.smithi167.stdout: "unhealthy_workers": 0 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "mempool": { 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_bytes": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bloom_filter_items": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_bytes": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_alloc_items": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_bytes": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_data_items": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_bytes": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_onode_items": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_bytes": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_meta_items": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_bytes": 0, 2024-09-19T04:41:41.610 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_other_items": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_bytes": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_cache_buffer_items": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_bytes": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_extent_items": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_bytes": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_blob_items": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_bytes": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_shared_blob_items": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_bytes": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_inline_bl_items": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_bytes": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_fsck_items": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_bytes": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_txc_items": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_bytes": 0, 2024-09-19T04:41:41.611 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_deferred_items": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_bytes": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "bluestore_writing_items": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_bytes": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_items": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_bytes": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_reader_items": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_bytes": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "bluefs_file_writer_items": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_bytes": 149034, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_anon_items": 32, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_bytes": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "buffer_meta_items": 0, 2024-09-19T04:41:41.612 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_bytes": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_items": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_bytes": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_mapbl_items": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_bytes": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osd_pglog_items": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_bytes": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_items": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_bytes": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "osdmap_mapping_items": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_bytes": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "pgmap_items": 0, 2024-09-19T04:41:41.613 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_bytes": 928, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "mds_co_items": 2, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_bytes": 0, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_1_items": 0, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_bytes": 0, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "unittest_2_items": 0 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: }, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "val": 0, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "max": 104857600, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "get_started": 0, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "get": 226, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "get_sum": 1417489, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_fail": 0, 2024-09-19T04:41:41.614 INFO:teuthology.orchestra.run.smithi167.stdout: "get_or_fail_success": 226, 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: "take": 0, 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: "take_sum": 0, 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: "put": 226, 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: "put_sum": 1417489, 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: "wait": { 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: "avgcount": 0, 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: "sum": 0.000000000, 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: "avgtime": 0.000000000 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout: } 2024-09-19T04:41:41.615 INFO:teuthology.orchestra.run.smithi167.stdout:} 2024-09-19T04:41:42.241 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-09-19T04:41:42.241 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-09-19T04:41:42.241 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update' not found on daemon mds.l 2024-09-19T04:41:42.241 WARNING:tasks.check_counter:Counter 'mds_cache.dir_update_receipt' not found on daemon mds.l 2024-09-19T04:41:42.241 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-09-19T04:41:42.241 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-09-19T04:41:42.241 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-09-19T04:41:42.241 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-09-19T04:41:42.253 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-09-19T04:41:42.253 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:41:42.253 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T04:41:42.274 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:41:42.274 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T04:41:42.334 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T04:41:42.633 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:43.028 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:42 smithi070 ceph-mon[30942]: pgmap v341: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:43.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:42 smithi134 ceph-mon[34525]: pgmap v341: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:43.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.105+0000 7fa95d0ce640 1 -- 172.21.15.70:0/3265945326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958100680 msgr2=0x7fa958100ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:43.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.105+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/3265945326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958100680 0x7fa958100ae0 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fa94000aa10 tx=0x7fa94002b720 comp rx=0 tx=0).stop 2024-09-19T04:41:43.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.105+0000 7fa95d0ce640 1 -- 172.21.15.70:0/3265945326 shutdown_connections 2024-09-19T04:41:43.136 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.105+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/3265945326 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa958101020 0x7fa95810d0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.105+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/3265945326 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958100680 0x7fa958100ae0 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.105+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/3265945326 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958105220 0x7fa958105600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.105+0000 7fa95d0ce640 1 -- 172.21.15.70:0/3265945326 >> 172.21.15.70:0/3265945326 conn(0x7fa958077210 msgr2=0x7fa958077620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.106+0000 7fa95d0ce640 1 -- 172.21.15.70:0/3265945326 shutdown_connections 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.106+0000 7fa95d0ce640 1 -- 172.21.15.70:0/3265945326 wait complete. 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.106+0000 7fa95d0ce640 1 Processor -- start 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.106+0000 7fa95d0ce640 1 -- start start 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.106+0000 7fa95d0ce640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa958100680 0x7fa958198580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.106+0000 7fa95d0ce640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958101020 0x7fa958198ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.106+0000 7fa95d0ce640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958105220 0x7fa95819ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.106+0000 7fa95d0ce640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fa95810fe50 con 0x7fa958105220 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95d0ce640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fa95810fcd0 con 0x7fa958100680 2024-09-19T04:41:43.137 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95d0ce640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fa95810ffd0 con 0x7fa958101020 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958105220 0x7fa95819ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958105220 0x7fa95819ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:58346/0 (socket says 172.21.15.70:58346) 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 -- 172.21.15.70:0/4272446640 learned_addr learned my addr 172.21.15.70:0/4272446640 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa956d9d640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa958100680 0x7fa958198580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa94ffff640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958101020 0x7fa958198ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 -- 172.21.15.70:0/4272446640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958101020 msgr2=0x7fa958198ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958101020 0x7fa958198ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 -- 172.21.15.70:0/4272446640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa958100680 msgr2=0x7fa958198580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa958100680 0x7fa958198580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 -- 172.21.15.70:0/4272446640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa95819d530 con 0x7fa958105220 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa94ffff640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958101020 0x7fa958198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95759e640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958105220 0x7fa95819ce50 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fa95000eaa0 tx=0x7fa95000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:43.138 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa954d99640 1 -- 172.21.15.70:0/4272446640 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa95000cdb0 con 0x7fa958105220 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa95819d820 con 0x7fa958105220 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa954d99640 1 -- 172.21.15.70:0/4272446640 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fa950005020 con 0x7fa958105220 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa954d99640 1 -- 172.21.15.70:0/4272446640 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa9500116b0 con 0x7fa958105220 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.107+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa9581a5100 con 0x7fa958105220 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.108+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa958100ae0 con 0x7fa958105220 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.110+0000 7fa954d99640 1 -- 172.21.15.70:0/4272446640 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fa9500051d0 con 0x7fa958105220 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.110+0000 7fa954d99640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9440a33b0 0x7fa9440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.110+0000 7fa956d9d640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9440a33b0 0x7fa9440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.110+0000 7fa954d99640 1 -- 172.21.15.70:0/4272446640 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7fa9500cffa0 con 0x7fa958105220 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.111+0000 7fa956d9d640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9440a33b0 0x7fa9440a5870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa948009b50 tx=0x7fa948005f90 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:43.139 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.114+0000 7fa954d99640 1 -- 172.21.15.70:0/4272446640 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fa950016030 con 0x7fa958105220 2024-09-19T04:41:43.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:42 smithi167 ceph-mon[34339]: pgmap v341: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 7 op/s 2024-09-19T04:41:43.293 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.292+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fa9581a52d0 con 0x7fa958105220 2024-09-19T04:41:43.294 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.292+0000 7fa954d99640 1 -- 172.21.15.70:0/4272446640 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v94) ==== 81+0+1002 (secure 0 0 0) 0x7fa95009c980 con 0x7fa958105220 2024-09-19T04:41:43.294 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/4212188848 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:43.294 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3933277587 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:43.294 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/544441745 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:43.294 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1492093884 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3192727507 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2407570280 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/3440627608 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2258273209 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/999804527 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1492093884 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1547748087 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/4212188848 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2420707462 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2647945535 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1218306304 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/3440627608 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:43.295 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3999565316 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:listed 17 entries 2024-09-19T04:41:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9440a33b0 msgr2=0x7fa9440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9440a33b0 0x7fa9440a5870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fa948009b50 tx=0x7fa948005f90 comp rx=0 tx=0).stop 2024-09-19T04:41:43.296 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958105220 msgr2=0x7fa95819ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958105220 0x7fa95819ce50 secure :-1 s=READY pgs=1353 cs=0 l=1 rev1=1 crypto rx=0x7fa95000eaa0 tx=0x7fa95000ef60 comp rx=0 tx=0).stop 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 shutdown_connections 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fa9440a33b0 0x7fa9440a5870 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fa958105220 0x7fa95819ce50 unknown :-1 s=CLOSED pgs=1353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fa958101020 0x7fa958198ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 --2- 172.21.15.70:0/4272446640 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa958100680 0x7fa958198580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.294+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 >> 172.21.15.70:0/4272446640 conn(0x7fa958077210 msgr2=0x7fa9580fe630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.295+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 shutdown_connections 2024-09-19T04:41:43.297 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:43.295+0000 7fa95d0ce640 1 -- 172.21.15.70:0/4272446640 wait complete. 2024-09-19T04:41:44.029 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:43 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4272446640' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:41:44.031 DEBUG:teuthology.orchestra.run.smithi070:> set -ex 2024-09-19T04:41:44.031 DEBUG:teuthology.orchestra.run.smithi070:> dd if=/proc/self/mounts of=/dev/stdout 2024-09-19T04:41:44.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:43 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4272446640' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:41:44.049 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd blocklist ls 2024-09-19T04:41:44.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:43 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4272446640' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:41:44.337 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:44.851 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 -- 172.21.15.70:0/2607760753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3958103660 msgr2=0x7f395810bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 --2- 172.21.15.70:0/2607760753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3958103660 0x7f395810bb50 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3948009900 tx=0x7f394802a480 comp rx=0 tx=0).stop 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 -- 172.21.15.70:0/2607760753 shutdown_connections 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 --2- 172.21.15.70:0/2607760753 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f395810c170 0x7f395810e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 --2- 172.21.15.70:0/2607760753 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f3958103660 0x7f395810bb50 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 --2- 172.21.15.70:0/2607760753 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3958102d40 0x7f3958103120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 -- 172.21.15.70:0/2607760753 >> 172.21.15.70:0/2607760753 conn(0x7f39580fc7a0 msgr2=0x7f39580febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 -- 172.21.15.70:0/2607760753 shutdown_connections 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.824+0000 7f39603df640 1 -- 172.21.15.70:0/2607760753 wait complete. 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f39603df640 1 Processor -- start 2024-09-19T04:41:44.852 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f39603df640 1 -- start start 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f39603df640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3958102d40 0x7f3958198530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f39603df640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3958103660 0x7f3958198a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f39603df640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f395810c170 0x7f395819ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f39603df640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3958111fa0 con 0x7f395810c170 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f39603df640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3958111e20 con 0x7f3958102d40 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f39603df640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f3958112120 con 0x7f3958103660 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f395e97c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f395810c170 0x7f395819ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f395e97c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f395810c170 0x7f395819ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49032/0 (socket says 172.21.15.70:49032) 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.825+0000 7f395e97c640 1 -- 172.21.15.70:0/4055398982 learned_addr learned my addr 172.21.15.70:0/4055398982 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395d97a640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3958103660 0x7f3958198a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395e17b640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3958102d40 0x7f3958198530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:44.853 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395e97c640 1 -- 172.21.15.70:0/4055398982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3958103660 msgr2=0x7f3958198a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395e97c640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3958103660 0x7f3958198a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395e97c640 1 -- 172.21.15.70:0/4055398982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3958102d40 msgr2=0x7f3958198530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395e97c640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3958102d40 0x7f3958198530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395e97c640 1 -- 172.21.15.70:0/4055398982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f395819d4e0 con 0x7f395810c170 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395d97a640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3958103660 0x7f3958198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f395e97c640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f395810c170 0x7f395819ce00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f395000b970 tx=0x7f395000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f394f7fe640 1 -- 172.21.15.70:0/4055398982 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3950019070 con 0x7f395810c170 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f395819d7d0 con 0x7f395810c170 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f394f7fe640 1 -- 172.21.15.70:0/4055398982 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f395000cb40 con 0x7f395810c170 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f394f7fe640 1 -- 172.21.15.70:0/4055398982 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3950007610 con 0x7f395810c170 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.826+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f39581a50b0 con 0x7f395810c170 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.827+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3958103120 con 0x7f395810c170 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.828+0000 7f394f7fe640 1 -- 172.21.15.70:0/4055398982 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f395001c070 con 0x7f395810c170 2024-09-19T04:41:44.854 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.829+0000 7f394f7fe640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39440a33b0 0x7f39440a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:44.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.829+0000 7f395e17b640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39440a33b0 0x7f39440a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:44.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.829+0000 7f394f7fe640 1 -- 172.21.15.70:0/4055398982 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f39500cf790 con 0x7f395810c170 2024-09-19T04:41:44.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.829+0000 7f395e17b640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39440a33b0 0x7f39440a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f39540058c0 tx=0x7f3954005c60 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:44.855 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:44.832+0000 7f394f7fe640 1 -- 172.21.15.70:0/4055398982 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f395009c280 con 0x7f395810c170 2024-09-19T04:41:45.012 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.010+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3958199890 con 0x7f395810c170 2024-09-19T04:41:45.012 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:44 smithi070 ceph-mon[30942]: pgmap v342: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:45.013 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.011+0000 7f394f7fe640 1 -- 172.21.15.70:0/4055398982 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 17 entries v94) ==== 81+0+1002 (secure 0 0 0) 0x7f3958199890 con 0x7f395810c170 2024-09-19T04:41:45.013 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/4212188848 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:45.013 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3933277587 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:45.013 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/544441745 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/1492093884 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3192727507 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2407570280 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6800/3440627608 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2258273209 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/999804527 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/1492093884 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1547748087 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/4212188848 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2420707462 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/2647945535 2024-09-20T04:21:55.166153+0000 2024-09-19T04:41:45.014 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/1218306304 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:45.015 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:6801/3440627608 2024-09-20T04:22:17.308265+0000 2024-09-19T04:41:45.015 INFO:teuthology.orchestra.run.smithi070.stdout:172.21.15.70:0/3999565316 2024-09-20T04:30:46.484972+0000 2024-09-19T04:41:45.015 INFO:teuthology.orchestra.run.smithi070.stderr:listed 17 entries 2024-09-19T04:41:45.015 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39440a33b0 msgr2=0x7f39440a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39440a33b0 0x7f39440a5870 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f39540058c0 tx=0x7f3954005c60 comp rx=0 tx=0).stop 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f395810c170 msgr2=0x7f395819ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f395810c170 0x7f395819ce00 secure :-1 s=READY pgs=1355 cs=0 l=1 rev1=1 crypto rx=0x7f395000b970 tx=0x7f395000be30 comp rx=0 tx=0).stop 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 shutdown_connections 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f39440a33b0 0x7f39440a5870 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f395810c170 0x7f395819ce00 unknown :-1 s=CLOSED pgs=1355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3958103660 0x7f3958198a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 --2- 172.21.15.70:0/4055398982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3958102d40 0x7f3958198530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 >> 172.21.15.70:0/4055398982 conn(0x7f39580fc7a0 msgr2=0x7f39580fdfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 shutdown_connections 2024-09-19T04:41:45.016 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:45.013+0000 7f39603df640 1 -- 172.21.15.70:0/4055398982 wait complete. 2024-09-19T04:41:45.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:44 smithi134 ceph-mon[34525]: pgmap v342: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:45.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:44 smithi167 ceph-mon[34339]: pgmap v342: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:45.759 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi070.front.sepia.ceph.com... 2024-09-19T04:41:45.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:41:45.759 DEBUG:teuthology.orchestra.run.smithi070:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-09-19T04:41:45.785 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi070.stderr:ceph-fuse[79472]: fuse finished with error 0 and tester_r 0 2024-09-19T04:41:45.786 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T04:41:46.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:45 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4055398982' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:41:46.134 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:45 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4055398982' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:41:46.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:45 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4055398982' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-09-19T04:41:47.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:46 smithi134 ceph-mon[34525]: pgmap v343: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:47.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:46 smithi070 ceph-mon[30942]: pgmap v343: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:47.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:46 smithi167 ceph-mon[34339]: pgmap v343: 97 pgs: 97 active+clean; 121 MiB data, 959 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-09-19T04:41:49.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:48 smithi134 ceph-mon[34525]: pgmap v344: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:41:49.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:48 smithi070 ceph-mon[30942]: pgmap v344: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:41:49.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:48 smithi167 ceph-mon[34339]: pgmap v344: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:41:51.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:50 smithi134 ceph-mon[34525]: pgmap v345: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:51.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:50 smithi070 ceph-mon[30942]: pgmap v345: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:51.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:50 smithi167 ceph-mon[34339]: pgmap v345: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:51.887 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:41:51.887 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:41:51.887 DEBUG:teuthology.orchestra.run.smithi070:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-09-19T04:41:52.078 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:41:52.079 DEBUG:teuthology.orchestra.run.smithi070:> ip netns list 2024-09-19T04:41:52.097 INFO:teuthology.orchestra.run.smithi070.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-09-19T04:41:52.097 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:41:52.098 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-09-19T04:41:52.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-09-19T04:41:52.168 DEBUG:teuthology.orchestra.run.smithi070:> sudo ip link delete ceph-brx 2024-09-19T04:41:52.276 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-09-19T04:41:52.287 INFO:tasks.cephadm:Teardown begin 2024-09-19T04:41:52.288 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-09-19T04:41:52.288 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:41:52.542 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:52.960 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:52 smithi070 ceph-mon[30942]: pgmap v346: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:41:53.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:52 smithi134 ceph-mon[34525]: pgmap v346: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 -- 172.21.15.70:0/959627173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41036e0 msgr2=0x7f5bc4107b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/959627173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41036e0 0x7f5bc4107b90 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7f5bc0009930 tx=0x7f5bc002a420 comp rx=0 tx=0).stop 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 -- 172.21.15.70:0/959627173 shutdown_connections 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/959627173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc41082a0 0x7f5bc410ec40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/959627173 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41036e0 0x7f5bc4107b90 unknown :-1 s=CLOSED pgs=1356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/959627173 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bc4102d30 0x7f5bc4103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 -- 172.21.15.70:0/959627173 >> 172.21.15.70:0/959627173 conn(0x7f5bc40fc7d0 msgr2=0x7f5bc40febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 -- 172.21.15.70:0/959627173 shutdown_connections 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 -- 172.21.15.70:0/959627173 wait complete. 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 Processor -- start 2024-09-19T04:41:53.052 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.039+0000 7f5bcbc94640 1 -- start start 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bcbc94640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc4102d30 0x7f5bc419e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bcbc94640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bc41036e0 0x7f5bc419e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bcbc94640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41082a0 0x7f5bc4198590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bcbc94640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc4112130 con 0x7f5bc41082a0 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bcbc94640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc4111fb0 con 0x7f5bc4102d30 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bcbc94640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f5bc41122b0 con 0x7f5bc41036e0 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41082a0 0x7f5bc4198590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41082a0 0x7f5bc4198590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:49054/0 (socket says 172.21.15.70:49054) 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 -- 172.21.15.70:0/4108890471 learned_addr learned my addr 172.21.15.70:0/4108890471 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bc9a30640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc4102d30 0x7f5bc419e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bc922f640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bc41036e0 0x7f5bc419e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 -- 172.21.15.70:0/4108890471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bc41036e0 msgr2=0x7f5bc419e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:53.053 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bc41036e0 0x7f5bc419e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 -- 172.21.15.70:0/4108890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc4102d30 msgr2=0x7f5bc419e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc4102d30 0x7f5bc419e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 -- 172.21.15.70:0/4108890471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5bc4198cc0 con 0x7f5bc41082a0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bc9a30640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc4102d30 0x7f5bc419e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bca231640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41082a0 0x7f5bc4198590 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00b970 tx=0x7f5bbc00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bbaffd640 1 -- 172.21.15.70:0/4108890471 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc019070 con 0x7f5bc41082a0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bbaffd640 1 -- 172.21.15.70:0/4108890471 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f5bbc00cb40 con 0x7f5bc41082a0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5bc4198fb0 con 0x7f5bc41082a0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bbaffd640 1 -- 172.21.15.70:0/4108890471 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5bbc007650 con 0x7f5bc41082a0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.040+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5bc41a52a0 con 0x7f5bc41082a0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.041+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5bc4103190 con 0x7f5bc41082a0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.043+0000 7f5bbaffd640 1 -- 172.21.15.70:0/4108890471 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f5bbc01c070 con 0x7f5bc41082a0 2024-09-19T04:41:53.054 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.043+0000 7f5bbaffd640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5bb00a33b0 0x7f5bb00a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:53.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.044+0000 7f5bc9a30640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5bb00a33b0 0x7f5bb00a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:53.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.044+0000 7f5bbaffd640 1 -- 172.21.15.70:0/4108890471 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f5bbc0cf340 con 0x7f5bc41082a0 2024-09-19T04:41:53.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.044+0000 7f5bc9a30640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5bb00a33b0 0x7f5bb00a5870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009930 tx=0x7f5bb4008040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:53.055 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.048+0000 7f5bbaffd640 1 -- 172.21.15.70:0/4108890471 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f5bbc09be30 con 0x7f5bc41082a0 2024-09-19T04:41:53.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:52 smithi167 ceph-mon[34339]: pgmap v346: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 767 B/s wr, 8 op/s 2024-09-19T04:41:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.247+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5bc410a2b0 con 0x7f5bc41082a0 2024-09-19T04:41:53.249 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.248+0000 7f5bbaffd640 1 -- 172.21.15.70:0/4108890471 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f5bbc09b730 con 0x7f5bc41082a0 2024-09-19T04:41:53.250 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:41:53.250 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:41:53.250 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:41:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5bb00a33b0 msgr2=0x7f5bb00a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5bb00a33b0 0x7f5bb00a5870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f5bb4009930 tx=0x7f5bb4008040 comp rx=0 tx=0).stop 2024-09-19T04:41:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41082a0 msgr2=0x7f5bc4198590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41082a0 0x7f5bc4198590 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc00b970 tx=0x7f5bbc00be30 comp rx=0 tx=0).stop 2024-09-19T04:41:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 shutdown_connections 2024-09-19T04:41:53.252 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f5bb00a33b0 0x7f5bb00a5870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f5bc41082a0 0x7f5bc4198590 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f5bc41036e0 0x7f5bc419e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 --2- 172.21.15.70:0/4108890471 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5bc4102d30 0x7f5bc419e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 >> 172.21.15.70:0/4108890471 conn(0x7f5bc40fc7d0 msgr2=0x7f5bc4105e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 shutdown_connections 2024-09-19T04:41:53.253 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:53.250+0000 7f5bcbc94640 1 -- 172.21.15.70:0/4108890471 wait complete. 2024-09-19T04:41:53.895 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:53 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4108890471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:54.026 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs dump --format=json 2024-09-19T04:41:54.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:53 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4108890471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:54.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:53 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4108890471' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:54.271 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:54.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.805+0000 7f358eb33640 1 -- 172.21.15.70:0/2454483198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 msgr2=0x7f358810ec40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:54.818 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.805+0000 7f358eb33640 1 --2- 172.21.15.70:0/2454483198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 0x7f358810ec40 secure :-1 s=READY pgs=1358 cs=0 l=1 rev1=1 crypto rx=0x7f3580009cd0 tx=0x7f358002a8e0 comp rx=0 tx=0).stop 2024-09-19T04:41:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.805+0000 7f358eb33640 1 -- 172.21.15.70:0/2454483198 shutdown_connections 2024-09-19T04:41:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.805+0000 7f358eb33640 1 --2- 172.21.15.70:0/2454483198 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 0x7f358810ec40 unknown :-1 s=CLOSED pgs=1358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:54.819 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.805+0000 7f358eb33640 1 --2- 172.21.15.70:0/2454483198 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35881036e0 0x7f3588107b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.805+0000 7f358eb33640 1 --2- 172.21.15.70:0/2454483198 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588102d30 0x7f3588103110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.805+0000 7f358eb33640 1 -- 172.21.15.70:0/2454483198 >> 172.21.15.70:0/2454483198 conn(0x7f35880fc7d0 msgr2=0x7f35880febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 -- 172.21.15.70:0/2454483198 shutdown_connections 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 -- 172.21.15.70:0/2454483198 wait complete. 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 Processor -- start 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 -- start start 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588102d30 0x7f3588198570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35881036e0 0x7f3588198ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 0x7f358819ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f3588112070 con 0x7f35881082a0 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f3588111ef0 con 0x7f35881036e0 2024-09-19T04:41:54.820 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358eb33640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f35881121f0 con 0x7f3588102d30 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358d0d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 0x7f358819ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358d0d0640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 0x7f358819ce40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46282/0 (socket says 172.21.15.70:46282) 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.806+0000 7f358d0d0640 1 -- 172.21.15.70:0/2915956983 learned_addr learned my addr 172.21.15.70:0/2915956983 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f3587fff640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35881036e0 0x7f3588198ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358c8cf640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588102d30 0x7f3588198570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358d0d0640 1 -- 172.21.15.70:0/2915956983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588102d30 msgr2=0x7f3588198570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358d0d0640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588102d30 0x7f3588198570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358d0d0640 1 -- 172.21.15.70:0/2915956983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35881036e0 msgr2=0x7f3588198ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358d0d0640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35881036e0 0x7f3588198ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358d0d0640 1 -- 172.21.15.70:0/2915956983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f358819d520 con 0x7f35881082a0 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358c8cf640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588102d30 0x7f3588198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358d0d0640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 0x7f358819ce40 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f35800097b0 tx=0x7f3580003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:54.821 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f3585ffb640 1 -- 172.21.15.70:0/2915956983 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580004040 con 0x7f35881082a0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f3585ffb640 1 -- 172.21.15.70:0/2915956983 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f35800046b0 con 0x7f35881082a0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f358819d7b0 con 0x7f35881082a0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f3585ffb640 1 -- 172.21.15.70:0/2915956983 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3580046480 con 0x7f35881082a0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.807+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35881a50f0 con 0x7f35881082a0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.808+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3588103110 con 0x7f35881082a0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.810+0000 7f3585ffb640 1 -- 172.21.15.70:0/2915956983 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f3580030730 con 0x7f35881082a0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.810+0000 7f3585ffb640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f35700a33b0 0x7f35700a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.810+0000 7f358c8cf640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f35700a33b0 0x7f35700a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.810+0000 7f3585ffb640 1 -- 172.21.15.70:0/2915956983 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f358002e030 con 0x7f35881082a0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.811+0000 7f358c8cf640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f35700a33b0 0x7f35700a5870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f35780058c0 tx=0x7f3578005d30 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:54.822 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:54.813+0000 7f3585ffb640 1 -- 172.21.15.70:0/2915956983 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f358004b060 con 0x7f35881082a0 2024-09-19T04:41:55.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.012+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f358810a2b0 con 0x7f35881082a0 2024-09-19T04:41:55.014 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:54 smithi070 ceph-mon[30942]: pgmap v347: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:55.014 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.013+0000 7f3585ffb640 1 -- 172.21.15.70:0/2915956983 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) ==== 94+0+11914 (secure 0 0 0) 0x7f35800be0f0 con 0x7f35881082a0 2024-09-19T04:41:55.015 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:41:55.015 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":34,"btime":"2024-09-19T04:37:01:957144+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14544,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6835/1596262416","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6834","nonce":1596262416},{"type":"v1","addr":"172.21.15.70:6835","nonce":1596262416}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14556,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6837/53186803","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6836","nonce":53186803},{"type":"v1","addr":"172.21.15.70:6837","nonce":53186803}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14598,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6839/302466091","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6838","nonce":302466091},{"type":"v1","addr":"172.21.15.70:6839","nonce":302466091}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14610,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.70:6841/3197291261","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6840","nonce":3197291261},{"type":"v1","addr":"172.21.15.70:6841","nonce":3197291261}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24391,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.167:6833/460081986","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6832","nonce":460081986},{"type":"v1","addr":"172.21.15.167:6833","nonce":460081986}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24407,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6833/2796874112","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6832","nonce":2796874112},{"type":"v1","addr":"172.21.15.134:6833","nonce":2796874112}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":34,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-09-19T04:29:02.989107+0000","modified":"2024-09-19T04:37:01.703852+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24470,"mds_1":24452,"mds_2":24433},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24412":{"gid":24412,"name":"f","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6835/3330741295","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6834","nonce":3330741295},{"type":"v1","addr":"172.21.15.167:6835","nonce":3330741295}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24418":{"gid":24418,"name":"c","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.167:6837/3495956228","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6836","nonce":3495956228},{"type":"v1","addr":"172.21.15.167:6837","nonce":3495956228}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24428":{"gid":24428,"name":"e","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.134:6835/1711007693","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6834","nonce":1711007693},{"type":"v1","addr":"172.21.15.134:6835","nonce":1711007693}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24433":{"gid":24433,"name":"i","rank":2,"incarnation":20,"state":"up:active","state_seq":8,"addr":"172.21.15.167:6839/2148889748","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6838","nonce":2148889748},{"type":"v1","addr":"172.21.15.167:6839","nonce":2148889748}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24452":{"gid":24452,"name":"h","rank":1,"incarnation":18,"state":"up:active","state_seq":9,"addr":"172.21.15.134:6837/2308950233","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6836","nonce":2308950233},{"type":"v1","addr":"172.21.15.134:6837","nonce":2308950233}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24470":{"gid":24470,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.134:6839/1808608891","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6838","nonce":1808608891},{"type":"v1","addr":"172.21.15.134:6839","nonce":1808608891}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24470,"qdb_cluster":[24470,24452,24433]},"id":1}]} 2024-09-19T04:41:55.015 INFO:teuthology.orchestra.run.smithi070.stderr:dumped fsmap epoch 34 2024-09-19T04:41:55.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f35700a33b0 msgr2=0x7f35700a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:55.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f35700a33b0 0x7f35700a5870 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f35780058c0 tx=0x7f3578005d30 comp rx=0 tx=0).stop 2024-09-19T04:41:55.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 msgr2=0x7f358819ce40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:55.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 0x7f358819ce40 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f35800097b0 tx=0x7f3580003970 comp rx=0 tx=0).stop 2024-09-19T04:41:55.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 shutdown_connections 2024-09-19T04:41:55.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f35700a33b0 0x7f35700a5870 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:55.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f35881082a0 0x7f358819ce40 unknown :-1 s=CLOSED pgs=1359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:55.017 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35881036e0 0x7f3588198ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:55.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 --2- 172.21.15.70:0/2915956983 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f3588102d30 0x7f3588198570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:55.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 >> 172.21.15.70:0/2915956983 conn(0x7f35880fc7d0 msgr2=0x7f3588105d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:55.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 shutdown_connections 2024-09-19T04:41:55.018 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:55.015+0000 7f358eb33640 1 -- 172.21.15.70:0/2915956983 wait complete. 2024-09-19T04:41:55.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:54 smithi134 ceph-mon[34525]: pgmap v347: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:55.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:54 smithi167 ceph-mon[34339]: pgmap v347: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:55.737 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd dump --format=json 2024-09-19T04:41:55.988 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:56.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:55 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2915956983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:56.109 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:55 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2915956983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:56.211 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:55 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2915956983' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-09-19T04:41:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 -- 172.21.15.70:0/808906170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 msgr2=0x7fe19c103120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 --2- 172.21.15.70:0/808906170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 0x7fe19c103120 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009900 tx=0x7fe18c02a480 comp rx=0 tx=0).stop 2024-09-19T04:41:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 -- 172.21.15.70:0/808906170 shutdown_connections 2024-09-19T04:41:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 --2- 172.21.15.70:0/808906170 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe19c10c170 0x7fe19c10e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 --2- 172.21.15.70:0/808906170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe19c103660 0x7fe19c10bb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 --2- 172.21.15.70:0/808906170 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 0x7fe19c103120 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 -- 172.21.15.70:0/808906170 >> 172.21.15.70:0/808906170 conn(0x7fe19c0fc7a0 msgr2=0x7fe19c0febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:56.484 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 -- 172.21.15.70:0/808906170 shutdown_connections 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 -- 172.21.15.70:0/808906170 wait complete. 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.470+0000 7fe1a401e640 1 Processor -- start 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a401e640 1 -- start start 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a401e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 0x7fe19c1009a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a401e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe19c103660 0x7fe19c100ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a401e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe19c10c170 0x7fe19c101420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a401e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c112020 con 0x7fe19c102d40 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a401e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c111ea0 con 0x7fe19c103660 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a401e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fe19c1121a0 con 0x7fe19c10c170 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 0x7fe19c1009a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:56.485 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 0x7fe19c1009a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46302/0 (socket says 172.21.15.70:46302) 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 -- 172.21.15.70:0/3596537731 learned_addr learned my addr 172.21.15.70:0/3596537731 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a25bb640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe19c10c170 0x7fe19c101420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 -- 172.21.15.70:0/3596537731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe19c10c170 msgr2=0x7fe19c101420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe19c10c170 0x7fe19c101420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 -- 172.21.15.70:0/3596537731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe19c103660 msgr2=0x7fe19c100ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a15b9640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe19c103660 0x7fe19c100ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe19c103660 0x7fe19c100ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 -- 172.21.15.70:0/3596537731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe19c1a6a40 con 0x7fe19c102d40 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a25bb640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe19c10c170 0x7fe19c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.471+0000 7fe1a1dba640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 0x7fe19c1009a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009a20 tx=0x7fe18c0043b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.472+0000 7fe192ffd640 1 -- 172.21.15.70:0/3596537731 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c03f030 con 0x7fe19c102d40 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.472+0000 7fe192ffd640 1 -- 172.21.15.70:0/3596537731 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fe18c031b80 con 0x7fe19c102d40 2024-09-19T04:41:56.486 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.472+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe19c1a6cd0 con 0x7fe19c102d40 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.472+0000 7fe192ffd640 1 -- 172.21.15.70:0/3596537731 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe18c035070 con 0x7fe19c102d40 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.472+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe19c1a71b0 con 0x7fe19c102d40 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.473+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe19c1031a0 con 0x7fe19c102d40 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.474+0000 7fe192ffd640 1 -- 172.21.15.70:0/3596537731 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fe18c0035f0 con 0x7fe19c102d40 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.474+0000 7fe192ffd640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe1880a33b0 0x7fe1880a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.474+0000 7fe1a15b9640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe1880a33b0 0x7fe1880a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.475+0000 7fe192ffd640 1 -- 172.21.15.70:0/3596537731 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7fe18c0f0ef0 con 0x7fe19c102d40 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.475+0000 7fe1a15b9640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe1880a33b0 0x7fe1880a5870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe19c102430 tx=0x7fe198008040 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:56.487 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.477+0000 7fe192ffd640 1 -- 172.21.15.70:0/3596537731 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fe18c0bd8d0 con 0x7fe19c102d40 2024-09-19T04:41:56.650 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.649+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe19c101ed0 con 0x7fe19c102d40 2024-09-19T04:41:56.651 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.650+0000 7fe192ffd640 1 -- 172.21.15.70:0/3596537731 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v94) ==== 74+0+23207 (secure 0 0 0) 0x7fe19c101ed0 con 0x7fe19c102d40 2024-09-19T04:41:56.652 INFO:teuthology.orchestra.run.smithi070.stdout: 2024-09-19T04:41:56.652 INFO:teuthology.orchestra.run.smithi070.stdout:{"epoch":94,"fsid":"7f15b24a-763e-11ef-bceb-c7b262605968","created":"2024-09-19T04:21:29.503052+0000","modified":"2024-09-19T04:41:14.516771+0000","last_up_change":"2024-09-19T04:28:14.232753+0000","last_in_change":"2024-09-19T04:27:49.518831+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T04:24:31.609825+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-09-19T04:28:59.024148+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-09-19T04:29:01.143246+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"93","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":93,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"4f4e9a42-7846-4760-aaa3-fd08543625d3","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6802","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6803","nonce":1173006577}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6804","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6805","nonce":1173006577}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6808","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6809","nonce":1173006577}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6806","nonce":1173006577},{"type":"v1","addr":"172.21.15.70:6807","nonce":1173006577}]},"public_addr":"172.21.15.70:6803/1173006577","cluster_addr":"172.21.15.70:6805/1173006577","heartbeat_back_addr":"172.21.15.70:6809/1173006577","heartbeat_front_addr":"172.21.15.70:6807/1173006577","state":["exists","up"]},{"osd":1,"uuid":"cbfe06a1-eca7-4785-8b9e-89a170a13ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6801","nonce":3268047050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6803","nonce":3268047050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6807","nonce":3268047050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3268047050},{"type":"v1","addr":"172.21.15.134:6805","nonce":3268047050}]},"public_addr":"172.21.15.134:6801/3268047050","cluster_addr":"172.21.15.134:6803/3268047050","heartbeat_back_addr":"172.21.15.134:6807/3268047050","heartbeat_front_addr":"172.21.15.134:6805/3268047050","state":["exists","up"]},{"osd":2,"uuid":"d4529395-6d0b-43a9-ab1c-00c5588e4bab","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6800","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6801","nonce":2534409375}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6802","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6803","nonce":2534409375}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6806","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6807","nonce":2534409375}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6804","nonce":2534409375},{"type":"v1","addr":"172.21.15.167:6805","nonce":2534409375}]},"public_addr":"172.21.15.167:6801/2534409375","cluster_addr":"172.21.15.167:6803/2534409375","heartbeat_back_addr":"172.21.15.167:6807/2534409375","heartbeat_front_addr":"172.21.15.167:6805/2534409375","state":["exists","up"]},{"osd":3,"uuid":"8d58ee3f-9c3d-46a3-ab56-e3ab7b8a2cef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":25,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6810","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6811","nonce":1314792763}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6812","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6813","nonce":1314792763}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6816","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6817","nonce":1314792763}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6814","nonce":1314792763},{"type":"v1","addr":"172.21.15.70:6815","nonce":1314792763}]},"public_addr":"172.21.15.70:6811/1314792763","cluster_addr":"172.21.15.70:6813/1314792763","heartbeat_back_addr":"172.21.15.70:6817/1314792763","heartbeat_front_addr":"172.21.15.70:6815/1314792763","state":["exists","up"]},{"osd":4,"uuid":"81b280f6-42d4-4e66-91d5-8119a66b7e23","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6809","nonce":1442854624}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6811","nonce":1442854624}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6815","nonce":1442854624}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1442854624},{"type":"v1","addr":"172.21.15.134:6813","nonce":1442854624}]},"public_addr":"172.21.15.134:6809/1442854624","cluster_addr":"172.21.15.134:6811/1442854624","heartbeat_back_addr":"172.21.15.134:6815/1442854624","heartbeat_front_addr":"172.21.15.134:6813/1442854624","state":["exists","up"]},{"osd":5,"uuid":"4980fc29-7eaf-4f69-a034-1c10dafe1318","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6808","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6809","nonce":1206537032}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6810","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6811","nonce":1206537032}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6814","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6815","nonce":1206537032}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6812","nonce":1206537032},{"type":"v1","addr":"172.21.15.167:6813","nonce":1206537032}]},"public_addr":"172.21.15.167:6809/1206537032","cluster_addr":"172.21.15.167:6811/1206537032","heartbeat_back_addr":"172.21.15.167:6815/1206537032","heartbeat_front_addr":"172.21.15.167:6813/1206537032","state":["exists","up"]},{"osd":6,"uuid":"f1b5fe84-82d8-4beb-b050-fc03c492ab85","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":43,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6818","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6819","nonce":1741503048}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6820","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6821","nonce":1741503048}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6824","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6825","nonce":1741503048}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6822","nonce":1741503048},{"type":"v1","addr":"172.21.15.70:6823","nonce":1741503048}]},"public_addr":"172.21.15.70:6819/1741503048","cluster_addr":"172.21.15.70:6821/1741503048","heartbeat_back_addr":"172.21.15.70:6825/1741503048","heartbeat_front_addr":"172.21.15.70:6823/1741503048","state":["exists","up"]},{"osd":7,"uuid":"ed960d6e-6426-4124-addf-efddb5b1a800","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":48,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6817","nonce":4280559958}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6819","nonce":4280559958}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6823","nonce":4280559958}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4280559958},{"type":"v1","addr":"172.21.15.134:6821","nonce":4280559958}]},"public_addr":"172.21.15.134:6817/4280559958","cluster_addr":"172.21.15.134:6819/4280559958","heartbeat_back_addr":"172.21.15.134:6823/4280559958","heartbeat_front_addr":"172.21.15.134:6821/4280559958","state":["exists","up"]},{"osd":8,"uuid":"abb19a65-c197-4a87-a223-38297eb046e9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6816","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6817","nonce":94770656}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6818","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6819","nonce":94770656}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6822","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6823","nonce":94770656}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6820","nonce":94770656},{"type":"v1","addr":"172.21.15.167:6821","nonce":94770656}]},"public_addr":"172.21.15.167:6817/94770656","cluster_addr":"172.21.15.167:6819/94770656","heartbeat_back_addr":"172.21.15.167:6823/94770656","heartbeat_front_addr":"172.21.15.167:6821/94770656","state":["exists","up"]},{"osd":9,"uuid":"14c34016-a6ec-45d9-8a5a-181af66bd84b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":62,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6826","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6827","nonce":4029282246}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6828","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6829","nonce":4029282246}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6832","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6833","nonce":4029282246}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.70:6830","nonce":4029282246},{"type":"v1","addr":"172.21.15.70:6831","nonce":4029282246}]},"public_addr":"172.21.15.70:6827/4029282246","cluster_addr":"172.21.15.70:6829/4029282246","heartbeat_back_addr":"172.21.15.70:6833/4029282246","heartbeat_front_addr":"172.21.15.70:6831/4029282246","state":["exists","up"]},{"osd":10,"uuid":"bfad740c-5443-45df-b7d6-523d91197fe2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":67,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6825","nonce":3415319781}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6827","nonce":3415319781}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6830","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6831","nonce":3415319781}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6828","nonce":3415319781},{"type":"v1","addr":"172.21.15.134:6829","nonce":3415319781}]},"public_addr":"172.21.15.134:6825/3415319781","cluster_addr":"172.21.15.134:6827/3415319781","heartbeat_back_addr":"172.21.15.134:6831/3415319781","heartbeat_front_addr":"172.21.15.134:6829/3415319781","state":["exists","up"]},{"osd":11,"uuid":"c23990f1-2aae-47b0-a906-4075d086633d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6824","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6825","nonce":986370842}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6826","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6827","nonce":986370842}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6830","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6831","nonce":986370842}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.167:6828","nonce":986370842},{"type":"v1","addr":"172.21.15.167:6829","nonce":986370842}]},"public_addr":"172.21.15.167:6825/986370842","cluster_addr":"172.21.15.167:6827/986370842","heartbeat_back_addr":"172.21.15.167:6831/986370842","heartbeat_front_addr":"172.21.15.167:6829/986370842","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:23:37.739298+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:02.992546+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:28.601990+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:24:53.932195+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:18.389166+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:25:42.887265+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:07.689701+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:32.225523+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:26:56.992054+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:21.869348+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:27:46.151808+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T04:28:11.424372+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.4","mappings":[{"from":2,"to":11}]},{"pgid":"2.5","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":3,"to":6}]},{"pgid":"3.20","mappings":[{"from":5,"to":9}]},{"pgid":"3.24","mappings":[{"from":4,"to":9}]},{"pgid":"3.34","mappings":[{"from":4,"to":9}]},{"pgid":"3.3a","mappings":[{"from":4,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.70:6800/4212188848":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/3933277587":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/544441745":"2024-09-20T04:30:46.484972+0000","172.21.15.70:6800/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/3192727507":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2407570280":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6800/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/2258273209":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/999804527":"2024-09-20T04:30:46.484972+0000","172.21.15.70:6801/1492093884":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/1547748087":"2024-09-20T04:21:55.166153+0000","172.21.15.70:6801/4212188848":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/2420707462":"2024-09-20T04:30:46.484972+0000","172.21.15.70:0/2647945535":"2024-09-20T04:21:55.166153+0000","172.21.15.70:0/1218306304":"2024-09-20T04:22:17.308265+0000","172.21.15.70:6801/3440627608":"2024-09-20T04:22:17.308265+0000","172.21.15.70:0/3999565316":"2024-09-20T04:30:46.484972+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe1880a33b0 msgr2=0x7fe1880a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe1880a33b0 0x7fe1880a5870 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fe19c102430 tx=0x7fe198008040 comp rx=0 tx=0).stop 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 msgr2=0x7fe19c1009a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 0x7fe19c1009a0 secure :-1 s=READY pgs=1361 cs=0 l=1 rev1=1 crypto rx=0x7fe18c009a20 tx=0x7fe18c0043b0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 shutdown_connections 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fe1880a33b0 0x7fe1880a5870 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fe19c10c170 0x7fe19c101420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe19c103660 0x7fe19c100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.654 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 --2- 172.21.15.70:0/3596537731 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fe19c102d40 0x7fe19c1009a0 unknown :-1 s=CLOSED pgs=1361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:56.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.652+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 >> 172.21.15.70:0/3596537731 conn(0x7fe19c0fc7a0 msgr2=0x7fe19c0fdfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:56.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.653+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 shutdown_connections 2024-09-19T04:41:56.655 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:56.653+0000 7fe1a401e640 1 -- 172.21.15.70:0/3596537731 wait complete. 2024-09-19T04:41:57.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:56 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/3596537731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:41:57.033 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:56 smithi070 ceph-mon[30942]: pgmap v348: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:56 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/3596537731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:41:57.035 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:56 smithi134 ceph-mon[34525]: pgmap v348: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:57.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:56 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/3596537731' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-09-19T04:41:57.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:56 smithi167 ceph-mon[34339]: pgmap v348: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 767 B/s wr, 6 op/s 2024-09-19T04:41:57.458 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs fail cephfs 2024-09-19T04:41:57.703 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:58.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 -- 172.21.15.70:0/2378776992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 msgr2=0x7f92a01029b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:58.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 --2- 172.21.15.70:0/2378776992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 0x7f92a01029b0 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f928c009900 tx=0x7f928c02a480 comp rx=0 tx=0).stop 2024-09-19T04:41:58.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 -- 172.21.15.70:0/2378776992 shutdown_connections 2024-09-19T04:41:58.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 --2- 172.21.15.70:0/2378776992 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a0102ef0 0x7f92a010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.172 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 --2- 172.21.15.70:0/2378776992 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 0x7f92a01029b0 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 --2- 172.21.15.70:0/2378776992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a0100e20 0x7f92a0101200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 -- 172.21.15.70:0/2378776992 >> 172.21.15.70:0/2378776992 conn(0x7f92a00fc7d0 msgr2=0x7f92a00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 -- 172.21.15.70:0/2378776992 shutdown_connections 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.169+0000 7f92a7030640 1 -- 172.21.15.70:0/2378776992 wait complete. 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a7030640 1 Processor -- start 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a7030640 1 -- start start 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a7030640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a0100e20 0x7f92a01993e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a7030640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 0x7f92a0199920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a7030640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a0102ef0 0x7f92a01a4460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a7030640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f92a0110f90 con 0x7f92a0102570 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a7030640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f92a0110e10 con 0x7f92a0102ef0 2024-09-19T04:41:58.173 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a7030640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f92a0111110 con 0x7f92a0100e20 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f929ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 0x7f92a0199920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f929ffff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 0x7f92a0199920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46306/0 (socket says 172.21.15.70:46306) 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f929ffff640 1 -- 172.21.15.70:0/865496283 learned_addr learned my addr 172.21.15.70:0/865496283 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a4dcc640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a0100e20 0x7f92a01993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f929ffff640 1 -- 172.21.15.70:0/865496283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a0100e20 msgr2=0x7f92a01993e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f929ffff640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a0100e20 0x7f92a01993e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f929ffff640 1 -- 172.21.15.70:0/865496283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a0102ef0 msgr2=0x7f92a01a4460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a55cd640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a0102ef0 0x7f92a01a4460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f929ffff640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a0102ef0 0x7f92a01a4460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f929ffff640 1 -- 172.21.15.70:0/865496283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f92a01a49a0 con 0x7f92a0102570 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.170+0000 7f92a55cd640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a0102ef0 0x7f92a01a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.171+0000 7f929ffff640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 0x7f92a0199920 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f928c005940 tx=0x7f928c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:58.174 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.171+0000 7f929dffb640 1 -- 172.21.15.70:0/865496283 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c03f030 con 0x7f92a0102570 2024-09-19T04:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.171+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f92a01971d0 con 0x7f92a0102570 2024-09-19T04:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.171+0000 7f929dffb640 1 -- 172.21.15.70:0/865496283 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f928c003ac0 con 0x7f92a0102570 2024-09-19T04:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.171+0000 7f929dffb640 1 -- 172.21.15.70:0/865496283 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f928c035070 con 0x7f92a0102570 2024-09-19T04:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.171+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f92a01976b0 con 0x7f92a0102570 2024-09-19T04:41:58.175 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.172+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f92a0101200 con 0x7f92a0102570 2024-09-19T04:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.173+0000 7f929dffb640 1 -- 172.21.15.70:0/865496283 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f928c042030 con 0x7f92a0102570 2024-09-19T04:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.174+0000 7f929dffb640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f92900a33b0 0x7f92900a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.174+0000 7f92a4dcc640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f92900a33b0 0x7f92900a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.174+0000 7f929dffb640 1 -- 172.21.15.70:0/865496283 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(94..94 src has 1..94) ==== 8527+0+0 (secure 0 0 0) 0x7f928c0f08d0 con 0x7f92a0102570 2024-09-19T04:41:58.176 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.174+0000 7f92a4dcc640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f92900a33b0 0x7f92900a5870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9294005e10 tx=0x7f9294005da0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:58.178 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.177+0000 7f929dffb640 1 -- 172.21.15.70:0/865496283 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f928c0bd250 con 0x7f92a0102570 2024-09-19T04:41:58.379 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.377+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f92a0109090 con 0x7f92a0102570 2024-09-19T04:41:58.381 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.379+0000 7f929dffb640 1 -- 172.21.15.70:0/865496283 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v35) ==== 161+0+0 (secure 0 0 0) 0x7f928c0bcb50 con 0x7f92a0102570 2024-09-19T04:41:58.381 INFO:teuthology.orchestra.run.smithi070.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-09-19T04:41:58.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f92900a33b0 msgr2=0x7f92900a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:58.384 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f92900a33b0 0x7f92900a5870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f9294005e10 tx=0x7f9294005da0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 msgr2=0x7f92a0199920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 0x7f92a0199920 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f928c005940 tx=0x7f928c004270 comp rx=0 tx=0).stop 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 shutdown_connections 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f92900a33b0 0x7f92900a5870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92a0102ef0 0x7f92a01a4460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f92a0102570 0x7f92a0199920 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 --2- 172.21.15.70:0/865496283 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f92a0100e20 0x7f92a01993e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 >> 172.21.15.70:0/865496283 conn(0x7f92a00fc7d0 msgr2=0x7f92a01068d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 shutdown_connections 2024-09-19T04:41:58.385 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:58.383+0000 7f92a7030640 1 -- 172.21.15.70:0/865496283 wait complete. 2024-09-19T04:41:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:58 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a[30938]: 2024-09-19T04:41:58.378+0000 7f43f70cb640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T04:41:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:58 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/865496283' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T04:41:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:58 smithi070 ceph-mon[30942]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T04:41:58.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:58 smithi070 ceph-mon[30942]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T04:41:58.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:58 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/865496283' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T04:41:58.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:58 smithi070 ceph-mon[30942]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T04:41:58.646 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:58 smithi070 ceph-mon[30942]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T04:41:58.710 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c[64282]: ignoring --setuser ceph since I am not root 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c[64282]: ignoring --setgroup ceph since I am not root 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mds[64286]: -- 172.21.15.167:0/2964279153 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560da1e7d860 con 0x560da1e5b400 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c[64282]: starting mds.c at 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/865496283' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mon[34339]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mon[34339]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/865496283' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mon[34339]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T04:41:58.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mon[34339]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T04:41:58.712 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f[63985]: ignoring --setuser ceph since I am not root 2024-09-19T04:41:58.712 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f[63985]: ignoring --setgroup ceph since I am not root 2024-09-19T04:41:58.712 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mds[63989]: -- 172.21.15.167:0/2713698402 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x555b2ab5f860 con 0x555b2ab3c800 2024-09-19T04:41:58.712 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f[63985]: starting mds.f at 2024-09-19T04:41:58.712 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i[64582]: ignoring --setuser ceph since I am not root 2024-09-19T04:41:58.712 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i[64582]: ignoring --setgroup ceph since I am not root 2024-09-19T04:41:58.713 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-mds[64586]: -- 172.21.15.167:0/586499491 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55b180539860 con 0x55b180517000 2024-09-19T04:41:58.713 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:41:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i[64582]: starting mds.i at 2024-09-19T04:41:58.785 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h[64054]: ignoring --setuser ceph since I am not root 2024-09-19T04:41:58.785 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h[64054]: ignoring --setgroup ceph since I am not root 2024-09-19T04:41:58.785 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mds[64058]: -- 172.21.15.134:0/2084619480 <== mon.1 v2:172.21.15.167:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5641426c3c20 con 0x5641426a1400 2024-09-19T04:41:58.785 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h[64054]: starting mds.h at 2024-09-19T04:41:58.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/865496283' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mon[34525]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mon[34525]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/865496283' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mon[34525]: osdmap e95: 12 total, 12 up, 12 in 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mon[34525]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: ignoring --setuser ceph since I am not root 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: ignoring --setgroup ceph since I am not root 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mds[64362]: -- 172.21.15.134:0/3985407339 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5572a0a5fc20 con 0x5572a0a3d000 2024-09-19T04:41:58.786 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: starting mds.b at 2024-09-19T04:41:58.787 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e[63752]: ignoring --setuser ceph since I am not root 2024-09-19T04:41:58.787 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e[63752]: ignoring --setgroup ceph since I am not root 2024-09-19T04:41:58.787 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-mds[63756]: -- 172.21.15.134:0/1869459238 <== mon.0 v2:172.21.15.70:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ae4b28fc20 con 0x55ae4b26c800 2024-09-19T04:41:58.787 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:41:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e[63752]: starting mds.e at 2024-09-19T04:41:59.192 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-09-19T04:41:59.438 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: pgmap v350: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.167:6834/2570023425,v1:172.21.15.167:6835/2570023425] up:boot 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.167:6836/4020403259,v1:172.21.15.167:6837/4020403259] up:boot 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6834/651585380,v1:172.21.15.134:6835/651585380] up:boot 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.167:6838/710057007,v1:172.21.15.167:6839/710057007] up:boot 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6837/2950341581,v1:172.21.15.134:6839/2950341581] up:boot 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: mds.? [v2:172.21.15.134:6836/2852356467,v1:172.21.15.134:6838/2852356467] up:boot 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:41:59.692 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:41:59.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:41:59.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:41:59.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:41:59.693 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:41:59 smithi070 ceph-mon[30942]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: pgmap v350: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.167:6834/2570023425,v1:172.21.15.167:6835/2570023425] up:boot 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.167:6836/4020403259,v1:172.21.15.167:6837/4020403259] up:boot 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6834/651585380,v1:172.21.15.134:6835/651585380] up:boot 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.167:6838/710057007,v1:172.21.15.167:6839/710057007] up:boot 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6837/2950341581,v1:172.21.15.134:6839/2950341581] up:boot 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: mds.? [v2:172.21.15.134:6836/2852356467,v1:172.21.15.134:6838/2852356467] up:boot 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:41:59.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:41:59.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:41:59.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:41:59.712 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:41:59 smithi167 ceph-mon[34339]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:41:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: pgmap v350: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T04:41:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.167:6834/2570023425,v1:172.21.15.167:6835/2570023425] up:boot 2024-09-19T04:41:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.167:6836/4020403259,v1:172.21.15.167:6837/4020403259] up:boot 2024-09-19T04:41:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6834/651585380,v1:172.21.15.134:6835/651585380] up:boot 2024-09-19T04:41:59.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.167:6838/710057007,v1:172.21.15.167:6839/710057007] up:boot 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6837/2950341581,v1:172.21.15.134:6839/2950341581] up:boot 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: mds.? [v2:172.21.15.134:6836/2852356467,v1:172.21.15.134:6838/2852356467] up:boot 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-09-19T04:41:59.786 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:41:59 smithi134 ceph-mon[34525]: from='mgr.15138 172.21.15.70:0/238481664' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-09-19T04:41:59.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 -- 172.21.15.70:0/4163258955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0100e20 msgr2=0x7ff2b0101200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:59.876 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/4163258955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0100e20 0x7ff2b0101200 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0009900 tx=0x7ff2a002a480 comp rx=0 tx=0).stop 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 -- 172.21.15.70:0/4163258955 shutdown_connections 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/4163258955 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b0102ef0 0x7ff2b010da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/4163258955 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b0102570 0x7ff2b01029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/4163258955 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0100e20 0x7ff2b0101200 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 -- 172.21.15.70:0/4163258955 >> 172.21.15.70:0/4163258955 conn(0x7ff2b00fc7d0 msgr2=0x7ff2b00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 -- 172.21.15.70:0/4163258955 shutdown_connections 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 -- 172.21.15.70:0/4163258955 wait complete. 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 Processor -- start 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.873+0000 7ff2b64f4640 1 -- start start 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b64f4640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b0100e20 0x7ff2b0197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b64f4640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b0102570 0x7ff2b0197980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:59.877 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b64f4640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0102ef0 0x7ff2b019bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b64f4640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b0110f50 con 0x7ff2b0102ef0 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b64f4640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b0110dd0 con 0x7ff2b0100e20 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b64f4640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7ff2b01110d0 con 0x7ff2b0102570 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2affff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b0100e20 0x7ff2b0197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b4a91640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0102ef0 0x7ff2b019bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2a7fff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b0102570 0x7ff2b0197980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2affff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b0100e20 0x7ff2b0197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.70:56824/0 (socket says 172.21.15.70:56824) 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2affff640 1 -- 172.21.15.70:0/2210382934 learned_addr learned my addr 172.21.15.70:0/2210382934 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b4a91640 1 -- 172.21.15.70:0/2210382934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b0102570 msgr2=0x7ff2b0197980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b4a91640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b0102570 0x7ff2b0197980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b4a91640 1 -- 172.21.15.70:0/2210382934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b0100e20 msgr2=0x7ff2b0197440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:41:59.878 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b4a91640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b0100e20 0x7ff2b0197440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:41:59.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b4a91640 1 -- 172.21.15.70:0/2210382934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2b019c3f0 con 0x7ff2b0102ef0 2024-09-19T04:41:59.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2affff640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b0100e20 0x7ff2b0197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-09-19T04:41:59.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2b4a91640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0102ef0 0x7ff2b019bd10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009fd0 tx=0x7ff2a800ef10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:59.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.874+0000 7ff2adffb640 1 -- 172.21.15.70:0/2210382934 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a800ce20 con 0x7ff2b0102ef0 2024-09-19T04:41:59.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.875+0000 7ff2adffb640 1 -- 172.21.15.70:0/2210382934 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7ff2a8005020 con 0x7ff2b0102ef0 2024-09-19T04:41:59.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.875+0000 7ff2adffb640 1 -- 172.21.15.70:0/2210382934 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2a80106b0 con 0x7ff2b0102ef0 2024-09-19T04:41:59.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.875+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2b019c6e0 con 0x7ff2b0102ef0 2024-09-19T04:41:59.879 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.875+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2b01a3fc0 con 0x7ff2b0102ef0 2024-09-19T04:41:59.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.876+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff2b01021b0 con 0x7ff2b0102ef0 2024-09-19T04:41:59.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.877+0000 7ff2adffb640 1 -- 172.21.15.70:0/2210382934 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7ff2a80051d0 con 0x7ff2b0102ef0 2024-09-19T04:41:59.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.877+0000 7ff2adffb640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff29c0a3430 0x7ff29c0a58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:41:59.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.878+0000 7ff2affff640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff29c0a3430 0x7ff29c0a58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:41:59.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.878+0000 7ff2adffb640 1 -- 172.21.15.70:0/2210382934 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8741+0+0 (secure 0 0 0) 0x7ff2a80d04b0 con 0x7ff2b0102ef0 2024-09-19T04:41:59.880 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.878+0000 7ff2affff640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff29c0a3430 0x7ff29c0a58f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0031440 tx=0x7ff2a00058d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:41:59.883 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:41:59.882+0000 7ff2adffb640 1 -- 172.21.15.70:0/2210382934 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7ff2a809cdb0 con 0x7ff2b0102ef0 2024-09-19T04:42:00.085 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.083+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ff2b01090f0 con 0x7ff2b0102ef0 2024-09-19T04:42:00.444 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.442+0000 7ff2adffb640 1 -- 172.21.15.70:0/2210382934 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v37) ==== 104+0+0 (secure 0 0 0) 0x7ff2a809c6b0 con 0x7ff2b0102ef0 2024-09-19T04:42:00.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff29c0a3430 msgr2=0x7ff29c0a58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:00.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff29c0a3430 0x7ff29c0a58f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff2a0031440 tx=0x7ff2a00058d0 comp rx=0 tx=0).stop 2024-09-19T04:42:00.446 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0102ef0 msgr2=0x7ff2b019bd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0102ef0 0x7ff2b019bd10 secure :-1 s=READY pgs=1367 cs=0 l=1 rev1=1 crypto rx=0x7ff2a8009fd0 tx=0x7ff2a800ef10 comp rx=0 tx=0).stop 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 shutdown_connections 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7ff29c0a3430 0x7ff29c0a58f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7ff2b0102ef0 0x7ff2b019bd10 unknown :-1 s=CLOSED pgs=1367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7ff2b0102570 0x7ff2b0197980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 --2- 172.21.15.70:0/2210382934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff2b0100e20 0x7ff2b0197440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 >> 172.21.15.70:0/2210382934 conn(0x7ff2b00fc7d0 msgr2=0x7ff2b00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 shutdown_connections 2024-09-19T04:42:00.447 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:00.445+0000 7ff2b64f4640 1 -- 172.21.15.70:0/2210382934 wait complete. 2024-09-19T04:42:00.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:00 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2210382934' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:42:00.762 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:00 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2210382934' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:42:00.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:00 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2210382934' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-09-19T04:42:01.174 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-09-19T04:42:01.563 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:42:01.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:01 smithi070 ceph-mon[30942]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T04:42:01.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:01 smithi070 ceph-mon[30942]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T04:42:01.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:01 smithi070 ceph-mon[30942]: Cluster is now healthy 2024-09-19T04:42:01.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:01 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/2210382934' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:42:01.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:01 smithi070 ceph-mon[30942]: fsmap 12 up:standby 2024-09-19T04:42:01.690 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:01 smithi070 ceph-mon[30942]: pgmap v351: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T04:42:01.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:01 smithi167 ceph-mon[34339]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T04:42:01.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:01 smithi167 ceph-mon[34339]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T04:42:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:01 smithi167 ceph-mon[34339]: Cluster is now healthy 2024-09-19T04:42:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:01 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/2210382934' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:42:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:01 smithi167 ceph-mon[34339]: fsmap 12 up:standby 2024-09-19T04:42:01.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:01 smithi167 ceph-mon[34339]: pgmap v351: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T04:42:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:01 smithi134 ceph-mon[34525]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-09-19T04:42:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:01 smithi134 ceph-mon[34525]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-09-19T04:42:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:01 smithi134 ceph-mon[34525]: Cluster is now healthy 2024-09-19T04:42:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:01 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/2210382934' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-09-19T04:42:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:01 smithi134 ceph-mon[34525]: fsmap 12 up:standby 2024-09-19T04:42:01.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:01 smithi134 ceph-mon[34525]: pgmap v351: 97 pgs: 97 active+clean; 121 MiB data, 946 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-09-19T04:42:02.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 -- 172.21.15.70:0/1155068991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4101de0 msgr2=0x7f41d41021c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:02.042 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 --2- 172.21.15.70:0/1155068991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4101de0 0x7f41d41021c0 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f41c8009900 tx=0x7f41c802a410 comp rx=0 tx=0).stop 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 -- 172.21.15.70:0/1155068991 shutdown_connections 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 --2- 172.21.15.70:0/1155068991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41d4106f10 0x7f41d410ea90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 --2- 172.21.15.70:0/1155068991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d4102790 0x7f41d41067e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 --2- 172.21.15.70:0/1155068991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4101de0 0x7f41d41021c0 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 -- 172.21.15.70:0/1155068991 >> 172.21.15.70:0/1155068991 conn(0x7f41d40fd8c0 msgr2=0x7f41d40ffce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 -- 172.21.15.70:0/1155068991 shutdown_connections 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.024+0000 7f41daeff640 1 -- 172.21.15.70:0/1155068991 wait complete. 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41daeff640 1 Processor -- start 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41daeff640 1 -- start start 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41daeff640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41d4101de0 0x7f41d4198460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:02.043 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41daeff640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d4102790 0x7f41d41989a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41daeff640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4106f10 0x7f41d419cd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41daeff640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4111f40 con 0x7f41d4106f10 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41daeff640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7f41d4111dc0 con 0x7f41d4101de0 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41daeff640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7f41d41120c0 con 0x7f41d4102790 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4106f10 0x7f41d419cd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4106f10 0x7f41d419cd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:46340/0 (socket says 172.21.15.70:46340) 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 -- 172.21.15.70:0/341295991 learned_addr learned my addr 172.21.15.70:0/341295991 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d8c9b640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41d4101de0 0x7f41d4198460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d3fff640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d4102790 0x7f41d41989a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 -- 172.21.15.70:0/341295991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d4102790 msgr2=0x7f41d41989a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d4102790 0x7f41d41989a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 -- 172.21.15.70:0/341295991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41d4101de0 msgr2=0x7f41d4198460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:02.044 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41d4101de0 0x7f41d4198460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 -- 172.21.15.70:0/341295991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f41d419d410 con 0x7f41d4106f10 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.025+0000 7f41d949c640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4106f10 0x7f41d419cd30 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00eaa0 tx=0x7f41cc00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.026+0000 7f41d1ffb640 1 -- 172.21.15.70:0/341295991 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc00cdb0 con 0x7f41d4106f10 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.026+0000 7f41d1ffb640 1 -- 172.21.15.70:0/341295991 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7f41cc005020 con 0x7f41d4106f10 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.026+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f41d419d700 con 0x7f41d4106f10 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.026+0000 7f41d1ffb640 1 -- 172.21.15.70:0/341295991 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f41cc0116b0 con 0x7f41d4106f10 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.026+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f41d41a4fe0 con 0x7f41d4106f10 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.027+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f41d41021c0 con 0x7f41d4106f10 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.028+0000 7f41d1ffb640 1 -- 172.21.15.70:0/341295991 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7f41cc0051d0 con 0x7f41d4106f10 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.029+0000 7f41d1ffb640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41c40a33b0 0x7f41c40a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:02.045 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.029+0000 7f41d8c9b640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41c40a33b0 0x7f41c40a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:02.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.029+0000 7f41d1ffb640 1 -- 172.21.15.70:0/341295991 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(95..95 src has 1..95) ==== 8741+0+0 (secure 0 0 0) 0x7f41cc0d00e0 con 0x7f41d4106f10 2024-09-19T04:42:02.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.029+0000 7f41d8c9b640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41c40a33b0 0x7f41c40a5870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f41c8005ab0 tx=0x7f41c8005a20 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:42:02.046 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.033+0000 7f41d1ffb640 1 -- 172.21.15.70:0/341295991 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7f41cc016030 con 0x7f41d4106f10 2024-09-19T04:42:02.202 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.200+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7f41d4109b60 con 0x7f41d4106f10 2024-09-19T04:42:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.450+0000 7f41d1ffb640 1 -- 172.21.15.70:0/341295991 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v96) ==== 181+0+0 (secure 0 0 0) 0x7f41cc09c9e0 con 0x7f41d4106f10 2024-09-19T04:42:02.452 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_metadata' removed 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41c40a33b0 msgr2=0x7f41c40a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41c40a33b0 0x7f41c40a5870 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f41c8005ab0 tx=0x7f41c8005a20 comp rx=0 tx=0).stop 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4106f10 msgr2=0x7f41d419cd30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4106f10 0x7f41d419cd30 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f41cc00eaa0 tx=0x7f41cc00ef60 comp rx=0 tx=0).stop 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 shutdown_connections 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7f41c40a33b0 0x7f41c40a5870 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7f41d4106f10 0x7f41d419cd30 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7f41d4102790 0x7f41d41989a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 --2- 172.21.15.70:0/341295991 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41d4101de0 0x7f41d4198460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:02.455 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.453+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 >> 172.21.15.70:0/341295991 conn(0x7f41d40fd8c0 msgr2=0x7f41d40fec30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:02.456 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:02 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/341295991' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:42:02.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.454+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 shutdown_connections 2024-09-19T04:42:02.456 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:02.454+0000 7f41daeff640 1 -- 172.21.15.70:0/341295991 wait complete. 2024-09-19T04:42:02.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:02 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/341295991' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:42:02.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:02 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/341295991' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:42:03.235 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961 shell --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-09-19T04:42:03.483 INFO:teuthology.orchestra.run.smithi070.stderr:Inferring config /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/mon.a/config 2024-09-19T04:42:03.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:03 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/341295991' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:42:03.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:03 smithi167 ceph-mon[34339]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T04:42:03.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:03 smithi167 ceph-mon[34339]: pgmap v353: 65 pgs: 65 active+clean; 577 KiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:42:03.742 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:03 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/341295991' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:42:03.742 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:03 smithi070 ceph-mon[30942]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T04:42:03.742 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:03 smithi070 ceph-mon[30942]: pgmap v353: 65 pgs: 65 active+clean; 577 KiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:42:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:03 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/341295991' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:42:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:03 smithi134 ceph-mon[34525]: osdmap e96: 12 total, 12 up, 12 in 2024-09-19T04:42:03.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:03 smithi134 ceph-mon[34525]: pgmap v353: 65 pgs: 65 active+clean; 577 KiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:42:03.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 -- 172.21.15.70:0/4216120275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70106a80 msgr2=0x7fda70106e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:03.960 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 --2- 172.21.15.70:0/4216120275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70106a80 0x7fda70106e60 secure :-1 s=READY pgs=1370 cs=0 l=1 rev1=1 crypto rx=0x7fda6c009930 tx=0x7fda6c02a420 comp rx=0 tx=0).stop 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 -- 172.21.15.70:0/4216120275 shutdown_connections 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 --2- 172.21.15.70:0/4216120275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda70101420 0x7fda7010d950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 --2- 172.21.15.70:0/4216120275 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda70100a80 0x7fda70100ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 --2- 172.21.15.70:0/4216120275 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70106a80 0x7fda70106e60 unknown :-1 s=CLOSED pgs=1370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 -- 172.21.15.70:0/4216120275 >> 172.21.15.70:0/4216120275 conn(0x7fda700fc7a0 msgr2=0x7fda700febc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 -- 172.21.15.70:0/4216120275 shutdown_connections 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.958+0000 7fda7808e640 1 -- 172.21.15.70:0/4216120275 wait complete. 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7808e640 1 Processor -- start 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7808e640 1 -- start start 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7808e640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70100a80 0x7fda7019a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7808e640 1 --2- >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda70101420 0x7fda7019aad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7808e640 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda70106a80 0x7fda7019ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7808e640 1 -- --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_getmap magic: 0 -- 0x7fda70110e50 con 0x7fda70100a80 2024-09-19T04:42:03.961 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7808e640 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 -- 0x7fda70110cd0 con 0x7fda70106a80 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7808e640 1 -- --> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] -- mon_getmap magic: 0 -- 0x7fda70110fd0 con 0x7fda70101420 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75e2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70100a80 0x7fda7019a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75e2a640 1 --2- >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70100a80 0x7fda7019a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.70:3300/0 says I am v2:172.21.15.70:51944/0 (socket says 172.21.15.70:51944) 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75e2a640 1 -- 172.21.15.70:0/4103591007 learned_addr learned my addr 172.21.15.70:0/4103591007 (peer_addr_for_me v2:172.21.15.70:0/0) 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75629640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda70101420 0x7fda7019aad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7662b640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda70106a80 0x7fda7019ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75e2a640 1 -- 172.21.15.70:0/4103591007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda70101420 msgr2=0x7fda7019aad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75e2a640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda70101420 0x7fda7019aad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75e2a640 1 -- 172.21.15.70:0/4103591007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda70106a80 msgr2=0x7fda7019ee60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75e2a640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda70106a80 0x7fda7019ee60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda75e2a640 1 -- 172.21.15.70:0/4103591007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fda7019f540 con 0x7fda70100a80 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.959+0000 7fda7662b640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda70106a80 0x7fda7019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.960+0000 7fda75e2a640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70100a80 0x7fda7019a590 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fda6c005940 tx=0x7fda6c004380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:42:03.962 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.960+0000 7fda66ffd640 1 -- 172.21.15.70:0/4103591007 <== mon.0 v2:172.21.15.70:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c03f030 con 0x7fda70100a80 2024-09-19T04:42:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.960+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fda7019f7d0 con 0x7fda70100a80 2024-09-19T04:42:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.960+0000 7fda66ffd640 1 -- 172.21.15.70:0/4103591007 <== mon.0 v2:172.21.15.70:3300/0 2 ==== config(27 keys) ==== 1136+0+0 (secure 0 0 0) 0x7fda6c003ac0 con 0x7fda70100a80 2024-09-19T04:42:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.960+0000 7fda66ffd640 1 -- 172.21.15.70:0/4103591007 <== mon.0 v2:172.21.15.70:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda6c035070 con 0x7fda70100a80 2024-09-19T04:42:03.963 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.960+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fda701a7110 con 0x7fda70100a80 2024-09-19T04:42:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.961+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fda70100ee0 con 0x7fda70100a80 2024-09-19T04:42:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.962+0000 7fda66ffd640 1 -- 172.21.15.70:0/4103591007 <== mon.0 v2:172.21.15.70:3300/0 4 ==== mgrmap(e 25) ==== 138486+0+0 (secure 0 0 0) 0x7fda6c042030 con 0x7fda70100a80 2024-09-19T04:42:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.963+0000 7fda66ffd640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda5c0a33b0 0x7fda5c0a5870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T04:42:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.963+0000 7fda75629640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda5c0a33b0 0x7fda5c0a5870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T04:42:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.963+0000 7fda66ffd640 1 -- 172.21.15.70:0/4103591007 <== mon.0 v2:172.21.15.70:3300/0 5 ==== osd_map(96..96 src has 1..96) ==== 8245+0+0 (secure 0 0 0) 0x7fda6c0f0370 con 0x7fda70100a80 2024-09-19T04:42:03.964 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.963+0000 7fda75629640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda5c0a33b0 0x7fda5c0a5870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fda7006b7e0 tx=0x7fda6000a2d0 comp rx=0 tx=0).ready entity=mgr.15138 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T04:42:03.967 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:03.967+0000 7fda66ffd640 1 -- 172.21.15.70:0/4103591007 <== mon.0 v2:172.21.15.70:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+188913 (secure 0 0 0) 0x7fda6c0bce60 con 0x7fda70100a80 2024-09-19T04:42:04.132 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.132+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 --> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fda701a72e0 con 0x7fda70100a80 2024-09-19T04:42:04.463 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.461+0000 7fda66ffd640 1 -- 172.21.15.70:0/4103591007 <== mon.0 v2:172.21.15.70:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v97) ==== 169+0+0 (secure 0 0 0) 0x7fda6c0bc760 con 0x7fda70100a80 2024-09-19T04:42:04.463 INFO:teuthology.orchestra.run.smithi070.stderr:pool 'cephfs_data' removed 2024-09-19T04:42:04.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.464+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda5c0a33b0 msgr2=0x7fda5c0a5870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:04.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.464+0000 7fda7808e640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda5c0a33b0 0x7fda5c0a5870 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fda7006b7e0 tx=0x7fda6000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:42:04.466 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70100a80 msgr2=0x7fda7019a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70100a80 0x7fda7019a590 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7fda6c005940 tx=0x7fda6c004380 comp rx=0 tx=0).stop 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 shutdown_connections 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:6800/4033699978,v1:172.21.15.70:6801/4033699978] conn(0x7fda5c0a33b0 0x7fda5c0a5870 secure :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fda7006b7e0 tx=0x7fda6000a2d0 comp rx=0 tx=0).stop 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fda70106a80 0x7fda7019ee60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.167:3300/0,v1:172.21.15.167:6789/0] conn(0x7fda70101420 0x7fda7019aad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 --2- 172.21.15.70:0/4103591007 >> [v2:172.21.15.70:3300/0,v1:172.21.15.70:6789/0] conn(0x7fda70100a80 0x7fda7019a590 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 >> 172.21.15.70:0/4103591007 conn(0x7fda700fc7a0 msgr2=0x7fda7006a790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 shutdown_connections 2024-09-19T04:42:04.467 INFO:teuthology.orchestra.run.smithi070.stderr:2024-09-19T04:42:04.465+0000 7fda7808e640 1 -- 172.21.15.70:0/4103591007 wait complete. 2024-09-19T04:42:04.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:04 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4103591007' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:42:04.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:04 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4103591007' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:42:04.821 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:04 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4103591007' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-09-19T04:42:05.261 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:42:05.288 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:42:05.323 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:42:05.358 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-09-19T04:42:05.358 DEBUG:teuthology.orchestra.run.smithi070:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:42:05.374 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:42:05.392 DEBUG:teuthology.orchestra.run.smithi167:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-09-19T04:42:05.417 INFO:tasks.cephadm:Stopping all daemons... 2024-09-19T04:42:05.417 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-09-19T04:42:05.417 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a 2024-09-19T04:42:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:05 smithi070 systemd[1]: Stopping Ceph mon.a for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:05 smithi070 ceph-mon[30942]: from='client.? 172.21.15.70:0/4103591007' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:42:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:05 smithi070 ceph-mon[30942]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T04:42:05.645 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:05 smithi070 ceph-mon[30942]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:42:05.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:05 smithi167 ceph-mon[34339]: from='client.? 172.21.15.70:0/4103591007' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:42:05.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:05 smithi167 ceph-mon[34339]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T04:42:05.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:05 smithi167 ceph-mon[34339]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:42:05.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:05 smithi134 ceph-mon[34525]: from='client.? 172.21.15.70:0/4103591007' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-09-19T04:42:05.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:05 smithi134 ceph-mon[34525]: osdmap e97: 12 total, 12 up, 12 in 2024-09-19T04:42:05.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:05 smithi134 ceph-mon[34525]: pgmap v355: 1 pgs: 1 active+clean; 577 KiB data, 951 MiB used, 1.0 TiB / 1.0 TiB avail 2024-09-19T04:42:06.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a[30938]: 2024-09-19T04:42:05.740+0000 7f43fc8d6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:06.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a[30938]: 2024-09-19T04:42:05.740+0000 7f43fc8d6640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-09-19T04:42:06.145 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:05 smithi070 podman[111236]: 2024-09-19 04:42:05.915218014 +0000 UTC m=+0.309025684 container died c4cdef64a225b2de1f25cb52e99ad700b8c19f195ea17c5e25fc8ee51916ac5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2) 2024-09-19T04:42:06.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:06 smithi070 podman[111236]: 2024-09-19 04:42:06.341571998 +0000 UTC m=+0.735379709 container cleanup c4cdef64a225b2de1f25cb52e99ad700b8c19f195ea17c5e25fc8ee51916ac5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, ceph=True, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-09-19T04:42:06.551 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:06 smithi070 bash[111236]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a 2024-09-19T04:42:06.779 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a.service' 2024-09-19T04:42:06.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:06 smithi070 podman[111247]: 2024-09-19 04:42:06.534550444 +0000 UTC m=+0.616044438 container remove c4cdef64a225b2de1f25cb52e99ad700b8c19f195ea17c5e25fc8ee51916ac5b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-a, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T04:42:06.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:06 smithi070 systemd[1]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a.service: Deactivated successfully. 2024-09-19T04:42:06.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:06 smithi070 systemd[1]: Stopped Ceph mon.a for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:42:06.820 INFO:journalctl@ceph.mon.a.smithi070.stdout:Sep 19 04:42:06 smithi070 systemd[1]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.a.service: Consumed 19.026s CPU time. 2024-09-19T04:42:06.843 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:06.844 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-09-19T04:42:06.844 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-09-19T04:42:06.844 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.b 2024-09-19T04:42:07.146 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:06 smithi134 systemd[1]: Stopping Ceph mon.b for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:07.487 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-b[34521]: 2024-09-19T04:42:07.144+0000 7f5dbe6c8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:07.488 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-b[34521]: 2024-09-19T04:42:07.144+0000 7f5dbe6c8640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-09-19T04:42:07.488 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:07 smithi134 podman[69601]: 2024-09-19 04:42:07.216146804 +0000 UTC m=+0.178403707 container died 1db1e0a005e9c7f0d87bf757ed1d2e0a281b0896201dfdab4859cf2ee112f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T04:42:07.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:07 smithi134 podman[69601]: 2024-09-19 04:42:07.594955731 +0000 UTC m=+0.557212629 container cleanup 1db1e0a005e9c7f0d87bf757ed1d2e0a281b0896201dfdab4859cf2ee112f96f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-b, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T04:42:07.785 INFO:journalctl@ceph.mon.b.smithi134.stdout:Sep 19 04:42:07 smithi134 bash[69601]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-b 2024-09-19T04:42:08.021 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.b.service' 2024-09-19T04:42:08.068 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:08.068 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-09-19T04:42:08.068 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-09-19T04:42:08.068 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.c 2024-09-19T04:42:08.367 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:08 smithi167 systemd[1]: Stopping Ceph mon.c for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:08.710 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:08 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-c[34334]: 2024-09-19T04:42:08.365+0000 7fdd8e3ae640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:08.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:08 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-c[34334]: 2024-09-19T04:42:08.365+0000 7fdd8e3ae640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-09-19T04:42:08.711 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:08 smithi167 podman[70003]: 2024-09-19 04:42:08.570150419 +0000 UTC m=+0.307658039 container died a37b07fe580fd7f06ac50394c8868cdf5b0ea97188c7f19974b744bc34c99ce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-c, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T04:42:09.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:08 smithi167 podman[70003]: 2024-09-19 04:42:08.949763362 +0000 UTC m=+0.687270979 container cleanup a37b07fe580fd7f06ac50394c8868cdf5b0ea97188c7f19974b744bc34c99ce4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-c, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T04:42:09.210 INFO:journalctl@ceph.mon.c.smithi167.stdout:Sep 19 04:42:08 smithi167 bash[70003]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mon-c 2024-09-19T04:42:09.386 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mon.c.service' 2024-09-19T04:42:09.427 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:09.427 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-09-19T04:42:09.428 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-09-19T04:42:09.428 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.x 2024-09-19T04:42:09.885 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:42:09 smithi070 systemd[1]: Stopping Ceph mgr.x for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:10.145 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:42:09 smithi070 podman[111358]: 2024-09-19 04:42:09.885316606 +0000 UTC m=+0.261834284 container died 4ca48c3ce5fecbd995a754f9d8fb93ee21f313d74bd2bf1f26329c4aafb46e28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:42:10.862 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:42:10 smithi070 podman[111358]: 2024-09-19 04:42:10.418375867 +0000 UTC m=+0.794893586 container cleanup 4ca48c3ce5fecbd995a754f9d8fb93ee21f313d74bd2bf1f26329c4aafb46e28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2) 2024-09-19T04:42:10.862 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:42:10 smithi070 bash[111358]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x 2024-09-19T04:42:10.862 INFO:journalctl@ceph.mgr.x.smithi070.stdout:Sep 19 04:42:10 smithi070 podman[111370]: 2024-09-19 04:42:10.648359605 +0000 UTC m=+0.758484153 container remove 4ca48c3ce5fecbd995a754f9d8fb93ee21f313d74bd2bf1f26329c4aafb46e28 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:2f599a46ad10e37c929e5c43da2f6907ddcd1961, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-x, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True) 2024-09-19T04:42:10.878 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.x.service' 2024-09-19T04:42:10.913 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:10.913 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-09-19T04:42:10.914 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-09-19T04:42:10.914 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.y 2024-09-19T04:42:11.246 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:42:10 smithi134 systemd[1]: Stopping Ceph mgr.y for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:11.535 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:42:11 smithi134 podman[69723]: 2024-09-19 04:42:11.244902262 +0000 UTC m=+0.141132558 container died b89878a339b48c5ce6991bf4d11042237182ea62391526ce9bb4ebe5093d0335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T04:42:11.984 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:42:11 smithi134 podman[69723]: 2024-09-19 04:42:11.748921653 +0000 UTC m=+0.645151988 container cleanup b89878a339b48c5ce6991bf4d11042237182ea62391526ce9bb4ebe5093d0335 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux ) 2024-09-19T04:42:11.984 INFO:journalctl@ceph.mgr.y.smithi134.stdout:Sep 19 04:42:11 smithi134 bash[69723]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-y 2024-09-19T04:42:12.130 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.y.service' 2024-09-19T04:42:12.165 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:12.165 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-09-19T04:42:12.165 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-09-19T04:42:12.165 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.z 2024-09-19T04:42:12.460 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:42:12 smithi167 systemd[1]: Stopping Ceph mgr.z for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:12.772 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:42:12 smithi167 podman[70129]: 2024-09-19 04:42:12.493726977 +0000 UTC m=+0.138595951 container died 09e53086493760df2379fbb885da641e2226cbd71732e8a633d9fa797aa5ae02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T04:42:13.106 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:42:12 smithi167 podman[70129]: 2024-09-19 04:42:12.862327601 +0000 UTC m=+0.507196578 container cleanup 09e53086493760df2379fbb885da641e2226cbd71732e8a633d9fa797aa5ae02 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4) 2024-09-19T04:42:13.106 INFO:journalctl@ceph.mgr.z.smithi167.stdout:Sep 19 04:42:12 smithi167 bash[70129]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mgr-z 2024-09-19T04:42:13.243 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mgr.z.service' 2024-09-19T04:42:13.277 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:13.277 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-09-19T04:42:13.277 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-09-19T04:42:13.277 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.0 2024-09-19T04:42:13.585 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:13 smithi070 systemd[1]: Stopping Ceph osd.0 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:13.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0[41985]: 2024-09-19T04:42:13.583+0000 7f1f57cee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:13.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0[41985]: 2024-09-19T04:42:13.583+0000 7f1f57cee640 -1 osd.0 97 *** Got signal Terminated *** 2024-09-19T04:42:13.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0[41985]: 2024-09-19T04:42:13.583+0000 7f1f57cee640 -1 osd.0 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:42:19.211 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:18 smithi070 podman[111480]: 2024-09-19 04:42:18.922041023 +0000 UTC m=+5.457135874 container died fe2bbc7e629972ff931e9b49ef4ee2e85f9d079bb28c0f321aa72a94c40be4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:42:19.644 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:19 smithi070 podman[111480]: 2024-09-19 04:42:19.375922318 +0000 UTC m=+5.911017218 container cleanup fe2bbc7e629972ff931e9b49ef4ee2e85f9d079bb28c0f321aa72a94c40be4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:42:19.645 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:19 smithi070 bash[111480]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0 2024-09-19T04:42:19.895 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:19 smithi070 podman[111495]: 2024-09-19 04:42:19.644091626 +0000 UTC m=+0.725309522 container remove fe2bbc7e629972ff931e9b49ef4ee2e85f9d079bb28c0f321aa72a94c40be4c7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T04:42:20.239 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:19 smithi070 podman[111583]: 2024-09-19 04:42:19.854802021 +0000 UTC m=+0.015990314 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:42:20.239 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:19 smithi070 podman[111583]: 2024-09-19 04:42:19.961472851 +0000 UTC m=+0.122661131 container create 36cdbae0e172175dffcc05cfa113e0095388391ee184a49f980b1dcbb1f1bbf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4) 2024-09-19T04:42:20.645 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:20 smithi070 podman[111583]: 2024-09-19 04:42:20.238843477 +0000 UTC m=+0.400031755 container init 36cdbae0e172175dffcc05cfa113e0095388391ee184a49f980b1dcbb1f1bbf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T04:42:20.645 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:20 smithi070 podman[111583]: 2024-09-19 04:42:20.242101621 +0000 UTC m=+0.403289909 container start 36cdbae0e172175dffcc05cfa113e0095388391ee184a49f980b1dcbb1f1bbf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0-deactivate, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-09-19T04:42:20.645 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:20 smithi070 podman[111583]: 2024-09-19 04:42:20.330826362 +0000 UTC m=+0.492014647 container attach 36cdbae0e172175dffcc05cfa113e0095388391ee184a49f980b1dcbb1f1bbf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T04:42:20.645 INFO:journalctl@ceph.osd.0.smithi070.stdout:Sep 19 04:42:20 smithi070 podman[111583]: 2024-09-19 04:42:20.427287731 +0000 UTC m=+0.588476026 container died 36cdbae0e172175dffcc05cfa113e0095388391ee184a49f980b1dcbb1f1bbf2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T04:42:21.096 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.0.service' 2024-09-19T04:42:21.136 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:21.137 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-09-19T04:42:21.137 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-09-19T04:42:21.137 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.1 2024-09-19T04:42:21.429 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:21 smithi134 systemd[1]: Stopping Ceph osd.1 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:21.785 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1[38969]: 2024-09-19T04:42:21.427+0000 7fceb4efa640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:21.785 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1[38969]: 2024-09-19T04:42:21.427+0000 7fceb4efa640 -1 osd.1 97 *** Got signal Terminated *** 2024-09-19T04:42:21.785 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1[38969]: 2024-09-19T04:42:21.427+0000 7fceb4efa640 -1 osd.1 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:42:27.222 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:26 smithi134 podman[69848]: 2024-09-19 04:42:26.922374593 +0000 UTC m=+5.589857615 container died 6e78dfd1ade4b641eccece49f7ea6d7e43fff4d590952dab5243679c587ef89e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1, io.buildah.version=1.37.2, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0) 2024-09-19T04:42:27.535 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:27 smithi134 podman[69848]: 2024-09-19 04:42:27.302516585 +0000 UTC m=+5.969999613 container cleanup 6e78dfd1ade4b641eccece49f7ea6d7e43fff4d590952dab5243679c587ef89e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:42:27.535 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:27 smithi134 bash[69848]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1 2024-09-19T04:42:27.922 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:27 smithi134 podman[69864]: 2024-09-19 04:42:27.595408074 +0000 UTC m=+0.666587057 container remove 6e78dfd1ade4b641eccece49f7ea6d7e43fff4d590952dab5243679c587ef89e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4) 2024-09-19T04:42:28.241 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:27 smithi134 podman[69954]: 2024-09-19 04:42:27.92125069 +0000 UTC m=+0.112680611 container create 49f9f62a354fd32ebee5cd085b5abbdc085e921338d99e48b66debabf2188786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1-deactivate, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:42:28.241 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:27 smithi134 podman[69954]: 2024-09-19 04:42:27.824347686 +0000 UTC m=+0.015777584 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:42:28.241 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:28 smithi134 podman[69954]: 2024-09-19 04:42:28.132172161 +0000 UTC m=+0.323602045 container init 49f9f62a354fd32ebee5cd085b5abbdc085e921338d99e48b66debabf2188786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=) 2024-09-19T04:42:28.241 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:28 smithi134 podman[69954]: 2024-09-19 04:42:28.136398431 +0000 UTC m=+0.327828307 container start 49f9f62a354fd32ebee5cd085b5abbdc085e921338d99e48b66debabf2188786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux ) 2024-09-19T04:42:28.242 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:28 smithi134 podman[69954]: 2024-09-19 04:42:28.240569392 +0000 UTC m=+0.431999280 container attach 49f9f62a354fd32ebee5cd085b5abbdc085e921338d99e48b66debabf2188786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD) 2024-09-19T04:42:28.535 INFO:journalctl@ceph.osd.1.smithi134.stdout:Sep 19 04:42:28 smithi134 podman[69954]: 2024-09-19 04:42:28.333211063 +0000 UTC m=+0.524640946 container died 49f9f62a354fd32ebee5cd085b5abbdc085e921338d99e48b66debabf2188786 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-1-deactivate, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:42:28.915 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.1.service' 2024-09-19T04:42:28.954 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:28.954 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-09-19T04:42:28.954 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-09-19T04:42:28.955 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.2 2024-09-19T04:42:29.259 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:29 smithi167 systemd[1]: Stopping Ceph osd.2 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:29.516 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2[39317]: 2024-09-19T04:42:29.256+0000 7f317f2b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:29.517 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2[39317]: 2024-09-19T04:42:29.256+0000 7f317f2b5640 -1 osd.2 97 *** Got signal Terminated *** 2024-09-19T04:42:29.517 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2[39317]: 2024-09-19T04:42:29.256+0000 7f317f2b5640 -1 osd.2 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:42:35.077 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:34 smithi167 podman[70253]: 2024-09-19 04:42:34.802376357 +0000 UTC m=+5.651706318 container died 34c5acfb9336fbc6c8c84c0fed08bc4f9c043c53b88443a69dad57a11e66b5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T04:42:35.451 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:35 smithi167 podman[70253]: 2024-09-19 04:42:35.174619549 +0000 UTC m=+6.023949518 container cleanup 34c5acfb9336fbc6c8c84c0fed08bc4f9c043c53b88443a69dad57a11e66b5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T04:42:35.451 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:35 smithi167 bash[70253]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2 2024-09-19T04:42:35.710 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:35 smithi167 podman[70280]: 2024-09-19 04:42:35.450942796 +0000 UTC m=+0.642381218 container remove 34c5acfb9336fbc6c8c84c0fed08bc4f9c043c53b88443a69dad57a11e66b5d1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, RELEASE=squid-2f599a4, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T04:42:36.080 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:35 smithi167 podman[70367]: 2024-09-19 04:42:35.690851537 +0000 UTC m=+0.015974516 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:42:36.080 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:35 smithi167 podman[70367]: 2024-09-19 04:42:35.793571566 +0000 UTC m=+0.118694578 container create a08ec09f6d093f53b0e5d77342ae615ff5ac60074b9ae80dd479bd4d77157d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-09-19T04:42:36.080 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:36 smithi167 podman[70367]: 2024-09-19 04:42:36.00441091 +0000 UTC m=+0.329533880 container init a08ec09f6d093f53b0e5d77342ae615ff5ac60074b9ae80dd479bd4d77157d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:42:36.080 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:36 smithi167 podman[70367]: 2024-09-19 04:42:36.007594426 +0000 UTC m=+0.332717402 container start a08ec09f6d093f53b0e5d77342ae615ff5ac60074b9ae80dd479bd4d77157d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T04:42:36.081 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:36 smithi167 podman[70367]: 2024-09-19 04:42:36.07932076 +0000 UTC m=+0.404443731 container attach a08ec09f6d093f53b0e5d77342ae615ff5ac60074b9ae80dd479bd4d77157d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T04:42:36.460 INFO:journalctl@ceph.osd.2.smithi167.stdout:Sep 19 04:42:36 smithi167 podman[70367]: 2024-09-19 04:42:36.197579593 +0000 UTC m=+0.522702576 container died a08ec09f6d093f53b0e5d77342ae615ff5ac60074b9ae80dd479bd4d77157d83 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-2-deactivate, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T04:42:36.823 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.2.service' 2024-09-19T04:42:36.863 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:36.863 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-09-19T04:42:36.863 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-09-19T04:42:36.863 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.3 2024-09-19T04:42:37.145 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:36 smithi070 systemd[1]: Stopping Ceph osd.3 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:37.645 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:37 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3[48477]: 2024-09-19T04:42:37.184+0000 7f1d28ceb640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:37.645 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:37 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3[48477]: 2024-09-19T04:42:37.184+0000 7f1d28ceb640 -1 osd.3 97 *** Got signal Terminated *** 2024-09-19T04:42:37.645 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:37 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3[48477]: 2024-09-19T04:42:37.184+0000 7f1d28ceb640 -1 osd.3 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:42:39.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:39 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:39.659+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:40.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:40.635+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:41.395 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:40 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3[48477]: 2024-09-19T04:42:40.951+0000 7f1d212e8640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:16.944916+0000 front 2024-09-19T04:42:16.944826+0000 (oldest deadline 2024-09-19T04:42:40.444894+0000) 2024-09-19T04:42:41.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:41 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:41.329+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:41.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:41.626+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:42.395 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:41 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3[48477]: 2024-09-19T04:42:41.940+0000 7f1d212e8640 -1 osd.3 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:16.944916+0000 front 2024-09-19T04:42:16.944826+0000 (oldest deadline 2024-09-19T04:42:40.444894+0000) 2024-09-19T04:42:42.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:42 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:42.328+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:42.895 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:42 smithi070 podman[111691]: 2024-09-19 04:42:42.639699103 +0000 UTC m=+5.572465985 container died 678b585f6242722ba9847233a121572732d0cf06b5513519e7506ed566ce7b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-09-19T04:42:42.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:42 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:42.689+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:42.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:42.640+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:43.362 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:43 smithi070 podman[111691]: 2024-09-19 04:42:43.1182019 +0000 UTC m=+6.050968815 container cleanup 678b585f6242722ba9847233a121572732d0cf06b5513519e7506ed566ce7b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:42:43.362 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:43 smithi070 bash[111691]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3 2024-09-19T04:42:43.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:42.996+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:43.645 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:43 smithi070 podman[111709]: 2024-09-19 04:42:43.361179485 +0000 UTC m=+0.721945007 container remove 678b585f6242722ba9847233a121572732d0cf06b5513519e7506ed566ce7b09 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, RELEASE=squid-2f599a4) 2024-09-19T04:42:43.645 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:43 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:43.539+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:43.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:43 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:43.291+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:43.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:43.638+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:43.981 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:43 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:43.699+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:43.981 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:43 smithi070 podman[111795]: 2024-09-19 04:42:43.581512566 +0000 UTC m=+0.015842021 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:42:43.982 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:43 smithi070 podman[111795]: 2024-09-19 04:42:43.695142746 +0000 UTC m=+0.129472187 container create d87395c6c6b3082a68ecea620e5d80436ac183b69a489c756e6750c972c4a08e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-09-19T04:42:44.395 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:43 smithi070 podman[111795]: 2024-09-19 04:42:43.981147162 +0000 UTC m=+0.415476613 container init d87395c6c6b3082a68ecea620e5d80436ac183b69a489c756e6750c972c4a08e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-09-19T04:42:44.395 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:43 smithi070 podman[111795]: 2024-09-19 04:42:43.984497845 +0000 UTC m=+0.418827287 container start d87395c6c6b3082a68ecea620e5d80436ac183b69a489c756e6750c972c4a08e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3-deactivate, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-09-19T04:42:44.395 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:44 smithi070 podman[111795]: 2024-09-19 04:42:44.056127439 +0000 UTC m=+0.490456899 container attach d87395c6c6b3082a68ecea620e5d80436ac183b69a489c756e6750c972c4a08e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4) 2024-09-19T04:42:44.396 INFO:journalctl@ceph.osd.3.smithi070.stdout:Sep 19 04:42:44 smithi070 podman[111795]: 2024-09-19 04:42:44.173376882 +0000 UTC m=+0.607706328 container died d87395c6c6b3082a68ecea620e5d80436ac183b69a489c756e6750c972c4a08e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-3-deactivate, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T04:42:44.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:44.012+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:44.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:44 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:44.261+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:44.715 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:44 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:44.582+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:44.824 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.3.service' 2024-09-19T04:42:44.861 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:44.861 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-09-19T04:42:44.861 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-09-19T04:42:44.861 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.4 2024-09-19T04:42:44.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:44.610+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:45.145 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:44 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:44.714+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:45.155 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:44 smithi134 systemd[1]: Stopping Ceph osd.4 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:45.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:44.985+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:45.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:45.293+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:45.535 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:42:45.154+0000 7f79c3c44640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:45.535 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:42:45.154+0000 7f79c3c44640 -1 osd.4 97 *** Got signal Terminated *** 2024-09-19T04:42:45.535 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:45 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:42:45.154+0000 7f79c3c44640 -1 osd.4 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:42:45.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:45.673+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:45.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:45 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:45.632+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:45.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:45.604+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:46.271 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:46 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:46.017+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:46.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:46 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:46.254+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:46.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:46.631+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:46.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:46 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:46.627+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:46.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:46 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:46.642+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:47.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:47 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:47.057+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:47.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:47 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:47.295+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:47.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:47.661+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:47.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:47 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:47.611+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:47.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:47 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:47.607+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:48.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:48 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:48.027+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:48.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:48 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:48.027+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:48.535 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:48 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:42:48.138+0000 7f79bc241640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.481116+0000 front 2024-09-19T04:42:25.481147+0000 (oldest deadline 2024-09-19T04:42:47.781238+0000) 2024-09-19T04:42:48.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:48 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:48.297+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:48.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:48 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:48.297+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:48.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:48.628+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:48.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:48.651+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:48.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:48 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:48.647+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:49.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:48 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:48.982+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:49.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:48 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:48.982+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:49.535 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:49 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:42:49.104+0000 7f79bc241640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.481116+0000 front 2024-09-19T04:42:25.481147+0000 (oldest deadline 2024-09-19T04:42:47.781238+0000) 2024-09-19T04:42:49.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:49 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:49.301+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:49.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:49 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:49.301+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:49.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:49 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:49.579+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:49.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:49 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:49.678+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:49.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:49 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:49.678+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:49.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:49 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:49.621+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:50.460 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:50 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:50.028+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:50.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:49 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:49.965+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:50.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:49 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:49.965+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:50.535 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:50 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4[45863]: 2024-09-19T04:42:50.115+0000 7f79bc241640 -1 osd.4 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.481116+0000 front 2024-09-19T04:42:25.481147+0000 (oldest deadline 2024-09-19T04:42:47.781238+0000) 2024-09-19T04:42:50.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:50 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:50.283+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:50.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:50 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:50.283+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:50.848 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:50 smithi134 podman[70072]: 2024-09-19 04:42:50.545436706 +0000 UTC m=+5.491114910 container died c0ce70173febc42b1c8fdb20a2575bc598698e37569288e02bc737903c5dcc24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-09-19T04:42:50.894 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:50.600+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:50.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:50.629+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:50.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:50 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:50.629+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:50.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:50 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:50.596+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:50.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:50 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:50.596+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.249711+0000 front 2024-09-19T04:42:24.249664+0000 (oldest deadline 2024-09-19T04:42:50.149391+0000) 2024-09-19T04:42:51.173 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:50 smithi134 podman[70072]: 2024-09-19 04:42:50.946089443 +0000 UTC m=+5.891767655 container cleanup c0ce70173febc42b1c8fdb20a2575bc598698e37569288e02bc737903c5dcc24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-09-19T04:42:51.173 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:50 smithi134 bash[70072]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4 2024-09-19T04:42:51.460 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:51 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:51.072+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:51.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:51 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:51.000+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:51.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:51 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:51.000+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:51.474 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:51 smithi134 podman[70088]: 2024-09-19 04:42:51.172333154 +0000 UTC m=+0.616433632 container remove c0ce70173febc42b1c8fdb20a2575bc598698e37569288e02bc737903c5dcc24 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T04:42:51.474 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:51 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:51.284+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:51.474 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:51 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:51.284+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:51.729 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:51 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:51.472+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:51.730 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:51 smithi134 podman[70176]: 2024-09-19 04:42:51.513759682 +0000 UTC m=+0.015974591 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:42:51.730 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:51 smithi134 podman[70176]: 2024-09-19 04:42:51.623240096 +0000 UTC m=+0.125455050 container create c7ec0814d950949fa3a4194aa90604057dd6be02d5f31aa44aa933f8b3dbe78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T04:42:51.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:51.563+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:51.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:51.674+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:51.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:51.674+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:51.961 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:51 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:51.587+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:51.961 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:51 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:51.587+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.249711+0000 front 2024-09-19T04:42:24.249664+0000 (oldest deadline 2024-09-19T04:42:50.149391+0000) 2024-09-19T04:42:52.035 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:51 smithi134 podman[70176]: 2024-09-19 04:42:51.858944124 +0000 UTC m=+0.361159034 container init c7ec0814d950949fa3a4194aa90604057dd6be02d5f31aa44aa933f8b3dbe78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux ) 2024-09-19T04:42:52.035 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:51 smithi134 podman[70176]: 2024-09-19 04:42:51.862551505 +0000 UTC m=+0.364766415 container start c7ec0814d950949fa3a4194aa90604057dd6be02d5f31aa44aa933f8b3dbe78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-09-19T04:42:52.035 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:51 smithi134 podman[70176]: 2024-09-19 04:42:51.933711674 +0000 UTC m=+0.435926600 container attach c7ec0814d950949fa3a4194aa90604057dd6be02d5f31aa44aa933f8b3dbe78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:42:52.313 INFO:journalctl@ceph.osd.4.smithi134.stdout:Sep 19 04:42:52 smithi134 podman[70176]: 2024-09-19 04:42:52.055308125 +0000 UTC m=+0.557523035 container died c7ec0814d950949fa3a4194aa90604057dd6be02d5f31aa44aa933f8b3dbe78e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-4-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731) 2024-09-19T04:42:52.460 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:52 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:52.092+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:52.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:52 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:52.037+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:52.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:52 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:52.037+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:52.621 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:52 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:52.428+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:52.621 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:52 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:52.312+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:52.621 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:52 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:52.312+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:52.642 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.4.service' 2024-09-19T04:42:52.714 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:42:52.714 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-09-19T04:42:52.715 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-09-19T04:42:52.715 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.5 2024-09-19T04:42:52.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:52 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:52.674+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:52.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:52 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:52.674+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:52.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:52 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:52.568+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:52.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:52 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:52.568+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:42:52.961 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:52 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:52.579+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:52.961 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:52 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:52.579+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.249711+0000 front 2024-09-19T04:42:24.249664+0000 (oldest deadline 2024-09-19T04:42:50.149391+0000) 2024-09-19T04:42:52.961 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:52 smithi167 systemd[1]: Stopping Ceph osd.5 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:42:53.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:53 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:53.101+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:53.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:53 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:53.077+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:53.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:53 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:53.077+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:53.461 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:53 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:53.018+0000 7fedaba3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:42:53.461 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:53 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:53.018+0000 7fedaba3f640 -1 osd.5 97 *** Got signal Terminated *** 2024-09-19T04:42:53.461 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:53 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:53.018+0000 7fedaba3f640 -1 osd.5 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:42:53.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:53 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:53.476+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:53.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:53 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:53.291+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:53.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:53 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:53.291+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:53.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:53.520+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:53.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:53.520+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:42:53.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:53.686+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:53.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:53 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:53.686+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:53.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:53 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:53.617+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:53.961 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:53 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:53.617+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.249711+0000 front 2024-09-19T04:42:24.249664+0000 (oldest deadline 2024-09-19T04:42:50.149391+0000) 2024-09-19T04:42:54.460 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:54 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:54.064+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:54.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:54 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:54.084+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:54.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:54 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:54.084+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:54.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:54 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:54.428+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:54.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:54 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:54.258+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:54.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:54 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:54.258+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:54.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:54.676+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:54.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:54.676+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:54.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:54.474+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:54.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:54 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:54.474+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:42:54.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:54 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:54.665+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:54.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:54 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:54.665+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.249711+0000 front 2024-09-19T04:42:24.249664+0000 (oldest deadline 2024-09-19T04:42:50.149391+0000) 2024-09-19T04:42:55.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:55 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:55.045+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:55.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:55 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:55.048+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:55.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:55 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:55.048+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:55.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:55 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:55.409+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:55.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:55 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:55.409+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:42:55.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:55 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:55.296+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:55.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:55 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:55.296+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:55.786 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:55 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:55.296+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:42:55.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:55 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:55.498+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:55.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:55 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:55.498+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:42:55.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:55 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:55.708+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:55.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:55 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:55.708+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:55.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:55 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:55.708+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:42:55.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:55 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:55.695+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:55.961 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:55 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:55.695+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.249711+0000 front 2024-09-19T04:42:24.249664+0000 (oldest deadline 2024-09-19T04:42:50.149391+0000) 2024-09-19T04:42:56.460 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:56.029+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:56.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:56.029+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:42:56.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:56.088+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:56.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:56.088+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:56.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:56 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:56.367+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:56.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:56 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:56.367+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:42:56.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:56 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:56.250+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:56.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:56 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:56.250+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:56.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:56 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:56.250+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:42:56.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:56.511+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:56.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:56.511+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:42:56.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:56.703+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:56.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:56.703+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:56.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:56.703+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:42:56.988 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:56.734+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:56.988 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:56.734+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.249711+0000 front 2024-09-19T04:42:24.249664+0000 (oldest deadline 2024-09-19T04:42:50.149391+0000) 2024-09-19T04:42:57.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:57 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:57.051+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:57.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:57 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:57.051+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:57.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:56.987+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:57.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:56 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:56.987+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:42:57.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:57 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:57.361+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:57.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:57 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:57.361+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:42:57.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:57 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:57.202+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:57.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:57 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:57.202+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:57.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:57 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:57.202+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:42:57.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:57 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:57.515+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:57.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:57 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:57.515+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:42:57.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:57 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:57.680+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:57.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:57 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:57.680+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:57.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:57 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:57.680+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:42:58.210 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:57 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:57.780+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:14.248471+0000 front 2024-09-19T04:42:14.248661+0000 (oldest deadline 2024-09-19T04:42:38.948594+0000) 2024-09-19T04:42:58.211 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:57 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5[45945]: 2024-09-19T04:42:57.780+0000 7feda8044640 -1 osd.5 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.249711+0000 front 2024-09-19T04:42:24.249664+0000 (oldest deadline 2024-09-19T04:42:50.149391+0000) 2024-09-19T04:42:58.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:57 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:57.938+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:58.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:57 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:57.938+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:42:58.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:58.015+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:58.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:58.015+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:58.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:58.015+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:42:58.436 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:58.356+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:58.437 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:58.356+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:42:58.437 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:58.168+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:58.437 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:58.168+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:58.437 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:58 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:58.168+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:42:58.687 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:58 smithi167 podman[70470]: 2024-09-19 04:42:58.404204772 +0000 UTC m=+5.489043274 container died 1558ee63bfa51e898ab46f5f2869992eb114c0a6adce1ac9b64bbaf256c6dda5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T04:42:58.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:58 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:58.561+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:58.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:58 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:58.561+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:42:58.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:58 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:58.561+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.502381+0000 front 2024-09-19T04:42:32.502337+0000 (oldest deadline 2024-09-19T04:42:58.402421+0000) 2024-09-19T04:42:58.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:58 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:58.646+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:58.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:58 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:58.646+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:58.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:58 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:58.646+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:42:58.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:58 smithi167 podman[70470]: 2024-09-19 04:42:58.776950118 +0000 UTC m=+5.861788619 container cleanup 1558ee63bfa51e898ab46f5f2869992eb114c0a6adce1ac9b64bbaf256c6dda5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:42:58.960 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:58 smithi167 bash[70470]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5 2024-09-19T04:42:59.388 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:59 smithi167 podman[70487]: 2024-09-19 04:42:59.053276853 +0000 UTC m=+0.637813473 container remove 1558ee63bfa51e898ab46f5f2869992eb114c0a6adce1ac9b64bbaf256c6dda5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, ceph=True) 2024-09-19T04:42:59.388 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:58.967+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:42:59.388 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:58 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:58.967+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:42:59.388 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:59 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:59.039+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:42:59.389 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:59 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:59.039+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:42:59.389 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:42:59 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:42:59.039+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:42:59.452 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:59 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:59.376+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:42:59.452 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:42:59 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:42:59.376+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:42:59.453 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:59 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:59.138+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:42:59.453 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:59 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:59.138+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:42:59.453 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:42:59 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:42:59.138+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:42:59.648 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:59 smithi167 podman[70575]: 2024-09-19 04:42:59.289987175 +0000 UTC m=+0.015609285 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:42:59.648 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:59 smithi167 podman[70575]: 2024-09-19 04:42:59.423148244 +0000 UTC m=+0.148770355 container create 3e21784142408c9aa01e0fae69ac7e9783a2f30273ecdb5d003aeda977eb00c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5-deactivate, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:42:59.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:59.542+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:42:59.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:59.542+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:42:59.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:42:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:42:59.542+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.502381+0000 front 2024-09-19T04:42:32.502337+0000 (oldest deadline 2024-09-19T04:42:58.402421+0000) 2024-09-19T04:42:59.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:59.682+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:42:59.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:59.682+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:42:59.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:42:59 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:42:59.682+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:42:59.941 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:59 smithi167 podman[70575]: 2024-09-19 04:42:59.648018125 +0000 UTC m=+0.373640235 container init 3e21784142408c9aa01e0fae69ac7e9783a2f30273ecdb5d003aeda977eb00c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-09-19T04:42:59.941 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:59 smithi167 podman[70575]: 2024-09-19 04:42:59.651451974 +0000 UTC m=+0.377074085 container start 3e21784142408c9aa01e0fae69ac7e9783a2f30273ecdb5d003aeda977eb00c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T04:42:59.941 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:59 smithi167 podman[70575]: 2024-09-19 04:42:59.748151525 +0000 UTC m=+0.473773637 container attach 3e21784142408c9aa01e0fae69ac7e9783a2f30273ecdb5d003aeda977eb00c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS) 2024-09-19T04:42:59.941 INFO:journalctl@ceph.osd.5.smithi167.stdout:Sep 19 04:42:59 smithi167 podman[70575]: 2024-09-19 04:42:59.837564933 +0000 UTC m=+0.563187052 container died 3e21784142408c9aa01e0fae69ac7e9783a2f30273ecdb5d003aeda977eb00c8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-5-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-09-19T04:43:00.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:59 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:59.940+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:00.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:42:59 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:42:59.940+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:00.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:00 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:00.085+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:00.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:00 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:00.085+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:00.212 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:00 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:00.085+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:00.477 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.5.service' 2024-09-19T04:43:00.518 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:00.518 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-09-19T04:43:00.518 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-09-19T04:43:00.518 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.6 2024-09-19T04:43:00.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:00 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:00.380+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:00.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:00 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:00.380+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:00.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:00 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:00.179+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:00.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:00 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:00.179+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:00.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:00 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:00.179+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:00.828 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:00.666+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:00.828 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:00.666+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:00.828 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:00.666+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:00.828 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:00.506+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:43:00.829 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:00.506+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:43:00.829 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:00.506+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.502381+0000 front 2024-09-19T04:42:32.502337+0000 (oldest deadline 2024-09-19T04:42:58.402421+0000) 2024-09-19T04:43:00.829 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:00 smithi070 systemd[1]: Stopping Ceph osd.6 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:00.829 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:00.826+0000 7f8dce62e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:00.829 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:00.826+0000 7f8dce62e640 -1 osd.6 97 *** Got signal Terminated *** 2024-09-19T04:43:00.829 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:00.826+0000 7f8dce62e640 -1 osd.6 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:43:01.064 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:00 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:00.892+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:01.064 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:00 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:00.892+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:01.064 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:01 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:01.062+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:01.064 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:01 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:01.062+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:01.064 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:01 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:01.062+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:01.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:01 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:01.421+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:01.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:01 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:01.421+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:01.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:01 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:01.216+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:01.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:01 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:01.216+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:01.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:01 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:01.216+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:01.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:01 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:01.536+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:43:01.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:01 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:01.536+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:43:01.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:01 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:01.536+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.502381+0000 front 2024-09-19T04:42:32.502337+0000 (oldest deadline 2024-09-19T04:42:58.402421+0000) 2024-09-19T04:43:01.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:01 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:01.626+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:01.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:01 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:01.626+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:01.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:01 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:01.626+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:01.960 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:01 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:01.884+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:01.960 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:01 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:01.884+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:02.452 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:02 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:02.187+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:02.453 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:02 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:02.187+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:02.453 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:02 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:02.187+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:02.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:02 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:02.088+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:02.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:02 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:02.088+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:02.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:02 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:02.088+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:02.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:02 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:02.451+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:02.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:02 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:02.451+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:02.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:02 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:02.586+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:43:02.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:02 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:02.586+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:43:02.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:02 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:02.586+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.502381+0000 front 2024-09-19T04:42:32.502337+0000 (oldest deadline 2024-09-19T04:42:58.402421+0000) 2024-09-19T04:43:02.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:02 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:02.613+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:02.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:02 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:02.613+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:02.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:02 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:02.613+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:03.210 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:02 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:02.862+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:03.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:02 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:02.862+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:03.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:03 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:03.088+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:03.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:03 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:03.088+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:03.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:03 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:03.088+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:03.478 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:03 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:03.181+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:03.478 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:03 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:03.181+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:03.478 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:03 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:03.181+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:03.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:03 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:03.477+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:03.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:03 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:03.477+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:03.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:03 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:03.477+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:03.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:03 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:03.621+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:43:03.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:03 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:03.621+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:43:03.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:03 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:03.621+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.502381+0000 front 2024-09-19T04:42:32.502337+0000 (oldest deadline 2024-09-19T04:42:58.402421+0000) 2024-09-19T04:43:03.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:03 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:03.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:03.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:03 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:03.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:03.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:03 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:03.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:04.122 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:03 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:03.812+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:04.122 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:03 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:03.812+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:04.122 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:03 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:03.812+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:04.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:04 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:04.120+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:04.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:04 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:04.120+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:04.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:04 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:04.120+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:04.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:04 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:04.464+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:04.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:04 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:04.464+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:04.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:04 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:04.464+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:04.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:04 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:04.222+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:04.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:04 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:04.222+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:04.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:04 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:04.222+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:04.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:04 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:04.633+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:43:04.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:04 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:04.633+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:43:04.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:04 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:04.633+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.502381+0000 front 2024-09-19T04:42:32.502337+0000 (oldest deadline 2024-09-19T04:42:58.402421+0000) 2024-09-19T04:43:04.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:04 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:04.592+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:04.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:04 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:04.592+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:04.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:04 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:04.592+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:04.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:04 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:04.592+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:05.106 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:04 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:04.812+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:05.106 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:04 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:04.812+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:05.106 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:04 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:04.812+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:05.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:05 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:05.104+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:05.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:05 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:05.104+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:05.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:05 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:05.104+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:05.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:05.488+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:05.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:05.488+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:05.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:05.488+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:05.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:05.240+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:05.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:05.240+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:05.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:05.240+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:05.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:05.240+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:05.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:05.615+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.400701+0000 front 2024-09-19T04:42:18.400495+0000 (oldest deadline 2024-09-19T04:42:41.900607+0000) 2024-09-19T04:43:05.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:05.615+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:21.901363+0000 front 2024-09-19T04:42:21.901200+0000 (oldest deadline 2024-09-19T04:42:52.501801+0000) 2024-09-19T04:43:05.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:05.615+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.502381+0000 front 2024-09-19T04:42:32.502337+0000 (oldest deadline 2024-09-19T04:42:58.402421+0000) 2024-09-19T04:43:05.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6[55463]: 2024-09-19T04:43:05.615+0000 7f8dcac33640 -1 osd.6 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.803943+0000 front 2024-09-19T04:42:41.803925+0000 (oldest deadline 2024-09-19T04:43:04.704064+0000) 2024-09-19T04:43:05.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:05.599+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:05.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:05.599+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:05.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:05.599+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:05.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:05 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:05.599+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:06.134 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:05 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:05.824+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:06.134 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:05 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:05.824+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:06.134 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:05 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:05.824+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:06.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:06 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:06.132+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:06.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:06 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:06.132+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:06.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:06 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:06.132+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:06.530 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:06 smithi070 podman[111897]: 2024-09-19 04:43:06.26059563 +0000 UTC m=+5.552460879 container died 3c284c62d177c2f8d359665fab87ff3775ba8c6c6ff0b01a087406fc546fdd46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:43:06.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:06 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:06.469+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:06.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:06 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:06.469+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:06.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:06 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:06.469+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:06.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:06 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:06.262+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:06.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:06 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:06.262+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:06.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:06 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:06.262+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:06.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:06 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:06.262+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:06.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:06 smithi070 podman[111897]: 2024-09-19 04:43:06.743242137 +0000 UTC m=+6.035107430 container cleanup 3c284c62d177c2f8d359665fab87ff3775ba8c6c6ff0b01a087406fc546fdd46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-09-19T04:43:06.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:06 smithi070 bash[111897]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6 2024-09-19T04:43:06.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:06 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:06.578+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:06.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:06 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:06.578+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:06.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:06 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:06.578+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:06.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:06 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:06.578+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:07.129 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:06 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:06.846+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:07.129 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:06 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:06.846+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:07.129 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:06 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:06.846+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:07.313 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:06 smithi070 podman[111912]: 2024-09-19 04:43:06.994634575 +0000 UTC m=+0.735106608 container remove 3c284c62d177c2f8d359665fab87ff3775ba8c6c6ff0b01a087406fc546fdd46 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-09-19T04:43:07.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:07 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:07.127+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:07.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:07 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:07.127+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:07.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:07 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:07.127+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:07.565 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:07 smithi070 podman[111998]: 2024-09-19 04:43:07.312413694 +0000 UTC m=+0.112095974 container create 9df330c9cf40e2545bccd9b5c7b274bf87cabe5296e034035d71ab37cad30c98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-09-19T04:43:07.565 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:07 smithi070 podman[111998]: 2024-09-19 04:43:07.216230024 +0000 UTC m=+0.015912322 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:43:07.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:07.473+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:07.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:07.473+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:07.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:07.473+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:07.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:07.295+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:07.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:07.295+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:07.786 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:07.295+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:07.786 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:07.295+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:07.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:07 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:07.596+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:07.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:07 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:07.596+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:07.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:07 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:07.596+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:07.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:07 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:07.596+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:07.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:07 smithi070 podman[111998]: 2024-09-19 04:43:07.564666918 +0000 UTC m=+0.364349207 container init 9df330c9cf40e2545bccd9b5c7b274bf87cabe5296e034035d71ab37cad30c98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6-deactivate, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-09-19T04:43:07.895 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:07 smithi070 podman[111998]: 2024-09-19 04:43:07.56793892 +0000 UTC m=+0.367621201 container start 9df330c9cf40e2545bccd9b5c7b274bf87cabe5296e034035d71ab37cad30c98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS) 2024-09-19T04:43:07.896 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:07 smithi070 podman[111998]: 2024-09-19 04:43:07.664795186 +0000 UTC m=+0.464477481 container attach 9df330c9cf40e2545bccd9b5c7b274bf87cabe5296e034035d71ab37cad30c98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-09-19T04:43:07.896 INFO:journalctl@ceph.osd.6.smithi070.stdout:Sep 19 04:43:07 smithi070 podman[111998]: 2024-09-19 04:43:07.751147449 +0000 UTC m=+0.550829742 container died 9df330c9cf40e2545bccd9b5c7b274bf87cabe5296e034035d71ab37cad30c98 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, ceph=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=) 2024-09-19T04:43:08.123 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:07 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:07.805+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:08.123 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:07 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:07.805+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:08.123 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:07 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:07.805+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:08.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:08 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:08.121+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:08.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:08 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:08.121+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:08.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:08 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:08.121+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:08.489 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.6.service' 2024-09-19T04:43:08.530 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:08.530 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-09-19T04:43:08.530 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-09-19T04:43:08.530 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.7 2024-09-19T04:43:08.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:08.461+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:08.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:08.461+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:08.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:08.461+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:08.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:08.268+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:08.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:08.268+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:08.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:08.268+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:08.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:08.268+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:08.832 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:08 smithi134 systemd[1]: Stopping Ceph osd.7 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:08.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:08 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:08.606+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:08.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:08 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:08.606+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:08.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:08 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:08.606+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:08.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:08 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:08.606+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:09.091 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:08 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:08.835+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:09.091 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:08 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:08.835+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:09.092 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:08 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:08.835+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:09.258 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:08.830+0000 7fdf333ad640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:09.258 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:08.830+0000 7fdf333ad640 -1 osd.7 97 *** Got signal Terminated *** 2024-09-19T04:43:09.258 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:08 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:08.830+0000 7fdf333ad640 -1 osd.7 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:43:09.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:09 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:09.089+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:09.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:09 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:09.089+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:09.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:09 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:09.089+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:09.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:09 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:09.486+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:09.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:09 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:09.486+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:09.535 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:09 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:09.486+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:09.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:09 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:09.256+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:09.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:09 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:09.256+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:09.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:09 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:09.256+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:09.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:09 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:09.256+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:09.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:09 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:09.629+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:09.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:09 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:09.629+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:09.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:09 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:09.629+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:09.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:09 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:09.629+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:10.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:10 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:10.060+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:10.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:10 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:10.060+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:10.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:10 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:10.060+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:10.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:09 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:09.865+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:10.212 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:09 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:09.865+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:10.212 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:09 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:09.865+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:10.533 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:10 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:10.252+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:10.534 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:10 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:10.252+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:10.534 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:10 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:10.252+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:10.534 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:10 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:10.252+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:10.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:10 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:10.532+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:10.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:10 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:10.532+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:10.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:10 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:10.532+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:10.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:10 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:10.581+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:10.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:10 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:10.581+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:10.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:10 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:10.581+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:10.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:10 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:10.581+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:11.201 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:11.111+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:11.201 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:11.111+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:11.201 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:11.111+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:11.201 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:10 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:10.899+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:11.201 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:10 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:10.899+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:11.201 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:10 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:10.899+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:11.201 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:10 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:10.899+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:11.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:11.282+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:11.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:11.282+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:11.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:11.282+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:11.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:11.282+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:11.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:11 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:11.562+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:11.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:11 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:11.562+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:11.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:11 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:11.562+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:11.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:11 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:11.562+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:11.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:11 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:11.562+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:12.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:11.554+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:12.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:11.554+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:12.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:11.554+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:12.147 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:11.916+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:12.147 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:11.916+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:12.147 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:11.916+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:12.147 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:11 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:11.916+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:12.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:12.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:12.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:12.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:12.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:12.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:12.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:12.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:12.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:12 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:12.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:12.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:12 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:12.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:12.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:12 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:12.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:12.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:12 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:12.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:12.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:12 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:12.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:12.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:12.611+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:12.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:12.611+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:12.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:12.611+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:12.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:12.611+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:12.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:12 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:12.611+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:13.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:12 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:12.595+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:13.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:12 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:12.595+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:13.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:12 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:12.595+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:13.210 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:12.953+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:13.210 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:12.953+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:13.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:12.953+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:13.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:12 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:12.953+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:13.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:13.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:13.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:13.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:13.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:13.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:13.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:13.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:13.642 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:13.298+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:13.642 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:13.298+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:13.642 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:13.298+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:13.642 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:13.298+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:13.642 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:13.298+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:13.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:13.615+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:13.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:13.615+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:13.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:13.615+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:13.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:13.615+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:13.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:13 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:13.615+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:14.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:13.640+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:25.413444+0000 front 2024-09-19T04:42:25.413385+0000 (oldest deadline 2024-09-19T04:42:50.614115+0000) 2024-09-19T04:43:14.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:13.640+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:30.614708+0000 front 2024-09-19T04:42:30.614799+0000 (oldest deadline 2024-09-19T04:42:55.314728+0000) 2024-09-19T04:43:14.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:13.640+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:39.916399+0000 front 2024-09-19T04:42:39.916434+0000 (oldest deadline 2024-09-19T04:43:02.716737+0000) 2024-09-19T04:43:14.035 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:13 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7[52411]: 2024-09-19T04:43:13.640+0000 7fdf2f9b2640 -1 osd.7 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:49.718322+0000 front 2024-09-19T04:42:49.718294+0000 (oldest deadline 2024-09-19T04:43:12.618403+0000) 2024-09-19T04:43:14.210 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:13.916+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:14.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:13.916+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:14.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:13.916+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:14.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:13 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:13.916+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:14.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:14.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:14.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:14.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:14.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:14.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:14.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:14.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:14.500 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:14 smithi134 podman[70290]: 2024-09-19 04:43:14.192456419 +0000 UTC m=+5.462482185 container died b1baa11315034b03119365f7d14ebc997601887d446867b5eada550ea9bb3234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_CLEAN=True) 2024-09-19T04:43:14.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:14.274+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:14.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:14.274+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:14.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:14.274+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:14.500 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:14.274+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:14.501 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:14 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:14.274+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:14.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:14 smithi134 podman[70290]: 2024-09-19 04:43:14.580870532 +0000 UTC m=+5.850896306 container cleanup b1baa11315034b03119365f7d14ebc997601887d446867b5eada550ea9bb3234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-09-19T04:43:14.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:14 smithi134 bash[70290]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7 2024-09-19T04:43:14.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:14 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:14.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:14.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:14 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:14.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:14.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:14 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:14.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:14.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:14 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:14.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:14.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:14 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:14.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:15.150 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:14 smithi134 podman[70308]: 2024-09-19 04:43:14.823657475 +0000 UTC m=+0.623042279 container remove b1baa11315034b03119365f7d14ebc997601887d446867b5eada550ea9bb3234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2) 2024-09-19T04:43:15.210 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:14.928+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:15.210 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:14.928+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:15.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:14.928+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:15.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:14 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:14.928+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:15.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:15.115+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:15.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:15.115+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:15.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:15.115+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:15.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:15.115+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:15.402 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:15 smithi134 podman[70400]: 2024-09-19 04:43:15.052421269 +0000 UTC m=+0.015647686 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:43:15.403 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:15 smithi134 podman[70400]: 2024-09-19 04:43:15.16621 +0000 UTC m=+0.129436418 container create ee26a3414dd2fb6643cafe5f6f8f7c0cc50a68960847d2024152978fe9c8a2e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T04:43:15.403 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:15 smithi134 podman[70400]: 2024-09-19 04:43:15.402121384 +0000 UTC m=+0.365347802 container init ee26a3414dd2fb6643cafe5f6f8f7c0cc50a68960847d2024152978fe9c8a2e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:43:15.403 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:15.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:15.403 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:15.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:15.403 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:15.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:15.403 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:15.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:15.403 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:15.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:15.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:15 smithi134 podman[70400]: 2024-09-19 04:43:15.405635705 +0000 UTC m=+0.368862126 container start ee26a3414dd2fb6643cafe5f6f8f7c0cc50a68960847d2024152978fe9c8a2e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, CEPH_POINT_RELEASE=, ceph=True, RELEASE=squid-2f599a4) 2024-09-19T04:43:15.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:15 smithi134 podman[70400]: 2024-09-19 04:43:15.477023744 +0000 UTC m=+0.440250162 container attach ee26a3414dd2fb6643cafe5f6f8f7c0cc50a68960847d2024152978fe9c8a2e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4) 2024-09-19T04:43:15.785 INFO:journalctl@ceph.osd.7.smithi134.stdout:Sep 19 04:43:15 smithi134 podman[70400]: 2024-09-19 04:43:15.590897162 +0000 UTC m=+0.554123580 container died ee26a3414dd2fb6643cafe5f6f8f7c0cc50a68960847d2024152978fe9c8a2e7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-7-deactivate, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:43:15.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:15.564+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:15.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:15.564+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:15.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:15.564+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:15.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:15.564+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:15.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:15 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:15.564+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:16.210 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:15.920+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:16.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:15.920+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:16.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:15.920+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:16.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:15 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:15.920+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:16.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:16.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:16.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:16.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:16.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:16.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:16.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:16.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:16.230 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.7.service' 2024-09-19T04:43:16.308 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:16.309 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-09-19T04:43:16.309 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-09-19T04:43:16.309 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.8 2024-09-19T04:43:16.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:16.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:16.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:16.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:16.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:16.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:16.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:16.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:16.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:16 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:16.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:16.616 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:16 smithi167 systemd[1]: Stopping Ceph osd.8 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:16.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:16.586+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:16.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:16.586+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:16.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:16.586+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:16.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:16.586+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:16.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:16 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:16.586+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:16.953 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:16.613+0000 7f7fd8fbd640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:16.954 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:16.613+0000 7f7fd8fbd640 -1 osd.8 97 *** Got signal Terminated *** 2024-09-19T04:43:16.954 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:16.613+0000 7f7fd8fbd640 -1 osd.8 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:43:16.954 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:16.951+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:16.954 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:16.951+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:16.954 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:16.951+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:16.954 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:16 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:16.951+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:17.210 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:17 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:17.182+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:17.210 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:17 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:17.182+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:17.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:17 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:17.182+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:17.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:17 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:17.182+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:17.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:17.267+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:17.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:17.267+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:17.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:17.267+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:17.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:17.267+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:17.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:17 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:17.267+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:17.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:17 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:17.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:17.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:17 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:17.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:17.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:17 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:17.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:17.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:17 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:17.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:17.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:17 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:17.583+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:18.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:17 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:17.996+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:18.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:17 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:17.996+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:18.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:17 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:17.996+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:18.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:17 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:17.996+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:18.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:18.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:18.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:18.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:18.462 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:18.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:18.462 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:18.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:18.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:18 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:18.229+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:18.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:18 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:18.229+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:18.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:18 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:18.229+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:18.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:18 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:18.229+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:18.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:18 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:18.229+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:18.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:18.551+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:18.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:18.551+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:18.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:18.551+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:18.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:18.551+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:18.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:18 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:18.551+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:19.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:18.961+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:19.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:18.961+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:19.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:18.961+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:19.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:18.961+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:19.461 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:18.961+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.391393+0000 front 2024-09-19T04:42:55.391338+0000 (oldest deadline 2024-09-19T04:43:18.891451+0000) 2024-09-19T04:43:19.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:19.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:19.462 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:19.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:19.462 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:19.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:19.462 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:19.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:19.462 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:19.150+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:19.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:19 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:19.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:19.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:19 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:19.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:19.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:19 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:19.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:19.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:19 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:19.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:19.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:19 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:19.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:19.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:19 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:19.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:19.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:19 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:19.523+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:19.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:19 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:19.523+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:19.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:19 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:19.523+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:19.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:19 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:19.523+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:19.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:19 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:19.523+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:20.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:20.127+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:20.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:20.127+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:20.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:20.127+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:20.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:20.127+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:20.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:20.127+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:20.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:19.930+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:20.212 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:19.930+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:20.212 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:19.930+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:20.212 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:19.930+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:20.212 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:19 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:19.930+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.391393+0000 front 2024-09-19T04:42:55.391338+0000 (oldest deadline 2024-09-19T04:43:18.891451+0000) 2024-09-19T04:43:20.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:20 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:20.292+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:20.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:20 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:20.292+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:20.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:20 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:20.292+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:20.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:20 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:20.292+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:20.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:20 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:20.292+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:20.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:20 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:20.292+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:20.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:20 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:20.491+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:20.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:20 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:20.491+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:20.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:20 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:20.491+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:20.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:20 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:20.491+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:20.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:20 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:20.491+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:21.210 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:20.903+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.985986+0000 front 2024-09-19T04:42:23.985973+0000 (oldest deadline 2024-09-19T04:42:49.285831+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:20.903+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:32.786985+0000 front 2024-09-19T04:42:32.786782+0000 (oldest deadline 2024-09-19T04:42:55.086954+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:20.903+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:41.488818+0000 front 2024-09-19T04:42:41.488885+0000 (oldest deadline 2024-09-19T04:43:03.788705+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:20.903+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:45.990440+0000 front 2024-09-19T04:42:45.990581+0000 (oldest deadline 2024-09-19T04:43:10.690383+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:20 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8[52467]: 2024-09-19T04:43:20.903+0000 7f7fd55c2640 -1 osd.8 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.391393+0000 front 2024-09-19T04:42:55.391338+0000 (oldest deadline 2024-09-19T04:43:18.891451+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:21 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:21.123+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:21 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:21.123+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:21 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:21.123+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:21 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:21.123+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:21.211 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:21 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:21.124+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:21.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:21.287+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:21.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:21.287+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:21.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:21.287+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:21.786 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:21.287+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:21.786 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:21.287+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:21.786 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:21 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:21.287+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:21.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:21 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:21.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:21.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:21 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:21.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:21.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:21 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:21.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:21.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:21 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:21.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:21.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:21 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:21.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:22.322 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:22 smithi167 podman[70692]: 2024-09-19 04:43:22.048330836 +0000 UTC m=+5.543872479 container died eb0586fcea1603d93ca168ee0caa1a4fadeb2059bde5438a4735967d624bc275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T04:43:22.323 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:22 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:22.108+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:22.323 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:22 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:22.108+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:22.323 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:22 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:22.108+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:22.323 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:22 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:22.108+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:22.323 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:22 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:22.108+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:22.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:22 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:22.260+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:22.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:22 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:22.260+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:22.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:22 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:22.260+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:22.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:22 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:22.260+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:22.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:22 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:22.260+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:22.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:22 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:22.260+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:22.664 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:22 smithi167 podman[70692]: 2024-09-19 04:43:22.420762587 +0000 UTC m=+5.916304229 container cleanup eb0586fcea1603d93ca168ee0caa1a4fadeb2059bde5438a4735967d624bc275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T04:43:22.664 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:22 smithi167 bash[70692]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8 2024-09-19T04:43:22.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:22 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:22.494+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:22.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:22 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:22.494+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:22.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:22 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:22.494+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:22.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:22 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:22.494+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:22.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:22 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:22.494+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:22.960 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:22 smithi167 podman[70708]: 2024-09-19 04:43:22.663426735 +0000 UTC m=+0.612258919 container remove eb0586fcea1603d93ca168ee0caa1a4fadeb2059bde5438a4735967d624bc275 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T04:43:23.270 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:23 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:23.155+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:23.270 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:23 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:23.155+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:23.270 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:23 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:23.156+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:23.270 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:23 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:23.156+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:23.270 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:23 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:23.156+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:23.270 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:22 smithi167 podman[70800]: 2024-09-19 04:43:22.890304239 +0000 UTC m=+0.016065177 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:43:23.270 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:23 smithi167 podman[70800]: 2024-09-19 04:43:23.014585699 +0000 UTC m=+0.140346618 container create e2a3957ddbc105aad345802d934a61e8743426829cc4e6202cb62b0de72f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T04:43:23.270 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:23 smithi167 podman[70800]: 2024-09-19 04:43:23.269372165 +0000 UTC m=+0.395133093 container init e2a3957ddbc105aad345802d934a61e8743426829cc4e6202cb62b0de72f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-09-19T04:43:23.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:23 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:23.215+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:23.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:23 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:23.215+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:23.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:23 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:23.215+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:23.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:23 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:23.215+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:23.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:23 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:23.215+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:23.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:23 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:23.215+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:23.710 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:23 smithi167 podman[70800]: 2024-09-19 04:43:23.273586576 +0000 UTC m=+0.399347495 container start e2a3957ddbc105aad345802d934a61e8743426829cc4e6202cb62b0de72f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8-deactivate, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, GIT_CLEAN=True) 2024-09-19T04:43:23.711 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:23 smithi167 podman[70800]: 2024-09-19 04:43:23.384001406 +0000 UTC m=+0.509762333 container attach e2a3957ddbc105aad345802d934a61e8743426829cc4e6202cb62b0de72f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8-deactivate, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, ceph=True, io.buildah.version=1.37.2) 2024-09-19T04:43:23.711 INFO:journalctl@ceph.osd.8.smithi167.stdout:Sep 19 04:43:23 smithi167 podman[70800]: 2024-09-19 04:43:23.458834792 +0000 UTC m=+0.584595714 container died e2a3957ddbc105aad345802d934a61e8743426829cc4e6202cb62b0de72f3199 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4) 2024-09-19T04:43:23.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:23 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:23.473+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:23.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:23 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:23.473+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:23.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:23 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:23.473+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:23.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:23 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:23.473+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:23.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:23 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:23.473+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:24.050 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.8.service' 2024-09-19T04:43:24.089 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:24.089 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-09-19T04:43:24.089 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-09-19T04:43:24.089 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.9 2024-09-19T04:43:24.299 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:24 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:24.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:24.299 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:24 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:24.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:24.299 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:24 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:24.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:24.299 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:24 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:24.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:24.299 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:24 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:24.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:24.395 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 systemd[1]: Stopping Ceph osd.9 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:24.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:24 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:24.214+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:24.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:24 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:24.214+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:24.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:24 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:24.214+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:24.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:24 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:24.214+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:24.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:24 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:24.214+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:24.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:24 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:24.214+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:24.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:24.410+0000 7efec72f6640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:24.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:24.410+0000 7efec72f6640 -1 osd.9 97 *** Got signal Terminated *** 2024-09-19T04:43:24.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:24.410+0000 7efec72f6640 -1 osd.9 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:43:24.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:24.470+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:24.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:24.470+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:24.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:24.470+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:24.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:24.470+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:24.896 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:24 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:24.470+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:25.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:25 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:25.140+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:25.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:25 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:25.140+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:25.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:25 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:25.140+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:25.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:25 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:25.140+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:25.462 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:25 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:25.140+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:25.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:25 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:25.182+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:25.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:25 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:25.182+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:25.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:25 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:25.182+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:25.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:25 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:25.182+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:25.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:25 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:25.182+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:25.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:25 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:25.182+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:25.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:25 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:25.446+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:25.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:25 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:25.446+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:25.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:25 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:25.446+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:25.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:25 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:25.446+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:25.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:25 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:25.446+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:26.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:26 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:26.188+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:26.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:26 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:26.188+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:26.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:26 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:26.188+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:26.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:26 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:26.188+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:26.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:26 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:26.188+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:26.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:26 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:26.191+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:26.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:26 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:26.191+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:26.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:26 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:26.191+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:26.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:26 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:26.191+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:26.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:26 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:26.191+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:26.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:26 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:26.191+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:26.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:26 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:26.442+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:26.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:26 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:26.442+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:26.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:26 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:26.442+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:26.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:26 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:26.442+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:26.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:26 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:26.442+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:27.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:27 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:27.180+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:27.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:27 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:27.180+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:27.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:27 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:27.180+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:27.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:27 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:27.180+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:27.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:27 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:27.180+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:27.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:27 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:27.227+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:27.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:27 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:27.227+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:27.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:27 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:27.227+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:27.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:27 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:27.227+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:27.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:27 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:27.227+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:27.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:27 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:27.227+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:27.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:27 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:27.460+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:27.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:27 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:27.460+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:27.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:27 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:27.460+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:27.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:27 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:27.460+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:27.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:27 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:27.460+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:28.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:28 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:28.193+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:28.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:28 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:28.193+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:28.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:28 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:28.193+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:28.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:28 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:28.193+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:28.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:28 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:28.193+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:28.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:28 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:28.193+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:28.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:28 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:28.254+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:28.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:28 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:28.254+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:28.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:28 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:28.254+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:28.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:28 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:28.254+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:28.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:28 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:28.254+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:28.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:28 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:28.254+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:28.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:28 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:28.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:17.185214+0000 front 2024-09-19T04:42:17.185121+0000 (oldest deadline 2024-09-19T04:42:43.085142+0000) 2024-09-19T04:43:28.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:28 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:28.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:23.586285+0000 front 2024-09-19T04:42:23.586245+0000 (oldest deadline 2024-09-19T04:42:48.886140+0000) 2024-09-19T04:43:28.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:28 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:28.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.687819+0000 front 2024-09-19T04:42:31.687831+0000 (oldest deadline 2024-09-19T04:42:55.187629+0000) 2024-09-19T04:43:28.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:28 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:28.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.389207+0000 front 2024-09-19T04:42:40.389236+0000 (oldest deadline 2024-09-19T04:43:03.889361+0000) 2024-09-19T04:43:28.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:28 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9[62423]: 2024-09-19T04:43:28.490+0000 7efec38fb640 -1 osd.9 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:44.990116+0000 front 2024-09-19T04:42:44.990225+0000 (oldest deadline 2024-09-19T04:43:10.890066+0000) 2024-09-19T04:43:29.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:29.158+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:29.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:29.158+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:29.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:29.158+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:29.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:29.158+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:29.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:29.158+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:29.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:29 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:29.158+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:29.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:29 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:29.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:29.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:29 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:29.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:29.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:29 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:29.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:29.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:29 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:29.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:29.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:29 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:29.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:29.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:29 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:29.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:29.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:29 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:29.235+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:30.094 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:29 smithi070 podman[112099]: 2024-09-19 04:43:29.827506281 +0000 UTC m=+5.534804165 container died 418432e808e60705cad9421ce2c3d6bb7598c7188384e14066d8630d1f02be80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-09-19T04:43:30.395 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:30 smithi070 podman[112099]: 2024-09-19 04:43:30.301784505 +0000 UTC m=+6.009082377 container cleanup 418432e808e60705cad9421ce2c3d6bb7598c7188384e14066d8630d1f02be80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:43:30.395 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:30 smithi070 bash[112099]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9 2024-09-19T04:43:30.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:30 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:30.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:30.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:30 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:30.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:30.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:30 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:30.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:30.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:30 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:30.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:30.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:30 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:30.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:30.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:30 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:30.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:30.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:30 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:30.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:30.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:30 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:30.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:30.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:30 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:30.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:30.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:30 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:30.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:30.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:30 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:30.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:30.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:30 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:30.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:30.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:30 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:30.251+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:30.895 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:30 smithi070 podman[112115]: 2024-09-19 04:43:30.561481553 +0000 UTC m=+0.729092988 container remove 418432e808e60705cad9421ce2c3d6bb7598c7188384e14066d8630d1f02be80 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T04:43:31.280 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:30 smithi070 podman[112204]: 2024-09-19 04:43:30.820863137 +0000 UTC m=+0.015635961 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:43:31.280 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:30 smithi070 podman[112204]: 2024-09-19 04:43:30.937068891 +0000 UTC m=+0.131841703 container create 6ac4b72b02b5a984e4de507eebfe190be10ba712e477090ec46076f571fcedbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9-deactivate, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2) 2024-09-19T04:43:31.280 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:31 smithi070 podman[112204]: 2024-09-19 04:43:31.16451379 +0000 UTC m=+0.359286612 container init 6ac4b72b02b5a984e4de507eebfe190be10ba712e477090ec46076f571fcedbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-09-19T04:43:31.280 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:31 smithi070 podman[112204]: 2024-09-19 04:43:31.1679809 +0000 UTC m=+0.362753715 container start 6ac4b72b02b5a984e4de507eebfe190be10ba712e477090ec46076f571fcedbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-09-19T04:43:31.281 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:31 smithi070 podman[112204]: 2024-09-19 04:43:31.279596563 +0000 UTC m=+0.474369395 container attach 6ac4b72b02b5a984e4de507eebfe190be10ba712e477090ec46076f571fcedbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-09-19T04:43:31.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:31 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:31.143+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:31.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:31 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:31.143+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:31.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:31 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:31.143+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:31.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:31 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:31.143+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:31.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:31 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:31.143+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:31.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:31 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:31.143+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:31.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:31 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:31.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:31.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:31 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:31.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:31.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:31 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:31.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:31.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:31 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:31.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:31.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:31 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:31.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:31.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:31 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:31.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:31.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:31 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:31.270+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:31.644 INFO:journalctl@ceph.osd.9.smithi070.stdout:Sep 19 04:43:31 smithi070 podman[112204]: 2024-09-19 04:43:31.352170887 +0000 UTC m=+0.546943700 container died 6ac4b72b02b5a984e4de507eebfe190be10ba712e477090ec46076f571fcedbf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-9-deactivate, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T04:43:32.004 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.9.service' 2024-09-19T04:43:32.041 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:32.041 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-09-19T04:43:32.041 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-09-19T04:43:32.042 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.10 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 systemd[1]: Stopping Ceph osd.10 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.308+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.308+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.308+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.308+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.308+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.308+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.308+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:32.358 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.356+0000 7f73cf750640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:32.359 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.356+0000 7f73cf750640 -1 osd.10 97 *** Got signal Terminated *** 2024-09-19T04:43:32.359 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:32 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:32.356+0000 7f73cf750640 -1 osd.10 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:43:32.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:32 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:32.109+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:32.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:32 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:32.109+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:32.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:32 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:32.109+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:32.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:32 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:32.109+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:32.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:32 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:32.109+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:32.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:32 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:32.109+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:33.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:33 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:33.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:33.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:33 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:33.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:33.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:33 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:33.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:33.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:33 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:33.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:33.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:33 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:33.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:33.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:33 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:33.103+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:33.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:33 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:33.285+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:33.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:33 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:33.285+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:33.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:33 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:33.285+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:33.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:33 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:33.285+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:33.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:33 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:33.285+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:33.786 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:33 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:33.285+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:33.786 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:33 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:33.285+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:34.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:34 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:34.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:34.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:34 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:34.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:34.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:34 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:34.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:34.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:34 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:34.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:34.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:34 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:34.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:34.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:34 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:34.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:34.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:34 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:34.304+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:34.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:34 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:34.304+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:34.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:34 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:34.304+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:34.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:34 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:34.304+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:34.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:34 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:34.304+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:34.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:34 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:34.304+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:34.785 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:34 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:34.304+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:35.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:35 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:35.167+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:35.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:35 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:35.167+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:35.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:35 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:35.167+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:35.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:35 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:35.167+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:35.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:35 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:35.167+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:35.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:35 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:35.167+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:35.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:35 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:35.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:35.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:35 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:35.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:35.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:35 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:35.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:35.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:35 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:35.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:35.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:35 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:35.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:35.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:35 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:35.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:35.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:35 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:35.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:36.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:36 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:36.172+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:36.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:36 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:36.172+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:36.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:36 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:36.172+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:36.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:36 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:36.172+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:36.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:36 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:36.172+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:36.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:36 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:36.172+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:36.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:36 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:36.172+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:36.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:36 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:36.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:36.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:36 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:36.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:36.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:36 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:36.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:36.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:36 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:36.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:36.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:36 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:36.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:36.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:36 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:36.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:36.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:36 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:36.264+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:37.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:37 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:37.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:37.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:37 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:37.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:37.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:37 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:37.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:37.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:37 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:37.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:37.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:37 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:37.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:37.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:37 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:37.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:37.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:37 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:37.153+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:37.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:37 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:37.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:13.544503+0000 front 2024-09-19T04:42:13.544585+0000 (oldest deadline 2024-09-19T04:42:41.144953+0000) 2024-09-19T04:43:37.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:37 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:37.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:22.845794+0000 front 2024-09-19T04:42:22.845820+0000 (oldest deadline 2024-09-19T04:42:48.145932+0000) 2024-09-19T04:43:37.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:37 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:37.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:29.246860+0000 front 2024-09-19T04:42:29.246957+0000 (oldest deadline 2024-09-19T04:42:55.146958+0000) 2024-09-19T04:43:37.535 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:37 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:37.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6814 osd.3 since back 2024-09-19T04:42:40.348258+0000 front 2024-09-19T04:42:40.348212+0000 (oldest deadline 2024-09-19T04:43:05.048205+0000) 2024-09-19T04:43:37.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:37 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:37.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:47.849500+0000 front 2024-09-19T04:42:47.849531+0000 (oldest deadline 2024-09-19T04:43:11.949502+0000) 2024-09-19T04:43:37.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:37 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:37.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:56.050597+0000 front 2024-09-19T04:42:56.050508+0000 (oldest deadline 2024-09-19T04:43:18.850997+0000) 2024-09-19T04:43:37.536 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:37 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10[58988]: 2024-09-19T04:43:37.242+0000 7f73c7d4d640 -1 osd.10 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.752206+0000 front 2024-09-19T04:43:04.752150+0000 (oldest deadline 2024-09-19T04:43:28.852014+0000) 2024-09-19T04:43:38.035 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:37 smithi134 podman[70513]: 2024-09-19 04:43:37.706714119 +0000 UTC m=+5.470481545 container died e7ef8d09ac628ec61b96bb779c87730e1e308330d015ad337798afa0699b6d45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:43:38.325 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:38 smithi134 podman[70513]: 2024-09-19 04:43:38.123550489 +0000 UTC m=+5.887317913 container cleanup e7ef8d09ac628ec61b96bb779c87730e1e308330d015ad337798afa0699b6d45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-09-19T04:43:38.325 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:38 smithi134 bash[70513]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10 2024-09-19T04:43:38.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:38 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:38.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:38.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:38 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:38.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:38.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:38 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:38.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:38.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:38 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:38.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:38.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:38 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:38.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:38.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:38 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:38.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:38.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:38 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:38.186+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:38.737 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:38 smithi134 podman[70529]: 2024-09-19 04:43:38.324559758 +0000 UTC m=+0.619046486 container remove e7ef8d09ac628ec61b96bb779c87730e1e308330d015ad337798afa0699b6d45 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS) 2024-09-19T04:43:38.990 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:38 smithi134 podman[70616]: 2024-09-19 04:43:38.639215136 +0000 UTC m=+0.016043136 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:43:38.990 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:38 smithi134 podman[70616]: 2024-09-19 04:43:38.767007878 +0000 UTC m=+0.143835883 container create 6ec6cc7f78a1ca2ccb9e158c4b1f0754bee47a4bad8b2d4545a6dc27f6ed024a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, io.buildah.version=1.37.2) 2024-09-19T04:43:38.990 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:38 smithi134 podman[70616]: 2024-09-19 04:43:38.986222454 +0000 UTC m=+0.363050459 container init 6ec6cc7f78a1ca2ccb9e158c4b1f0754bee47a4bad8b2d4545a6dc27f6ed024a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2) 2024-09-19T04:43:38.990 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:38 smithi134 podman[70616]: 2024-09-19 04:43:38.989424722 +0000 UTC m=+0.366252723 container start 6ec6cc7f78a1ca2ccb9e158c4b1f0754bee47a4bad8b2d4545a6dc27f6ed024a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, ceph=True, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2) 2024-09-19T04:43:39.285 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:39 smithi134 podman[70616]: 2024-09-19 04:43:39.086332226 +0000 UTC m=+0.463160240 container attach 6ec6cc7f78a1ca2ccb9e158c4b1f0754bee47a4bad8b2d4545a6dc27f6ed024a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True) 2024-09-19T04:43:39.286 INFO:journalctl@ceph.osd.10.smithi134.stdout:Sep 19 04:43:39 smithi134 podman[70616]: 2024-09-19 04:43:39.17377966 +0000 UTC m=+0.550607660 container died 6ec6cc7f78a1ca2ccb9e158c4b1f0754bee47a4bad8b2d4545a6dc27f6ed024a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.schema-version=1.0) 2024-09-19T04:43:39.452 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:39 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:39.174+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:39.452 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:39 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:39.174+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:39.452 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:39 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:39.174+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:39.452 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:39 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:39.174+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:39.452 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:39 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:39.174+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:39.452 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:39 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:39.174+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:39.452 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:39 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:39.174+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:39.903 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.10.service' 2024-09-19T04:43:39.941 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:39.941 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-09-19T04:43:39.941 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-09-19T04:43:39.941 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.11 2024-09-19T04:43:40.249 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:39 smithi167 systemd[1]: Stopping Ceph osd.11 for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:40.249 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:40.249 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:40.249 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:40.249 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:40.249 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:40.250 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:40.250 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:40.250 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.247+0000 7f995e144640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:40.250 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.247+0000 7f995e144640 -1 osd.11 97 *** Got signal Terminated *** 2024-09-19T04:43:40.250 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:40 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:40.247+0000 7f995e144640 -1 osd.11 97 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-09-19T04:43:41.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:41.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:41.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:41.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:41.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:41.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:41.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:41.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:41.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:41.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:41.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:41.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:41.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:41 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:41.125+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:42.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:42.137+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:42.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:42.137+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:42.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:42.137+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:42.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:42.137+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:42.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:42.137+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:42.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:42.137+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:42.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:42 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:42.137+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:43.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:43.148+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:43.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:43.148+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:43.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:43.148+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:43.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:43.148+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:43.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:43.148+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:43.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:43.148+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:43.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:43 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:43.148+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:44.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:44.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:44.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:44.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:44.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:44.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:44.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:44.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:44.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:44.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:44.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:44.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:44.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:44 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:44.145+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:45.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:45.136+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6806 osd.0 since back 2024-09-19T04:42:18.482748+0000 front 2024-09-19T04:42:18.482718+0000 (oldest deadline 2024-09-19T04:42:42.582920+0000) 2024-09-19T04:43:45.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:45.136+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6804 osd.1 since back 2024-09-19T04:42:24.784866+0000 front 2024-09-19T04:42:24.785082+0000 (oldest deadline 2024-09-19T04:42:47.084847+0000) 2024-09-19T04:43:45.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:45.136+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6804 osd.2 since back 2024-09-19T04:42:31.185723+0000 front 2024-09-19T04:42:31.185751+0000 (oldest deadline 2024-09-19T04:42:57.085906+0000) 2024-09-19T04:43:45.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:45.136+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6812 osd.4 since back 2024-09-19T04:42:46.387999+0000 front 2024-09-19T04:42:46.387986+0000 (oldest deadline 2024-09-19T04:43:11.687965+0000) 2024-09-19T04:43:45.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:45.136+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.167:6812 osd.5 since back 2024-09-19T04:42:55.788772+0000 front 2024-09-19T04:42:55.788875+0000 (oldest deadline 2024-09-19T04:43:18.688907+0000) 2024-09-19T04:43:45.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:45.136+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.70:6822 osd.6 since back 2024-09-19T04:43:04.990560+0000 front 2024-09-19T04:43:04.990546+0000 (oldest deadline 2024-09-19T04:43:27.890561+0000) 2024-09-19T04:43:45.461 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:45 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11[59464]: 2024-09-19T04:43:45.136+0000 7f9956741640 -1 osd.11 97 heartbeat_check: no reply from 172.21.15.134:6820 osd.7 since back 2024-09-19T04:43:11.391578+0000 front 2024-09-19T04:43:11.391692+0000 (oldest deadline 2024-09-19T04:43:36.091578+0000) 2024-09-19T04:43:46.041 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:45 smithi167 podman[70913]: 2024-09-19 04:43:45.775110471 +0000 UTC m=+5.636582319 container died 27bc416fc6895856bb39637b6c1ab3686642d5c94bf8a5ec223cc95e57d85e0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_CLEAN=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, io.buildah.version=1.37.2) 2024-09-19T04:43:46.408 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:46 smithi167 podman[70913]: 2024-09-19 04:43:46.139839015 +0000 UTC m=+6.001310863 container cleanup 27bc416fc6895856bb39637b6c1ab3686642d5c94bf8a5ec223cc95e57d85e0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2) 2024-09-19T04:43:46.408 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:46 smithi167 bash[70913]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11 2024-09-19T04:43:46.710 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:46 smithi167 podman[70932]: 2024-09-19 04:43:46.407408496 +0000 UTC m=+0.621515822 container remove 27bc416fc6895856bb39637b6c1ab3686642d5c94bf8a5ec223cc95e57d85e0c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:43:47.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:46 smithi167 podman[71020]: 2024-09-19 04:43:46.663317906 +0000 UTC m=+0.015974518 image pull d2baa855c067ff6a7470a2dcec37621dc44864d3a0d23b0aa8bba9bd386dfe3d quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e 2024-09-19T04:43:47.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:46 smithi167 podman[71020]: 2024-09-19 04:43:46.766394818 +0000 UTC m=+0.119051415 container create 657ffa6fcce99fa4dab210abca0fa4bb17aab6adbb3408c774bed19e51b0f9ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-09-19T04:43:47.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:47 smithi167 podman[71020]: 2024-09-19 04:43:47.002378839 +0000 UTC m=+0.355035446 container init 657ffa6fcce99fa4dab210abca0fa4bb17aab6adbb3408c774bed19e51b0f9ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:43:47.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:47 smithi167 podman[71020]: 2024-09-19 04:43:47.005606368 +0000 UTC m=+0.358262968 container start 657ffa6fcce99fa4dab210abca0fa4bb17aab6adbb3408c774bed19e51b0f9ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:43:47.086 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:47 smithi167 podman[71020]: 2024-09-19 04:43:47.085711405 +0000 UTC m=+0.438368015 container attach 657ffa6fcce99fa4dab210abca0fa4bb17aab6adbb3408c774bed19e51b0f9ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11-deactivate, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:43:47.460 INFO:journalctl@ceph.osd.11.smithi167.stdout:Sep 19 04:43:47 smithi167 podman[71020]: 2024-09-19 04:43:47.199805692 +0000 UTC m=+0.552462291 container died 657ffa6fcce99fa4dab210abca0fa4bb17aab6adbb3408c774bed19e51b0f9ca (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-osd-11-deactivate, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:43:47.860 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@osd.11.service' 2024-09-19T04:43:47.898 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:47.899 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-09-19T04:43:47.899 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-09-19T04:43:47.899 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.a 2024-09-19T04:43:48.203 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:43:47 smithi070 systemd[1]: Stopping Ceph mds.a for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:48.645 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:43:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a[69180]: 2024-09-19T04:43:48.201+0000 7fc5dfb58640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:48.645 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:43:48 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a[69180]: 2024-09-19T04:43:48.201+0000 7fc5dfb58640 -1 mds.a *** got signal Terminated *** 2024-09-19T04:43:50.327 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:43:50 smithi070 podman[112307]: 2024-09-19 04:43:50.076238194 +0000 UTC m=+1.983601775 container died 3392ae3361d785ad4b6810b221ebf3bc22dd870061da538082e7edf588cbe934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, GIT_CLEAN=True, ceph=True) 2024-09-19T04:43:50.645 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:43:50 smithi070 podman[112307]: 2024-09-19 04:43:50.509300182 +0000 UTC m=+2.416663751 container cleanup 3392ae3361d785ad4b6810b221ebf3bc22dd870061da538082e7edf588cbe934 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-09-19T04:43:50.645 INFO:journalctl@ceph.mds.a.smithi070.stdout:Sep 19 04:43:50 smithi070 bash[112307]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-a 2024-09-19T04:43:50.937 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.a.service' 2024-09-19T04:43:50.971 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:50.972 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-09-19T04:43:50.972 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-09-19T04:43:50.972 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.d 2024-09-19T04:43:51.298 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:43:51 smithi070 systemd[1]: Stopping Ceph mds.d for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:51.645 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:43:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d[67995]: 2024-09-19T04:43:51.296+0000 7fba9fa84640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:51.645 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:43:51 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d[67995]: 2024-09-19T04:43:51.296+0000 7fba9fa84640 -1 mds.d *** got signal Terminated *** 2024-09-19T04:43:55.597 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:43:55 smithi070 podman[112430]: 2024-09-19 04:43:55.303118064 +0000 UTC m=+4.118291656 container died 8968a2ee3f41c7e3f3e33352eb201bee960b3197cadbdbc6054916ceaf515e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux ) 2024-09-19T04:43:55.895 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:43:55 smithi070 podman[112430]: 2024-09-19 04:43:55.77975509 +0000 UTC m=+4.594928727 container cleanup 8968a2ee3f41c7e3f3e33352eb201bee960b3197cadbdbc6054916ceaf515e66 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731) 2024-09-19T04:43:55.895 INFO:journalctl@ceph.mds.d.smithi070.stdout:Sep 19 04:43:55 smithi070 bash[112430]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-d 2024-09-19T04:43:56.217 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.d.service' 2024-09-19T04:43:56.249 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:56.250 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-09-19T04:43:56.250 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-09-19T04:43:56.250 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.g 2024-09-19T04:43:56.567 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:56 smithi070 systemd[1]: Stopping Ceph mds.g for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:43:56.895 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g[68780]: 2024-09-19T04:43:56.566+0000 7ff22986e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:43:56.895 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:56 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g[68780]: 2024-09-19T04:43:56.566+0000 7ff22986e640 -1 mds.g *** got signal Terminated *** 2024-09-19T04:43:59.134 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:58 smithi070 podman[112552]: 2024-09-19 04:43:58.74830327 +0000 UTC m=+2.285439940 container died 5baf0eb5de1e5efc62e6f5334e9992a95fba0ebfd410667d3c8ecffe55eb4104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T04:43:59.395 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:59 smithi070 podman[112552]: 2024-09-19 04:43:59.291417098 +0000 UTC m=+2.828553754 container cleanup 5baf0eb5de1e5efc62e6f5334e9992a95fba0ebfd410667d3c8ecffe55eb4104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-2f599a4, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-09-19T04:43:59.395 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:59 smithi070 bash[112552]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g 2024-09-19T04:43:59.764 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.g.service' 2024-09-19T04:43:59.785 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:59 smithi070 podman[112565]: 2024-09-19 04:43:59.526550375 +0000 UTC m=+0.772984542 container remove 5baf0eb5de1e5efc62e6f5334e9992a95fba0ebfd410667d3c8ecffe55eb4104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-g, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2) 2024-09-19T04:43:59.785 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:59 smithi070 systemd[1]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.g.service: Deactivated successfully. 2024-09-19T04:43:59.786 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:59 smithi070 systemd[1]: Stopped Ceph mds.g for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:43:59.786 INFO:journalctl@ceph.mds.g.smithi070.stdout:Sep 19 04:43:59 smithi070 systemd[1]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.g.service: Consumed 1.022s CPU time. 2024-09-19T04:43:59.796 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:43:59.796 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-09-19T04:43:59.796 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-09-19T04:43:59.796 DEBUG:teuthology.orchestra.run.smithi070:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.j 2024-09-19T04:44:00.138 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:43:59 smithi070 systemd[1]: Stopping Ceph mds.j for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:00.395 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:44:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j[67578]: 2024-09-19T04:44:00.136+0000 7fa888567640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:00.395 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:44:00 smithi070 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j[67578]: 2024-09-19T04:44:00.136+0000 7fa888567640 -1 mds.j *** got signal Terminated *** 2024-09-19T04:44:04.346 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:44:04 smithi070 podman[112673]: 2024-09-19 04:44:04.060422957 +0000 UTC m=+4.050987074 container died f3e72a5f4ed087a91a689ba70cf1e6bb7e1f1f258aa3395485b618beaf5791e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-09-19T04:44:04.645 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:44:04 smithi070 podman[112673]: 2024-09-19 04:44:04.516284406 +0000 UTC m=+4.506848515 container cleanup f3e72a5f4ed087a91a689ba70cf1e6bb7e1f1f258aa3395485b618beaf5791e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j, ceph=True, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:44:04.645 INFO:journalctl@ceph.mds.j.smithi070.stdout:Sep 19 04:44:04 smithi070 bash[112673]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-j 2024-09-19T04:44:04.939 DEBUG:teuthology.orchestra.run.smithi070:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.j.service' 2024-09-19T04:44:04.971 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:04.971 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-09-19T04:44:04.971 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-09-19T04:44:04.971 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.b 2024-09-19T04:44:05.274 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:44:05 smithi134 systemd[1]: Stopping Ceph mds.b for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:05.534 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:44:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: 2024-09-19T04:44:05.272+0000 7fe0d64fc640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:05.534 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:44:05 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b[64358]: 2024-09-19T04:44:05.272+0000 7fe0d64fc640 -1 mds.b *** got signal Terminated *** 2024-09-19T04:44:06.774 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:44:06 smithi134 podman[70719]: 2024-09-19 04:44:06.462520402 +0000 UTC m=+1.302679096 container died 28ec9eeea4944e707bdcbe4b5146897805e331f6c35231b5d06a5d1ac74d7e14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2) 2024-09-19T04:44:07.035 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:44:06 smithi134 podman[70719]: 2024-09-19 04:44:06.847869121 +0000 UTC m=+1.688027804 container cleanup 28ec9eeea4944e707bdcbe4b5146897805e331f6c35231b5d06a5d1ac74d7e14 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS) 2024-09-19T04:44:07.035 INFO:journalctl@ceph.mds.b.smithi134.stdout:Sep 19 04:44:06 smithi134 bash[70719]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-b 2024-09-19T04:44:07.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.b.service' 2024-09-19T04:44:07.242 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:07.242 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-09-19T04:44:07.242 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-09-19T04:44:07.242 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.e 2024-09-19T04:44:07.661 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:44:07 smithi134 systemd[1]: Stopping Ceph mds.e for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:08.035 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:44:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e[63752]: 2024-09-19T04:44:07.660+0000 7f5f68b8e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:08.035 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:44:07 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e[63752]: 2024-09-19T04:44:07.660+0000 7f5f68b8e640 -1 mds.e *** got signal Terminated *** 2024-09-19T04:44:10.745 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:44:10 smithi134 podman[70853]: 2024-09-19 04:44:10.453213882 +0000 UTC m=+2.995396640 container died 94ad4b08ce3186dac51559df168bda10cb4270a8bdb5cd31178c2de4755c8cf3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, GIT_BRANCH=HEAD) 2024-09-19T04:44:11.035 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:44:10 smithi134 podman[70853]: 2024-09-19 04:44:10.8266824 +0000 UTC m=+3.368865158 container cleanup 94ad4b08ce3186dac51559df168bda10cb4270a8bdb5cd31178c2de4755c8cf3 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-09-19T04:44:11.035 INFO:journalctl@ceph.mds.e.smithi134.stdout:Sep 19 04:44:10 smithi134 bash[70853]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-e 2024-09-19T04:44:11.192 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.e.service' 2024-09-19T04:44:11.226 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:11.227 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-09-19T04:44:11.227 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-09-19T04:44:11.227 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.h 2024-09-19T04:44:11.558 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:44:11 smithi134 systemd[1]: Stopping Ceph mds.h for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:12.035 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:44:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h[64054]: 2024-09-19T04:44:11.556+0000 7fe3891a0640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:12.035 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:44:11 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h[64054]: 2024-09-19T04:44:11.556+0000 7fe3891a0640 -1 mds.h *** got signal Terminated *** 2024-09-19T04:44:14.748 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:44:14 smithi134 podman[70972]: 2024-09-19 04:44:14.457831798 +0000 UTC m=+3.015812507 container died 47d6773c6ecba519ba9c1acf17edf6014a089c7e4bca7c06d641657f6cc0e504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23) 2024-09-19T04:44:15.035 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:44:14 smithi134 podman[70972]: 2024-09-19 04:44:14.82983188 +0000 UTC m=+3.387812590 container cleanup 47d6773c6ecba519ba9c1acf17edf6014a089c7e4bca7c06d641657f6cc0e504 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4) 2024-09-19T04:44:15.035 INFO:journalctl@ceph.mds.h.smithi134.stdout:Sep 19 04:44:14 smithi134 bash[70972]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-h 2024-09-19T04:44:15.258 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.h.service' 2024-09-19T04:44:15.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:15.291 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-09-19T04:44:15.291 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-09-19T04:44:15.291 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.k 2024-09-19T04:44:15.609 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 19 04:44:15 smithi134 systemd[1]: Stopping Ceph mds.k for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:15.997 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 19 04:44:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-k[63439]: 2024-09-19T04:44:15.608+0000 7f76cdec2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:15.997 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 19 04:44:15 smithi134 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-k[63439]: 2024-09-19T04:44:15.608+0000 7f76cdec2640 -1 mds.k *** got signal Terminated *** 2024-09-19T04:44:17.218 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 19 04:44:16 smithi134 podman[71091]: 2024-09-19 04:44:16.946102698 +0000 UTC m=+1.443132450 container died ef11b2d346f090f21219968ef0aa5233d9a8234ff4246a8dcb63d4b4d158318b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-k, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.37.2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-09-19T04:44:17.535 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 19 04:44:17 smithi134 podman[71091]: 2024-09-19 04:44:17.317112662 +0000 UTC m=+1.814142414 container cleanup ef11b2d346f090f21219968ef0aa5233d9a8234ff4246a8dcb63d4b4d158318b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-k, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.37.2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-2f599a4, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-09-19T04:44:17.535 INFO:journalctl@ceph.mds.k.smithi134.stdout:Sep 19 04:44:17 smithi134 bash[71091]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-k 2024-09-19T04:44:17.691 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.k.service' 2024-09-19T04:44:17.723 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:17.723 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-09-19T04:44:17.723 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-09-19T04:44:17.723 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.c 2024-09-19T04:44:18.049 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:44:17 smithi167 systemd[1]: Stopping Ceph mds.c for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:18.414 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:44:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c[64282]: 2024-09-19T04:44:18.046+0000 7f449ad36640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:18.414 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:44:18 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c[64282]: 2024-09-19T04:44:18.046+0000 7f449ad36640 -1 mds.c *** got signal Terminated *** 2024-09-19T04:44:22.340 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:44:22 smithi167 podman[71125]: 2024-09-19 04:44:22.06237411 +0000 UTC m=+4.147920391 container died d11fa244cb39eac06b4540db4b097cb963a95bcf0a0d00bca01144e175988edd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c, RELEASE=squid-2f599a4, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-09-19T04:44:22.710 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:44:22 smithi167 podman[71125]: 2024-09-19 04:44:22.413983343 +0000 UTC m=+4.499529623 container cleanup d11fa244cb39eac06b4540db4b097cb963a95bcf0a0d00bca01144e175988edd (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-2f599a4, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-09-19T04:44:22.711 INFO:journalctl@ceph.mds.c.smithi167.stdout:Sep 19 04:44:22 smithi167 bash[71125]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-c 2024-09-19T04:44:22.899 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.c.service' 2024-09-19T04:44:22.935 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:22.935 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-09-19T04:44:22.935 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-09-19T04:44:22.935 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.f 2024-09-19T04:44:23.461 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:44:23 smithi167 systemd[1]: Stopping Ceph mds.f for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:23.461 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:44:23 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f[63985]: 2024-09-19T04:44:23.251+0000 7f6119081640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:23.461 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:44:23 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f[63985]: 2024-09-19T04:44:23.251+0000 7f6119081640 -1 mds.f *** got signal Terminated *** 2024-09-19T04:44:26.710 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:44:26 smithi167 podman[71257]: 2024-09-19 04:44:26.448775696 +0000 UTC m=+3.296017441 container died 4a0ecc9ccf6845bbcb79d00e0d83bd196a300aa15eb9bf72057af36ce49ea27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.37.2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.build-date=20240731) 2024-09-19T04:44:27.069 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:44:26 smithi167 podman[71257]: 2024-09-19 04:44:26.801061453 +0000 UTC m=+3.648303189 container cleanup 4a0ecc9ccf6845bbcb79d00e0d83bd196a300aa15eb9bf72057af36ce49ea27d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image) 2024-09-19T04:44:27.069 INFO:journalctl@ceph.mds.f.smithi167.stdout:Sep 19 04:44:26 smithi167 bash[71257]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-f 2024-09-19T04:44:27.222 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.f.service' 2024-09-19T04:44:27.255 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:27.255 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-09-19T04:44:27.255 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-09-19T04:44:27.255 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.i 2024-09-19T04:44:27.710 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:27 smithi167 systemd[1]: Stopping Ceph mds.i for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:27.710 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:27 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i[64582]: 2024-09-19T04:44:27.570+0000 7f6b83779640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:27.710 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:27 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i[64582]: 2024-09-19T04:44:27.570+0000 7f6b83779640 -1 mds.i *** got signal Terminated *** 2024-09-19T04:44:30.707 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:30 smithi167 podman[71377]: 2024-09-19 04:44:30.451214856 +0000 UTC m=+2.984279047 container died eef0be9bfff3a9623bb4472e47e30f507f42763286c7d1fa179055aafd66cefc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, RELEASE=squid-2f599a4, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , io.buildah.version=1.37.2, ceph=True, org.label-schema.schema-version=1.0) 2024-09-19T04:44:30.960 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:30 smithi167 podman[71377]: 2024-09-19 04:44:30.787890992 +0000 UTC m=+3.320955182 container cleanup eef0be9bfff3a9623bb4472e47e30f507f42763286c7d1fa179055aafd66cefc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.37.2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, maintainer=Guillaume Abrioux , RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-09-19T04:44:30.961 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:30 smithi167 bash[71377]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i 2024-09-19T04:44:31.219 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.i.service' 2024-09-19T04:44:31.241 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:30 smithi167 podman[71391]: 2024-09-19 04:44:30.989290618 +0000 UTC m=+0.531731971 container remove eef0be9bfff3a9623bb4472e47e30f507f42763286c7d1fa179055aafd66cefc (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-i, RELEASE=squid-2f599a4, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.37.2, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-09-19T04:44:31.241 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:31 smithi167 systemd[1]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.i.service: Deactivated successfully. 2024-09-19T04:44:31.241 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:31 smithi167 systemd[1]: Stopped Ceph mds.i for 7f15b24a-763e-11ef-bceb-c7b262605968. 2024-09-19T04:44:31.241 INFO:journalctl@ceph.mds.i.smithi167.stdout:Sep 19 04:44:31 smithi167 systemd[1]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.i.service: Consumed 1min 38.355s CPU time. 2024-09-19T04:44:31.252 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:31.252 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-09-19T04:44:31.252 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-09-19T04:44:31.252 DEBUG:teuthology.orchestra.run.smithi167:> sudo systemctl stop ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.l 2024-09-19T04:44:31.584 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:44:31 smithi167 systemd[1]: Stopping Ceph mds.l for 7f15b24a-763e-11ef-bceb-c7b262605968... 2024-09-19T04:44:31.960 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:44:31 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l[63687]: 2024-09-19T04:44:31.583+0000 7f75a43f5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-09-19T04:44:31.961 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:44:31 smithi167 ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l[63687]: 2024-09-19T04:44:31.583+0000 7f75a43f5640 -1 mds.l *** got signal Terminated *** 2024-09-19T04:44:34.575 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:44:34 smithi167 podman[71500]: 2024-09-19 04:44:34.247174694 +0000 UTC m=+2.771768449 container died 3c554b56acb65223331d5c61d66f5c19d68b3521fd142c340295927c255927a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l, ceph=True, RELEASE=squid-2f599a4, GIT_BRANCH=HEAD, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.37.2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, maintainer=Guillaume Abrioux ) 2024-09-19T04:44:34.575 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:44:34 smithi167 podman[71500]: 2024-09-19 04:44:34.575079443 +0000 UTC m=+3.099673193 container cleanup 3c554b56acb65223331d5c61d66f5c19d68b3521fd142c340295927c255927a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, io.buildah.version=1.37.2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, RELEASE=squid-2f599a4, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-09-19T04:44:34.960 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:44:34 smithi167 bash[71500]: ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l 2024-09-19T04:44:34.960 INFO:journalctl@ceph.mds.l.smithi167.stdout:Sep 19 04:44:34 smithi167 podman[71514]: 2024-09-19 04:44:34.775894685 +0000 UTC m=+0.523794176 container remove 3c554b56acb65223331d5c61d66f5c19d68b3521fd142c340295927c255927a7 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:ea3a79400324e9054be6f7f19ded2753beeca1d15cbe0b9cab2e816ae9b5fd3e, name=ceph-7f15b24a-763e-11ef-bceb-c7b262605968-mds-l, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=92e6e0d02ffae0030ac4c9454206214b98a73a23, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.37.2, CEPH_POINT_RELEASE=, RELEASE=squid-2f599a4, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux ) 2024-09-19T04:44:34.999 DEBUG:teuthology.orchestra.run.smithi167:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7f15b24a-763e-11ef-bceb-c7b262605968@mds.l.service' 2024-09-19T04:44:35.030 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-09-19T04:44:35.030 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-09-19T04:44:35.031 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T04:44:35.231 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:44:37.571 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T04:44:37.772 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:44:40.211 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 --force --keep-logs 2024-09-19T04:44:40.412 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:44:42.835 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:44:42.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:44:42.900 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-09-19T04:44:42.926 INFO:tasks.cephadm:Archiving crash dumps... 2024-09-19T04:44:42.928 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi070/crash 2024-09-19T04:44:42.929 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash -- . 2024-09-19T04:44:42.956 INFO:teuthology.orchestra.run.smithi070.stderr:tar: /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T04:44:42.957 INFO:teuthology.orchestra.run.smithi070.stderr:tar: Error is not recoverable: exiting now 2024-09-19T04:44:42.958 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi134/crash 2024-09-19T04:44:42.959 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash -- . 2024-09-19T04:44:43.009 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T04:44:43.009 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-09-19T04:44:43.010 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi167/crash 2024-09-19T04:44:43.011 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash -- . 2024-09-19T04:44:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:tar: /var/lib/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/crash: Cannot open: No such file or directory 2024-09-19T04:44:43.052 INFO:teuthology.orchestra.run.smithi167.stderr:tar: Error is not recoverable: exiting now 2024-09-19T04:44:43.053 INFO:tasks.cephadm:Checking cluster log for badness... 2024-09-19T04:44:43.054 DEBUG:teuthology.orchestra.run.smithi070:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'online, but wants' | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-09-19T04:44:43.095 INFO:tasks.cephadm:Compressing logs... 2024-09-19T04:44:43.095 DEBUG:teuthology.orchestra.run.smithi070:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T04:44:43.138 DEBUG:teuthology.orchestra.run.smithi134:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T04:44:43.140 DEBUG:teuthology.orchestra.run.smithi167:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T04:44:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.0.log 2024-09-19T04:44:43.162 INFO:teuthology.orchestra.run.smithi070.stderr:: No such file or directory 2024-09-19T04:44:43.163 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.9.log 2024-09-19T04:44:43.163 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T04:44:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.9.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T04:44:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.a.log 2024-09-19T04:44:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T04:44:43.164 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.a.log 2024-09-19T04:44:43.165 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.g.log 2024-09-19T04:44:43.165 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.6.log 2024-09-19T04:44:43.166 INFO:teuthology.orchestra.run.smithi070.stderr: 84.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T04:44:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T04:44:43.166 INFO:teuthology.orchestra.run.smithi167.stderr:: No such file or directory 2024-09-19T04:44:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T04:44:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.i.log 2024-09-19T04:44:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.c.log 2024-09-19T04:44:43.167 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T04:44:43.168 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.g.log: 90.3% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T04:44:43.168 INFO:teuthology.orchestra.run.smithi070.stderr: 94.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.a.log.gz 2024-09-19T04:44:43.181 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.11.log 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.c.log: /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.2.log 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.11.log: gzip 82.0% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log.gz 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr: -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.5.log 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.l.log 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log: 90.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr: 87.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.8.log 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.z.log 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.8.log: /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.l.log: 94.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.l.log.gz 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.c.log 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.z.log: 91.0% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T04:44:43.182 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.f.log 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr: 94.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.g.log.gz 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.d.log 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.x.log 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.j.log 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.x.log: 87.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr: 94.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.d.log.gz 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr: 90.8% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.3.log 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.log 2024-09-19T04:44:43.183 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T04:44:43.185 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-09-19T04:44:43.185 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.10.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.1.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.7.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.10.log: /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.b.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.k.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.b.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.4.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.k.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log: 90.4% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.audit.log.gz 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.y.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr: 94.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.k.log.gz 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log: 82.0%gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr: -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.cephadm.log.gz/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.y.log: 2024-09-19T04:44:43.186 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.h.log 2024-09-19T04:44:43.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log: 87.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph.log.gz 2024-09-19T04:44:43.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.b.log 2024-09-19T04:44:43.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.h.log: 91.0% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-volume.log.gz 2024-09-19T04:44:43.187 INFO:teuthology.orchestra.run.smithi134.stderr: 91.9% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.y.log.gz 2024-09-19T04:44:43.187 INFO:teuthology.orchestra.run.smithi134.stderr:gzip -5 --verbose -- /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.e.log 2024-09-19T04:44:43.187 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T04:44:43.187 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/ceph-client.0.log: 94.7% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.j.log.gz 2024-09-19T04:44:43.188 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.c.log: 91.9% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.z.log.gz 2024-09-19T04:44:43.189 INFO:teuthology.orchestra.run.smithi167.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-09-19T04:44:43.195 INFO:teuthology.orchestra.run.smithi070.stderr:/var/log/ceph/cephadm.log: 94.5% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T04:44:43.201 INFO:teuthology.orchestra.run.smithi167.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.f.log: /var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T04:44:43.209 INFO:teuthology.orchestra.run.smithi134.stderr:/var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.e.log: /var/log/ceph/cephadm.log: 91.8% -- replaced with /var/log/ceph/cephadm.log.gz 2024-09-19T04:44:43.311 INFO:teuthology.orchestra.run.smithi134.stderr: 93.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.e.log.gz 2024-09-19T04:44:43.365 INFO:teuthology.orchestra.run.smithi167.stderr: 94.2% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.c.log.gz 2024-09-19T04:44:43.426 INFO:teuthology.orchestra.run.smithi070.stderr: 90.3% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mgr.x.log.gz 2024-09-19T04:44:43.620 INFO:teuthology.orchestra.run.smithi167.stderr: 91.7% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.c.log.gz 2024-09-19T04:44:43.645 INFO:teuthology.orchestra.run.smithi134.stderr: 91.7% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.b.log.gz 2024-09-19T04:44:44.347 INFO:teuthology.orchestra.run.smithi134.stderr: 93.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.4.log.gz 2024-09-19T04:44:44.415 INFO:teuthology.orchestra.run.smithi070.stderr: 90.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mon.a.log.gz 2024-09-19T04:44:44.798 INFO:teuthology.orchestra.run.smithi167.stderr: 93.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.8.log.gz 2024-09-19T04:44:44.898 INFO:teuthology.orchestra.run.smithi134.stderr: 93.8% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.b.log.gz 2024-09-19T04:44:44.911 INFO:teuthology.orchestra.run.smithi070.stderr: 93.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.9.log.gz 2024-09-19T04:44:44.912 INFO:teuthology.orchestra.run.smithi134.stderr: 94.2% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.h.log.gz 2024-09-19T04:44:44.930 INFO:teuthology.orchestra.run.smithi070.stderr: 93.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.6.log.gz 2024-09-19T04:44:45.022 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.10.log.gz 2024-09-19T04:44:45.262 INFO:teuthology.orchestra.run.smithi167.stderr: 93.4% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.2.log.gz 2024-09-19T04:44:45.301 INFO:teuthology.orchestra.run.smithi134.stderr: 93.4% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.1.log.gz 2024-09-19T04:44:45.572 INFO:teuthology.orchestra.run.smithi134.stderr: 93.6% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.7.log.gz 2024-09-19T04:44:45.574 INFO:teuthology.orchestra.run.smithi134.stderr: 2024-09-19T04:44:45.574 INFO:teuthology.orchestra.run.smithi134.stderr:real 0m2.419s 2024-09-19T04:44:45.574 INFO:teuthology.orchestra.run.smithi134.stderr:user 0m11.298s 2024-09-19T04:44:45.574 INFO:teuthology.orchestra.run.smithi134.stderr:sys 0m0.367s 2024-09-19T04:44:45.585 INFO:teuthology.orchestra.run.smithi070.stderr: 93.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.0.log.gz 2024-09-19T04:44:45.605 INFO:teuthology.orchestra.run.smithi167.stderr: 93.7% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.11.log.gz 2024-09-19T04:44:45.741 INFO:teuthology.orchestra.run.smithi070.stderr: 93.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.3.log.gz 2024-09-19T04:44:45.897 INFO:teuthology.orchestra.run.smithi167.stderr: 95.7% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.f.log.gz 2024-09-19T04:44:45.931 INFO:teuthology.orchestra.run.smithi167.stderr: 93.5% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-osd.5.log.gz 2024-09-19T04:44:55.312 INFO:teuthology.orchestra.run.smithi070.stderr: 93.9% -- replaced with /var/log/ceph/ceph-client.0.log.gz 2024-09-19T04:44:55.314 INFO:teuthology.orchestra.run.smithi070.stderr: 2024-09-19T04:44:55.314 INFO:teuthology.orchestra.run.smithi070.stderr:real 0m12.163s 2024-09-19T04:44:55.315 INFO:teuthology.orchestra.run.smithi070.stderr:user 0m21.374s 2024-09-19T04:44:55.315 INFO:teuthology.orchestra.run.smithi070.stderr:sys 0m0.798s 2024-09-19T04:45:21.002 INFO:teuthology.orchestra.run.smithi167.stderr: 93.4% -- replaced with /var/log/ceph/7f15b24a-763e-11ef-bceb-c7b262605968/ceph-mds.i.log.gz 2024-09-19T04:45:21.004 INFO:teuthology.orchestra.run.smithi167.stderr: 2024-09-19T04:45:21.004 INFO:teuthology.orchestra.run.smithi167.stderr:real 0m37.848s 2024-09-19T04:45:21.004 INFO:teuthology.orchestra.run.smithi167.stderr:user 0m48.535s 2024-09-19T04:45:21.004 INFO:teuthology.orchestra.run.smithi167.stderr:sys 0m1.540s 2024-09-19T04:45:21.005 INFO:tasks.cephadm:Archiving logs... 2024-09-19T04:45:21.005 DEBUG:teuthology.misc:Transferring archived files from smithi070:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi070/log 2024-09-19T04:45:21.006 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T04:45:24.157 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi134/log 2024-09-19T04:45:24.158 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T04:45:25.547 DEBUG:teuthology.misc:Transferring archived files from smithi167:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi167/log 2024-09-19T04:45:25.547 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T04:45:32.561 INFO:tasks.cephadm:Removing cluster... 2024-09-19T04:45:32.561 DEBUG:teuthology.orchestra.run.smithi070:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 --force 2024-09-19T04:45:32.762 INFO:teuthology.orchestra.run.smithi070.stdout:Deleting cluster with fsid: 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:45:33.037 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 --force 2024-09-19T04:45:33.240 INFO:teuthology.orchestra.run.smithi134.stdout:Deleting cluster with fsid: 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:45:33.503 DEBUG:teuthology.orchestra.run.smithi167:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7f15b24a-763e-11ef-bceb-c7b262605968 --force 2024-09-19T04:45:33.705 INFO:teuthology.orchestra.run.smithi167.stdout:Deleting cluster with fsid: 7f15b24a-763e-11ef-bceb-c7b262605968 2024-09-19T04:45:34.107 INFO:tasks.cephadm:Removing cephadm ... 2024-09-19T04:45:34.107 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T04:45:34.123 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T04:45:34.140 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf /home/ubuntu/cephtest/cephadm 2024-09-19T04:45:34.156 INFO:tasks.cephadm:Teardown complete 2024-09-19T04:45:34.156 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T04:45:34.170 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T04:45:34.170 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T04:45:34.172 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T04:45:34.184 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T04:45:34.284 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T04:45:34.295 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T04:45:34.295 DEBUG:teuthology.orchestra.run.smithi070:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:45:34.298 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:45:34.300 DEBUG:teuthology.orchestra.run.smithi167:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T04:45:34.309 INFO:teuthology.orchestra.run.smithi070.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:45:34.312 INFO:teuthology.orchestra.run.smithi134.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:45:34.314 INFO:teuthology.orchestra.run.smithi070.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:45:34.314 INFO:teuthology.orchestra.run.smithi070.stdout:=============================================================================== 2024-09-19T04:45:34.314 INFO:teuthology.orchestra.run.smithi070.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 +16us[ +39us] +/- 48ms 2024-09-19T04:45:34.314 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 +106us[ +128us] +/- 78ms 2024-09-19T04:45:34.314 INFO:teuthology.orchestra.run.smithi070.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 59 -132us[ -110us] +/- 86ms 2024-09-19T04:45:34.314 INFO:teuthology.orchestra.run.smithi070.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:45:34.315 INFO:teuthology.orchestra.run.smithi167.stderr:bash: line 1: ntpq: command not found 2024-09-19T04:45:34.317 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:45:34.317 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-09-19T04:45:34.317 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv01.front.sepia.ceph.com 3 6 377 57 +10us[ +25us] +/- 48ms 2024-09-19T04:45:34.317 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 55 +102us[ +102us] +/- 78ms 2024-09-19T04:45:34.317 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 54 -133us[ -133us] +/- 86ms 2024-09-19T04:45:34.317 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:45:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T04:45:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:=============================================================================== 2024-09-19T04:45:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:^* hv01.front.sepia.ceph.com 3 6 377 54 +15us[ +22us] +/- 48ms 2024-09-19T04:45:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 57 +120us[ +127us] +/- 78ms 2024-09-19T04:45:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 57 -134us[ -127us] +/- 86ms 2024-09-19T04:45:34.319 INFO:teuthology.orchestra.run.smithi167.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T04:45:34.320 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T04:45:34.331 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T04:45:34.331 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T04:45:34.360 DEBUG:teuthology.orchestra.run.smithi070:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T04:45:34.441 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T04:45:34.509 DEBUG:teuthology.orchestra.run.smithi167:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T04:45:34.578 DEBUG:teuthology.orchestra.run.smithi070:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:45:34.606 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:45:34.606 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:45:34.633 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:45:34.634 DEBUG:teuthology.orchestra.run.smithi167:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-09-19T04:45:34.662 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:45:34.662 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T04:45:34.673 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T04:45:34.719 INFO:teuthology.task.internal:Duration was 1846.469542 seconds 2024-09-19T04:45:34.719 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T04:45:34.752 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T04:45:34.753 DEBUG:teuthology.orchestra.run.smithi070:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T04:45:34.755 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T04:45:34.758 DEBUG:teuthology.orchestra.run.smithi167:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T04:45:34.792 INFO:teuthology.orchestra.run.smithi070.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:45:34.794 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:45:34.796 INFO:teuthology.orchestra.run.smithi167.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T04:45:35.257 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T04:45:35.258 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi070.front.sepia.ceph.com 2024-09-19T04:45:35.258 DEBUG:teuthology.orchestra.run.smithi070:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T04:45:35.279 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-09-19T04:45:35.279 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T04:45:35.311 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi167.front.sepia.ceph.com 2024-09-19T04:45:35.311 DEBUG:teuthology.orchestra.run.smithi167:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T04:45:35.341 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T04:45:35.341 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T04:45:35.343 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T04:45:35.353 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T04:45:35.407 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T04:45:35.408 DEBUG:teuthology.orchestra.run.smithi070:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T04:45:35.410 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T04:45:35.420 DEBUG:teuthology.orchestra.run.smithi167:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T04:45:36.746 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T04:45:36.757 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T04:45:36.757 DEBUG:teuthology.orchestra.run.smithi070:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T04:45:36.782 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T04:45:36.812 DEBUG:teuthology.orchestra.run.smithi167:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T04:45:36.843 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T04:45:36.855 DEBUG:teuthology.orchestra.run.smithi070:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:45:36.858 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:45:36.860 DEBUG:teuthology.orchestra.run.smithi167:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:45:36.878 INFO:teuthology.orchestra.run.smithi070.stdout:kernel.core_pattern = core 2024-09-19T04:45:36.885 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-09-19T04:45:36.909 INFO:teuthology.orchestra.run.smithi167.stdout:kernel.core_pattern = core 2024-09-19T04:45:36.952 DEBUG:teuthology.orchestra.run.smithi070:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:45:36.967 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:45:36.967 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:45:36.982 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:45:36.983 DEBUG:teuthology.orchestra.run.smithi167:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T04:45:37.008 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T04:45:37.009 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T04:45:37.021 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T04:45:37.022 DEBUG:teuthology.misc:Transferring archived files from smithi070:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi070 2024-09-19T04:45:37.022 DEBUG:teuthology.orchestra.run.smithi070:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T04:45:37.083 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi134 2024-09-19T04:45:37.083 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T04:45:37.124 DEBUG:teuthology.misc:Transferring archived files from smithi167:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-09-18_21:24:17-fs-squid-distro-default-smithi/7911631/remote/smithi167 2024-09-19T04:45:37.124 DEBUG:teuthology.orchestra.run.smithi167:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T04:45:37.163 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T04:45:37.163 DEBUG:teuthology.orchestra.run.smithi070:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T04:45:37.165 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T04:45:37.168 DEBUG:teuthology.orchestra.run.smithi167:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T04:45:37.213 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T04:45:37.227 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T04:45:37.228 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T04:45:37.252 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T04:45:37.252 DEBUG:teuthology.orchestra.run.smithi070:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T04:45:37.255 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T04:45:37.257 DEBUG:teuthology.orchestra.run.smithi167:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T04:45:37.267 INFO:teuthology.orchestra.run.smithi070.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 04:45 /home/ubuntu/cephtest 2024-09-19T04:45:37.271 INFO:teuthology.orchestra.run.smithi134.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 04:45 /home/ubuntu/cephtest 2024-09-19T04:45:37.274 INFO:teuthology.orchestra.run.smithi167.stdout: 262169 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 04:45 /home/ubuntu/cephtest 2024-09-19T04:45:37.275 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T04:45:37.286 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T04:45:37.357 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/fuse objectstore-ec/bluestore-bitmap omap_limit/10 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/random export-check n/3 replication/always} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/no 5-quiesce/no 6-workunit/fs/norstats}} duration: 1846.4695417881012 flavor: default owner: scheduled_teuthology@teuthology success: true 2024-09-19T04:45:37.357 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T04:45:37.448 INFO:teuthology.run:pass